CN106504335A - Realization method and system based on 2D, 3D mixing augmented reality of mobile device - Google Patents
Realization method and system based on 2D, 3D mixing augmented reality of mobile device Download PDFInfo
- Publication number
- CN106504335A CN106504335A CN201610966656.8A CN201610966656A CN106504335A CN 106504335 A CN106504335 A CN 106504335A CN 201610966656 A CN201610966656 A CN 201610966656A CN 106504335 A CN106504335 A CN 106504335A
- Authority
- CN
- China
- Prior art keywords
- drawings
- mobile device
- module
- augmented reality
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention discloses a kind of realization method and system of 2D, 3D mixing augmented reality based on mobile device, its system, including：2D management of blueprint servers, for managing and configuring；2D drawing identifying devices, for recognizing 2D drawings；2D/3D data mixing visualization devices, for realizing that the 2D/3D data mixings based on mobile device are visualized；The present invention based on mobile device 2D, 3D mixing augmented reality realize system by mobile device video be designed drawing identification without being marked to drawing, and in order to recognize design drawing, extracting boundary point from video image is used for determining 2D drawings region, characteristic point in due to whole image is extracted according to the display degree in 2D drawings region coupling, amount of calculation is much smaller than existing matching way, and discrimination is greatly improved.
Description
Technical field
The present invention relates to 2D/3D mixing augmented realities field, more particularly to a kind of 2D, 3D based on mobile device is mixed
Close the realization method and system of augmented reality.
Background technology
As augmented reality can strengthen reality immersion sense, therefore it is widely used in including including power equipment manufacture
Industry-by-industry.Because the expression of two-dimensional design drawing information is not directly, to equipment designer, between engineer and manufacturer
Exchange, understanding cause certain difficulty, and the therefore 2D drawings 3D virtualizations based on augmented reality show by more and more
Concern, the implementation amount of calculation of existing 2D, 3D mixing augmented reality is larger, and discrimination is not high.
Content of the invention
The technical problem to be solved in the present invention is to provide a kind of realization of 2D, 3D mixing augmented reality based on mobile device
Method and system.
It is an object of the invention to provide a kind of implementation method of 2D, 3D mixing augmented reality based on mobile device, bag
Include：
2D managements of blueprint server admin and configuration；
2D drawings identifying device recognizes 2D drawings；
2D/3D data mixings visualization device realizes that the 2D/3D data mixings based on mobile device are visualized.
Wherein, the 2D managements of blueprint server admin and configuration, including：
The 2D managements of blueprint server, including 2D management of blueprint server configures modules, 2D drawing information management modules,
Feature Points Matching and enquiry module；
The 2D managements of blueprint server configures module stores are corresponding with management video image, characteristic point and 2D drawings
3D models, search the 2D drawings related to the characteristic point data for coming from mobile device, transmission 2D drawing informations and 3D models；
Information in the 2D drawing informations management module management 2D drawings, manages all of auxiliary information, authorized user's energy
Enough manage which and authorize the information for accessing, manage the information of all images that uses in augmented reality；
The Feature Points Matching and enquiry module, after mobile device obtains associated picture, based on database D B management system
Information in system carries out the coupling of characteristic point and inquiry, and lookup result is exported in the form of expandable mark language XML.
Wherein, the 2D managements of blueprint server admin and configuration, also include：
Drawing model library, the corresponding 3D models of storage 2D drawings.
Wherein, the 2D drawings identifying device recognizes 2D drawings, including：2D drawing characteristic point datas storehouse, 2D drawings region
Detection module, the feature point module for extracting 2D drawings, 2D drawing Feature Points Matching modules；
The 2D drawings characteristic point data storehouse preserves 2D line drawings, characteristic point data, 3D models；
The 2D drawings region detection module detects the effective drawing region of rectangle, including：
The 2D drawings region detection module moves the denoising of equipment drawing picture from downward extended mode is extended up；
Using interaction area profile algorithm, border detection is carried out by adjusting threshold value, by approaching these indexs, generated
Rectangular area, and calculate its corresponding apex coordinate；
The feature point module of the extraction 2D drawings after the rectangular active area for extracting 2D drawings, then in the rectangular area
Feature point extraction is inside carried out；
The 2D drawings Feature Points Matching module is mated in data base to the characteristic feature point data for extracting.
Wherein, the 2D/3D data mixings visualization device realizes that the 2D/3D data mixings based on mobile device are visual
Change, including：
2D/3D data mixing visualization devices, at 3D model geometric modular converters, the 3D model consistencies of 2D drawings
Reason module；
When known to 4 coordinates of the 3D model geometrics modular converter in 2D drawings rectangular area, the rotation to 2D drawings
Position is calculated based on photographic head coordinate system with posture, and photographic head coordinate system will be from 2D drawing region of interest ROI
Obtain；
Actual drawing is overlapped by the 3D model consistencies processing module of the 2D drawings with virtuality 3D figures, by connecing
Video image in the graphics system frame buffer of receipts, is carried out in specified location after the depth value and 3D drawings coupling for carrying out 3D models
Overlap and show.
It is an object of the invention to also provide a kind of 2D, 3D mixing augmented reality based on mobile device realizes system,
Including：2D management of blueprint servers, 2D drawing identifying devices, 2D/3D data mixing visualization devices；
The 2D managements of blueprint server, for managing and configuring；
The 2D drawings identifying device, for recognizing 2D drawings；
The 2D/3D data mixings visualization device, visual for realizing the 2D/3D data mixings based on mobile device
Change.
Wherein, the 2D managements of blueprint server, including：
Management of blueprint server configures module, 2D drawing information management modules, Feature Points Matching and enquiry module；
The management of blueprint server configures module, for storage and management video image, characteristic point and 2D drawings pair
The 3D models that answers, search the 2D drawings related to the characteristic point data for coming from mobile device, transmission 2D drawing informations and 3D
Model；
The 2D drawing informations management module, for managing information in 2D drawings, manages all of auxiliary information, authorizes and use
Family can manage which and authorize the information for accessing, and manage the information of all images that uses in augmented reality；
The Feature Points Matching and enquiry module, for, after mobile device obtains associated picture, being managed based on database D B
Information in reason system carries out the coupling of characteristic point and inquiry, and lookup result is exported in the form of expandable mark language XML.
Wherein, the 2D managements of blueprint server, also includes：
Drawing model library, for storing the corresponding 3D models of 2D drawings.
Wherein, the 2D drawings identifying device, including：
2D drawing characteristic point datas storehouse, 2D drawing region detection modules, the feature point module for extracting 2D drawings, 2D drawings are special
Levy Point matching module；
The 2D drawings characteristic point data storehouse, for preserving 2D line drawings, characteristic point data, 3D models；
The 2D drawings region detection module, for detecting the effective drawing region of rectangle, including：
The 2D drawings region detection module moves the denoising of equipment drawing picture from downward extended mode is extended up；
Using interaction area profile algorithm, border detection is carried out by adjusting threshold value, by approaching these indexs, generated
Rectangular area, and calculate its corresponding apex coordinate；
The feature point module of the extraction 2D drawings, for after the rectangular active area for extracting 2D drawings, then in the square
Feature point extraction is carried out in shape region；
The 2D drawings Feature Points Matching module, is carried out in data base for the characteristic feature point data to extracting
Match somebody with somebody.
Wherein, the 2D/3D data mixings visualization device, including：
3D model geometric modular converters, the 3D model consistency processing modules of 2D drawings；
The 3D model geometrics modular converter, for when known to 4 coordinates in 2D drawings rectangular area, to 2D drawings
Rotation position is calculated based on photographic head coordinate system with posture, and photographic head coordinate system will be from 2D drawing area-of-interests
Obtain in ROI；
The 3D model consistency processing modules of the 2D drawings, for actual drawing is overlapped with virtuality 3D figures,
By receive graphics system frame buffer in video image, carry out 3D models depth value and 3D drawings coupling after in specific bit
Putting carries out overlap displaying.
The implementation method of 2D, 3D mixing augmented reality based on mobile device that the present invention is provided, including：2D managements of blueprint
Server admin and configuration；2D drawings identifying device recognizes 2D drawings；2D/3D data mixings visualization device is realized based on movement
The 2D/3D data mixings visualization of equipment；The present invention is passed through based on the implementation method of 2D, 3D mixing augmented reality of mobile device
Mobile device video is designed drawing identification without being marked to drawing, and in order to recognize design drawing, from video
Extracting boundary point in image is used for determining 2D drawings region, due to whole image in characteristic point be according to the aobvious of 2D drawings region
Indication coupling is extracted, and amount of calculation is much smaller than existing matching way, and discrimination is greatly improved.
2D, 3D mixing augmented reality based on mobile device that the present invention is provided realizes system, including：2D managements of blueprint
Server, 2D drawing identifying devices, 2D/3D data mixing visualization devices；2D management of blueprint servers, for managing and matching somebody with somebody
Put；2D drawing identifying devices, for recognizing 2D drawings；2D/3D data mixing visualization devices, for realizing being based on mobile device
2D/3D data mixings visualization；The present invention based on mobile device 2D, 3D mixing augmented reality realize system by move
Equipment video is designed drawing identification without being marked to drawing, and in order to recognize design drawing, from video image
Middle extraction boundary point is used for determining 2D drawings region, due to whole image in characteristic point be display degree according to 2D drawings region
Coupling is extracted, and amount of calculation is much smaller than existing matching way, and discrimination is greatly improved.
Description of the drawings
Fig. 1, is schematic diagram of the present invention based on the implementation method of 2D, 3D mixing augmented reality of mobile device；
Fig. 2, is the schematic diagram of realizing system of the present invention based on 2D, 3D mixing augmented reality of mobile device.
Specific embodiment
The present invention provides a kind of realization method and system of 2D, 3D mixing augmented reality based on mobile device, is applied to
2D/3D mixing augmented realities field, implementation method of the present invention based on 2D, 3D mixing augmented reality of mobile device, bag
Include：2D managements of blueprint server admin and configuration；2D drawings identifying device recognizes 2D drawings；2D/3D data mixings are visually disguised
Put and realize that the 2D/3D data mixings based on mobile device are visualized；2D, 3D mixing augmented reality of the present invention based on mobile device
Implementation method drawing identification is designed without being marked to drawing by mobile device video, and set to recognize
Meter drawing, from video image extract boundary point be used for determine 2D drawings region, due to whole image in characteristic point be basis
The display degree coupling in 2D drawings region is extracted, and amount of calculation is much smaller than existing matching way, and discrimination is greatly improved.
In order that the objects, technical solutions and advantages of the present invention become more apparent, below in conjunction with drawings and Examples, right
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only in order to explain the present invention, and
It is not used in the restriction present invention.
The present invention provides a kind of implementation method of 2D, 3D mixing augmented reality based on mobile device.
Fig. 1 is referred to, Fig. 1 is signal of the present invention based on the implementation method of 2D, 3D mixing augmented reality of mobile device
Figure, implementation method of the present invention based on 2D, 3D mixing augmented reality of mobile device, including：
S11,2D management of blueprint server admin and configuration；
S12,2D drawing identifying device recognizes 2D drawings；
S13,2D/3D data mixing visualization device realizes that the 2D/3D data mixings based on mobile device are visualized.
Wherein, 2D managements of blueprint server admin and configuration, including：
2D management of blueprint servers, including 2D management of blueprint server configures modules, 2D drawing information management modules, feature
Point matching and enquiry module；
2D management of blueprint server configures module stores 3D moulds corresponding with management video image, characteristic point and 2D drawings
Type, searches the 2D drawings related to the characteristic point data for coming from mobile device, transmission 2D drawing informations and 3D models；
Information in 2D drawing informations management module management 2D drawings, manages all of auxiliary information, and authorized user can manage
Manage which and authorize the information for accessing, manage the information of all images that uses in augmented reality；
Feature Points Matching and enquiry module, after mobile device obtains associated picture, based on data base (DB) management system
In information carry out coupling and the inquiry of characteristic point, lookup result is exported in the form of extensible markup language (XML).
Wherein, 2D managements of blueprint server admin and configuration, also include：
2D managements of blueprint server admin and configuration, also include drawing model library, the corresponding 3D models of storage 2D drawings.
Wherein, 2D drawings identifying device identification 2D drawings, including：
2D drawing identifying devices, including 2D drawing characteristic point datas storehouse, 2D drawing region detection modules, extract 2D drawings
Feature point module, 2D drawing Feature Points Matching modules；
2D drawing characteristic point datas storehouse preserves 2D line drawings, characteristic point data, 3D models；
The effective drawing region of 2D drawings region detection module detection rectangle, including：
2D drawings region detection module moves the denoising of equipment drawing picture from downward extended mode is extended up；
Using interaction area profile algorithm, border detection is carried out by adjusting threshold value, by approaching these indexs, generated
Rectangular area, and calculate its corresponding apex coordinate；
The feature point module of 2D drawings is extracted after the rectangular active area for extracting 2D drawings, then is entered in the rectangular area
Row feature point extraction；
2D drawing Feature Points Matchings module is mated in data base to the characteristic feature point data for extracting；Due to movement
The disposal ability and rate limitation of equipment, this method carry out Feature Points Matching using acceleration robust features (SURF) algorithm.
Wherein, 2D/3D data mixings visualization device realizes that the 2D/3D data mixings based on mobile device are visualized, bag
Include：
2D/3D data mixing visualization devices, at 3D model geometric modular converters, the 3D model consistencies of 2D drawings
Reason module；
When known to 4 coordinates of the 3D model geometrics modular converter in 2D drawings rectangular area, the rotation position to 2D drawings
Calculated based on photographic head coordinate system with posture, photographic head coordinate system will be obtained from 2D drawing area-of-interests (ROI)
Take；
Actual drawing is overlapped by the 3D model consistencies processing module of 2D drawings with virtuality 3D figures, by received
Video image in graphics system frame buffer, is overlapped in specified location after the depth value and 3D drawings coupling for carrying out 3D models
Show.
What the present invention also provided a kind of 2D, 3D mixing augmented reality based on mobile device realizes system.
Fig. 2 is referred to, Fig. 2 is the signal of realizing system of the present invention based on 2D, 3D mixing augmented reality of mobile device
Figure, the present invention realize system 20 based on 2D, 3D mixing augmented reality of mobile device, including：2D management of blueprint servers
201st, 2D drawings identifying device 202,2D/3D data mixings visualization device 203；
2D managements of blueprint server 201, for managing and configuring；
2D drawings identifying device 202, for recognizing 2D drawings；
2D/3D data mixings visualization device 203, for realizing that the 2D/3D data mixings based on mobile device are visualized.
Wherein, 2D managements of blueprint server 201, including：
Management of blueprint server configures module 2011,2D drawing informations management module 2012, Feature Points Matching and inquiry mould
Block 2013；
Management of blueprint server configures module 2011, for storage and management video image, characteristic point and 2D drawings pair
The 3D models that answers, search the 2D drawings related to the characteristic point data for coming from mobile device, transmission 2D drawing informations and 3D
Model；
2D drawing informations management module 2012, for managing information in 2D drawings, manages all of auxiliary information, authorizes and use
Family can manage which and authorize the information for accessing, and manage the information of all images that uses in augmented reality；
Feature Points Matching and enquiry module 2013, for, after mobile device obtains associated picture, being managed based on database D B
Information in reason system carries out the coupling of characteristic point and inquiry, and lookup result is exported in the form of expandable mark language XML.
Wherein, 2D managements of blueprint server 201, also includes：
Drawing model library (is not indicated in figure), for storing the corresponding 3D models of 2D drawings.
Wherein, 2D drawings identifying device 202, including：
2D drawing characteristic point datas storehouse 2021,2D drawings region detection module 2022, the feature point module for extracting 2D drawings
2023rd, 2D drawings Feature Points Matching module 2024；
2D drawing characteristic point datas storehouse 2021, for preserving 2D line drawings, characteristic point data, 3D models；
2D drawings region detection module 2022, for detecting the effective drawing region of rectangle, including：
2D drawings region detection module 2022 moves the denoising of equipment drawing picture from downward extended mode is extended up；
Using interaction area profile algorithm, border detection is carried out by adjusting threshold value, by approaching these indexs, generated
Rectangular area, and calculate its corresponding apex coordinate；
The feature point module 2023 of 2D drawings is extracted, for after the rectangular active area for extracting 2D drawings, then in the square
Feature point extraction is carried out in shape region；
2D drawing Feature Points Matchings module 2024, is carried out in data base for the characteristic feature point data to extracting
Match somebody with somebody；Due to the disposal ability and rate limitation of mobile device, this method carries out characteristic point using acceleration robust features SURF algorithm
Coupling.
Wherein, 2D/3D data mixings visualization device 203, including：
The 3D model consistencies processing module 2032 of 3D model geometrics modular converter 2031,2D drawings；
3D model geometrics modular converter 2031, for when known to 4 coordinates in 2D drawings rectangular area, to 2D drawings
Rotation position is calculated based on photographic head coordinate system with posture, and photographic head coordinate system will be from 2D drawing area-of-interests
Obtain in ROI；
The 3D model consistencies processing module 2032 of 2D drawings, for actual drawing is overlapped with virtuality 3D figures,
By receive graphics system frame buffer in video image, carry out 3D models depth value and 3D drawings coupling after in specific bit
Putting carries out overlap displaying.
The implementation method of 2D, 3D mixing augmented reality based on mobile device that the present invention is provided, including：2D managements of blueprint
Server admin and configuration；2D drawings identifying device recognizes 2D drawings；2D/3D data mixings visualization device is realized based on movement
The 2D/3D data mixings visualization of equipment；The present invention is passed through based on the implementation method of 2D, 3D mixing augmented reality of mobile device
Mobile device video is designed drawing identification without being marked to drawing, and in order to recognize design drawing, from video
Extracting boundary point in image is used for determining 2D drawings region, due to whole image in characteristic point be according to the aobvious of 2D drawings region
Indication coupling is extracted, and amount of calculation is much smaller than existing matching way, and discrimination is greatly improved.
2D, 3D mixing augmented reality based on mobile device that the present invention is provided realizes system 20, including：2D drawing pipes
Reason server 201,2D drawings identifying device 202,2D/3D data mixings visualization device 203；2D managements of blueprint server 201,
For managing and configuring；2D drawings identifying device 202, for recognizing 2D drawings；2D/3D data mixings visualization device 203, uses
Visualize in 2D/3D data mixings of the realization based on mobile device；2D, 3D mixing augmented reality of the present invention based on mobile device
Realize that system 20 is designed drawing identification without being marked to drawing by mobile device video, and in order to recognize
Design drawing, from video image extract boundary point be used for determine 2D drawings region, due to whole image in characteristic point be root
Extracted according to the display degree coupling in 2D drawings region, amount of calculation is much smaller than existing matching way, and discrimination is greatly improved.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation are made a distinction with another entity or operation, and are not necessarily required or implied between these entities or operation
There is any this actual relation or order.And, term "comprising", " including " or its any other variant are intended to contain
Lid nonexcludability includes, so that process, method, article or equipment including a factor of system not only includes that those will
Element, but also other key elements including being not expressly set out, or also include for this process, method, article or equipment
Intrinsic key element.In the absence of more restrictions, by sentence " including one,,, " key element that limits, it is not excluded that
Also there is other identical element in process, method, article, equipment or the device for including the key element.
For realization method and system of the present invention based on 2D, 3D mixing augmented reality of mobile device, the form of realization
It is diversified.All any modification, equivalent substitution and improvements that within the spirit and principles in the present invention, is made etc., all should wrap
It is contained within protection scope of the present invention.
Claims (10)
1. a kind of implementation method of 2D, 3D mixing augmented reality based on mobile device, it is characterised in that include：
2D managements of blueprint server admin and configuration；
2D drawings identifying device recognizes 2D drawings；
2D/3D data mixings visualization device realizes that the 2D/3D data mixings based on mobile device are visualized.
2. the implementation method of 2D, 3D mixing augmented reality based on mobile device as claimed in claim 1, it is characterised in that
The 2D managements of blueprint server admin and configuration, including：
The 2D managements of blueprint server, including 2D management of blueprint server configures modules, 2D drawing information management modules, feature
Point matching and enquiry module；
2D managements of blueprint server configures module stores 3D moulds corresponding with management video image, characteristic point and 2D drawings
Type, searches the 2D drawings related to the characteristic point data for coming from mobile device, transmission 2D drawing informations and 3D models；
Information in the 2D drawing informations management module management 2D drawings, manages all of auxiliary information, and authorized user can manage
Manage which and authorize the information for accessing, manage the information of all images that uses in augmented reality；
The Feature Points Matching and enquiry module, when mobile device obtain associated picture after, based on database D B management system in
Information carry out coupling and the inquiry of characteristic point, lookup result is exported in the form of expandable mark language XML.
3. the implementation method of 2D, 3D mixing augmented reality based on mobile device as claimed in claim 2, it is characterised in that
The 2D managements of blueprint server admin and configuration, also include：
Drawing model library, the corresponding 3D models of storage 2D drawings.
4. the implementation method of 2D, 3D mixing augmented reality based on mobile device as claimed in claim 1, it is characterised in that
The 2D drawings identifying device recognizes 2D drawings, including：2D drawing characteristic point datas storehouse, 2D drawing region detection modules, extraction
The feature point module of 2D drawings, 2D drawing Feature Points Matching modules；
The 2D drawings characteristic point data storehouse preserves 2D line drawings, characteristic point data, 3D models；
The 2D drawings region detection module detects the effective drawing region of rectangle, including：
The 2D drawings region detection module moves the denoising of equipment drawing picture from downward extended mode is extended up；
Using interaction area profile algorithm, border detection is carried out by adjusting threshold value, by approaching these indexs, next life is rectangular
Region, and calculate its corresponding apex coordinate；
The feature point module of the extraction 2D drawings is after the rectangular active area for extracting 2D drawings, then enters in the rectangular area
Row feature point extraction；
The 2D drawings Feature Points Matching module is mated in data base to the characteristic feature point data for extracting.
5. the implementation method of 2D, 3D mixing augmented reality based on mobile device as claimed in claim 1, it is characterised in that
The 2D/3D data mixings visualization device realizes that the 2D/3D data mixings based on mobile device are visualized, including：
2D/3D data mixing visualization devices, the 3D model consistencies including 3D model geometric modular converters, 2D drawings process mould
Block；
When known to 4 coordinates of the 3D model geometrics modular converter in 2D drawings rectangular area, the rotation position to 2D drawings
Calculated based on photographic head coordinate system with posture, photographic head coordinate system will be obtained from 2D drawing region of interest ROI；
Actual drawing is overlapped by the 3D model consistencies processing module of the 2D drawings with virtuality 3D figures, by received
Video image in graphics system frame buffer, is overlapped in specified location after the depth value and 3D drawings coupling for carrying out 3D models
Show.
6. a kind of 2D, 3D mixing augmented reality based on mobile device realizes system, it is characterised in that include：2D drawing pipes
Reason server, 2D drawing identifying devices, 2D/3D data mixing visualization devices；
The 2D managements of blueprint server, for managing and configuring；
The 2D drawings identifying device, for recognizing 2D drawings；
The 2D/3D data mixings visualization device, for realizing that the 2D/3D data mixings based on mobile device are visualized.
7. as claimed in claim 6 2D, 3D mixing augmented reality based on mobile device realizes system, it is characterised in that
The 2D managements of blueprint server, including：
Management of blueprint server configures module, 2D drawing information management modules, Feature Points Matching and enquiry module；
The management of blueprint server configures module, corresponding for storage and management video image, characteristic point and 2D drawings
3D models, search the 2D drawings related to the characteristic point data for coming from mobile device, transmission 2D drawing informations and 3D models；
The 2D drawing informations management module, for managing information in 2D drawings, manages all of auxiliary information, authorized user's energy
Enough manage which and authorize the information for accessing, manage the information of all images that uses in augmented reality；
The Feature Points Matching and enquiry module, for after mobile device obtains associated picture, based on database D B management system
Information in system carries out the coupling of characteristic point and inquiry, and lookup result is exported in the form of expandable mark language XML.
8. as claimed in claim 7 2D, 3D mixing augmented reality based on mobile device realizes system, it is characterised in that
The 2D managements of blueprint server, also includes：
Drawing model library, for storing the corresponding 3D models of 2D drawings.
9. as claimed in claim 6 2D, 3D mixing augmented reality based on mobile device realizes system, it is characterised in that
The 2D drawings identifying device, including：
2D drawing characteristic point datas storehouse, 2D drawing region detection modules, the feature point module for extracting 2D drawings, 2D drawing characteristic points
Matching module；
The 2D drawings characteristic point data storehouse, for preserving 2D line drawings, characteristic point data, 3D models；
The 2D drawings region detection module, for detecting the effective drawing region of rectangle, including：
The 2D drawings region detection module moves the denoising of equipment drawing picture from downward extended mode is extended up；
Using interaction area profile algorithm, border detection is carried out by adjusting threshold value, by approaching these indexs, next life is rectangular
Region, and calculate its corresponding apex coordinate；
The feature point module of the extraction 2D drawings, for after the rectangular active area for extracting 2D drawings, then in the rectangle region
Feature point extraction is carried out in domain；
The 2D drawings Feature Points Matching module, mates in data base for the characteristic feature point data to extracting.
10. as claimed in claim 6 2D, 3D mixing augmented reality based on mobile device realizes system, it is characterised in that
The 2D/3D data mixings visualization device, including：
3D model geometric modular converters, the 3D model consistency processing modules of 2D drawings；
The 3D model geometrics modular converter, for when known to 4 coordinates in 2D drawings rectangular area, the rotation to 2D drawings
Position is calculated based on photographic head coordinate system with posture, and photographic head coordinate system will be from 2D drawing region of interest ROI
Obtain；
The 3D model consistency processing modules of the 2D drawings, for actual drawing is overlapped with virtuality 3D figures, pass through
Video image in the graphics system frame buffer of reception, enters in specified location after the depth value and 3D drawings coupling for carrying out 3D models
Row is overlapped and is shown.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610966656.8A CN106504335A (en) | 2016-10-28 | 2016-10-28 | Realization method and system based on 2D, 3D mixing augmented reality of mobile device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610966656.8A CN106504335A (en) | 2016-10-28 | 2016-10-28 | Realization method and system based on 2D, 3D mixing augmented reality of mobile device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106504335A true CN106504335A (en) | 2017-03-15 |
Family
ID=58322732
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610966656.8A Pending CN106504335A (en) | 2016-10-28 | 2016-10-28 | Realization method and system based on 2D, 3D mixing augmented reality of mobile device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106504335A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107610217A (en) * | 2017-08-22 | 2018-01-19 | 中广核工程有限公司 | A kind of nuclear power generating equipment virtually identifies display systems and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103955889A (en) * | 2013-12-31 | 2014-07-30 | 广东工业大学 | Drawing-type-work reviewing method based on augmented reality technology |
| CN104821011A (en) * | 2015-05-20 | 2015-08-05 | 郭小虎 | Method of generating 3D house type model by 2D house type model based on camera shooting |
| CN105183823A (en) * | 2015-08-28 | 2015-12-23 | 上海永为科技有限公司 | Interactive display system for virtual object and real image |
| CN105788001A (en) * | 2014-12-19 | 2016-07-20 | 镇江雅迅软件有限责任公司 | 2D drawing-to-3D model data conversion method |
| US9460561B1 (en) * | 2013-03-15 | 2016-10-04 | Bentley Systems, Incorporated | Hypermodel-based panorama augmentation |
| CN106023307A (en) * | 2016-07-12 | 2016-10-12 | 深圳市海达唯赢科技有限公司 | Three-dimensional model rapid reconstruction method and system based on field environment |
-
2016
- 2016-10-28 CN CN201610966656.8A patent/CN106504335A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9460561B1 (en) * | 2013-03-15 | 2016-10-04 | Bentley Systems, Incorporated | Hypermodel-based panorama augmentation |
| CN103955889A (en) * | 2013-12-31 | 2014-07-30 | 广东工业大学 | Drawing-type-work reviewing method based on augmented reality technology |
| CN105788001A (en) * | 2014-12-19 | 2016-07-20 | 镇江雅迅软件有限责任公司 | 2D drawing-to-3D model data conversion method |
| CN104821011A (en) * | 2015-05-20 | 2015-08-05 | 郭小虎 | Method of generating 3D house type model by 2D house type model based on camera shooting |
| CN105183823A (en) * | 2015-08-28 | 2015-12-23 | 上海永为科技有限公司 | Interactive display system for virtual object and real image |
| CN106023307A (en) * | 2016-07-12 | 2016-10-12 | 深圳市海达唯赢科技有限公司 | Three-dimensional model rapid reconstruction method and system based on field environment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107610217A (en) * | 2017-08-22 | 2018-01-19 | 中广核工程有限公司 | A kind of nuclear power generating equipment virtually identifies display systems and method |
| CN107610217B (en) * | 2017-08-22 | 2021-09-07 | 深圳中广核工程设计有限公司 | Nuclear power equipment virtual identification display system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108520519B (en) | Image processing method and device and computer readable storage medium | |
| US11017244B2 (en) | Obstacle type recognizing method and apparatus, device and storage medium | |
| CN108027877A (en) | System and method for the detection of non-barrier | |
| CN109584276A (en) | Critical point detection method, apparatus, equipment and readable medium | |
| US10915781B2 (en) | Scene reconstructing system, scene reconstructing method and non-transitory computer-readable medium | |
| CN110942479B (en) | Virtual object control method, storage medium and electronic device | |
| KR20150082379A (en) | Fast initialization for monocular visual slam | |
| CN105143907A (en) | Localization systems and methods | |
| CN108198044A (en) | Methods of exhibiting, device, medium and the electronic equipment of merchandise news | |
| CN103907123A (en) | Human head detection in depth images | |
| US11669977B2 (en) | Processing images to localize novel objects | |
| CN111459269B (en) | Augmented reality display method, system and computer readable storage medium | |
| CN110648363A (en) | Camera posture determining method and device, storage medium and electronic equipment | |
| CN105303550A (en) | Image processing apparatus and image processing method | |
| US20190318535A1 (en) | Display data processing method and apparatus | |
| US20210278908A1 (en) | Electronic-Device Interaction Via a Remote User Interface | |
| CN108510528A (en) | A kind of method and device of visible light and infrared image registration fusion | |
| CN109815854A (en) | It is a kind of for the method and apparatus of the related information of icon to be presented on a user device | |
| US20230401706A1 (en) | Method for detecting a rib with a medical image, device, and medium | |
| JP2022508733A (en) | Augmented reality system and method | |
| Zhang et al. | Level set evolution with local uncertainty constraints for unsupervised change detection | |
| Cao et al. | Detection method for auto guide vehicle’s walking deviation based on image thinning and Hough transform | |
| Makita et al. | View management of annotations for wearable augmented reality | |
| CN112509027A (en) | Repositioning method, robot, and computer-readable storage medium | |
| WO2019201228A1 (en) | Position measurement method and position measurement device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20200904 |
|
| AD01 | Patent right deemed abandoned |