CN106780753A - A kind of augmented reality register device and its method - Google Patents
A kind of augmented reality register device and its method Download PDFInfo
- Publication number
- CN106780753A CN106780753A CN201611058797.6A CN201611058797A CN106780753A CN 106780753 A CN106780753 A CN 106780753A CN 201611058797 A CN201611058797 A CN 201611058797A CN 106780753 A CN106780753 A CN 106780753A
- Authority
- CN
- China
- Prior art keywords
- image
- data model
- augmented reality
- module
- threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of augmented reality register device and its method, shoot the image of current scene respectively simultaneously by the double photographing modules in terminal, two images got to double photographing modules carry out the extraction of characteristic information, the characteristic information that will be extracted is compared with the data model in preset model storehouse, judge whether to meet preset requirement, if meeting, augmented reality registration is carried out；By implementation of the invention, double photographing modules obtain image and compare simultaneously, greatly increase the speed of augmented reality registration so that the image that terminal can simultaneously carry out different angles is compared, also the registration operation of augmented reality is optimized, the experience of user is improved.
Description
Technical field
The present invention relates to AR (Augmented Reality, augmented reality) technical field, more specifically to one kind
Augmented reality register device and its method.
Background technology
AR technologies are a kind of novel computers grown up on the basis of virtual reality (Virtual Reality, VR)
Using and human-computer interaction technology, it is reached virtual information and the seamless fusion of real world to existing by various computer technologies
The effect of real field scape " enhancing ", lays particular emphasis on the combination of actual environment and virtual information and interacts.Mobile augmented reality is existing enhancing
The product that real technology and Mobile portable equipment are combined.Due to the quick popularization of the mobile computing platforms such as smart mobile phone, mobile enhancing
Reality technology possesses very wide market prospects.
For the realization of AR technologies, most crucial technology is the registration technology of AR, and terminal will be counted after AR succeeds in registration
The virtual information generated in calculation machine is attached in real scene in real time.The main registration commonly used in current augmented reality system
Technology is the realtime graphic that current environment is obtained by the rear camera of terminal, the realtime graphic obtained to rear camera with
The iconic model being stored in advance on AR servers compares, and realizes the identification to registering target, is finally completed virtual
The registration of information.
But, when being registered by existing register method, rear camera is in collection image can be due to by week
The influence of factor is thought in collarette border so that shoots the image for coming and does not comply with standard, is at this moment accomplished by repeatedly to working as
Preceding environment is shot, and until meeting standard, this iterative cycles remind the matching speed for shooting comparison very low, cause AR to note
The speed of volume is relatively low, the experience effect extreme difference of user.
The content of the invention
The invention provides a kind of augmented reality register device and its method, solving prior art is carrying out augmented reality
During registration, it is necessary to which follow-up prompts user repeatedly shoots could realize the technical problem of augmented reality registration, so as to greatly promote
The experience of user.
In order to solve the above technical problems, the invention provides a kind of augmented reality register device, including：
First acquisition module, the double photographing modules for obtaining terminal shoot the figure for respectively obtaining simultaneously in current scene
Picture；
Characteristic extracting module, two images for being got to first acquisition module carry out characteristic information and carry respectively
Take；
Comparing module, characteristic information and the data model in preset model storehouse for will be extracted in each image are carried out
Compare；
Judge module, judges whether to meet preset requirement for the comparison result based on the comparing module；
Registering modules, the judged result for the judge module is when meeting the preset requirement, to carry out augmented reality
Registration.
In the present invention, the judge module is used for the comparison result based on the comparing module and judges whether that satisfaction is default
It is required that mode for it is following any one：
If the phase of the first data model in the characteristic information extracted in one of image and the preset model storehouse
First threshold is reached like degree, is then judged as meeting preset requirement；
If the characteristic information extracted in another image is similar to the second data model in the preset model storehouse
Degree reaches Second Threshold, then be judged as meeting preset requirement；
If the first data model in the characteristic information extracted in one of image and the preset model storehouse
Similarity reach the 3rd threshold value, in the characteristic information extracted in described another image and the preset model storehouse second
The similarity of data model reaches the 4th threshold value, and the current geographic position of the terminal and first data model geography
The distance between geographical position of position or second data model is less than the 5th threshold value, then be judged as meeting preset requirement,
3rd threshold value is less than the first threshold, and the 4th threshold value is less than the Second Threshold.
In the present invention, the augmented reality register device also includes：
Second acquisition module, the current geographic position for obtaining the terminal；
3rd acquisition module, for obtaining the geographical position of first data model and the ground of second data model
Reason position.
In the present invention, first acquisition module exists for obtaining the preposition photographing module and rearmounted photographing module of terminal
The image for respectively obtaining is shot in current scene simultaneously.
In the present invention, the characteristic extracting module is used to carry out marker feature letter respectively to two images for getting
Breath is extracted, and obtains marker feature information, and the mark includes building.
In order to solve the above-mentioned technical problem, present invention also offers a kind of augmented reality register method, including：
The double photographing modules for obtaining terminal shoot the image for respectively obtaining simultaneously in current scene；
Two images to getting carry out feature information extraction respectively；
The characteristic information extracted in each image is compared with the data model in preset model storehouse；
Judge whether to meet preset requirement based on comparison result；
If meeting the preset requirement, augmented reality registration is carried out.
In the present invention, it is described based on comparison result judge whether to meet preset requirement include it is following any one：
If the phase of the first data model in the characteristic information extracted in one of image and the preset model storehouse
First threshold is reached like degree, is then judged as meeting preset requirement；
If the characteristic information extracted in another image is similar to the second data model in the preset model storehouse
Degree reaches Second Threshold, then be judged as meeting preset requirement；
If the first data model in the characteristic information extracted in one of image and the preset model storehouse
Similarity reach the 3rd threshold value, in the characteristic information extracted in described another image and the preset model storehouse second
The similarity of data model reaches the 4th threshold value, and the current geographic position of the terminal and first data model geography
The distance between geographical position of position or second data model is less than the 5th threshold value, then be judged as meeting preset requirement,
3rd threshold value is less than the first threshold, and the 4th threshold value is less than the Second Threshold.
In the present invention, the augmented reality register method also includes：
Obtain current geographic position, the geographical position of first data model and the second data mould of the terminal
The geographical position of type.
In the present invention, the double photographing modules for obtaining terminal shoot the image for respectively obtaining simultaneously in current scene
Including：The preposition photographing module and rearmounted photographing module for obtaining terminal shoot the image for respectively obtaining simultaneously in current scene.
In the present invention, the current scene is Outdoor Scene, and described pair of two images for getting carry out feature respectively
Information extraction includes：Two images to getting carry out marker feature information extraction respectively, obtain marker feature information,
The mark includes building.
Augmented reality register device provided in an embodiment of the present invention and its method, by the double photographing modules in terminal simultaneously
The image of current scene is shot respectively, and two images got to double photographing modules carry out the extraction of characteristic information, will extract
To characteristic information compare with the data model in preset model storehouse, judge whether to meet preset requirement, if meet, enter
Row augmented reality is registered；The implementation of the method by providing the present invention, double photographing modules obtain image and compare simultaneously, greatly
The earth improves the speed of augmented reality registration so that the image that terminal can simultaneously carry out different angles is compared, and is also optimized
The registration operation of augmented reality, improves the experience of user.
Brief description of the drawings
Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing：
The structured flowchart of the augmented reality register device that Fig. 1 is provided for first embodiment of the invention；
The flow chart of the augmented reality register method that Fig. 2 is provided for first embodiment of the invention；
Another flow chart of the augmented reality register method that Fig. 3 is provided for second embodiment of the invention；
Another structured flowchart of the augmented reality register device that Fig. 4 is provided for third embodiment of the invention.
Specific embodiment
The embodiment of the present invention is described in further detail below by specific embodiment combination accompanying drawing.
First embodiment：
Fig. 1 is refer to, the structured flowchart of the augmented reality register device that Fig. 1 is provided for the present embodiment, the device is directed to
In existing AR logon modes, its registration efficiency is too low, and it registers whether and is successfully influenceed by artificial or environmental factor
It is too big, cause the success rate of registration than relatively low, as long as existing AR logon modes image is not inconsistent standardization will constantly carry
Awake user re-shoots, registration of comparing again after image meets standard, so that the experience of user is excessively poor, in order to
The problem is solved, a kind of augmented reality register device is the embodiment of the invention provides, including：First acquisition module 101, feature is carried
Modulus block 102, comparing module 103, judge module 104 and Registering modules 105, wherein：
Double photographing modules that first acquisition module 101 is used to obtain terminal are obtained respectively in current scene while shooting
The image for arriving, current scene here includes indoor scene and outdoor scene, and indoor scene can be market, station etc., room
Outer scene includes environment around tourist attractions, landmark thing etc.；It can be current environment wherein to shoot the image for obtaining
A certain mark, such as the signboard in market, Oriental Pearl's tower in Shanghai etc.；
The characteristic extracting module 102 is used to carry out two images that first acquisition module 101 gets respectively
Feature information extraction, characteristic information here includes building, the flag information of building, the ground of current scene in current scene
Two images for getting particularly are carried out marker feature by mark of reason position and current scene etc. respectively
Information extraction, obtains marker feature information, and the mark includes building；
The data mould that the comparing module 103 is used in the characteristic information and preset model storehouse that will be extracted in each image
Type is compared, and specifically compares the similarity of the image and data model for photographing, and whether the scene for judging both is same
Individual scene, if so, then meet preset requirement, conversely, being unsatisfactory for；
The judge module 104 is used for the comparison result based on the comparing module 103 and judges whether to meet preset requirement；
The Registering modules 105 are used to, when the judged result of the judge module 104 meets preset requirement, be strengthened
Reality registration.
In the present embodiment, described pair of photographing module includes preposition photographing module and rearmounted photographing module, specially terminal
On front camera and rear camera, at this moment the first acquisition module 101 obtain image when be by preposition in terminal
Camera and rear camera obtain two images in current scene, and two images are current scene simultaneously in
The image of different directions；Or, this pair of photographing module is provided in the terminal back side or dual camera above, at this moment described
One acquisition module 101 obtain be the dual camera simultaneously shoot two current scenes in same direction on different angles
Image because being the image photographed by two cameras the standard and quality of this two images have been certain to not
Together, then just to provide multiple comparison objects when comparing module 103 is compared, it is to avoid multiple shooting and lose time, improve
The efficiency of comparison.
Further, the function of first acquisition module 101 can specifically be realized using communication module, for example, obtaining
During image, terminal can be connected by communication module with other-end, obtain the image of the current scene that other-end shoots, than
Such as obtained by WIFI, bluetooth, radio frequency communication mode；Further, can also be the first acquisition module 101 just using eventually
The preceding camera and rear camera of itself is held to carry out direct access.
When augmented reality register device is connected with terminal by way of bluetooth, then first acquisition module 101 is
Bluetooth module, is connected by bluetooth module with terminal, and double photographing modules of control terminal shoot the image of current scene, and terminal exists
The image that will be photographed further according to the image for getting by Bluetooth transmission to augmented reality device, then carrying out AR registration offices
Reason.
In the present embodiment, when the result that judge module 104 judges is as situations below, then it is assumed that be to meet default wanting
Ask：
Situation one：The image that contrast module 103 photographs rear camera and front camera respectively with preset model
During corresponding data model is compared in storehouse, the image shot when rear camera and first data model comparison
When similarity reaches first threshold, then judge module 104 is judged as meeting preset requirement, can carry out augmented reality registration step
Suddenly.
Situation two：The image that contrast module 103 photographs rear camera and front camera respectively with preset model
During corresponding data model is compared in storehouse, the image shot when front camera and second data model comparison
When similarity reaches Second Threshold, then judge module 104 is judged as meeting preset requirement, can carry out augmented reality registration step
Suddenly.
Situation three：The image that contrast module 103 photographs rear camera and front camera respectively with preset model
During corresponding data model is compared in storehouse, when the phase of image and the first data model comparison that rear camera shoots
The 3rd threshold value is reached like degree, the image and the similarity of the second data model comparison that front camera shoots reach the 4th threshold value,
And the geographical position of the terminal and the geographical position of first data model or the geographical position of second data model
The distance between be less than the 5th threshold value, then judge module 104 be judged as meeting preset requirement, can carry out augmented reality registration step
Suddenly, wherein, the 3rd threshold value be less than the first threshold, the 4th threshold value be less than the Second Threshold.Specifically, here
Data model can be the picture of a certain building, or the measurements of the chest, waist and hips model of the building, it might even be possible to be the building institute field
All environment threedimensional models.
In the present embodiment, the first threshold and Second Threshold could be arranged to same value, at this moment, in comparing module
103 carry out the image that preposition and rear camera photographs when comparing, as long as having one up to or over pre- in both
If threshold value, the AR registered tasks for being judged as user's triggering meet preset requirement, and Registering modules 105 perform AR registration steps,
When neither meeting, then whether the deterministic process of implementation status three judges the distance between geographical position less than default the
Five threshold values, if being less than, can also perform AR registration steps.
For example, when user is in the doorway in certain market, user does not know that layout and each floor in market are corresponding
What the type of merchandise is, at this moment user can open map software by terminal, carry out AR trade mark enquiries, and detailed process is：
First, user opens map software, such as Baidu map, and starts AR functions.
Then, user shoots two photos including the current scene including market by the dual camera in terminal, eventually
The data model of the current scene for prestoring is found at end from AR servers, and two pieces that will be photographed are compared with data model
It is right, if comparison result is have a photo in two photos to reach more than 90% with the similarity of data model, judge to work as
Preceding registration operation meets preset requirement, succeeds in registration；
Or, in this two similarities of the comparison result of photo all only 80%, 90% preset requirement is unsatisfactory for, this
When calculate the distance between geographical position again, judge whether less than default threshold value, if so, then meeting preset requirement, to register
Work(.
Finally, current shooting meet the type of merchandise of each floor on the market on the photo of preset requirement and
Store information is displayed on photo, it is achieved thereby that showing the information that present mode can not possibly be present in true environment.
In the present embodiment, the comparing module 103 in the augmented reality register device is to front camera and rearmounted
Before the image that camera is photographed is compared, also include：Priority is set to front camera and rear camera, by after
Put the image that camera photographs and be set to main target image (being priority level highest), the figure that front camera is photographed
As being set to auxiliary mark image (being minimum priority level), contrast module 103 is first entered when comparing to main target image
Row is compared, and after the image alignment similarity of rear camera is unsatisfactory for preset requirement, comparing module 103 is performed to auxiliary mesh again
Logo image is compared treatment, if the image of front camera is also unsatisfactory for preset requirement, the judgement step of implementation status three
Suddenly.
In the present embodiment, if the similarity of the image that shoots of rear camera and the first data model comparison is unsatisfactory for the
Two threshold values, when the image and the similarity of the second data model comparison that front camera shoots also are unsatisfactory for Second Threshold, except
Needs further determine whether to meet outside the 3rd threshold value and the 4th threshold value, in addition it is also necessary to obtain the current geographical position of terminal, so
Judge whether the distance between geographical position of the current geographical position of terminal and data model meets the 5th threshold value afterwards, finally,
Consider and whether meet preset requirement, then meet, it is allowed to carry out AR registrations.
In the present embodiment, the augmented reality register device, when geographical position is obtained, is specifically respectively by the
Two acquisition modules and the 3rd acquisition module are obtained, wherein, second acquisition module is used to obtain the current geographic of the terminal
Position, the 3rd acquisition module possesses the ground in the geographical position and second data model that obtain first data model
Reason position.Preferably, the second acquisition module can be realized directly using the first acquisition module 101, as long as obtaining mould first
Increase GPS location function in block 101, first acquisition module 101 is also right while the image of current scene is obtained
The current position of terminal is positioned, and is stored.
The first data model and the geographical position of the second data model that 3rd acquisition module is obtained, can directly from
Obtained in data model libraries, because also can be by the geography of the corresponding data model of GPS location while data storage model
Position, is then collectively stored on AR servers, and when needing to carry out the calculating of geographical position distance, the 3rd acquisition module is direct
The query calls from AR servers, naturally it is also possible to positioning in real time is carried out by the data model for calling and is obtained.
The augmented reality register device that the present embodiment is provided, by simultaneously using dual camera shooting image and using shooting
Two images of head are compared fast registration, compared to existing technology using the matching way of single camera shooting image, are utilized
Matching degree that both dual camera and pool are each obtained, can greatly optimize the registered task of AR applications, lifting Consumer's Experience.
Second embodiment：
Fig. 2 is referred to, Fig. 2 is the flow chart of augmented reality register method provided in an embodiment of the present invention, and the present embodiment is carried
The register method of confession is primarily to the registration operation of optimization AR, solution registration of the prior art is less efficient, and is noting
Prompting user is also repeated continuously after volume failure to re-shoot, have a strong impact on registration speed etc. these cumbersome problems.
Augmented reality register method provided in an embodiment of the present invention specifically includes following steps：
S201, the double photographing modules for obtaining terminal shoot the image for respectively obtaining simultaneously in current scene, described current
Scene includes indoor scene and outdoor scene, and indoor scene can be market, station etc., outdoor scene include tourist attractions,
Environment around landmark thing etc..
In this step, particular by the preposition photographing module and rearmounted photographing module of terminal in current scene simultaneously
Shooting image respectively, it is preferable that the preposition photographing module and rearmounted photographing module are respectively the front camera of terminal and rearmounted
Camera, two images in current scene are obtained by two cameras in terminal simultaneously, and two images are
The image of the different directions in current scene；
Or, while using the same direction in two rear cameras in terminal simultaneously two current scenes of shooting
On different angles image.
S202, two images to getting carry out feature information extraction respectively.
The characteristic information include current scene in building, the flag information of building, the geographical position of current scene,
And the mark of current scene etc., it is preferred that in the characteristic information of two images of acquisition, the mark in image is obtained respectively
Will thing characteristic information, obtains marker feature information.
S203, the characteristic information extracted in each image is compared with the data model in preset model storehouse.
In this step, the characteristic information that will specifically be extracted in the one of image in two images is pre- with described
If the first data model in model library is compared；The characteristic information that will be extracted in another image and the preset model
The second data model in storehouse is compared, when the comparison result of two images is all unsatisfactory for preset requirement, in addition it is also necessary to calculate
The geographical position of the current geographic position of terminal and first data model or the geographical position of second data model it
Between distance, and compare with default distance value.
S204, judges whether to meet preset requirement based on comparison result.
In this step, the comparison result includes following several situations：
One is：When the image and the similarity of the first data model comparison that rear camera shoots reach first threshold, then
It is judged as meeting preset requirement；
Two are：When the image and the similarity of the second data model comparison that front camera shoots reach Second Threshold, then
It is judged as meeting preset requirement；
Three are：The image and the similarity of the first data model comparison that rear camera shoots reach the 3rd threshold value, preposition
The similarity of image and the second data model comparison that camera shoots reaches the 4th threshold value, and the geographical position of the terminal and
The distance between geographical position of the geographical position of first data model or second data model is less than the 5th threshold value,
Then it is judged as meeting preset requirement, wherein, the 3rd threshold value is less than the first threshold, and the 4th threshold value is less than described the
Two threshold values.
S205, if meeting the preset requirement, carries out augmented reality registration.
In the present embodiment, the first threshold and Second Threshold could be arranged to same value, it is also possible to be set to not
With value, when same value is set to, when carrying out the image that preposition and rear camera photographs and comparing, if two
There is one in person up to or over default threshold value, the AR registered tasks for being judged as user's triggering meet preset requirement, hold
Row AR registration steps, when neither meeting, then whether the deterministic process of implementation status three, judge the distance between geographical position
Less than default 5th threshold value, if being less than, AR registration steps can also be performed.
For example, when user is in the doorway in certain market, user does not know that layout and each floor in market are corresponding
What the type of merchandise is, at this moment user can open map software by terminal, carry out AR trade mark enquiries, and detailed process is：
First, user opens map software, such as Baidu map, and starts AR functions.
Then, user shoots two photos including the current scene including market by the dual camera in terminal, eventually
The data model of the current scene for prestoring is found at end from AR servers, and two pieces that will be photographed are compared with data model
It is right, if comparison result is have a photo in two photos to reach more than 90% with the similarity of data model, judge to work as
Preceding registration operation meets preset requirement, succeeds in registration；
Or, in this two similarities of the comparison result of photo all only 80%, 90% preset requirement is unsatisfactory for, this
When calculate the distance between geographical position again, judge whether less than default threshold value, if so, then meeting preset requirement, to register
Work(.
Finally, current shooting meet the type of merchandise of each floor on the market on the photo of preset requirement and
Store information is displayed on photo, it is achieved thereby that the information that the premode that contraindicated in true environment can not possibly be present.
When the first threshold and Second Threshold could be arranged to different values, by front camera and rearmounted take the photograph respectively
As the image that head shoots is compared with corresponding model, the result for being compared, by comparison result and corresponding threshold value ratio
Compared with, judge whether meet requirement, for example, the pixel of taking pictures of front camera and rear camera is differed, front camera
Relative low points, at this moment, the comparison of front camera requirement it is relative can low spot, so will according to the actual mass of the equipment of acquisition come
Corresponding threshold value is set.
In the present embodiment, the augmented reality register method is in the figure photographed to front camera and rear camera
Before as comparing, also include：Priority is set to front camera and rear camera, rear camera is photographed
Image is set to main target image (being priority level highest), and the image that front camera is photographed is set to auxiliary mark
Image (being minimum priority level), when comparing, first compares, in the image ratio of rear camera to main target image
After being unsatisfactory for preset requirement to similarity, then treatment of comparing to auxiliary mark image is performed, if the image of front camera
When being also unsatisfactory for preset requirement, then the judgement step of implementation status three.
Before implementation status three, in addition it is also necessary to obtain the current geographical location information of terminal, the geography of the first data model
Position and the geographical position of the second data model, the ground of the current geographic position of computing terminal and first data model
The distance between geographical position of reason position or second data model；
Then, the in the characteristic information that extracts and the preset model storehouse is judged in the image that rear camera shoots
Whether the similarity of one data model reaches the 3rd threshold value, the characteristic information extracted in the image that front camera shoots and institute
Whether the similarity for stating the second data model in preset model storehouse reaches the 4th threshold value, if all meeting, between geographical position
Distance whether reach the 5th threshold value, if reaching, perform AR registration.
In the present embodiment, it is preferred to judge it is all to meet augmented reality registration operation using situation three, specific treatment step
It is rapid as shown in Figure 3：
S301, shoots two images of current location by the preceding camera in terminal and rear camera, and by image
It is sent on AR servers, the image that wherein rear camera is photographed is set to main target image, front camera shoots
To image be set to auxiliary mark image.
S302, extracts two characteristic informations of image.
Specifically, the image that AR server receiving terminals send, and respectively to main target image and auxiliary mark image
Carry out the extraction of characteristic information, it is preferred that extract the key feature information in image, such as working as where in extraction present image
The characteristic information for most having the information or road sign of landmark thing etc. of front position.
In this step, after characteristic information has been extracted, also comprise determining whether to meet the requirement of augmented reality registration,
Perform step S303 and step S304.
S303, judges whether the image of rear camera meets the requirement of augmented reality registration.
Specifically, the characteristic information extracted from main target image is compared with the first data model, phase is obtained
Like the comparison result of degree, when result reaches first threshold, such as the similarity of main target image and the first data model is compared
90% is reached, then performs step S308, when result does not reach first threshold, then perform step S304.
S304, judges whether the image of front camera meets the requirement of augmented reality registration.
Specifically, the characteristic information extracted from auxiliary mark image is compared with the second data model, phase is obtained
Like the comparison result of degree, when result reaches Second Threshold, such as the similarity of auxiliary mark image and the second data model is compared
90% is reached, then performs step S308, when result does not reach Second Threshold, then perform step S305.
Further, image is compared and does not reach preset requirement, it may be possible to pixel or recognized in itself due to terminal camera
For factor cause image taking can't meet the quality requirement, also or the factor such as environment so that the final feature letter for extracting
Breath possibly cannot meet the requirement of similarity-rough set, cause registration failure.
S305, obtains the geographical position of present terminal.
In this step, positioning in real time can be specifically carried out by the d GPS locating module of terminal and obtains current shooting
Geographical position.
S306, respectively calculate rear camera image geographical position and front camera image geographical position with
The distance between geographical position of default data model in AR servers.
In this step, it is also pre- with AR servers including calculating the image of rear camera and the image of front camera
If corresponding data model similarity.
S307, judges whether similarity and distance all meet pre-conditioned.
Specifically, when similarity both knows about and reaches 80%, and distance is less than default distance threshold, then be judged as meeting
The requirement of registration, performs step S308, if be all unsatisfactory for, return to step S301.
For example, main target image is calculated, the similarity A1 of auxiliary mark image and the default data model of AR servers,
A2, and judge that Similarity value A1, A2 meet the current location D2 and AR of preset requirement (developer pre-sets similarity requirement)
The distance of server data model server storage address D1, when A1, A2 similarity meet preset requirement and D2, D1 distance become
In same position, then directly registered.
S308, realizes that augmented reality is registered.
By the implementation of the present embodiment, the Similarity value for obtaining image calculating by double end picture head can quickly be met
Registration requirement is registered.Two images for being obtained by the same time simultaneously judge whether to meet the registration demand of registered task
The difficulty of single picture adaptation can be reduced, fast registration is realized.
The augmented reality register method that the present embodiment is provided, is shot current respectively simultaneously by the double photographing modules in terminal
The image of scene, two images got to double photographing modules carry out the extraction of characteristic information, the characteristic information that will be extracted
Compare with the data model in preset model storehouse, judge whether to meet preset requirement, if meeting, carry out augmented reality note
Volume；The implementation of the method provided by the present invention, double photographing modules are obtained image and compared simultaneously, greatly increase enhancing
The speed of reality registration so that the image that terminal can simultaneously carry out different angles is compared, and also optimizes the registration of augmented reality
Operation, improves the experience of user.
3rd embodiment：
Fig. 4 is refer to, Fig. 4 is another structured flowchart of augmented reality register device provided in an embodiment of the present invention, the dress
Put including photographing module 41, communication module 42 and processor 43, the photographing module 41 includes preposition image unit 411 and rearmounted
Image unit 412, the photographing module 41 is used to be shot simultaneously in current scene the image for respectively obtaining, wherein：
The preposition image unit 411 is used for preposition image of the camera terminal in current scene；
The rearmounted image unit 412 is used for rearmounted image of the camera terminal in current scene；
The communication module 42 is used to obtain two images that the photographing module 41 is photographed；
Processor 43 is used to carry out feature information extraction respectively to two images that first acquisition module gets, will
The characteristic information extracted in each image is compared with the data model in preset model storehouse, based on the comparing module
Comparison result judges whether to meet preset requirement, and judged result is when meeting the preset requirement, to carry out augmented reality registration, institute
Stating characteristic information includes building, the flag information of building, the geographical position of current scene and current field in current scene
Mark of scape etc., it is preferred that in the characteristic information of two images of acquisition, obtains the marker feature letter in image respectively
Breath, obtains marker feature information.
In the present embodiment, comparison result of the processor 43 based on the comparing module judges whether to meet default wanting
The mode asked for it is following any one：
If the phase of the first data model in the characteristic information extracted in one of image and the preset model storehouse
First threshold is reached like degree, is then judged as meeting preset requirement；
If the characteristic information extracted in another image is similar to the second data model in the preset model storehouse
Degree reaches Second Threshold, then be judged as meeting preset requirement；
If the first data model in the characteristic information extracted in one of image and the preset model storehouse
Similarity reach the 3rd threshold value, in the characteristic information extracted in described another image and the preset model storehouse second
The similarity of data model reaches the 4th threshold value, and the current geographic position of the terminal and first data model geography
The distance between geographical position of position or second data model is less than the 5th threshold value, then be judged as meeting preset requirement,
3rd threshold value is less than the first threshold, and the 4th threshold value is less than the Second Threshold.
In the present embodiment, the first threshold and Second Threshold could be arranged to same value, it is also possible to be set to not
Same value, when same value is set to, carries out preposition image unit 411 and rearmounted image unit 412 shoots in processor 43
To image compare when, as long as having one in both up to or over default threshold value, be judged as user's triggering
AR registered tasks meet preset requirement, processor 43 performs AR registration steps, and when neither meeting, then implementation status three is sentenced
Whether disconnected process, judge the distance between geographical position less than default 5th threshold value, if being less than, can also perform AR registrations
Step.
When the first threshold and Second Threshold could be arranged to different values, respectively by the He of preposition image unit 411
Rearmounted image unit 412 shoot image compare with corresponding model, the result for being compared, by comparison result with it is right
Whether the threshold value answered compares, and judges meet requirement, for example, the pixel of taking pictures of front camera and rear camera is differed,
The relative low points of front camera, at this moment, the relative meeting low spot of comparison requirement of front camera, so will be according to the equipment of acquisition
Actual mass sets corresponding threshold value.
In the present embodiment, the augmented reality register device is to preposition image unit 411 and rearmounted image unit 412
Before the image for photographing is compared, also include：Priority is set to preposition image unit 411 and rearmounted image unit 412,
The image that rearmounted shooting base of a fruit Na unit 412 photographs is set to main target image (being priority level highest), preposition shooting
The image that unit 411 is photographed is set to auxiliary mark image (being minimum priority level), when comparing, first to main target
Image is compared, and after the image alignment similarity of rearmounted image unit 412 is unsatisfactory for preset requirement, then is performed to auxiliary mesh
Logo image compares treatment, if the image of preposition image unit 411 is also unsatisfactory for preset requirement, implementation status three is sentenced
Disconnected step.
Before implementation status three, in addition it is also necessary to obtain the current geographical location information of terminal, the geography of the first data model
Position and the geographical position of the second data model, the ground of the current geographic position of computing terminal and first data model
The distance between geographical position of reason position or second data model；
Then, the characteristic information extracted in the image for judging the shooting of rearmounted image unit 412 and the preset model storehouse
In the similarity of the first data model whether reach the 3rd threshold value, extracted in the image that preposition image unit 411 shoots
Whether the similarity of the second data model in characteristic information and the preset model storehouse reaches the 4th threshold value, if all meeting,
Whether the distance between geographical position reaches the 5th threshold value, if reaching, performs AR registrations.
Institute is to sum up stated, augmented reality register device and its method that the present invention is provided, by the double photographing modules in terminal
Shoot the image of current scene respectively simultaneously, two images got to double photographing modules carry out the extraction of characteristic information, will
The characteristic information for extracting is compared with the data model in preset model storehouse, judges whether to meet preset requirement, if meeting,
Then carry out augmented reality registration；By implementation of the invention, double photographing modules obtain image and compare simultaneously, greatly improve
The speed of augmented reality registration so that the image that terminal can simultaneously carry out different angles is compared, and also optimizes augmented reality
Registration operation, improve the experience of user.
Embodiments of the invention are described above in conjunction with accompanying drawing, but the invention is not limited in above-mentioned specific
Implementation method, above-mentioned specific embodiment is only schematical, rather than restricted, one of ordinary skill in the art
Under enlightenment of the invention, in the case of present inventive concept and scope of the claimed protection is not departed from, can also make a lot
The conversion of form, these are belonged within protection of the invention.
Claims (10)
1. a kind of augmented reality register device, it is characterised in that including：
First acquisition module, the double photographing modules for obtaining terminal shoot the image for respectively obtaining simultaneously in current scene；
Characteristic extracting module, two images for being got to first acquisition module carry out feature information extraction respectively；
Contrast module, it is right to be carried out for the data model in the characteristic information that will be extracted in each image and preset model storehouse
Than；
Judge module, judges whether to meet preset requirement for the comparison result based on the comparing module；
Registering modules, the judged result for the judge module is when meeting the preset requirement, to carry out augmented reality registration.
2. augmented reality register device according to claim 1, it is characterised in that the judge module is used for based on described
The comparing result of comparing module judge whether to meet the mode of preset requirement for it is following any one：
If the similarity of the first data model in the characteristic information extracted in one of image and the preset model storehouse
First threshold is reached, is then judged as meeting preset requirement；
If the similarity of the second data model in the characteristic information extracted in another image and the preset model storehouse reaches
To Second Threshold, then it is judged as meeting preset requirement；
If the phase of the first data model in the characteristic information extracted in one of image and the preset model storehouse
The 3rd threshold value, the characteristic information extracted in described another image and the second data mould in the preset model storehouse are reached like degree
The similarity of type reaches the 4th threshold value, and the geographical position of the current geographic position of the terminal and first data model or
The distance between geographical position of second data model is less than the 5th threshold value, then be judged as meeting preset requirement, and described the
Three threshold values are less than the first threshold, and the 4th threshold value is less than the Second Threshold.
3. augmented reality register device according to claim 2, it is characterised in that also include：
Second acquisition module, the current geographic position for obtaining the terminal；
3rd acquisition module, for obtaining the geographical position of first data model and the geographical position of second data model
Put.
4. augmented reality register device according to claim 1, it is characterised in that first acquisition module is used to obtain
The preposition photographing module and rearmounted photographing module of terminal shoot the image for respectively obtaining simultaneously in current scene.
5. the augmented reality register device according to any one of Claims 1-4, it is characterised in that the feature extraction mould
Block is used to carry out marker feature information extraction respectively to two images for getting, and obtains marker feature information, the mark
Will thing includes building.
6. a kind of augmented reality register method, it is characterised in that including：
The double photographing modules for obtaining terminal shoot the image for respectively obtaining simultaneously in current scene；
Two images to getting carry out feature information extraction respectively；
The data model that the characteristic information extracted in each image collects with preset model storehouse is compared；
Judge whether to meet preset requirement based on comparing result；
If meeting the preset requirement, augmented reality registration is carried out.
7. augmented reality register method according to claim 6, it is characterised in that described to be judged whether based on comparison result
Meet preset requirement include it is following any one：
If the similarity of the first data module in the characteristic information extracted in one of image and the preset model storehouse
First threshold is reached, is then judged as meeting preset requirement；
If the similarity of the second data model in the characteristic information extracted in another image and the preset model storehouse reaches
To Second Threshold, then it is judged as meeting preset requirement；
If the phase of the first data model in the characteristic information extracted in one of image and the preset model storehouse
The 3rd threshold value, the second number that the characteristic information extracted in described another image collects with the preset model storehouse are reached like degree
Reach the 4th threshold value according to the similarity of model, and the current geographic position of the terminal and first data model geographical position
Put or second data model the distance between geographical position less than the 5th threshold value, then be judged as meeting it is default to go, institute
The 3rd threshold value is stated less than the first threshold, the 4th threshold value is less than the Second Threshold.
8. augmented reality register method according to claim 7, it is characterised in that also include：
Obtain the current geographic position of the terminal, the geographical position of first data model and second data model
Geographical position.
9. augmented reality register method according to claim 6, it is characterised in that double photographing modules of the acquisition terminal
Shooting the image for respectively obtaining simultaneously in current scene includes：The preposition photographing module and rearmounted photographing module for obtaining terminal exist
The image for respectively obtaining is shot in current scene simultaneously.
10. the augmented reality register method according to any one of claim 6 to 9, it is characterised in that the current scene is
Outdoor Scene, described pair of two images for getting carry out feature information extraction respectively to be included：To two images point for getting
Marker feature information extraction is not carried out, marker feature information is obtained, and the mark includes building.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611058797.6A CN106780753A (en) | 2016-11-22 | 2016-11-22 | A kind of augmented reality register device and its method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611058797.6A CN106780753A (en) | 2016-11-22 | 2016-11-22 | A kind of augmented reality register device and its method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106780753A true CN106780753A (en) | 2017-05-31 |
Family
ID=58911485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611058797.6A Pending CN106780753A (en) | 2016-11-22 | 2016-11-22 | A kind of augmented reality register device and its method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106780753A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109840457A (en) * | 2017-11-29 | 2019-06-04 | 深圳市掌网科技股份有限公司 | Augmented reality register method and augmented reality register device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101950353A (en) * | 2010-08-17 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Method and mobile terminal for controlling device remotely by image identification |
| US20120057032A1 (en) * | 2010-09-03 | 2012-03-08 | Pantech Co., Ltd. | Apparatus and method for providing augmented reality using object list |
| CN103105993A (en) * | 2013-01-25 | 2013-05-15 | 腾讯科技（深圳）有限公司 | Method and system for realizing interaction based on augmented reality technology |
| CN103489002A (en) * | 2013-09-27 | 2014-01-01 | 广州中国科学院软件应用技术研究所 | Reality augmenting method and system |
| CN103577788A (en) * | 2012-07-19 | 2014-02-12 | 华为终端有限公司 | Augmented reality realizing method and augmented reality realizing device |
| CN105046213A (en) * | 2015-06-30 | 2015-11-11 | 成都微力互动科技有限公司 | Method for augmenting reality |
| CN105607882A (en) * | 2014-11-19 | 2016-05-25 | 三星电子株式会社 | Display method and electronic device |
-
2016
- 2016-11-22 CN CN201611058797.6A patent/CN106780753A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101950353A (en) * | 2010-08-17 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Method and mobile terminal for controlling device remotely by image identification |
| US20120057032A1 (en) * | 2010-09-03 | 2012-03-08 | Pantech Co., Ltd. | Apparatus and method for providing augmented reality using object list |
| CN103577788A (en) * | 2012-07-19 | 2014-02-12 | 华为终端有限公司 | Augmented reality realizing method and augmented reality realizing device |
| CN103105993A (en) * | 2013-01-25 | 2013-05-15 | 腾讯科技（深圳）有限公司 | Method and system for realizing interaction based on augmented reality technology |
| CN103489002A (en) * | 2013-09-27 | 2014-01-01 | 广州中国科学院软件应用技术研究所 | Reality augmenting method and system |
| CN105607882A (en) * | 2014-11-19 | 2016-05-25 | 三星电子株式会社 | Display method and electronic device |
| CN105046213A (en) * | 2015-06-30 | 2015-11-11 | 成都微力互动科技有限公司 | Method for augmenting reality |
Non-Patent Citations (3)
| Title |
|---|
| 李苗: "《数据化时代的创意营销：2013-2014年度典型案例》", 31 December 2015, 暨南大学出版社 * |
| 杨铁军: "《产业专利分析报告》", 30 June 2015, 知识产权出版社 * |
| 钟广媛: "《玩转GALAXY S4手机》", 31 August 2014, 贵州人民出版社 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109840457A (en) * | 2017-11-29 | 2019-06-04 | 深圳市掌网科技股份有限公司 | Augmented reality register method and augmented reality register device |
| CN109840457B (en) * | 2017-11-29 | 2021-05-18 | 深圳市掌网科技股份有限公司 | Augmented reality registration method and augmented reality registration device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220262039A1 (en) | Positioning method, electronic device, and storage medium | |
| US10636326B2 (en) | Image processing apparatus, image processing method, and computer-readable storage medium for displaying three-dimensional virtual objects to modify display shapes of objects of interest in the real world | |
| CN108616563B (en) | Virtual information establishing method, searching method and application system of mobile object | |
| CN104748738B (en) | Indoor positioning air navigation aid and system | |
| US9721388B2 (en) | Individual identification character display system, terminal device, individual identification character display method, and computer program | |
| CN104281840B (en) | A kind of method and device based on intelligent terminal fixation and recognition building | |
| CN110017841A (en) | Vision positioning method and its air navigation aid | |
| CN104378735B (en) | Indoor orientation method, client and server | |
| CN108921894A (en) | Object positioning method, device, equipment and computer readable storage medium | |
| CN110858414A (en) | Image processing method and device, readable storage medium and augmented reality system | |
| CN111028358B (en) | Indoor environment augmented reality display method and device and terminal equipment | |
| CN101924992A (en) | Method, system and equipment for acquiring scene information through mobile terminal | |
| CN106679665A (en) | Route planning method and route planning device | |
| CN110794955B (en) | Positioning tracking method, device, terminal equipment and computer readable storage medium | |
| EP3748533A1 (en) | Method, apparatus, and storage medium for obtaining object information | |
| CN110111388A (en) | Three-dimension object pose parameter estimation method and visual apparatus | |
| CN110361005A (en) | Positioning method, positioning device, readable storage medium and electronic equipment | |
| CN112419388A (en) | Depth detection method and device, electronic equipment and computer readable storage medium | |
| CN106446098A (en) | Live action image processing method and server based on location information | |
| CN113298928A (en) | House three-dimensional reconstruction method, device, equipment and storage medium | |
| CN107193820A (en) | Location information acquisition method, device and equipment | |
| CN107154967A (en) | A kind of method of locating terminal and device | |
| CN108388636B (en) | Streetscape method for retrieving image and device based on adaptive segmentation minimum circumscribed rectangle | |
| TW201823929A (en) | Method and system for remote management of virtual message for a moving object | |
| CN106203279A (en) | The recognition methods of destination object, device and mobile terminal in a kind of augmented reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170531 |
|
| RJ01 | Rejection of invention patent application after publication |