CN106681000B - Augmented reality registration device and method thereof - Google Patents
Augmented reality registration device and method thereof Download PDFInfo
- Publication number
- CN106681000B CN106681000B CN201611052764.0A CN201611052764A CN106681000B CN 106681000 B CN106681000 B CN 106681000B CN 201611052764 A CN201611052764 A CN 201611052764A CN 106681000 B CN106681000 B CN 106681000B
- Authority
- CN
- China
- Prior art keywords
- information
- terminal
- registration
- acceleration
- registered user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an augmented reality registration device and a method thereof, wherein the current first characteristic information of a terminal is acquired, the first characteristic information of the terminal acquired by a first acquisition module is compared with the characteristic information of registered users stored in a first preset database, when the comparison result shows that matched registered users exist in the first preset database, the registration information of the registered users is acquired, and augmented reality registration is carried out according to the registration information; according to the implementation of the method, the geographical position information and the acceleration information of the terminal are obtained and compared with the geographical position information and the acceleration information of the registered user, whether the conditions are met or not is judged, if yes, the registration is carried out, so that the user can compare and judge the information registered by other users at the current position to carry out augmented reality registration, the registration operation of augmented reality is optimized, and the use experience of the user is improved.
Description
Technical Field
The present invention relates to the field of AR (Augmented Reality) technology, and more particularly, to an Augmented Reality registration apparatus and method.
Background
The AR technology is a novel computer application and human-computer interaction technology developed on the basis of Virtual Reality (VR), which seamlessly fuses Virtual information and the real world through various computer technologies to achieve the effect of "enhancing" a real scene, and focuses on the combination and interaction of a real environment and Virtual information. Mobile augmented reality is the product of a combination of augmented reality technology and mobile portable devices. Due to the rapid popularization of mobile computing platforms such as smart phones, the mobile augmented reality technology has a very wide market prospect.
For realizing the AR technology, the most core technology is the registration technology of the AR, and after the AR is successfully registered, the terminal combines the virtual information generated in the computer into a real scene in real time. The main registration technology commonly used in the current augmented reality system is to acquire a real-time image of the current environment through a rear camera of a terminal, compare and analyze the real-time image acquired by the rear camera with an image model pre-stored on an AR server, recognize a registration target, and finally complete registration of virtual information.
However, when the registration is performed by the existing registration method, the acquired images of the rear camera are affected by the surrounding environment or thought factors, so that the photographed images do not meet the standard, especially, the user performs AR registration when the vehicle moves, and the definition of the images photographed by the terminal is not enough due to the movement of the vehicle, so that it is difficult to realize real-time high-quality framing, and the images need to be continuously and repeatedly photographed, which results in low AR registration speed and extremely poor user experience effect.
Disclosure of Invention
The invention provides an augmented reality registration device and method, which solve the technical problem that the augmented reality registration can be realized only by acquiring a high-quality image of the current environment when the augmented reality registration is carried out in the prior art, thereby greatly improving the use experience of a user.
In order to solve the above technical problem, the present invention provides an augmented reality registration apparatus, including:
the terminal comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring current first characteristic information of the terminal, and the first characteristic information comprises geographical position information or geographical position information and acceleration information;
the first comparison module is used for comparing the first characteristic information of the terminal acquired by the first acquisition module with the characteristic information of the registered user stored in a first preset database;
the second obtaining module is used for obtaining the registration information of the registered user when the comparison result of the first comparing module is that the matched registered user exists in the first preset database;
and the registration module is used for performing augmented reality registration according to the registration information acquired by the second acquisition module.
In some examples of the present invention, if the first feature information acquired by the first acquiring module includes geographical location information and acceleration information, the first comparing module is configured to compare the acquired geographical location information of the terminal with geographical location information of a registered user stored in the first preset database; if the registered user with the geographic position information matched exists in the first preset database, comparing the acquired acceleration information of the terminal with the acceleration information of the registered user stored in the first preset database; and if the acceleration information of the terminal is matched with the acceleration information of the registered user, notifying the second acquisition module to acquire the registration information of the registered user, wherein the registered information refers to a registered image of the registered user during augmented reality registration, an image which is uploaded to an AR server and meets the registration standard, geographical location information during registration and the like.
In some examples of the present invention, matching the geographical location information of the terminal with the geographical location information of the registered user includes: the distance between the geographic position of the terminal and the geographic position of the registered user is smaller than or equal to a first threshold value;
the matching of the acceleration information of the terminal and the acceleration information of the registered user comprises the following steps: the direction of the acceleration of the terminal is the same as the direction of the acceleration of the registered user, and the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is smaller than or equal to a second threshold value.
In some examples of the invention, the augmented reality registration apparatus further comprises:
the third acquisition module is used for acquiring the current image shot by the terminal;
the feature extraction module is used for extracting feature information of the image acquired by the third acquisition module;
the second comparison module is used for comparing the second characteristic information extracted by the characteristic extraction module with a data model stored in a second preset database;
the registration module is further configured to perform augmented reality registration when the comparison result of the second comparison module indicates that the matched data model exists in the second preset database.
In some examples of the invention, the feature extraction module is configured to extract feature information of a marker from the image, the marker including a building, as the second feature information.
The invention also provides an augmented reality registration method, which comprises the following steps:
acquiring current first characteristic information of a terminal, wherein the first characteristic information comprises geographical position information or geographical position information and acceleration information;
comparing the acquired first characteristic information of the terminal with the characteristic information of the registered user stored in a first preset database;
if the first preset database contains the matched registered user, acquiring the registration information of the registered user;
and performing augmented reality registration according to the registration information.
In some examples of the present invention, if the first feature information includes geographic location information and acceleration information, the comparing the acquired first feature information of the terminal with feature information of registered users stored in a first preset database includes:
comparing the acquired geographical position information of the terminal with the geographical position information of the registered user stored in the first preset database;
if the registered user with the geographic position information matched exists in the first preset database, comparing the acquired acceleration information of the terminal with the acceleration information of the registered user stored in the first preset database;
and if the acceleration information of the terminal is matched with the acceleration information of the registered user, entering the step of acquiring the registration information of the registered user.
In some examples of the present invention, matching the geographical location information of the terminal with the geographical location information of the registered user includes: the distance between the geographic position of the terminal and the geographic position of the registered user is smaller than or equal to a first threshold value;
the matching of the acceleration information of the terminal and the acceleration information of the registered user comprises the following steps: the direction of the acceleration of the terminal is the same as the direction of the acceleration of the registered user, and the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is smaller than or equal to a second threshold value.
In some examples of the invention, the augmented reality registration method further includes:
acquiring a current shot image of the terminal;
extracting characteristic information of the acquired image;
comparing the extracted second characteristic information with a data model stored in a second preset database;
and if the matched data model exists in the second preset database, performing augmented reality registration.
In some examples of the present invention, the extracting feature information of the acquired image includes:
feature information of a marker including a building is extracted from the image as the second feature information.
The augmented reality registration device and the method thereof provided by the embodiment of the invention compare the first characteristic information of the terminal acquired by the first acquisition module with the characteristic information of the registered user stored in a first preset database by acquiring the current first characteristic information of the terminal, wherein the first characteristic information comprises geographical position information or geographical position information and acceleration information, and when the comparison result shows that the registered user matched with the first preset database exists in the first preset database, the registration information of the registered user is acquired, and augmented reality registration is carried out according to the registration information; according to the implementation of the method, the geographical position information and the acceleration information of the terminal are obtained and compared with the geographical position information and the acceleration information of the registered user, whether the conditions are met or not is judged, if yes, the registration is carried out, so that the user can compare and judge the information registered by other users at the current position to carry out augmented reality registration, the registration operation of augmented reality is optimized, and the use experience of the user is improved.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
fig. 1 is a block diagram of an augmented reality registration apparatus according to a first embodiment of the present invention;
fig. 2 is a flowchart of an augmented reality registration method according to a first embodiment of the present invention;
fig. 3 is another flowchart of an augmented reality registration method according to a second embodiment of the present invention;
fig. 4 is another block diagram of an augmented reality registration apparatus according to a third embodiment of the present invention.
Detailed Description
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings.
The first embodiment:
referring to fig. 1, fig. 1 is a block diagram of a structure of an augmented reality registration apparatus provided in this embodiment, where the apparatus is directed to an existing AR registration method, the efficiency is too low, and whether registration is successfully performed is greatly affected by external environmental factors, so that a registration success rate is also low, and as long as an image does not meet a standard, a user is continuously reminded to shoot again, and then comparison registration is performed, so that user experience is very poor, in order to solve the problem, an embodiment of the present invention provides an augmented reality registration apparatus, including: a first obtaining module 101, a first comparing module 102, a second obtaining module 103, and a registering module 104, wherein:
the first obtaining module 101 is configured to obtain current first feature information of the terminal, where the first feature information includes geographical location information or geographical location information and acceleration information.
The geographical position information is acquired through a GPS positioning unit on the terminal, and the acceleration information is acquired by an acceleration sensor arranged on the terminal.
The first comparing module 102 is configured to compare the first feature information of the terminal acquired by the first acquiring module 101 with feature information of a registered user stored in a first preset database; specifically, when the first feature information includes geographical location information, the first comparing module 102 compares the current geographical location information of the terminal with geographical location information registered by other users who have performed AR registration on the AR server, and when the first feature information includes geographical location information and acceleration information, the first comparing module 102 compares the current geographical location information of the terminal, the current speed information of the terminal, and the current speed information of the terminal with geographical location information and acceleration information registered by other users who have performed AR registration on the AR server, respectively.
The second obtaining module 103 is configured to obtain registration information of a registered user when the comparison result of the first comparing module 102 is that a matched registered user exists in the first preset database, where the registered user refers to a terminal user that has been successfully registered on the AR server by another terminal in the current environment where the terminal is located;
the registration module 104 is configured to perform augmented reality registration according to the registration information acquired by the second acquisition module 103.
In this embodiment, the augmented reality registration apparatus performs AR registration by acquiring geographic location information of a terminal, specifically, acquiring real-time geographic location information of the terminal, and the real-time geographic location information registration may enable a user to update information on an AR display interface in real time during a moving process of the terminal, for example, when traveling in a certain place, because the user is unfamiliar with the place, the user usually uses navigation software to realize location navigation, but when traveling, many locations are navigated at the same time, which is very inconvenient, so that the user can be realized by the AR registration apparatus provided in this embodiment, starts an AR application of the terminal, acquires current geographic location information through the terminal, and determines whether the geographic location information is the same as geographic location information preset on an AR server or registered by other users, if the two types of images are the same, executing an AR registration step, after the registration is finished, displaying all scenic spots in the scenic spot on a display interface of the terminal on an interface of the terminal for displaying the scenic spot, wherein the scenic spot image displayed on the interface of the terminal can be a picture shot by a user on site, combining the scenic spots in the scenic spot with the shot image for displaying after the registration is successful, and even the scenic spots can be shot when displayed, so that the user can conveniently find the scenic spots, and the scenic spot images are also in a display mode changing in real time, namely the positions of the scenic spots can be changed along with the continuous movement of the user, and the terminal can register, update and display at any time, so that the accuracy of AR registration display information is ensured.
Further, the function of the first obtaining module 101 may be specifically implemented by a communication module, for example, when obtaining the first feature information, the terminal may be connected to other terminals through the communication module, and obtain the feature information of the current environment collected by other terminals, for example, the feature information is obtained by being connected to other terminals through communication modes such as WIFI, bluetooth, radio frequency, and the like; further, the first acquiring module 101 may directly acquire the information by using a GPS positioning unit and an acceleration sensor of the terminal itself.
When the augmented reality registration device is connected with the terminal in a Bluetooth mode, the first acquisition module 101 is a Bluetooth module, the Bluetooth module is connected with an external terminal, the GPS positioning unit and the acceleration sensor of the control terminal acquire the geographic position and the acceleration, the terminal transmits the geographic position and the acceleration to the augmented reality device through the Bluetooth after acquiring the geographic position and the acceleration, then the judgment is carried out according to the acquired geographic position and the acceleration, and the AR registration processing is executed after the judgment meets the conditions.
In this embodiment, if the first feature information acquired by the first acquiring module 101 includes geographical location information and acceleration information, the first comparing module 102 is configured to compare the acquired geographical location information of the terminal with geographical location information of a registered user stored in the first preset database; and determining whether to perform AR registration according to the comparison result.
If the comparison result of the first comparison module 102 is that a registered user with geographical location information matched exists in the first preset database, comparing the acquired acceleration information of the terminal with the acceleration information of the registered user stored in the first preset database; if the acceleration information of the terminal is matched with the acceleration information of the registered user, the second obtaining module 103 is notified to obtain the registration information of the registered user, and finally the registration module 104 performs AR registration according to the registration information obtained by the second obtaining module 103.
In this embodiment, the matching of the geographic location information of the terminal with the geographic location information of the registered user by the first comparing module 102 specifically includes first calculating a distance between the geographic location of the terminal and the geographic location of the registered user, where the distance refers to a distance between two geographic locations, and then determining a size relationship between the distance and a first threshold, and if the distance is less than or equal to the first threshold, determining that the current geographic location information of the terminal is consistent with the registered geographic location information pre-stored in the first preset database;
the step of matching the acceleration information of the terminal with the acceleration information of the registered user by the first comparing module 102 is specifically as follows: firstly, the direction of the acceleration of the terminal is compared with the direction of the acceleration of the registered user, then the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is calculated, wherein the distance refers to the change rule of two acceleration values in the same time period and the magnitude of the acceleration, and the distance is compared with a second threshold value.
Preferably, the requirement of AR registration is satisfied when the comparison result of comparing the geographic positions by the first comparing module 102 is that the distance between the geographic position of the terminal and the geographic position of the registered user is smaller than or equal to a first threshold, the directions of the accelerations of the terminal are the same, and the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is smaller than or equal to a second threshold.
For example, a user performs AR registration through a terminal when a vehicle moves, and at this time, since the terminal moves together with the vehicle, it is difficult to perform AR registration by only acquiring an image, so that the terminal acquires current geographic location information and acceleration information of the terminal through the registration method of the embodiment, then relaxes to an AR server, and detects registered information of other users registered on the AR server in the current location, specifically, detects the geographic location information and acceleration information of the registered user; further, comparing the geographical position information of the terminal with the geographical position information of the registered user, if the comparison result is that the distance between the geographical position information of the terminal and the geographical position information of the registered user is smaller than or equal to a preset distance value, the distance between the geographical position information of the terminal and the geographical position information of the registered user is very close to each other, and the terminal can be considered to be in the same place, then comparing the acceleration information of the terminal with the acceleration information of the registered user, and if the comparison result is that the acceleration change rule and the acceleration value of the terminal both meet the registration requirement, performing AR registration, for example, the acceleration values of the registered user of the terminal are similar when encountering traffic lights or traffic jam and the like on the same road section.
In this embodiment, the augmented reality registration apparatus further includes a third obtaining module, a feature extracting module and a second comparing module, wherein:
the third acquisition module is used for acquiring the current image shot by the terminal, and specifically, two images in the current scene are acquired simultaneously through a front camera and a rear camera on the terminal;
the feature extraction module is configured to perform feature information extraction on the image acquired by the third acquisition module, where the feature information includes a building in a current scene, sign information of the building, a geographic position of the current scene, a sign of the current scene, and the like, and specifically, perform feature information extraction on two acquired images respectively to obtain sign feature information, where the sign includes the building;
the second comparison module is used for comparing the second feature information extracted by the feature extraction module with a data model stored in a second preset database;
the registration module is further configured to perform augmented reality registration when the comparison result of the second comparison module indicates that the matched data model exists in the second preset database.
Specifically, the second comparison module compares the similarity between the acquired image and the data model in the second preset database, and if the similarity is within a preset range, the requirement is met, and AR registration can be directly performed.
In this embodiment, if the third acquiring module acquires two images, the two images include a front image and a rear image, and the second comparing module performs the following comparison method:
the first method is as follows: and the second comparison module compares the images shot by the rear camera and the front camera with corresponding data models in a preset model library respectively, and when the comparison similarity between the images shot by the rear camera and the first data model reaches a third threshold value, the images are judged to meet the preset requirements, and the augmented reality registration step can be carried out.
The second method comprises the following steps: the second comparison module compares the images shot by the rear camera and the front camera with corresponding data models in a preset model library respectively, and when the similarity of the images shot by the front camera and the second data models reaches a third threshold value, the images are judged to meet the preset requirements, and the augmented reality registration step can be carried out.
The third method comprises the following steps: the second comparison module compares the images shot by the rear camera and the front camera with corresponding data models in a preset model library respectively, when the similarity of the image shot by the rear camera and the first data model reaches a fourth value, the similarity of the image shot by the front camera and the second data model reaches a fourth threshold value, and the distance between the geographical position of the terminal and the geographical position of the registered user is smaller than or equal to the first threshold value and the distance between the acceleration value of the terminal and the acceleration value of the registered user is smaller than or equal to the second threshold value, the judgment is that the preset requirement is met, and the augmented reality registration step can be performed.
In this embodiment, the user performs AR registration when the vehicle moves, and may perform the comparison of the first feature information after image registration if the image registration does not satisfy the condition.
The augmented reality registration device provided by this embodiment realizes AR registration by shooting an image and also performs a test by using registration information of other devices according to the principle of similarity between GPS positioning and acceleration and deceleration values of vehicles on the same road. The registration task of AR application can be greatly optimized, and the registration speed of the vehicle-mounted equipment is improved.
Second embodiment:
referring to fig. 2, fig. 2 is a flowchart of an augmented reality registration method according to an embodiment of the present invention, and the registration method provided in this embodiment is mainly used to optimize an AR registration operation, and solve the tedious problems of low registration efficiency, repeated prompting of a user to shoot again after a registration failure, serious influence on registration speed, and the like in the prior art.
The augmented reality registration method provided by the embodiment of the invention specifically comprises the following steps:
s201, acquiring current first characteristic information of the terminal, wherein the first characteristic information comprises geographical position information or geographical position information and acceleration information.
The geographical position information is acquired through a GPS positioning unit on the terminal, and the acceleration information is acquired by an acceleration sensor arranged on the terminal.
S202, comparing the acquired first characteristic information of the terminal with the characteristic information of the registered user stored in a first preset database.
Specifically, when the first feature information includes geographical location information, the first comparing module 102 compares the current geographical location information of the terminal with geographical location information registered by other users who have performed AR registration on the AR server, and when the first feature information includes geographical location information and acceleration information, the first comparing module 102 compares the current geographical location information of the terminal, the current speed information of the terminal, and the current speed information of the terminal with geographical location information and acceleration information registered by other users who have performed AR registration on the AR server, respectively.
S203, if the matched registered user exists in the first preset database, acquiring the registration information of the registered user.
The registered user here refers to an end user in which other terminals in the environment where the terminal is currently located have successfully registered on the AR server
And S204, performing augmented reality registration according to the registration information.
In this embodiment, when the first feature information is obtained, the terminal may be connected to other terminals through the communication module, and obtain feature information of the current environment collected by other terminals, for example, the feature information is obtained by being connected to other terminals through communication modes such as WIFI, bluetooth, and radio frequency; further, the GPS positioning unit and the acceleration sensor of the terminal can be used for direct acquisition. When the augmented reality registration device is connected with the terminal in a Bluetooth mode, the augmented reality registration device is connected with an external terminal through a Bluetooth module, a GPS positioning unit and an acceleration sensor of the control terminal acquire a geographic position and an acceleration, the terminal transmits the geographic position and the acceleration to the augmented reality device through the Bluetooth after acquiring the geographic position and the acceleration, then the terminal judges according to the acquired geographic position and the acceleration, and executes AR registration processing after judging that conditions are met.
In this embodiment, if the first feature information includes geographic location information and acceleration information, the comparing the acquired first feature information of the terminal with the feature information of the registered user stored in the first preset database specifically includes:
comparing the acquired geographical position information of the terminal with the geographical position information of the registered user stored in the first preset database;
if the registered user with the geographic position information matched exists in the first preset database, comparing the acquired acceleration information of the terminal with the acceleration information of the registered user stored in the first preset database;
and if the acceleration information of the terminal is matched with the acceleration information of the registered user, entering the step of acquiring the registration information of the registered user.
In this embodiment, matching the geographic location information of the terminal with the geographic location information of the registered user specifically includes first calculating a distance between the geographic location of the terminal and the geographic location of the registered user, where the distance refers to a distance between two geographic locations, and then determining a size relationship between the distance and a first threshold, and if the distance is less than or equal to the first threshold, determining that the current geographic location information of the terminal is consistent with the registered geographic location information pre-stored in a first preset database;
matching the acceleration information of the terminal with the acceleration information of the registered user specifically comprises: firstly, the direction of the acceleration of the terminal is compared with the direction of the acceleration of the registered user, then the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is calculated, wherein the distance refers to the change rule of two acceleration values in the same time period and the magnitude of the acceleration, and the distance is compared with a second threshold value.
For example, a user performs AR registration through a terminal when a vehicle moves, and at this time, since the terminal moves together with the vehicle, it is difficult to perform AR registration by only acquiring an image, so that the terminal acquires current geographic location information and acceleration information of the terminal through the registration method of the embodiment, then relaxes to an AR server, and detects registered information of other users registered on the AR server in the current location, specifically, detects the geographic location information and acceleration information of the registered user; further, comparing the geographical position information of the terminal with the geographical position information of the registered user, if the comparison result is that the distance between the geographical position information of the terminal and the geographical position information of the registered user is smaller than or equal to a preset distance value, the distance between the geographical position information of the terminal and the geographical position information of the registered user is very close to each other, and the terminal can be considered to be in the same place, then comparing the acceleration information of the terminal with the acceleration information of the registered user, and if the comparison result is that the acceleration change rule and the acceleration value of the terminal both meet the registration requirement, performing AR registration, for example, the acceleration values of the registered user of the terminal are similar when encountering traffic lights or traffic jam and the like on the same road section.
In this embodiment, the augmented reality registration method further includes:
acquiring a current shot image of the terminal;
extracting feature information of the acquired images, wherein the feature information comprises buildings in the current scene, mark information of the buildings, the geographic position of the current scene, marks of the current scene and the like, specifically, extracting mark feature information of the two acquired images respectively to obtain mark feature information, and the marks comprise the buildings;
comparing the extracted second characteristic information with a data model stored in a second preset database;
and if the matched data model exists in the second preset database, performing augmented reality registration.
In this embodiment, the user performs AR registration when the vehicle moves, and may perform the comparison of the first feature information after image registration if the image registration does not satisfy the condition.
Specifically, firstly, two images in a current scene are simultaneously acquired through a front camera and a rear camera on a terminal; comparing the two images with data models in a data model library respectively, and if one image is greater than or equal to a third threshold value in the comparison result, allowing the terminal to directly perform AR registration, wherein the data model can be a picture of a certain building, can also be a three-dimensional model of the building, and even can be a three-dimensional model of the environment where the building is located;
and if the two image heads do not meet the third threshold value, acquiring the current geographical position information and the acceleration information of the terminal, and comparing the acquired current geographical position information and the acquired acceleration information of the terminal with the geographical position information and the acceleration information of the registered user stored in the first preset database.
And when the distance between the current geographic position of the terminal and the geographic position of the registered user is smaller than or equal to a first threshold value and the distance between the current acceleration value of the terminal and the acceleration value of the registered user is smaller than or equal to a second threshold value, judging that the preset requirement is met, and performing an augmented reality registration step.
In this embodiment, a preferable third adoption method is that all the judgments satisfy the augmented reality registration operation, and the specific processing steps are as shown in fig. 3:
s301, shooting two images of the current position, the current geographic position information and the acceleration information of the terminal through a front camera and a rear camera on the terminal, and sending the two images, the current geographic position information and the acceleration information to an AR server, wherein the image shot by the rear camera is set as a main target image, the image shot by the front camera is set as an auxiliary target image, and the positioning information is obtained through a GPS positioning unit.
S302, extracting the characteristic information of the two images.
Specifically, the AR server receives the image sent by the terminal, and extracts feature information of the main target image and the auxiliary target image respectively, and preferably, extracts key feature information in the image, for example, extracts feature information of a most landmark building or a landmark in the current position where the current image is located.
In this step, after the feature information is extracted, it is further determined whether the requirement for augmented reality registration is satisfied, and step S303 and step S304 are executed.
And S303, judging whether the image of the rear camera meets the requirement of augmented reality registration.
Specifically, the feature information extracted from the main target image and the auxiliary target image is compared with the data model respectively to obtain a comparison result of similarity, when the result reaches a third threshold, for example, the similarity between the comparison image and the data model reaches 90%, step S308 is executed, and when the result does not reach the third threshold, step S304 is executed.
S304, whether the registered user exists in the current geographic position information of the terminal is detected.
Specifically, the feature information extracted from the auxiliary target image is compared with the second data model to obtain a comparison result of the similarity, and when the result reaches a second threshold, for example, the similarity between the auxiliary target image and the second data model reaches 90%, step S308 is executed, and when the result does not reach the second threshold, step S305 is executed.
Further, the image comparison may not meet the preset requirement, and may be caused by that the image shooting quality does not meet the requirement due to the pixels of the terminal camera or the considered factors, or due to factors such as the environment, so that the finally extracted feature information may not meet the requirement for similarity comparison, resulting in registration failure.
S305, acquiring the geographic position information and the acceleration information of the registered user.
In this step, the current geographic position of the terminal may be obtained by positioning in real time through a GPS positioning module of the terminal, and acceleration information is acquired through an acceleration sensor.
S306, respectively calculating the distance between the current geographic position of the terminal and the geographic position of the registered user, and the distance between the acceleration of the terminal and the acceleration of the registered user.
S307, judging whether the distance and the spacing meet preset conditions, and if so, executing the step S308.
Specifically, the AR server detects other users whose geographic location D1 is successfully registered, and obtains the real-time acceleration value a2 of the user. If the acceleration value A1 of the user to be registered and the acceleration value A2 of the registered user have similar acceleration and deceleration values, the fact that the two vehicles are on the same road section is judged (the acceleration values of the vehicles have similarity due to the fact that the vehicles meet traffic lights or are blocked on the same road section) and the registration information of the registered user is used for directly registering.
And S308, realizing augmented reality registration.
Specifically, the change of the acceleration value is obtained through the GPS positioning and acceleration sensor, and the situation that a user who is registered successfully nearby and the user to be registered are located in the same road section is determined, so that the registered information of the registered user is used for dismemberment registration.
The method of the embodiment is used for AR registration, particularly for the AR registration of the vehicle-mounted mobile terminal, and real-time images are shot through framing and sent to the AR server. And the AR server acquires the image to perform registration task extraction. If the task characteristic information extracted from the main target image meets the registration requirement, directly registering; and if the registration requirement is not met, judging the geographic position and the acceleration.
According to the augmented reality registration method provided by the embodiment of the invention, the current first characteristic information of a terminal is acquired, wherein the first characteristic information comprises geographical position information or geographical position information and acceleration information, the first characteristic information of the terminal acquired by a first acquisition module is compared with the characteristic information of a registered user stored in a first preset database, when the comparison result shows that the registered user matched with the first preset database exists in the first preset database, the registration information of the registered user is acquired, and augmented reality registration is carried out according to the registration information; according to the implementation of the method, the geographical position information and the acceleration information of the terminal are obtained and compared with the geographical position information and the acceleration information of the registered user, whether the conditions are met or not is judged, if yes, the registration is carried out, so that the user can compare and judge the information registered by other users at the current position to carry out augmented reality registration, the registration operation of augmented reality is optimized, and the use experience of the user is improved.
The third embodiment:
referring to fig. 4, fig. 4 is another structural block diagram of an augmented reality registration apparatus provided in an embodiment of the present invention, where the apparatus includes a communication module 41 and a processor 42, where:
the communication module 42 is configured to obtain current first feature information of the terminal, where the first feature information includes geographic position information or includes geographic position information and acceleration information;
the processor 43 is configured to compare the first feature information of the terminal acquired by the first acquisition module with feature information of a registered user stored in a first preset database, acquire registration information of the registered user when a comparison result shows that a matched registered user exists in the first preset database, and perform augmented reality registration according to the registration information acquired by the second acquisition module.
Specifically, when the first feature information includes geographical location information, the processor 42 compares the current geographical location information of the terminal with geographical location information registered on the AR server by other users who have performed AR registration, and when the first feature information includes geographical location information and acceleration information, compares the current geographical location information of the terminal, and the speed information of the terminal with geographical location information and acceleration information registered on the AR server by other users who have performed AR registration, respectively.
In this embodiment, the augmented reality registration apparatus performs AR registration by acquiring geographic location information of a terminal, specifically, acquiring real-time geographic location information of the terminal, and the real-time geographic location information registration may enable a user to update information on an AR display interface in real time during a moving process of the terminal, for example, when traveling in a certain place, because the user is unfamiliar with the place, the user usually uses navigation software to realize location navigation, but when traveling, many locations are navigated at the same time, which is very inconvenient, so that the user can be realized by the AR registration apparatus provided in this embodiment, starts an AR application of the terminal, acquires current geographic location information through the terminal, and determines whether the geographic location information is the same as geographic location information preset on an AR server or registered by other users, if the two types of images are the same, executing an AR registration step, after the registration is finished, displaying all scenic spots in the scenic spot on a display interface of the terminal on an interface of the terminal for displaying the scenic spot, wherein the scenic spot image displayed on the interface of the terminal can be a picture shot by a user on site, combining the scenic spots in the scenic spot with the shot image for displaying after the registration is successful, and even the scenic spots can be shot when displayed, so that the user can conveniently find the scenic spots, and the scenic spot images are also in a display mode changing in real time, namely the positions of the scenic spots can be changed along with the continuous movement of the user, and the terminal can register, update and display at any time, so that the accuracy of AR registration display information is ensured.
In this embodiment, if the first feature information acquired by the communication module 41 includes geographic position information and acceleration information, the first comparing module is configured to compare the acquired geographic position information of the terminal with geographic position information of a registered user stored in the first preset database; if the registered user with the geographic position information matched exists in the first preset database, comparing the acquired acceleration information of the terminal with the acceleration information of the registered user stored in the first preset database; and if the acceleration information of the terminal is matched with the acceleration information of the registered user, informing the second acquisition module of acquiring the registration information of the registered user.
The processor 42 matches the geographical location information of the terminal with the geographical location information of the registered user, specifically, first calculates a distance between the geographical location of the terminal and the geographical location of the registered user, where the distance refers to a distance between two geographical locations, and then determines a size relationship between the distance and a first threshold, and if the distance is less than or equal to the first threshold, determines that the current geographical location information of the terminal is consistent with the registered geographical location information pre-stored in the first preset database;
the matching, by the processor 42, the acceleration information of the terminal with the acceleration information of the registered user specifically includes: firstly, the direction of the acceleration of the terminal is compared with the direction of the acceleration of the registered user, then the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is calculated, wherein the distance refers to the change rule of two acceleration values in the same time period and the magnitude of the acceleration, and the distance is compared with a second threshold value.
Preferably, the requirement of AR registration is satisfied when the processor 42 compares the geographical locations such that the distance between the geographical location of the terminal and the geographical location of the registered user is less than or equal to a first threshold, the direction of the acceleration of the terminal is the same, and the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is less than or equal to a second threshold.
In this embodiment, the processor 42 in the augmented reality registration apparatus further includes:
acquiring a current shot image of the terminal;
extracting characteristic information of the acquired image;
comparing the extracted second characteristic information with a data model stored in a second preset database;
and if the matched data model exists in the second preset database, performing augmented reality registration.
In this embodiment, if the processor 42 specifically obtains two images through a front camera and a rear camera on the terminal, then the processor 42 compares the two images with a preset data model, specifically by the following means:
the first method is as follows: the processor 42 compares the images shot by the rear camera and the front camera with the corresponding data models in the preset model library respectively, and when the similarity of the images shot by the rear camera and the first data model reaches a third threshold, the images are judged to meet the preset requirements, and the augmented reality registration step can be performed.
The second method comprises the following steps: the processor 42 compares the images shot by the rear camera and the front camera with the corresponding data models in the preset model library respectively, and when the similarity of the images shot by the front camera and the second data model reaches a third threshold, the images are judged to meet the preset requirements, and the augmented reality registration step can be performed.
The third method comprises the following steps: the processor 42 compares the images shot by the rear camera and the front camera with corresponding data models in a preset model library respectively, when the similarity of the image shot by the rear camera and the first data model reaches a fourth value, the similarity of the image shot by the front camera and the second data model reaches a fourth threshold, and the distance between the geographical position of the terminal and the geographical position of the registered user is less than or equal to the first threshold and the distance between the acceleration value of the terminal and the acceleration value of the registered user is less than or equal to the second threshold, it is determined that the preset requirement is met, and an augmented reality registration step can be performed.
Summarizing the above, the augmented reality registration apparatus and method provided by the present invention compare the first characteristic information of the terminal acquired by the first acquisition module with the characteristic information of the registered user stored in the first preset database by acquiring the current first characteristic information of the terminal, the first characteristic information including geographical location information or geographical location information and acceleration information, acquire the registration information of the registered user when the comparison result is that the registered user matched with the first preset database exists, and perform augmented reality registration according to the registration information; according to the implementation of the method, the geographical position information and the acceleration information of the terminal are obtained and compared with the geographical position information and the acceleration information of the registered user, whether the conditions are met or not is judged, if yes, the registration is carried out, so that the user can compare and judge the information registered by other users at the current position to carry out augmented reality registration, the registration operation of augmented reality is optimized, and the use experience of the user is improved.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (8)
1. An augmented reality registration apparatus, comprising:
the terminal comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring current first characteristic information of the terminal, and the first characteristic information comprises geographical position information and acceleration information;
the first comparison module is used for comparing the acquired geographic position information of the terminal with the geographic position information of the registered user stored in a first preset database, if the registered user with the geographic position information matched exists in the first preset database, then comparing the acquired acceleration information of the terminal with the acceleration information of the registered user stored in the first preset database, and if the acceleration information of the terminal is matched with the acceleration information of the registered user, notifying a second acquisition module to acquire the registration information of the registered user;
a second obtaining module, configured to obtain registration information of a registered user when a comparison result of the first comparing module indicates that the registered user matching current first feature information of the terminal exists in the first preset database;
and the registration module is used for performing augmented reality registration according to the registration information acquired by the second acquisition module.
2. The augmented reality registration apparatus according to claim 1, wherein the matching of the geographical location information of the terminal with the geographical location information of the registered user comprises: the distance between the geographic position of the terminal and the geographic position of the registered user is smaller than or equal to a first threshold value;
the matching of the acceleration information of the terminal and the acceleration information of the registered user comprises the following steps: the direction of the acceleration of the terminal is the same as the direction of the acceleration of the registered user, and the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is smaller than or equal to a second threshold value.
3. The augmented reality registration apparatus according to claim 1 or 2, further comprising:
the third acquisition module is used for acquiring the current image shot by the terminal;
the feature extraction module is used for extracting feature information of the image acquired by the third acquisition module;
the second comparison module is used for comparing the second characteristic information extracted by the characteristic extraction module with a data model stored in a second preset database;
the registration module is further configured to perform augmented reality registration when the comparison result of the second comparison module indicates that the matched data model exists in the second preset database.
4. The augmented reality registration apparatus according to claim 3, wherein the feature extraction module is configured to extract feature information of a marker from the image, the marker including a building as the second feature information.
5. An augmented reality registration method, comprising:
acquiring current first characteristic information of a terminal, wherein the first characteristic information comprises geographical position information and acceleration information;
comparing the acquired geographic position information of the terminal with geographic position information of registered users stored in a first preset database, if the registered users with geographical position information matched exist in the first preset database, comparing the acquired acceleration information of the terminal with the acceleration information of the registered users stored in the first preset database, and if the acceleration information of the terminal is matched with the acceleration information of the registered users, entering a step of acquiring the registration information of the registered users;
if the registered user matched with the current first characteristic information of the terminal exists in the first preset database, acquiring the registration information of the registered user;
and performing augmented reality registration according to the registration information.
6. The augmented reality registration method of claim 5, wherein matching the geographic location information of the terminal with the geographic location information of the registered user comprises: the distance between the geographic position of the terminal and the geographic position of the registered user is smaller than or equal to a first threshold value;
the matching of the acceleration information of the terminal and the acceleration information of the registered user comprises the following steps: the direction of the acceleration of the terminal is the same as the direction of the acceleration of the registered user, and the distance between the value of the acceleration of the terminal and the value of the acceleration of the registered user is smaller than or equal to a second threshold value.
7. The augmented reality registration method according to claim 5 or 6, further comprising:
acquiring a current shot image of the terminal;
extracting characteristic information of the acquired image;
comparing the extracted second characteristic information with a data model stored in a second preset database;
and if the matched data model exists in the second preset database, performing augmented reality registration.
8. The augmented reality registration method according to claim 7, wherein the extracting feature information of the acquired image includes:
feature information of a marker including a building is extracted from the image as the second feature information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611052764.0A CN106681000B (en) | 2016-11-22 | 2016-11-22 | Augmented reality registration device and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611052764.0A CN106681000B (en) | 2016-11-22 | 2016-11-22 | Augmented reality registration device and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106681000A CN106681000A (en) | 2017-05-17 |
| CN106681000B true CN106681000B (en) | 2020-09-11 |
Family
ID=58866665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611052764.0A Active CN106681000B (en) | 2016-11-22 | 2016-11-22 | Augmented reality registration device and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106681000B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108133181B (en) * | 2017-12-12 | 2022-03-18 | 北京小米移动软件有限公司 | Method for acquiring indication information, AR device and storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214000B (en) * | 2011-06-15 | 2013-04-10 | 浙江大学 | Hybrid registration method and system for target objects of mobile augmented reality (MAR) system |
| KR101356192B1 (en) * | 2012-04-26 | 2014-01-24 | 서울시립대학교 산학협력단 | Method and System for Determining Position and Attitude of Smartphone by Image Matching |
| CN103051705A (en) * | 2012-12-19 | 2013-04-17 | 中兴通讯股份有限公司 | Method and device for determining target person and mobile terminal |
| CN103345064B (en) * | 2013-07-16 | 2015-08-26 | 深圳市智帽科技开发有限公司 | The 3D recognition methods of the cap that a kind of integrated 3D identifies and cap |
| CN103489002B (en) * | 2013-09-27 | 2017-03-29 | 广州中国科学院软件应用技术研究所 | A kind of augmented reality method and system |
| CN106066701B (en) * | 2016-07-05 | 2019-07-26 | 上海智旭商务咨询有限公司 | A kind of AR and VR data processing equipment and method |
-
2016
- 2016-11-22 CN CN201611052764.0A patent/CN106681000B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106681000A (en) | 2017-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11967109B2 (en) | Vehicle localization using cameras | |
| US11721098B2 (en) | Augmented reality interface for facilitating identification of arriving vehicle | |
| KR101758576B1 (en) | Method and apparatus for detecting object with radar and camera | |
| KR101147748B1 (en) | A mobile telecommunication device having a geographic information providing function and the method thereof | |
| WO2014115563A1 (en) | Driving support device, driving support method, and recording medium storing driving support program | |
| CN100382074C (en) | Position tracking system and method based on digital video processing technique | |
| JP2022520544A (en) | Vehicle intelligent driving control methods and devices, electronic devices and storage media | |
| CN111192341A (en) | Method and device for generating high-precision map, automatic driving equipment and storage medium | |
| KR102383499B1 (en) | Method and system for generating visual feature map | |
| WO2022041869A1 (en) | Road condition prompt method and apparatus, and electronic device, storage medium and program product | |
| CN108846336B (en) | Target detection method, device and computer readable storage medium | |
| CN104143074A (en) | Method and equipment for generating motion feature codes on the basis of motion feature information | |
| US20220076469A1 (en) | Information display device and information display program | |
| US11334174B2 (en) | Universal pointing and interacting device | |
| CN108320497B (en) | Method and device for detecting behavior of pedestrian running red light and computer readable storage medium | |
| EP3648005B1 (en) | Passage determination method and device | |
| CN114554391A (en) | Parking lot vehicle searching method, device, equipment and storage medium | |
| CN106681000B (en) | Augmented reality registration device and method thereof | |
| CN113221756A (en) | Traffic sign detection method and related equipment | |
| CN113345107A (en) | Augmented reality data display method and device, electronic equipment and storage medium | |
| CN110470293B (en) | Navigation method and mobile terminal | |
| CN111105641A (en) | BIM model-based vehicle searching method and device and readable storage medium | |
| CN111444749A (en) | Method and device for identifying road surface guide mark and storage medium | |
| JP2011214961A (en) | Reference pattern information generating device, method, program and general vehicle position specifying device | |
| CN109164962A (en) | A method of pushing away the profile information for broadcasting image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |