TWI659327B - Interaction method of augmented reality identification and system thereof - Google Patents

Abstract

The invention provides an interactive method for augmented reality authentication, which includes the following steps: a wireless connection step, a terminal display device receiving a wireless identification signal sent by a physical object, and connecting to a server; a data obtaining step, Confirming a first display information corresponding to the identification signal in an image database of the server and downloading the first display information to the terminal display device; the augmented reality image display step is to use a camera module of the terminal display device to virtualize one of the physical objects The object presentation surface is photographed, the first display information is integrated with the virtual object presentation surface, and finally the first display information is presented on the virtual object presentation surface through a display module. Use the unique identification signal of the physical object to prevent the physical object from being counterfeited.

Description

Interactive method and system for augmented reality authentication

The invention relates to an interactive technology and method for augmented reality, in particular to an interactive method and system for augmented reality authentication.

Pressing, Augmented Reality (AR) is a combination of real-world images and virtual objects, which can extend the user's visual experience by providing interaction between users and virtual objects. Nowadays, augmented reality technology is mainly to download the virtual objects that need to be displayed directly to the user's electronic display device by using a web link webpage or using a two-dimensional bar code login, and then the user starts an application to link the virtual objects with the real environment Perform the corresponding display interaction.

For example, the Republic of China Patent No. I568481 discloses an augmented reality game system including a processor that reads environmental data of a real environment, creates a virtual space according to the environmental data, and creates a virtual target in the virtual space. A wearable display device connected to the processor, the processor receiving information of the virtual target and enabling a user to see a target image of the virtual target mapped to a real environment; and a smart device connected to the wearable The display device, the wearable display device uses a smart device including a display light source as an image display source, so the user sees a corresponding variety of target images in a real environment, thereby making the game richer and more varied.

However, since the aforementioned augmented reality game system has previously downloaded the virtual target data corresponding to the display, and the virtual target data has not been set up with an authorization authentication system, other users can freely download the virtual target data for game interaction and generate The inability to protect the confidentiality of virtual target data. Therefore, how to design an augmented reality technology to solve the problem of the confidentiality of the known virtual target data is a goal that related industry players want to work together.

In order to solve the above problems, the present invention provides an interactive method and system for augmented reality authentication. Before the augmented reality interaction, the terminal display device needs to receive signals of physical objects, and must confirm before downloading virtual objects. It can be displayed on the screen of the terminal display device to improve the confidentiality of the overall system.

An embodiment of the present invention provides an interactive method for augmented reality authentication, which includes the following steps: wireless connection: a terminal display device receives a wireless identification signal sent by a physical object, and enters a server through an Internet connection Data acquisition: confirming a first display information corresponding to the identification signal in an image database of a server through a terminal display device and downloading the first display information to the terminal display device; and augmented reality image display: one of the terminal display devices The photographing module photographs a virtual object presentation surface of a solid object, and integrates the first display information and the virtual object presentation surface through a data processing module of a terminal display device, and then uses a display module of a terminal display device to The first display information is presented on the virtual object presentation surface.

Another embodiment of the present invention provides an interactive system for augmented reality authentication, which includes: a physical object having a wireless signal transmitting module for transmitting an identification signal, and the physical object having a virtual object presentation A server, which has an image database, the image database stores a first display information; and a terminal display device, which includes a data processing module and a wireless connection module which is an electrical connection data processing module, A display module and a photographing module. The wireless connection module receives the identification signal, and enters the server through the Internet connection and uploads the identification signal, and confirms downloading the first display information corresponding to the identification signal. The photographing module verifies the virtual object. The presentation surface is photographed, and the first display information is integrated with the virtual object presentation surface through a data processing module, and then the first display information is presented on the virtual object presentation surface through the display module.

Therefore, the present invention receives the identification signal of the physical object through the terminal display device, and downloads the first display information correspondingly after the server is confirmed and verified, and then uses the display module to present the first display on the virtual object presentation surface of the physical object. Information. Therefore, the unique identification signal of the physical object is used to avoid the possibility of counterfeiting of the physical object, thereby improving the uniqueness and confidentiality of the overall system.

In order to facilitate the description of the central idea of the present invention in the above-mentioned summary of content, specific embodiments are described below. Various objects in the embodiments are drawn according to the proportions suitable for enumeration, rather than the proportions of the actual components, which will be described beforehand.

As shown in FIGS. 1 to 6, the present invention provides an interactive system for augmented reality authentication, which includes: a physical object 10, a server 20, and a terminal display device 30. The physical object 10 and the terminal display device 30 are wireless. The server 20 and the terminal display device 30 are connected to each other via the Internet. The terminal display device 30 may be a mobile device of a smart phone or a tablet computer, a non-mobile device of a personal computer, or a head-mounted display device.

With particular reference to FIG. 1 and FIG. 5, the physical object 10 has a wireless signal sending module 11 and a virtual object presentation surface 12. The wireless signal sending module 11 is used to send an identification signal. Among them, the wireless signal sending module 11 The near-field communication method, the radio frequency identification method, and the like can be used to send the identification signal. In the embodiment of the present invention, the wireless signal sending module 11 is wirelessly connected using the low-power Bluetooth (Bluetooth 4.0) method and sends the identification signal to the terminal. The display device 30, and the terminal display device 30 presents the virtual object corresponding to the virtual object presentation surface 12 after receiving the identification signal.

Please refer to FIG. 2, the server 20 has a control module 21, an image database 22 and a wireless communication module 23. The image database 22 and the wireless communication module 23 are electrically connected to the control module 21. The image database 22 has a storage unit 221 and a verification unit 222. The storage unit 221 is configured to store a plurality of virtual object display information. The virtual object display information includes a first display information and a second display information in this embodiment. The first display information and the second display information are text, graphics or videos related to the virtual object. The verification unit 222 is used to confirm the uploaded identification signal, and the first display information corresponding to the identification signal is downloaded from the storage unit 221, and then The wireless communication module 23 transmits the first display information and the second display information to the terminal display device 30 by using the Internet.

The terminal display device 30 includes a data processing module 31, a wireless connection module 32, a display module 33, and a photographing module 34. The wireless connection module 32, the display module 33, and the photographing module 34 are electrically connected to data processing. Module 31, the data processing module 31 has a signal strength judging unit 311. When there are a plurality of physical objects 10 around the terminal display device 30, the signal strength judging unit 311 is used to judge the strength of the identification signal sent by each physical object 10. , So that the data processing module 31 can download the displayed first display information among the plurality of physical objects 10 based on the strength of the signal. By default, the physical object 10 with the strongest signal is the terminal display device. 30 corresponding physical objects to be processed 10. In addition, in the embodiment of the present invention, the data processing module 31 further includes a distance judgment unit 312. The distance judgment unit 312 judges the distance between each physical object 10 and the terminal display device 30 through the photographing module 34, and cooperates with a signal strength judgment unit. 311 accurately determine which of the physical objects 10 captured by the photography module 34, and then download the first display information corresponding to the photographed physical objects 10, thereby solving the problem that multiple physical objects 10 are beside the terminal display device 30 and cannot be correct The problem of displaying the displayed first display information corresponding to the photographed solid object 10 achieves the purpose of accurately displaying the desired first display information even in the plurality of solid objects 10.

In addition, as shown in FIG. 6, the data processing module 31 further includes a trigger unit 313. The trigger unit 313 triggers according to a specific condition C, so that the terminal display device 30 receives the second display information. The specific condition C may be A group consisting of a gesture condition, a sound condition, a perspective transition condition, a time trigger condition, and a combination thereof.

The wireless connection module 32 is used to receive the identification signal sent by the physical object 10 and enter the server 20 through an Internet connection and upload the identification signal. The verification unit 222 of the server 20 confirms whether the identification signal meets the verification. After being judged to be in compliance with the verification, the wireless connection module 32 downloads the first display information corresponding to the identification signal from the storage unit 221 of the server 20. The camera module 34 is a camera lens of the terminal display device 30, and the camera module 34 is used for the entity. The virtual object presentation surface 12 of the object 10 is photographed, and the first display information is integrated with the virtual object presentation surface 12 through the data processing module 31, and then the first display information is presented on the virtual object presentation surface 12 through the display module 33. In the embodiment of the present invention, the display module 33 is a display screen of the terminal display device 30; therefore, in the process of use, it is necessary to match the physical object 10 and use a specific identification signal to present the virtual object correspondingly, thereby avoiding The physical object 10 suffers the effect of counterfeiting.

In addition, when the first display information is to be switched to the second display information, the user activates the specific condition C on the terminal display device 30. For example, the user makes the trigger unit 313 receive the terminal display device 30 in a left-right swing gesture. Specific condition C, at this time, the first display information control is switched to the second display information, and the second display information is switched and displayed on the virtual object presentation surface 12 through the display module 33.

In addition to the above system embodiment, an embodiment of the present invention provides an interactive method for augmented reality authentication, which includes the following steps:

Wireless connection S1: the terminal display device 30 receives the identification signal sent by the wireless signal sending module 11 of the physical object 10, wherein the wireless signal sending module 11 can be composed of a near field communication method, a radio frequency identification method and a combination thereof For the group, in the embodiment of the present invention, the wireless signal sending module 11 sends the identification signal to the terminal display device 30 using the low-power Bluetooth method. At this time, the wireless connection module 32 of the terminal display device 30 receives the identification signal and An internet link enters server 20.

Data acquisition S2: The user uploads the identification signal to the verification unit 222 of the image database 22 through the terminal display device 30. The verification unit 222 confirms whether the uploaded identification signal meets the verification. If it is judged that the verification is satisfied, the wireless connection mode of the terminal display device 30 The group 32 may download the virtual object display information corresponding to the identification signal in the storage unit 221, wherein the virtual object display information may include a first display information and a second display information.

Augmented reality image display S3: as shown in FIG. 2, FIG. 3 and FIG. 5, the camera module 34 of the terminal display device 30 is activated, and the virtual object presentation surface 12 of the physical object 10 is photographed, and then displayed through the terminal The data processing module 31 of the device 30 integrates the first display information with the virtual object presentation surface 12. The user displays the first display information on the virtual object presentation surface 12 through the display module 33 of the terminal display device 30. Among them, The first display information is a virtual round table, so the user directly displays the virtual round table on the physical object 10 through the display module 33 of the terminal display device 30, and can directly observe and determine that the first display information corresponds to the shape, pattern, and shape of the real item. Is it for what you want to buy.

In addition, when there are three physical objects 10 around the terminal display device 30, and each physical object 10 sends an identification signal at the same time, as shown in FIGS. 2 and 4, the distance between one of the physical objects 10a and the terminal display device 30 D1 is 15 cm, the intensity of the received identification signal is 7 dBm, the distance between the other physical object 10b and the terminal display device 30 is D2, and the intensity of the received identification signal is 4 dBm, and the other physical object 10 c and the terminal The distance D3 between the display devices 30 is 9 cm, and the intensity of the received identification signal is 11 dBm. The distance determination unit 312 of the terminal display device 30 determines the distance based on the physical object 10 captured by the camera module 34, and then uses the signal The strength determination unit 311 selects the corresponding identification signal of the captured physical object 10 on the photographing module 34 from the received physical objects 10a, 10b, and 10c, and downloads the corresponding first display information, so even the terminal display device 30 There are a plurality of solid objects 10 around, and it can also accurately receive the identification signal and present the desired first display information correspondingly.

Switch image display S4: as shown in Figure 2, Figure 3 and Figure 6, if you want to switch the display of virtual object display information, the user can use the trigger unit 313 in the data processing module 31 to trigger based on the specific condition C. In the embodiment of the present invention, the specific condition C is a swing gesture of left and right to switch the first display information to the second display information, so that the terminal display device 30 downloads the second display information from the image database 22, and finally the second display information The display information is integrated with the virtual object presentation, and then the virtual object presentation surface 12 is switched to the second display information by the display module 33. The second display information may be other furniture shapes.

In addition, when the user can pass through before purchasing the processing machine, the display module 33 of the terminal display device 30 displays the first display information of the processing machine on the virtual object presentation surface 12, and the user may not need to arrive at the factory site at this time. The overall structure of the processing machine can also be clearly understood. If the user wants to clearly understand the internal structure or other aspects of the processing machine, the terminal display device 30 may switch and present the second display information according to the specific condition C.

For example: when the user swings the gesture left and right, the processing unit corresponding to the specific condition C will remove part of the shell structure of the processing machine, at this time the second display information corresponds to the internal part structure of the processing machine; if you want to understand more clearly When the structural characteristics of the processing machine are enlarged, the user will make a gesture to make the second display information correspond to the enlarged structure of the processing machine. If you want to know the other structure-oriented structures of the processing machine, you can use the physical object 10 or the terminal display device. The viewing angle of 30 turns. At this time, the second display information will correspond to the rear structure of the processing machine, so the user can understand the internal performance of the processing machine more clearly.

In addition, the terminal display device 30 receives the first display information and the second display information by downloading to the image database 22 in sections, thereby reducing the user's waiting time for downloading, and speeding up the time and speed of displaying virtual objects.

Accordingly, the present invention has the following characteristics:

1. When a user performs an augmented reality interaction, first, the terminal display device 30 receives the identification signal of the physical object 10, and downloads the first display information correspondingly after the server 20 is confirmed and verified, and then uses the display module 33 in the The first display information is presented on the virtual object presentation surface 12 of the physical object 10, so the unique identification signal of the physical object 10 is used to prevent the physical object 10 from being counterfeited.

Second, the signal strength judgment unit 311 and the distance judgment unit 312 can make accurate judgments between multiple groups of physical objects 10 to avoid multiple groups of identification signals being received by the terminal display device 30 at the same time without knowing how to make a selection judgment. .

Third, the triggering unit 313 of the terminal display device 30 triggers according to the specific condition C, so that the terminal display device 30 receives and downloads the second display information from the image database 22, thereby reducing the user's waiting time for downloading and speeding up the display of virtual Time and speed of objects.

Many modifications and changes for those skilled in the art are obvious without departing from the scope and spirit of the present invention. Other embodiments of the present invention are obvious to those skilled in the art from the description of the description and the method of the present invention disclosed herein. The description and examples are merely illustrative, and the true scope and spirit of the present invention will be pointed out in the following patent application scope.

 Physical objects 10, 10a, 10b, 10c  Distance judgment unit 312  Wireless signal transmission module 11  Trigger unit 313  Dummy presentation surface 12  Wireless connection module 32  Server 20  Display module 33  Control module 21  Photography module 34  Image Database 22  Specific condition C  Storage unit 221  Distance D1, D2, D3  Verification unit 222  Wireless Link S1  Wireless communication module 23  Data acquisition S2  Terminal display device 30  Augmented reality image shows S3  Data processing module 31  Switch image display S4  Signal strength judgment unit 311

FIG. 1 is a system architecture diagram of the present invention. FIG. 2 is a functional block diagram of the system of the present invention. Figure 3 is a flowchart of the steps of the present invention. FIG. 4 is a schematic diagram (1) of a use state of the present invention, showing that the terminal display device receives identification signals sent by a plurality of physical objects. FIG. 5 is a schematic diagram (2) of a use state of the present invention, showing that a terminal display device presents a virtual object on a virtual object presentation surface of the physical object. FIG. 6 is a schematic diagram (3) of the use state of the present invention, showing that the terminal display device controls the switching of virtual objects.

Claims (9)

An interactive method for augmented reality authentication includes the following steps: wireless connection: a terminal display device receives a wireless identification signal sent by a physical object and enters a server through an Internet connection; data acquisition: through the terminal The display device confirms a first display information corresponding to the identification signal in an image database of the server, and downloads the first display information to the terminal display device; and the augmented reality image display: a photography module of the terminal display device Photographing a virtual object presentation surface of the physical object, and integrating the first display information with the virtual object presentation surface through a data processing module of the terminal display device, and then using a display model of the terminal display device The first display information is displayed on the virtual object presentation surface. Among the plurality of physical objects, a distance determination unit of the terminal display device judges the physical objects and the terminal display device through the photography module. Distance, together with a signal strength judgment unit of the terminal display device to judge the strength of the identification signals, and Among those physical objects by distance and signal strength judgment should display the first display information. The interactive method of augmented reality authentication according to claim 1, further comprising a step after the augmented reality image display step: switching the image display: by a trigger unit in the data processing module according to A specific condition is triggered to cause the terminal display device to download a second display information from the image database, and switch the second display information on the virtual object presentation surface through the display module. The interactive method of augmented reality authentication according to claim 2, wherein the specific condition is selected from the group consisting of a gesture condition, a sound condition, a perspective transition condition, a time trigger condition, and a combination thereof . The interactive method of augmented reality authentication according to claim 1, wherein the method for transmitting the identification signal by the physical object is selected from the group consisting of a near field communication method, a radio frequency identification method, and a combination thereof. An interactive system for augmented reality authentication includes: a physical object having a wireless signal transmitting module for transmitting an identification signal, and the physical object has a virtual object presentation surface; and a server having An image database, which stores a first display information; and a terminal display device, which includes a data processing module, a wireless connection module, a display module and a photographing module, the wireless connection module The display module, the display module, and the photographing module are electrically connected to the data processing module. The wireless connection module receives the identification signal, and connects to the server through an Internet connection and uploads the identification signal, and confirms that the download should correspond. Identifying the first display information of the signal, the photographing module photographs the virtual object presentation surface, and integrates the first display information with the virtual object presentation surface through the data processing module, and then passes through the display module Displaying the first display information on the virtual object presentation surface, wherein the data processing module includes a distance judgment unit and a signal strength judgment sheet The distance judging unit judges the distance between the physical object and the terminal display device through the photographing module, and the signal strength judging unit is used to judge the strength of the identification signal, so that the data processing module can be used for plural physical objects. Among them, the first display information to be displayed is judged by distance. The augmented reality authentication interactive system according to claim 5, wherein the image database has a storage unit and a verification unit for storing the first display information, and the verification unit is used to confirm the upload And the first display information corresponding to the identification signal is downloaded from the storage unit. The augmented reality authentication interactive system according to claim 5, wherein the wireless signal sending module is performed by using a method selected from the group consisting of a near field communication method, a radio frequency identification method and a combination thereof. The identification signal is sent. The augmented reality authentication interactive system according to claim 6, wherein the image database further stores a second display information, the data processing module includes a trigger unit, and the trigger unit triggers according to a specific condition, The terminal display device is caused to receive the second display information, and switch and present the second display information on the virtual object presentation surface through the display module. The augmented reality authentication interactive system according to claim 8, wherein the specific condition is selected from the group consisting of a gesture condition, a sound condition, a perspective transition condition, a time trigger condition, and a combination thereof .