TW201913438A - Interaction method of augmented reality identification and system thereof - Google Patents

Abstract

An interaction method of augmented reality identification includes (a) wirelessly connecting, receiving a wireless identification signal from a physical element and accessing a server; (b) data acquiring, confirming a first displaying information corresponding to the identification signal in an image database of the server, and downloading the first displaying information to the terminal displaying device; and (c) AR image displaying, capturing the image of a presenting face of a virtual object by an image capturing module of the terminal displaying device, and integrating the first displaying information with the presenting face of the virtual object, and presenting the first displaying information on the presenting face of the virtual object through a displaying module. By use of the unique identification signal of the physical element, counterfeit of the physical element is avoided.

Description

Augmented reality authentication interaction method and system thereof

The invention relates to an interactive technology and method for augmenting reality, in particular to an interactive method and system for augmenting reality authentication.

Press, Augmented Reality (AR) is a combination of real-world images and virtual objects. It can extend the user's visual experience by providing an interactive way of combining users and virtual objects. Nowadays, the augmented reality technology mainly uses the virtual object to be displayed directly to use the network to link the webpage or use the two-dimensional barcode to download and download the electronic display device to the user, and then the user launches the application to virtualize the object and the real environment. Perform corresponding display interactions.

For example, the Republic of China Patent No. I568481 discloses an augmented reality game system, which includes a processor that reads an environmental material of a real environment, creates a virtual space according to the environmental data, and creates a virtual target in the virtual space. a wearable display device coupled to the processor, the processor receiving information of the virtual target, and causing a user to see the virtual target mapped to a target image of the real environment; and a smart device connected to the wearable The display device, the wearable display device uses a smart device to include a display light source as a source of image display, so that the user sees a plurality of target images in a real environment, thereby making the game more varied.

However, since the augmented reality game system described above has previously downloaded the corresponding virtual target data, and the virtual target data does not have an authorization authentication system, other users are free to download the virtual target data for game interaction, thereby generating The issue of the confidentiality of virtual target data cannot be guaranteed. Therefore, how to design an augmented reality technology to solve the problem of the confidentiality of the conventional virtual target data is the goal of the relevant industry.

In order to solve the above problems, the present invention provides an interactive method for augmenting reality authentication and a system thereof. Before augmenting the real-world interaction, the terminal display device needs to receive the signal of the physical object, and must confirm before downloading the virtual object, and finally It can be presented on the screen of the terminal display device to enhance the confidentiality of the overall system.

An embodiment of the present invention provides an interactive method for augmented reality authentication, which includes the following steps: wireless connection: a terminal display device receives a wireless identification signal sent by a physical object, and enters a servo through an internet connection. Data acquisition: confirming a first display information corresponding to the identification signal in the image database of the server through the terminal display device, and downloading to the terminal display device; and augmenting the reality image display: one of the terminal display devices The photographic module captures a virtual object presentation surface of the physical object, and integrates the first display information and the virtual object presentation surface through one of the data processing modules of the terminal display device, and then displays the module through one of the terminal display devices. The first display information is presented on the virtual object presentation surface.

Another embodiment of the present invention provides an interactive system for augmented reality authentication, comprising: a physical object having a wireless signal transmitting module for transmitting an identification signal, and the physical object has a virtual object presentation a server having an image database, the image database storing a first display information, and a terminal display device including a data processing module and a wireless connection module electrically connected to the data processing module, a display module and a photographic module, the wireless connection module receives the identification signal, and connects to the server via the Internet connection and uploads the identification signal, and confirms that the first display information corresponding to the identification signal is downloaded, and the photographic module pairs the virtual object The presentation surface is photographed, and the first display information and the virtual object presentation surface are integrated through the data processing module, and then the first display information is presented on the virtual object presentation surface through the display module.

Therefore, the present invention receives the identification signal of the physical object by the terminal display device, and correspondingly downloads the first display information after the server passes the confirmation verification, and then uses the display module to present the first display on the virtual object presentation surface of the physical object. News. Therefore, the unique identification signal of the physical object can be used to avoid the possibility of counterfeiting of the physical object, thereby improving the uniqueness and confidentiality of the overall system.

For the convenience of the description, the central idea expressed by the present invention in the column of the above summary of the invention is expressed by the specific embodiments. The various items in the examples are drawn to scale in the description and not to the actual elements, and are described in the foregoing.

As shown in FIG. 1 to FIG. 6 , the present invention provides an interactive system for augmented reality authentication, comprising: a physical object 10, a server 20 and a terminal display device 30, and the physical object 10 and the terminal display device 30 are wireless. The server 20 and the terminal display device 30 are connected to each other via the Internet. The terminal display device 30 can be a mobile device of a smart phone or a tablet, a non-mobile device of a personal computer, or a head mounted display device.

Referring to FIG. 1 and FIG. 5, the physical object 10 has a wireless signal transmitting module 11 and a virtual object presentation surface 12, and the wireless signal transmitting module 11 is configured to send an identification signal, wherein the wireless signal transmitting module 11 In the embodiment of the present invention, the wireless signal transmitting module 11 wirelessly connects and transmits the identification signal to the terminal by using a low-power Bluetooth (Bluetooth 4.0) method. The display device 30 displays the virtual object on the virtual object presentation surface 12 after receiving the identification signal.

As shown in FIG. 2, the server 20 has a control module 21, an image database 22, and a wireless communication module 23. The image database 22 and the wireless communication module 23 are electrically coupled to the control module 21. The image database 22 has a storage unit 221 and a verification unit 222. The storage unit 221 is configured to store a plurality of virtual objects to display information. The virtual object display information includes a first display information and a second display information in the embodiment. The first display information and the second display information are texts, patterns, or videos related to the virtual object. The verification unit 222 is configured to confirm the uploaded identification signal, and download the first display information corresponding to the identification signal in the storage unit 221, and then The wireless communication module 23 transmits the first display information and the second display information to the terminal display device 30 by using the Internet.

The terminal display device 30 includes a data processing module 31, a wireless connection module 32, a display module 33, and a camera module 34. The wireless connection module 32, the display module 33, and the camera module 34 are electrically connected to the data processing. The module 31, the data processing module 31 has a signal strength determining unit 311. When the terminal display device 30 has a plurality of physical objects 10, the signal strength determining unit 311 is used to determine the strength of the identification signal sent by each physical object 10. The data processing module 31 can determine, in the plurality of physical objects 10, the first display information that should be downloaded and displayed by the signal strength. Under the preset condition, the physical object 10 with the strongest received signal is the terminal display device. 30 physical objects 10 that should be processed accordingly. In addition, in the embodiment of the present invention, the data processing module 31 further has a distance determining unit 312. The distance determining unit 312 determines the distance between each physical object 10 and the terminal display device 30 by the camera module 34, and matches the signal strength determining unit. The 311 accurately determines which of the physical objects 10 captured by the camera module 34, and then downloads the first display information corresponding to the photographed physical object 10, thereby solving that the plurality of physical objects 10 are not adjacent to the terminal display device 30. The problem of displaying the displayed first display information corresponding to the photographed physical object 10 is achieved, so that the desired first display information can be accurately displayed in the plurality of physical objects 10.

In addition, please refer to FIG. 6 , the data processing module 31 further has a trigger unit 313 , and the trigger unit 313 triggers according to a specific condition C, so that the terminal display device 30 receives the second display information, wherein the specific condition C can be A group consisting of a gesture condition, a sound condition, a perspective transition condition, a time trigger condition, and a combination thereof.

The wireless connection module 32 is configured to receive the identification signal sent by the physical object 10, and connect to the server 20 via the Internet connection and upload the identification signal. The verification unit 222 of the server 20 confirms whether the identification signal is in compliance with the verification, and if the identification signal is uploaded. After the verification is verified, the wireless connection module 32 downloads the first display information corresponding to the identification signal in the storage unit 221 of the server 20. The photography module 34 is a photographic lens of the terminal display device 30, and the photography module 34 is used for the entity. The virtual object presentation surface 12 of the object 10 is photographed, and the first display information is integrated with the virtual object presentation surface 12 through the data processing module 31, and then the first display information is presented on the virtual object presentation surface 12 through the display module 33. In the embodiment of the present invention, the display module 33 is a display screen of the terminal display device 30; thereby, the physical object 10 needs to be matched with the physical object 10 during use, and the virtual object can be correspondingly presented, thereby avoiding The physical object 10 suffers from counterfeiting.

In addition, when the first display information is to be switched to the second display information, the user sends the specific condition C to the terminal display device 30. For example, the user causes the trigger unit 313 to receive the left and right swing gestures to the terminal display device 30. The specific condition C, at this time, the first display information manipulation is switched to the second display information, and the second display information is switched and displayed on the virtual object presentation surface 12 through the display module 33.

In addition to the above system embodiment, an embodiment of the present invention provides an interactive method for augmented reality authentication, which includes the following steps:

The wireless connection S1: the terminal display device 30 receives the identification signal sent by the wireless signal transmitting module 11 of the physical object 10, wherein the wireless signal transmitting module 11 can be composed of a near field communication method, a radio frequency identification method, and a combination thereof. In the embodiment of the present invention, the wireless signal transmitting module 11 transmits the identification signal to the terminal display device 30 by using the low-power Bluetooth mode. At this time, the wireless connection module 32 of the terminal display device 30 receives the identification signal, and The internet connection enters the server 20.

The data acquisition S2: the user uploads the identification signal to the verification unit 222 of the image database 22 through the terminal display device 30, and the verification unit 222 confirms whether the uploaded identification signal conforms to the verification. If the verification is satisfied, the wireless connection mode of the terminal display device 30 is determined. The group 32 can download the virtual object display information corresponding to the identification signal in the storage unit 221, wherein the virtual object display information can include a first display information and a second display information.

Augmented Reality Image Display S3: As shown in FIG. 2, FIG. 3 and FIG. 5, the camera module 34 of the terminal display device 30 is activated, and the virtual object presentation surface 12 of the physical object 10 is photographed, and then displayed through the terminal. The data processing module 31 of the device 30 integrates the first display information with the virtual object presentation surface 12, and the user displays the first display information on the virtual object presentation surface 12 by the display module 33 of the terminal display device 30. The first display information is a virtual round table. Therefore, the user directly presents a virtual round table on the physical object 10 through the display module 33 of the terminal display device 30, and can directly observe and determine the shape, pattern, and shape of the first display information corresponding to the real object. Whether it is what you want to buy.

In addition, when there are three physical objects 10 around the terminal display device 30, and each physical object 10 simultaneously transmits an identification signal, as shown in FIG. 2 and FIG. 4, the distance between one of the physical objects 10a and the terminal display device 30. D1 is 15 cm, the received identification signal strength is 7 dBm, the distance D2 between the other physical object 10b and the terminal display device 30 is 21 cm, the received identification signal strength is 4 dBm, and the other physical object 10c and the terminal The distance D3 between the display devices 30 is 9 cm, and the received identification signal strength is 11 dBm. The distance determining unit 312 of the terminal display device 30 determines the distance according to the physical object 10 captured by the camera module 34, and then the signal is determined by the signal. The strength determining unit 311 selects the identification signal of the physical object 10 corresponding to the image taken by the camera module 34 from the received physical objects 10a, 10b, and 10c, and downloads the corresponding first display information, so that even the terminal display device 30 There are a plurality of physical objects 10 around, which can also accurately receive the identification signal and correspondingly present the desired first display information.

Switching the image display S4: as shown in FIG. 2, FIG. 3 and FIG. 6, if the user wants to switch to display the virtual object display information, the user can trigger by the trigger unit 313 in the data processing module 31 according to the specific condition C. In the embodiment of the present invention, the specific condition C is a left-right swing gesture mode to control the switching of the first display information to the second display information, so that the terminal display device 30 downloads the second display information from the image database 22, and finally the second The display information is integrated with the virtual object presentation, and then displayed on the virtual object presentation surface 12 by the display module 33 to display the second display information, wherein the second display information can be other furniture shapes.

In addition, when the user can pass through before purchasing the processing machine, the display module 33 of the terminal display device 30 presents the first display information of the processing machine on the virtual object presentation surface 12, and the user can not arrive at the factory site at this time. The overall structure of the processing machine can also be clearly understood. If the user wants to clearly understand the internal structure or other orientation of the processing machine, the terminal display device 30 can display the second display information according to the specific condition C.

For example, when the user swings the left and right gestures, the delivery unit corresponding to the specific condition C will remove part of the outer casing structure of the processing machine. At this time, the second display information corresponds to the internal part structure of the processing machine; if it is to be more clearly understood When processing the structural features of the machine, the user enlarges the gesture, so that the second display information corresponds to the enlarged structure of the processing machine; if you want to know the other structure of the processing machine, the physical object 10 or the terminal display device can be The viewing angle of 30 is turned, and the second display information correspondingly presents the rear side structure of the processing machine, so that the user can more clearly understand the internal performance of the processing machine.

In addition, the terminal display device 30 receives the first display information and the second display information in a segment download mode to the image database 22, thereby shortening the time for the user to wait for the download and speeding up the display of the time and speed of the virtual object.

Thereby, the invention has the following characteristics:

1. When the user performs the augmented reality interaction, the terminal display device 30 first receives the identification signal of the physical object 10, and after the server 20 passes the verification and verification, correspondingly downloads the first display information, and then uses the display module 33 to The first display information is presented on the virtual object presentation surface 12 of the physical object 10, so the unique identification signal of the physical object 10 is used to prevent the physical object 10 from being subjected to counterfeiting.

2. The signal strength determining unit 311 and the distance determining unit 312 can accurately determine between the plurality of sets of physical objects 10, so as to prevent the plurality of sets of identification signals from being received by the terminal display device 30 at the same time without knowing how to make a selection judgment. .

3. The trigger unit 313 of the terminal display device 30 triggers according to the specific condition C, so that the terminal display device 30 receives the second display information from the image database 22, thereby shortening the time for the user to wait for the download, and simultaneously speeding up the display virtual The effect of the time and speed of the object.

Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the invention. Other embodiments of the invention will be apparent to those skilled in the art from the description of the invention. The specification and examples are merely illustrative, and the true scope and spirit of the invention will be pointed out

10, 10a, 10b, 10c‧‧‧ physical objects

312‧‧‧Distance unit

11‧‧‧Wireless signal transmission module

313‧‧‧Trigger unit

12‧‧‧Virtual object presentation

32‧‧‧Wireless Connection Module

20‧‧‧Server

33‧‧‧Display module

21‧‧‧Control Module

34‧‧‧Photography module

22‧‧‧Image database

C‧‧‧Specific conditions

221‧‧‧ storage unit

D1, D2, D3‧‧‧ distance

222‧‧‧ verification unit

S1‧‧‧Wireless Link

23‧‧‧Wireless communication module

S2‧‧‧Information acquisition

30‧‧‧Terminal display device

S3‧‧‧Augmented Reality Image Display

31‧‧‧Data Processing Module

S4‧‧‧Switch image display

311‧‧‧Signal Strength Judgment Unit

1 is a system architecture diagram of the present invention. 2 is a functional block diagram of the system of the present invention. Figure 3 is a flow chart of the steps of the present invention. FIG. 4 is a schematic diagram (1) of the use state of the present invention, which shows that the terminal display device receives the identification signal sent by a plurality of physical objects. FIG. 5 is a schematic diagram of the use state of the present invention (2), showing that the terminal display device presents a virtual object on the virtual object presentation surface of the physical object. FIG. 6 is a schematic diagram (3) of the use state of the present invention, showing that the terminal display device controls the switching of the virtual object.

Claims (13)

An interactive method for augmenting reality authentication, comprising the following steps: Wireless connection: a terminal display device receives a wireless identification signal sent by a physical object, and accesses a server through an internet connection; data acquisition: through the terminal The display device confirms a first display information corresponding to the identification signal in an image database of the server, and downloads to the terminal display device; and augmented reality image display: one of the terminal display device The virtual object presentation surface of the physical object is photographed, and the first display information is integrated with the virtual object presentation surface through a data processing module of the terminal display device, and then displayed by one of the terminal display devices. The group presents the first display information on the virtual object presentation surface. The interactive method for augmented reality authentication according to claim 1, wherein the step of displaying the augmented reality image further comprises a step of: switching the image display: by one of the data processing modules, the triggering unit is A specific condition is triggered, and the terminal display device downloads a second display information from the image database, and displays the second display information by switching the virtual object presentation surface through the display module. The interactive method for augmented reality authentication according to claim 2, wherein the specific condition is selected from the group consisting of a gesture condition, a sound condition, a view transfer condition, a time trigger condition, and a combination thereof. . The interactive method for augmented reality authentication according to claim 1, wherein the entity object sends the identification signal in a manner selected from the group consisting of a near field communication method, a radio frequency identification method, and a combination thereof. The interactive method for augmented reality authentication according to claim 1, wherein the physical object is plural, and the signal strength determining unit of the terminal display device determines the identification signal strength of the physical objects, and displays the corresponding A display of information. The interactive method for augmented reality authentication according to claim 1, wherein the physical object is plural, and the distance determining unit of the terminal display device determines, by the camera module, the physical object and the terminal display device. The distance is matched with the signal strength determining unit of the terminal display device to determine the strength of the identification signals, and the first display information should be displayed by the distance and the signal strength among the physical objects. An interactive system for augmented reality authentication, comprising: a physical object having a wireless signal transmitting module for transmitting an identification signal, wherein the physical object has a virtual object presentation surface; and a server having An image database storing a first display information; and a terminal display device comprising a data processing module, a wireless connection module, a display module and a camera module, the wireless connection module The display module and the camera module are electrically connected to the data processing module, and the wireless connection module receives the identification signal, and connects to the server via the Internet connection and uploads the identification signal, and confirms that the download corresponds. Identifying the first display information of the signal, the camera module photographs the virtual object presentation surface, and integrates the first display information and the virtual object presentation surface through the data processing module, and then through the display module The first display information is presented on the virtual object presentation surface. The interactive system for augmented reality authentication according to claim 7, wherein the physical object is plural, the data processing module includes a signal strength determining unit, and the signal strength determining unit is configured to determine the strength of the identification signal. And the data processing module can determine, by the signal strength, the first display information that should be displayed in the plurality of physical objects. The interactive system for augmented reality authentication according to claim 7, wherein the data processing module includes a distance determining unit and a signal strength determining unit, wherein the distance determining unit determines the physical object by the camera module The terminal displays the distance of the device, and the signal strength determining unit is configured to determine the strength of the identification signal, so that the data processing module can determine the first display information to be displayed by the distance among the plurality of physical objects. The interactive system for augmented reality authentication according to claim 7, wherein the image database has a storage unit and a verification unit for storing the first display information, and the verification unit is used for confirming the uploading. The identification signal, and the first display information corresponding to the identification signal is downloaded in the storage unit. The interactive system for augmented reality authentication according to claim 7, wherein the wireless signal transmitting module performs the method selected from the group consisting of a near field communication method, a radio frequency identification method, and a combination thereof. The transmission of the identification signal. The interactive system for augmented reality authentication according to claim 7, wherein the image database further stores a second display information, the data processing module includes a trigger unit, and the trigger unit triggers according to a specific condition. And causing the terminal display device to receive the second display information, and switching the second display information on the virtual object presentation surface through the display module. The interactive system for augmented reality authentication according to claim 12, wherein the specific condition is selected from the group consisting of a gesture condition, a sound condition, a view transfer condition, a time trigger condition, and a combination thereof. .