TWI733176B - Verification by augmented reality system and method thereof - Google Patents

Abstract

A verification by augmented reality system and a method thereof are provided. Object information and a device identification code are transferred to a server by a portable device. Virtual object images are transferred to the portable device from the server. An augmented reality image with the virtual object images and at least one object placement position is displayed by the portable device. A verified image is generated and transferred to the server by the portable device when virtual object image is placed in each object placement position in augmented reality image. The verified image is verified by the server to generate an execution instruction and the execution instruction is transferred by the server. Therefore, the efficiency of verifying through augmented reality may be achieved.

Description

System and method for realizing verification by augmented reality

A verification system and method, in particular, a system and method for verification through augmented reality images.

With the development of portable devices and the popularization of network applications, users can implement various business operations through various applications installed on portable devices, such as social instant messaging services, shopping payment services, etc. To realize the above-mentioned services, the portable device often needs to be registered on the server and implement certain business operations based on the registered account.

In addition, the portable device can also provide access control management, that is, the data stored in the portable device is provided to the access control management system through near field communication for verification. When the data stored in the portable device is verified, that is, The access control management can be lifted.

To sum up, it can be seen that the prior art has long been a problem of potential risks of using the portable device to facilitate login authentication and access control management when the portable device is lost. Therefore, it is necessary to propose improved technical means to solve this problem.

In view of the problem of the potential risks of using the portable device to facilitate login authentication and access control management when the portable device is lost in the prior art, the present invention discloses a system and method for realizing authentication in augmented reality, in which:

The system for realizing verification in augmented reality disclosed in the present invention includes: a portable device and a server. The portable device further includes: a device receiving module, an image module, and a device transmitting module; the server further includes: a server Receiving module, query module, verification module, command generation module, and server transmission module.

The device receiving module of the portable device is used to receive multiple object information to receive multiple virtual object images; the image module of the portable device is used to display augmented reality images, and in the augmented reality images Provide a virtual object image and at least one object placement position. When a virtual object image is placed at each object placement position, an image to be verified is generated; and the device transmission module of the portable device is used to transmit the object information and Device identification code, to transmit the image to be verified.

The server receiving module of the server is used to receive the object information and device identification code from the device transmission module, and the image to be verified from the device transmission module; the query module of the server is used to identify the object information and device identification The code corresponds to the virtual object image, and the verification image is corresponding to the device identification code; the server's verification module is used to verify the image to be verified based on the verification image; the server's command generation module is used When the verification module passes the verification of the image to be verified, an execution instruction is generated; and the server transmission module of the server is used to transmit the virtual object image and transmit the execution instruction.

The method for realizing verification in augmented reality disclosed in the present invention includes the following steps:

First, the portable device receives multiple object information, and sends the object information and device identification code to the server; then, the server queries the virtual object image according to the object information and the device identification code, and correspondingly queries the verification according to the device identification code Image; then, the server transmits the virtual object image to the portable device; then, the portable device displays the augmented reality image, and provides the virtual object image and at least one object placement position in the augmented reality image; then, When a virtual object image is placed at each object placement position in the augmented reality image, the portable device generates the image to be verified; then, the portable device transmits the image to be verified to the server; then, the server according to the verification image It is like verifying the image to be verified; then, when the image to be verified passes the verification of the server, the server generates an execution instruction; finally, the server sends the execution instruction.

The system and method disclosed in the present invention are as above. The difference between the portable device and the prior art is that the portable device provides object information and device identification code to the server, the server feeds back the virtual object image back to the portable device, and the portable device displays the augmented reality image , And provide a virtual object image and at least one object placement position in the augmented reality image. When a virtual object image is placed at each object placement position in the augmented reality image, the portable device generates an image to be verified The image is provided to the server, and the server generates an execution instruction and sends it after passing the image to be verified.

Through the above-mentioned technical means, the present invention can achieve the technical effect of verification through augmented reality images.

The following describes the implementation of the present invention in detail with the drawings and embodiments, so as to fully understand and implement the implementation process of how the present invention uses technical means to solve technical problems and achieve technical effects.

The following firstly describes the system for realizing verification in augmented reality disclosed in the present invention, and please refer to "Figure 1" and "Figure 2". "Figure 1" shows the augmented reality of the present invention. The system block diagram of the real-world verification system; "Figure 2" is a schematic diagram of the architecture of the present invention for realizing verification in augmented reality.

The system for realizing verification in augmented reality disclosed in the present invention includes: a portable device 10 and a server 20. The portable device 10 further includes: a device receiving module 11, an image module 12, and a device transmitting module 13; The server 20 further includes: a server receiving module 21, a query module 22, a verification module 23, a command generation module 24, and a server transmission module 25.

The portable device 10 is, for example, a smart phone, a tablet computer, etc., which are only examples for illustration, and the application scope of the present invention is not limited by this. The device receiving module 11 of the portable device 10 is used to receive multiple object information 41. The device receiving module 11 of the portable device 10 receives multiple object information 41 by selecting multiple object images in the selection interface, and the device receiving module 11 of the portable device 10 can also use the portable device 10 The image module 12 respectively parses a plurality of two-dimensional barcodes to receive a plurality of object information 41. This is only an example for illustration and does not limit the scope of application of the present invention.

After the device receiving module 11 of the portable device 10 receives the multiple object information 41, the device transmitting module 13 of the portable device 10 can transmit the multiple object information 41 and the device identification code 42 to the server 20 through wireless transmission. , The server receiving module of the server 20 can receive a plurality of object information 41 and the device identification code 42 from the device transmission module 13 of the portable device 10. The aforementioned wireless transmission methods are, for example: Wi-Fi, 3G, 4G, 5G... etc., here are only examples, and do not limit the scope of application of the present invention. The aforementioned device identification code 42 is, for example: the media access control address (Media Access Control Address) of the portable device 10, the international The mobile device identification code (International Mobile Equipment Identity, IMEI), etc., are merely illustrative here, and the scope of application of the present invention is not limited by this.

After the server receiving module of the server 20 receives a plurality of object information 41 and the device identification code 42 from the device transmission module 13 of the portable device 10, the query module 22 of the server 20 will then base on the object information 41 and device identification The code 42 correspondingly queries a plurality of virtual object images 43, and the query module 22 of the server 20 also queries the verification images correspondingly according to the device identification code 42. It is worth noting that each object information 41 corresponds to a virtual object image. Like 43, the device identification code 42 can correspond to at least one virtual object image 43, and the object information 41 is different from the virtual object image 43 corresponding to the device identification code 42.

After the query module 22 of the server 20 correspondingly inquires a plurality of virtual object images 43 according to the object information 41 and the device identification code 42, the server transmission module 25 of the server 20 can transmit the plurality of virtual object images 43 To the portable device 10, the device receiving module 11 of the portable device 10 can receive a plurality of virtual object images 43 from the server transmitting module 25 of the server 20.

Please refer to "Figure 3A". "Figure 3A" is a schematic diagram of the augmented reality image verified by augmented reality of the present invention.

After the device receiving module 11 of the portable device 10 receives a plurality of virtual object images 43 from the server transmission module 25 of the server 20, the image module 12 of the portable device 10 can display the augmented reality image 51, and A plurality of virtual object images 43 and at least one object placement position 52 are provided in the augmented reality image 51. In "Figure 3A", four virtual object images 43 and three object placement positions 52 are used as For illustration, it is worth noting that the number of virtual object images 43 in the augmented reality image 51 can be greater than or equal to the number of object placement positions 52 in the augmented reality image 51, which is the augmentation in "Figure 3A" The number of virtual object images 43 in the reality image 51 is greater than the number of object placement positions 52 in the augmented reality image 51. This is only an example, and the scope of application of the present invention is not limited by this.

Then, the holder of the portable device 10 can drag the virtual object image 43 in the augmented reality image 51 to the object placement position 52, as shown in "Figure 3B", and "Figure 3B" shows this The invention uses the augmented reality to realize the verification image schematic diagram. It is worth noting that each virtual object image 43 can only be placed in one object placement position 52, and the virtual object images 43 can also be placed in multiple Among the object placement positions 52, in "Figure 3B", each virtual object image 43 can only be placed in one object placement position 52 as an example, which does not limit the scope of application of the present invention. When a virtual object image 43 is placed at each object placement position 52, the image module 12 of the portable device 10 can generate the image 44 to be verified.

After the image module 12 of the portable device 10 generates the image 44 to be verified, the device transmission module 13 of the portable device 10 can transmit the image 44 to be verified to the server 20, and the server receiving module 21 of the server 20 That is, the image to be verified 44 is received from the device transmission module 13 of the portable device 10.

Next, please refer to "Figure 4A" and "Figure 4B". "Figure 4A" is a schematic diagram of the image to be verified through the augmented reality implementation of the present invention; "Figure 4B" is shown as The present invention uses the augmented reality to realize the verification image schematic diagram for verification.

The verification module 23 of the server 20 intercepts the object image at the first object placement position 521, the object image at the second object placement position 522, and the object image at the third object placement position 523 in the verification image 45 , And the verification module 23 of the server 20 intercepts the object image at the first object placement position 521, the object image at the second object placement position 522, and the third object placement position 523 in the image 44 to be verified Object image.

In an embodiment, the verification module 23 of the server 20 maps the object image at the first object placement position 521 in the verification image 45 and the object image at the first object placement position 521 in the to-be-verified image 44. Image comparison, the verification module 23 of the server 20 compares the object image at the first object placement position 521 in the verification image 45 to the object image at the first object placement position 521 in the image to be verified 44 The result will exceed the preset value. For the image comparison technology, please refer to the description of the prior art, and the present invention will not repeat it again.

In an embodiment, the verification module 23 of the server 20 maps the object image at the second object placement position 522 in the verification image 45 and the object image at the second object placement position 522 in the to-be-verified image 44. Image comparison, the verification module 23 of the server 20 compares the object image at the second object placement position 522 in the verification image 45 to the object image at the second object placement position 522 in the image to be verified 44 The result will exceed the preset value.

In an embodiment, the verification module 23 of the server 20 maps the object image at the third object placement position 523 in the verification image 45 and the object image at the third object placement position 523 in the to-be-verified image 44. The comparison of the image, the verification module 23 of the server 20 compares the object image at the third object placement position 523 in the verification image 45 to the object image at the third object placement position 523 in the image to be verified 44 The result will exceed the preset value.

It is worth noting that as long as the object image comparison result between the image to be verified 44 and the image 45 to be verified at the same object placement position 52 does not exceed the preset value, the image to be verified 44 cannot pass the server 20. Verification of the verification module 23.

For example, the image 44 to be verified will be verified by the verification module 23 of the server 20, the command generation module 24 of the server 20 can generate the execution command 46, and the server transmission module of the server 20 25 will transmit the execution command 46 to the execution device 30 through a wired transmission method or a wireless transmission method. The aforementioned wired transmission method is, for example, a cable network, an optical fiber network, etc., and the aforementioned wireless transmission method is, for example, Wi-Fi. , 3G, 4G, 5G... etc. The aforementioned execution device 30 is, for example, an access control device, a login server... etc. This is only an example for illustration and does not limit the scope of application of the present invention.

After the execution device 30 receives the execution command 46 from the server transmission module 25 of the server 20, the execution device 30 executes the login operation or the unlock operation according to the execution command 46, thereby providing the server with the augmented reality method. The technical function of login authentication or access control unlocking.

Please refer to "Figure 5A" and "Figure 5B". "Figure 5A" and "Figure 5B" illustrate the flow chart of the method for implementing the verification method in augmented reality according to the present invention.

First, the portable device receives multiple object information, and sends the object information and device identification code to the server (step 101); then, the server queries the virtual object image according to the object information and the device identification code, and according to the device identification code Correspondingly query the verification image (step 102); then, the server sends the virtual object image to the portable device (step 103); then, the portable device displays the augmented reality image, and provides the virtual object in the augmented reality image Image and at least one object placement position (step 104); then, when a virtual object image is placed at each object placement position in the augmented reality image, the portable device generates an image to be verified (step 105); Next, the portable device transmits the image to be verified to the server (step 106); then, the server verifies the image to be verified according to the verification image (step 107); then, when the image to be verified passes the verification of the server, The server generates an execution instruction (step 108); finally, the server sends an execution instruction (step 109).

In summary, it can be seen that the difference between the present invention and the prior art is that the portable device provides object information and device identification code to the server, the server feeds back the virtual object image back to the portable device, and the portable device displays the augmented reality image, and Provide a virtual object image and at least one object placement position in the augmented reality image. When a virtual object image is placed at each object placement position in the augmented reality image, the portable device generates the image to be verified and Provided to the server, the server generates an execution instruction and sends it after passing the image to be verified.

This technical method can solve the problem of the potential risks of login authentication and access control management through the portable device when the portable device is lost in the prior art, and then achieve the technical effect of verification through augmented reality images.

Although the embodiments disclosed in the present invention are as described above, the content described is not intended to directly limit the scope of patent protection of the present invention. Anyone with ordinary knowledge in the technical field to which the present invention belongs can make slight changes in the implementation form and details without departing from the spirit and scope disclosed by the present invention. The scope of patent protection of the present invention shall still be subject to those defined by the scope of the attached patent application.

10: portable device 11: Device receiving module 12: Image module 13: Device transfer module 20: server 21: Server receiving module 22: Query module 23: Verification Module 24: Instruction generation module 25: Server transmission module 30: Execution device 41: Object Information 42: Device ID 43: Virtual Object Image 44: Image to be verified 45: verify image 46: execute instructions 51: Augmented Reality Image 52: Object placement 521: Placement of the first object 522: Placement of the second object 523: Placement of the third object Step 101: The portable device receives multiple object information, and sends the object information and device ID to the server Step 102: The server correspondingly queries the virtual object image according to the object information and the device identification code, and correspondingly queries the verification image according to the device identification code Step 103: The server sends the virtual object image to the portable device Step 104: The portable device displays the augmented reality image, and provides a virtual object image and at least one object placement position in the augmented reality image Step 105: When a virtual object image is placed at each object placement position in the augmented reality image, the portable device generates an image to be verified Step 106: The portable device sends the image to be verified to the server Step 107: The server verifies the image to be verified based on the verification image Step 108: When the image to be verified passes the verification of the server, the server generates an execution instruction Step 109: The server sends an execution command

Figure 1 is a system block diagram of the verification system implemented by augmented reality according to the present invention. Figure 2 is a schematic diagram of the architecture of the present invention for realizing verification in augmented reality. FIG. 3A is a schematic diagram of an augmented reality image verified by augmented reality according to the present invention. Figure 3B is a schematic diagram of an image to be verified that is verified by augmented reality in the present invention. Figure 4A is a schematic diagram of an image to be verified that is verified by augmented reality in the present invention. FIG. 4B is a schematic diagram of a verification image for realizing verification in augmented reality according to the present invention. Fig. 5A and Fig. 5B are flowcharts of the method for realizing the verification method in augmented reality according to the present invention.

10: portable device

11: Device receiving module

12: Image module

13: Device transfer module

20: server

21: Server receiving module

22: Query module

23: Verification Module

24: Instruction generation module

25: Server transmission module

30: Execution device

Claims (8)

A system for realizing verification in augmented reality, which includes: a portable device, the portable device further includes: a device receiving module for receiving a plurality of object information, for receiving a plurality of virtual object images; An image module, the image module is connected to the device receiving module, and the image module is used to display an augmented reality image and provide the virtual object image in the augmented reality image And at least one object placement position, when each object placement position is placed with a virtual object image, generate a to-be-verified image; and a device transmission module, the device transmission module and the image module Connected, the device transmission module is used to transmit the object information and a device identification code to transmit the image to be verified; and a server, and the server further includes: a server receiving module for The object information and the device identification code are received from the device transmission module, the image to be verified is received from the device transmission module; a query module, the query module and the server receive Modules are connected, and the query module is used for querying the virtual object image correspondingly according to the object information and the device identification code, and correspondingly querying a verification image according to the device identification code; A verification module, the verification module is connected to the server receiving module, and the verification module respectively intercepts the verification image and the object image of the placement position of the object in the image to be verified, The object images corresponding to the same object placement position are compared. If the comparison result of each object image of the same object placement position exceeds the preset value, the image to be verified passes the verification; a command is generated Module, the instruction generation module is connected to the verification module, and the instruction generation module is used to generate an execution instruction when the verification module passes the verification of the image to be verified; and a servo Server transmission module, the server transmission module is respectively connected with the query module and the instruction generation module, the server transmission module is used to transmit the virtual object image, and transmit the execution instruction . As described in item 1 of the scope of patent application, the system for realizing verification in augmented reality, wherein the number of images of the virtual object in the augmented reality image is greater than or equal to the number of placement positions of the object. As described in item 1 of the scope of patent application, the system for realizing verification by augmented reality, wherein the device receiving module parses a plurality of two-dimensional barcodes through the image module to receive the object information. As described in the first item of the scope of patent application, the system for realizing verification by augmented reality, wherein the verification system further includes an execution device, and the execution device receives the execution instruction from the server transmission module, so The execution device executes a login operation or an unlock operation according to the execution instruction. A method for realizing verification in augmented reality, which includes the following steps: A portable device receives a plurality of object information, and transmits the object information and a device identification code to a server; the server correspondingly queries the corresponding virtual object image according to the object information and the device identification code, And correspondingly query a verification image according to the device identification code; the server sends the virtual object image to the portable device; the portable device displays an augmented reality image, and displays the augmented reality image in the augmented reality image. The virtual object image and at least one object placement position are provided in the real image; when a virtual object image is placed at each object placement position in the augmented reality image, the portable device generates a waiting A verification image; the portable device transmits the image to be verified to the server; the server respectively intercepts the verification image and the object image at the position of the object in the image to be verified, Compare the object images corresponding to the same object placement position. If the comparison result of each object image of the same object placement position exceeds the preset value, the image to be verified passes the verification; when the When the image to be verified passes the verification of the server, the server generates an execution instruction; and the server transmits the execution instruction. As described in item 5 of the scope of patent application, the method for realizing verification in augmented reality, wherein the number of the virtual object images in the augmented reality image is greater than or equal to the number of placement positions of the objects. As described in item 5 of the scope of patent application, the method for realizing verification by augmented reality, wherein the portable device receives the object information by acquiring and analyzing multiple two-dimensional barcodes respectively. The method for realizing verification in augmented reality as described in item 5 of the scope of patent application, wherein the verification method further includes an execution device receiving the execution instruction from the server, and the execution device according to the execution instruction Steps to perform login operation or unlock operation.

Images