TWI724615B - Unlock system for configured image on augmented reality and method thereof - Google Patents

Abstract

A unlock system for configured image on augmented reality and a method thereof are provided. An original image and a device identification code are provided to server from a portable device. A plurality of sub-images is captured from the original image through image processing and the sub-images are established association with virtual objects. Object placement positions and virtual objects provided from the server are displayed on display image by the portable device. A virtual object image is generated and transferred to the server by the portable device when virtual object is placed in each object placement position in display image. A verified image is transformed from the virtual object image by server. The verified image is verified by the server to generate an execution instruction and the execution instruction is transferred by the server. Therefore, the efficiency of verifying through augmented reality may be achieved.

Description

System and method for unlocking based on image configuration of augmented reality

An unlocking system and method, in particular, a system and method for unlocking based on the image configuration of augmented reality.

With the development of portable devices and the popularization of network applications, users can implement various business operations through various applications installed on portable devices, such as social instant messaging services, shopping payment services, etc. To realize the above-mentioned services, the portable device often needs to be registered on the server and implement certain business operations based on the registered account.

In addition, the portable device can also provide access control management, that is, the data stored in the portable device is provided to the access control management system through near field communication for verification. When the data stored in the portable device is verified, that is, The access control management can be lifted.

To sum up, it can be seen that the prior art has long been a problem of potential risks of using the portable device to facilitate login verification and access control management when the portable device is lost. Therefore, it is necessary to propose improved technical means to solve this problem.

In view of the problem of the potential risks of login verification and access control management through the portable device when the portable device is lost in the prior art, the present invention discloses a system and method for unlocking based on the image configuration of augmented reality. among them:

The system for unlocking based on the image configuration of the augmented reality disclosed in the present invention includes: a portable device and a server; the portable device further includes: a device receiving module, an image module, and a device transmitting module; the server is more Including: server receiving module, query module, image processing module, image restoration module, verification module, command generation module, and server transmission module.

The device receiving module of the portable device is used to receive multiple image positions and multiple virtual objects; the image module of the portable device is used to capture the original image, when the original image is determined to have a specific object, Generate verification commands; provide corresponding object placement positions and provided virtual objects in the displayed image according to the image position, and generate virtual object images when each object placement position is placed in a virtual object; and portable device devices The transmission module is used to transmit the original image and the device identification code when the verification command is generated; to transmit the virtual object image.

The server receiving module of the server is used to receive the original image and device identification code from the device transmission module; the virtual object image is received from the device transmission module; the query module of the server is used to correspond according to the device identification code Query multiple image positions and virtual objects corresponding to the image positions; the image processing module of the server extracts multiple images from the original image corresponding to the queried image position according to the queried image position. Sub-images, and associate the sub-images extracted from the image position according to the virtual object corresponding to the image position; the image restoration module of the server is to perform the virtual object in the virtual object image from the associated sub-image Instead, generate the image to be verified; the verification module of the server is used to verify the image to be verified based on the original image; the command generation module of the server is used when the image to be verified is verified by the verification module , Generate execution instructions; and the server transmission module of the server is used to transmit image positions and virtual objects; and transmit execution instructions.

The method for unlocking based on the image configuration of the augmented reality disclosed in the present invention includes the following steps:

First, the portable device captures the original image, and when the original image is determined to have a specific object, a verification command is generated; then, the portable device transmits the original image and the device identification code to the server according to the verification command; then, the server According to the device identification code, a plurality of image positions and virtual objects corresponding to the image positions are correspondingly queried; then, the server extracts multiple image positions corresponding to the queried image positions in the original image according to the queried image positions. Sub-images, and associate the sub-images extracted from the image position with the virtual object corresponding to the image position; then, the server transmits the image position and the virtual object to the portable device; then, the portable device displays the image according to The image position provides the corresponding object placement position and the provided virtual object. When a virtual object is placed at each object placement position, a virtual object image is generated; then, the portable device sends the virtual object image to the server; , The server replaces the virtual object in the virtual object image with the associated sub-image to generate the image to be verified; then, the server verifies the image to be verified based on the original image; then, when the image to be verified passes During server verification, the server generates an execution command; finally, the server sends an execution command.

The system and method disclosed in the present invention are as described above. The difference between the portable device and the prior art is that the portable device provides the original image and the device identification code to the server, and the server performs image processing on the original image to capture multiple sub-images, and Establish the association between the virtual object and the sub-image. The portable device displays the object placement position provided by the server and the virtual object provided in the display image. When a virtual object is placed at each object placement position, the portable device generates a virtual The object image is provided to the server, and the server converts the virtual object image into an image to be verified, and the server generates an execution instruction and sends it after passing the verification of the image to be verified.

Through the above-mentioned technical means, the present invention can achieve the technical effect of verification through augmented reality images.

The following describes the implementation of the present invention in detail with the drawings and embodiments, so as to fully understand and implement the implementation process of how the present invention uses technical means to solve technical problems and achieve technical effects.

The following first describes the system for unlocking based on the image configuration of the augmented reality disclosed in the present invention. Please refer to "Figure 1" for the following description. "Figure 1" shows the present invention based on the augmented reality. The system block diagram of the image configuration of the environment for unlocking.

The system for unlocking based on the image configuration of the augmented reality disclosed in the present invention includes: a portable device 10 and a server 20; the portable device 10 further includes: a device receiving module 11, an image module 12, and a device transmitting module Group 13; the server 20 further includes: a server receiving module 21, a query module 22, an image processing module 23, an image restoration module 24, a verification module 25, a command generation module 26, and a server transmission module Group 27.

The portable device 10 is, for example, a smart phone, a tablet computer, etc., which are only examples for illustration, and the application scope of the present invention is not limited by this. The portable device 10 captures the original image 31 through the image module 12, and the original image For image 31, please refer to "Figure 2". "Figure 2" is a schematic diagram of the original image unlocked according to the image configuration of the augmented reality of the present invention. The original image 31 has a specific object 311. At this time, the image module 12 of the portable device 10 can determine that the original image 31 has a specific object 311, and the image module 12 of the portable device 10 generates a verification command.

The portable device 10 establishes a connection with the server 20 through wireless transmission. When the image module 12 of the portable device 10 generates a verification command, the device transmission module 13 of the portable device 10 will send the original image 31 and the device identification code Send to the server 20, the server receiving module 21 of the server 20 can receive the original image 31 and the device identification code from the device transmitting module 13 of the portable device 10. The aforementioned wireless transmission methods are, for example, Wi-Fi, 3G, 4G, 5G... etc., here are only examples, and do not limit the scope of application of the present invention. The aforementioned device identification code is, for example, the media access control address of the portable device 10 (Media Access Control Address). ), International Mobile Equipment Identity (IMEI), etc., which are only examples here, and do not limit the scope of application of the present invention.

After the server receiving module 21 of the server 20 receives the original image 31 and the device identification code from the device transmission module 13 of the portable device 10, the query module 22 of the server 20 can query the corresponding information according to the device identification code. Each image position and the virtual object corresponding to the image position. It is worth noting that the virtual object has a corresponding number. The number corresponding to the virtual object can be a continuous number or a non-continuous number, and the number corresponding to the virtual object is unique and not repeated The numbering is only an example here, and it does not limit the scope of application of the present invention.

The image processing module 23 of the server 20 extracts multiple sub-images from the original image corresponding to the queried image position according to the queried image position, and pairs of virtual objects corresponding to the image position The sub-images extracted from the image position are associated.

Please refer to "Picture 3A", "Picture 3B" and "Picture 3C". "Picture 3A" shows the position of the image and the virtual object unlocked according to the image configuration of the augmented reality. Schematic diagram; "Figure 3B" is a schematic diagram of the sub-image association that the present invention is unlocked based on the image configuration of the augmented reality; "Figure 3C" is the diagram of the present invention based on the image configuration of the augmented reality A schematic diagram of the association between the unlocked virtual object and the sub-image.

The query module 22 of the server 20 can correspondingly query the first image position 321 and the first virtual object 331, the second image position 322, and the second image position corresponding to the first image position 321 according to the device identification code. The second virtual object 332 corresponding to 322 and the third image position 323 and the third virtual object 331 corresponding to the position 323 in the third figure, the number corresponding to the first virtual object 331 is "10", and the number corresponding to the first virtual object 331 It is "1" and the number corresponding to the first virtual object 331 is "89". This is only an example for illustration and does not limit the scope of application of the present invention.

The image processing module 23 of the server 20 captures the first sub-image 341 at the first image position 321 in the original image 31, and extracts the second sub-image 341 at the second image position 322 in the original image 31. The sub-image 342 and the third sub-image 343 are extracted from the third image position 323 in the original image 31.

The image processing module 23 of the server 20 then associates the first virtual object 331 with the first sub-image 341, associates the second virtual object 332 with the second sub-image 342, and associates the third virtual object 333 with the first sub-image 341. The third sub-image 343 establishes an association.

Then, the server sending module 27 of the server 20 will send the queried image position and virtual object to the device receiving module 11 of the portable device 10, and the device receiving module 11 of the portable device 10 can be sent from the server 20. The server transmission module 27 of the server receives the image position and the virtual object.

Please refer to "Figure 4A". "Figure 4A" is a schematic diagram of the displayed image unlocked according to the image configuration of the augmented reality of the present invention. The image module 12 of the portable device 10 is in the server 20. After the server transmission module 27 receives the image position and the virtual object, the image module 12 of the portable device 10 can display the image 41 according to the first image position 321, the second image position 322, and the third image position. 323 provides corresponding first object placement position 411, second object placement position 412, and third object placement position 413, and the provided first virtual object 331, second virtual object 332, and third virtual object 333.

In an embodiment, the first virtual object 331 is placed in the first object placement position 411, the second virtual object 332 is placed in the second object placement position 412, and the third virtual object 333 is placed in the third object. For the placement position 413, please refer to "Figure 4B". "Figure 4B" is a schematic diagram of the image of the virtual object unlocked according to the image configuration of the augmented reality of the present invention. The image module of the portable device 10 12 That is, when a virtual object is placed at each object placement position, a virtual object image 42 is generated.

Then, when the image module 12 of the portable device 10 generates the virtual object image 42, the device transmission module 13 of the portable device 10 can transmit the virtual object image 42 to the server receiving module 21 of the server 20. The server receiving module 21 of 20 can receive the virtual object image 42 from the device transmission module 13 of the portable device 10.

Next, please refer to "Figure 3C", "Figure 4B" and "Figure 5". "Figure 5" shows the image to be verified unlocked according to the image configuration of the augmented reality. Schematic.

The image restoration module 24 of the server 20 replaces the first virtual object 331 in the virtual object image 42 with the associated first sub-image 341, and replaces the second virtual object 332 in the virtual object image 42 with the associated first sub-image 341 The two sub-images 342 are replaced and the third virtual object 333 in the virtual object image 42 is replaced by the associated third sub-image 343. After the above-mentioned image restoration process, the image restoration module 24 of the server 20 It can be generated as the image 51 to be verified.

The verification module 25 of the server 20 can verify the image 51 to be verified based on the original image 31. In an embodiment, the verification module 25 of the server 20 can compare the image 51 to be verified with the original image 31. Match, that is, the to-be-verified image 51 will pass the verification of the verification module 25 of the server 20.

After the image 51 to be verified passes the verification of the verification module 25 of the server 20, the command generation module 26 of the server 20 can generate an execution command, and the server transmission module 25 of the server 20 will transmit or It is a wireless transmission method that transmits the execution command to the execution device 60. The aforementioned wired transmission method is, for example, a cable network, an optical fiber network, etc., and the aforementioned wireless transmission method is, for example, Wi-Fi, 3G, 4G, 5G, etc. The aforementioned execution device is, for example, an access control device, a login server, etc., which are only examples for illustration, and the scope of application of the present invention is not limited by this.

After the execution device 60 receives the execution command from the server transmission module 27 of the server 20, the execution device 60 executes the login operation or the unlock operation according to the execution command, thereby providing server login verification through augmented reality. Or the technical effect of access control unlocking.

It is worth noting that the portable device 10 can further provide a click on the virtual object in the displayed image, and the virtual object provides repeated clicks or the virtual object only provides a single click. The image module 12 of the portable device 10 can be clicked according to The selected virtual object sequence generates a sequence of numbers to be verified.

Following the above-mentioned embodiment, the image module 12 of the portable device 10 generates the sequence of numbers to be verified according to the selected virtual objects, for example: 10-1-89, 10-10-89, 89-10-1... etc. This is only an example, and does not limit the scope of application of the present invention.

The query module 22 of the server 20 further includes a corresponding query of the verification number sequence according to the device identification code. The verification number sequence is, for example: 10-1-89, 10-10-89, 89-10-1, etc., here It is only an example, and does not limit the scope of application of the present invention.

The device transmitting module 13 of the portable device 10 transmits the number sequence to be verified to the server receiving module 21 of the server 20. The verification module 25 of the server 20 verifies the image to be verified based on the original image, and also The sequence of the number to be verified is further verified according to the sequence of the verification number, and when the image to be verified passes the verification of the verification module 25 of the server 20 and the sequence of the number to be verified passes the verification of the verification module 25 of the server 20, the server 20 The command generation module 26 of the command will generate the execution command.

Please refer to "Figure 6A" and "Figure 6B". "Figure 6A" and "Figure 6B" illustrate the flowchart of the method for unlocking according to the image configuration of the augmented reality of the present invention.

First, the portable device captures the original image, and when the original image is determined to have a specific object, a verification command is generated (step 101); then, the portable device transmits the original image and the device identification code to the server according to the verification command ( Step 102); Next, the server correspondingly inquires a plurality of image positions and virtual objects corresponding to the image positions according to the device identification code (step 103); Next, the server converts the original image into the original image according to the queried image position Capture multiple sub-images corresponding to the queried image location, and associate the sub-images captured at the image location according to the virtual object corresponding to the image location (step 105); then, the server transmits the image location And the virtual object to the portable device (step 106); then, the portable device provides the corresponding object placement position and the provided virtual object according to the image position in the displayed image. When a virtual object is placed at each object placement position, Generate a virtual object image (step 107); then, the portable device transmits the virtual object image to the server (step 108); then, the server replaces the virtual object in the virtual object image with associated sub-images to generate The image to be verified (step 109); then, the server verifies the image to be verified based on the original image (step 110); then, when the image to be verified passes the server verification, the server generates an execution command (step 111) ; Finally, the server sends an execution command (step 112).

In summary, it can be seen that the difference between the present invention and the prior art is that the portable device provides the original image and the device identification code to the server. The server performs image processing on the original image to capture multiple sub-images and create a virtual The association between the object and the sub-image, the portable device displays the object placement position provided by the server and the virtual object provided in the display image. When a virtual object is placed at each object placement position, the portable device generates a virtual object map The image is provided to the server, and the server converts the virtual object image into the image to be verified, and the server generates the execution instruction and sends it after passing the verification of the image to be verified.

This technical method can solve the problem of the potential risks of login authentication and access control management through the portable device when the portable device is lost in the prior art, and then achieve the technical effect of verification through augmented reality images.

Although the embodiments disclosed in the present invention are as described above, the content described is not intended to directly limit the scope of patent protection of the present invention. Anyone with ordinary knowledge in the technical field to which the present invention belongs can make some changes in the form and details of the implementation without departing from the spirit and scope of the present invention. The scope of patent protection of the present invention shall still be subject to those defined by the scope of the attached patent application.

10: portable device 11: Device receiving module 12: Image module 13: Device transfer module 20: server 21: Server receiving module 22: Query module 23: Image processing module 24: Image restoration module 25: Verification module 26: Instruction generation module 27: Server transmission module 31: Original image 311: specific object 321: first image position 322: second image position 323: third image position 331: The First Virtual Object 332: The second virtual object 333: Third Virtual Object 341: The first sub-image 342: second sub-image 343: third sub-image 41: Display image 411: Placement of the first object 412: Placement of the second object 413: Placement of the third object 42: Virtual object image 51: image to be verified 60: Execution device Step 101: The portable device captures the original image, and when the original image is judged to have a specific object, a verification command is generated Step 102: The portable device sends the original image and device ID to the server according to the verification command Step 103: The server correspondingly queries multiple image positions and virtual objects corresponding to the image positions according to the device identification code Step 104: The server extracts multiple sub-images in the original image corresponding to the queried image position according to the queried image position, and extracts the image position according to the virtual object corresponding to the image position Sub-images to associate Step 105: The server sends the image location and virtual object to the portable device Step 106: The portable device provides the corresponding object placement position and the provided virtual object according to the image position in the displayed image, and when a virtual object is placed at each object placement position, a virtual object image is generated Step 107: Send the virtual object image to the server from the portable device Step 108: The server replaces the virtual object in the virtual object image with the associated sub-image to generate the image to be verified Step 109: The server verifies the image to be verified based on the original image Step 110: When the image to be verified passes the server verification, the server generates an execution command Step 111: The server sends an execution command

FIG. 1 is a block diagram of the system for unlocking according to the image configuration of augmented reality according to the present invention. Figure 2 is a schematic diagram of the original image unlocked according to the image configuration of the augmented reality according to the present invention. FIG. 3A is a schematic diagram of image positions and virtual objects unlocked according to the image configuration of augmented reality according to the present invention. FIG. 3B is a schematic diagram of the sub-image association for unlocking according to the image configuration of augmented reality according to the present invention. FIG. 3C is a schematic diagram of the association between the virtual object and the sub-image that is unlocked according to the image configuration of the augmented reality according to the present invention. FIG. 4A is a schematic diagram of a display image that is unlocked according to the image configuration of the augmented reality according to the present invention. FIG. 4B is a schematic diagram of the virtual object image that is unlocked according to the image configuration of the augmented reality according to the present invention. Figure 5 is a schematic diagram of the image to be verified unlocked according to the image configuration of the augmented reality of the present invention. FIG. 6A and FIG. 6B are flowcharts of the method for unlocking according to the image configuration of the augmented reality according to the present invention.

10: portable device

11: Device receiving module

12: Image module

13: Device transfer module

20: server

21: Server receiving module

22: Query module

23: Image processing module

24: Image restoration module

25: Verification module

26: Instruction generation module

27: Server transmission module

60: Execution device

Claims (8)

A system for unlocking based on the image configuration of augmented reality, which includes: a portable device, the portable device further includes: a device receiving module for receiving a plurality of image positions and a plurality of images from a server Virtual object; an image module to capture an original image, when the original image is determined to have a specific object, generate a verification command; in a displayed image according to the image position Corresponding to the object placement position, the virtual object provided in the display image generates a virtual object image when a virtual object is placed in each object placement position; and a device transmission module is used To transmit the original image and a device identification code when the verification command is generated; transmit the virtual object image; and the server further includes: a server receiving module for transmitting from the device A module receives the original image and the device identification code; receives the virtual object image from the device transmission module; a query module for correspondingly querying a plurality of images according to the device identification code Position and the virtual object corresponding to the image position; an image processing module, according to the image position that is queried, extracts the image position corresponding to the queried image in the original image Sub-images, and associate the sub-images captured at the image position according to the virtual object corresponding to the image position; An image restoration module, which replaces the virtual object in the virtual object image with associated sub-images to generate an image to be verified; a verification module, which is used to pair the virtual object according to the original image The image to be verified performs image comparison verification; an instruction generation module for generating an execution instruction when the image to be verified is verified by the verification module; a server transmission module, For transmitting the image position and the virtual object; and transmitting the execution instruction; and an execution device, the execution device receives the execution instruction from the server transmission module, and the execution device is based on the The execution command executes the login operation or the unlock operation. As described in item 1 of the scope of patent application, the system for unlocking based on the image configuration of augmented reality, wherein the query module further includes a corresponding query of a verification number sequence based on the device identification code; the virtual object Corresponding to a number, the image module is further included in the display image when the virtual object is clicked, generates a sequence of numbers to be verified according to the sequence of the clicked virtual objects, and the device transmission module transmits the The number sequence to be verified is sent to the server receiving module, the verification module further includes verifying the number sequence to be verified according to the verification number sequence, and the command generation module further includes when the image to be verified For example, when the number sequence to be verified is verified by the verification module, and when the number sequence to be verified is verified by the verification module, the execution instruction is generated. As described in item 2 of the scope of patent application, the system for unlocking based on the image configuration of augmented reality, wherein the virtual object provides repeated clicks. As described in item 2 of the scope of patent application, the system for unlocking based on the image configuration of augmented reality, wherein the virtual object only provides a single click. A method for unlocking based on the image configuration of augmented reality, which includes the following steps: a portable device captures an original image, and when the original image is determined to have a specific object, a verification command is generated The portable device transmits the original image and a device identification code to a server according to the verification instruction; the server correspondingly queries a plurality of image locations and the image location according to the device identification code Corresponding virtual objects; the server extracts a plurality of sub-images in the original image corresponding to the queried image position according to the queried image position, and according to the image The virtual object corresponding to the position is associated with the sub-image captured by the image position; the server transmits the image position and the virtual object to the portable device; the portable device is in a display image The corresponding object placement position is provided according to the image position, and the virtual object provided in the display image generates a virtual object image when a virtual object is placed at each object placement position; The portable device transmits the virtual object image to the server; the server replaces the virtual object in the virtual object image with an associated sub-image to generate an image to be verified; The server performs image comparison verification on the image to be verified based on the original image; when the image to be verified passes the server verification, the server generates an execution instruction; The server transmits the execution command to an execution device; and the execution device executes a login operation or an unlock operation according to the execution command. As described in item 5 of the scope of patent application, the method for unlocking based on the image configuration of the augmented reality, wherein the verification method further includes the following steps: the server queries a verification number corresponding to the device identification code Sequence; the virtual object corresponds to a number, when the virtual object in the displayed image is clicked, the portable device generates a sequence of numbers to be verified according to the selected virtual object; the portable device transmits the The number sequence to be verified is sent to the server; the server verifies the number sequence to be verified according to the verification number sequence; and when the image to be verified passes the server verification and when the to-be-verified image When the verification number sequence is verified by the server, the server generates the execution instruction. As described in item 6 of the scope of patent application, the method for unlocking based on the image configuration of augmented reality, wherein the virtual object provides repeated clicks. As described in item 6 of the scope of patent application, the method for unlocking based on the image configuration of augmented reality, wherein the virtual object only provides a single click.

Images