TWI619041B - Augmented reality unlocking system and method - Google Patents

Abstract

The invention provides an augmented reality unlocking system and method, which mainly includes two parts, an unlocking end and an auxiliary end. The end-to-end is a communication method using network transmission. The unlocking end has a keyboard for users to enter a password and actively Send a set of dynamic information to the auxiliary terminal to produce a dynamic virtual keyboard. The virtual keyboard is arranged according to random information, and the auxiliary terminal has a lens device, which can be aligned with the unlocking keyboard by augmented reality technology. To overlay the virtual keyboard on it, the user must enter the correct set of passwords on the keyboard on the unlocking end according to the virtual keyboard. After the passwords are successfully compared on the unlocking end, the unlocking process is completed.

Description

Augmented reality unlocking system and method

The invention is an unlocking system and method, in particular, an augmented reality unlocking system and method that cooperates with augmented reality technology.

The change of life habits of the Internet is an irresistible trend. Especially with the advent of 4G, the concept of smart living is increasingly taking shape. With the continuous introduction of consumer electronics, the new life of smart networking is undoubtedly the future. Equal sign. With the continuous development of digitalization, it also highlights the needs of various types of network security mechanisms. Usually, in terms of password security protection, the common one-time password (OTP) is two-step verification. , TSV), but the one-time password is a new set of passwords each time, the user has to temporarily enter a new set of new passwords each time, and the one-time password has restrictions on the input time For users, this security program is slightly cumbersome in some applications. Therefore, how to achieve a balance between convenience and security is the goal of active research by all parties.

In view of various shortcomings derived from the above-mentioned conventional methods, the inventor of the present case has been eager to improve and innovate. After painstaking research, he finally successfully developed an augmented reality unlocking system and method.

The invention provides an augmented reality unlocking system, which is an unlocking end and an auxiliary end, wherein the unlocking end includes: a memory module for storing an original password; an input module for providing a first unlock Code; a dynamic information generation module that generates a conversion factor; a password check module that combines the conversion factor and the first unlock code to generate a second unlock code and compares the second unlock code And the original password; an unlocking module, which provides unlocking; an unlocking communication module, which provides wireless connection with the auxiliary terminal; wherein the auxiliary terminal includes: an auxiliary communication module, which receives the transmission from the unlocking terminal. Conversion factor; a screen capture module that captures the appearance image of the unlocked end and displays it on a display screen of the auxiliary end; a virtual keyboard production module that generates a virtual keyboard image through the conversion factor, The keyboard sequence on this image is different from the keyboard sequence on the input module on the unlocking end; an identification positioning module locates the position of the input module through the appearance image of the unlocking end; and an image overlay The module is to overlay the virtual keyboard image on the position of the input module in the display screen.

The unlocking end is a device with a keyboard, such as an access control device and a safe device. The auxiliary end is a device with a photographic lens such as a handheld mobile device and smart glasses. among them The conversion factor is generated based on the system time.

The present invention provides an augmented reality unlocking method, the steps of which are as follows: an unlocking communication module of an unlocking terminal is connected with an auxiliary communication module of an auxiliary terminal; a dynamic information generating module of the unlocking terminal generates A conversion factor is transmitted to the auxiliary terminal, and a virtual keyboard production module generates a virtual keyboard image according to the conversion factor. A screen capture module of the auxiliary terminal is used to capture the appearance image of the unlocked terminal. , And displayed on a display screen of one of the auxiliary terminals; one of the auxiliary terminals recognizes the positioning module, and locates an input module of the unlocking terminal through the appearance image of the unlocking terminal, and an image overlay module The virtual keyboard image is superimposed on the position of the input module in the display screen; a first unlock code is entered in the input module; the password check module on the unlocking end converts the conversion factor And the first unlock code is combined to generate a second unlock code, and the second unlock code is compared with the original password; and an unlock module is unlocked.

Compared with other conventional technologies, the augmented reality unlocking system and method of the present invention has the following advantages:

1. The present invention can improve advanced security protection measures for general electronic password locks.

2. The present invention uses the augmented reality technology to nest the virtual keyboard, which can effectively avoid the risk of being easily recorded by the camera during the password input process.

3. The invention can solve the problem that a set of passwords is used for a physical keyboard for a long time, which easily causes the keys to be dirty and thus exposes the combination of passwords.

4. The present invention does not deliver the password via the network, which can prevent hacker attacks where the password is intercepted and decrypted.

The above detailed description is a specific description of a feasible embodiment of the present invention, but this embodiment is not intended to limit the patent scope of the present invention. Any equivalent implementation or change that does not depart from the technical spirit of the present invention should be included in Within the scope of the patent in this case.

To sum up, this case is not only innovative in terms of space type, but also enhances the above-mentioned multiple effects over conventional items. It should have fully met the requirements for statutory invention patents that are novel and progressive. Apply for it in accordance with the law and ask your office for approval. This invention patent application is designed to encourage inventions, and it is a matter of virtue.

100‧‧‧Unlock side

200‧‧‧Auxiliary

110‧‧‧Memory module

120‧‧‧input module

130‧‧‧ dynamic information generation module

140‧‧‧password check module

150‧‧‧Unlock Module

160‧‧‧Unlock communication module

210‧‧‧ auxiliary communication module

220‧‧‧Screen Capture Module

230‧‧‧Virtual keyboard production module

240‧‧‧Identification positioning module

250‧‧‧Image nesting module

S21 ~ S29‧‧‧step flow

S301 ~ S311‧‧‧step flow

FIG. 1 is an architecture diagram of an augmented reality unlocking system of the present invention.

FIG. 2 is a flowchart of an augmented reality unlocking method of the present invention.

FIG. 3 is a flowchart of the augmented reality unlocking method of the present invention.

FIG. 4 is a schematic diagram of the actual operation of the augmented reality unlocking of the present invention.

FIG. 5 is a schematic diagram of the actual operation of the augmented reality unlocking of the present invention.

FIG. 6 is a schematic diagram of the actual operation of the augmented reality unlocking of the present invention.

In order for the reviewing committee members to understand the technical features, contents and advantages of the present invention and the effects that can be achieved, the present invention is described in detail with the accompanying drawings in the form of embodiments, and the drawings used therein are The main purpose is only for the purpose of illustration and supplementary description. It may not be the actual proportion and precise configuration after the implementation of the invention. Therefore, the attached drawings should not be interpreted and limited to the scope of rights of the present invention in actual implementation. He Xianming.

Please refer to FIG. 1. As shown in the figure, it is an architecture diagram of the augmented reality unlocking system of the present invention. The unlocking terminal 100 and the auxiliary terminal 200 are used. The unlocking terminal 100 is an unlocking device with a physical or virtual keyboard, such as an access control device and a safe device. Unit, the auxiliary end 200 is a smart mobile device such as a handheld mobile device and smart glasses. The unlocking terminal 100 includes a memory module 110, an input module 120, a dynamic information generating module 130, a password checking module 140, an unlocking module 150, an unlocking communication module 160, and an auxiliary terminal 200 includes an auxiliary communication module 210, The screen capture module 220, the virtual keyboard production module 230, the identification and positioning module 240, and the image overlay module 250. The original password is stored in the memory module 110, and the input module 120 is provided for the user to enter a first unlock code, and dynamic information is generated. Module 130 generates a conversion factor based on the system timestamp, and password check module 140 combines the conversion factor and the first unlock code to generate a second unlock code, and compares the second unlock code with the original password. The unlocking module 150 provides unlocking, and the unlocking communication module 160 provides wireless connection with the auxiliary terminal 200. The auxiliary communication module 210 receives the conversion factor transmitted by the unlocking terminal 100, and the screen capture module 220 captures the appearance image of the unlocking terminal 100 and displays it on the display screen of the auxiliary terminal 200. The virtual keyboard The production module 230 generates a virtual keyboard image through the conversion factor, identifies the positioning module 240, locates the position of the input module 120 through the appearance image of the unlocking terminal 100, and the image overlay module 250, The virtual keyboard image is nested at the position of the input module 120- in the display screen.

Please refer to FIG. 2. As shown in the figure, the flowchart of the augmented reality unlocking method of the present invention is as follows. The steps are as follows: S21: One of the unlocking communication modules is an unlocking communication module and one of the auxiliary communication modules is an auxiliary communication module. Get a connection; S22: A dynamic information generating module on the unlocking end generates a conversion factor and transmits it to the auxiliary end, and a virtual keyboard production module generates a virtual keyboard image according to the conversion factor; S23: the One of the auxiliary terminal screen capture modules is to capture the appearance image of the unlocked terminal and display it on one of the auxiliary terminal's display screens; S24: One of the auxiliary terminals identifies the positioning module, which is based on the appearance of the unlocked terminal An image is positioned on an input module of the unlocking terminal, and an image overlay module is used to overlay the virtual keyboard image on the position of the input module in the display screen; S25: On the input module Group input a first unlock code; S26: the password verification module on the unlock side generates the combination of the conversion factor and the first unlock code A second unlock code, and compare the second unlock code with the original password; S27: if the second unlock code is consistent with the original password, enable the unlocking module to unlock.

Please refer to Figures 3 to 6 for the flowchart and actual operation schematic diagram of the augmented reality unlocking method of the present invention. The steps are as follows: S301: The user establishes a wireless network connection with the access control device using the communication module of the smart phone. It includes a pre-step. The smart phone provides a graphical interface for the user to enter the social account password to verify the correctness of the identity. S302: The access control device generates a random seed based on the system time with a dynamic information generation module; S303: and Send to the smart phone through the communication module; S304: After the smart phone receives the random number seed, the virtual keyboard production module scrambles the keyboard order based on the random number seed and generates a virtual keyboard image; S305: the lens of the smart phone The screen capture module turns on the camera and captures the image captured by the lens; S306: The identification and positioning module of the smartphone uses this image to find out where the access control keyboard is located in the image (as shown in Figure 4); S307: Smart The image overlay module of the mobile phone uses this positioning information to overlay the virtual keyboard image on the physical access control keyboard position in the lens screen (as shown in Figure 5). Achieve the effect of completely covering the original physical keyboard; S308: The user enters the access password through the physical keyboard on the access control device (as shown in Figure 6, the password is exemplified as "0123"); S309: enter the receiving module to receive the password ( The password is exemplified, the relative value is "5860") and handed over to the password check module; S310: The password check module performs password restoration based on random seed ("5860" restores to "0123") And compare it with the actual password in the password memory module; and S311: if the comparison is correct, unlock the door by unlocking the module.

To sum up, this case is not only innovative in terms of technical ideas, but also has many of the above-mentioned effects that are not used by traditional methods. It has fully met the requirements of statutory invention patents that are novel and progressive. To approve this invention patent application, to encourage invention, to the utmost convenience.

100‧‧‧Unlock side

200‧‧‧Auxiliary

110‧‧‧Memory module

120‧‧‧input module

130‧‧‧ dynamic information generation module

140‧‧‧password check module

150‧‧‧Unlock Module

160‧‧‧Unlock communication module

210‧‧‧ auxiliary communication module

220‧‧‧Screen Capture Module

230‧‧‧Virtual keyboard production module

240‧‧‧Identification positioning module

250‧‧‧Image nesting module

Claims (6)

An augmented reality unlocking system is an unlocking terminal and an auxiliary terminal, wherein the unlocking terminal includes: a memory module for storing an original password; an input module for providing a first unlock code; A dynamic information generating module generates a random conversion factor; a password check module generates a second unlock code by combining the conversion factor and the first unlock code, and combines the second unlock code with the original The passwords are compared; an unlocking module provides unlocking; an unlocking communication module provides wireless connection with the auxiliary terminal; wherein the auxiliary terminal includes: an auxiliary communication module that receives the transmission from the unlocking terminal. Conversion factor; a screen capture module that captures the appearance image of the unlocked end and displays it on a display screen of the auxiliary end; a virtual keyboard production module that generates a virtual keyboard image through the conversion factor; An identification positioning module is used to locate the position of the input module through the appearance image of the unlocking end; and an image overlay module is used to overlay the virtual keyboard image on the input in the display screen. Position of the group. The augmented reality unlocking system described in item 1 of the patent application scope, wherein the unlocking end is provided with a keyboard. The augmented reality unlocking system described in item 1 of the patent application scope, wherein the auxiliary end is provided with a photographic lens. The augmented reality unlocking system described in item 1 of the scope of patent application, wherein the conversion factor is generated based on the system time. An augmented reality unlocking method includes the following steps: an unlocking communication module of an unlocking terminal is connected with an auxiliary communication module of an auxiliary terminal; a dynamic information generating module of the unlocking terminal generates a conversion factor And send it to the auxiliary terminal, and a virtual keyboard production module generates a virtual keyboard image according to the conversion factor; a screen capture module of the auxiliary terminal is to capture the appearance image of the unlocked terminal and display it Display a screen on one of the auxiliary terminals; one of the auxiliary terminals recognizes the positioning module, locates the position of one of the input terminals of the unlocking terminal through the appearance image of the unlocking terminal, and an image overlay module The virtual keyboard image is nested on the position of the input module in the display screen; a first unlock code is generated according to the relative position of the input module and the virtual keyboard image; the password check on the unlock end The module combines the conversion factor and the first unlock code to generate a second unlock code, and compares the second unlock code with an original password stored in a memory module; and instructs an unlock module to unlock. The augmented reality unlocking method described in item 5 of the scope of patent application, wherein the first unlock code is entered into the input module by using a gesture between the unlocking end and the auxiliary end.