KR101837152B1 - Method of user authentication using a variable keypad and facial recognition and, the system thereof - Google Patents

Abstract

The present invention relates to an authentication system for a financial transaction, wherein an authentication server, which is a mixed password and facial recognition information, according to an embodiment of the present invention generates a variable keypad including a cryptographic key, A variable keypad generating unit for generating a variable key every time the key is generated; An authentication information storage unit for storing authentication information of a portable terminal user; And providing the generated information on the variable keypad to a remote portable terminal. The location information of the cryptographic key according to the order inputted by the user from the portable terminal and the face recognition information of the user acquired using the camera of the portable terminal And an authentication performing unit for performing authentication of the user using the received authentication information.

Description

TECHNICAL FIELD The present invention relates to a method and system for authenticating a user using a variable keypad and face recognition,

More particularly, the present invention relates to a method and system for authenticating a user, and more particularly, to a system and method for authenticating a user by inputting a password through a variable keypad in a portable terminal, receiving facial recognition information through a camera and transmitting it to a server, Authentication method and system.

Recently, financial transactions such as electronic payment using mobile terminals such as smart phones and tablets have become active, and interest in security related issues such as passwords is increasing.

This is because, unlike existing mobile phones, smartphones are vulnerable to hacking like a widely deployed PC because anyone can develop applications and learn about its structure.

In particular, when entering a password or a resident registration number by using a fixed keypad, the user needs to be careful when inputting the password since it is easy to find out the password or the resident registration number based on the location when the location is touched.

A method for compensating the problem in using such a fixed keypad is an authentication method using a variable keypad. In the variable keypad method, since the arrangement of the input buttons of the keypad is changed every time the user connects, even if a third party finds a position of a password or the like inputted by the user on the keypad, it is difficult to know the password by using it.

However, even if the variable keypad is used, when the user witnesses a password input scene in the vicinity or hacking a password transmitted from the portable terminal to the server in the middle when the authentication is requested, the password itself can be detected, .

Also, there is a problem that if the third party authenticates the user and performs authentication of the user with the password thus obtained, it can not be prevented.

SUMMARY OF THE INVENTION The present invention has been made in view of the technical background as described above, and it is an object of the present invention to provide a system capable of preventing the unauthorized use of a third party by transmitting the position information of the variable keypad and the face recognition information together when the password is transmitted from the portable terminal to the authentication server The present invention is directed to providing a method for providing a service to a user.

The objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to another aspect of the present invention, there is provided an authentication server which is a mixed password and face recognition information authentication system, comprising: a variable keypad including a cryptographic key, the variable keypad generating a variable A keypad generating unit; An authentication information storage unit for storing authentication information of a portable terminal user; And providing the generated information on the variable keypad to a remote portable terminal. The location information of the cryptographic key according to the order inputted by the user from the portable terminal and the face recognition information of the user acquired using the camera of the portable terminal And an authentication performing unit for performing authentication of the user using the received authentication information.

The authentication portable terminal according to another aspect of the present invention includes a display unit displaying a variable keypad including a cryptographic key, the variable keypad being generated such that the position of each cryptographic key is varied at every generation; A camera unit for recognizing the user's face; And an authentication server for receiving the information of the variable keypad and transmitting the position information of the cryptographic key obtained through the variable keypad and the input order of the cryptographic key and the face recognition information acquired through the camera unit to the authentication server .

According to another aspect of the present invention, there is provided a method of authenticating a password and a facial recognition information mixed entity, the method comprising: generating a variable keypad including an encryption key, wherein the position of each of the encryption keys is varied at every generation; Transmitting the generated variable keypad to a portable terminal; Receiving position information of the cryptographic key according to an order entered by a user from the portable terminal and face recognition information of the user acquired through a camera of the portable terminal; And performing authentication of the user based on the received location information of the encryption key and the face recognition information.

According to the present invention, since the position information of the keypad is transmitted instead of the password itself, the password can not be obtained by hacking, and even when the password is leaked, the face identification information is transmitted together. There is an effect that can be made.

Brief Description of the Drawings Fig. 1 is a diagram illustrating an authentication system including a portable terminal and an authentication server according to an embodiment of the present invention.
2 is a flow diagram of a principal authentication method in accordance with an embodiment of the present invention.
FIG. 3 is a view showing generation of a variable keypad according to an embodiment of the present invention. FIG.
FIG. 4 is a diagram showing a variable keypad according to an embodiment of the present invention in the XY plane as coordinates; FIG.
5 is a flowchart illustrating a procedure for extracting a password from an encryption key according to an embodiment of the present invention to perform authentication.
6 is a view illustrating a display unit of a mobile terminal having a variable keypad and a face recognition unit according to an exemplary embodiment of the present invention.
FIG. 7 illustrates authentication using an identifier of a variable pad according to another embodiment of the present invention. FIG.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. As used herein, the terms " comprises, " and / or "comprising" refer to the presence or absence of one or more other components, steps, operations, and / Or additions.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing an authentication system which is a mixed password and face recognition information according to an embodiment of the present invention.

As shown in FIG. 1, the authentication system, which is a mixed password and facial recognition information, includes a portable terminal 100 and a personal authentication server 200.

The authentication server 200 includes a variable keypad generation unit 210, an authentication performance unit 220, and an authentication information storage unit 230.

The variable keypad generation unit 210 generates a variable keypad including an encryption key so that the positions of each of the numeric keys and the character keys constituting the encryption key are varied at each generation of the variable keypad.

When the authentication performing unit 220 transmits the arrangement information of each cipher key, which is information of the generated variable keypad, to the remote portable terminal 100, the portable terminal 100 uses the same to authenticate the password and the face identification information Input information.

In addition to the method of generating a variable keypad whenever necessary, the authentication performing unit 220 generates a plurality of variable keypads in advance, assigns an identifier to each of the variable keypads, shares the same with the portable terminal 100, It is also possible to use a method of transmitting only the identifier to the mobile terminal 100.

The authentication performing unit 220 receives the location information of the cryptographic key and the face recognition information according to the order inputted by the user from the mobile terminal 100 and performs the authentication based on the received information.

For example, the authentication performing unit 220 receives the location information of the cipher key according to the order inputted by the user from the portable terminal 100 such as a smart phone, that is, 4, 3, 1, (0.5, 2.5), (3.5, 3.5), (1.5, 3.5), (2.5, 3.5) and face recognition information corresponding to the position of the corresponding cryptographic key, .

The authentication performing unit 220 stores the location information and the input order of each cryptographic key corresponding to the password at the time of generating the variable keypad and stores the location information of the cryptographic key according to the order inputted by the user from the portable terminal 100, It performs authentication by comparing it with the location information of the pre-stored encryption key and the face recognition information.

If the password is 4, 3, 1, 2 as in the above example, the location information of the corresponding cryptographic key is (0.5, 2.5), (3.5, 3.5) , (2.5, 3.5), and the input sequence is the same as above.

The authentication performing unit 220 receives the location information and the input order and the face recognition information of the encryption key for the password according to the order inputted by the user from the portable terminal 100 and stores it in the authentication information storage unit 230 Authentication is performed by comparing with the authentication information including the location information of the encryption key, the input order, and the face recognition information.

The authentication performing unit 220 compares the characteristics of the facial image received from the terminal device 100 with the characteristics of the facial image stored in the authentication information storage unit 230 and outputs statistics to calculate the score, If it is equal to or greater than a predetermined threshold value (for example, 80%), it is determined that the face is the same face.

Face recognition technology is a technology for recognizing a user 's face displayed on a camera, analyzing the characteristics of the face, databaseing it, and discriminating users. Although recognition rate is lower than that of biometrics using iris, fingerprint, and vein, it is easy to recognize and does not have a sense of rejection, and it is advantageous that multiple persons can be recognized at the same time.

For facial recognition, faces are detected in the input image, and the positions of the eyes, nose, and mouth are aligned according to the standard image, and the facial features are matrixized and stored in the database.

In order to align the detected faces, the positions, sizes, and orientations of the faces stored in the database to be compared are aligned with respect to the positions of the eyes, nose, and mouth, which are elements of the face.

In order to recognize the face, it is necessary to extract the features that express the face well in the aligned face image. The recognition process is performed by comparing the similarity with other face features through a classifier that can classify these features well.

The authentication information storage unit 230 stores passwords, face recognition information, and the like of the users using the portable terminals.

Also, authentication information including the encryption key of the variable keypad, the location information of the encryption key, and the face recognition information generated by the variable keypad generation unit 210 is stored.

The mobile terminal 100 includes a display unit 120 including a variable keypad 110, a control unit 130, and a camera unit 140.

The mobile terminal 100 includes not only a mobile phone but also a kiosk installed in a smart phone, a mobile phone, a tablet PC, a notebook, a mobile credit card payment terminal, a bank ATM, a pharmacy,

The variable keypad 110 has a variable position of each cryptographic key at each generation. The variable keypad 110 is generated by the variable keypad generation unit 210 of the authentication server 200 and the variable keypad 110 of the portable terminal 100 is generated by the variable keypad 110 ) To the user.

The display unit 120 displays the face of the user obtained by the variable keypad 110 and the camera unit 140, and the position of the cipher key included in the variable keypad is changed at each generation.

6 shows a state in which the variable keypad 110 and the input unit for face recognition are displayed on the display unit 120. FIG. 6 (a) shows a state before a user recognizes a password and a face, and Fig. 6 (b) shows a state after a user recognizes a password and a face. Entered passwords are asterisked (*) for security purposes.

The control unit 130 receives the information of the variable keypad from the authentication server 200, and transmits the encryption key position information, the input order of the encryption key, and the face identification information received from the user to the authentication server 200.

The portable terminal 100 includes a camera unit 140 for face recognition, and the camera unit 140 photographs a direction toward a user. In order to use the user's face for inputting the authentication information in addition to the input of the above-described variable keypad 110 as the authentication information.

The camera unit 140 receives a command from the control unit 130 while the user inputs the variable keypad 110 and allows the user to photograph the face of the user while aligning with the guideline of the face contour displayed on the display unit 120. [ ) To adjust the position of the face to the guideline.

Since face alignment is required for face recognition, if the face of the user is photographed according to the guidelines displayed on the display unit 120, there is an advantage that the alignment for face recognition can be performed more easily.

The control unit 130 transmits the photographed face image to the authentication server 200, and the authentication server 200 can perform additional authentication using the face recognition information together with other authentication information.

The face image photographed by the camera unit 140 may be transmitted to the authentication server 200 as it is for analysis for face recognition or may be performed only for the information required for face recognition in the mobile terminal 100 It is also possible to extract and transmit only this information.

In the latter case, since it is not necessary to transmit the entire face image, the amount of data to be transmitted can be reduced, so that the transmission time can be shortened, the network load can be reduced, and the privacy of the face image can be protected against hacking. In such a case, the control unit 130 extracts feature information for face recognition from the photographed face image.

It is also possible to enhance the security through the method of adjusting the illuminance using the flash of the mobile terminal 100 before the camera 140 photographs the face. If the illuminance of the portable terminal 100 is adjusted by the flash of the human eye, the pupil becomes wider or narrower in response to the human eye. If this is checked, it is possible to distinguish whether the face captured by the camera is actually a human face. It is possible to prevent the authentication information from being manipulated by using the face photograph of the user, thereby enhancing security.

FIG. 2 is a flowchart illustrating a procedure of an authentication method in which a password and a face identification information are mixed according to an embodiment of the present invention.

First, the variable keypad including the encryption key is generated. The position of each encryption key may be varied at each generation (S110).

The generated variable keypad is transmitted to the portable terminal 100 together with the generation information (S120), and the user enters the password into the variable keypad and recognizes the face to the camera.

The authentication server 200 receives the location information and the face identification information of the encryption key according to the order inputted by the user from the portable terminal 100 in step S130 and performs authentication on the basis of the location information and the face identification information in step S140.

According to another embodiment of the present invention, it is also possible to perform identity authentication using only the location information of a part of the cryptographic key in the authentication of the user.

For example, if the password is 4312, the user does not input all four-digit passwords, but inputs only a part of the passwords such as 43 for the first two digits, 12 for the two digits after the first digits, 41 for the first digits and 41 for the third digits.

In the case of inputting the two digits 43, the position of the password becomes (0.5, 2.5), (3.5, 3.5) in FIG. 4 (a) The user authentication is performed.

When the user authentication is performed based on the positional information of a portion of the cryptographic key, the amount of data to be authenticated is relatively smaller than the amount of data of the entire cryptographic key, so that the operation speed can be improved. The user convenience can be improved.

FIG. 3 shows that the position of a cryptographic key in a variable keypad including a cryptographic key is varied at each generation according to an embodiment of the present invention. FIG. 3 (a) shows a state when the first variable keypad is generated 3 (b) indicates that the position of the encryption key is changed when the encryption key is next generated.

FIG. 5 is a flowchart illustrating a method for extracting a password from a location of a cryptographic key to perform identity authentication according to an embodiment of the present invention.

When the password is stored in advance in the authentication server of the user and the location information of the password is received from the portable terminal, the password is extracted from the location information and the input order of the received password and the extracted password is compared with the password stored in the authentication storage unit. Authentication.

First, the authentication performing unit receives the position of the encryption key according to the order inputted by the member from the portable terminal, and extracts the password inputted by the member (S510).

Next, the authentication performing unit compares the extracted password and the received face recognition information with password and facial recognition information stored in the authentication information storage unit to perform authentication (S520).

FIG. 7 is a diagram illustrating a primary authentication performed through an identifier corresponding to a variable keypad according to an embodiment of the present invention. FIG. 7 (a) illustrates an identifier assigned to a variable keypad stored in an authentication server, 7 (b) is a diagram showing an identifier assigned to a variable keypad stored in a portable terminal.

As shown in Fig. 7, the authentication performing unit generates a plurality of variable keypads and generates an identifier corresponding thereto. That is, when generating the variable keypad in the identity authentication server, indexes 1, 2, and 3 corresponding to the variable keys 1, 2, and 3 are generated, and the generated variable keypad and the identifier are provided to the portable terminal in advance.

When the authentication server receives the authentication request, the authentication server selects one of the stored identifiers and provides it to the portable terminal. The portable terminal receives the identifier and selects a variable keypad corresponding to the identifier and displays the selected variable keypad on the screen.

The authentication server performs the secondary authentication by comparing the position information, the input order, and the face recognition information of the encryption key received from the portable terminal with the position information, the input order, and the face recognition information of the previously stored encryption key.

According to this embodiment, since the variable keypad layout structure is not transmitted from the authentication server to the portable terminal, security can be improved because the variable keypad layout structure can not be found by hacking the transmission packet.

Since the user can advantageously conduct financial transactions in a more secure environment through the user authentication method and apparatus using the above-described variable keypad and face recognition, the user can safely conduct financial transactions using the mobile terminal and the mobile communication network .

While the present invention has been described in detail with reference to the accompanying drawings, it is to be understood that the invention is not limited to the above-described embodiments. Those skilled in the art will appreciate that various modifications, Of course, this is possible. Accordingly, the scope of protection of the present invention should not be limited to the above-described embodiments, but should be determined by the description of the following claims.

100:
110: Variable keypad 120: Display
130: control unit 140: camera unit
200: authentication server
210: Variable keypad generation unit 220: Authentication performance unit
230: Authentication information storage unit

Claims (9)

A variable keypad generating unit for generating a variable keypad including an encryption key so that the position of each of the encryption keys is variable at every generation;
An authentication information storage unit for storing authentication information of a portable terminal user; And
Providing the generated information on the variable keypad to a remote portable terminal, receiving position information of the cryptographic key according to the order inputted by the user from the portable terminal, and information on the movement of the user's pupil obtained using the camera of the portable terminal And an authentication performing unit for receiving the face recognition information and performing the identity authentication,
The authentication performing unit receives the face recognition information when the pupil is reacted according to the illuminance controlled through the flash of the camera when the user's password is input to the variable keypad, Used for
Wherein the authentication server is a mixed password and face recognition information.
2. The method according to claim 1,
The face image of the user or the feature information extracted from the face image
In password and face recognition information mixed authentication server.
The apparatus of claim 1, wherein the authentication performing unit
Extracting the password inputted by the user from the positional information of the received cryptographic key, and comparing the extracted password and the received face recognition information with the authentication information previously stored in the authentication information storage unit to perform authentication
In password and face recognition information mixed authentication server.
The apparatus of claim 1, wherein the authentication performing unit
Storing location information and an input order of each cryptographic key corresponding to the password at the time of generating the variable keypad,
Upon receipt of the position information of the cryptographic key and the face recognition information according to the order inputted by the user from the portable terminal,
And compares it with the position information, the input order, and the face recognition information of the cipher key previously stored in the authentication information storage unit to perform authentication
In password and face recognition information mixed authentication server.
The apparatus of claim 1, wherein the authentication performing unit
Storing an identifier corresponding to the variable keypad generated each time the variable keypad is generated, providing the stored identifier to the portable terminal,
Upon receipt of the identifier from the mobile terminal, compares the identifier with the previously stored identifier to perform the first authentication,
If the result of the first authentication is successful, the location information, the input order, and the face recognition information of the cryptographic key received from the portable terminal are stored in the authentication information storage unit, Comparing and performing authentication
In password and face recognition information mixed authentication server.
A display unit displaying a variable keypad including a cryptographic key, the variable keypad being generated such that the position of each cryptographic key is variable at every generation;
A camera unit for recognizing the user's face; And
And an input order of the cipher key of the cipher key obtained through the variable keypad and an input order of the cipher key obtained by the variable length keypad by the camera unit A controller for transmitting the facial recognition information of the user, which is obtained when the pupil is reacted according to the illuminance of the flash to be controlled, to the authentication server of the user;
And a portable terminal.
Generating a variable keypad including a cryptographic key, wherein the position of each of the cryptographic keys is variable at each generation;
Transmitting the generated variable keypad to a portable terminal;
When the pupil is reacted according to the position information of the cryptographic key according to the order inputted by the user from the portable terminal and the illuminance adjusted through the flash of the camera of the portable terminal, step; And
Authenticating the user based on the received location information, the input order, and the face recognition information of the encryption key;
And a face authentication information mixed authentication method.
8. The method of claim 7, wherein performing the identity authentication comprises:
Authenticating the user based on the location information of a part of the encryption key
In password and face identification information.
8. The method of claim 7,
The step of performing the identity authentication includes:
Extracting the password inputted by the user from the position information of the cryptographic key according to the order inputted by the user from the portable terminal, and then extracting the extracted password and the received face recognition information from the password and face recognition Performing identity verification against information
In password and face identification information.

Images