KR20180062937A - Method and apparatus for personal authentication based on fingertip gesture recognition and fake pattern identification - Google Patents

Abstract

A method and apparatus for recognizing a user through a fingertip gesture are provided. The recognition device may display a pattern generated based on the geometric information of the shape or size of a user′s hand and recognize the fingertip gesture through interaction with the user on the pattern. The recognition device can perform authentication for the user using the recognized fingertip gesture. The pattern may include a gesture induction/related pattern and a fake pattern. The fingertip gesture may include the fingertip touch positions of the fingertip gesture, the touch order of the fingertip touch positions, and the movement direction of the fingertip touch positions.

Description

[0001] METHOD AND APPARATUS FOR PERSONAL AUTHENTICATION BASED ON FINGERTIP GESTURE RECOGNITION AND FAKE PATTERN IDENTIFICATION [0002]

The following embodiments relate to a method and apparatus for personal authentication, and more particularly to a method and apparatus for personal authentication based on fingertip gesture recognition and false pattern identification.

Various methods for personal identification and personal authentication have been developed and various methods have been used.

Efforts are being made to improve security in personal authentication in order to more securely protect important assets. Efforts to improve security and convenience are becoming important issues in the field of personal authentication.

Personal authentication is used for purposes such as controlling access to smart devices and controlling access to buildings and the like.

Various methods for authenticating an individual for such use control and access control include a password, a pattern lock based on a numeric pad, a random keyboard, a personal identification number (PIN), and a smart card (smart cards) are used.

Passwords, pattern locks, and PINs for personal authentication have a disadvantage in that they are easily forgotten or easily leaked.

Static pattern locks and random keyboards, which are mainly used in mobile devices, can also be easily leaked by shoulder surfing or the like.

As a more advanced method to overcome the problems of these methods, biometrics technology which utilizes various biometric information such as fingerprint, iris, face, finger vein, hand vein and hand geometry for personal authentication .

Biometric technology can be one of the powerful means of personal authentication. However, personal authentication using biometric information generally requires additional sensors to stably acquire biometric information. In addition, since the biometric information is lifelong invariable and is different from each other, it can not be deleted, changed and re-issued even if the biometric information of the individual is leaked. Further, there is a problem that it is difficult to technically cope with leakage of biometric information.

To address this problem, there is a need for a personal authentication based on soft biometric or semi-biometric and a mechanism for enhancing the security of such personal authentication.

Korean Patent Publication No. 1020130072606, published on July 2, 2013 (name: input interface providing apparatus and operation method thereof)

One embodiment provides an apparatus and method for providing a pattern that enables interaction with a user based on a geometric range of a hand shape and / or a hand size when biometric information of a hand shape and / or a hand size is registered through a touch screen Can be provided.

One embodiment may provide an apparatus and method for authenticating a user through continuous interaction of a pattern and a fingertip gesture.

One embodiment may provide an apparatus and method for authenticating a user using a predetermined sequence or a randomly displayed gesture induction / associated pattern and a fake pattern.

One embodiment can provide an apparatus and method for authenticating a user by simultaneously using hand and / or hand biometric information lacking uniqueness to identify an individual and a fingertip gesture capable of supplementing the biometric information .

One embodiment of the present invention provides a device and a method for simultaneously providing advantages of ease of use of existing personal authentication methods such as a password and a PIN and security benefits of existing biometric methods through simultaneous use can do.

One embodiment provides an apparatus and method for continuously recognizing various fingertip gestures capable of re-issuing and regenerating for enhancing safety and security based on soft biometrics using hand-shaped and / or hand-sized biometric information .

One embodiment can provide an apparatus and method for recognizing a user more securely and efficiently through recognition of soft biometrics and fingertip gestures.

One embodiment can provide an apparatus and method for authenticating a user without using an additional sensor by directly using the touch screen used in various products, technologies, and applications.

One embodiment can provide an apparatus and method for authenticating a user that can be implemented without changing and adding hardware in existing smart devices, computer systems, ATM devices, and access control systems using a touch screen have.

At a side, identifying a user; Displaying a generated pattern based on geometric information of the identified hand or hand size of the identified user; Recognizing a fingertip gesture through interaction with the user for the pattern; And performing authentication for the user using the recognized fingertip gesture.

In the identifying step, the candidate user information corresponding to the user ID or information of the hand may be retrieved using the user ID or information of the input hand.

The information of the hand may include geometric information in the form of a hand or a hand.

The pattern may be a gesture induction / related pattern.

The gesture inducing / related pattern may be a pattern for acquiring a fingertip gesture registered by the user.

The step of recognizing the fingertip gesture may include sensing fingertip touch positions of the input fingertip gesture; Sensing a movement direction of the fingertip touch positions; And determining whether the input fingertip gesture is a successful gesture for the gesture inducing / related pattern through comparison of similarity between information of the input fingertip gesture and information of the registered fingertip gesture.

The input fingertip gesture information may include the fingertip touch positions and the movement direction.

The input fingertip gesture may be determined to be successful if the result of the comparison of the calculated fingertip gesture and the calculated comparison of the fingertip gesture information is greater than or equal to the predetermined reference value.

The input information of the fingertip gesture may further include a touch order of the fingertip touch positions.

A particular entity may be displayed as a background with the gesture induction / association pattern.

The entity may represent one or more points.

Each point of the one or more points may be an area that can be identified and identified within the entity.

The one or more points may be generated based on geometric information of the user's hand or hand size.

The one or more points may correspond to positions of the ends of the user's fingers in accordance with the geometric information of the user's hand or hand size.

The pattern may be hidden at the moment when the fingertip gesture is touched or may be hidden when the predetermined time after the touch of the fingertip gesture has elapsed.

The pattern may be a fake pattern.

The fake pattern may be a pattern for obtaining a predefined fingertip gesture.

Registering information for identification of a user on another side; And registering the user's fingertip gesture, wherein the information for identifying the user includes geometric information of the hand shape or the hand size of the user.

The authentication information registration method may further include selecting a type of registration information of the fingertip gesture.

The registration information may be background-based registration information or fingerprint-based registration information of no background.

Wherein registering the fingertip gesture comprises: registering a background and a fingertip touch position of the fingertip gesture; And registering a moving direction of the fingertip touch positions.

In registering the fingertip touch position, when one or more points of the background entity are displayed, one or more fingertip touch positions may be selected and registered among the one or more points.

The size or shape of the entity may be created or adjusted based on the geometry of the user's hand or hand size.

In the step of registering the fingertip touch position, the touch order of one or more fingertip touch positions of the fingertip gesture may be registered.

Wherein the registering of the fingertip gesture includes: registering a fingertip touch position of the fingertip gesture; And registering a moving direction of the fingertip touch positions.

In registering the fingertip touch position, one or more points may be displayed, and one or more fingertip touch positions may be selected and registered among the one or more points.

The positions of the one or more points may be created or adjusted by geometric information of the shape or size of the user.

A display for outputting a generated pattern based on geometric information of a user's hand or hand size; And a processor for recognizing a fingertip gesture through interaction with the user for the pattern and performing authentication for the user using the recognized fingertip gesture.

In addition, there is further provided another method, apparatus, system for implementing the invention and a computer readable recording medium for recording a computer program for executing the method.

There is provided an apparatus and method for providing a pattern that enables interaction with a user based on a geometric range of a hand shape and / or a hand size when hand and / or hand-sized biometric information is registered through a touch screen.

An apparatus and method for authenticating a user through continuous interaction of a pattern and a fingertip gesture are provided.

An apparatus and method for authenticating a user using a predetermined sequence or randomly displayed gesture induction / associated pattern and a fake pattern are provided.

There is provided an apparatus and method for authenticating a user by simultaneously using hand and / or hand biometric information lacking uniqueness to identify an individual and a fingertip gesture capable of supplementing the biometric information.

There is provided an apparatus and a method for simultaneously providing advantages of ease of use of existing personal authentication methods such as a password and a PIN and security benefits of existing biometric methods through simultaneous use.

Based on soft biometrics using hand and / or hand-sized biometric information, an apparatus and method for continuously recognizing various fingertip gestures capable of re-issuance and regeneration for enhanced security and security are provided.

An apparatus and method for recognizing a user more securely and efficiently is provided through recognition of soft biometrics and fingertip gestures.

There is provided an apparatus and method for authenticating a user without using additional sensors by directly using the touch screen used in various products, technologies, and applications.

There is provided an apparatus and method for authenticating a user that can be implemented without changing or adding hardware in existing smart devices, computer systems, ATM devices, and access control systems using a touch screen.

1 is a structural diagram of an authentication apparatus according to an embodiment.
Figure 2 illustrates the functionality of a processor according to an example.
FIG. 3 illustrates personal authentication using hand and / or hand sized biometric information and fingertip gestures based on an example touch screen.
FIG. 4 is a block diagram of a personal authentication system based on recognition of a hand shape and fingertip gesture in a touch screen environment according to an embodiment.
5 is a flow diagram of an authentication method according to one embodiment.
6 is a flowchart of a registration method of authentication information according to an example.
7 is a flowchart of a registration method of background-based registration information according to an example.
FIG. 8 is a flowchart illustrating a method of registering finger-point-based registration information of a non-background according to an example.
9 is a flowchart of an authentication method for a user according to an example.
10 is a flowchart of a method of identifying a user according to an example.
11 is a flowchart of a method for recognizing a fingertip gesture with respect to a gesture inducing / related pattern according to an example.
FIG. 12 is a flowchart of a fingertip gesture recognition method for a fake pattern according to an example.

The following detailed description of exemplary embodiments refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments. It should be understood that the various embodiments are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the location or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the embodiments. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the exemplary embodiments is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained.

In the drawings, like reference numerals refer to the same or similar functions throughout the several views. The shape and size of the elements in the figures may be exaggerated for clarity.

The terms used in the examples are intended to illustrate the embodiments and are not intended to limit the invention. In the examples, the singular includes the plural unless otherwise stated in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / And that additional configurations may be encompassed within the scope of the embodiments of the exemplary embodiments or the technical ideas of the exemplary embodiments. When it is mentioned that a component is " connected " or " connected " to another component, the two components may be directly connected or connected to each other, It is to be understood that other components may be present in the middle of the components.

The terms first and second, etc. may be used to describe various components, but the components should not be limited by the terms above. The above terms are used to distinguish one component from another. For example, without departing from the scope of the right, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

In addition, the elements shown in the embodiments are shown independently to represent different characteristic functions, and do not mean that each element is composed of separate hardware or a single software constituent unit. That is, each component is listed as each component for convenience of explanation. For example, at least two of the components may be combined into a single component. Also, one component can be divided into a plurality of components. The integrated embodiments and the separate embodiments of each of these components are also included in the scope of the right without departing from the essence.

Also, some components are not essential components to perform essential functions, but may be optional components only to improve performance. Embodiments may be implemented only with components that are essential to implementing the essentials of the embodiments, and structures within which the optional components are excluded, such as, for example, components used only for performance enhancement, are also included in the scope of the right.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to facilitate embodiments of the present invention by those skilled in the art. In the following description of the embodiments, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present disclosure rather unclear.

In the following embodiments, a method and apparatus for personal authentication based on continuous fingertip gesture recognition are provided to overcome various problems associated with personal authentication according to the above-described prior art. Here, the continuous fingertip gesture recognition may mean recognizing the fingertip touch positions of the fingertip gesture, the touch order of the fingertip touch positions, and the movement directions of the fingertip touch positions.

In recent years, touchscreens have been used in various systems such as mobile devices as well as computers and access control devices.

In the following embodiments, a method and apparatus for personal authentication based on a fingertip gesture based on hand and / or hand-sized biometric information in a touch screen environment provided with a touch screen may be provided. The fingertip gesture can be continuously recognized by the device through interaction with the device. The interaction between the fingertip gesture and the device may be based on hand shape and / or hand size biometric information.

Personal authentication based on continuous fingertip recognition can be performed through interaction between a user and an authentication system using hand-sized and / or hand-sized biometric information in a touch screen environment without additional sensors.

For example, when hand and / or hand-sized biometric information is input via the touch screen, the authentication device may generate a pattern that can interact with the user on the touch screen based on hand geometry and / Can be presented. Personal authentication can be performed through continuous and correct interaction of the fingertip gestures performed by the user with respect to the presented pattern.

Personal authentication using biometric information may be a more advanced method than other conventional personal authentication methods. Personal authentication using biometric information may be a very good technique in terms of security, but may be a technique that is somewhat lacking in ease of use. On the other hand, other types of personal authentication may be a technique that is somewhat lacking in terms of ease of use and superior security or security.

In the following embodiments, a method and an apparatus for personal authentication for simultaneously benefiting from advantages in terms of ease of use of existing personal authentication methods and security advantages of personal authentication using biometric information . The method and apparatus can authenticate an individual more securely and efficiently through continuous recognition of various fingertip gestures that can be reissued and regenerated in order to enhance stability and security based on soft biometric information.

1 is a structural diagram of an authentication apparatus according to an embodiment.

The authentication device 100 can perform authentication for a user in a touch screen environment. The authentication apparatus 100 can perform authentication for the user based on the hand-shaped biometric information. The authentication device 100 may also be configured to authenticate the user based on continuous recognition of the user's fingertip gesture through interaction with the authentication device 100 within the geometric location and / Can be performed.

The authentication device 100 may include a sensor 110, an interface 120, a display 130, and a processor 140.

The sensor 110 may be an input sensing device such as a touch screen. The sensor 110 may receive a multi-touch input. The sensor 110 or the processor 140 may recognize the user's hand shape, hand shape, and fingertip gesture through the obtained multi-touch input.

The interface 120 may transmit the data sensed by the multi-touch input to the processor 140. [

The interface 120 may be any suitable interface such as a Universal Serial Bus (USB), an IEEE 1394, a LAN (Local Area Network), a WiFi, a Bluetooth, Various types of interface functions can be provided.

The sensor 110, the interface 120 and the display 130 may constitute a touch screen display. In other words, the authentication device 100 may include a touch screen display and a processor 140. In the following, the operations and functions described as being performed by the sensor 110, the interface 120 and the display 130 may be considered to be performed by a touch screen display.

Display 130 may output a generated pattern based on geometric information of a user's hand and / or hand size.

The display 130 may output a gesture induction / association pattern for fingertip gesture recognition generated by the processor 140 for interaction between the user and the sensor 110. The user can recognize the output gesture inducing / related pattern and input the fingertip gesture corresponding to the gesture inducing / related pattern to the sensor 110.

The gesture induction / related pattern may be a pattern that induces a user's fingertip gesture within the geometry of the user's hand and / or hand size. For example, the gesture induction / related pattern may indicate one or more or five points at which the fingers of the user's hand can be touched. The points may be determined according to the user's hand shape and / or hand size.

Finger gestures can be recognized through user interaction with gesture induction / related patterns.

The processor 140 can perform registration of authentication information used for authentication of the user and can control the user's authentication.

Processor 140 may recognize the user's fingertip gesture for the pattern and perform authentication for the user using the recognized fingertip gesture. The processor 140 may recognize the fingertip gesture through interaction with the user on the pattern.

The function of the processor 140 is described below with reference to FIG.

Figure 2 illustrates the functionality of a processor according to an example.

Processor 140 may perform functions such as registration management, fingertip gesture management, fingertip gesture matching, and authentication management. For example, the processor 140 may include a registration management module, a fingertip gesture management module, a fingertip gesture matching module, and an authentication management module.

The registration management module can perform registration of the user and registration of the authentication information with respect to the user. The registration management module can securely and efficiently manage the authentication information registered for the user.

The authentication management module can determine whether or not the user is authenticated. The authentication management module can determine whether the user is authenticated through interlocking with the registered authentication information and gesture matching based on the fingertip gesture.

The fingertip gesture management module may generate a pattern for user registration and authentication to the user based on hand geometry and / or hand size geometry information. Also, the fingertip gesture management module can handle the interaction of fingertip recognition.

The fingertip gesture matching module can manage the registration of various fingertip gestures such as the fingertip touch position and the movement direction of the fingertip touch position.

FIG. 3 illustrates personal authentication using hand and / or hand sized biometric information and fingertip gestures based on an example touch screen.

A user ID input screen 310 for inputting a user ID of a user or a hand input for inducing a hand touch when a finger of the user is proximate to the sensor 110 or the touch screen or touches the sensor 110 or the touch screen A screen 320 may be displayed.

For example, the hand-shaped input screen 320 may include a hand-shaped outline generated according to information of a user's hand shape and / or hand size.

When the authentication apparatus 100 displays the user ID input screen 310, the user can input the registered user ID to the touch screen.

When the authentication device 100 displays a hand-shaped input screen 320 for inducing a hand-shaped touch, the user can input hand-shaped biometric information according to the guidance of the displayed hand-shaped input screen 320.

For example, the user may place his or her hand within the outline of the hand.

Also, if necessary, the authentication apparatus 100 can acquire user's basic information through the user ID input screen 310 and the hand input screen 320. [ The user can input the user ID through the user ID input screen 310 and also input the hand biometric information through the hand input screen 320. [

As described above, when the basic information of the pre-registered user is inputted, the fingertip recognition process may be performed to authenticate the user.

For authentication of the user, the authentication device 100 may display the gesture induction / association pattern 330 to obtain a fingertip gesture corresponding to a pre-registered fingertip gesture by the user.

The user can touch one or more fingertip locations pre-registered on the displayed display or touch screen with the gesture induction / associated pattern. One or more touched fingertip positions may constitute an input pattern. Also, the user can move one or more fingertip positions along the pre-registered direction while one or more fingertip positions are touched.

For example, if the input pattern and the direction of movement of one or more fingertip positions match the information of the pre-registered fingertip gesture, the authentication device 100 may determine that the input of the gesture induction / related pattern is successful. If at least one of the input pattern and the direction of movement of one or more fingertip positions does not match the information of the pre-registered fingertip gesture, the authentication device 100 may determine that the user's input to the gesture induction / related pattern has failed.

Authentication for the user may consist of a plurality of steps. The user's input on the gesture induction / related pattern for each of the plurality of steps may be determined to be success or failure.

If the input pattern and the direction of movement of one or more fingertip positions match the information of the pre-registered fingertip gesture, the authentication device 100 may display the gesture induction / related pattern of the next step.

That is to say, the gesture induction / related pattern may be a plurality of consecutive steps. Information of the fingertip gesture can be registered for each gesture inducing / related pattern of the gesture inducing / related patterns of the plurality of steps. The plurality of gesture induction / related patterns can be randomly generated and displayed regardless of the registration order of information of the fingertip gesture.

Background information or objects similar to previously registered or pre-registered may be displayed with the gesture induction / related pattern so that the user can easily remember his / her gesture. Background information or objects allow the user to identify which fingertip gesture should be entered for the gesture induction / related pattern.

3, three background information 340, 350 and 370 are shown. Background information may be a specified picture or picture that is displayed in a form that is specific to the point at which one or more fingertip positions of the user are touched.

The background information may be a hint or information that may be helpful in memorizing or inputting the fingertip touch positions, the touch order of the fingertip touch positions and / or the direction of movement of the fingertip touch positions as the user enters the fingertip gesture .

For example, background information 340, 350, and 370 may include entities. Here, the object may be an animal or a character.

An entity may represent one or more points. Each point of one or more points can be an area that can be identified and identified within an entity and can be the object of a touch.

For example, each of at least some of the animal's eyes, nose, mouth, and ears may be a point.

For example, the first background information 340 may be a picture or a photograph of a koala, and a point at which one or more fingertip positions are touched may be ears of a koala. That is to say, when the koala is displayed as the background information of the gesture induction / related pattern, the user can recognize that he or she must touch each of the koala's ears with fingers and move the touched fingers in the downward direction.

For example, the second background information 350 may be a picture or a photograph of a face of a tiger, and a point at which one or more fingertip positions are touched may be teeth of a tiger's face. That is to say, when the face of the tiger is displayed as the background information of the gesture induction / related pattern, the user recognizes that he must touch the teeth of the tiger's face with fingers and move the touched fingers in the left direction .

For example, the fourth background information 370 may be a picture or a photograph of a whole body of a tiger, and a point at which one or more fingertip positions are touched may be the fore and aft ends of the tiger. That is to say, when the user displays the body of the tiger as the background information of the gesture inducing / related pattern, he or she must touch each of the fore and aft ends of the tiger with fingers and move the touched fingers in the left direction You may have to be aware.

If the user's inputs to a plurality of steps are continuously and correctly entered, then the number of steps required for authentication can be reduced. Alternatively, additional steps may be required if the user's input to one of the plurality of steps fails.

In order to supplement the problem of having to go through several steps for personal authentication, gesture induction / related patterns can be regenerated even if the user's input is inconsistent with a portion or information of the registered fingertip gesture information. The user can again input a fingertip gesture for the re-generated gesture induction / related pattern. Here, the regenerated gesture inducing / related pattern may have a high degree of difficulty for a general gesture induction / related pattern, or may have a normal degree of difficulty.

In the generation of the gesture induction / related pattern, a fake pattern 360 may be generated, either randomly or according to predetermined conditions, as the case may be.

For a fake pattern, the user can enter a predefined fingertip gesture for the fake pattern. That is to say, the fake pattern may be a case where a predetermined fingertip gesture must be entered in order to recognize that the fake pattern is not the fingertip gesture registered by the user.

The fake pattern may be displayed along with background information or an entity that allows the user to identify that it is a fake pattern. Alternatively, the fake pattern may be displayed with a default background color, a predefined message, a predefined symbol, and a predefined effect sound that allows the user to identify that it is a fake pattern. Alternatively, as the fake pattern, a random pattern that the user has not seen before can be displayed.

As described above, for the gesture induction / related patterns and fake patterns displayed in the plurality of steps, the user can enter a plurality of fingertip gestures in random or sequential order, Personal authentication can be done.

Background information or the size of the object and one or more points may be generated based on pre-input user's hand shape and / or hand size geometry information. For example, the one or more points determined by the background information or the size of the object may correspond to the positions of the ends of the user's fingers in accordance with the user's hand shape and / or hand size geometric information.

 When a user's fingertip is touched on the touch screen, the displayed pattern may be hidden at the moment the fingertip gesture is touched, or may be hidden when the predetermined time elapses after the touch of the fingertip gesture.

The order in which the patterns are generated, the background information, the objects, and the like can be generated differently according to the time of the interaction between the fingertip gesture and the device or the order of the touch of the fingertip.

FIG. 4 is a block diagram of a personal authentication system based on recognition of a hand shape and fingertip gesture in a touch screen environment according to an embodiment.

The sensing unit 405, the interface unit 410 and the display unit 480 may correspond to the sensor 110, the interface 120, and the display 130, respectively.

A hand information input unit 415, a gesture detection unit 420, a fingertip sensing unit 425, a fingertip sensing unit 430, an ID input unit 435, a registration management unit 440, an ID management unit 445, The gesture matching unit 460, the authentication management unit 465, the fake pattern generation unit 470 and the pattern generation unit 475 are executed by the processor 140. The data base (DB) 450, the gesture management unit 455, the gesture matching unit 460, Lt; / RTI > The functions or operations described as being performed by the program modules may be considered to be performed by the processor 140. [ Alternatively, the processor 140 may include a hand information input unit 415, a gesture detection unit 420, a fingertip sensing unit 425, a fingertip sensing unit 430, an ID input unit 435, a registration management unit 440, A gesture management unit 455, a gesture matching unit 460, an authentication management unit 465, a fake pattern generation unit 470, and a pattern generation unit 475, .

The user's fingertip gesture may be input through the sensing unit 405. [

The information of the input fingertip gesture may be transmitted to the hand information input unit 415 through the interface unit 410.

When the user ID of the user is inputted through the ID input screen 310, the ID input unit 435 can verify and process the input character string and the completion of the input. The input character string may be transmitted to the ID management unit 445.

When registering the user ID, the registration management unit 440 can check whether or not the user ID requested to be registered is valid, and determines whether the user ID requested to be registered overlaps with the ID registered in the registration information DB 450 .

The ID management unit 445 can manage the input of the user ID, the registration of the user ID, and the registration information DB 450 and the like.

The ID management unit 445 may transmit information of the user's fingertip gesture to the gesture management unit 455. [

The hand information input unit 415 may generate hand-shaped and / or hand-shaped geometric information when information about the user's hand is input through the sensor 110 or the touch screen.

The hand information input unit 415 analyzes the contact surface of the sensor 110 or the touch screen and verifies the hand shape and / or hand shape of the user's hand so that the user's hand touches the touch screen, It is possible to judge whether information about the hand is inputted or not.

The hand information input unit 415 can cause the gesture detection unit 420 to be performed unless the information on the hand is inputted.

The gesture detection unit 420 can verify whether or not the fingertip gesture is input by analyzing the touch surface of the fingertip.

When the input of the fingertip gesture is confirmed, the fingertip sensing unit 425 can sense the touch order of the fingertip touch positions and the fingertip touch positions with respect to the input fingertip gesture.

Also, when the input of the fingertip gesture is confirmed, the fingertip direction sensing unit 430 can sense the movement direction of the fingertip touch positions.

The information of the fingertip gesture may include the touch order of the selective fingertip touch positions and the fingertip touch positions sensed by the fingertip sensing unit 425 and the movement direction of the fingertip touch positions sensed by the fingertip sensing unit 430 .

The gesture management unit 455 can analyze and process similarity comparison items between the input fingertip gesture information and registered fingertip gesture information. The ID management unit 445 can retrieve the information of the fingertip gesture of the user registered in the registration information DB 450. [ By analyzing and processing the similarity comparison items, it can be efficiently compared whether the user's fingertip gesture corresponds to the registered user's fingertip gesture.

The gesture matching unit 460 can calculate the quantitative similarity comparison result through matching with the similarity comparison item.

The authentication management unit 465 may perform the following steps according to the calculated quantitative similarity comparison result. The next step may be authentication (completion), (additional) authentication using a gesture induction / association pattern, or (further) authentication using a fake pattern.

For example, the authentication management unit 465 may determine that the input fingertip gesture is successful if the calculated quantitative similarity comparison result is greater than or equal to the predetermined reference value. The authentication management unit 465 may determine that the input fingertip gesture has failed if the calculated quantitative similarity comparison result is smaller than the predetermined reference value.

For example, the authentication management unit 465 can complete the authentication when the input fingertip gesture is successful.

For example, the authentication management unit 465 may complete authentication if one or more predetermined steps have been performed and the input fingertip gesture is successful.

For example, if the input fingertip gesture is successful, the authentication management unit 465 may perform authentication using the next gesture induction / related pattern as a next step.

For example, if the input fingertip gesture fails, the authentication management unit 465 may perform authentication using the following gesture induction / related pattern as a next step.

For example, if the input fingertip gesture is successful, the authentication management unit 465 can generate a fake pattern as the next step, and proceed with authentication using the fake pattern.

For example, if the input fingertip gesture fails, the authentication management unit 465 can generate a fake pattern as the next step, and proceed with authentication using the fake pattern.

When the authentication using the fake pattern proceeds, the fake pattern generator 470 can generate a fake pattern. The fake pattern generator 470 may randomly generate a fake pattern according to various difficulties.

If authentication using the gesture induction / association pattern is in progress, the pattern generation unit 475 may generate a gesture induction / association pattern.

The display unit 480 may output a fake pattern or a gesture inducing / related pattern and may include a sensing unit 405, an interface unit 410, and a hand information input unit 415, And the like can be repeated again.

5 is a flow diagram of an authentication method according to one embodiment.

In step 510, the authentication apparatus 100 can register authentication information for user authentication. The authentication information may include information of a fingertip gesture.

At step 520, the authentication device 100 may perform authentication for the user.

The authentication apparatus 100 can perform authentication for the user based on recognition of a hand shape and / or hand size, recognition of a fingertip gesture, and identification of a fake pattern.

6 is a flowchart of a registration method of authentication information according to an example.

Step 510 described above with reference to FIG. 5 may include steps 610, 620, 630, and 640 described below.

In steps 610 and 620, the authentication device 100 may register information for identification of the user.

The information for identifying the user may include the user ID of the user and the hand information of the user.

The user's hand information may include geometric information of the user's hand shape and / or hand size.

In step 610, the authentication device 100 may register the user ID of the user.

In step 620, the authentication device 100 may register the hand information of the user.

In step 630, the authentication device 100 can select the type of registration information of the fingertip gesture.

The registration information may be background-based registration information or fingerprint-based registration information of no background. The background can be a photo or a picture. The type of registration information can be selected by the user or the authentication apparatus 100. [

In step 640, the authentication device 100 can register the fingertip gesture. The specific method of registration of the fingertip gesture may vary depending on the type of registration information selected.

The case where the background-based registration information is registered will be described later with reference to Fig. The case where the finger-point-based registration information with no background is registered will be described later with reference to Fig.

The steps 630 and 640 may be repeated as many times as required by the authentication device 100 and the process of registration after the iteration of steps 630 and 640 may end.

7 is a flowchart of a registration method of background-based registration information according to an example.

Step 640 described above with reference to FIG. 6 may include steps 710 and 720 described below.

At step 710, the authentication device 100 may register the background and fingertip touch location.

The touch screen can display background pictures and pictures. A photograph or a picture of the background can be selected by the user or the authentication apparatus 100, and a photograph or an object of the picture can be selected.

Once an object is selected, the touch screen may display one or more points of the background object. One or more fingertip touch locations may be selected and registered by the user or authentication device 100 from one or more points of the entity. That is to say, the points to be touched by the fingertip gesture among the one or more points of the pattern may be some of the one or more points of the above. The user may touch the point (s) of one or more of the points of the pattern, and the point (s) of the touched portion may be registered as part of the fingertip gesture for the pattern.

In addition, the touch sequence of one or more fingertip touch positions may be selected and registered by the user or the authentication device 100.

The pattern may include an indication of one or more points. For example, a pattern may include one or more circles centered around one or more points.

When one or more points of an object are displayed on the touch screen, the size and / or shape of the object, such as an animal or character, etc., may be created or adjusted based on the geometry information of the initially entered user's hand and / . Further, when one or more points of an object are displayed on the touch screen, the locations of one or more points of the object such as an animal or character, etc., may be determined and adjusted by geometric information of the user's hand and / or hand size. Thus, the locations of one or more points of the entity may be automatically adjusted by the geometry of the user's hand and / or hand size.

In step 720, once the fingertip touch positions are determined, the user or the authentication device 100 can then select and register the direction of movement of the fingertip touch positions.

The direction of movement of one or more fingertip touch positions may be different. For example, the direction of movement of one or more fingertip touch positions may be a direction away from a particular reference point or a direction approaching the particular reference point.

FIG. 8 is a flowchart illustrating a method of registering finger-point-based registration information of a non-background according to an example.

Step 640 described above with reference to FIG. 6 may include steps 810 and 820 described below.

Non-background finger point based registration information may also be registered in a manner similar to the background based registration information described above.

In step 810, the authentication device 100 can register the fingertip touch location.

The touch screen can display one or more points. For example, a point can have the shape of a circle. One or more fingertip touch locations may be selected and registered by the user or authentication device 100 from one or more points. In addition, the touch sequence of one or more fingertip touch positions may be selected and registered by the user or the authentication device 100.

When one or more points are displayed on the touch screen, the positions of the one or more points may be created and / or adjusted by geometric information of the user's hand and / or hand size.

For example, the larger the user's hand, the more spaced intervals of locations of one or more points.

For example, the positions of one or more points may correspond to the positions of the fingertips of the user's hand when the user properly spreads the fingers so that the user can touch the fingers. Thus, the positions of one or more points can be automatically adjusted by geometric information of the shape and size of the user.

In step 820, once the fingertip touch positions are determined, the user or the authentication device 100 can then select and register the direction of movement of the fingertip touch positions.

The contents of the above-described embodiment with reference to Fig. 7 can also be applied to this embodiment except for the background display.

9 is a flowchart of an authentication method for a user according to an example.

The above-described step 520 with reference to FIG. 5 may include steps 910, 920, 930, and 940 described below.

In step 910, the authentication device 100 may identify the user.

The identification of the user will be described below with reference to Fig.

The authentication apparatus 100 can reduce the range of the user's search in step 920 to be described later through identification of the user and sequentially perform authentication for the user in the following steps 920, 930, and 940 can do.

Once the user is identified, the information of the registered fingertip gesture of the identified user may be retrieved. The authentication apparatus 100 can search the registration information DB 450 to retrieve the information of the registered fingertip gesture.

In step 920, to receive a fingertip gesture for authentication to the user, the authentication device 100 may generate a pattern and display the generated pattern.

The pattern may be a gesture induction / related pattern or a fake pattern.

The pattern may be generated based on geometric information of the hand shape and / or hand size of the identified user.

The gesture induction / related pattern may be a pattern for acquiring a fingertip gesture registered by the user. The fake pattern may be a pattern for obtaining a predefined fingertip gesture. That is to say, the gesture induction / related pattern may be a " registered pattern " (by the user with respect to the user's authentication) and the fake pattern may be a " unregistered pattern " or " &Quot;

At step 930, the authentication device 100 may recognize the user's fingertip gesture on the pattern. The authentication apparatus 100 can recognize the fingertip gesture through the interaction with the user on the pattern.

The recognition of the fingertip gesture with respect to the gesture induction / related pattern will be described below with reference to FIG.

The recognition of the fingertip gesture with respect to the fake pattern will be described later with reference to Fig.

At step 940, the authentication device 100 may perform authentication for the user using the recognized fingertip gesture.

For example, the authentication device 100 may determine that authentication of the user has been successful if the input fingertip gesture is successful. The authentication apparatus 100 can determine that authentication for the user has failed if the input fingertip gesture fails.

Steps 920, 930 and 940 may be performed repeatedly. The authentication apparatus 100 can finally complete the authentication for the user when the authentication for the user is successful for a predetermined number of times.

10 is a flowchart of a method of identifying a user according to an example.

Step 910 described above with reference to FIG. 9 may include steps 1010, 1020, and 1030 described below.

In step 1010, a user ID may be entered into the authentication device 100 by the user. The authentication apparatus 100 can identify the user by searching the registration information DB 450 using the input user ID.

At step 1020, information of the user's hand may be input by the user to the authentication device 100. [ The authentication apparatus 100 can identify the user by searching the registration information DB 450 using the input hand information.

Steps 1010 and 1020 may be optional. For example, the input of the user ID may be omitted. Alternatively, the user ID and the information of the user's hand may be input to the authentication apparatus 100. [

The information of the hand may include hand geometry and / or hand geometry information.

In step 1030, the authentication apparatus 100 uses the input user ID and / or information of the input hand to input the user ID input from the registration information DB 450 and the candidate user information Can be searched. The user can be identified by retrieving candidate user information. The retrieved user among the users registered in the registration information DB 450 can be identified as the user of the current authentication apparatus 100. [

The authentication apparatus 100 can reduce the range of the user's search in step 920 to be described later through identification of the user and sequentially perform authentication for the user in the following steps 920, 930, and 940 can do.

11 is a flowchart of a method for recognizing a fingertip gesture with respect to a gesture inducing / related pattern according to an example.

Step 930 described above with reference to FIG. 9 may include steps 1110, 1120, and 1130 described below.

Steps 1110, 1120, and 1130 may be performed when the user's fingertip gesture is entered for the gesture induction / related pattern.

In step 1110, the authentication apparatus 100 may sense the touch order of the fingertip touch positions and the fingertip touch positions with respect to the input fingertip gesture.

In step 1120, the authentication device 100 may sense the direction of movement of the fingertip touch locations.

The information of the fingertip gesture may include optional fingertip touch positions, touch order of fingertip touch positions, and movement direction of fingertip touch positions.

At step 1130, the authentication device 100 may recognize a fingertip gesture for a gesture induction / related pattern.

The authentication apparatus 100 can perform similarity analysis and processing on the similarity comparison item between the information of the inputted fingertip gesture and the information of the fingertip gesture of the searched user.

The authentication apparatus 100 can retrieve the information of the fingertip gesture of the user registered in the registration information DB 450. [ It is possible to efficiently compare whether or not the fingertip gesture input by the analysis and processing of the similarity comparison item corresponds to the fingertip gesture of the searched user.

The authentication apparatus 100 can calculate the quantitative similarity comparison result through matching with the similarity comparison item.

The authentication apparatus 100 can determine whether the entered fingertip gesture is a successful gesture for the gesture induction / related pattern or a failed gesture through comparison of the similarity between information of the input fingertip gesture and information of the registered user's fingertip gesture have.

For example, when the comparison result of the quantitative similarity calculated for the input fingertip gesture information and the information of the registered user's fingertip gesture is greater than or equal to the predetermined reference value, the authentication device 100 determines that the input fingertip gesture is successful can do. The authentication apparatus 100 may determine that the input fingertip gesture has failed if the calculated quantitative similarity comparison result is smaller than the predetermined reference value.

FIG. 12 is a flowchart of a fingertip gesture recognition method for a fake pattern according to an example.

Step 930 described above with reference to FIG. 9 may include steps 1210, 1220, and 1230 described below.

Steps 1210, 1220, and 1230 may be performed when a user's fingertip gesture is entered for the fake pattern.

In step 1210, the authentication device 100 can detect the touch order of the fingertip touch positions and the fingertip touch positions of the selected fingertip gesture.

In step 1220, the authentication device 100 may sense the direction of movement of the fingertip touch locations.

The information of the fingertip gesture may include optional fingertip touch positions, touch order of fingertip touch positions, and movement direction of fingertip touch positions.

In step 1230, the authentication device 100 may recognize the fingertip gesture for the fake pattern.

The authentication apparatus 100 can perform similarity analysis and processing on the similarity comparison item between the input fingertip gesture information and the predetermined fingertip gesture information on the fake pattern. The authentication device 100 can determine whether the input fingertip gesture corresponds to a predefined fingertip gesture for the fake pattern.

It is possible to efficiently compare whether or not the fingertip gesture inputted by the analysis and processing of the similarity comparison item corresponds to the predetermined fingertip gesture for the fake pattern.

The authentication apparatus 100 can calculate the quantitative similarity comparison result through matching with the similarity comparison item.

For example, the authentication apparatus 100 may determine that the input fingertip gesture is successful if the calculated quantitative similarity comparison result is greater than or equal to the predetermined reference value. The authentication apparatus 100 may determine that the input fingertip gesture has failed if the calculated quantitative similarity comparison result is smaller than the predetermined reference value.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CDROMs and DVDs, magnetic optical media such as floppy disks, magnetooptical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

100: Authentication device
110: sensor
120: Interface
130: Display
140: Processor

Claims (20)

Identifying a user;
Displaying a generated pattern based on geometric information of the identified hand or hand size of the identified user;
Recognizing a fingertip gesture through interaction with the user for the pattern; And
Performing authentication for the user using the recognized fingertip gesture
. The method according to claim 1,
In the identifying step, the candidate user information corresponding to the information of the hand is retrieved using the information of the input hand,
Wherein the information of the hand includes geometric information in the form of a hand or a hand. The method according to claim 1,
The pattern is a gesture induction / related pattern,
Wherein the gesture inducing / related pattern is a pattern for obtaining a fingertip gesture registered by the user. The method of claim 3,
Wherein the step of recognizing the fingertip gesture comprises:
Detecting finger touch positions of the input fingertip gesture;
Sensing a movement direction of the fingertip touch positions; And
Determining whether the input fingertip gesture is a successful gesture with respect to the gesture inducing / related pattern through comparison of similarity between information of the input fingertip gesture and information of the registered fingertip gesture
Lt; / RTI >
Wherein the information of the input fingertip gesture includes the fingertip touch positions and the movement direction. 5. The method of claim 4,
Wherein the input fingertip gesture is judged to be successful when the result of the comparison of the quantitative similarity calculated for the input fingertip gesture information and the registered fingertip gesture information is greater than or equal to a predetermined reference value. 5. The method of claim 4,
Wherein the information of the input fingertip gesture further includes a touch order of the fingertip touch positions. 5. The method of claim 4,
Wherein the object is displayed as a background with the gesture induction /
The entity representing one or more points,
Wherein each point of the one or more points is an area that can be identified and identified within the entity. 8. The method of claim 7,
Wherein the one or more points are generated based on geometric information of the user's hand or hand size. 9. The method of claim 8,
Wherein the one or more points correspond to positions of the ends of the user's fingers in accordance with the geometric information of the user's hand or hand size. The method according to claim 1,
Wherein the pattern is hidden when the fingertip gesture is touched or is hidden when the predetermined time after touching the fingertip gesture passes. The method according to claim 1,
Wherein the pattern is a fake pattern,
Wherein the fake pattern is a pattern for obtaining a predefined fingertip gesture. Registering information for identification of a user; And
Registering the user's fingertip gesture
Lt; / RTI >
Wherein the information for identifying the user includes geometric information of the hand shape or the hand size of the user. 13. The method of claim 12,
Selecting a kind of registration information of the fingertip gesture
Further comprising:
Wherein the registration information is background-based registration information or fingerprint-based registration information of no background. 13. The method of claim 12,
Wherein registering the fingertip gesture comprises:
Registering a background and a fingertip touch position of the fingertip gesture; And
Registering a moving direction of the fingertip touch positions
And the authentication information is registered. 15. The method of claim 14,
Wherein when registering the fingertip touch location, one or more points of the background entity are displayed, one or more fingertip touch locations are selected and registered among the one or more points. 16. The method of claim 15,
Wherein the size or shape of the entity is created or adjusted based on geometric information of the hand shape or hand size of the user. 15. The method of claim 14,
Wherein the touch order of one or more fingertip touch positions of the fingertip gesture is registered in the step of registering the fingertip touch position. 13. The method of claim 12,
Wherein registering the fingertip gesture comprises:
Registering a fingertip touch position of the fingertip gesture; And
Registering a moving direction of the fingertip touch positions
Lt; / RTI >
Wherein the registering of the fingertip touch location comprises displaying one or more points and selecting and registering at least one fingertip touch location among the one or more points. 19. The method of claim 18,
Wherein the positions of the one or more points are generated or adjusted by geometric information of the hand shape or size of the user. A display for outputting the generated pattern based on geometric information of a user's hand shape or hand size; And
A processor for recognizing the fingertip gesture through interaction with the user for the pattern and performing authentication for the user using the recognized fingertip gesture;
.

Images