KR20210155298A - Multi finger scan based user interface - Google Patents

Abstract

Fingerprint recognition can input a variety of information through one fingerprint recognition sensor and, through this, can perform additional functions besides user authentication by using each finger like a number as ten fingers have different fingerprints. Provided is a user interface capable of performing various functions instead of using fingerprint recognition as a simple means for user authentication.

Description

Multi-finger scan based user interface and method of using the same

The present invention relates to a multi-fingerprint recognition-based user interface, and more particularly, a user interface that registers two or more user fingerprints and performs different functions for a specific fingerprint or sequential input of a specific fingerprint using the registered fingerprint information It relates to systems and methods.

One of the important technical issues in the use of portable devices is user authentication. A simple, low probability of counterfeiting/copying, and high-accuracy user authentication method unlocks portable devices, increases the reliability of financial transactions, and enables convenient use.

Password input, which is the most widely used method of user authentication for portable devices, has a high possibility of exposing information to others and a high risk of hacking. In addition, there is a possibility of duplication of public certificates and security cards used for financial transactions. In order to compensate for these weaknesses, fingerprint recognition and iris recognition are commonly used in portable devices.

Among them, iris recognition has a high number of cases and is difficult to duplicate, so it can be effectively used for user authentication such as financial transactions. In addition, the fingerprint recognition that has been used so far can register multiple fingerprints, but there is no case connected to functions other than simple user authentication.

A user interface capable of performing various functions is provided instead of using fingerprint recognition as a simple user authentication method.

In fingerprint recognition, since ten fingers have different fingerprints, each finger is used as a number, and various information can be input through a single fingerprint recognition sensor, and through this, additional functions other than user authentication are possible.

The phone number input or keyboard input so far is a 1:N relationship in which one of several (N) buttons corresponding to each number or letter is pressed with one input means (eg, one stick). In this input method, if the user's password is exposed, anyone can input the password.

However, as described above, if fingerprints of ten fingers are registered and numbers are assigned to each finger, (for example, from the left little finger to the thumb 0-4 times, and from the right thumb to the little finger 5-9 times, A relationship of M:1 is possible in which several (M) input means correspond to one button. In this case, even if the user's password is exposed, a high level of security can be maintained because the user's fingerprint is required to enter each number. When there are N fingerprint recognition sensors, an M:N relationship is possible.

In the simplest way, a user interface that maps different functions to the fingerprints of each finger is possible. For example, when a fingerprint of the right thumb is input to the portable device, unlocking, recording when a fingerprint of the right index finger is input, a camera when a fingerprint of the right middle finger is input, an emergency message or a phone call, etc. can be executed when a fingerprint of the right ring finger is input. Alternatively, when the portable device is in standby mode or in lock state, it is possible to simply unlock when a fingerprint of the right thumb is input, or simple unlock when a fingerprint of the right index finger is input, but it is possible to send an emergency message to a designated contact in the background. .

Also, in user authentication for financial transactions, it is also possible to authenticate a normal user when a right thumb fingerprint is input, and to authenticate a financial transaction when a right index finger is input, but send an emergency message to a designated contact in the background.

In addition, it is possible to further increase the number of cases by sequentially recognizing the fingerprint of a specific finger in one fingerprint recognition sensor by using each finger as a number. If this is generalized, a user interface in which a random number is input using ten fingers on one button is possible.

Using the multi-fingerprint recognition-based user interface technology of the present application, it is possible to implement a user interface having a high security level by going beyond simple user authentication for fingerprint recognition.

1 shows a system for multiple fingerprint recognition interfaces.
2A shows a procedure for registering initial fingerprint information to be used in a multi-fingerprint recognition interface.
2B shows a procedure for registering fingerprint information after the second to be used in a multi-fingerprint recognition interface.
3 shows a procedure for using a user interface based on multiple fingerprint recognition functions.
4A to 4D show examples of use of a smart watch to which a multi-fingerprint recognition interface is applied.

Hereinafter, embodiments for implementing a multi-fingerprint recognition interface will be described in more detail.

1 shows a system for multiple fingerprint recognition interfaces.

The system includes an input unit 102 for receiving fingerprint information from a user, a storage unit 104 for storing the input fingerprint information and functions related thereto, and a user based on the registered fingerprint information stored in the storage unit. It may include a fingerprint processing unit 106 for processing the fingerprint information input from the , and a control unit 108 configured to perform a specific function based on the processing result of the fingerprint processing unit.

For the input unit 102, for example, a fingerprint recognition sensor may be used, but is not limited thereto, and any means for receiving fingerprint information from a user may be used. In addition, the fingerprint is not limited to the fingerprint on the surface of the finger, and a deep fingerprint pattern using ultrasonic waves, microvascular pattern recognition using light, etc. may be used.

In the storage unit 104, the user's fingerprint information and functions related thereto, for example, the number of the finger corresponding to the stored and registered fingerprint information, the fingerprint pattern of the corresponding finger, the fingerprint information performed in each operation mode of the user device A set of functions to be performed, and a mapping relationship therebetween may be stored.

In one embodiment, the finger number may correspond to, for example, 0-4 from the left little finger to the thumb, and 5-9 from the right thumb to the little finger, although any other combination of finger numbers may be used. free

A set of functions to be performed for each operation mode of the user device is defined, and each function of the function set is associated with one or more fingerprint patterns. In one embodiment, a function is implemented in a specific operating mode, a specific action of the user device (eg, a specific action such as selecting, playing, stopping, volume up/down, music in a music app operating mode), specific data required by the user device It may be an input (eg, input of specific character string data in a text app operation mode), and the like, but is not limited thereto.

On the other hand, in the above, the number of the finger corresponding to the stored and registered fingerprint information, the fingerprint pattern of the finger, the set of functions to be performed in each operation mode of the user device based on the fingerprint information, and the mapping relationship between them Although described as being stored in a storage unit, at least one of them may be stored in another device such as a server remote from the user device.

The fingerprint processing unit 106 checks whether the fingerprint information input from the user matches the registered fingerprint information based on the registered fingerprint information stored in the storage unit and related functions, and the like. In this case, a function corresponding to the corresponding fingerprint information is identified.

The control unit 108 performs a function corresponding to the input fingerprint information based on the processing result of the fingerprint processing unit.

2A and 2B illustrate a process of registering fingerprint information to be used in a multi-fingerprint recognition interface.

FIG. 2A illustrates a process of registering first fingerprint information to be used in a user device. The first input fingerprint information, after performing user authentication through a password, etc., acquires the finger number and fingerprint pattern of the inputted fingerprint, and registers the acquired finger number and fingerprint pattern as the first fingerprint information. Although FIG. 2A is illustrated as acquiring a finger number for the first fingerprint information, it may be implemented by defining a finger number to be acquired in advance and presenting it to the user without a separate finger number acquisition process in the fingerprint registration process. .

FIG. 2B illustrates a process of registering second and subsequent fingerprint information to be used in the user device. After the second fingerprint information, after user authentication is performed using a password, first input user fingerprint information, etc., the finger number and fingerprint pattern of the second and subsequent fingerprint information are acquired, and the acquired finger number and fingerprint pattern are added to the additional fingerprint information will be registered as For example, the second and subsequent additional fingerprint information registration may be performed on at least one finger other than the finger used for initial fingerprint information registration among a total of 10 fingers. Although FIG. 2B shows that the finger numbers are acquired for the second and subsequent fingerprint information, it is ok to implement in a way that the finger numbers to be acquired sequentially are defined in advance and presented to the user during the fingerprint registration process. Here, the registration of fingerprint information does not need to be limited to a total of 10, nor does it need to be limited to both fingers of one person.

Next, an example of a user interface based on a multi-fingerprint recognition function will be described using the flowchart of FIG. 3 .

In step 302, scanning of an input unit (eg, a fingerprint recognition sensor) is activated to receive a user's fingerprint. Thereafter, in step 304, an arbitrary fingerprint pattern is input from the user. Here, in order to feed back to the user whether a fingerprint of a finger has been recognized, a function of notifying the user through display, sound, or vibration on the screen when a fingerprint currently touching the fingerprint recognition sensor is recognized may be added.

In step 306, it is checked whether the input fingerprint pattern matches the fingerprint pattern among the fingerprint information stored and registered in the storage unit of the user device. If there is no matching fingerprint pattern, the process returns to step 304 for receiving a fingerprint pattern input from the user along with an error display. and this process is repeated until the fingerprint recognition input is finished in step 310 . Here, when there is no registered fingerprint pattern matching the fingerprint pattern of the fingerprint that is currently touched by the fingerprint recognition sensor, a function informing the user of this through an on-screen display, sound, or vibration pattern corresponding to an error may be added.

In one embodiment, in step 312 , it may wait for additional fingerprint information input from the user until the previously recognized finger is removed from the fingerprint recognition sensor.

Although not limited thereto, in one embodiment, the end of the fingerprint recognition input in step 310 determines whether there is an input corresponding to 'ENTER', which means that the information input through the fingerprint sensor is finished in the fingerprint processing unit. For example, if the user does not remove his or her finger from the fingerprint sensor for a certain period of time, it is recognized as 'ENTER', which means the end of the fingerprint recognition input, and 'ENTER' is displayed through the display, sound or vibration on the screen. You can notify that the input has been entered and allow the input to be completed. As another embodiment, a specific input detected through a pressure or a touch sensor (eg, when a pressure of a certain level or more is applied, a contact range of a certain area or more is sensed, or an increase in the contact area by a certain ratio or more is detected. case) can be recognized as 'ENTER'. As another embodiment, a predetermined predetermined fingerprint pattern is input through the fingerprint recognition sensor, a predetermined number of fingerprint patterns are input through the fingerprint identification sensor, or a predetermined predetermined user action to define the end of fingerprint pattern input When this is detected, it may be recognized as 'ENTER'.

In step 314, the fingerprint processing unit identifies the terminal input data based on the input fingerprint pattern and transmits it to the control unit, and the control unit performs a specific function corresponding to the terminal input data.

4A to 4D show examples of use of a smart watch to which a multi-fingerprint recognition interface is applied.

In one embodiment, the multi-fingerprint recognition interface may be utilized in the smart watch in the following manner. For reference, the following description will be made on the assumption that the smart watch has a touch screen and a built-in fingerprint sensor.

4A shows that when the messenger app is started, the upper message window and the lower text input window are provided.

4B shows keyboard groups grouped by position in the character input window at the bottom in different colors. For example, 'ㄱ', 'ㅋ', 'ㄴ', and 'ㄹ' may belong to the same group, and each character in this group may correspond to a fingerprint of the index finger, middle finger, ring finger, and little finger. The part marked with color in FIG. 4B can be viewed as a fingerprint recognition region of each group, and the input unit in which the vowel Cheonjiin is displayed may set a larger area as the fingerprint recognition area than the input unit in each group in which the consonants are displayed.

FIG. 4c shows red (hereinafter, referred to as 'red'), orange (hereinafter referred to as 'main'), yellow (hereinafter referred to as 'no'), and green (hereinafter referred to as 'second') of FIG. 4b; , the blue (hereinafter referred to as 'green') part of the right index finger (hereinafter referred to as 'sword'), middle finger (hereinafter referred to as 'middle'), ring finger (hereinafter referred to as 'weak'), young When input using a finger (hereinafter referred to as 'bird') in the following order, the result is displayed in the white input window.

[Example of input sequence 1] "Sword, Red Sword, Red, Main, Main, Red, Red, Red, Red"

Then, when input in the following order, the result is as shown in FIG. 4D .

[Example of input sequence 2] "Sword, Super Middle, Red Sword, Red, Super Sword, Red, Red Sword, Red Sword, Sword, Red, Red, Red, Red, Sword"

By using multiple fingerprint recognition-based user interface technology, as described above, fingerprint recognition can be developed into a user interface with a high security level beyond simple user authentication. can be sent or connected to an emergency call. When sending an emergency message or connecting to an emergency call, it is also possible to send the user's GPS information together. In particular, when connecting to an emergency call, a pre-specified guidance voice is delivered to the other party, so that the user who activated the emergency call can inform the other party of the current situation. Without explanation, you can make the other party recognize that you are in an emergency and take action. In addition, when sending an emergency message or connecting to an emergency call, it is also possible to maintain a setting more suitable for an emergency situation by performing a function of turning off the volume of the user terminal. In addition, the present invention can be used not only in communication terminals such as smart phones and smart watches, but also in any device requiring both security and interface (eg, a password input interface of a safe).

In addition, the existing number input or keyboard input required a separate button corresponding to each number or character, so it was difficult to implement in a small area. Since information input of dogs (eg, numbers 0-9 corresponding to ten fingers) is possible, user convenience can be further enhanced when applied to a device having a limited user interface area such as a smart watch.

Claims (12)

A fingerprint recognition-based user device having one or more operating modes,
an input unit configured to receive a fingerprint pattern from a user;
Based on the mapping between two or more functions of the function set provided in each of the one or more operation modes and the user's two or more fingerprint patterns, a function in the function set of the currently running operation mode corresponding to the fingerprint pattern received from the input unit is identified a fingerprint processing unit configured to; and
Controls configured to perform the identified function
A fingerprint recognition-based user device comprising a. The method of claim 1, wherein the mapping comprises:
a first mapping between two or more functions of a function set provided in each of one or more operation modes and two or more finger numbers of the user; and
and a second mapping between the user's two or more finger numbers and the user's two or more fingerprint patterns. 3. A user device according to claim 1 or 2, wherein the mapping is stored on the user device or another device remote from the user device. 4. The method of claim 3,
The user device further comprises a storage unit configured to store two or more finger numbers of the user and two or more fingerprint patterns of the user corresponding thereto. According to claim 1, wherein the input unit is further configured to determine whether the fingerprint pattern input by the user has ended,
The control unit, in response to a determination that the fingerprint pattern input by the user is terminated, to perform the identified function, fingerprint recognition-based user device. The method of claim 5, wherein the determination that the fingerprint pattern input by the user is terminated comprises:
i) whether the user's finger is kept in contact with the input unit for a predetermined time or longer;
ii) whether more than a predetermined pressure is applied to the input unit by the user's finger;
iii) whether the contact area between the user's finger and the input unit is greater than or equal to a predetermined value;
iv) whether the contact area between the user's finger and the input unit increases by a predetermined ratio or more;
v) whether a predetermined fingerprint pattern is received through the input unit;
vi) whether a predetermined number of fingerprint patterns have been received through the input unit; and
vii) at least one of whether a predetermined predetermined user action has been detected to define the end of the fingerprint pattern input.
Which will be made based on the fingerprint recognition-based user device. A method for use in a fingerprint recognition-based user device, the method comprising:
receiving a fingerprint pattern from a user at an input unit of the user device during a predetermined operation mode of the user device;
identifying a function in the set of functions provided in the predetermined operation mode that is mapped to the received fingerprint pattern, wherein the function set provided in the predetermined operation mode includes two or more functions, wherein the two or more functions are two or more fingerprints of the user each mapped to the pattern - ;
checking whether the input of the fingerprint pattern from the user is terminated;
Performing the identified function when the fingerprint pattern input from the user is terminated
A method for use in a fingerprint recognition based user device comprising: The method of claim 7, wherein the mapping comprises:
a first mapping between two or more functions of a function set provided in a predetermined operation mode and two or more finger numbers of the user; and
and a second mapping between the user's two or more finger numbers and the user's two or more fingerprint patterns. 9. A method according to claim 7 or 8, wherein the mapping is stored on the user device or another device remote from the user device. The method of claim 8 , further comprising storing two or more fingerprint information of the user and two or more finger numbers corresponding thereto. The method of claim 10 , wherein storing further comprises an additional step for user authentication. The method of claim 7, wherein the step of determining whether the input of the fingerprint pattern from the user is terminated comprises:
i) whether the user's finger is kept in contact with the input unit for a predetermined time or longer;
ii) whether more than a predetermined pressure is applied to the input unit by the user's finger;
iii) whether the contact area between the user's finger and the input unit is greater than or equal to a predetermined value;
iv) whether the contact area between the user's finger and the input unit increases by a predetermined ratio or more;
v) whether a predetermined fingerprint pattern is received through the input unit;
vi) whether a predetermined number of fingerprint patterns have been received through the input unit; and
vii) at least one of whether a predetermined predetermined user action has been detected to define the end of the fingerprint pattern input.
A method for use in a fingerprint recognition based user device, which is based on

Images