KR102673978B1 - Method for controlling device using fingerprint verification and touch gesture and the device - Google Patents

Abstract

A method and device for controlling a device using fingerprint recognition and additional touch gestures, such as taps and/or presses, are provided. The device is an electronic device including a touch sensitive module, a biometric information recognition module, and one or more processors, wherein the processor detects a touch input applied to the touch sensitive module and determines whether the obtained biometric information matches the stored information. and determine whether the time pattern in which the touch input is recognized matches the stored information, and if the acquired biometric information matches the stored information and the time pattern of the touch input matches the stored information, perform a designated operation. .

Description

Method and device for controlling a device using fingerprint recognition and touch gestures {METHOD FOR CONTROLLING DEVICE USING FINGERPRINT VERIFICATION AND TOUCH GESTURE AND THE DEVICE}

The present invention relates to a method of controlling a device using fingerprint recognition and additional touch gestures, such as taps and/or presses.

Technologies related to various electronic devices such as laptops, computers, tablets, and smartphones are being actively developed. In particular, since portable electronic devices such as the above have a risk of being lost, methods are being developed to improve the security of the devices to prevent them from being used by others.

For example, smartphones are equipped with a fingerprint recognition module, register the user's fingerprint in advance, and unlock the device when the registered fingerprint information matches the recognized fingerprint information. In other words, the security of the device can be increased by maintaining the smartphone in a locked state so that it cannot be used normally, and only allowing the user with an authenticated fingerprint to unlock it when in use.

Technologies that improve security by using biometric information other than fingerprints, such as iris or the user's facial shape, have also been developed. However, for iris recognition, the user's posture is limited, and facial recognition is inconvenient in that recognition is limited by the glasses or mask worn by the user, or recognition accuracy is low, and authentication technology using fingerprint recognition is difficult to use. It is widely used.

Conventional unlocking methods, such as a password or pin code that inputs text, or a pattern unlocking method that connects multiple points, cannot maintain security if the authentication method is leaked. There was a problem. In other words, since authentication methods such as passwords, pin codes, and unlock patterns are related to rules or information specified by the user, the security of the device can no longer be maintained if it is disclosed to others or unintentionally known to others.

On the other hand, biometric information such as fingerprints have relatively high security because they are user-specific information that cannot be shared with others even if they want to. However, there is a limit to how biometric information can be used as an authentication method regardless of the user's intention.

For example, when the finger of an unconscious user, such as a drunk, a sleeping person, or a patient, is lifted and recognized by the fingerprint recognition module, there is a problem that unintentional authentication is completed regardless of the intention of the user, that is, the drunk or sleeping person. Rather, with conventional authentication methods such as passwords, there is no risk of unintentional authentication by a completely unknown third party while the user is asleep, although there may be a problem of security not being maintained if the authentication method is leaked to an acquaintance. In particular, as fingerprint authentication technology has recently been expanded to include not only device unlocking but also payment authentication, the above unintentional authentication problems are likely to be exploited.

Accordingly, the problem to be solved by the present invention is to provide a method for unlocking a device that can prevent unintentional authentication of a user. Alternatively, it provides a method for controlling the operation of other devices in addition to unlocking the device.

Another problem to be solved by the present invention is to provide an electronic device or terminal device controlled by the above method.

Another problem to be solved by the present invention is to provide a program that performs an operation in combination with a computing device that performs the above method.

The problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

An electronic device according to an embodiment of the present invention for solving the above problem is an electronic device including a touch sensitive module, a biometric information recognition module, and one or more processors, wherein the processor receives a touch input applied to the touch sensitive module. detecting, determining whether the acquired biometric information matches the stored information, determining whether the change in the touch input matches the stored information, determining whether the acquired biometric information matches the stored information, and determining whether the change in the touch input matches the stored information. If matched, it is configured to perform the specified action.

The change in the touch input is a slide in a certain direction at an initial first point, and the information stored in relation to the change in the touch input may include information about the direction within the error range of the slide at the first point. .

The change in the touch input includes a pattern of touch and untouch of the touch response at the first first point, and the pattern of touch and untouch includes the duration of the touch response at the beginning or not the first time, and the time after the touch response. It may include the duration of the untouch state until the touch is sensitive again, or the number of multiple taps.

The first point may be located within an area where biometric information is obtained.

If the acquired biometric information matches the stored information, but the change in touch input does not match the stored information, the operation may not be performed.

Additionally, if the acquired biometric information does not match the stored information, the step of determining whether the change in the touch input matches the stored information may not be performed.

An electronic device according to another embodiment of the present invention for solving the above problem is a command module including a touch sensitivity module, a biometric information recognition module, one or more processors, one or more memories, and one or more instructions, stored in the memory, and A command module configured to be executed by a processor, wherein instructions of the command module detect a touch input applied to the touch sensitive module, determine whether the acquired biometric information matches stored information, and change the touch input. It includes determining whether the obtained biometric information matches the stored information, and if a change in touch input matches the stored information, performing a designated operation.

An electronic device according to another embodiment of the present invention for solving the above problem is an electronic device including a touch sensitive module, a biometric information recognition module, and one or more processors, wherein the processor provides a touch input applied to the touch sensitive module. detects, determines whether the acquired biometric information matches the stored information, determines whether the time pattern at which the touch input is recognized matches the stored information, determines whether the acquired biometric information matches the stored information, and determines whether the time pattern of the touch input If the pattern matches the stored information, it is configured to perform the specified action.

The information stored to determine whether the time pattern matches includes the retention time of the first first touch detected before determining whether the biometric information matches, the retention time of the second touch that is not the first after the first touch, and It may include one or more of the duration of the untouch state between the first touch and the second touch.

Additionally, the first point where the first touch is detected may be located within an area where the biometric information is obtained.

At this time, the maintenance time of the second touch is the maintenance time of the touch that is sensitive in the area including the first point, and the touch that is sensitive in the area that does not include the first point can be excluded.

An electronic device according to another embodiment of the present invention for solving the above problem is a command module including a touch sensitivity module, a biometric information recognition module, one or more processors, one or more memories, and one or more instructions, stored in the memory, and A command module configured to be executed by a processor, wherein the instructions of the command module detect a touch input applied to the touch sensitive module, determine whether the acquired biometric information matches stored information, and recognize the touch input. This includes determining whether the time pattern used matches the stored information, performing a designated operation if the acquired biometric information matches the stored information, and if the time pattern of the touch input matches the stored information.

A method of controlling an electronic device according to an embodiment of the present invention for solving the above other problems is a method performed by a device including at least one processor, and detects and obtains a touch input applied to a touch sensitive module. Determine whether the biometric information matches the stored information, determine whether the change in the touch input matches the stored information, determine if the acquired biometric information matches the stored information, and if the change in the touch input matches the stored information, determine the designated It involves performing an action.

A control method of an electronic device according to another embodiment of the present invention for solving the above other problems is a method performed by a device including at least one processor, and detects and obtains a touch input applied to a touch sensitive module. Determine whether the biometric information matches the stored information, determine whether the time pattern at which the touch input is recognized matches the stored information, determine whether the acquired biometric information matches the stored information, and determine whether the time pattern of the touch input matches the stored information. If there is a match, this includes performing the specified action.

A program according to an embodiment of the present invention for solving the above other problem is a program recorded on a recording medium and performed by a computing device, and is combined with the computing device to detect a touch input applied to the touch sensitive module. , determine whether the acquired biometric information matches the stored information, determine whether the change in the touch input matches the stored information, and if the acquired biometric information matches the stored information and the change in the touch input matches the stored information, , is configured to perform a specified operation.

A program according to another embodiment of the present invention for solving the above further problem is a program recorded on a recording medium and performed by a computing device, and is combined with the computing device to detect a touch input applied to the touch sensitive module. , determine whether the acquired biometric information matches the stored information, determine whether the time pattern at which the touch input is recognized matches the stored information, determine whether the acquired biometric information matches the stored information, and determine whether the time pattern of the touch input is stored. If it matches the information, it is configured to perform the specified action.

Specific details of other embodiments are included in the detailed description.

According to embodiments of the present invention, the device may be unlocked based on other gestures or rules of the user along with recognized biometric information, such as fingerprint information. Therefore, it is possible to prevent the problem of fingerprints being stolen by others in an unconscious state, such as a drunk person, a sleeping person, or a patient.

Such biometric information recognition technology, specifically fingerprint recognition technology, is not limited to simply unlocking devices, but can also replace authentication methods such as passwords, be used for payment authentication, or run other pre-linked programs. It can also be used as an operation trigger for the device.

Effects according to embodiments of the present invention are not limited to the contents exemplified above, and further various effects are included in the present specification.

1 is a hardware configuration diagram of an electronic device according to an embodiment of the present invention.
Figure 2 is a flowchart showing a control method of an electronic device according to an embodiment of the present invention.
Figures 3 to 8 are schematic diagrams for explaining the control method of Figure 2.
Figure 9 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention.
Figure 10 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention.
11 to 16 are schematic diagrams for explaining a control method of an electronic device according to still further embodiments of the present invention.
Figure 17 is a flowchart showing a control method of an electronic device according to another embodiment of the present invention.
FIG. 18 is a schematic diagram for explaining the control method of FIG. 17.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. Only the examples are provided to make the disclosure of the present invention complete and to fully convey the scope of the invention to those skilled in the art to which the present invention pertains, and the present invention is defined by the scope of the claims. It's just that.

In addition, the scope of the patent claims is not a matter that explains the technical content that constitutes the substance of the invention, but rather a matter that indicates what scope of rights is claimed based on the technical composition disclosed by the detailed description of the invention. Therefore, it is inevitable to some extent that the patent claims are composed of an abstract higher concept that includes the technology disclosed in the detailed description of the invention, and if a person skilled in the art can understand the technical composition, combination, and operational effect within the scope of the patent claims through the entire specification, The scope of the patent claims should be viewed as supported by the detailed description of the invention.

That is, various changes may be made to the embodiments presented by the present invention. The embodiments described below are not intended to limit the embodiments, but should be understood to include all changes, equivalents, and substitutes therefor.

If any term described in this specification is intended to be used in a specific sense, the meaning may be defined and used and should be interpreted accordingly. Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings that can be commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

As used herein, 'and/or' includes each and every combination of one or more of the mentioned items. Additionally, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, 'comprises' and/or 'comprising' do not exclude the presence or addition of one or more other components in addition to the mentioned components. The numerical range expressed using 'to' indicates a numerical range that includes the values written before and after it as the lower limit and upper limit, respectively. ‘About’ or ‘approximately’ means a value or numerical range within 20% of the value or numerical range stated thereafter.

In this specification, when referring to components, ordinal modifiers such as 'first component', 'second component', '1-1 component', etc. simply refer to one component and another component. It is just used to do so. Accordingly, the first component referred to below may be referred to as the second component within the scope of the technical idea of the present invention. For example, what is referred to as a first component in one embodiment may be referred to as a second component in another embodiment. Additionally, of course, what is referred to as a first component in the description of the invention may be referred to as a second component in the claims.

The term 'touch gesture' used in this specification refers to dot touch gestures such as tap, multiple tap and press, one-point line touch gestures such as flick, swipe, pan and drag, and two-point line touch gestures such as pinch and rotate. It means including. A touch gesture refers to a manipulation method for implementing various different events using a touch object, for example, the user's finger or stylus pen.

Tap (or single tap) (or click) refers to the action of briefly and lightly touching a touch device. An event may occur the moment a finger, etc., falls from the touch device (or after a predetermined interval has elapsed). In other words, an event may occur at the moment when a touch is recognized for a period of time within a predetermined tap reference time and is not recognized. As a non-limiting example, the predetermined tap reference time may be 0.1 seconds, and can be distinguished from a press to be described later based on this time.

Multiple tap (or multiple click) refers to the operation of performing the tap multiple times on the same point within an error range within a predetermined time interval. For example, repeatedly touching a touch device twice briefly can be referred to as a double tap, and touching a touch device repeatedly three times briefly can be referred to as a triple tap. A separate algorithm may be required to distinguish between events according to the single tap and multiple taps described above.

Press or touch and hold refers to the action of touching and holding a touch device. An event may occur the moment a finger falls off a touch device. In other words, an event may occur at the moment when a touch is recognized for more than a predetermined press reference time and is not recognized. The press reference time may be the same as or different from the tap reference time described above.

Slide refers to the action of moving a finger in a random direction while touching a touch device. Slide gestures include swipe, flick, pan, and drag. The direction of the slide can include straight, curved, or arbitrary lines.

Hereinafter, the present invention will be described in detail with reference to the attached drawings.

1 is a hardware configuration diagram of an electronic device according to an embodiment of the present invention.

First, referring to FIG. 1, the electronic device 10 (or terminal device) according to this embodiment includes a processor 100, a memory 200, a storage 300, a display module 410, and a touch sensitive module. 420 and a biometric information recognition module 430 may be further included.

The processor 100 may implement operations and/or functions related to the method according to the present invention based on instructions according to software in which the control method according to the present invention is implemented and resident (loaded) in the memory 200. In other words, the processor 100 can be understood as a subject that executes a program. For example, by executing software, hardware components and/or software components connected to the processor 100 can be controlled, and data processing or calculations can be performed. That is, the processor 100 stores commands or data received from other components in the memory 200 as part of data processing or calculation, processes commands or data stored in the memory 200, or stores the resulting data in the memory 200. It can be saved at (200). The processor 100 and/or memory 200 may also be referred to as a control unit. The processor 100 may use any known processor, for example, Application-Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), and Field Programmable Circuits (FPGAs). Gate Arrays), processors, controllers, microcontrollers, microprocessors, etc.

Software or programs resident in the memory 200 or stored in the storage 300 may be computer programs recorded on a recording medium to execute a control method to be described later. The computer program may be a program that is stored in a storage medium, can be read, and can be executed in combination with a computer.

The memory 200 may store various data used for at least one component. The data may include input data or output data for software and instructions related thereto. The memory 200 may be implemented through read-only memory (ROM), random access memory (RAM), flash memory, memory card, storage medium, and/or other storage devices.

Memory 200 can load the computer program from storage 300. The storage 300 may store application programming interfaces (APIs), libraries, resource files, etc. required for execution of software implementing the control method according to the present invention. Additionally, software and a database in which the method is implemented can be stored. The contents of various databases required to perform operations and/or functions related to the method according to the present invention, which will be described later, can be understood.

In the case of implementation by firmware or software in the control method described later, it is implemented in the form of modules, codes, code segments, procedures, functions, etc. including instructions that perform the described functions or operations, using various computer means. It can be recorded on a readable recording medium. Here, the recording medium may include program instructions, data files, data structures, etc., singly or in combination. In this case, each component on the configuration diagram or block diagram may mean a module, segment, or part of code that includes one or more executable instructions for executing a specified logical function. Therefore, the functions provided by the components on the configuration diagram or block diagram may be implemented by a plurality of more detailed components, or the multiple components on the configuration diagram or block diagram may be implemented by one integrated component. Of course. That is, within the scope of the purpose of the present invention, each component can be operated by selectively combining one or more of them. In addition, all components may be implemented as independent hardware, and some or all of the components may be selectively combined to have a program module that performs some or all of the combined functions in one or more pieces of hardware. It may also be implemented as a computer program. The codes and code segments that make up the computer program can be easily deduced by those skilled in the art.

The program instructions recorded on the recording medium in this specification may be those specifically designed and configured for the present invention, or may be known and usable by those skilled in the art of computer software. For example, recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROM (Compact Disk Read Only Memory) and DVD (Digital Video Disk), and floptical media. It includes magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions such as ROM, RAM, flash memory, etc. Examples of program instructions may include machine language code such as that created by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. Such hardware devices may be configured to operate as one or more software to perform the operations of the present invention, and vice versa.

As described above, the electronic device 10, which is understood as a type of computing device including the processor 100, may further include a display module 410, a touch sensitivity module 420, and a biometric information recognition module 430. .

The display module 410 may be an output device. The display module 410 may display output according to software executed by the processor 100 in a visual form. The display module 410 may include a display panel. Additionally, the display panel may include a liquid crystal display (LCD) or an organic light emitting display (OLED), but the present invention is not limited thereto.

The touch sensitive module 420 may be an input device. The touch sensitivity module 420 can detect the touch of a touch tool such as a user's finger or a stylus pen and collect the touched location or coordinates. The touch sensitive module 420 may include a touch panel. In some embodiments, the display module 410, such as a display panel, and the touch sensitive module 420, such as a touch panel, may be provided integratedly. That is, they may be stacked on each other and not physically separably coupled to each other.

The display module 410 and the touch sensitive module 420 are positioned overlapping each other, and the coordinates of the touch sensitive module 420 can be matched to any position of the display device of the display module 410. Through this, the user can provide an input signal by touching a certain position of the display module 410 where visual expression occurs, and the touch sensitive module 420 can perform an operation using the touch-sensitive coordinates.

The biometric information recognition module 430 may refer to a module that collects or recognizes the user's biometric information. For example, the biometric information recognition module 430 may include an iris information recognition module, a facial information recognition module, and/or a fingerprint information recognition module. Preferably, in this embodiment, the biometric information recognition module 430 may include a fingerprint information recognition module.

The biometric information recognition module 430 may be placed on the lower surface of the display module 410 and overlapped with the display module 410 . In some embodiments, the display module 410, such as a display panel, and the biometric information recognition module 430, such as a fingerprint information recognition module, may be provided in an integrated manner. For example, part of the light source of the display panel may be used as a light source for fingerprint recognition. Additionally, the display module 410, which can recognize the user's fingerprint information, can output an interface indicating that the location of the biometric information recognition module 430 is an area where fingerprint recognition is possible. Through this, the user can visually understand the area where fingerprint recognition is possible, and fingerprint recognition can be performed by recognizing the finger at the corresponding location.

Various hardware components of FIG. 1 constituting the electronic device 10 are connected through a data bus, and data can be transferred between each component through the data bus.

Hereinafter, with further reference to FIG. 2, a method for controlling an electronic device according to the present embodiment, that is, a module stored in the memory 200 and configured to be executed by the processor 100, will be described regarding software or a program configured to perform various instructions. Explain in detail.

Figure 2 is a flowchart showing a control method of an electronic device according to an embodiment of the present invention. Figures 3 to 8 are schematic diagrams for explaining the control method of Figure 2.

First, referring further to FIG. 2, the control method or its instructions according to the present embodiment provides an interface in a locked state (S100), detects a touch in the fingerprint recognition area (S150), and connects the fingerprint with the pre-stored fingerprint information. Determine if they match (S200), detect if the touch information changes (S300), determine if the touch change matches the previously stored touch change information (S400), perform an unlock operation (S500), and unlock the interface. It includes providing (S550). Hereinafter, each step or instruction will be described.

In the initial state, that is, in a state in which no separate manipulation is provided by the user, the electronic device 10 may provide a locked interface using the display module 410 (S100). In relation to this, Figure 3 illustrates an interface in a locked state. In the step of providing the first interface (S100), the fingerprint recognition area 430a may be displayed.

A locked state interface (or locked state) may cause electronic device 10 to be powered and operable, but ignore all or part of the user's input. That is, the electronic device 10 ignores at least some of the user input and does not perform a predetermined set of operations, and the electronic device 10 may provide only limited functions. As shown in FIG. 3, the electronic device 10 displays the current time and date and can turn on or off the screen of the display module 410 through a touch input or a physical button, but since it is in a locked state, the screen of the display module 410 can be turned on or off. This shows a restricted state in using the electronic device 10. As described above, the display module 410, such as a display panel, and the touch sensitive module 420, such as a touch panel, are positioned overlapping each other, and touch sensitivity may be possible in most areas where visual output through the display panel occurs. Additionally, an interface indicating that the fingerprint recognition area 430a is provided may be provided at a certain location on the display panel. The fingerprint recognition area 430a may occupy a predetermined area. A biometric information recognition module 430, that is, a fingerprint information recognition module, may be disposed inside the electronic device 10 in the fingerprint recognition area 430a.

The electronic device 10 can detect a user's touch at any location using the touch sensitivity module 420. User touch may include touch using a finger and touch using a stylus pen. And the electronic device 10 can detect a touch in the fingerprint recognition area 430a, or detect the input of information classified as a fingerprint without detecting a touch (S150). In relation to this, Figure 4 illustrates a case where the user touches an area other than the fingerprint recognition area 430a with his or her finger.

Even if the electronic device 10 is in a locked state, that is, is not unlocked and a user or another person provides a touch input to the electronic device 10, the electronic device 10 still provides a locked state interface as shown in FIG. 4. and can ignore at least some of the user input.

And, as shown in FIG. 5, when the user recognizes a finger print in the fingerprint recognition area 430a of the electronic device 10 and the electronic device 10 detects a touch input in the fingerprint recognition area 430a (S150) , the electronic device 10 may determine whether the pattern of the fingerprint recognized in the fingerprint recognition area 430a matches pre-registered fingerprint information (S200).

If the recognized fingerprint information does not match the stored fingerprint information, the lock is not unlocked and the electronic device 10 may still provide a locked state interface and ignore at least some of the user input. Although not shown in the drawing, the display module 410 of the electronic device 10 may output a message indicating that the lock has not been released or an interface informing of an error. Here, whether or not the fingerprint information matches may mean whether the fingerprint information matches more than a preset match level. Known techniques can be used to determine whether fingerprint information matches.

On the other hand, if the recognized fingerprint information matches the stored fingerprint information, the electronic device 10 may detect a change in touch recognized in the fingerprint recognition area 430a without immediately unlocking (S300). For example, the electronic device 10 may wait for a specified time to detect a change in input of a touch recognized in the fingerprint recognition area 430a or the touch area A1 used for fingerprint recognition without immediately unlocking the lock. there is.

The change in the touch input may be a change in the touch gesture input value using touch. That is, it is possible to detect whether the touch input value in the fingerprint recognition area 430a changes. If no change is detected after waiting a predetermined period of time, for example about 1 second, or about 500 milliseconds (ms), or about 250 milliseconds (ms), the lock is not released and the electronic device 10 is still locked. Provides an interface and can ignore at least some of the user input. Although not shown in the drawing, the display module 410 of the electronic device 10 may output a message indicating that the lock has not been released or an interface informing of an error.

On the other hand, when a change in touch input is detected in the first touch detection area (A1) used for fingerprint recognition in the fingerprint recognition area (430a), the electronic device 10 matches the detected touch input change with the previously stored touch change information. You can determine whether it is done (S400).

In an exemplary embodiment, the pre-stored touch change information is located within the fingerprint recognition area 430a and at any first point (e.g., initial area or first area) within the initial touch detection area A1 (e.g., initial area or first area) used for fingerprint recognition. It may include a slide input from P1) to another second point P2 previously saved by the user.

In relation to this, as illustrated in FIG. 6, even if the user provides a slide (or swipe) input in the downward direction from the fingerprint recognition area 430a, if it does not match the stored touch input change information, the lock is not released and the electronic device (10) still provides a lock state interface and can ignore at least some of the user input. Although not shown in the drawing, the display module 410 of the electronic device 10 may output a message indicating that the lock has not been released or an interface informing of an error.

On the other hand, as illustrated in FIG. 7, when the user provides a slide (or swipe) input in the downward and right direction from the fingerprint recognition area 430a, and this matches the previously stored touch input change, the electronic device 10 is finally locked. After performing this unlock operation (S500), the electronic device 10 may provide an unlock state interface (or unlock state). The unlocked state is a normal operating state for using the electronic device 10, and can detect user input and perform corresponding operations according to instructions of a program presented in advance.

An instruction for determining whether touch change information matches will be described in more detail with further reference to FIG. 8 . Referring further to FIG. 8, as described above, the area of the fingerprint recognition area 430a is at least partially, or 50% or more, or about 50% or more of the initial touch detection area A1 (or first area) used for fingerprint recognition. The areas overlap by more than 70%, or about 80% or more. If the fingerprint recognition area 430a and the initial touch detection area A1 do not overlap, the touch detection step S150 in the fingerprint recognition area 430a is not performed. At this time, the first point P1 may be an arbitrary point specified or designated within the fingerprint recognition area 430a or the first area A1. Preferably, the first point P1 may be any point within the fingerprint recognition area 430a that is predetermined according to the location of the biometric information recognition module 430.

In this embodiment, the electronic device 10 collects and stores touch input change information in advance by the user, and at this time, the derived end point of the slide, that is, the second point P2, is located below and to the right of the first point P1. The explanation will be given as an example of a case defined in a diagonal direction and at a position on a line inclined at about 30 degrees from the right direction. Here, the second point P2 may be configured to be recognized as a normal range within a predetermined error range. For example, the electronic device 10 is divided into 12 areas with a central angle of 30 degrees based on the first point (P1), and if the end point of the slide is in the area belonging to the second point (P2), the previously stored It may be configured to determine that it matches a change in touch input. In other words, one fan-shaped area with a central angle of 30 degrees can be understood as the standard for the error range. However, the present invention is not limited thereto. Of course, the central angle of the reference area of the error range can be made smaller to increase security instead of lowering convenience, or the central angle can be made larger to increase convenience instead of lowering security.

Additionally, the user's fingers, etc. may come into contact with the cover glass of the electronic device 10 and provide a touch input for a predetermined area rather than providing a touch input only at one point. The first area A1 described above may also be an input range used to detect a fingerprint area having a predetermined area.

At this time, when the user slides in the downward and right direction using a finger, similarly, the slide input is not provided as only one point or one line, but the slide input can be obtained with a predetermined area. The touch input area detected at the end point of the slide can be defined as the second area (A2).

In this case, if the pre-stored or set second point (P2) is located within the second area (A2), it can be determined that a slide touch starting at the first point (P1) and ending at the second point (P2) has been input. . On the other hand, if the predefined second point P2 is not located in the second area pressed and input by the user's finger when the slide is ended, it is determined that it is an inconsistent touch input change and the electronic device 10 It can remain locked.

Here, the slide from the first point P1 to the second point P2 may be a straight line or an arbitrary line other than a straight line. In addition, although not shown in the drawing, when the user's touch input moves from the first point (P1) to the second point (P2) to a position further away from the first point (P1), it matches the previously stored change in touch input. You may decide not to do it.

Meanwhile, after the step of determining whether the fingerprint matches (S200), for example, the step of detecting a change in the touch input (S300) and the step of determining whether the change of the touch input matches (S400), whether the fingerprint matches or not is determined. Verification is not performed and can be based only on change information of touch input.

According to this embodiment, in order to unlock the electronic device 10, fingerprint information is not only acquired to determine whether there is a match, but also the change in touch input is obtained to determine whether there is a match, and only when all of them match are the locks performed. It can be released. Therefore, security can be further improved.

What is particularly important is that, in information about changes in touch input, for example, information about slide input, the starting point of the slide, that is, the first point (P1), is the area where the touch is input for fingerprint recognition, that is, the first area (A1). ), and for fingerprint recognition, the touch change matching step (S400) is performed while the touch input is maintained without lifting the finger after the touch is detected (S150). Therefore, the user's action of touching the fingerprint recognition area 430a as in the past is maintained, but only the action of sliding the finger in a direction known only to the user after recognition is added, thereby creating a unique feature without harming user convenience. Can provide user experience.

Additionally, there may be one or more patterns pre-entered by the user to determine a change in touch input (S400). Even when there are multiple stored patterns, authentication according to any pattern may lead to a designated operation, for example, an unlocking operation of the electronic device 10.

In other words, the operation of the electronic device 10 that occurs as a result of determining the match of the fingerprint (S200) and determining the match of the change in touch input such as a slide (S400) is not an operation specified by the user, but fingerprint recognition. It may be designated by a program or software of the electronic device 10 depending on the purpose of step S100 of providing an interface for the device. That is, in this embodiment, determining a change in touch input (S400) can be understood as part of a verification step rather than functioning as a trigger for a specific operation.

Additionally, the determination of whether the fingerprint matches (S200) or the determination of whether the touch input pattern matches (S400) as described above may be used in a plurality of interfaces of the program of the electronic device 10. For example, as described above, it can be used in a program for unlocking the electronic device 10, and at the same time, it can also be used in a program for payment, as will be described later with reference to FIG. 17 and the like. At this time, even if the user provides the same touch input change or pattern during the unlocking process and payment authentication process, it may lead to different actions. That is, even if the user touch input pattern entered in the locking interface and the user touch input pattern inputted in the payment authentication interface are the same, the locking interface may lead to a unlock operation and the payment authentication interface may lead to a payment process operation.

In some embodiments, the electronic device 10 may provide a predetermined number of opportunities in each of the step of determining whether the fingerprint matches (S200) and the step of determining whether the touch input change matches (S400). Although fingerprint recognition is very accurate, inaccurate recognition may occur due to moisture in the user's fingers. To this end, the electronic device 10 may provide a predetermined number of opportunities, and if normal fingerprint recognition is not performed within the given number of times, it may not present an unlocking interface based on biometric information.

In the method of controlling the electronic device 10 according to this embodiment, the number of opportunities provided in the step (S200) of determining whether the fingerprint recognition matches is provided in the step (S400) of determining whether the change in touch input matches. It can be greater than the number of opportunities. For a non-limiting example, if the step (S200) of determining whether the fingerprints match and providing a mismatch interface if they do not match is performed five times, the unlocking interface through fingerprint recognition is no longer provided and the pin number Alternatively, only an unlocking interface may be provided through password input or pattern input. In addition, if the step (S400) of determining whether the touch input changes match and providing a mismatch interface if they do not match is performed less than 5 times, for example, 3 times, unlocking through fingerprint recognition is no longer possible. Instead of providing an interface, it is possible to provide only an unlocking interface through inputting a pin number or password, or entering a pattern.

Hereinafter, a method for controlling an electronic device according to another embodiment of the present invention will be described. However, descriptions of configurations that are substantially the same or extremely similar to the previously described embodiments will be omitted, and this will be understood by those skilled in the art from the attached drawings.

Figure 9 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches.

Referring to FIG. 9, the change in touch input pre-stored to determine whether or not the change in touch input matches is not limited to a linear slide (or swipe) from one point to another, but rather changes to the starting point, that is, the first point. Three or more points including (P1) may be defined.

That is, the electronic device 10 collects and stores touch input change information by the user in advance, and at this time, the derived points are the second point (P2) (or intermediate point) and the third point (P3) (or final point). may include. Additionally, the distance from the first point (P1) to the third point (P3) may be greater than the distance from the first point (P1) to the second point (P2).

It provides a slide touch input that connects the first area (A1) that the user first touched for fingerprint recognition to the second area (A2), which is the area where the second point (P2) belongs. If you provide a slide touch input connecting area 2 (A2) to the area where the third point (P3) belongs, that is, the third area (A3), it is judged to match the stored touch change information and an action such as unlocking can be performed. You can.

Figure 10 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches.

Referring to FIG. 10 , in order to determine whether the change in the touch input matches, the first point P1 may be located in the path of a pre-stored change in the touch input, for example, a slide input.

That is, the electronic device 10 collects and stores touch input change information by the user in advance, and at this time, the derived points are the second point (P2) (or intermediate point) and the third point (P3) (or final point). may include.

It provides a slide touch input that connects the first area (A1) that the user first touched for fingerprint recognition to the second area (A2), which is the area where the second point (P2) belongs. 2 Provides a slide touch input connecting the area (A2) to the area to which the third point (P3) belongs, that is, the third area (A3), and provides a slide touch input connecting the second area (A2) to the third area (A3). The first point (P1) or the first area (A1) may overlap during input.

As described above, in the step of determining whether the touch change in the control method of an electronic device according to the present invention matches, the change in the touch input may include a gesture action, such as a slide, tap, or press. The previous embodiments described a case where the change in the pre-stored touch input was a slide input, but the embodiments described later in FIGS. 11 to 16 include a tap, press, and/or press tab including touch and untouch. This is an example. In this specification, untouch refers to a state between when an initial touch (eg, tap or press) input is recognized, when the touch input ends, and when a touch (eg, tap or press) input is recognized again. In other words, untouch can be defined only when at least two touch inputs are provided. At this time, untouch may be subject to a predetermined time limit. For example, the time limit may be 2 seconds, 1 second, or 500 ms, etc. For a non-limiting example, if the time limit is 2 seconds and the initial touch input is terminated (i.e., the finger is lifted) and the touch input is provided again 1 second later, the time interval of 1 second may be defined as an untouch state. there is. On the other hand, if the initial touch input (first touch) ends and a touch input (second touch) is provided again 5 seconds later, the 5 second time period is not an untouch state, but is the first touch and the second touch, respectively. It can be recognized by touch. 11 to 16 are schematic diagrams of touch input with the horizontal axis representing the passage of time. Shaded sections indicate sections where touch input (tap or press) is provided, and sections marked in white represent sections where an untouch state is provided. means.

Figure 11 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches. FIG. 11 illustrates the example of a pre-stored pattern to determine whether the touch change matches, that is, the type of touch input is a press of 500 milliseconds or longer.

Referring to FIG. 11, if the user maintains the touch at the location where the fingerprint was recognized for 450 milliseconds from the time the fingerprint was recognized, the electronic device may not be unlocked.

On the other hand, if the user maintains the touch at the location where the fingerprint was recognized for a specified period of time, that is, 500 milliseconds or more, for example, 620 milliseconds, from the time the user recognizes the fingerprint, the point at which the user ends the press input, e.g. After 620 milliseconds, an operation to unlock can be performed.

Figure 12 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches. FIG. 12 illustrates an example of a pre-stored pattern to determine whether the touch change matches, that is, the type of touch input is a press within an error range based on 500 milliseconds. For example, the case of a press for 450 to 550 milliseconds will be described as an example.

Referring to FIG. 12, if the user maintains the touch at the location where the fingerprint was recognized for 400 milliseconds, which is outside the error range from the time the fingerprint was recognized, and then terminates the lock, the electronic device may not be unlocked. Alternatively, if the touch is maintained at the location where the fingerprint was recognized for 650 milliseconds, which is outside the error range, and then terminated, the electronic device may not be unlocked.

On the other hand, if the user maintains the touch at the location where the fingerprint was recognized for a time within the error range from the time the fingerprint was recognized, for example, 520 milliseconds, the lock is unlocked when the user ends the press input, that is, after 520 milliseconds have elapsed. An operation may be performed. In other words, unlocking may not be performed if a touch input is provided that exceeds the time interval of the specified tolerance range.

In the embodiments described below, whether the times of the first touch, untouch, and second touch coincide may be determined within a predetermined tolerance range, as in the present embodiment.

Figure 13 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches. FIG. 13 illustrates the case where the pre-stored pattern, that is, the type of touch input, is an untouch for 250 milliseconds as an example to determine whether the touch change matches. The touch change pattern collected by the user may be that the first touch is 250 milliseconds, the untouch is 250 milliseconds, and the second touch is a tap. However, in this embodiment, the information used to determine whether the touch change matches may be only the untouch time, not the first touch and the second touch.

Referring to FIG. 13, even if the user maintains the first touch (press) for 250 milliseconds, lifts the finger, and provides a second touch (tap or press) input again 200 milliseconds later, the electronic device is unlocked. It may not work. That is, the lock may not be released even if an input matching the first touch of the pre-stored touch change pattern is provided.

On the other hand, if the user maintains the first touch for 120 milliseconds, lifts his finger, and provides a touch input again 250 milliseconds later, an operation for unlocking may be performed. That is, even if an input that does not match the first touch time of the pre-stored touch change pattern is provided, the lock can be released if the untouch time matches. The timing of performing the unlocking operation may be the moment when the second touch is input again after the untouch.

Likewise, if the user maintains the first touch for 370 milliseconds, lifts his finger, and provides a touch input again 250 milliseconds later, an operation for unlocking may be performed. That is, even if an input that does not match the first touch time of the pre-stored touch change pattern is provided, the lock can be released if the untouch time matches. The timing of performing the unlocking operation may be the moment when the second touch is input again after the untouch.

Here, the first touch is a touch in the fingerprint recognition area or a designated first point within the fingerprint recognition area, and the second touch may only mean a touch in the same area as the first touch or at the first point. For example, even if the user inputs a touch at a different location after recognizing the first touch, this may not be recognized as the second touch.

Figure 14 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches. FIG. 14 illustrates an example in which the second touch is recognized again after an untouch of the pre-stored pattern, that is, the type of touch input, to determine whether the touch change matches, but the second touch lasts for 150 milliseconds. The touch change pattern collected by the user may be a first touch of 50 milliseconds, an untouch of 50 milliseconds, and a second touch of 150 milliseconds. However, in this embodiment, the information used to determine whether the touch change matches may be only the second touch time, not the first touch and untouch.

Referring to FIG. 14, even if the user maintains the first touch for 50 milliseconds, lifts his finger, provides a second touch input again after 50 milliseconds, and maintains the second touch input for 100 milliseconds, the electronic device will not be unlocked. You can. That is, the lock may not be released even if an input matching the first touch and untouch of the pre-stored touch change pattern is provided.

On the other hand, if the user maintains the first touch for 150 milliseconds, lifts the finger, provides a second touch input again 50 milliseconds later, and maintains the second touch input for 150 milliseconds, an operation for unlocking may be performed. That is, even if an input that does not match the first touch time of the pre-stored touch change pattern is provided, the lock can be released if the retention time of the second touch matches. The timing of performing the unlocking operation may be the moment the second touch ends.

Likewise, if the user maintains the first touch for 150 milliseconds, lifts his finger, and provides a second touch input again 350 milliseconds later and maintains the second touch input for 150 milliseconds, an operation for unlocking may be performed. That is, even if an input that does not match the first touch time and the untouch maintenance time of the pre-stored touch change pattern is provided, the lock can be released if the maintenance time of the second touch matches. The timing of performing the unlocking operation may be the moment the second touch ends.

Figure 15 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches. FIG. 15 illustrates an example of a pre-stored pattern to determine whether the touch change matches, that is, the type of touch input is a first touch of 250 milliseconds and an untouch of 200 milliseconds. The touch change pattern collected by the user may be a first touch of 250 milliseconds, an untouch of 200 milliseconds, and a second touch of 50 milliseconds. However, in this embodiment, the information used to determine whether the touch change matches may only be the first touch and untouch.

Referring to FIG. 15, even if the times of the untouch and the second touch match, if the holding time of the first touch does not match or does not match within the tolerance range, the electronic device may not be unlocked.

On the other hand, even if the second touch time of the user's input does not match the stored pattern information, the operation for unlocking can be performed if only the first touch maintenance time and the untouch time match. The timing of performing the unlocking operation may be the moment when the second touch is input again after the untouch.

Figure 16 is a schematic diagram for explaining a control method of an electronic device according to another embodiment of the present invention, and is a schematic diagram for explaining the step of determining whether a change in touch input matches. FIG. 16 illustrates the case where the pre-stored pattern, that is, the type of touch input, is an untouch for 250 milliseconds and a second touch for 250 milliseconds as an example to determine whether the touch changes match. The touch change pattern collected by the user may be the first touch for 250 milliseconds, the untouch for 250 milliseconds, and the third touch for 250 milliseconds. However, in this embodiment, the information used to determine whether the touch change matches may only be the untouch and the second touch.

Referring to FIG. 16, even if the times of the first touch and untouch match, if the holding time of the second touch does not match or does not match within the tolerance range, the electronic device may not be unlocked.

On the other hand, even if the first touch time of the user's input does not match the stored pattern information, an operation for unlocking can be performed if only the untouch maintenance time and the second touch maintenance time match. The timing of performing the unlocking operation may be the moment the second touch ends.

In the above, the embodiments of FIGS. 11 to 16 have been described by taking the case where the change in touch input is the maintenance time of touch and/or untouch as an example. In addition, in FIGS. 13 to 16, only the temporally preceding first touch and the following second touch are used as examples to define at least one untouch state, but the present invention is not limited thereto. Of course, in another embodiment, a change in touch input can be determined using three or more touches and a plurality of untouch times defined between them. In addition, in the step of verifying the change in touch input described in FIGS. 11 to 16, verification of whether the fingerprint matches is not performed, and matching can be determined only based on time information of touch and untouch.

Figure 17 is a flowchart showing a control method of an electronic device according to another embodiment of the present invention. FIG. 18 is a schematic diagram for explaining the control method of FIG. 17.

Referring to FIGS. 17 and 18, the control method of an electronic device or its instructions according to this embodiment provides a payment request interface (S100), detects a touch in the fingerprint recognition area (S150), and detects a touch in the fingerprint recognition area (S150). Determine whether it matches the fingerprint information (S200), detect whether the touch information changes (S300), determine whether the touch change matches the previously stored touch change information (S400), and perform an operation to proceed with the payment process (S500) It includes doing.

As described above, the electronic device 10 includes a display module 410, a touch sensitive module 420, and a biometric information recognition module, and can output a fingerprint recognition area 430a defined by the biometric information recognition module. The electronic device 10 may provide a predetermined interface that is not specified by the user (S100). In relation to this, Figure 18 illustrates a payment interface using the electronic device 10.

Then, a touch in the fingerprint recognition area 430a is detected (S150), a fingerprint match is determined (S200), a touch change in the fingerprint recognition area is detected (S300), and the touch change information is pre-stored. It can be determined (S400) whether it matches. At this time, the step of determining whether the touch change information matches (S400) may be performed using any one of the above-described FIGS. 8 to 16 or a combination of one or more methods. Since these steps have been described together with FIG. 2 and the like, redundant description will be omitted.

And, if the fingerprint matches the pre-stored fingerprint information, a touch change in the fingerprint recognition area is detected, and the detected touch change matches the pre-stored touch input change information, the payment process can proceed (S500).

The technical idea according to the present invention, which uses not only information on the user's fingerprint but also changes in touch input as security authentication, is not limited to being used as a means of unlocking an electronic device as described in FIGS. 1 to 16, and user authentication is It can be used as a means of authenticating the required operation. In other words, it can be applied to all methods for user identification, such as being used as a means of payment authentication, as shown in Figure 17, or as a means to replace password input in a web browser.

Although the above description focuses on the embodiments of the present invention, this is only an example and does not limit the present invention, and those skilled in the art will understand the present invention without departing from the essential characteristics of the embodiments of the present invention. It will be apparent that various modifications and applications not illustrated above are possible.

Therefore, the scope of the present invention should be understood to include changes, equivalents, or substitutes of the technical ideas exemplified above. For example, each component specifically shown in the embodiments of the present invention can be modified and implemented. And these variations and differences in application should be construed as being included in the scope of the present invention as defined in the appended claims.

Claims (3)

An electronic device comprising a touch sensitivity module, a biometric information recognition module, and one or more processors, the processor comprising:
Detect a touch input applied to the touch sensitive module,
Determine whether the obtained biometric information matches the stored information,
Determine whether the time pattern in which the touch input is recognized matches stored information,
If the acquired biometric information matches the stored information and the time pattern of the touch input matches the stored information, a designated operation is performed,
The stored information to determine whether the time pattern matches the stored information is,
The retention time of the first first touch detected before determining whether the biometric information matches,
A retention time of a second touch other than the first after the first touch, and
Includes one or more of the duration of the untouch state between the first touch and the second touch,
When determining whether the time pattern matches stored information, at least the duration of the untouch state is compared, but the comparison is performed without considering the retention time of the second touch following the untouch,
The designated operation is performed at the moment the second touch is input. According to paragraph 1,
When determining whether the time pattern matches stored information, the electronic device compares only the duration of the untouch state without considering the holding time of the first touch preceding the untouch. According to paragraph 1,
The first point where the first touch is detected is located within the area where the biometric information is obtained,
The holding time of the second touch is the holding time of a touch that is sensitive in an area including the first point, and excludes a touch that is sensitive in an area that does not include the first point.