WO2019151642A1

WO2019151642A1 - Apparatus and method for displaying guide information for changing fingerprint state

Info

Publication number: WO2019151642A1
Application number: PCT/KR2018/016015
Authority: WO
Inventors: 김용석; 김선아; 김정후; 프루신스키발레리; 허창룡; 현석; 송경훈; 조치현
Original assignee: 삼성전자 주식회사
Priority date: 2018-01-31
Filing date: 2018-12-17
Publication date: 2019-08-08
Also published as: KR20190093003A

Abstract

An electronic device according to various embodiments can comprise: a touch display; a fingerprint sensor formed on at least a partial region of the touch display; a memory; and a processor configured to acquire a first image of a user fingerprint, which is related to a first touch input, by using the fingerprint sensor on the basis of the first touch input, detected through the touch display, on the at least partial region, check whether a state of the fingerprint corresponds to a first state, on the basis of the acquired first image and a reference image of the fingerprint, which is stored in the memory, and display, through the touch display, information for guiding a second touch input for changing the state of the fingerprint from the first state to a second state, on the basis of the checking.

Description

Apparatus and method for displaying guide information for changing fingerprint status

Various embodiments relate to a method of recognizing a fingerprint and an electronic device thereof.

An electronic device such as a smart phone may store various kinds of personal information such as a phone number and authentication information (for example, a password). Accordingly, the electronic device may provide an authentication service to protect personal information stored in the electronic device from others. For example, the electronic device may provide an authentication service (eg, a biometric service) using biometric information such as an iris, a fingerprint, a face, a palm, and a vein.

As technology for recognizing fingerprints is developed, in addition to fingerprint input by a fingerprint sensor including a physical button, a fingerprint input method through a display may be required by integrating a fingerprint sensor inside the display. However, when the fingerprint sensor is disposed inside the display, the success rate of fingerprint recognition may decrease according to the state of the fingerprint. Thus, a solution may be required to increase the success rate of fingerprint recognition.

According to various embodiments of the present disclosure, by displaying information guiding a touch input, the fingerprint recognition state may be improved by changing the state of the fingerprint.

The technical problem to be achieved in this document is not limited to the technical problem mentioned above, and other technical problems not mentioned above may be clearly understood by those skilled in the art from the following description. There will be.

An electronic device according to various embodiments of the present disclosure may include a touch screen, a memory, and a processor. The processor acquires a first image of a fingerprint of a user associated with the first touch input based on a first touch input detected through the touch screen, and obtains the obtained first image and the memory stored in the memory. A second touch input for confirming that the state of the fingerprint corresponds to the first state based on the reference image for the fingerprint, and for changing the state of the fingerprint from the first state to the second state based on the confirmation It may be configured to display information for guiding through the touch screen.

An electronic device according to various embodiments of the present disclosure may include a touch screen, a plurality of fingerprint sensors disposed under the touch screen, and a processor. The processor detects a touch input through the touch screen, determines whether the position of the detected touch input is included in the position of the plurality of fingerprint sensors, and based on the determination, the processor determines the touch input of the detected touch input. And display information guiding fingerprint input at a location.

According to various embodiments of the present disclosure, a method of an electronic device obtains a first image of a fingerprint of a user associated with the first touch input based on a first touch input detected through a touch screen, and obtains the obtained first image. And confirming that the state of the fingerprint corresponds to the first state based on the reference image of the fingerprint stored in the memory, and changing the state of the fingerprint from the first state to the second state based on the confirmation. And display information for guiding a second touch input.

An electronic device method according to various embodiments of the present disclosure may detect a touch input through a touch screen, determine whether a position of the detected touch input is included in a location of a plurality of fingerprint sensors, and based on the determination, And display information guiding the fingerprint input at the location of the detected touch input.

The electronic device and the method according to various embodiments of the present disclosure may improve the recognition rate of the fingerprint by displaying information guiding a touch input based on the identified fingerprint state.

Effects obtained in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned above may be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.

2 illustrates an example of a functional configuration of an electronic device according to various embodiments of the present disclosure.

3A and 3B illustrate examples of fingerprint states according to various embodiments.

4 illustrates an operation principle of a fingerprint sensor according to various embodiments of the present disclosure.

5 illustrates an example of an operation of an electronic device for displaying information for guiding a touch input according to various embodiments of the present disclosure.

6A and 6B illustrate an example in which a fingerprint sensor is disposed in an electronic device according to various embodiments of the present disclosure.

7 illustrates an example of an operation of an electronic device to acquire a first image according to various embodiments of the present disclosure.

8 illustrates an example of an operation of an electronic device to determine a state of a fingerprint according to various embodiments of the present disclosure.

9 illustrates an example of an operation of an electronic device for displaying information guiding a second touch input according to various embodiments of the present disclosure.

10 illustrates an example of information guiding a second touch input according to various embodiments of the present disclosure.

11 illustrates an example of an operation of an electronic device for displaying information guiding a second touch input according to various embodiments of the present disclosure.

12 illustrates an example of information guiding a second touch input according to various embodiments of the present disclosure.

13 illustrates an example of an operation of an electronic device for displaying information guiding a second touch input according to various embodiments of the present disclosure.

14A to 14C illustrate examples of information for guiding a second touch input according to various embodiments of the present disclosure.

15 illustrates an example of an operation of an electronic device for displaying information guiding a second touch input according to various embodiments of the present disclosure.

16 illustrates an example of information guiding a second touch input according to various embodiments of the present disclosure.

17 illustrates an example of an operation of an electronic device for displaying information guiding a second touch input based on a grip sensor according to various embodiments of the present disclosure.

18A and 18B illustrate an example of information for guiding a second touch input based on a grip sensor according to various embodiments.

19 illustrates an example of an operation of an electronic device for displaying information guiding a first touch input according to various embodiments of the present disclosure.

20A and 20B illustrate an example of information for guiding a first touch input according to various embodiments.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art as described in the present disclosure. Among the terms used in the present disclosure, terms defined in the general dictionary may be interpreted as having the same or similar meaning as the meaning in the context of the related art, and ideally or excessively formal meanings are not clearly defined in the present disclosure. Not interpreted as In some cases, even if terms are defined in the present disclosure, they may not be interpreted to exclude embodiments of the present disclosure.

In various embodiments of the present disclosure described below, a hardware approach will be described as an example. However, various embodiments of the present disclosure include a technology using both hardware and software, and thus various embodiments of the present disclosure do not exclude a software-based approach.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (for example, near field communication), or the second network 199 ( For example, it may communicate with the electronic device 104 or the server 108 through remote wireless communication. According to an embodiment of the present disclosure, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, an audio output device 155, a display device 160, an audio module 170, and a sensor module. 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196, and antenna module 197. ) May be included. In some embodiments, at least one of the components (for example, the display device 160 or the camera module 180) may be omitted or another component may be added to the electronic device 101. In some embodiments, some components, such as in the case of a sensor module 176 (eg, fingerprint sensor, iris sensor, or illuminance sensor) embedded in display device 160 (eg, display), may be It can be integrated.

The processor 120 may drive at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120 by driving software (eg, the program 140). It can control and perform various data processing and operations. The processor 120 loads and processes the command or data received from another component (eg, the sensor module 176 or the communication module 190) into the volatile memory 132, and processes the result data in the nonvolatile memory 134. Can be stored in According to one embodiment, the processor 120 operates independently of the main processor 121 (eg, central processing unit or application processor), and additionally or alternatively, uses less power than the main processor 121, Or a coprocessor 123 specialized for a designated function (eg, a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor). Here, the coprocessor 123 may be operated separately from the main processor 121 or embedded.

In this case, the coprocessor 123 may, for example, replace the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg At least one of the elements of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module) together with the main processor 121 while in the application execution state. 190) may control at least some of the functions or states associated with). According to one embodiment, the coprocessor 123 (e.g., image signal processor or communication processor) is implemented as some component of another functionally related component (e.g. camera module 180 or communication module 190). Can be. The memory 130 may include various data used by at least one component of the electronic device 101 (for example, the processor 120 or the sensor module 176), for example, software (for example, the program 140). ), And input data or output data for a command related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

The program 140 is software stored in the memory 130 and may include, for example, an operating system 142, a middleware 144, or an application 146.

The input device 150 is a device for receiving a command or data to be used for a component (for example, the processor 120) of the electronic device 101 from the outside (for example, a user) of the electronic device 101. For example, it may include a microphone, a mouse, or a keyboard.

The sound output device 155 is a device for outputting sound signals to the outside of the electronic device 101. For example, the sound output device 155 may include a speaker used for general purposes such as multimedia playback or recording playback, and a receiver used only for receiving a call. It may include. According to one embodiment, the receiver may be formed integrally or separately from the speaker.

The display device 160 is a device for visually providing information to a user of the electronic device 101. For example, the display device 160 may include a display, a hologram device, a projector, and a control circuit for controlling the device. According to an embodiment of the present disclosure, the display device 160 may include a pressure sensor capable of measuring the strength of the pressure on the touch circuitry or the touch.

The audio module 170 may bidirectionally convert a sound and an electrical signal. According to an embodiment, the audio module 170 acquires sound through the input device 150, or an external electronic device (for example, a wired or wireless connection with the sound output device 155 or the electronic device 101). Sound may be output through the electronic device 102 (for example, a speaker or a headphone).

The sensor module 176 may generate an electrical signal or data value corresponding to an operating state (eg, power or temperature) inside the electronic device 101 or an external environmental state. The sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, Or an illumination sensor.

The interface 177 may support a specified protocol that may be connected to an external electronic device (for example, the electronic device 102) by wire or wirelessly. According to an embodiment, the interface 177 may include a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 is a connector for physically connecting the electronic device 101 and an external electronic device (for example, the electronic device 102), for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector. (Eg, headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. The haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and videos. According to an embodiment of the present disclosure, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

The power management module 188 is a module for managing power supplied to the electronic device 101, and may be configured, for example, as at least part of a power management integrated circuit (PMIC).

The battery 189 is a device for supplying power to at least one component of the electronic device 101 and may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 establishes a wired or wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108), and establishes the established communication channel. It can support to perform communication through. The communication module 190 may include one or more communication processors that support wired communication or wireless communication that operate independently of the processor 120 (eg, an application processor). According to an embodiment, the communication module 190 may include a wireless communication module 192 (eg, a cellular communication module, a near field communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, A local area network (LAN) communication module, or a power line communication module, comprising a local area network such as a first network 198 (eg, Bluetooth, WiFi direct, or infrared data association) using a corresponding communication module. Communication with an external electronic device via a communication network) or a second network 199 (eg, a telecommunication network such as a cellular network, the Internet, or a computer network (eg, a LAN or a WAN)). The various types of communication modules 190 described above may be implemented as one chip or each separate chip.

According to an embodiment of the present disclosure, the wireless communication module 192 may distinguish and authenticate the electronic device 101 in a communication network by using user information stored in the subscriber identification module 196.

The antenna module 197 may include one or more antennas for transmitting or receiving signals or power from the outside. According to an exemplary embodiment, the communication module 190 (for example, the wireless communication module 192) may transmit a signal to or receive a signal from an external electronic device through an antenna suitable for a communication method.

Some of the components are connected to each other via a communication method between peripheral devices (eg, a bus, a general purpose input / output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)). (E.g. commands or data) can be exchanged with each other.

According to an embodiment of the present disclosure, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the

electronic devices

102 and 104 may be a device of the same or different type as the electronic device 101. According to an embodiment of the present disclosure, all or part of operations executed in the electronic device 101 may be executed in another or a plurality of external electronic devices. According to an embodiment of the present disclosure, when the electronic device 101 needs to perform a function or service automatically or by request, the electronic device 101 may instead or additionally execute the function or service by itself. At least some associated functions may be requested to the external electronic device. Upon receiving the request, the external electronic device may execute the requested function or additional function and transmit the result to the electronic device 101. The electronic device 101 may process the received result as it is or additionally to provide the requested function or service. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

Electronic devices according to various embodiments of the present disclosure may be various types of devices. The electronic device may include, for example, at least one of a portable communication device (eg, a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present disclosure is not limited to the above-described devices.

Various embodiments of the present document and terms used therein are not intended to limit the techniques described in this document to specific embodiments, but should be understood to include various modifications, equivalents, and / or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar components. Singular expressions may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and / or B", "A, B or C" or "at least one of A, B and / or C", etc. Possible combinations may be included. Expressions such as "first," "second," "first," or "second," etc. may modify the components in any order or importance, and are only used to distinguish one component from another. It does not limit the components. When any (eg first) component is said to be "(functionally or communicatively)" or "connected" to another (eg second) component, the other component is said other The component may be directly connected or connected through another component (eg, a third component).

As used herein, the term "module" includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, components, or circuits. The module may be an integrally formed part or a minimum unit or part of performing one or more functions. For example, the module may be configured as an application-specific integrated circuit (ASIC).

Various embodiments of the present disclosure may include instructions stored in a machine-readable storage media (eg, internal memory 136 or external memory 138) that can be read by a machine (eg, a computer). It may be implemented in software (eg, program 140). The device may be a device capable of calling a stored command from a storage medium and operating in accordance with the called command, and may include an electronic device (eg, the electronic device 101) according to the disclosed embodiments. When the command is executed by a processor (for example, the processor 120), the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. The instructions can include code generated or executed by a compiler or interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' means that the storage medium does not include a signal and is tangible, but does not distinguish that the data is stored semi-permanently or temporarily on the storage medium.

According to one embodiment, a method according to various embodiments of the present disclosure may be included in a computer program product. The computer program product may be traded between the seller and the buyer as a product. The computer program product may be distributed online in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)) or through an application store (eg Play StoreTM). In the case of an online distribution, at least a portion of the computer program product may be stored at least temporarily on a storage medium such as a server of a manufacturer, a server of an application store, or a relay server, or may be temporarily created.

Each component (for example, a module or a program) according to various embodiments may be composed of a singular or plural number of objects, and some of the above-described subcomponents may be omitted, or other subcomponents may vary. It may be further included in the embodiment. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity to perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or at least some operations may be executed in a different order, omitted, or another operation may be added. Can be.

2 illustrates an example of a functional configuration of an electronic device according to various embodiments of the present disclosure. The functional configuration of such an electronic device may be included in the electronic device 101 shown in FIG. 1.

2, the electronic device 101 may include a display device 160, a sensor module 176, a memory 130, and a processor 120.

The display device 160 may output data or signals in the form of an image or an image. In various embodiments, the display device 160 may output data or a signal received from the memory 130 or the sensor module 176 in the form of an image or an image according to a control signal of the processor 120. In various embodiments, the display device 160 may display information for guiding a fingerprint input. The information may include an image of a fingerprint or similar shape. For example, when it is determined that the state of the fingerprint corresponds to the first state (for example, the state in which the fingerprint is dry, the state in which the oil is low in the fingerprint), the display device 160 according to the control signal of the processor 120, Information for guiding a user's touch input may be displayed. The first state may be a fingerprint for the authenticated user based on a result of the comparison of the reference image of the fingerprint and the image of the input fingerprint, with the fingerprint dry, the oil lacking or lacking in the fingerprint. Estimated, but the image for the input fingerprint does not match the reference image, the match rate between the image for the input fingerprint and the reference image is lower than a specified value, or within the image for the input fingerprint. The ratio of the area caused by the floor area located in the fingerprint at may be a lower value than the ratio of the area caused by the floor area located in the fingerprint in the reference image. The touch input may include a drag input. The information for guiding the touch input may have a form including a first point and a second point, a plurality of objects arranged in a grid, or an arrow indicating a specific direction. The display device 160 may display a graphical user interface (GUI) for interaction between the user and the electronic device 101. According to various embodiments of the present disclosure, the display device 160 may include a liquid crystal display (LCD) or an organic light emitting diode (OLED). According to various embodiments of the present disclosure, the display device 160 may receive information about a fingerprint of a user related to a touch input through a touch screen panel (TSP) module 222 that may receive a user's touch input and a user's touch input. It may be electrically or functionally coupled with the fingerprint sensor 224 to acquire.

According to various embodiments of the present disclosure, the sensor module 176 may receive data for determining a context related to the inside or the outside of the electronic device 101. The sensor module 176 may be configured to integrate with various sensors (eg, grip sensor, proximity sensor, geomagnetic sensor, gyro sensor, illuminance sensor, barometric pressure sensor, pressure sensor, touch sensor, or biometric sensor). For example, the sensor module 176 may transmit data about an external situation related to the user to the processor 120.

According to various embodiments of the present disclosure, the sensor module 176 may include a TSP module 222, a fingerprint sensor 224, and a grip sensor 226.

The TSP module 222 may receive data related to a user's touch input. According to various embodiments of the present disclosure, the TSP module 222 may detect a touch input of a finger and a pen. The touch input may include touch and release, drag and drop, long touch, or force touch. According to various embodiments of the present disclosure, the TSP module 222 may receive information about a location in a display where a user's touch is input and an area where the user's touch is input. According to various embodiments of the present disclosure, the TSP module 222 may map information about a location and an area where a user's touch is input to the time when the touch is input, and store the information in the memory 130. For example, a user of the electronic device 101 may contact the electronic device 101 with an ear of the user to perform a voice call. The TSP module 222 maps information about the location and area of the touch input caused by the contact (e.g., the front of the display) to the time at which the contact occurred (e.g. 11:10 am), and the memory ( 130). The TSP module 222 may store mapping information regarding a plurality of touch inputs. In the above-described embodiments, the TSP module 222 is described as mapping the information regarding the position and area of the touch input to the time at which the touch input occurs, but is not limited thereto. For example, the TSP module 222 may provide only the information about the position and the area where the touch input is detected to the processor 120, and the processor 120 may map the information about the acquired position and the area in time. .

According to various embodiments of the present disclosure, the TSP module 222 may receive a user's touch input independently of the operation mode of the display device 160. For example, the display device 160 may operate in an off state. In the off state, power is supplied from the electronic device 101 to the display device 160, but no object is displayed, and a blank screen or a black screen on the display device 160 is displayed. black screen) may be displayed. The off state may be variously referred to as an inactive state, a deactivation state, a sleep state, an inactive state, or an idle state. The on state may include a state in which at least one object is displayed on the display device 160 based on data or a signal received from the processor 120. The on state may be variously referred to as an active state or an activated state. According to another embodiment of the present disclosure, when the processor 120 of the electronic device 101 is in a sleep state, the electronic device 101 may operate in a mode of displaying content through a display. For example, the electronic device 101 displays at least one icon for indicating a current time, date, and a notification provided from at least one application while the processor 120 operates in the sleep state. Can be represented on the image. The mode may be referred to as always on display (AOD) mode.

The TSP module 222 may receive a user touch input through the touch screen regardless of the on / off state of the display device 160. The TSP module 222 may operate in an active state, for example, while the display device 160 operates in an off state. The TSP module 222 may receive a user's touch input while the display device 160 displays the blank screen or the black screen. The TSP module 222 may receive a user's touch input, for example, while the display device 160 operates in the on state. The TSP module 222 may provide the processor 120 with information about the location of the received touch input on the display device 160 and the area of the received touch input. The processor 120 may execute an application or change the display of the display device 160 based on the information about the touch input provided from the TSP module 222.

According to various embodiments of the present disclosure, the TSP module 222 may provide the processor 120 with the received touch input and data related to the received touch input. For example, the TSP module 222 may receive a touch input while the display device 160 operates in the off state. Accordingly, the TSP module 222 controls to turn on (or change) the display device 160 to the processor 120 based on the off state of the display device 160 and the received touch input. You can send a signal. The TSP module 222 may transmit data regarding the location, area, and time of the touch input to the memory 130 to store data related to the touch input. For example, the processor 120 acquires data related to the touch input from the TSP module 222 and instructs the memory 130 to store the acquired data and the obtained data in the memory 130. The control signal can be transmitted. As another example, the TSP module 222 may store the obtained data in the memory 130 by transmitting the obtained data to the memory 130.

The fingerprint sensor 224 may receive data related to a fingerprint through a user's touch input. The fingerprint sensor 224 may receive data for determining whether a user associated with a touch input is an authenticated user, according to a characteristic pattern of valleys and ridges located within the user's fingerprint. According to various embodiments of the present disclosure, the fingerprint sensor 224 may be based on an optical scheme based on a difference in light reflected by a valley located in a fingerprint, and a phase difference in ultrasonic waves reflected by a floor located in the fingerprint. It may operate according to an ultrasonic method, or an electrostatic method based on the difference in dielectric constant caused by the valleys and ridges located in the fingerprint.

The grip sensor 226 may detect whether the electronic device 101 is held by a user and the direction of the held hand. According to various embodiments, the grip sensor 226 may be configured to be integrated with a gyro sensor (not shown), a geomagnetic sensor (not shown), or a proximity sensor (not shown). For example, the electronic device 101 may detect a change in capacitance or a change in the magnetic field between the detection object and the proximity sensor through the proximity sensor. The electronic device 101 uses the grip sensor 226 to allow the user to move the electronic device 101 to the left or right hand based on the magnitude of the change in the left magnetic field and the magnitude of the change in the right magnetic field of the electronic device 101. It can be identified whether it is held.

According to various embodiments of the present disclosure, the grip sensor 226 may transmit information about a position of a hand of the user holding the electronic device 101 to the processor 120. For example, when the user grips the electronic device 101 with his left hand, the grip sensor 226 may transmit information indicating to the processor 120 that the electronic device 101 is gripped by the left hand. have. The processor 120 may control to display an interface for fingerprint input on an area of the display device 160 where the fingerprint sensor on the left side of the plurality of fingerprint sensors is located. For another example, when the user grips the electronic device 101 with his right hand, the grip sensor 226 may transmit information indicating to the processor 120 that the electronic device 101 is gripped by the right hand. Can be. The processor 120 may display an arrow figure for guiding a drag input in a left direction through the display device 160.

The memory 130 may correspond to the memory 130 shown in FIG. 1.

According to various embodiments of the present disclosure, the memory 130 may store a command, a control command code, control data, or user data for controlling the electronic device 101. For example, the memory 130 may include an application, an operating system (OS), middleware, and a device driver. For another example, the memory 130 may be stored in advance by an authenticated user and store pattern information used to release the lock state of the electronic device 101. The pattern information may be information related to the order of a plurality of objects arranged in a grid. As another example, the memory 130 may store information related to a touch input. The memory 130 may obtain, through the processor 120, information in which the time when the touch is input is mapped to a location and an area on the display device 160 on which the user touch is input from the TSP module 222. The memory 130 may provide information related to the touch input at the request of the processor 120.

According to various embodiments of the present disclosure, the memory 130 may include one or more of volatile memory or non-volatile memory. Volatile memory includes dynamic random access memory (DRAM), static RAM (SRAM), synchronous DRAM (SDRAM), phase-change RAM (PRAM), magnetic RAM (MRAM), persistent RAM (RRAM), ferroelectric RAM (FeRAM), and the like. It may include. The nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, and the like. The memory 130 may be a non-volatile medium such as a hard disk drive (HDD), a solid state disk (SSD), an embedded multi media card (eMMC), or a universal flash storage (UFS). It may include.

According to various embodiments, the memory 130 may provide stored data based on a request of the processor 120 or another component (eg, the TSP module 222), or the processor 120 or the other component ( For example, data received from the TSP module 222 may be recorded and stored. For example, the memory 130 may receive information about the location, area, and time related to the touch input from the TSP module 222 according to a request of the TSP module 222. In addition, the processor 120 receives, from the TSP module 222, information regarding a location, an area, and a time related to the touch input, and transmits the obtained information to the memory 130 to store the obtained information. You may.

For another example, the memory 130 may transmit information about the location and area of the touch input received within the closest time from the specific time to the processor 120 at the request of the processor 120.

According to various embodiments of the present disclosure, the processor 120 may control the overall operation of the electronic device 101. For example, the processor 120 may read or write data in the memory 130 and execute application instruction codes stored in the memory 130. For example, the processor 120 may perform user authentication using an image of a fingerprint input through a touch input. To this end, the processor 120 may receive a reference image of the fingerprint of the authenticated user from the memory 130. The processor 120 may perform user authentication by performing image matching between the received reference image and the image of the input fingerprint. The processor 120 may obtain a matching rate between areas corresponding to the first color and a matching rate between areas corresponding to the second color based on the image matching.

In another example, the processor 120 may display various information through the display device 160. When the processor 120 determines that the fingerprint input through the touch input corresponds to a first state (for example, a dry state of the fingerprint or a state in which the fingerprint is insufficient), the processor 120 changes the state of the fingerprint from the first state to the second state. For example, the display device 160 may be controlled to display the guided information for changing the fingerprint to a state in which the fingerprint is not dry or the fingerprint is sufficiently oiled. The second state is based on a state in which the fingerprint is not dry, a state in which the oil is sufficient in the fingerprint, a comparison result of the reference image for the fingerprint and the image for the input fingerprint, and the reference image and the reference image. The coincidence ratio of may be greater than or equal to a predetermined value, and within the ridge area of the fingerprint, a small bone area generated when the fingerprint is dry may include a state filled with a material such as sweat or oil.

According to various embodiments of the present disclosure, all or part of the processor 120 may be electrically connected to other components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the memory 130). It can be electrically connected or functionally combined or connected. According to various embodiments of the present disclosure, the processor 120 may be configured of one or more processors. For example, the processor 120 includes an application processor (AP) that controls a higher layer program such as an application or a communication processor (CP) that performs control for communication with another electronic device. can do.

3A and 3B illustrate examples of a fingerprint state according to various embodiments of the present disclosure.

Referring to FIG. 3A, a state of a fingerprint may correspond to a second state (eg, a state in which the fingerprint is not dry or a state in which the oil is sufficient in the fingerprint). In detail, the fingerprint of the user is based on the touch surface of the touch screen 303 (for example, the display device 160 of FIG. 1), and the area of the ridge 302 corresponding to the relatively low position and the touch screen ( Based on the touch surface of 303, it may be divided into a valley 301 region corresponding to a relatively high position. In the user's touch input, the floor 302 area included in the fingerprint has a relatively low position from the touch surface of the touch screen 303, and thus may be in physical contact with the touch screen 303. On the other hand, when the user's touch input, the valley 301 region included in the fingerprint has a relatively high position from the touch surface of the touch screen 303, and thus may not be in physical contact with the touch screen 303. Thus, an air layer may be formed between the area of the valley 301 located in the fingerprint and the surface of the touch screen 303. Since the area of the floor 302 located within the fingerprint is in physical contact with the touchscreen 303, no air layer may be formed between the area of the floor 302 and the surface of the touchscreen 303.

According to various embodiments of the present disclosure, the processor 120 may acquire an image 310 corresponding to the second state of the fingerprint through the fingerprint sensor 224 when a user inputs a touch. The image 310 corresponding to the second state includes a first area 312 indicated by a first color (eg black) and a second area 314 indicated by a second color (eg white). can do. An area of the ridge 302 located in the fingerprint may correspond to the first area 312 of the image 310 corresponding to the second state. An area of the valley 301 located in the fingerprint may correspond to the second area 314 of the image 310 corresponding to the second state.

Referring to FIG. 3B, the state of the fingerprint may correspond to a first state (eg, a state in which the fingerprint is dry and a state in which the oil is insufficient in the fingerprint). When the state of the fingerprint corresponds to the first state, an area that is not in physical contact with the touch screen 303 may be generated inside the floor 302 of the fingerprint corresponding to the second state. That is, when the fingerprint corresponds to the first state, in the floor 302 region of the fingerprint, the fingerprint has a relatively high position with respect to the touch surface of the touch screen 303 and is not in physical contact with the touch screen 303. A small valley 304 area may be created. That is, the small valley 304 area may include a material such as sweat or oil when the state of the fingerprint corresponds to the second state (for example, the state in which the fingerprint is not dry), and the touch screen 303 may be formed. There may be no air layer between the touch surface and the small valley 304 area. The small valley 304 area may not include a material such as sweat or oil when the state of the fingerprint corresponds to the first state (eg, the state in which the fingerprint is dry). When the state of the fingerprint corresponds to the first state, an air layer may be formed between the small valley 304 area and the touch surface of the touch screen 303.

According to various embodiments of the present disclosure, the processor 120 may acquire an image 320 corresponding to the first state of the fingerprint through the fingerprint sensor 224 when a user inputs a touch. The image 320 corresponding to the first state includes a third area 322 indicated by a first color (eg black) and a fourth area 324 indicated by a second color (eg white). can do. The fourth region 324 indicated by the second color may include the region generated by the region of the valley 301 included in the fingerprint and the region generated by the region of the small valley 304 generated according to the second state. Can be.

4 illustrates an operation principle of a fingerprint sensor according to various embodiments of the present disclosure. The fingerprint sensor 420 illustrated in FIG. 4 may correspond to the fingerprint sensor 224 illustrated in FIG. 2.

Referring to FIG. 4, the fingerprint sensor 420 may be located at the bottom of the light emitting layer 410 of the display. The fingerprint sensor 420 may be positioned under the light emitting layer 410 of the display to detect light reflected from the window glass of the display device 160 and obtain an image of the fingerprint based on the detected light. Since the fingerprint sensor 420 is not transparent, when the fingerprint sensor 420 is positioned above the light emitting layer 410 of the translucent display, the overall performance of the display may be reduced.

According to another embodiment, although not shown, the fingerprint sensor 420 may acquire an image regarding the fingerprint by using a separate light source. For example, the fingerprint sensor 420 may be generated from a separate light source to detect light reflected from the window glass and traveling. The fingerprint sensor 420 may be located at a specific location (eg, in an edge direction of the display) in order to efficiently receive light generated from a separate light source. The separate light source may operate to acquire a fingerprint image for a touch input when there is no light source generated from the light emitting layer 410 of the display by operating the display device 160 in an off state or a low power mode.

Referring to FIG. 4, when a user inputs a touch, a contact 434 region by physical contact between a window glass and a plurality of floors 431 may be generated. The bone 432 area within the fingerprint may be created or destroyed depending on the state of the fingerprint. For example, when the state of the fingerprint corresponds to a second state (for example, a state in which the oil is sufficient for the fingerprint and the state in which the fingerprint is not dry), a region of the bone 432 where a material such as sweat or oil is small is formed. I can fill it. Accordingly, when the fingerprint corresponds to the second state, the small valley 432 area may not exist. In another example, when the state of the fingerprint corresponds to the first state (for example, the state in which the oil is insufficient in the fingerprint and the state in which the fingerprint is dry), since there is no material such as sweat or oil, the bone 435 Small valleys 432 areas different from the areas may be created. The valley 435 is an area that cannot be filled by a material such as sweat or oil, and may correspond to an area that always has a second color (eg, white color) when a fingerprint is input.

According to various embodiments of the present disclosure, the fingerprint sensor 420 may acquire the image of the fingerprint by receiving the light of the path A and the path B reflected on the touch screen to the fingerprint sensor 420. The light in path A may be light reflected and received from the area of the valleys 432 or 435 located within the window glass and fingerprint. The light in path B may be light received reflected from the area of the ridge 431 located in the window glass and fingerprint. Light in path A may be reflected through an air layer present between the window glass and the area of valleys 432 or 435 located within the fingerprint. Therefore, the light of the path A can be reduced in intensity small. On the other hand, when the light of the path B reaches the area of the contact 434 of the window glass and the floor 431 located in the fingerprint, the light of the path B may be absorbed through the user's fingerprint. Therefore, the light of the path B reflected from the contact 434 region can be greatly reduced in the amount of light. That is, the light of the path A may be light brighter than the light of the path B.

According to various embodiments, the fingerprint sensor 420 receives the light of the path A and the light of the path B reflected through the plurality of air layers 433 and the contact 434 regions, and compares the two light intensity differences to obtain a fingerprint. Obtain an image for. For example, the fingerprint sensor 420 may receive the reflected light of the path A, and detect the light having the first value. The fingerprint sensor 420 may receive the reflected path B light and detect light having a second brightness. Through the image processing, the fingerprint sensor 420 may recognize that the value of the brightness of the first value corresponding to the light of the reflected path A is greater than the value of the second brightness corresponding to the light of the reflected path B. Since the reflected path B is partially absorbed into the floor area 431 of the fingerprint in contact with the window glass, the value of the second brightness may be smaller than the value of the first brightness. Accordingly, the fingerprint sensor 420 may receive the light of the path A reflected at the location corresponding to the valley area 432 of the fingerprint, and the path B of the path B reflected onto the location corresponding to the floor area 431 of the fingerprint. Can receive light. The fingerprint sensor 224 may acquire the image 310 corresponding to the second state of the fingerprint of FIG. 3A or the image 320 corresponding to the first state of the fingerprint shown in FIG. 3B by inverting the received light. have.

5 is a flowchart illustrating an electronic device for displaying information guiding a touch input according to various embodiments of the present disclosure.

Referring to FIG. 5, in operation 501, the processor 120 may acquire a first image of a fingerprint of a user associated with a first touch input. According to various embodiments, the processor 120 may display an interface for guiding a fingerprint input through the display device 160 to obtain a first image of the user's fingerprint. For example, the processor 120 may detect that the display device 160 is changed from an off state to an on state, and display an interface for guiding a fingerprint input according to the detection. The interface for guiding the fingerprint input may be an image including the shape of the fingerprint or the like. The interface for guiding the fingerprint input may further include text for guiding the fingerprint input (eg, “Please enter a fingerprint” or “Raise your finger”). The processor 120 may acquire, via the fingerprint sensor 224, a first image of a fingerprint related to a touch input according to the interface.

According to an embodiment of the present disclosure, the processor 120 may acquire a first image of a user's fingerprint through the fingerprint sensor 224 while the display device 160 operates in an off state. The fingerprint sensor 224 may receive a touch input even when the display device 160 operates in the off state. For example, the processor 120 may display a graphical user interface (GUI) on an area of the display device 160 where the fingerprint sensor 224 is located while operating in the AOD mode. For example, the GUI may include a graphic object that includes the shape of a fingerprint. The display device 160 may operate in a low power mode or an off state based on the AOD mode. The fingerprint sensor 224 may acquire an image of a user's fingerprint through an area where the GUI is displayed while the display device 160 operates in a low power mode or an off state.

According to another exemplary embodiment, the fingerprint sensor 224 may perform fingerprint authentication by comparing an image of a fingerprint of an authenticated user with a first image acquired based on the received touch input. The processor 120 may change the display device 160 from the off state to the on state in response to obtaining the first image by the fingerprint sensor 224. For example, when the first image and the image of the authenticated user's fingerprint match, the processor 120 determines that the fingerprint authentication is successful, and releases the lock state of the electronic device 101 and the display device 160. The off state of can be switched on. In another example, when it is determined that there is a mismatch between the first image and the image of the authenticated user's fingerprint, the processor 120 turns on the state of the display device 160 and guides the second touch input. Information may be displayed through the display device 160.

According to another embodiment, the processor 120 may display a graphical user interface (GUI) on an area where the fingerprint sensor 224 is located. For example, the GUI may include a graphic object that includes the shape of a fingerprint. The display device 160 may operate in a low power mode or an off state based on the AOD mode. The fingerprint sensor 224 may acquire an image of a user's fingerprint through an area where the GUI is displayed while the display device 160 operates in a low power mode or an off state.

According to an embodiment, referring to FIG. 6A, the processor 120 may display an interface for guiding a fingerprint input. The processor 120 may display an interface for guiding the fingerprint input on an area where the fingerprint sensor 224 is located. For example, when the fingerprint sensor 224 is positioned at the bottom center of the display device 160, the processor 120 may display a fingerprint-shaped image 620 at the bottom center of the display device 160.

According to another embodiment, referring to FIG. 6B, the electronic device 101 may include a plurality of fingerprint sensors 620 through 660. For example, the plurality of fingerprint sensors 620 to 660 may include five fingerprint sensors. The fingerprint sensor 620 may be disposed at a position corresponding to a conventional physical key or button (for example, a lower center portion of the display device 160). The remaining fingerprint sensors 630 to 660 may be disposed through the remaining area except for the area where the fingerprint sensor 620 is disposed. For another example, the plurality of fingerprint sensors 620 through 660 may be disposed through the entire area of the display device 160. In this case, the plurality of fingerprint sensors may be arranged such that the distance between each fingerprint sensor is the same. Since the plurality of fingerprint sensors 620 to 660 are located in the display device 160 area, the processor 120 may adaptively change the position of the interface for fingerprint input.

In operation 503, the processor 120 may identify that the state of the fingerprint corresponds to the first state, based on the obtained first image and the reference image. The first state may be a fingerprint for the authenticated user based on a result of the comparison of the reference image of the fingerprint and the image of the input fingerprint, with the fingerprint dry, the oil lacking or lacking in the fingerprint. Estimated, but the image for the input fingerprint does not match the reference image, the match rate between the image for the input fingerprint and the reference image is lower than a specified value, or within the image for the input fingerprint. In FIG. 5, the ratio of the area caused by the floor area positioned in the fingerprint may be lower than the ratio of the area caused by the floor area located in the fingerprint in the reference image. The processor 120 may perform a comparison with the reference image to perform fingerprint authentication using the obtained first image. The reference image may be stored in advance by an authenticated user of the electronic device, and may include an image of a fingerprint of an authenticated user, an image registered for setting a fingerprint registration, and an image of a fingerprint of an authorized user. The processor 120 may determine whether a state of the fingerprint corresponds to the first state based on the obtained first image and the reference image. According to an embodiment of the present disclosure, the processor 120 may determine that the state of the fingerprint corresponds to the first state by determining whether the first area of the first image and the third area of the reference image are different.

In operation 505, the processor 120 may display information guiding a second touch input for changing the state of the fingerprint from the first state to the second state. The second state is based on a state in which the fingerprint is not dry, a state in which the oil is sufficient in the fingerprint, a comparison result of the reference image for the fingerprint and the image for the input fingerprint, and the reference image and the reference image. The coincidence ratio of may be greater than or equal to a predetermined value, or a small bone region generated when the fingerprint is dry, or when the fingerprint is dry, may be filled with a material such as sweat or oil. The processor 120 may display information for guiding a touch input to change the state of the fingerprint to the second state based on detecting that the state of the fingerprint corresponds to the first state. The information guiding the touch input may include a visual object such as a figure including a first point and a second point, a visual object such as a plurality of objects arranged in a grid, and a visual object such as an arrow indicating a specific direction. have. The second touch input may include a drag input. The user may input a touch based on the displayed information through the display device 160. According to the drag touch of the user, a material such as sweat generated by friction between the display device 160 and the fingerprint and oil present on the display device 160 may fill small valley areas in the floor area. . As the small valley areas in the ridge area are filled, the state of the fingerprint may change from the first state to the second state.

7 illustrates an example of an operation of an electronic device to acquire a first image according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Operations 701 to 705 of FIG. 7 may be related to operation 501 of FIG. 5.

Referring to FIG. 7, in operation 701, the processor 120 may receive data from a grip sensor 226 or a pressure sensor (not shown). The grip sensor 226 may obtain information related to the direction of the hand holding the electronic device 101 by comparing the magnitude of the magnetic field change in the left direction and the magnitude of the magnetic field change in the right direction.

For example, the processor 120 may detect that the user grips the electronic device 101 by receiving information from the grip sensor 226. When the user grips the electronic device 101, the processor 120 transmits a control signal instructing to display the information for guiding the change from the off state of the display device 160 to the on state and the first touch input. can do.

In another example, processor 120 may receive data from a pressure sensor (not shown). The pressure sensor (not shown) may be disposed in the lower center portion of the display device 160. The pressure sensor (not shown) may correspond to a conventional physical key or button for activating the display. When the pressure sensor (not shown) detects a touch input having a pressure equal to or greater than a preset threshold value, the pressure sensor (not shown) may transmit data to the processor 120. The processor 120 may transmit a control signal instructing the display device 160 to turn on the display device 160 based on data reception from a pressure sensor (not shown).

In the above embodiments, the processor 120 has been described as receiving data from the grip sensor 226 or a pressure sensor (not shown), but is not limited thereto. For example, the processor 120 may receive data from an illuminance sensor (not shown) based on a sudden change in illuminance value when the user removes the electronic device from a pocket (or bag) for use. Can be. The processor 120 may transmit a control signal instructing to activate the display device 160 based on receiving data from an illumination sensor (not shown).

In operation 703, the processor 120 may display information guiding the first touch input. The processor 120 may transmit a control signal instructing the display device 160 to display information guiding a first touch input for fingerprint authentication of the user. The information guiding the first touch input may be an image including a shape of a fingerprint and a shape similar thereto. The information for guiding the first touch input may further include text for guiding the fingerprint input (eg, “Please enter a fingerprint” or “Raise a finger”). The display device 160 may display information guiding the first touch input based on a control signal from the processor 120. Accordingly, the first touch input for fingerprint authentication may be received in an area where the fingerprint sensor 224 is located in the display device 160.

In operation 705, the processor 120 may acquire a first image through the fingerprint sensor 224. The fingerprint sensor 224 may acquire an image of the fingerprint according to the first touch input based on the difference in the intensity of light reflected by the valley area and the floor area located in the fingerprint. An image of the fingerprint according to the first touch input may be referred to as a first image. The fingerprint sensor 224 may acquire the first image by converting analog data about received light intensity into digital data and performing image processing.

8 illustrates an example of an operation of an electronic device to determine whether a state of a fingerprint corresponds to a first state according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG.

Operations 801 to 805 illustrated in FIG. 8 may relate to operation 503 illustrated in FIG. 5.

Referring to FIG. 8, in operation 801, the processor 120 may determine whether a matching ratio between the second area of the first image and the fourth area of the reference image is greater than or equal to the first threshold value. That is, the processor 120 may determine whether the regions corresponding to the valley 435 regions overlap by comparing the reference image with the first image. For example, when the second area of the first image and the fourth area of the reference image are not equal to each other by about 95% or more, the processor 120 may determine the touch input by a third party, not an authenticated user. This is because the second region of the first image is a region having a second color according to the region of the valley 435 that exists regardless of the presence of a material such as sweat or oil. In another example, when the second area of the first image and the fourth area of the reference image are about 95% or more identical, the processor 120 may determine that the first image is an image of a fingerprint of an authenticated user. Accordingly, the processor 120 may perform operation 803 to determine whether fingerprint authentication has failed due to the state of the fingerprint.

In the above-described embodiments, the first threshold value has been described as the same value as about 95%, but the present invention is not limited thereto. The processor 120 may set the first threshold value to various values according to the security setting of the user. For example, if the user requires a high security fingerprint authentication, the first threshold may be set to about 99%. The specific first threshold value is not limited thereto and may have various values.

In operation 803, the processor 120 may determine whether a match rate between the first area of the first image and the third area of the reference image is greater than or equal to a second threshold value. That is, the processor 120 may determine whether the floor 302 overlaps by comparing the reference image with the first image. For example, the processor 120 does not determine whether the state of the fingerprint corresponds to the first state or the second state when the first region of the first image and the third region of the reference image are not equal to about 70% or more. You may not. According to an embodiment of the present disclosure, the processor 120 may display information guiding the first touch input again in order to obtain specific information about the first image. In another example, the processor 120 may detect that the first area of the first image and the third area of the reference image are about 70% or more the same.

In operation 805, the processor 120 may determine that the state of the fingerprint corresponds to the first state. The processor 120 may determine that the fingerprint of the authenticated user of the electronic device 101 corresponds to the first state based on the first image and the reference image. Thereafter, the processor 120 may display the information guiding the second touch input through the display device 160 to change the first state of the fingerprint to the second state.

9 is a flowchart of an electronic device for displaying information guiding a second touch input according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Operations 901 to 909 of FIG. 9 may be related to operation 505 of FIG. 5.

Referring to FIG. 9, in operation 901, the processor 120 may display a graphic object (eg, a figure) including a first point and a second point as information guiding the second touch input. The first point and the second point may include different points located in the display device 160. The first point and the second point may include different points spaced apart by a minimum distance that may be distinguished by a user's touch input. The graphic object including the first point and the second point may have a shape for guiding a drag input of the user. For example, the graphic object may have various shapes (eg, star shape, circle shape, square shape, or triangle shape). The processor 120 may additionally display text (eg, “draw a star on the screen for fingerprint authentication”) for guiding the drag input through the display device 160.

According to an embodiment, referring to FIG. 10, the processor 120 may display a star-shaped figure 1001 based on detecting that the state of the fingerprint corresponds to the first state. The processor 120 may further display the text 1003 for guiding the drag input to improve the user's perception.

In operation 903, the processor 120 may detect a drag input including the first point and the second point. The processor 120 may detect a drag input through the TSP module 222. The drag input may include a first point and a second point.

According to an embodiment, referring to FIG. 10, the processor 120 may add an animation effect according to the detected drag input through the display device 160. For example, the processor 120 may further display a line 1005 that is displayed to overlap the star-shaped figure.

In operation 905, the processor 120 may determine whether a drag input is detected in the entire area where the figure is displayed. The processor 120 may receive information about all areas from which the drag input is detected from the TSP module 222. The processor 120 may determine whether an area in which the figure is displayed is included in an area in which the drag input is detected.

For example, when the region in which the figure is displayed includes all of the regions in which the drag input is detected, the processor 120 may determine that the drag input is detected along the region in which the figure is displayed. The processor 120 may perform operation 907 to detect a drag input corresponding to an area where the figure is displayed and to obtain a second image of the fingerprint changed to the second state.

For another example, when the region in which the figure is displayed does not include all of the regions in which the drag input is detected, the processor 120 may determine that the drag input is not detected along the region in which the figure is displayed. The processor 120 may maintain the display of the figure through the display device 160 until a drag input is detected in the entire region where the figure is displayed.

In operation 907, the processor 120 may acquire a second image of the fingerprint through the third point. The third point may correspond to an area in which the fingerprint sensor is located in the display device 160. The third point may correspond to an area different from the first point and the second point. The processor 120 may display information for guiding a fingerprint input on an area where the third point is located through the display device 160. The information guiding the fingerprint input may be an image including the shape of the fingerprint or the like. The information for guiding the fingerprint input may further include text for guiding the fingerprint input (eg, “Please enter a fingerprint” or “Raise a finger”). The processor 120 may acquire a second image of the fingerprint through the fingerprint sensor 224 corresponding to the third point. The second image may include an image of the fingerprint in which the state of the fingerprint is changed from the first state to the second state. The second image may be an image of a fingerprint in which a small valley 304 region located in the ridge 302 region in the fingerprint is filled with a material such as sweat or oil.

Although not shown, the processor 120 may display an interface for guiding a fingerprint input on an area corresponding to the first point or the second point. For example, the processor 120 may display information for guiding a fingerprint input on an area corresponding to the first point through the display device 160. Accordingly, the processor 120 may obtain the second image by only the drag input of the user input to the displayed figure.

In operation 909, the processor 120 may perform fingerprint authentication based on the obtained second image and the reference image. The processor 120 may compare the second image and the reference image based on an image matching technique. For example, when it is determined that the fingerprints match, the processor 120 may release the lock state of the electronic device 101 based on the fingerprint authentication result. For another example, when detecting a fingerprint mismatch, the processor 120 may maintain the lock state of the electronic device 101 and display the interface for guiding the fingerprint input again based on a fingerprint authentication result. .

11 illustrates an example of an operation of an electronic device displaying information guiding a second touch input according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Operations 1101 to 1109 of FIG. 11 may be related to operation 505 of FIG. 5.

Referring to FIG. 11, in operation 1101, the processor 120 may display a plurality of objects arranged in a grid through the display device 160. The plurality of objects arranged in the grid may have a shape of a circle, as shown in FIG. 12. In addition, although not shown, each of the plurality of objects arranged in the grid may include a star, a rectangle, a triangle, various shapes or images.

According to an embodiment, each of the plurality of objects arranged in the grid may have the same shape or different shapes from each other. For example, the processor 120 may display a plurality of circular objects 1201 to 1209 arranged in a grid, as shown in FIG. 12. According to another embodiment, although not shown, the processor 120 may display the objects of each of the plurality of objects arranged in the grid in different shapes. The order of at least some of the objects to which a touch is input among the plurality of objects arranged in the grid may be used as pattern information for unlocking. The processor 120 may store pattern information preset by an authenticated user through the memory 130.

In operation 1103, the processor 120 may detect a second touch input input to at least some objects through the TSP module 222. The processor 120 may store an order of at least some objects determined according to the second touch input as an input pattern.

According to an embodiment, referring to FIG. 12, the processor 120 may detect the trajectory 1210 of the second touch input. Accordingly, the processor 120 proceeds in the order of the object 1201, the object 1202, the object 1203, the object 1206, the object 1205, the object 1204, the object 1207, and the object 1208. The second touch input can be detected. The processor 120 may store the order of the objects corresponding to the trajectory 1210 of the second touch input as a pattern of the second touch input. According to another embodiment, the processor 120 may display an animation effect by displaying a line on the touch area corresponding to the trajectory 1210 of the second touch input through the display device 160. In addition, the processor 120 may provide animation effects to objects positioned on the trajectory 1210 of the second touch input among the plurality of objects arranged in the grid. The processor 120 may change the color of the objects for which the second touch input is detected or enlarge the size of the objects. For example, the processor 120 according to the progress of the trajectory 1210 of the second touch input, the object 1202, the object 1203, the object 1206, the object 1205, the object 1204, the object ( 1207, in order of the object 1208, the size of the object to which the touch is input may be enlarged or the color may be changed. Accordingly, the user may identify in real time an area where the touch input is received, based on the trajectory 1210 of the second touch input and the animation effect applied to the plurality of objects arranged in the grid.

In operation 1105, the processor 120 may determine whether the previously stored pattern and the pattern of the second touch input match. For example, when stored by an authenticated user and the pattern for unlocking the electronic device 101 and the pattern of the second touch input match, the processor 120 may display information guiding the fingerprint input. have.

For another example, when the pattern for unlocking the electronic device 101 and the pattern of the second touch input do not match, the processor 120 may display a plurality of objects arranged in the grid through the display device 160. You can continue to display. This is because the user of the second touch input may be different from the authenticated user when the pattern is inconsistent.

Although not shown, the processor 120 may display an interface for guiding the fingerprint input based on the matching of the pre-stored pattern and the pattern of the second touch input. Accordingly, the processor 120 may release the lock state based on the matching of the pattern information for unlocking the electronic device and the matching of the reference image and the second image, thereby further enhancing security.

In operation 1107, the processor 120 may acquire a second image through the fingerprint sensor 224. The second image may include an image of the fingerprint input through the fingerprint sensor 224 after the drag input. The fingerprint sensor 224 may acquire a second image of the fingerprint changed to the second state according to the drag input.

According to an embodiment of the present disclosure, the fingerprint sensor 224 may acquire a second image according to the fingerprint input based on the matching of the pre-stored pattern and the pattern of the second touch input. For example, if the previously stored pattern and the pattern of the second touch input do not match, the fingerprint sensor 224 may not generate the second image. For another example, the fingerprint sensor 224 is based on the matching of the pre-stored pattern and the pattern of the second touch input, the fingerprint sensor 224 is based on the difference between the intensity of the light having the path A and the light having the path B is reflected and received after the matching Based on the second image may be generated. For example, the fingerprint sensor 420 may receive the reflected light of the path A, and detect the light having the first value. The fingerprint sensor 420 may receive the reflected path B light and detect light having a second brightness. Through the image processing, the fingerprint sensor 420 may recognize that the value of the brightness of the first value corresponding to the light of the reflected path A is greater than the value of the second brightness corresponding to the light of the reflected path B. Since the reflected path B is partially absorbed into the floor area 431 of the fingerprint in contact with the window glass, the value of the second brightness may be smaller than the value of the first brightness. Accordingly, the fingerprint sensor 420 may receive the light of the path A reflected at the location corresponding to the valley area 432 of the fingerprint, and the path B of the path B reflected onto the location corresponding to the floor area 431 of the fingerprint. Can receive light. The fingerprint sensor 224 may acquire the image 310 corresponding to the second state of the fingerprint of FIG. 3A or the image 320 corresponding to the first state of the fingerprint shown in FIG. 3B by inverting the received light. have.

In operation 1109, the processor 120 may perform fingerprint authentication based on the obtained second image and the reference image. Operation 1109 may correspond to operation 909 of FIG. 9.

13 illustrates an example of an operation of an electronic device that displays information for guiding a second touch input according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Operation 1301 to operation 1307 of FIG. 13 may be related to operation 505 of FIG. 5.

Referring to FIG. 13, in operation 1301, the processor 120 may check information regarding an area where a touch input is received, before detecting the first touch input. The processor 120 may request information about an area related to the touch input received before the first touch input is input to the memory 130. For example, the processor 120 may determine that the state of the fingerprint corresponds to the first state based on the first image. The processor 120 may read information from the memory 130 regarding the region in which the touch input is received at the closest time based on the determination. As another example, the processor 120 may receive information related to an area of a touch input received within a predetermined time interval, having an area equal to or greater than a predetermined threshold value. As another example, the processor 120 may receive information about an area in which a touch input is received a predetermined number of times or more within a predetermined time interval. That is, the processor 120 may check information on an area related to a touch input within a predetermined time interval from a specific time (eg, a time when the state of the fingerprint is determined to correspond to the first state).

According to an embodiment, referring to FIG. 14A, the processor 120 may receive a user's touch input. For example, the user may contact the electronic device 101 with the ear of the user for a voice call. Accordingly, a touch input may occur between the side of the user's face and the display device 160 of the electronic device 101. The touch input may have an area of a predetermined size and may be received through at least a portion of the front or top of the display device 160. The at least some area may be represented by the original area 1410. The TSP module 222 may map information regarding the position and area of the received touch input to the time when the touch is input and transmit the information to the memory 130. For example, the TSP module 222 may provide information regarding the location and area (eg, the original area 1410) of the touch input received on the display device 160 at a time when the touch input is received (eg, 11 am). 10 minutes).

According to an embodiment, referring to FIG. 14B, the processor 120 may receive a user's touch input. For example, the processor 120 may display a virtual keyboard for inputting a user's text through the display device 160 at the bottom of the display device 160. The processor 120 may receive a plurality of touch inputs input on the virtual keyboard.

In operation 1303, the processor 120 may display information guiding the second touch input on the identified region. The identified area may correspond to an area where a touch input is detected within a short time. Thus, a material such as sweat or oil may be present in the display device 160 on the identified area. Accordingly, the processor 120 may display information guiding the second touch input on the identified area in order to change the state of the fingerprint from the first state to the second state. The information guiding the second touch input may include a figure including a first point and a second point, a plurality of objects arranged in a grid, and arrows indicating a specific direction.

According to an embodiment, referring to FIG. 14A, the processor 120 displays information for guiding the second touch input through the display device 160 based on information about the location, area, and time of the touch input. can do. According to an embodiment of the present disclosure, when the processor 120 detects that the state of the fingerprint corresponds to the first state, the processor 120 based on the information regarding the touch area having a large touch area received before the detection, Information for guiding a touch input may be displayed. For example, a star shape may be displayed on the display device 160 through the circle region 1410.

According to an embodiment, referring to FIG. 14B, the processor 120 may provide information for guiding the second touch input through the display device 160 based on information about the location, area, and time of the touch input. I can display it. For example, when the processor 120 detects that the state of the fingerprint corresponds to the first state, the processor 120 guides the second touch input based on the information about the region where the multi-touch occurs within a predetermined time interval from the detection time. Information to be displayed can be displayed. For example, the processor 120 may display a star-shaped figure through the display device 160 and through the rectangular area 1420.

According to an embodiment, referring to FIG. 14C, the processor 120 guides the second touch input through the display device 160 based on information about the location, area, and time of the touch input. Can be displayed. For example, when the processor 120 detects that the state of the fingerprint corresponds to the first state, the processor 120 identifies the touch input received through a predetermined size or more among touch inputs received within a predetermined interval from the detection time. can do. The processor 120 may identify a touch input corresponding to an area of a predetermined size or more by receiving information about a touch input previously received from the memory 130. The processor 120 may display information guiding the second touch input based on the identified touch input. For example, the processor 120 may receive information related to an area of the identified touch input from the memory 130. Based on this, the processor 120 may display a droplet shape on the area to guide the second touch input. The processor 120 may display text for guiding the second touch input (eg, “drop water droplets for fingerprint authentication”). According to an embodiment of the present disclosure, the processor 120 may display an effect corresponding to the second touch input through the display device 160. For example, the processor 120 may not partially display the droplet shape of the region in which the touch input is received, in response to the touch input received in the region including the droplet shape. Accordingly, the user may experience the effect of deleting at least a portion of the droplet shape located on the corresponding area according to the second touch input through the display device 160.

Although not shown, the processor 120 may display a plurality of objects arranged in a grid or arrows indicating a specific direction on the identified area.

In operation 1305, the processor 120 may acquire a second image through the fingerprint sensor 224. The fingerprint sensor 224 may receive a touch input for fingerprint recognition after the second touch input of the user. According to an embodiment of the present disclosure, the processor 120 may display information for guiding a fingerprint input changed to a second state by a user's second touch input. For example, the processor 120 may display an image related to a fingerprint on an area of the display device 160 corresponding to the position of the fingerprint sensor 224. The fingerprint sensor 224 may acquire an image of a fingerprint changed to a second state by the second touch input based on the touch input for fingerprint recognition. Operation 1305 may correspond to operation 1107 of FIG. 11.

In operation 1307, the processor 120 may perform fingerprint authentication based on the obtained second image and the reference image. Operation 1307 may correspond to operation 1109 of FIG. 11.

15 illustrates an example of an operation of an electronic device displaying information guiding a second touch input according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Operations 1501 through 1507 of FIG. 15 may be related to operation 505 of FIG. 5.

Referring to FIG. 15, in operation 1501, the processor 120 may detect a touch input having a predetermined pressure value or more. The processor 120 may receive a touch input through a predetermined area on a pressure sensor (not shown). The pressure sensor (not shown) may be located at the center of the bottom of the display device 160. The pressure sensor (not shown) may determine whether the received touch input is equal to or greater than a predetermined pressure value. Specifically, the pressure sensor (not shown) may acquire a specific pressure value of the touch input according to the magnitude of the change in the dielectric constant.

In operation 1503, the processor 120 may display an arrow from the bottom surface toward the center of the display device 160. When the processor 120 detects a touch input with a predetermined pressure value or more, the processor 120 may transmit a signal for controlling the display device 160 to be turned on. The processor 120 may display information for guiding the second touch input. The information may be an image related to an arrow indicating a specific direction. For example, the arrow may indicate that the arrow points toward the center of the display device 160 from the bottom surface of the four surfaces forming the outline of the display device 160. The processor 120 may additionally display text (eg, “drag” or “drag in the direction of the arrow”) for guiding the second touch input through the display device 160.

In operation 1505, the processor 120 may detect a second touch input. The user may provide a second touch input based on an arrow and / or text displayed through the display device 160. The second touch input may include a drag input.

In operation 1507, the processor 120 may determine whether the direction of the detected touch input coincides with the displayed arrow direction. The processor 120 may identify the direction of the second touch input based on the detected second touch input. For example, the processor 120 may identify the direction of the second touch input based on the difference between the coordinate at which the second touch input is applied and the coordinate at which the second touch input is released. The processor 120 may determine whether the detected direction of the second touch input coincides with the direction indicated by the arrow.

According to an embodiment of the present disclosure, the processor 120 may detect that the direction indicated by the arrow does not coincide with the direction of the second touch input. The processor 120 may maintain the display of the arrow through the display device 160 to receive a second touch input having a direction indicated by the arrow.

According to another embodiment, the processor 120 may detect coincidence between the direction of the second touch input and the direction indicated by the arrow. The processor 120 may display information for guiding a fingerprint input according to the match. According to an embodiment, referring to FIG. 16, the processor 120 may display an image and text guiding a fingerprint input. For example, the processor 120 may display text (eg, “fingerprint touch”) for guiding a fingerprint input. The processor 120 may display an interface (eg, a fingerprint shape or similar image) for guiding a fingerprint input.

In operation 1509, the processor 120 may acquire a second image through the fingerprint sensor 224. The fingerprint sensor 224 may receive a touch input for fingerprint recognition after the second touch input of the user through the fingerprint sensor 224. The second image may include an image of a fingerprint in which the state of the fingerprint is changed from the first state to the second state according to the second touch input. The processor 120 may display an interface (eg, a fingerprint or an image of a similar shape) that guides fingerprint input on an area of the display device 160 corresponding to the fingerprint sensor 224. The processor 120 may receive a touch for fingerprint input provided from a user according to the interface. In response to the touch for fingerprint input, the fingerprint sensor 224 may obtain an image of the fingerprint changed to the second state. Operation 1509 may correspond to operation 1107 of FIG. 11.

In operation 1511, the processor 120 may perform fingerprint authentication based on the obtained second image and the reference image. Operation 1511 may correspond to operation 1109 of FIG. 11.

17 illustrates an example of an operation of an electronic device that displays information for guiding a second touch input according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Operations 1701 to 1707 of FIG. 17 may be related to operation 505 of FIG. 5.

Referring to FIG. 17, in operation 1701, the processor 120 may identify a direction of a hand holding the electronic device 101 through the grip sensor 226. The grip sensor 226 may identify the direction of the hand holding the electronic device 101 by comparing the magnitude of the magnetic field change in the left direction and the magnitude of the magnetic field change in the right direction. The processor 120 may identify that the electronic device 101 is held by the user and the direction of the hand holding the electronic device 101 based on the data received from the grip sensor 226. For example, the grip sensor 226 may identify that the grip by the left hand when the magnitude of the left magnetic field change is greater than the magnitude of the right magnetic field change.

In operation 1703, the processor 120 may display information for guiding the second touch input based on the identified direction. The processor 120 may identify the direction of the hand holding the electronic device 101 based on the information received from the grip sensor 226. The processor 120 may adaptively display the information for guiding the second touch input according to the identified hand direction. For example, when the electronic device 101 is held by the user's left hand, the processor 120 may display an arrow pointing to the right through the display device 160. The arrow may indicate a direction from the left side to the center of the display unit 160 among the four surfaces forming the outline of the display device 160. For another example, when the electronic device 101 is gripped by the user's right hand, the processor 120 may display an arrow pointing to the left through the display device 160. The arrow may indicate a direction from the right side of the four surfaces forming the outline of the display device 160 toward the center of the display device 160. According to an embodiment of the present disclosure, the processor 120 may display text ("drag to the left", "drag to the right", or "Drag") together with the arrow to guide the second touch input. The processor 120 may receive a second touch input input by the arrow and / or text. For example, the processor 120 may detect the second touch input and determine whether the detected direction of the second touch input coincides with the direction indicated by the arrow. In detail, the processor 120 may identify the direction of the second touch input by identifying a start coordinate and a release coordinate of the drag input. When the direction of the identified second touch input coincides with the direction indicated by the arrow, the processor 120 may display an interface for guiding the fingerprint input.

According to an embodiment, referring to FIGS. 18A and 18B, the processor 120 displays an interface for guiding a fingerprint input on an area corresponding to the position of the fingerprint sensor 224 through the display device 160. can do. The electronic device 101 may include a plurality of fingerprint sensors, and the plurality of fingerprint sensors may be uniformly disposed in an area of the display device 160. Thus, the processor 120 may adaptively activate one of the plurality of fingerprint sensors.

For example, when the user grips the electronic device 101 with his left hand, the processor 120 may activate a fingerprint sensor located at the upper left of the display device 160. The processor 120 may display an interface for guiding a fingerprint input on the area of the fingerprint sensor positioned at the upper left side through the display device 160.

For another example, when the user grips the electronic device 101 with his right hand, the processor 120 may activate a fingerprint sensor located at the upper right side of the display device 160. The processor 120 may display an interface for guiding a fingerprint input on the area of the fingerprint sensor positioned at the upper right side through the display device 160. The interface for guiding the fingerprint input may be an image including the shape of the fingerprint and the like. Accordingly, when the user grips the electronic device 101 with his left hand, the user may input a fingerprint through a fingerprint sensor on a relatively close position instead of a fingerprint sensor on a relatively far bottom.

In operation 1705, the processor 120 may acquire a second image through the fingerprint sensor 224. The fingerprint sensor 224 may receive a touch input for fingerprint recognition after the second touch input of the user through the fingerprint sensor 224. The second image may include an image of a fingerprint in which the state of the fingerprint is changed from the first state to the second state according to the second touch input. According to an embodiment of the present disclosure, the processor 120 may receive the second image by activating a fingerprint sensor corresponding to a holding direction of the user's electronic device 101. For example, referring to FIG. 18A, the processor 120 activates the fingerprint sensor in the upper left side of the plurality of fingerprint sensors based on information indicating that the user grips the electronic device 101 with his left hand. 2 Images can be received. For another example, referring to FIG. 18B, the processor 120 activates a fingerprint sensor on the upper right side of the plurality of fingerprint sensors based on information indicating that the user has gripped the electronic device 101 with his right hand. The second image may be received. Operation 1705 may correspond to operation 1107 of FIG. 11. In operation 1707, the processor 120 may perform fingerprint authentication based on the obtained second image and the reference image. Operation 1707 may correspond to operation 1109 of FIG. 11.

19 is a flowchart illustrating an electronic device for displaying information guiding a first touch input according to various embodiments of the present disclosure. This operation may be performed by the processor 120 shown in FIG. 2.

Referring to FIG. 19, in operation 1901, the processor 120 may detect a user's touch input while the display is in an off state. The processor 120 may receive a touch input through the TSP module 222 regardless of the on / off state of the display device 160. The TSP module 222 may receive a user's touch input while the display device 160 displays the blank screen or the black screen. The TSP module 222 may receive a user's touch input, for example, while the display device 160 operates in the on state. The TSP module 222 may provide the processor 120 with information about the location of the received touch input on the display device 160 and the area of the received touch input. The processor 120 may execute an application or change the display of the display device 160 based on the information about the touch input provided from the TSP module 222.

The TSP module 222 may map information about a location and an area of the display device 160 where a user's touch is input to the time when the touch is input, and store the information in the memory 130. According to the user's touch input, a material such as sweat or oil may be present on the display device 160 at the location where the touch input is received.

In operation 1903, the processor 120 may determine whether the location of the detected touch input is included in the location of the plurality of fingerprint sensors. The processor 120 may determine whether a touch input has been received on an area corresponding to the location of at least one fingerprint sensor among the plurality of fingerprint sensors based on the information stored in the memory 130. For example, if the position of the detected touch input includes the position of at least one of the plurality of fingerprint sensors, the processor 120 may operate on the area where the fingerprint sensor is located while the display is in an off state. It may be determined that a touch input has occurred.

According to an embodiment, referring to FIGS. 20A and 20B, the processor 120 may detect a touch input received in the off state of the display device 160 through the TSP module 222. For example, the user may touch the area 2010 on the lower left side while the display device 160 operates in the off state. The area where the touch input is detected may be the same as the area where one fingerprint sensor of the plurality of fingerprint sensors is disposed. The processor 120 may determine that the region 2010 at the lower left where the touch input is detected is included in the positions 2010 to 2060 of the plurality of fingerprint sensor regions.

In another example, if the location of the detected touch input does not include the location of the plurality of fingerprint sensors, the processor 120 may not display the touch input in an area other than the area where the fingerprint sensor is located while the display is turned off. It can be determined that it has occurred. The processor 120 may, via the drag input, acquire a second touch through the display device 160 to acquire other materials, such as sweat or oil, which are present in a different area from the area where the fingerprint sensor is located. Information to guide the input can be displayed.

In operation 1905, the processor 120 may display information for guiding the fingerprint input at the position of the detected touch input. The processor 120 may identify one fingerprint sensor based on the detected position of the touch input. The identified fingerprint sensor may be a fingerprint sensor located in the area 2010 in the lower left corner. The processor 120 may display information for guiding a fingerprint input on an area 2010 on the lower left side of the identified fingerprint sensor. Information guiding the fingerprint input may include an image of a fingerprint or similar shape.

In operation 1907, the processor 120 may acquire a fingerprint image. The processor 120 may acquire a fingerprint image of the received touch input through the fingerprint sensor 224. The fingerprint image may correspond to a second state (eg, a state in which the fingerprint is not dry or a state in which oil is present in the fingerprint). When the user inputs a touch, the small valley area may acquire an oil present on the area where the fingerprint sensor is located. Thus, the obtained fingerprint may correspond to the second state. The processor 120 may improve the recognition rate of fingerprint recognition without displaying information for guiding a user's drag input.

In operation 1909, the processor 120 may perform fingerprint authentication based on the obtained fingerprint image and the reference image. Operation 1909 may correspond to operation 1707 of FIG. 17.

Meanwhile, in the detailed description of the present disclosure, specific embodiments have been described. However, various modifications may be possible without departing from the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by the equivalents of the claims.

Claims

In an electronic device,

Touch display;

A fingerprint sensor formed on at least a portion of the touch display;

Memory; And

A processor, wherein the processor,

Obtaining a first image of a fingerprint of a user associated with the first touch input using the fingerprint sensor, based on a first touch input of the at least some area detected through the touch display,

Confirming that the state of the fingerprint corresponds to a first state based on the obtained first image and a reference image for the fingerprint stored in the memory, and

Based on the confirmation, the electronic device is configured to display, on the touch display, information for guiding a second touch input for changing the state of the fingerprint from the first state to the second state.
The method according to claim 1,

The processor,

Through the touch display, receive a third touch input for the at least some area,

Based on the third touch input, obtain a second image of the fingerprint changed to the second state,

Based on the obtained second image and the reference image, determine a matching ratio of the second image to the reference image, and

And determine the user as an authenticated user when the matching rate satisfies a specified range.
The method according to claim 2,

The processor,

Displaying the graphic object including the first point and the second point for guiding a drag input from the first point to the second point of the touch display as the information,

Detecting the drag input from the first point to the second point through at least a portion of the touch display corresponding to the graphic object;

Receive the third touch input through the fingerprint sensor located at a third point inside the touch display,

Based on the third touch input, obtain the second image for the fingerprint, and

And determine the user as an authenticated user by comparing the second image and the reference image.
The method according to claim 2,

The processor,

Displaying, through the touch display, a graphic object for indicating a direction from one surface of the touch display to another surface facing the one surface as the information;

Via the touch display, detect the second touch input, and

The electronic device is further configured to check whether a movement direction of the second touch input coincides with a direction indicated by the displayed graphic object.
The method according to claim 4,

Further comprises at least one pressure sensor,

The processor,

Detecting, via the at least one pressure sensor, a touch input of at least a threshold value, and

Based on the detection, displaying the graphic object via the touch display,

Detect the second touch input,

And displaying another graphic object for acquiring the second image by checking whether the detected movement direction of the second touch input coincides with the direction indicated by the graphic object.

In response to a third touch input corresponding to the other graphical object displayed, acquire the second image using the fingerprint sensor, and

And determine the user as an authenticated user based on the obtained second image and the reference image.
The method according to claim 4,

Further comprises at least one grip sensor,

The processor,

Detecting, by the at least one grip sensor, the direction of the hand of the user holding the electronic device; and

The electronic device is configured to determine the one surface based on the direction of the hand.
The method according to claim 1,

The first image,

A first area corresponding to a Ridge area of the fingerprint, a first area having a first color, and a second area corresponding to a Valley area of the fingerprint, and having a second color;

The reference image is,

A third area corresponding to the floor area of the fingerprint, a third area having a first color, and a fourth area corresponding to a valley area of the fingerprint, and having a second color,

The processor,

Comparing the first image with the reference image, detecting that a first region having a first color in the first image is different from a third region having a first color in the reference image, and

And determine to determine that the state of the fingerprint corresponds to the first state based on the detection.
The method according to claim 7,

The processor,

By comparing the fourth area of the reference image and the second area of the first image, detecting that a match rate of the fourth area and the second area is greater than or equal to a first threshold value,

Comparing the third area of the reference image and the first area of the first image to detect that a match rate of the third area and the first area is greater than or equal to a second threshold value, and

And determine to determine that the state of the fingerprint corresponds to the first state based on the comparison of the first area to the fourth area.
In an electronic device,

Touch display;

A plurality of fingerprint sensors disposed on the bottom of the touch display;

Memory; And

A processor, wherein the processor,

Detect a touch input through the touch display,

Determine whether a position of the detected touch input is included in a position of at least one fingerprint sensor among the plurality of fingerprint sensors,

And based on the determination, display information guiding a fingerprint input at a position of the detected touch input.
In the operating method of the electronic device,

Acquiring a first image of a user's fingerprint associated with the first touch input using a fingerprint sensor, based on a first touch input of at least some area detected through the touch display;

Confirming that a state of the fingerprint corresponds to a first state based on the obtained first image and a reference image of the fingerprint stored in a memory;

Based on the confirmation, displaying on the touch display information for guiding a second touch input for changing the state of the fingerprint from the first state to the second state.
The method according to claim 10,

Obtaining a second image for the fingerprint changed to the second state based on a third touch input for the at least some area detected through the touch display.
The method according to claim 11,

Determining a matching ratio between the second image and the reference image based on the obtained second image and the reference image;

Determining the user as an authenticated user if the match rate satisfies a specified range.
The method of claim 11, wherein displaying information for guiding the second touch input through the touch display comprises:

Displaying a graphic object including the first point and the second point for guiding a drag input from the first point to the second point of the touch display as the information;

Detecting the drag input from the first point to the second point through an area of the touch display corresponding to the graphic object;

Receiving a touch input by the fingerprint through the fingerprint sensor located at a third point of the touch display;

Obtaining the second image for the fingerprint based on the touch input;

Determining the user as an authenticated user by comparing the second image and the reference image.
The method according to claim 10,

The first image,

A first area corresponding to a Ridge area of the fingerprint, a first area having a first color, and a second area corresponding to a Valley area of the fingerprint, and having a second color;

The reference image is,

A third area corresponding to the floor area of the fingerprint, a third area having a first color, and a fourth area corresponding to a valley area of the fingerprint, and having a second color,

Confirming that the state of the fingerprint corresponds to the first state,

Comparing the first image with the reference image to detect that a first region having a first color in the first image is different from a third region having a first color in the reference image;

Based on the detection, determining that the state of the fingerprint corresponds to the first state.
The method according to claim 14,

Confirming that the state of the fingerprint corresponds to the first state,

Comparing the fourth area with the second area of the first image to detect that a matching ratio between the fourth area and the second area is greater than or equal to a first threshold value;

Comparing the third area of the reference image with the first area of the first image to detect that a matching ratio between the third area and the first area is greater than or equal to a second threshold value;

And determining that a state of the fingerprint corresponds to the first state based on the comparison of the first area to the fourth area.