KR20200010542A - Electronic device and a method for controlling a biometric sensor associated with a display using the same - Google Patents

Abstract

Various embodiments of the present invention relate to a method for controlling a biometric sensor interlocked with a display, which may obtain a user input based on a first area corresponding to the biometric sensor and a second area corresponding to a touch sensor and adjacent to at least a partial area of the first area, confirm an input shape corresponding to the user input, and obtain biometric information corresponding to the user input through the control of the biometric sensor when the confirmed input shape satisfies a designated condition. Other embodiments are possible.

Description

ELECTRONIC DEVICE AND A METHOD FOR CONTROLLING A BIOMETRIC SENSOR ASSOCIATED WITH A DISPLAY USING THE SAME}

Various embodiments of the present disclosure are directed to a method of controlling a biometric sensor linked to a display of an electronic device.

As the use of portable electronic devices is diversified, there is a growing interest in security functions of portable electronic devices. The portable electronic device may be set to release the lock function based on a password or a pattern. Recently, a portable electronic device may have a built-in biometric sensor (eg, a fingerprint sensor, an iris sensor, etc.), and may be configured to release a lock function by utilizing the biometric sensor. As security concerns grow, various security methods based on raw sensors that are difficult to replicate can be utilized.

The portable electronic device includes a fingerprint sensor, which is one of the raw sensor, and recognizes a user's fingerprint through the fingerprint sensor. The portable electronic device may perform user authentication by using a fingerprint sensor.

In the portable electronic device, the role of the display is becoming important, and the size of the display is gradually increasing. Accordingly, it may be considered that a biometric sensor (for example, a fingerprint sensor) provided separately from the display in the portable electronic device is embedded in the portable electronic device. The portable electronic device may include a fingerprint sensor and set a portion of the display area of the display as a fingerprint sensing area for recognizing a fingerprint. The portable electronic device may include a fingerprint sensor corresponding to the fingerprint sensing area as a component constituting the display. The fingerprint sensor may operate in conjunction with the display. For example, a fingerprint sensor may be embedded in a portion of the display, and a fingerprint recognition region may be formed based on the embedded fingerprint sensor. The portable electronic device may recognize a user's fingerprint input corresponding to the fingerprint recognition area and perform user authentication.

As a fingerprint recognition area is formed in a portion of the display, the portable electronic device may have difficulty detecting a user's fingerprint input in an area other than the fingerprint recognition area.

According to various embodiments of the present disclosure, a fingerprint input error has occurred with respect to a fingerprint of a user input in an area other than the fingerprint recognition area, and an object of the present invention is to provide a guide to a user to correctly input a fingerprint.

An electronic device according to various embodiments of the present disclosure may include a biometric sensor; A processor; A display panel including a first sensor corresponding to the biometric sensor and a touch sensor including a second region formed at least partially adjacent to at least a portion of the first region; And one or more control circuits capable of controlling the touch sensor, wherein the processor is configured to obtain an input of a user based on the first area and the second area, and to determine an input shape corresponding to the input of the user. When the checked input shape satisfies a specified condition, the biometric information corresponding to the user input may be acquired through the control of the biometric sensor.

According to various embodiments of the present disclosure, a method of controlling a biometric sensor interlocked with a display may include a first region corresponding to the biometric sensor and a second region corresponding to a touch sensor and adjacent to at least a portion of the first region. Obtaining a user input based on the result; Checking an input shape corresponding to the input of the user; Acquiring biometric information corresponding to the user's input through control of the biometric sensor when the identified input shape satisfies a specified condition; It may include.

According to various embodiments of the present disclosure, a partial area may be determined as a fingerprint sensing area on a display of an electronic device, and a user's fingerprint may be recognized based on the fingerprint sensing area. According to various embodiments of the present disclosure, a fingerprint recognition area for recognizing a user's fingerprint and a fingerprint error area adjacent to the fingerprint recognition area may be formed, and the user's fingerprint may be recognized based on the fingerprint recognition area and the fingerprint error area. have. According to various embodiments of the present disclosure, when a user input is detected in the fingerprint error region, a fingerprint input error may be informed. Various embodiments of the present invention may guide the fingerprint recognition area so that the user can conveniently authenticate the user on the display. Various embodiments of the present invention can increase user convenience for fingerprint sensor based user authentication.

1 illustrates an electronic device in a network environment according to various embodiments of the present disclosure.
2 is a block diagram of an electronic device according to various embodiments of the present disclosure.
3 is a block diagram of a program module according to various embodiments of the present disclosure.
4 is a diagram illustrating a structure in which a display is disposed on a front surface of an electronic device according to various embodiments of the present disclosure.
5 is a diagram illustrating a structure in which a fingerprint sensor is embedded in a display of an electronic device according to various embodiments of the present disclosure.
6A through 6B are block diagrams illustrating components of an electronic device according to various embodiments of the present disclosure.
7 illustrates a structure of main components of an electronic device according to various embodiments of the present disclosure.
8 is a flowchart illustrating an operation of main components when a fingerprint input is detected while the display is turned off according to various embodiments of the present disclosure.
9 is a flowchart illustrating an operation of detecting a fingerprint input based on a touch input while the display is turned on according to various embodiments of the present disclosure.
10 is a flowchart illustrating an operation of detecting a fingerprint input based on touch pressure in a state where a display is turned on according to various embodiments of the present disclosure.
11 is a flowchart illustrating a method of recognizing a fingerprint using a fingerprint sensor linked to a display according to various embodiments of the present disclosure.
12 is a diagram illustrating a fingerprint recognition region formed corresponding to a portion of a display according to various embodiments of the present disclosure.
13 is a diagram illustrating a process of detecting a user input based on a fingerprint recognition area according to various embodiments of the present disclosure.
14 illustrates a process of recognizing a user fingerprint according to various embodiments of the present disclosure.
15 illustrates a fingerprint recognition area and a fingerprint error area according to various embodiments of the present disclosure.
16 illustrates a process of recognizing a fingerprint based on a fingerprint recognition area and a fingerprint error area according to various embodiments of the present disclosure.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. However, this is not intended to limit the techniques described in this document to specific embodiments, but should be understood to cover various modifications, equivalents, and / or alternatives to the embodiments of this document. . In connection with the description of the drawings, similar reference numerals may be used for similar components.

In this document, expressions such as "have," "may have," "include," or "may include" include the presence of a corresponding feature (e.g., numerical, functional, operational, or component such as a component). Does not exclude the presence of additional features.

In this document, expressions such as "A or B," "at least one of A or / and B," or "one or more of A or / and B" may include all possible combinations of items listed together. . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) both of cases including at least one A and at least one B.

Expressions such as "first," "second," "first," or "second," as used herein, may modify various components, regardless of order and / or importance, and may form a component. It is used to distinguish it from other components and does not limit the components. For example, the first user device and the second user device may represent different user devices regardless of the order or importance. For example, without departing from the scope of rights described in this document, a first component may be named a second component, and similarly, the second component may be renamed to a first component.

One component (such as a first component) is "(functionally or communicatively) coupled with / to" to another component (such as a second component) or " When referred to as "connected to," it is to be understood that any component may be directly connected to the other component or may be connected through another component (e.g., a third component). On the other hand, when a component (e.g., a first component) is said to be "directly connected" or "directly connected" to another component (e.g., a second component), the component and the It may be understood that no other component (eg, a third component) exists between the other components.

The expression "configured to" used in this document is, for example, "having the capacity to," "suitable for," " , "" Designed to, "" adapted to, "" made to, "or" capable of. " The term "configured to" may not necessarily mean only "specifically designed to" in hardware. Instead, in some situations, the expression “device configured to” may mean that the device “can” along with other devices or components. For example, the phrase “processor configured (or configured to) perform A, B, and C” may be executed by executing a dedicated processor (eg, an embedded processor) to perform the operation, or one or more software programs stored in a memory device. It may mean a general-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

The terminology used herein is for the purpose of describing particular embodiments only and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art. Among the terms used in this document, terms defined in the general dictionary may be interpreted to have the same or similar meaning as the meaning in the context of the related art, and ideally or excessively formal meanings are not clearly defined in this document. Not interpreted as In some cases, even if terms are defined in the specification, they may not be interpreted to exclude embodiments of the present disclosure.

An electronic device according to various embodiments of the present disclosure may include, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, and an e-book reader. , Desktop personal computer, laptop personal computer, netbook computer, workstation, server, personal digital assistant, portable multimedia player, MP3 player, mobile It may include at least one of a medical device, a camera, or a wearable device. According to various embodiments, wearable devices may be accessory (eg, watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs)), textiles, or clothing integral pieces ( For example, it may include at least one of an electronic garment, a body attachment type (eg, a skin pad or a tattoo), or a living implantable type (eg, an implantable circuit).

In some embodiments, the electronic device may be a home appliance. Home appliances are, for example, televisions, digital video disk (DVD) players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air purifiers, set-top boxes, home automation controls Panel (home automation control panel), security control panel, TV box (e.g. Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ), game console (e.g. Xbox ^TM , PlayStation ^TM ), electronic dictionary It may include at least one of an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include a variety of medical devices (e.g., various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Such as computed tomography (CT), imaging or ultrasound), navigation devices, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), automotive infotainment ) Devices, ship's electronic equipment (e.g. ship's navigation system, gyro compass, etc.), avionics, security devices, vehicle head units, industrial or home robots, automatic teller's machines (financial institutions) Point of sales (POS) in stores, or Internet of things (e.g. light bulbs, sensors, electricity or gas meters, sprinkler devices, fire alarms, thermostats, street lights, Of the emitter (toaster), exercise equipment, hot water tank, a heater, boiler, etc.) may include at least one.

According to some embodiments, an electronic device may be a piece of furniture or a building / structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, Water, electricity, gas, or radio wave measuring instrument). In various embodiments, the electronic device may be one or a combination of the above-described various devices. An electronic device according to an embodiment may be a flexible electronic device. In addition, the electronic device according to an embodiment of the present disclosure is not limited to the above-described devices, and may include a new electronic device according to technology development.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.

1 illustrates an electronic device in a network environment according to various embodiments of the present disclosure.

Referring to FIG. 1, the electronic device 101, 102, 104, or server 106 may be connected to each other through a network 162 or short-range communication 164.

Referring to FIG. 1, in various embodiments, an electronic device 101 in a network environment 100 is described. The electronic device 101 may include a bus 110, a processor 120, a memory 130, an input / output interface 150, a display 160, and a communication interface 170. In some embodiments, the electronic device 101 may omit at least one of the components or additionally include other components. The bus 110 may include circuitry that connects the components 110-170 to each other and transfers communication (eg, control messages or data) between the components. The processor 120 may include one or more of a central processing unit, an application processor, or a communication processor (CP). The processor 120 may execute, for example, an operation or data processing related to control and / or communication of at least one other component of the electronic device 101.

The memory 130 may include volatile and / or nonvolatile memory. The memory 130 may store, for example, commands or data related to at least one other element of the electronic device 101. According to an embodiment of the present disclosure, the memory 130 may store software and / or a program 140. The program 140 may include, for example, a kernel 141, middleware 143, an application programming interface (API) 145, an application program (or “application”) 147, or the like. . At least a portion of kernel 141, middleware 143, or API 145 may be referred to as an operating system. The kernel 141 may be, for example, system resources used to execute an action or function implemented in other programs (eg, middleware 143, API 145, or application program 147) (eg, The bus 110, the processor 120, or the memory 130 may be controlled or managed. In addition, the kernel 141 may provide an interface for controlling or managing system resources by accessing individual components of the electronic device 101 from the middleware 143, the API 145, or the application program 147. Can be.

The middleware 143 may serve as an intermediary for allowing the API 145 or the application program 147 to communicate with the kernel 141 to exchange data. In addition, the middleware 143 may process one or more work requests received from the application program 147 according to priority. For example, the middleware 143 may use system resources (eg, the bus 110, the processor 120, or the memory 130, etc.) of the electronic device 101 for at least one of the application programs 147. Prioritize and process the one or more work requests. The API 145 is an interface for the application 147 to control functions provided by the kernel 141 or the middleware 143. For example, the API 145 may include at least the following: file control, window control, image processing, or character control. It can contain one interface or function (eg command). The input / output interface 150 may transmit, for example, a command or data input from a user or another external device to other component (s) of the electronic device 101, or other components of the electronic device 101 ( Commands or data received from the device) can be output to the user or other external device.

Display 160 may be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper display. It may include. The display 160 may display, for example, various types of content (eg, text, images, videos, icons, and / or symbols) to the user. The display 160 may include a touch screen and, for example, may receive a touch, gesture, proximity, or hovering input using an electronic pen or a part of a user's body.

The communication interface 170 may, for example, establish communication between the electronic device 101 and an external device (eg, the first external electronic device 102, the second external electronic device 104, or the server 106). Can be. For example, the communication interface 170 may be connected to the network 162 through wireless or wired communication to communicate with an external device (eg, the second external electronic device 104 or the server 106).

The wireless communication may be, for example, LTE, LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), or global network (GSM). Cellular communication using at least one of the System for Mobile Communications, and the like. According to one embodiment, the wireless communication is, for example, wireless fidelity (WiFi), light fidelity (LiFi), Bluetooth, Bluetooth low power (BLE), ZigBee (as illustrated by near field communication 164 of FIG. 1). Zigbee), near field communication (NFC), magnetic secure transmission (Magnetic Secure Transmission), radio frequency (RF), or a body area network (BAN). According to an embodiment, the wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter referred to as "Beidou"), or a Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". Wired communication may include, for example, at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard232 (RS-232), power line communication, or a plain old telephone service (POTS). have. The network 162 may comprise a telecommunications network, for example, at least one of a computer network (eg, LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 102 and 104 may be a device of the same or different type as the electronic device 101. According to various embodiments of the present disclosure, all or part of operations executed in the electronic device 101 may be executed in another or a plurality of electronic devices (for example, the electronic devices 102 and 104 or the server 106). According to this, when the electronic device 101 needs to perform a function or service automatically or by request, the electronic device 101 may instead execute or execute the function or service by itself, or at least some function associated therewith. May be requested to another device (eg, the electronic devices 102 and 104 or the server 106.) The other electronic device (eg, the electronic devices 102 and 104 or the server 106) may request the requested function or The additional function may be executed and the result may be transferred to the electronic device 101. The electronic device 101 may provide the requested function or service by processing the received result as it is or additionally. For Cloud computing, distributed computing, or client-server computing techniques can be used.

2 is a block diagram of an electronic device 201 according to various embodiments of the present disclosure. The electronic device 201 may include, for example, all or part of the electronic device 101 illustrated in FIG. 1. The electronic device 201 may include one or more processors (eg, an AP) 210, a communication module 220, a subscriber identification module 224, a memory 230, a sensor module 240, an input device 250, and a display ( 260, an interface 270, an audio module 280, a camera module 291, a power management module 295, a battery 296, an indicator 297, and a motor 298. The processor 210 may control, for example, a plurality of hardware or software components connected to the processor 210 by running an operating system or an application program, and may perform various data processing and operations. The processor 210 may be implemented with, for example, a system on chip (SoC). According to an embodiment, the processor 210 may further include a graphic processing unit (GPU) and / or an image signal processor. The processor 210 may include at least some of the components illustrated in FIG. 2 (eg, the cellular module 221). The processor 210 may load and process instructions or data received from at least one of other components (eg, nonvolatile memory) into the volatile memory, and store the result data in the nonvolatile memory.

It may have the same or similar configuration as the communication module 220 (eg, the communication interface 170 of FIG. 1). The communication module 220 may include, for example, a cellular module 221, a WiFi module 223, a Bluetooth module 225, a GNSS module 227, an NFC module 228, and an RF module 229. have. The cellular module 221 may provide, for example, a voice call, a video call, a text service, or an internet service through a communication network. According to an embodiment of the present disclosure, the cellular module 221 may perform identification and authentication of the electronic device 201 in a communication network using a subscriber identification module (eg, a SIM card) 224. According to an embodiment, the cellular module 221 may perform at least some of the functions that the processor 210 may provide. According to an embodiment, the cellular module 221 may include a communication processor (CP). According to some embodiments, at least some (eg, two or more) of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 may be one integrated chip. (IC) or in an IC package. The RF module 229 may transmit / receive a communication signal (for example, an RF signal), for example. The RF module 229 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna, or the like. According to another embodiment, at least one of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 may transmit and receive an RF signal through a separate RF module. Can be. Subscriber identification module 224 may include, for example, a card or embedded SIM that includes a subscriber identification module, and may include unique identification information (such as an integrated circuit card identifier (ICCID)) or subscriber information (such as IMSI). (international mobile subscriber identity)).

The memory 230 (eg, the memory 130 of FIG. 1) may include, for example, an internal memory 232 or an external memory 234. The internal memory 232 may include, for example, volatile memory (for example, DRAM, SRAM, or SDRAM), nonvolatile memory (for example, one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM). The flash memory may include at least one of a flash memory, a hard drive, or a solid state drive (SSD) The external memory 234 may be a flash drive, for example, a compact flash (CF) or a secure digital (SD). ), Micro-SD, Mini-SD, extreme digital (xD), multi-media card (MMC) or memory stick, etc. The external memory 234 may be functionally connected with the electronic device 201 through various interfaces. Or physically connected.

The sensor module 240 may measure, for example, a physical quantity or detect an operation state of the electronic device 201 and convert the measured or detected information into an electrical signal. The sensor module 240 includes, for example, a gesture sensor 240A, a gyro sensor 240B, an air pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, and a proximity sensor ( 240G), color sensor 240H (e.g., RGB (red, green, blue) sensor), biometric sensor 240I, temperature / humidity sensor 240J, illuminance sensor 240K, UV (ultra violet) It may include at least one of the sensor 240M or the fingerprint print sensor 240N. Additionally or alternatively, the sensor module 240 may comprise, for example, an e-nose sensor, an electromyography (EMG) sensor, an electrocardiogram (EEG) sensor, an electrocardiogram (ECG) sensor, It may include an infrared (IR) sensor and / or an iris sensor. The sensor module 240 may further include a control circuit for controlling at least one or more sensors belonging therein. In some embodiments, the electronic device 201 further includes a processor configured to control the sensor module 240 as part of or separately from the processor 210, while the processor 210 is in a sleep state. The sensor module 240 may be controlled.

The input device 250 may include, for example, a touch panel 252, a (digital) pen sensor 254, a key 256, or an ultrasonic input device 258. The touch panel 252 may use at least one of capacitive, resistive, infrared, or ultrasonic methods, for example. In addition, the touch panel 252 may further include a control circuit. The touch panel 252 may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor 254 may be, for example, part of a touch panel or may include a separate recognition sheet. The key 256 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 258 may detect the ultrasonic waves generated by the input tool through a microphone (for example, the microphone 288) and check data corresponding to the detected ultrasonic waves.

Display 260 (eg, display 160 of FIG. 1) may include panel 262, hologram device 264, projector 266, and / or control circuitry to control them. The panel 262 may be implemented to be, for example, flexible, transparent, or wearable. The panel 262 may be configured with the touch panel 252 and one or more modules. According to one embodiment, panel 262 may include a pressure sensor (or force sensor) capable of measuring the strength of the pressure on the user's touch. The pressure sensor may be integrally implemented with the touch panel 252 or one or more sensors separate from the touch panel 252. The hologram device 264 may show a stereoscopic image in the air by using interference of light. The projector 266 may display an image by projecting light onto a screen. For example, the screen may be located inside or outside the electronic device 201. According to an embodiment, the display 260 may include a fingerprint sensor 240N for recognizing a user's fingerprint. The display 260 may include a fingerprint sensor 240N corresponding to a portion of the panel 262. The display 260 may set a partial area of the display 260 as a fingerprint sensing area and recognize a user's fingerprint based on the fingerprint sensing area. The fingerprint sensor 240N may be integrated with the touch panel 252 or may be implemented with one or more sensors separate from the touch panel 252.

The interface 270 may include, for example, an HDMI 272, a USB 274, an optical interface 276, or a D-subminiature 278. The interface 270 may be included in, for example, the communication interface 170 illustrated in FIG. 1. Additionally or alternatively, interface 270 may include, for example, a mobile high-definition link (MHL) interface, an SD card / multi-media card (MMC) interface, or an infrared data association (IrDA) compliant interface. have.

The audio module 280 may bidirectionally convert, for example, a sound and an electrical signal. At least some components of the audio module 280 may be included in, for example, the input / output interface 150 illustrated in FIG. 1. The audio module 280 may process sound information input or output through, for example, a speaker 282, a receiver 284, an earphone 286, a microphone 288, or the like. The camera module 291 is, for example, a device capable of capturing still images and moving images. According to an embodiment, the camera module 291 may include one or more image sensors (eg, a front sensor or a rear sensor), a lens, and an image signal processor (ISP). , Or flash (eg, LED or xenon lamp, etc.). The power management module 295 may manage power of the electronic device 201, for example. According to an embodiment, the power management module 295 may include a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge. The PMIC may have a wired and / or wireless charging scheme. The wireless charging scheme may include, for example, a magnetic resonance scheme, a magnetic induction scheme, or an electromagnetic wave scheme, and may further include additional circuits for wireless charging, such as a coil loop, a resonance circuit, a rectifier, and the like. have. The battery gauge may measure, for example, the remaining amount of the battery 296, the voltage, the current, or the temperature during charging. The battery 296 may include, for example, a rechargeable cell and / or a solar cell.

The indicator 297 may display a specific state of the electronic device 201 or a part thereof (for example, the processor 210), for example, a booting state, a message state, or a charging state. The motor 298 may convert electrical signals into mechanical vibrations, and may generate vibrations or haptic effects. The electronic device 201 may be, for example, a mobile TV supporting device capable of processing media data according to a standard such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo ^™ . : GPU). Each of the components described in this document may be composed of one or more components, and the names of the corresponding components may vary depending on the type of electronic device. In various embodiments, the electronic device (eg, the electronic device 201) may include some components, omit additional components, or combine some of the components to form a single entity. The functions of the previous corresponding components may be performed in the same manner.

3 is a block diagram of a program module according to various embodiments of the present disclosure. According to an embodiment of the present disclosure, the program module 310 (eg, the program 140) may include an operating system and / or various applications running on the operating system for controlling resources related to the electronic device (eg, the electronic device 101). For example, the application program 147 may be included. The operating system may include, for example, Android ^™ , iOS ^™ , Windows ^™ , Symbian ^™ , Tizen ^™ , or Bada ^™ . Referring to FIG. 3, the program module 310 may include a kernel 320 (eg, kernel 141), middleware 330 (eg, middleware 143), and API 360 (eg, API 145). , And / or the application 370 (eg, the application program 147). At least a part of the program module 310 may be preloaded on the electronic device or may be downloaded from an external electronic device (eg, the electronic devices 102 and 104, the server 106, etc.).

The kernel 320 may include, for example, a system resource manager 321 and / or a device driver 323. The system resource manager 321 may perform control, allocation, or retrieval of system resources. According to an embodiment, the system resource manager 321 may include a process manager, a memory manager, or a file system manager. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication (IPC) driver. . The middleware 330 may provide various functions through the API 360, for example, to provide functions commonly required by the application 370, or to allow the application 370 to use limited system resources inside the electronic device. May be provided to the application 370. According to an embodiment, the middleware 330 may include a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, and a database manager ( 346, a package manager 347, a connectivity manager 348, a notification manager 349, a location manager 350, a graphic manager 351, or a security manager 352.

The runtime library 335 may include, for example, a library module that the compiler uses to add new functionality through the programming language while the application 370 is running. The runtime library 335 may perform input / output management, memory management, or arithmetic function processing. The application manager 341 may manage, for example, the life cycle of the application 370. The window manager 342 may manage GUI resources used on the screen. The multimedia manager 343 may identify a format necessary for playing the media files, and may encode or decode the media file using a codec suitable for the format. The resource manager 344 may manage space of source code or memory of the application 370. The power manager 345 may manage, for example, the capacity, temperature, or power of the battery, and determine or provide power information necessary for the operation of the electronic device using the corresponding information. According to an embodiment of the present disclosure, the power manager 345 may interwork with a basic input / output system (BIOS). The database manager 346 may create, retrieve, or change a database to be used, for example, in the application 370. The package manager 347 may manage installation or update of an application distributed in the form of a package file.

The connectivity manager 348 may manage, for example, a wireless connection. The notification manager 349 may provide the user with events such as, for example, an arrival message, an appointment, a proximity notification, and the like. The location manager 350 may manage location information of the electronic device, for example. The graphic manager 351 may manage, for example, graphic effects to be provided to the user or a user interface related thereto. The security manager 352 may provide system security or user authentication, for example. According to an embodiment of the present disclosure, the middleware 330 may include a telephony manager for managing a voice or video call function of the electronic device or a middleware module capable of forming a combination of the functions of the above-described components. . According to an embodiment, the middleware 330 may provide a module specialized for each type of operating system. The middleware 330 may dynamically delete some of the existing components or add new components. The API 360 is, for example, a set of API programming functions, which may be provided in different configurations depending on the operating system. For example, Android or iOS can provide one API set for each platform, and Tizen can provide two or more API sets for each platform.

The application 370 may be, for example, a home 371, a dialer 372, an SMS / MMS 373, an instant message (IM) 374, a browser 375, a camera 376, an alarm 377. , Contacts 378, voice dials 379, emails 380, calendars 381, media players 382, albums 383, watches 384, health care (e.g., measures exercise or blood sugar) Or an application for providing environmental information (eg, barometric pressure, humidity, or temperature information). According to an embodiment of the present disclosure, the application 370 may include an information exchange application capable of supporting information exchange between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for delivering specific information to the external electronic device, or a device management application for managing the external electronic device. For example, the notification delivery application may deliver notification information generated by another application of the electronic device to the external electronic device, or receive notification information from the external electronic device and provide the notification information to the user. The device management application may, for example, turn on / turn-off of the function of an external electronic device (eg, the external electronic device itself (or some component)) in communication with the electronic device or the brightness (or resolution) of the display. Control), or install, delete, or update an application running on the external electronic device. According to an embodiment of the present disclosure, the application 370 may include an application (eg, a health care application of a mobile medical device) designated according to an attribute of the external electronic device. According to an embodiment of the present disclosure, the application 370 may include an application received from an external electronic device. At least a part of the program module 310 may be implemented (eg, executed) in software, firmware, hardware (eg, the processor 210), or a combination of at least two or more thereof, and a module for performing one or more functions; It can include a program, routine, instruction set, or process.

4 is a diagram illustrating a structure in which a display is disposed on a front surface of an electronic device according to various embodiments of the present disclosure.

In the electronic device 400 (eg, the electronic device 101 of FIG. 1) according to various embodiments, a display 410 (eg, the display 160 of FIG. 1) is disposed on a front surface of the electronic device 400, and the display 410 is provided. The fingerprint sensor 420 (eg, the biometric sensor 240I of FIG. 2) may be built in correspondence to a partial area of the. The display 410 may include a fingerprint sensor 420 based on some areas.

The electronic device 400 according to various embodiments of the present disclosure may have a front portion configured as a display 410, and the fingerprint sensor 420 may be configured to be embedded in a lower surface of the display 410. According to various embodiments of the present disclosure, the electronic device 400 includes a fingerprint sensor 420 on at least a portion of the display 410, and forms an area occupied by the fingerprint sensor 420 as a part of the display 410 to display a size of the display. Can be extended.

5 is a diagram illustrating a structure in which a fingerprint sensor is embedded in a display of an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 5, the fingerprint sensor 580 is mounted to correspond to at least a portion of the display on the front of the electronic device. The electronic device may include a glass 510, a touch sensor 530 (eg, a touch sensing sensor), a display panel 540 (eg, the panel 262 of FIG. 2), and a biometric sensor 580 (eg, the living body of FIG. 2). Sensor 240I or fingerprint sensor 240N) and PCB 590. The glass 510 of the electronic device may be adhered to the touch sensor 530 or the display panel 540 through the adhesive 520. In addition, the electronic device may further include structures 550-1 and 550-2 to secure a space for mounting the fingerprint sensor 580. The structures 550-1 and 550-2 may form at least part of a sealing structure for protecting the fingerprint sensor 580.

According to various embodiments, the touch sensor 530 may be formed in a partial region (eg, one region or a plurality of regions) of the display or the entire region of the display.

According to various embodiments, the touch sensor 530 may include at least one surface of the display panel 540 (eg, a separate layer 530 on one surface of the display, or a surface on which pixels 541 to 543 of the display panel are formed). And a user's touch input. According to various embodiments, the fingerprint sensor 580 may be formed on another side (eg, back) of the display panel 540. The touch sensor 530 and the fingerprint sensor 580 may include, for example, an optical image sensor, an ultrasonic transmission / reception module, or an electrostatic transmission / reception electrode pattern.

According to various embodiments, the touch sensor 530 may be disposed between the adhesive 520 and the display panel 540 or between the glass 510 and the adhesive layer 520. The touch sensor 530 may be formed of an electrostatic transmission / reception electrode pattern, and may be formed of a transparent electrode to increase transmittance of light output from the display panel 540.

According to various embodiments, in the electronic device, the fingerprint sensor 580 may be disposed on another surface (for example, a rear surface) of the display panel 540. Between the fingerprint sensor 580 and the display panel 540 is an elastic body (570-1, 570-2) (e.g., sponge or rubber) to prevent the shock between the fingerprint sensor 580 and the display panel 540 or foreign matter inflow Etc.) may be formed. According to various embodiments, the fingerprint sensor 580 may include an image sensor. For example, the image sensor of the fingerprint sensor 580 may include light (eg, visible light, infrared light, or ultraviolet light) emitted from a light source (eg, the display panel 340 or an infrared ray (IR) LED) on the user's fingerprint. You can detect the reflected light coming back. The fingerprint sensor 580 may recognize the fingerprint of the user based on the light reflected on the fingerprint of the user.

6A through 6B are block diagrams illustrating components of an electronic device according to various embodiments of the present disclosure.

6A is an example of an electronic device 600 (eg, the electronic device 101 of FIG. 1) according to various embodiments of the present disclosure. According to an embodiment, the electronic device 600 may include at least one processor (for example, the first processor 610 and the second processor 620), the memory 630, the display module 640, and the at least one sensor. 650).

The first processor 610 may control the overall operation of the electronic device 600. The second processor 620 (eg, a low power processor, or sensor HUB) does not wake up the first processor 610 when the electronic device is in a sleep state (eg, a lock mode, a state in which the display is inactive). The sensor information acquired through at least one sensor 650 or an input obtained from a user may be processed. According to an embodiment, the second processor 620 may independently control the biometric sensor 651, the touch sensor 652, or the display module 640.

According to various embodiments of the present disclosure, the electronic device 600 may include a memory 630, and the memory 630 may store security sensitive information such as a general area for storing a user application, or information for fingerprint sensing. It may include a security zone for.

According to various embodiments of the present disclosure, the display module 640 may control the display panel 642 including a plurality of pixels and at least some of the plurality of pixels included in the display panel 642 to provide display information. It may include a set display driving module (eg, display driver ic (DDI) 641).

According to various embodiments, at least one sensor 650 may be a biometric sensor 651 (eg, a fingerprint sensor) for detecting a user's fingerprint through the display module 640 for the display module 640, or a user's fingerprint. It may include a touch sensor 652 for detecting a touch. According to various embodiments, the biometric sensor 651 may include an optical fingerprint sensor (eg, an image sensor) that uses light output from the display module 640 as a light source. According to various embodiments, the biometric sensor 651 may use an additional light source (eg, an IR LED light source (not shown)) as a light source in addition to the light output by the display module.

According to various embodiments, at least one sensor 650 may drive a plurality of pixels included in the display panel 642 through a display driving module (DDI) 641 in response to a user input. At least one sensor 650 may control the display panel 642 as necessary. For example, the biometric sensor 651 may use the light emitted from the display panel 642 by controlling the display panel 642 to acquire biometric information (eg, fingerprint information) of the user.

6B is another example of an electronic device 600 according to various embodiments of the present disclosure. According to an embodiment of the present disclosure, the electronic device 600 may include a plurality of control units (for example, the first control unit 612, the second control unit 622, the third control unit 643, the fourth control unit 653, or the fifth control unit). 660). For example, the first control unit 612 may be included in the first processor 610, and the second control unit 622 may be included in the second processor 620. The third controller 643 may be included in the display driving module (DDI) 641 of the display module 640. The fourth controller 653 may be included in the biometric sensor 651 of the sensor 650. According to various embodiments, the electronic device 600 may control the first processor 610 using the first control unit 612, and control the second processor 620 using the second control unit 622. can do. The electronic device 600 may control the display driving module 641 using the third control unit 643, and control the biometric sensor 651 using the fourth control unit 653.

According to various embodiments of the present disclosure, the electronic device 600 may include a plurality of controllers (eg, the first controller 612, the second controller 622, and the first controller) by using a main controller (eg, the fifth controller 660). The third control unit 643 or the fourth control unit 653 can be controlled. In addition, the electronic device 600 may designate a main controller and control other controllers by the designated main controller. For example, the electronic device 600 may change / designate the main controller from the fifth controller 660 that is the main controller to the first controller 612. The electronic device 600 may control other controllers using the changed / designated main controller.

According to various embodiments, the electronic device 600 may directly control the modules of the electronic device 600 by using one controller. For example, the electronic device 600 may include the second processor 620, the memory 630, the display module 640, and / or the first controller 612 included in the first processor 610. At least one sensor 650 may be controlled. According to various embodiments, one controller may control the display module 640 and at least one sensor 650. For example, in the case of an optical fingerprint sensor using the display module 640 as a light source, the display module 640 and the at least one sensor 650 may be controlled by one controller, and the user's biometric information (eg : Fingerprint information) can be obtained easily.

An electronic device according to various embodiments of the present disclosure may include a biometric sensor; A processor; A display panel including a touch sensor including a first area corresponding to the biosensor, and including a second area formed at least partially adjacent to at least a part of the first area; And one or more control circuits capable of controlling the touch sensor, wherein the processor is configured to obtain an input of a user based on the first area and the second area, and to determine an input shape corresponding to the input of the user. When the checked input shape satisfies a specified condition, the biometric information corresponding to the user input may be acquired through the control of the biometric sensor.

According to various embodiments of the present disclosure, the processor may be set to satisfy the specified condition when the identified input shape is detected in the first area and not in the second area.

According to various embodiments of the present disclosure, the processor may be set to satisfy the specified condition when the identified input shape is detected in the first area and detected in at least some of the second areas. .

According to various embodiments of the present disclosure, the processor may be configured to recognize the user's input as a touch input to the first area or the second area when the shape satisfies another specified condition.

According to various embodiments of the present disclosure, the processor may be configured to ignore the user input in a low power state.

According to various embodiments of the present disclosure, the processor may be configured to, when the acquired user's input corresponds to a set pattern or shape in a low power state, or when the strength of pressure corresponding to the user's input exceeds a set pressure strength. It can be set to activate the display panel.

According to various embodiments of the present disclosure, the processor may be configured to, when the acquired user's input corresponds to a set pattern or shape in a low power state, or when the strength of pressure corresponding to the user's input exceeds a set pressure strength. It can be set to activate the biometric sensor.

According to various embodiments of the present disclosure, the processor may be configured to deactivate the biometric sensor when a user input is obtained through a part of the second area that is not set.

According to various embodiments of the present disclosure, the processor may be configured to display a notification message or to control and guide the display panel so that the user input satisfies the specified condition.

According to various embodiments of the present disclosure, the processor may be configured to control the biometric sensor to emit a light source corresponding to the user's input, and obtain biometric information reflected from the user's input.

According to various embodiments of the present disclosure, the light source for emitting light may be a light source in which luminance, green value, and red value are adjusted.

According to various embodiments of the present disclosure, the processor may be configured to compare the obtained biometric information with biometric information stored in a memory and authenticate a user based on the comparison result.

7 illustrates a structure of main components of an electronic device according to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, the fingerprint may be recognized in a high bright mode (HBM) mode in which a brightness of the display is variably adjusted in order to recognize the fingerprint of the user. According to various embodiments of the present disclosure, the electronic device (eg, the electronic device 600 of FIG. 6) detects a user's touch input through a touch screen panel (TSP) (eg, a display panel), and touches the touch input. If the set condition is satisfied, the HBM mode can be activated. According to various embodiments of the present disclosure, the electronic device 600 receives a pressure corresponding to a user's touch input through a force sensor, activates an HBM mode or activates a fingerprint sensor when the pressure satisfies a set condition. It can be activated.

7 is a diagram briefly illustrating components corresponding to a display of an electronic device. Referring to FIG. 7, a display (eg, the display module 640 of FIG. 6) of the electronic device 600 may include a glass 704, a touch screen panel (TSP) 706 disposed under the glass 704, Or a fingerprint sensor (FPS) 722 (eg, the biometric sensor 651 of FIGS. 6A and 6B). The electronic device 600 may detect fingerprint information corresponding to the touch input 702 of the user through a high brightness mode (HBM) mode through some light sources 700 of the display. According to an embodiment of the present disclosure, a fingerprint recognition area 700 having a size larger than that of the fingerprint sensor 722 may be formed in the electronic device 600, and the fingerprint information of the user is based on the fingerprint recognition area 700. It can be detected. For example, the electronic device 600 may temporarily emit bright light based on the fingerprint recognition area 700 in the HBM mode. The electronic device 600 may control the brightness of the light by dividing the area emitting the light in the HBM mode into the first area and the second area according to the brightness and the brightness of the light.

According to various embodiments, the electronic device 600 may emit light by setting at least one of luminance, red, green, and blue values higher in the HBM mode. For example, when the user's touch is recognized, light with a higher Green value may be emitted. The electronic device 600 may set a high power consumption in the HBM mode to emit light of a portion of the display corresponding to the fingerprint recognition area 700. The emitted light may be reflected by the user's fingerprint and transmitted to the fingerprint sensor 722 of the electronic device 600. The reflected light (reflected light) may include fingerprint information of the user. The electronic device 600 may acquire the reflected light through the fingerprint sensor 722, and may acquire an image corresponding to the fingerprint of the user using the reflected light. The electronic device 600 may obtain the information about the fingerprint of the user by analyzing the image.

According to various embodiments of the present disclosure, the electronic device 600 may include pressure sensors 734-1 and 734-2, and may control the pressure 732 generated through the pressure sensors 734-1 and 734-2. When the pressure 732 meets a predetermined criterion, the HBM mode may be activated. The electronic device 600 measures the intensity of the pressure 732 corresponding to the touch input of the user. When the intensity of the pressure 732 meets a preset criterion, the electronic device 600 activates the HBM mode and applies the touch input of the user. A corresponding user fingerprint can be obtained.

According to various embodiments of the present disclosure, when a user's touch input is detected, the electronic device 600 may perform filtering to determine whether the user's touch input is a touch input not intended by the user. If it is determined that the user's touch input is a normal touch input, the electronic device 600 may activate the HBM mode by controlling the brightness or power of the display. The electronic device 600 may acquire a fingerprint of the user corresponding to the touch input of the user in the HBM mode, and perform a user authentication function based on the obtained fingerprint.

8 is a flowchart illustrating an operation of main components when a fingerprint input is detected while the display is turned off according to various embodiments of the present disclosure.

Referring to FIG. 8, the operation of each major component corresponding to the operation of activating the HBM mode with the display turned off is shown. The main components shown in FIG. 8 may include a touch screen panel (TSP) 810, an application processor (AP) 820, a display drive module (DDI) 830, or a fingerprint sensor (FPS) 840. Can be.

In operation 801, the AP 820 may be in a sleep state (eg, an inactive state). In operation 803, the fingerprint sensor (FPS) 840 may also be in an inactive state. The electronic device may be in a turned off state. In operation 805, the electronic device may detect a user's touch input through the TSP 810. The electronic device may activate the AP 820 and the FPS 840 when the user's touch input satisfies a preset condition. For example, when a user's touch input coincides with a preset touch pattern or input shape or when a pressure greater than a preset pressure intensity occurs, the electronic device may activate the AP 820 and the FPS 840. . In operation 809, the electronic device may activate the AP 820, and in operation 807, the electronic device may activate the FPS 840.

If the AP 820 is activated in operation 809, the AP 820 may activate the display by controlling the DDI 830 in operation 811. The electronic device can turn on the display. If the FPS 840 is activated in operation 807, the electronic device may enter the FPS low power mode in operation 813.

In operation 815, the electronic device may control the DDI 830 to activate the HBM mode, and in operation 817, the electronic device may change the FPS 840 from the low power mode to the active mode. According to various embodiments, the electronic device may acquire fingerprint information of the user corresponding to the touch input of the user in the HBM mode, and perform a user authentication function based on the fingerprint information. In operation 819, the electronic device may capture fingerprint information of the user corresponding to the touch input of the user through the FPS 840. After capturing the fingerprint information of the user, in operation 823, the electronic device may control the DDI 830 to deactivate the HBM mode. According to various embodiments of the present disclosure, even when the user's touch input is released in operation 821, the electronic device may control the DDI 830 in operation 823 to deactivate the HBM mode.

In operation 825, the electronic device may compare the captured user's fingerprint information with the fingerprint information stored in the memory and inform the user of the comparison result. For example, if the fingerprint information matches each other, in operation 827, the electronic device may display a set user interface (UI). If the fingerprint information does not match with each other, the electronic device may provide an authentication error message to the user. According to various embodiments of the present disclosure, as the user authentication is completed, the electronic device may release a lock function of the electronic device or perform a function of a set application.

9 is a flowchart illustrating an operation of detecting a fingerprint input based on a touch input while the display is turned on according to various embodiments of the present disclosure.

Referring to FIG. 9, since the display is turned on, the AP 820 of FIG. 8 may remain activated and the AP 820 may be omitted.

In operation 901, the electronic device may control the DDI 830 to maintain the display turned on. In operation 903, the FPS 903 may be in an inactive state. In operation 905, the electronic device may detect a user's touch input through the TSP 810. For example, the electronic device may check an input shape corresponding to the detected user's touch input and determine whether the input shape matches the set input shape. If the input shape matches the preset input shape, the electronic device may activate the FPS 840 in operation 907. In operation 909, the electronic device may activate the FPS low power mode.

In operation 911, the electronic device may activate the HBM mode by controlling the DDI 830, and in operation 913, the electronic device may change the FPS 840 from the low power mode to the activation mode. According to various embodiments of the present disclosure, the electronic device may acquire fingerprint information of the user corresponding to the touch input of the user in the HBM mode. In operation 915, the electronic device may capture fingerprint information of the user corresponding to the touch input of the user through the FPS 840. After capturing the fingerprint information of the user, in operation 917, the electronic device may control the DDI 830 to deactivate the HBM mode. According to various embodiments, even when the user's touch input is released in operation 919, the electronic device may control the DDI 830 in operation 917 to deactivate the HBM mode.

In operation 921, the electronic device may compare the captured fingerprint information of the user with the fingerprint information stored in the memory, and inform the user of the comparison result. For example, if the fingerprint information matches each other, in operation 923, the electronic device may display the set user interface. If the fingerprint information does not match with each other, the electronic device may provide an authentication error message to the user.

10 is a flowchart illustrating an operation of detecting a fingerprint input based on touch pressure in a state where a display is turned on according to various embodiments of the present disclosure.

Referring to FIG. 10, the TSP 810 shown in FIG. 9 is omitted, and the pressure sensor 850 is shown. FIG. 10 may measure the strength of a pressure corresponding to a user's touch input based on the pressure sensor 850, and activate the HBM mode when the strength of the pressure satisfies a preset condition.

Operations 1001 and 1003 correspond to operations 901 and 903 of FIG. 9. In operation 1005, the electronic device may measure the pressure intensity of the user touch input using the pressure sensor 850. When the measured pressure intensity exceeds a preset pressure intensity value (when a predetermined condition is satisfied), the electronic device may activate the FPS 840 in operation 1007.

Operation 1007 to operation 1017 correspond to operation 907 to operation 917 of FIG. 9. In operation 1019, the electronic device may use the pressure sensor 850 to determine whether the pressure intensity of the user touch input is less than a preset pressure intensity value. If the pressure strength is smaller than the preset pressure strength value, the electronic device may deactivate the HBM mode in operation 1017. According to various embodiments of the present disclosure, the electronic device may determine whether to activate the HBM mode in response to the pressure strength of the user touch input.

In operation 1021, the electronic device may compare the fingerprint information of the user captured in operation 1015 with the fingerprint information stored in the memory, and inform the user of the comparison result. For example, if the fingerprint information matches each other, in operation 1023, the electronic device may display the set user interface. If the fingerprint information does not match with each other, the electronic device may provide an authentication error message to the user.

According to various embodiments of the present disclosure, the electronic device measures an intensity of a pressure corresponding to a user's touch input through the pressure sensor 850, and activates or prints the HBM mode when the intensity of the pressure exceeds a preset pressure intensity value. The sensor can be activated. According to various embodiments of the present disclosure, the pressure sensor 850 may detect pressure in an always on state, or the pressure sensor may be activated by a TSP 810 (not shown), and the strength of the pressure corresponding to the user input may be determined. Can be measured.

11 is a flowchart illustrating a method of recognizing a fingerprint using a fingerprint sensor linked to a display according to various embodiments of the present disclosure.

In operation 1101, the processor (eg, the first processor 610 or the second processor 620 of FIG. 6A) of the electronic device (eg, the electronic device 600 of FIG. 6A) detects a touch input by the user, or The pressure intensity corresponding to the touch input may be measured. For example, the electronic device 600 may detect a touch pattern, a touch position, or an input shape corresponding to the touch input. The input shape may be a specific shape corresponding to a user's touch input. Hereinafter, although the electronic device 600 is described as being controlled by the first processor 610, the electronic device is controlled by the second processor 620 in a low power mode (eg, a lock mode, a sleep mode, or a display inactive mode). 600 may be controlled.

In operation 1103, the electronic device 600 (eg, the first processor 610 or the second processor 620) determines whether the touch input is a false touch input (eg, a touch input not intended by the user). You can check. For example, the electronic device 600 may determine and form a fingerprint recognition area for recognizing a user's fingerprint on a partial area of the display (for example, the display module 640). The processor of the electronic device 600 (for example, the first processor 610, the second processor 620, and the processor will be described as the first processor 610) may be a user's touch based on the formed fingerprint recognition area. You can check whether the input is an invalid touch input. In addition, the first processor 610 of the electronic device 600 may determine and form a fingerprint error area corresponding to a partial area of the display to determine that a user's touch input is wrong. The first processor 610 may determine a fingerprint error area based on the fingerprint recognition area. The first processor 610 may identify that a user's touch input is wrong based on the formed fingerprint error area. The fingerprint recognition area and the fingerprint error area may be formed adjacent to each other, and the first processor 610 may determine that a user's touch input outside the fingerprint error area is a wrong touch input. If it is determined that the user's touch input is a wrong touch input, the first processor 610 may perform another function in operation 1115. For example, the first processor 610 may provide a notification message for notifying that the touch input is wrong. The notification message may include a pop-up message, a voice message, a beep sound, a change in brightness, a vibration, and the like. For example, when the touch input is incorrect, the electronic device 600 may perform a general touch function, a UI control, a function control, or the like corresponding to an application without performing a fingerprint recognition operation. According to an embodiment of the present disclosure, the electronic device may check the direction, pressure, or position of the touch in operation 1101 in order to determine whether the user touch input is a touch input not intended by the user.

If the user's touch input is a correct touch input (eg, a touch input for fingerprint recognition) in operation 1103, the electronic device 600 (eg, (eg, the first processor 610 or the second processor 620)) in operation 1105, the HBM. A high bright mode can be activated. For example, the first processor 610 may activate the HBM mode based on the fingerprint recognition area. The first processor 610 may acquire a fingerprint of the user in the activated HBM mode. The first processor 610 may adjust the brightness of a portion of the display in the HBM mode or control the display to emit light based on Green or Red values. According to an embodiment of the present disclosure, the electronic device may increase the luminance of a portion of the display or control the applied power to be high in the HBM mode. The first processor 610 may obtain a fingerprint of the user by adjusting the light source.

In operation 1107, the first processor 610 may acquire a user's touch input based on the fingerprint recognition area, and may obtain a user's fingerprint corresponding to the user's touch input. In operation 1109, the first processor 610 may perform a fingerprint authentication function based on the obtained user fingerprint. For example, the first processor 610 may acquire a user fingerprint in a state in which fingerprint information of the user is stored in a memory (for example, the memory 630 of FIG. 6A). The first processor 610 may perform a fingerprint authentication function by comparing the obtained user fingerprint with fingerprint information stored in the memory 630. After performing the fingerprint authentication function, in operation 1111, the first processor 610 may deactivate the HBM mode.

According to another embodiment, in operation 1113, the first processor 610 may determine whether the user's touch input is released (ended). For example, when the touch input is released, the first processor 610 may deactivate the activated HBM mode in operation 1111. When the touch input is not released, the first processor 610 may perform a fingerprint authentication function by acquiring a fingerprint of the user while the HBM mode is activated.

According to various embodiments, the operation illustrated in FIG. 11 may be controlled by the second processor 620 in the low power mode (eg, the lock mode, the sleep mode, or the display inactive mode).

12 is a diagram illustrating a fingerprint recognition region formed corresponding to a portion of a display according to various embodiments of the present disclosure.

12 illustrates a display 1210 of an electronic device. Referring to FIG. 12, the electronic device 600 may include a fingerprint print sensor (FPS) 1230 in response to a portion of the display 1210 (eg, 410 of FIG. 4). The fingerprint sensor 1230 may be disposed at the lower end of the display 1210. The fingerprint sensor 1230 may be provided in a rectangular shape according to the vertical length 1230-1 and the horizontal length 1230-2, but is not limited thereto. When the HBM mode is activated, the electronic device 600 may form a fingerprint recognition area (HBM area) 1220 (eg, 420 of FIG. 4) based on the fingerprint sensor 1230. The fingerprint recognition area 1220 may be formed adjacent to the fingerprint sensor 1230 based on the size of the fingerprint sensor 1230, and may be larger than the fingerprint sensor 1230. For example, the fingerprint recognition area 1220 may be formed of horizontal lengths 1220-1 and 1220-2 that are 1 to 2 mm larger than the fingerprint sensor 1230. The fingerprint recognition area 1220 may be an area where the electronic device 600 can detect a user's touch input. Referring to FIG. 12, the fingerprint recognition area 1220 may be formed in a rectangular shape along the vertical length 1220-1 and the horizontal length 1220-2, but is not limited thereto.

13 is a diagram illustrating a process of detecting a user input based on a fingerprint recognition area according to various embodiments of the present disclosure.

Referring to FIG. 13, the electronic device may include a fingerprint sensor 1320 corresponding to a portion of the display 1310, and detect a user's touch input 1305 based on the fingerprint sensor. The electronic device may determine the fingerprint recognition area 1303 based on the user's touch input 1305. An electronic device according to various embodiments may variably change a fingerprint recognition area based on a user's touch input. For example, the electronic device may variably set the fingerprint recognition area 1303 corresponding to the touch input 1305 of the user, and the fingerprint recognition area 1303 may be configured to correspond to the change of the user's touch input 1305. You can control it to change.

14 illustrates a process of recognizing a user fingerprint according to various embodiments of the present disclosure.

Referring to FIG. 14, the electronic device 600 receives a user's touch input 1403 based on a panel (eg, the panel 642 of FIG. 6A) of the display module (eg, the display module 640 of FIG. 6A). It can be detected. For example, the electronic device 600 may include points 1410-1, 1410-2, 1410-3, and 1410-5 that detect a user's touch input on the panel, and a point 1410 where the user's touch input is not detected. The user's touch input 1403 may be checked based on the number of times (4, 1410-6). The electronic device 600 according to various embodiments of the present disclosure may set a partial area of the display as the fingerprint recognition area 1401 in response to the identified user's touch input 1403. The electronic device 600 may obtain an image corresponding to the user's fingerprint for the user's touch input 1403 from the fingerprint sensor 1420 in response to the set fingerprint recognition area 1401. The electronic device 600 according to various embodiments of the present disclosure may identify a user fingerprint by comparing the acquired image with fingerprint information stored in a memory.

According to an embodiment of the present invention, when activating a high bright mode (HBM) mode, which is a mode for variably adjusting the brightness of a display, the electronic device 600 may be an area (eg, a fingerprint recognition area) 1401 that is an HBM object. ) Can be determined. For example, an area 1401 as an HBM object may be brightened in the display, and the remaining area may be darker than an area 1401 as an HBM object. According to an embodiment of the present invention, the processing for the region 1401 as the HBM target is not limited to the HBM, and the processing for the region 1401 as the HBM target is performed based on various factors such as color, brightness, and power supply. can do.

15 illustrates a fingerprint recognition area and a fingerprint error area according to various embodiments of the present disclosure.

Referring to FIG. 15, the electronic device may include a fingerprint sensor 1530 corresponding to a portion of the display 1510 and may determine a fingerprint recognition area 1530 based on the fingerprint sensor 1530. The electronic device may form the fingerprint error area 1540 in the outer area based on the fingerprint recognition area 1530. The electronic device according to various embodiments of the present disclosure may determine a false touch (eg, an invalid touch input, an abnormal touch input generated by touching a body part other than the user's finger) based on the fingerprint error area 1540. The electronic device according to various embodiments may emit a light source for fingerprint sensing in response to the fingerprint recognition area 1530.

According to various embodiments of the present disclosure, a fingerprint error region (eg, a false touch prevention guide region) 1540 may be formed adjacent to the outside of the fingerprint recognition region 1530. According to various embodiments of the present disclosure, when a user's touch input occurs in response to the fingerprint error area 1540, the electronic device may determine the touch input as an abnormal touch input and may not perform a fingerprint sensing function. The electronic device may not perform a fingerprint sensing function or may not activate the fingerprint sensor 1530. An electronic device according to various embodiments of the present disclosure may determine whether a user's touch input is normal based on a set angle, position, direction, and shape.

16 illustrates a process of recognizing a fingerprint based on a fingerprint recognition area and a fingerprint error area according to various embodiments of the present disclosure.

Referring to FIG. 16, the electronic device is based on a fingerprint recognition area 1530 and a fingerprint error area (for example, a false touch prevention guide area) 1540, and a touch input that is not intended by the user is a false touch. Can be determined. For example, when the first touch input 1610 of the user occurs through a portion of the fingerprint error area 1540, the electronic device does not correspond to a touch input not intended by the user, and the user authentication is performed. Function can be performed. On the other hand, when the second touch input 1620 of the user occurs through a portion of the fingerprint error area 1540, the electronic device determines the user's touch input as a touch input not intended by the user, and determines the user authentication function. May not be performed. The electronic device may determine that the user is not an unintentional touch input only in the case of a user touch input through the lower portion of the fingerprint error area 1540. The electronic device may determine that the touch input is a normal touch input when a touch does not occur in response to the fingerprint error region 1540 and a touch input corresponding to the fingerprint recognition region 1530 occurs.

The electronic device according to various embodiments of the present disclosure may determine the fingerprint error area 1540 corresponding to the fingerprint recognition area 1530, and may include a portion (eg, an upper part, a lower part, a left part, and a right part) of the fingerprint error area 1540. Part, etc.) may be excluded from the fingerprint error area 1540.

According to various embodiments of the present disclosure, the electronic device may determine whether the user's touch input is an unintended touch input based on the fingerprint recognition area 1530 and the fingerprint error area 1540, and the user's touch input is the user's touch input. Is not an unintended touch input, the user authentication function may be performed based on the fingerprint of the user corresponding to the touch input of the user.

According to various embodiments of the present disclosure, a method of controlling a biometric sensor interlocked with a display may include a first region corresponding to the biometric sensor and a second region corresponding to a touch sensor and adjacent to at least a portion of the first region. Acquires a user's input based on the input, checks an input shape corresponding to the user's input, and if the identified input shape satisfies a specified condition, the biometric information corresponding to the user's input through the control of the biometric sensor; Can be obtained.

According to various embodiments of the present disclosure, the method may further include: when the identified input shape is detected in the first area and not detected in the second area, satisfying the specified condition; It may further include.

According to various embodiments of the present disclosure, the method may further include: satisfying the specified condition when the identified input shape is detected in a first area and detected in at least some of the second areas; It may further include.

According to various embodiments of the present disclosure, when the form satisfies another specified condition, recognizing the user's input as a touch input to the first area or the second area; It may further include.

According to various embodiments of the present disclosure, in the low power state, the display panel is activated when the acquired user input corresponds to a set pattern or shape, or when the strength of the pressure corresponding to the user input exceeds the set pressure strength. To act; It may further include.

According to various embodiments of the present disclosure, the biosensor is activated when the acquired user input corresponds to a set pattern or shape in a low power state, or when the intensity of pressure corresponding to the user input exceeds a set pressure strength. To act; It may further include.

According to various embodiments of the present disclosure, the method may further include: deactivating the biometric sensor when a user input is obtained through a part of the second area that is not set; It may further include.

According to various embodiments of the present disclosure, the method may further include: displaying a notification message or controlling and guiding the display panel so that the user input satisfies the specified condition; It may further include.

According to various embodiments of the present disclosure, the operation of acquiring the biometric information may include controlling the biometric sensor to emit a light source corresponding to the user's input, and obtaining biometric information reflected from the user's input. It may include.

According to various embodiments of the present disclosure, the method may further include: comparing the obtained biometric information with biometric information stored in a memory, and authenticating a user based on the comparison result; It may further include.

As used herein, the term "module" includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, components, or circuits. The module may be an integrally formed part or a minimum unit or part of performing one or more functions. "Modules" may be implemented mechanically or electronically, for example, known or future developed application-specific integrated circuit (ASIC) chips, field-programmable gate arrays (FPGAs), or performing certain operations. It may include a programmable logic device. At least a portion of an apparatus (eg, modules or functions thereof) or method (eg, operations) according to various embodiments may be stored on a computer-readable storage medium (eg, memory 330) in the form of a program module. It can be implemented as. When the instruction is executed by a processor (eg, the processor 320), the processor may perform a function corresponding to the instruction. Computer-readable recording media include hard disks, floppy disks, magnetic media (e.g. magnetic tape), optical recording media (e.g. CD-ROM, DVD, magnetic-optical media (e.g. floppy disks), internal memory, etc. Instructions may include code generated by a compiler or code executable by an interpreter Modules or program modules according to various embodiments may include at least one or more of the above-described components. In some embodiments, operations performed by a module, a program module, or another component may be executed sequentially, in parallel, repeatedly, or heuristically, or at least, or may include other components. Some operations may be executed in a different order, omitted, or other operations may be added.

400: electronic device 410: display
420: fingerprint recognition area
600: electronic device 610: first processor
620: second processor 630: memory
640: display module
641 display driving module (DDI, display driver ic)
642 panel 650 sensor
651: biometric sensor 652: fingerprint sensor

Claims (20)

In a portable communication device,
Touch sensors;
A display including a plurality of pixels and displaying a guide of a fingerprint sensing area for obtaining fingerprint information;
An optical fingerprint sensor disposed below the fingerprint sensing region, wherein the optical fingerprint sensor is an external object emitted from at least one pixel corresponding to the fingerprint sensing region among the plurality of pixels and adjacent to or in contact with the fingerprint sensing region Obtain fingerprint information corresponding to the external object using the light reflected by;
A pressure sensor for measuring an intensity of pressure corresponding to a touch input to the display of the external object; And
At least one processor, wherein the at least one processor,
Emit light through the at least one pixel corresponding to the fingerprint sensing region based at least on determining that the intensity of the pressure satisfies a specified intensity, and
And use the optical fingerprint sensor to obtain fingerprint information corresponding to the external object based at least in part on the light emitted by the external object proximate the fingerprint sensing area. The processor of claim 1, wherein the at least one processor comprises:
And in connection with the obtaining of the fingerprint information, control the display such that light corresponding to a specified color is emitted through the at least one pixel. The processor of claim 1, wherein the at least one processor comprises:
And in connection with the emission of the light, adjust a brightness of an area corresponding to the at least one pixel higher than a brightness of another area. The processor of claim 1, wherein the at least one processor comprises:
And in connection with the emission of the light, adjust the voltage supplied to the at least one pixel higher than before the emission to perform the emitting operation of the light. The processor of claim 1, wherein the at least one processor comprises:
And at least based on the determination that the touch input is released, to stop the emission of the light. The processor of claim 1, wherein the at least one processor comprises:
And to stop the emission of the light based at least on another determination that the intensity of the pressure does not satisfy the specified intensity. The processor of claim 1, wherein the at least one processor comprises:
Detecting the touch input using the touch sensor, and
And based on the determination that the touch input sensed using the touch sensor satisfies a specified condition, the portable communication device configured to perform the emitting operation of the light. The processor of claim 1, wherein the at least one processor comprises:
And switch the optical fingerprint sensor from an inactive state to an active state based at least on the determination that the strength of the pressure satisfies the specified intensity. In a portable communication device,
A display including a plurality of pixels and displaying a guide of a fingerprint sensing area for obtaining fingerprint information;
An optical fingerprint sensor disposed below the fingerprint sensing region, wherein the optical fingerprint sensor is emitted from at least one pixel corresponding to the fingerprint sensing region of the plurality of pixels and is adjacent to or in contact with the fingerprint sensing region Obtain fingerprint information corresponding to the external object using the light reflected by the object;
A pressure sensor for measuring an intensity of pressure corresponding to an input to the display of the external object; And
At least one processor, wherein the at least one processor,
Checking the strength of the pressure corresponding to the input,
Emit light through the at least one pixel corresponding to the fingerprint sensing region based at least on determining that the intensity of the pressure satisfies a specified intensity, and
And use the optical fingerprint sensor to obtain fingerprint information corresponding to the external object based at least in part on the light emitted by the external object proximate the fingerprint sensing area. The processor of claim 9, wherein the at least one processor comprises:
And in connection with the obtaining of the fingerprint information, control the display such that light corresponding to a specified color is emitted through the at least one pixel. The processor of claim 9, wherein the at least one processor comprises:
And in connection with the emission of the light, adjust a brightness of an area corresponding to the at least one pixel higher than a brightness of another area. The processor of claim 9, wherein the at least one processor comprises:
And in connection with the emission of the light, adjust the voltage supplied to the display higher than before the emission to perform the emitting operation of the light. The processor of claim 9, wherein the at least one processor comprises:
And to stop the emission of the light based at least on the determination that the intensity of the pressure does not satisfy the specified intensity. The method of claim 9,
The at least one processor comprises a low power processor and an application processor,
The low power processor,
The application processor performs the verification of the input in an inactive state, and
And in response to the confirmation of the input, transition the application processor from an inactive state to an active state. The method of claim 14, wherein the application processor,
And in the activated state, perform the emission of the light and the acquisition of the fingerprint information. 10. The method of claim 9, further comprising a touch sensor for sensing the input,
The processor,
Detecting a touch input corresponding to the input using the touch sensor, and
And emit the light based on the determination that the touch input sensed by the touch sensor satisfies a specified condition. The portable communication device of claim 9, wherein the pressure sensor is disposed adjacent the optical fingerprint sensor and a periphery. In a portable communication device,
A display including a plurality of pixels and displaying a guide of a fingerprint sensing area for obtaining fingerprint information;
A pressure sensor capable of sensing a pressure corresponding to an input to the display; And
An optical fingerprint sensor disposed below the fingerprint sensing region,
The optical fingerprint sensor may be generated by an external object that is emitted from at least one pixel corresponding to the fingerprint sensing area among the plurality of pixels when the sensed pressure satisfies a specified intensity and is adjacent to or in contact with the fingerprint sensing area. And receive the reflected light to obtain fingerprint information corresponding to the external object. 19. The system of claim 18, further comprising at least one processor, wherein the at least one processor comprises:
And in connection with the obtaining of the fingerprint information, a brightness of an area corresponding to the at least one pixel is adjusted to be higher than a brightness of another area. 19. The method of claim 18, further comprising a touch sensor for sensing the input,
And the pressure sensor is configured to switch from an inactive state to an activated state in response to a touch input corresponding to the input sensed using the touch sensor.

Images