WO2021206354A1

WO2021206354A1 - Electronic device for fingerprint recognition and operation method thereof

Info

Publication number: WO2021206354A1
Application number: PCT/KR2021/003970
Authority: WO
Inventors: 최정우; 진윤장; 박종호; 김선아
Original assignee: 삼성전자 주식회사
Priority date: 2020-04-07
Filing date: 2021-03-31
Publication date: 2021-10-14
Also published as: KR20210124829A

Abstract

Various embodiments of the present invention relate to a device and a method for fingerprint recognition in an electronic device. The electronic device may comprise a sensor module and a processor operatively connected to the sensor module, wherein the processor acquires fingerprint information related to an external object via the sensor module, performs first user authentication on the basis of the fingerprint information, acquires background noise via the sensor module when the first user authentication fails, and performs second user authentication on the basis of the fingerprint information and the background noise. Other embodiments may be possible.

Description

Electronic device for fingerprint recognition and method of operation thereof

Various embodiments of the present invention relate to an apparatus and method for fingerprint recognition in an electronic device.

With the development of information and communication technology and semiconductor technology, various electronic devices are developing into multimedia devices that provide various multimedia services. For example, the multimedia service may include at least one of a voice call service, a message service, a broadcast service, a wireless Internet service, a camera service, an electronic payment service, and a music reproduction service.

As multimedia services are diversified in electronic devices, personal information stored in electronic devices is increasing. The electronic device may provide an authentication service for protecting personal information stored in the electronic device from others. For example, the electronic device may provide an authentication service (eg, biometric recognition service) using biometric information such as an iris, a fingerprint, a face, a palm, and a vein.

The electronic device may perform fingerprint recognition for authenticating the user by using the user's fingerprint information. For example, the electronic device may acquire fingerprint information by scanning a human body in contact with the fingerprint sensor. The electronic device may authenticate the user based on the similarity between the fingerprint image generated based on the fingerprint information and the reference fingerprint image stored in the memory.

The fingerprint information obtained through the fingerprint sensor may include a background noise component in addition to the fingerprint component obtained from the human body. The fingerprint image generated based on the fingerprint information may include a background noise component as well as a fingerprint component obtained from a human body. Accordingly, an error in fingerprint recognition may occur in the electronic device due to background noise generated during fingerprint scanning.

Various embodiments of the present invention disclose an apparatus and method for removing background noise of a fingerprint sensor in an electronic device.

According to various embodiments, the electronic device includes a sensor module and a processor operatively connected to the sensor module, wherein the processor acquires fingerprint information related to an external object through the sensor module, and the fingerprint information may perform the first user authentication based on , and when the first user authentication fails, the background noise may be acquired through the sensor module, and the second user authentication may be performed based on the fingerprint information and the background noise. .

According to various embodiments of the present disclosure, the method of operating an electronic device includes: obtaining fingerprint information related to an external object through a sensor module of the electronic device; performing first user authentication based on the fingerprint information; When the first user authentication fails, the method may include acquiring a background noise through the sensor module and performing a second user authentication based on the fingerprint information and the background noise.

According to various embodiments, the electronic device includes a sensor module and a processor operatively connected to the sensor module, wherein the processor acquires fingerprint information related to an external object through the sensor module, and the fingerprint information The background noise may be acquired through the sensor module based on the acquisition of , and user authentication may be performed based on the fingerprint information and the background noise.

According to various embodiments of the present disclosure, the electronic device acquires a background noise adjacent to a fingerprint recognition time point through a noise scan performed after the fingerprint scan, and generates a fingerprint image for fingerprint recognition based on the background noise, It can improve the quality of the fingerprint image for fingerprint recognition and improve the fingerprint recognition performance.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;

2 is a plan view illustrating a front surface of an electronic device according to various embodiments of the present disclosure;

3 is a block diagram of an electronic device for fingerprint recognition according to various embodiments of the present disclosure;

4 is an example for fingerprint recognition in an electronic device according to various embodiments.

5 is a flowchart for generating a first fingerprint image in an electronic device according to various embodiments of the present disclosure;

6 is a flowchart for outputting scan completion information in an electronic device according to various embodiments of the present disclosure;

7 is a flowchart for generating a second fingerprint image in an electronic device according to various embodiments of the present disclosure;

8 is another example for recognizing a fingerprint in an electronic device according to various embodiments of the present disclosure;

Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphic processing unit, an image signal processor) that can operate independently or together with the main processor 121 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 and 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more of the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more stored in a storage medium (eg, the internal memory 136 or the external memory 138 ) readable by a machine (eg, the electronic device 101 ) It may be implemented as software (eg, program 140) including instructions. For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a plan view illustrating a front surface of an electronic device according to various embodiments of the present disclosure; For example, the electronic device 200 of FIG. 2 may be at least partially similar to the electronic device 101 of FIG. 1 , or may include another embodiment of the electronic device.

Referring to FIG. 2 , according to various embodiments, the electronic device 200 includes a first surface (or front surface) 210A, a second surface (or rear surface) facing the opposite direction of the first surface 210A, and The housing 210 may include a side surface 210C surrounding a space between the first surface 210A and the second surface. In another embodiment (not shown), the housing may refer to a structure that forms part of the first surface 210A, the second surface, and the side surface 210C of FIG. 2 . According to one embodiment, the first surface 210A may be formed by a front plate 202 (eg, a glass plate including various coating layers, or a polymer plate) that is at least partially transparent. According to one embodiment, the side surface 210C engages the front plate 202 and may be formed by a side bezel structure 218 (or "side member") comprising a metal and/or a polymer.

According to various embodiments, the electronic device 200 includes a display 201 , an input device 203 , a sound output device 207 and/or 214 , a sensor module 204 and/or 230 , and a camera module 205 . ), a key input device 217 , an indicator (not shown), or a connector 208 . According to an embodiment, the electronic device 200 may omit at least one of the components (eg, the key input device 217 or the indicator) or additionally include other components.

According to one embodiment, the display 201 may be exposed through a substantial portion of the front plate 202 . For example, at least a portion of the display 201 may be exposed through the front plate 202 . The display 201 may be coupled to or disposed adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and/or a digitizer that detects a magnetic field type stylus pen.

According to an embodiment, the input device 203 may include at least one microphone. For example, the input device 203 may include a plurality of microphones disposed to detect the direction of sound.

According to an embodiment, the sound output device 207 and/or 214 may include speakers. For example, the sound output device 207 and/or 214 may include a first sound output device 207 (eg, an external speaker) for outputting sound to the outside and a second sound output device 214 (eg, an external speaker) for a call. : Receiver for calls) may be included. According to an embodiment, the input device 203 , the sound output devices 207 and/or 214 , and/or the connector 208 are connected to an internal space of the electronic device 200 (eg, an internal space of the housing 210 ). disposed and may be exposed to the external environment through at least one hole formed in the housing 210 . According to an embodiment, the hole formed in the housing 210 may be commonly used for the input device 203 and the sound output device 207 and/or 214 . According to an embodiment, the sound output device 207 and/or 214 may include a speaker (eg, a piezo speaker) that operates while excluding a hole formed in the housing 210 .

According to an embodiment, the sensor module 204 and/or 230 may generate an electrical signal or data value corresponding to an internal operating state of the electronic device 200 or an external environmental state. For example, the sensor module 204 and/or 230 may include a first sensor module 204 (eg, a proximity sensor) and/or a second sensor module 230 disposed on the first side 210A of the housing 210 . ) (eg fingerprint sensor). For example, the second sensor module 230 may be disposed under the display 201 . For example, the second sensor module 230 may identify biometric information (eg, fingerprint) corresponding to a user input on the display 201 . As another example, the second sensor module 230 may be disposed in a partial area (eg, a home key button) of the first surface 210A of the housing 210 or a partial area of the second surface (eg, the rear surface) of the housing 210 . have.

According to an embodiment, the camera module 205 may be disposed on the first surface 210A of the electronic device 200 . For example, the camera module 205 may include one or more lenses, an image sensor, and/or an image signal processor. According to an embodiment, two or more lenses (a wide-angle lens, an ultra-wide-angle lens, or a telephoto lens) and image sensors may be disposed on one surface of the electronic device 200 .

According to an embodiment, the key input device 217 may be disposed on the side surface 210C of the housing 210 . In another embodiment, the electronic device 200 may not include some or all of the key input devices 217 and the not included key input devices 217 may be displayed on the display 201 as a soft key or in other form. can be implemented. In another embodiment, the key input device 217 may be implemented using a pressure sensor included in the display 201 .

According to an embodiment, the indicator may be disposed on the first surface 210A of the housing 210 . For example, the indicator may provide status information of the electronic device 200 in the form of light. In another embodiment, the light emitting device may provide a light source that is interlocked with the operation of the camera module 205 . For example, the indicator may include a light emitting diode (LED), an infrared (IR) LED, and a xenon lamp.

According to an embodiment, the connector hole 208 may receive a connector (eg, a USB connector) for transmitting and receiving power and/or data to and from an external electronic device (eg, the electronic device 102 of FIG. 1 ). and a first connector hole 208 located there.

According to an embodiment, the camera module 205 , the first sensor module 204 and/or the indicator may be disposed to be exposed through the display 201 . For example, the camera module 205 , the first sensor module 204 , and/or the indicator may be connected from the internal space of the electronic device 200 to the external environment through a through-hole drilled to the front plate 202 of the display 201 . It may be arranged so as to be in contact with In another embodiment, the first sensor module 204 may be arranged to perform its function without being visually exposed through the front plate 202 in the internal space of the electronic device. For example, in this case, the area of the display 201 facing the sensor module may not need a through hole.

3 is a block diagram of an electronic device for fingerprint recognition according to various embodiments of the present disclosure; For example, the electronic device 300 of FIG. 3 may be at least partially similar to the electronic device 101 of FIG. 1 or the electronic device 200 of FIG. 2 , or may include another embodiment of the electronic device.

Referring to FIG. 3 , according to various embodiments, the electronic device 300 includes a processor 310 (eg, the processor 120 of FIG. 1 ), a sensor module 320 (eg, the sensor module 176 of FIG. 1 ). ) and/or the second sensor module 230 of FIG. 2 ), the memory 330 (eg, the memory 130 of FIG. 1 ) and/or the display 340 (eg, the display device 160 of FIG. 1 and and/or display 201 of FIG. 2 ). According to an embodiment, the processor 310 may control the operatively connected sensor module 320 , the memory 330 , and/or the display 340 .

According to various embodiments, the processor 310 may determine whether to perform fingerprint recognition using the sensor module 320 . According to an embodiment, when an application program requiring user authentication (eg, fingerprint recognition) is executed, the processor 310 may determine to start fingerprint recognition. For example, when the sensor module 320 is in an inactive state, the processor 310 may transmit a signal related to transition to the active state to the sensor module 320 based on a determination to start a fingerprint scan. For example, the signal related to the transition to the active state may include information instructing the transition to the active mode of the sensor module 320 . For example, the application program related to fingerprint recognition may include a payment application program requiring user authentication, an unlocking application program, and/or a bank application program.

According to various embodiments, the processor 310 may perform user authentication based on a determination to start a fingerprint scan. According to an embodiment, the processor 310 may acquire fingerprint information through the sensor module 320 based on a determination to start a fingerprint scan. For example, the processor 310 may transmit a signal related to the fingerprint scan to the sensor module 320 based on the determination to start the fingerprint scan. The processor 310 may receive fingerprint information from the sensor module 320 in response to a signal related to a fingerprint scan. As an example, the signal related to the fingerprint scan may include information indicating the start of the fingerprint scan. For example, the fingerprint information is information obtained through a fingerprint scan of the sensor module 320 based on a signal related to a fingerprint scan, and may include a fingerprint component and background noise obtained from a user's body (eg, finger). . For example, the background noise may be noise generated by an internal structure (eg, the front plate 202 , the display 340 , or a printed board) constituting the electronic device 300 and/or other electronic devices (eg, as shown in FIG. 1 ). It may include noise introduced from the electronic device 102 .

According to an embodiment, the processor 310 may generate a first fingerprint image based on the fingerprint information received from the sensor module 320 . For example, the processor 310 may generate the first fingerprint image by removing the background noise of the fingerprint information received from the sensor module 320 based on the previously acquired background noise stored in the memory 330 . . For example, the previously acquired background noise is acquired through the background noise acquired through the most recently performed fingerprint recognition prior to the current fingerprint recognition time or the sensor module 320 for a reference time prior to the current fingerprint recognition time. One background noise (or an average of the background noise) may be included.

According to an embodiment, the processor 310 may perform user authentication based on the first fingerprint image and the reference fingerprint image stored in the memory 330 . For example, when the similarity between the first fingerprint image and the reference fingerprint image satisfies a specified similarity, the processor 310 may determine that user authentication is successful. For example, the state satisfying the specified similarity may include a state in which the similarity between the first fingerprint image and the reference fingerprint image exceeds the specified similarity. For example, when the similarity between the first fingerprint image and the reference fingerprint image does not satisfy a specified similarity, the processor 310 may determine that user authentication has failed. For example, the state that does not satisfy the specified similarity may include a state in which the similarity between the first fingerprint image and the reference fingerprint image is less than or equal to the specified similarity. For example, the specified similarity may include a criterion for determining success or failure of user authentication. The specified similarity may be set based on a user input, a security level of an application program, and/or a security level of the electronic device.

According to various embodiments, when the user authentication fails based on the first fingerprint image, the processor 310 may perform additional authentication. According to an embodiment, the background noise of the sensor module 320 may be changed relatively sensitively based on an environmental change related to the electronic device 300 . When the user authentication fails based on the first fingerprint image, the processor 310 generates a background noise in the first fingerprint image due to a difference between the previously acquired background noise stored in the memory 330 and the background noise at the time of fingerprint recognition. At least a portion remains, so that it can be determined that user authentication has failed. The processor 310 may acquire the background noise of the sensor module 320 after acquiring fingerprint information through a fingerprint scan in order to acquire the background noise at the point closest to the fingerprint recognition time. According to an embodiment, the processor 310 may acquire the background noise through the sensor module 320 based on the failure of user authentication. According to an embodiment, the processor 310 may transmit a signal related to the scan of the background noise to the sensor module 320 . For example, when the processor 310 receives information related to a contact state of an external object (eg, a finger) from the sensor module 320 in response to a signal related to scanning of background noise, the It may be determined that the background noise scan cannot be performed. The processor 310 may control the display 340 to display information related to completion of a fingerprint scan to release an external object's contact with the sensor module 320 . For example, the processor 310 may receive the background noise from the sensor module 320 in response to a signal related to the scan of the background noise. For example, the signal related to the scan of the background noise may include information indicating the start of the scan related to the background noise. For example, the environmental change related to the electronic device 300 includes a change in the external temperature and/or the internal temperature of the electronic device 300 , aging of the sensor module 320 and/or electrical noise. can do.

According to an embodiment, the processor 310 may generate a second fingerprint image based on the fingerprint information received from the sensor module 320 and the background noise received from the sensor module 320 . For example, the processor 310 may generate the second fingerprint image by removing the background noise received from the sensor module 320 from the fingerprint information received from the sensor module 320 . For example, the fingerprint information may include fingerprint information received in response to a signal related to a fingerprint scan. For example, the background noise may include a background noise received in response to a signal related to a scan of the background noise.

According to an embodiment, the processor 310 may perform user authentication based on the second fingerprint image and the reference fingerprint image stored in the memory 330 . For example, when the similarity between the second fingerprint image and the reference fingerprint image satisfies a specified similarity, the processor 310 may determine that user authentication is successful. For example, the satisfaction of the specified similarity may include a state in which the similarity between the second fingerprint image and the reference fingerprint image exceeds the specified similarity. For example, when the similarity between the second fingerprint image and the reference fingerprint image does not satisfy a specified similarity, the processor 310 may determine that user authentication has failed. For example, the dissatisfaction of the specified similarity may include a state in which the similarity between the second fingerprint image and the reference fingerprint image is less than or equal to the specified similarity.

According to an embodiment, when the user authentication is successful based on the first fingerprint image or the second fingerprint image, the processor 310 may perform a designated function. For example, the designated function may include unlocking, unlocking security settings, logging in, and/or authorizing payment.

According to an embodiment, when user authentication fails based on the second fingerprint image, the processor 310 may control the sensor module 320 to perform a fingerprint scan again. For example, the processor 310 may determine that the fingerprint scan has failed when the number of user authentication failures is greater than or equal to the specified number of times. The processor 310 may control the display 340 to output information related to the failure of the fingerprint scan based on the failure of the fingerprint scan. As an example, the specified number of times may include an integer of 1 or more.

According to various embodiments, the processor 310 may perform user authentication by acquiring fingerprint information and background information of a user based on a determination to start a fingerprint scan. According to an embodiment, the processor 310 may acquire fingerprint information through the sensor module 320 based on a determination to start a fingerprint scan. For example, the fingerprint information may be obtained through a fingerprint scan of the sensor module 320 based on a signal related to a fingerprint scan.

According to an embodiment, when receiving fingerprint information from the sensor module 320 , the processor 310 may acquire background noise through the sensor module 320 . For example, the processor 310 may require a background noise at a fingerprint recognition time point or a point closest to the fingerprint recognition time point in order to remove the background noise from the fingerprint image. At the time of fingerprint recognition, since an external object (eg, a finger) is in contact with the sensor module 320 , background noise cannot be acquired. Since the electronic device 300 cannot predict in advance when the user attempts to recognize a fingerprint at a time prior to the fingerprint recognition time, the background noise cannot be acquired immediately before the user attempts to recognize the fingerprint. Accordingly, the processor 310 may acquire the background noise through scanning of the background noise immediately after the user attempts to recognize the fingerprint and acquires fingerprint information. For example, the processor 310 may transmit a signal related to the scan of the background noise to the sensor module 320 . The processor 310 may receive the background noise from the sensor module 320 in response to a signal related to the scan of the background noise. For example, when the processor 310 receives information related to a contact state of an external object (eg, a finger) from the sensor module 320 in response to a signal related to scanning of the background noise, the processor 310 relates to completion of the fingerprint scan. The display 340 may be controlled to display information.

According to an embodiment, the processor 310 may generate a fingerprint image based on the fingerprint information received from the sensor module 320 and the background noise received from the sensor module 320 . For example, the processor 310 may generate a fingerprint image by removing the background noise from the fingerprint information received from the sensor module 320 based on the background noise received from the sensor module 320 . For example, the fingerprint information may include fingerprint information received in response to a signal related to a fingerprint scan. For example, the background noise may include a background noise received in response to a signal related to a scan of the background noise.

According to an embodiment, the processor 310 may perform user authentication based on the fingerprint image and the reference fingerprint image stored in the memory 330 . For example, when the similarity between the fingerprint image and the reference fingerprint image satisfies a specified similarity, the processor 310 may determine that user authentication is successful. For example, the satisfaction of the specified similarity may include a state in which the similarity between the fingerprint image and the reference fingerprint image exceeds the specified similarity. For example, when the similarity between the fingerprint image and the reference fingerprint image does not satisfy a specified similarity, the processor 310 may determine that user authentication has failed. For example, the dissatisfaction with the specified similarity may include a state in which the similarity between the fingerprint image and the reference fingerprint image is less than or equal to the specified similarity.

According to an embodiment, when the user authentication is successful based on the image, the processor 310 may perform a specified function. According to an embodiment, when user authentication fails based on the fingerprint image, the processor 310 may control the sensor module 320 to perform a fingerprint scan again. For example, the processor 310 may determine that the fingerprint scan has failed when the number of user authentication failures is greater than or equal to the specified number of times. The processor 310 may control the display 340 to output information related to the failure of the fingerprint scan based on the failure of the fingerprint scan.

According to various embodiments, the sensor module 320 may detect an operating state of the electronic device 300 or an external environmental state, and provide the sensed information to the processor 310 . According to an embodiment, the sensor module 320 may acquire the user's biometric information (eg, fingerprint information) through a scan of an external object (eg, a finger) in contact with the sensor module 320 . For example, the sensor module 320 may acquire the user's fingerprint information through a fingerprint scan based on an ultrasonic method, an optical method, or a capacitive method. For example, when using the ultrasonic method, the sensor module 320 may output ultrasonic waves to the outside. The sensor module 320 may collect information related to the shape of the external object (eg, fingerprint information) based on the ultrasonic wave reflected and received by the external object.

According to an embodiment, the sensor module 320 may acquire the background noise by scanning the background noise. For example, the sensor module 320 may determine whether an external object in contact with the sensor module 320 exists based on a signal related to a scan of background noise received from the processor 310 . For example, the sensor module 320 may output an ultrasonic wave to the outside based on a signal related to the scan of the background noise. The sensor module 320 may determine whether an external object in contact with the sensor module 320 exists based on the ultrasonic wave reflected and received by the external object. For example, the sensor module 320 may determine whether an external object in contact with the sensor module 320 exists based on touch input information of at least a portion of the display 340 corresponding to the sensor module 320 . For example, when there is an external object in contact with the sensor module 320 , the sensor module 320 may transmit information related to the contact state of the external object to the processor 310 , for example, the sensor module ( 320 is received by being reflected by an internal structure (eg, the front plate 202 , the display 340 or the printed board) of the electronic device 300 when there is no external object in contact with the sensor module 320 . Background noise may be detected based on ultrasound.

According to an embodiment, the sensor module 320 may be disposed under the display 340 , a home key button, or a partial region of the rear surface of the electronic device 300 . For example, the rear surface of the electronic device 300 may include a surface facing in a direction opposite to the front surface of the display 340 exposed to the outside.

According to various embodiments, the memory 330 includes various components used by at least one component (eg, the processor 310 , the sensor module 320 , and/or the display 340 ) of the electronic device 300 . data can be saved. For example, the data may include a reference fingerprint image related to user authentication, information related to background noise, or fingerprint information obtained through a fingerprint scan. For example, the information related to the background noise may be obtained through a scan of the background noise performed before the fingerprint scan of the sensor module 320 .

According to various embodiments, the display 340 may display information processed by the electronic device 300 . According to an embodiment, the display 340 may display content related to an application program executed by the processor 310 . According to an embodiment, the display 340 may display information related to completion of the fingerprint scan based on the control of the processor 310 .

According to various embodiments, the processor 310 may control the sensor module 320 to scan the background noise after checking whether an external object (eg, a finger) in contact with the sensor module 320 exists. According to an embodiment, when determining that the background noise is to be scanned, the processor 310 may transmit a signal related to a confirmation request of an external object to the sensor module 320 . For example, when receiving information related to a contact state of an external object from the sensor module 320 , the processor 310 may control the display 340 to display information related to completion of a fingerprint scan. For example, when receiving information indicating that an external object is not in contact with the sensor module 320 , the processor 310 may transmit a signal related to a background noise scan to the sensor module 320 . The processor 310 may receive the background noise from the sensor module 320 in response to a signal related to the scan of the background noise.

According to various embodiments, the electronic device 300 may output information related to completion of the fingerprint scan through graphic information, vibration, light (or light), and/or sound. For example, the electronic device 300 may generate vibration of a specified pattern based on information related to completion of a fingerprint scan through a vibration module (not shown).

According to various embodiments, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 ) may include a sensor module (eg, the sensor of FIG. 1 ). Module 176 , second sensor module 230 of FIG. 2 or sensor module 320 of FIG. 3 ) and a processor operatively connected to the sensor module (eg, processor 120 of FIG. 1 or FIG. 3 ) of a processor 310), wherein the processor obtains fingerprint information related to an external object through the sensor module, performs a first user authentication based on the fingerprint information, and fails In this case, the background noise may be acquired through the sensor module, and second user authentication may be performed based on the fingerprint information and the background noise.

According to various embodiments, it further includes a memory (eg, the memory 130 of FIG. 1 or the memory 330 of FIG. 3) for storing information related to the background noise collected before acquiring the fingerprint information, The processor may generate a first fingerprint image based on the fingerprint information and background noise stored in the memory, and perform the first user authentication based on the first fingerprint image.

According to various embodiments, when the first user authentication fails, the processor checks whether an external object is in contact with the sensor module, and when the external object does not come into contact with the sensor module, the processor performs the background through the sensor module When noise is acquired and an external object comes into contact with the sensor module, information related to completion of fingerprint scan may be output.

According to various embodiments, the processor generates a second fingerprint image based on the fingerprint information and the background noise acquired through the sensor module, and performs the second user authentication based on the second fingerprint image can do.

According to various embodiments, the processor checks the similarity between the second fingerprint image and the reference fingerprint image, and when the similarity between the second fingerprint image and the reference fingerprint image satisfies a specified similarity, the second user is authenticated is determined to be successful, and when the similarity between the second fingerprint image and the reference fingerprint image does not satisfy a specified similarity, it may be determined that the second user authentication has failed.

According to various embodiments, the display may further include a housing and a display included in at least a portion of the first surface of the housing, wherein the sensor module may be disposed under the display in the housing.

According to various embodiments, the background noise may include noise generated by an internal structure constituting the electronic device and/or noise introduced from another electronic device.

According to various embodiments, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 ) may include a sensor module (eg, the sensor of FIG. 1 ). Module 176 , second sensor module 230 of FIG. 2 or sensor module 320 of FIG. 3 ) and a processor operatively connected to the sensor module (eg, processor 120 of FIG. 1 or FIG. 3 ) a processor (310) of User authentication may be performed based on the information and the background noise.

According to various embodiments, the processor checks whether an external object is in contact with the sensor module when the fingerprint information is obtained, and when the external object does not contact the sensor module, background noise through the sensor module , and when an external object comes into contact with the sensor module, information related to fingerprint scan completion may be output.

According to various embodiments, the processor may generate a fingerprint image based on the fingerprint information and the background noise, and perform user authentication based on the fingerprint image.

4 is an example for fingerprint recognition in an electronic device according to various embodiments. In the following embodiments, the operations may be sequentially performed, but are not necessarily sequentially performed. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 4 may be the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 .

Referring to FIG. 4 , according to various embodiments, an electronic device (eg, the processor 120 of FIG. 1 , the sensor module 176 of FIG. 1 , the processor 310 of FIG. 3 , or the sensor module 320 of FIG. 3 ) is performed in operation 401 . , fingerprint information (eg, biometric information) may be acquired through a scan (eg, fingerprint scan) of an external object (eg, a finger). According to an embodiment, when an application program requiring user authentication (eg, fingerprint recognition) is executed, the processor 310 may determine to start fingerprint recognition. According to an embodiment, the processor 310 may transmit a signal related to the fingerprint scan to the sensor module 320 based on the determination to start the fingerprint scan. The processor 310 may receive fingerprint information obtained through a fingerprint scan from the sensor module 320 in response to a signal related to the fingerprint scan. For example, the application program related to fingerprint recognition may include a payment application program requiring user authentication, an unlocking application program, and/or a bank application program. As an example, the signal related to the fingerprint scan may include information indicating the start of the fingerprint scan. For example, the fingerprint information may include a fingerprint component and a background noise component obtained from a user's body (eg, a finger) obtained through a fingerprint scan of the sensor module 320 .

According to various embodiments, the electronic device (eg, the processor 120 or 310 ) may perform user authentication based on fingerprint information in operation 403 . According to an embodiment, the processor 310 may generate the first fingerprint image based on the fingerprint information received from the sensor module 320 and the previously acquired background noise stored in the memory 330 . The processor 310 may check a similarity between the first fingerprint image and the reference fingerprint image stored in the memory 330 . For example, the previously acquired background noise is acquired through the background noise acquired through the most recently performed fingerprint recognition prior to the current fingerprint recognition time or the sensor module 320 for a reference time prior to the current fingerprint recognition time. One background noise (or an average of the background noise) may be included.

According to various embodiments, the electronic device (eg, the processor 120 or 310 ) may check whether user authentication based on fingerprint information is successful in operation 405 . According to an embodiment, when the similarity between the first fingerprint image and the reference fingerprint image exceeds a specified similarity, the processor 310 may determine that user authentication is successful. According to an embodiment, when the similarity between the first fingerprint image and the reference fingerprint image is less than or equal to a specified similarity, the processor 310 may determine that user authentication has failed. For example, the specified similarity may indicate a criterion for determining success or failure of user authentication. The specified similarity may be set based on a user input, a security level of an application program, and/or a security level of the electronic device.

According to various embodiments, when the electronic device (eg, the processor 120 or 310 ) fails user authentication based on fingerprint information (eg, 'No' in operation 405 ), in operation 407 , a scan for background noise is performed. background noise can be obtained. According to an exemplary embodiment, when the user authentication fails based on the first fingerprint image, the processor 310 is configured to retain the remaining in the first fingerprint image due to a difference between the background noise stored in the memory 330 and the background noise at the time of fingerprint recognition. It may be determined that user authentication has failed based on the background noise. Accordingly, the processor 310 may transmit a signal related to the scan of the background noise to the sensor module 320 to obtain the background noise related to the fingerprint recognition time. For example, the processor 310 may receive the background noise from the sensor module 320 in response to a signal related to the scan of the background noise. For example, the signal related to the scan of the background noise may include information indicating the start of the scan related to the background noise.

According to various embodiments, in operation 409 , the electronic device (eg, the processor 120 or 310 ) may perform user authentication based on fingerprint information and background noise information. According to an embodiment, the processor 310 performs the fingerprint information received from the sensor module 320 (eg, fingerprint information acquired in operation 401) and background noise received from the sensor module 320 (eg, acquired in operation 407). A second fingerprint image may be generated based on the background noise). The processor 310 may compare the degree of similarity to which the degree of similarity of the second fingerprint image and the reference fingerprint image is designated. For example, when the similarity between the second fingerprint image and the reference fingerprint image exceeds a specified similarity, the processor 310 may determine that user authentication is successful. For example, when the similarity between the second fingerprint image and the reference fingerprint image is less than or equal to a specified similarity, the processor 310 may determine that user authentication has failed.

According to various embodiments, when the electronic device (eg, the processor 120 or 310) succeeds in user authentication based on fingerprint information (eg, 'Yes' in operation 405), the electronic device (eg, 'Yes' in operation 405) performs the operation according to an embodiment of the present invention. can be shut down According to an embodiment, when the user authentication is successful based on the first fingerprint image, the processor 310 may perform a designated function. For example, the designated function may include unlocking, unlocking security settings, logging in, and/or authorizing payment.

According to various embodiments, when user authentication fails in operation 409 , the electronic device (eg, the processor 120 or 310 ) may perform a fingerprint scan again. According to an embodiment, when user authentication fails, the processor 310 may check the number of authentication failures. For example, the processor 310 may control the sensor module 320 to perform a fingerprint scan again when the number of user authentication failures is less than a specified number of times. For example, when the number of user authentication failures is greater than or equal to the specified number of times, the processor 310 may determine that fingerprint recognition has failed and control the display 340 to output information related to the failure of fingerprint recognition. As an example, the specified number of times may include an integer of 1 or more. As an example, the number of authentication failures may include the number of times operations 401 to 409 of FIG. 4 are performed.

5 is a flowchart for generating a first fingerprint image in an electronic device according to various embodiments of the present disclosure; According to an embodiment, the operations of FIG. 5 may be an embodiment of operation 403 of FIG. 4 . In the following embodiments, the operations may be sequentially performed, but are not necessarily sequentially performed. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 5 may be the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 .

Referring to FIG. 5 , according to various embodiments, an electronic device (eg, the processor 120 of FIG. 1 , or the processor 310 of FIG. 3 ) performs fingerprint information through a scan of an external object (eg, a finger). When (eg, biometric information) is acquired (eg, in operation 401 of FIG. 4 ), in operation 501 , the background noise stored in the memory (eg, the memory 330 ) may be checked. For example, the background noise stored in the memory 330 may be acquired through a scan of the background noise before performing a fingerprint scan (eg, operation 401 of FIG. 4 ).

According to various embodiments, in operation 503 , the electronic device (eg, the processor 120 or 310 ) generates a first fingerprint image based on fingerprint information and background noise stored in a memory (eg, the memory 330 ). can According to an embodiment, the processor 310 may generate the first fingerprint image by removing the background noise from the fingerprint information received from the sensor module 320 based on the background noise stored in the memory 330 .

According to various embodiments, the electronic device (eg, the processor 120 or 310 ) may perform user authentication based on the first fingerprint image in operation 505 . According to an embodiment, the processor 310 may check the similarity between the first fingerprint image and the reference fingerprint image stored in the memory 330 . The processor 310 may determine whether user authentication is successful based on a comparison result of the similarity between the first fingerprint image and the reference fingerprint image and the specified degree of similarity. For example, when the similarity between the first fingerprint image and the reference fingerprint image exceeds a specified similarity, the processor 310 may determine that user authentication is successful. For example, when the similarity between the first fingerprint image and the reference fingerprint image is less than or equal to a specified similarity, the processor 310 may determine that user authentication has failed.

6 is a flowchart for outputting scan completion information in an electronic device according to various embodiments of the present disclosure; According to an embodiment, the operations of FIG. 6 may be an embodiment of operation 407 of FIG. 4 . In the following embodiments, the operations may be sequentially performed, but are not necessarily sequentially performed. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 6 may be the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 .

Referring to FIG. 6 , according to various embodiments, when the electronic device (eg, the processor 120 of FIG. 1 or the processor 310 of FIG. 3 ) fails user authentication based on fingerprint information (eg, FIG. 4 ) 'No' in operation 405) and in operation 601, it may be determined whether an external object (eg, a finger) is in contact with a sensor module (eg, a fingerprint sensor). According to an embodiment, when the user authentication based on the first fingerprint image fails, the processor 310 may transmit a signal related to a confirmation request of an external object to the sensor module 320 . For example, when the processor 310 receives the information related to the contact state of the external object from the sensor module 320 , the user's finger is in contact with the sensor module 320 , and the background noise using the sensor module 320 is reduced. It can be judged that the scan is limited. For example, when receiving information indicating that an external object is not in contact with the sensor module 320 , the processor 310 may determine that background noise can be scanned through the sensor module 320 . As an example, when the sensor module 320 is disposed under the display 340 , the contact of an external object (eg, a finger) with respect to the sensor module 320 is performed by the display 340 corresponding to the sensor module 320 . A state in which an external object (eg, a finger) is in contact with at least a portion may be included.

According to various embodiments, when an external object (eg, a finger) comes into contact with a sensor module (eg, a fingerprint sensor), the electronic device (eg, the processor 120 or 310 ) (eg, 'Yes' in operation 601) , in operation 603 , information related to completion of the fingerprint scan may be output. According to an embodiment, when it is determined that the scan of the background noise is limited because the external object comes into contact with the sensor module 320 , the processor 310 may allow the user to release the contact of the external object with the sensor module 320 . It can be controlled to output information related to the completion of the fingerprint scan. For example, information related to the completion of a fingerprint scan may be output by graphical information, light (or light), sound, and/or vibration. For example, the display 340 may display graphic information related to completion of a fingerprint scan on at least a partial area (eg, a fingerprint scan area) of the display 340 . For example, the vibration module (not shown) may generate vibration of a specified pattern related to completion of fingerprint scan.

According to various embodiments, when an external object (eg, a finger) does not come into contact with a sensor module (eg, a fingerprint sensor), the electronic device (eg, the processor 120 or 310 ) performs 'No' in operation 601 (eg, 'No' in operation 601). ), in operation 605 , a background noise of a sensor module (eg, a fingerprint sensor) may be acquired by scanning the background noise. According to an embodiment, when the processor 310 determines that scanning of the background noise is possible through the sensor module 320 because an external object does not come into contact with the sensor module 320 , the processor 310 transmits a signal related to scanning of the background noise to the sensor module. It can be transmitted to (320). The processor 310 may receive the background noise from the sensor module 320 in response to a signal related to the scan of the background noise.

7 is a flowchart for generating a second fingerprint image in an electronic device according to various embodiments of the present disclosure; According to an embodiment, the operations of FIG. 7 may be an embodiment of operation 409 of FIG. 4 . In the following embodiments, the operations may be sequentially performed, but are not necessarily sequentially performed. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 7 may be the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 .

Referring to FIG. 7 , according to various embodiments, when the electronic device (eg, the processor 120 of FIG. 1 or the processor 310 of FIG. 3 ) acquires the background noise through a scan for the background noise ( Example: In operation 407) and operation 701 of FIG. 4, a second fingerprint image is generated based on fingerprint information acquired through a sensor module (eg, fingerprint sensor) and background noise acquired through a sensor module (eg, fingerprint sensor). can create According to an embodiment, the processor 310 performs the fingerprint information (eg, FIG. 4 ) received from the sensor module 320 based on the background noise received from the sensor module 320 (eg, obtained in operation 407 of FIG. 4 ). A second fingerprint image may be generated by removing the background noise in operation 401 ).

According to various embodiments, the electronic device (eg, the processor 120 or 310 ) may perform user authentication based on the second fingerprint image in operation 703 . According to an embodiment, the processor 310 may check the similarity between the second fingerprint image and the reference fingerprint image. The processor 310 may determine whether user authentication is successful based on a comparison result of the similarity between the second fingerprint image and the reference fingerprint image and the specified degree of similarity. For example, when the similarity between the second fingerprint image and the reference fingerprint image exceeds a specified similarity, the processor 310 may determine that user authentication is successful. For example, when the similarity between the second fingerprint image and the reference fingerprint image is less than or equal to a specified similarity, the processor 310 may determine that user authentication has failed.

8 is another example for recognizing a fingerprint in an electronic device according to various embodiments of the present disclosure; In the following embodiments, the operations may be sequentially performed, but are not necessarily sequentially performed. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 8 may be the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 .

Referring to FIG. 8 , according to various embodiments, an electronic device (eg, the processor 120 of FIG. 1 , the sensor module 176 of FIG. 1 , the processor 310 of FIG. 3 , or the sensor module 320 of FIG. 3 ) is performed in operation 801 . , it is possible to obtain fingerprint information (eg, biometric information) by performing a scan (eg, fingerprint scan) of an external object (eg, a finger) through a sensor module (eg, a fingerprint sensor). According to an embodiment, when an application program for fingerprint recognition (eg, a payment application program) is executed, the processor 310 may transmit a fingerprint scan related signal to the sensor module 320 . The processor 310 may receive fingerprint information obtained through a fingerprint scan from the sensor module 320 in response to a signal related to the fingerprint scan. For example, the fingerprint information may include a fingerprint component and a background noise component obtained from the user's human body (eg, a finger) obtained through a fingerprint scan of the sensor module 320 .

According to various embodiments, in operation 803 , the electronic device (eg, the processor 120 or 310 ) performs a scan for background noise through a sensor module (eg, a fingerprint sensor) to obtain a sensor module (eg, a fingerprint sensor) It is possible to obtain the background noise for . According to an embodiment, when the processor 310 acquires fingerprint information through a fingerprint scan, as in operations 601 to 605 of FIG. 6 , the processor 310 may acquire background noise through the sensor module 320 . For example, when the processor 310 determines that scanning of the background noise is possible through the sensor module 320 because there is no external object in contact with the sensor module 320 , the processor 310 transmits a signal related to scanning of the background noise to the sensor module. It can be transmitted to (320). The processor 310 may receive the background noise from the sensor module 320 in response to a signal related to the scan of the background noise.

According to various embodiments, in operation 805 , the electronic device (eg, the processor 120 or 310 ) acquires fingerprint information acquired through a sensor module (eg, a fingerprint sensor) and a sensor module (eg, a fingerprint sensor) User authentication may be performed based on background noise information. According to an embodiment, the processor 310 may generate a fingerprint image based on the fingerprint information received from the sensor module 320 and background noise received from the sensor module 320 as in operation 701 of FIG. 7 . . As in operation 703 of FIG. 7 , the processor 310 may compare the similarity between the fingerprint image and the reference fingerprint image with a specified degree of similarity. For example, when the similarity between the fingerprint image and the reference fingerprint image exceeds a specified similarity, the processor 310 may determine that user authentication is successful. For example, when the similarity between the fingerprint image and the reference fingerprint image is less than or equal to a specified similarity, the processor 310 may determine that user authentication has failed.

According to various embodiments, the electronic device (eg, the processor 120 or 310 ) may perform a specified function when user authentication is successful. For example, the designated function may include unlocking, unlocking security settings, logging in, and/or authorizing payment.

According to various embodiments, when user authentication fails, the electronic device (eg, the processor 120 or 310 ) may perform the fingerprint recognition procedure of operations 801 to 805 again. According to an embodiment, when user authentication fails, the processor 310 may check the number of consecutive failures of user authentication. The processor 310 may determine that the fingerprint recognition has failed when the number of consecutive failures of user authentication is greater than or equal to the specified number of times. The processor 310 may control the display 340 to output information related to the failure of fingerprint recognition based on the failure of fingerprint recognition. As an example, the specified number of times may include an integer of 1 or more.

According to various embodiments, a method of operating an electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 200 of FIG. 2 , or the electronic device 300 of FIG. 3 ) may include a sensor module of the electronic device. An operation of acquiring fingerprint information related to an external object through (eg, the sensor module 176 of FIG. 1 , the second sensor module 230 of FIG. 2 , or the sensor module 320 of FIG. 3 ), based on the fingerprint information performing the first user authentication, acquiring background noise through the sensor module when the first user authentication fails, and performing second user authentication based on the fingerprint information and the background noise may include.

According to various embodiments, the performing of the first user authentication may include: generating a first fingerprint image based on the fingerprint information and background noise collected before acquiring the fingerprint information; and performing the first user authentication based on a fingerprint image.

According to various embodiments, the acquiring of the background noise includes, when the first user authentication fails, checking whether an external object is in contact with the sensor module, and when the external object is not in contact with the sensor module , acquiring the background noise through the sensor module.

According to various embodiments, the method may further include outputting information related to completion of fingerprint scan when an external object comes into contact with the sensor module.

According to various embodiments, the information related to the completion of the fingerprint scan may be output by graphic information, light, sound, and/or vibration.

According to various embodiments, the performing of the second user authentication includes generating a second fingerprint image based on the fingerprint information and background noise acquired through the sensor module, and based on the second user authentication.

According to various embodiments, the performing of the second user authentication may include checking the similarity between the second fingerprint image and the reference fingerprint image and the similarity between the second fingerprint image and the reference fingerprint image satisfies a specified similarity. , determining that user authentication is successful, and determining that user authentication has failed when the similarity between the second fingerprint image and the reference fingerprint image does not satisfy a specified similarity.

The embodiments of the present invention disclosed in the present specification and drawings are merely provided for specific examples in order to easily explain the technical contents according to the embodiments of the present invention and help the understanding of the embodiments of the present invention, and limit the scope of the embodiments of the present invention It's not what you want to do. Therefore, in the scope of various embodiments of the present invention, in addition to the embodiments disclosed herein, all changes or modifications derived from the technical ideas of various embodiments of the present invention should be interpreted as being included in the scope of various embodiments of the present invention. .

Claims

In an electronic device,

sensor module; and

a processor operatively connected to the sensor module;

The processor is

Obtaining fingerprint information related to an external object through the sensor module,

Perform a first user authentication based on the fingerprint information,

When the first user authentication fails, background noise is acquired through the sensor module,

The electronic device performs second user authentication based on the fingerprint information and the background noise.
The method of claim 1,

Further comprising a memory for storing information related to the background noise collected before acquiring the fingerprint information,

The processor generates a first fingerprint image based on the fingerprint information and the background noise stored in the memory,

The electronic device performs the first user authentication based on the first fingerprint image.
The method of claim 1,

The processor is

If the first user authentication fails, check whether an external object is in contact with the sensor module,

When it is determined that an external object has not contacted the sensor module, background noise is acquired through the sensor module,

When it is determined that an external object has touched the sensor module, the electronic device outputs information related to completion of a fingerprint scan.
The method of claim 1,

The processor generates a second fingerprint image based on the fingerprint information and the background noise acquired through the sensor module,

The electronic device performs the second user authentication based on the second fingerprint image.
5. The method of claim 4,

The processor checks a degree of similarity between the second fingerprint image and a reference fingerprint image,

If the degree of similarity between the second fingerprint image and the reference fingerprint image satisfies a specified degree of similarity, it is determined that the second user authentication is successful;

When the similarity between the second fingerprint image and the reference fingerprint image does not satisfy a specified similarity, the electronic device determines that the second user authentication has failed.
The method of claim 1,

housing; and

Further comprising a display included in at least a portion of the first surface of the housing,

The sensor module is an electronic device disposed under the display in the housing.
7. The method of claim 6,

The background noise includes noise generated by an internal structure constituting the electronic device and/or noise introduced from another electronic device.
A method of operating an electronic device, comprising:

acquiring fingerprint information related to an external object through a sensor module of the electronic device;

performing first user authentication based on the fingerprint information;

When the first user authentication fails, acquiring background noise through the sensor module; and

and performing second user authentication based on the fingerprint information and the background noise.
9. The method of claim 8,

The operation of performing the first user authentication is,

generating a first fingerprint image based on the fingerprint information and background noise collected before acquiring the fingerprint information; and

and performing the first user authentication based on the first fingerprint image.
9. The method of claim 8,

The operation of acquiring the background noise is

When the first user authentication fails, checking whether an external object is in contact with the sensor module; and

and acquiring a background noise through the sensor module when it is determined that an external object has not made contact with the sensor module.
11. The method of claim 10,

and outputting information related to completion of fingerprint scan when it is determined that an external object has touched the sensor module.
12. The method of claim 11,

The information related to the completion of the fingerprint scan is output by means of graphic information, light, sound and/or vibration.
9. The method of claim 8,

The operation of performing the second user authentication is,

generating a second fingerprint image based on the fingerprint information and the background noise acquired through the sensor module; and

and performing the second user authentication based on the second fingerprint image.
14. The method of claim 13,

The operation of performing the second user authentication includes:

checking the similarity between the second fingerprint image and the reference fingerprint image;

determining that user authentication is successful when the similarity between the second fingerprint image and the reference fingerprint image satisfies a specified similarity; and

and determining that user authentication has failed when the similarity between the second fingerprint image and the reference fingerprint image does not satisfy a specified similarity.
9. The method of claim 8,

The background noise includes noise generated by an internal structure constituting the electronic device and/or noise introduced from another electronic device.