KR20190088322A - An electronic device performing authentication for fingerprint according to processing method determined by property of fingerprint image and method thereof - Google Patents

Abstract

Disclosed are an electronic apparatus performing authentication on a fingerprint image in accordance with a processing system of a fingerprint image determined based on an attribute of the fingerprint image, and a method thereof. According to various embodiments of the present invention, the electronic apparatus comprises a biometric sensor and a processor. The processor is configured to acquire a fingerprint image using the biometric sensor, to determine a ratio of the width of a first area corresponding to a ridge and the width of a second area corresponding to a valley, to select at least one image processing system for the fingerprint image from a plurality of image processing systems based on the ratio, and to use the at least one image processing system to process the fingerprint image.

Description

FIELD OF THE INVENTION [0001] The present invention relates to an electronic device and a method for performing authentication on a fingerprint image according to a processing method of a fingerprint image determined based on a property of a fingerprint image.

The present invention relates to an electronic apparatus and method for performing authentication on a fingerprint image according to a processing method of a fingerprint image determined based on an attribute of a fingerprint image.

[0002] With the development of computer technology, various applications such as a notebook computer, a tablet PC, a smart phone, a personal digital assistant, an automated teller machine, A computer based system has been developed. Since these systems typically store a large amount of confidential data such as sales information or business secrets, as well as personal information related to the privacy of the individual, there is a need to enhance security to protect these data. Accordingly, there has been known a fingerprint sensor capable of enhancing security by performing registration and authentication of a system using a fingerprint of a finger.

In recent years, with the rapid spread of portable electronic devices such as smart phones, there has been an increasing number of portable electronic devices including fingerprint sensors as a method for enhancing security for portable electronic devices. Accordingly, the user is provided with a security method that is stronger than an existing security method (for example, a password input method).

The fingerprint sensor may include various types of fingerprint sensors such as a fingerprint sensor using an optical method, a fingerprint sensor using a capacitive method, and a fingerprint sensor using an ultrasound method. It is difficult to obtain a fingerprint image having a high resolution (for example, 500 DPI or more) when a fingerprint sensor, for example, a fingerprint sensor using a capacitive method, is enhanced in fingerprint recognition sensitivity. Accordingly, a fingerprint image having a low resolution (e.g., degradation) can be obtained, and it becomes difficult to extract feature points for fingerprint recognition and comparison in the obtained fingerprint image. Particularly, for fingerprints having a large ridge and valley ratios of fingerprints, or in other words, fingerprints having a narrow interval between fusing and fusing, it may become more difficult to extract feature points if resolution is low. However, if an algorithm for increasing the resolution of the fingerprint image is applied to all the fingerprint images obtained by the fingerprint sensor, the fingerprint processing algorithm must be complicatedly configured, thereby increasing the throughput of the processor, The power consumption can be increased.

According to various embodiments, in an electronic device including a fingerprint sensor, for example, a fingerprint sensor using a capacitive method, the ratio of the finger's width to the finger's width (in this document, quot; ridge-valley ratio "), the at least one of the pre-processing algorithm for the obtained fingerprint image and the algorithm for increasing the resolution is applied to the obtained fingerprint image, An electronic device capable of reducing the power consumption of an electronic device in accordance with simplification is provided.

According to various embodiments, when a user is authenticated using a fingerprint of a user, the fingerprint comparison is made by comparing the fusion-bone ratio of the obtained fingerprint with the fusion-bone ratio of the registered (e.g., stored) fingerprint, An electronic device is provided that can increase the accuracy of fingerprint matching.

According to various embodiments, in an electronic device including a fingerprint sensor, for example, a fingerprint sensor using a capacitive method, the preprocessing algorithm and the resolution increase for the acquired fingerprint image, depending on the fingerprint ratio of the fingerprint Readable nonvolatile recording medium on which at least one operation is recorded, wherein at least one of the algorithms for the fingerprint image processing is applied to the obtained fingerprint image to reduce the power consumption of the electronic device according to the simplification of the fingerprint image processing algorithm / RTI >

According to various embodiments, when a user is authenticated using a fingerprint of a user, the fingerprint comparison is made by comparing the fusion-bone ratio of the obtained fingerprint with the fusion-bone ratio of the registered (e.g., stored) fingerprint, There is provided a computer readable nonvolatile recording medium having recorded thereon at least one operation which can increase the accuracy of fingerprint matching.

An electronic device according to various embodiments includes a biometric sensor and a processor, wherein the processor is configured to cause the biometric sensor to acquire a fingerprint image and to determine a width of a first region determining a ratio of a size of a width of the fingerprint image to a size of a width of a second region corresponding to the goal and selecting at least one image processing method for the fingerprint image among the plurality of image processing methods based on the ratio And to process the fingerprint image using the at least one image processing scheme.

An electronic device according to various embodiments includes a biometric sensor and a processor operatively coupled to the biometric sensor, the processor using the biometric sensor to acquire a first fingerprint image, 1 verifies the size of the width of the area corresponding to the goal in the fingerprint image and performs authentication on the fingerprint image based on the first process when the size of the width belongs to the first specified range, If the size falls within the second specified range, it may be configured to perform authentication for the first fingerprint image based on a second process.

A method of controlling an electronic device according to various embodiments is characterized in that the electronic device obtains a fingerprint image using a biosensor, and the electronic device obtains a fingerprint image of a first region Determining a ratio of a magnitude of a width and a magnitude of a width of a second region corresponding to a valley; and the electronic device is operable to determine, based on the ratio, at least one image of the plurality of image processing methods Processing the fingerprint image using the at least one image processing method; and selecting the processing method, and the electronic device processing the fingerprint image using the at least one image processing method.

According to various embodiments, by applying at least one of the algorithms for preprocessing algorithms and resolution enhancement to the acquired fingerprint image to the obtained fingerprint image, based on the finger-to-finger ratio of the fingerprint, Simplification can reduce the power consumption of the electronic device.

According to various embodiments, when a user is authenticated using a fingerprint of a user, the fingerprint comparison is made by comparing the fusion-bone ratio of the obtained fingerprint with the fusion-bone ratio of the registered (e.g., stored) fingerprint, The accuracy of the fingerprint matching can be increased.

1 is a block diagram of an electronic device in a network environment for determining a manner of processing a fingerprint image based on the attributes of the fingerprint, in accordance with various embodiments.
Fig. 2 is an exemplary view for explaining the structure of a display device according to various embodiments. Fig.
3A and 3B are exemplary diagrams illustrating a structure of a display device including a fingerprint sensor according to various embodiments.
4A to 4D are exemplary diagrams illustrating an operation in which a fingerprint image is obtained by a fingerprint sensor using a capacitive method, according to various embodiments.
Figs. 5A and 5B are illustrations for explaining the fusion-bone ratio of a fingerprint according to various embodiments. Fig.
6 is an exemplary diagram illustrating a method of operating an electronic device, in accordance with various embodiments.
7 is an exemplary diagram for describing filters included in a filter bank according to various embodiments.
8A-8C are exemplary diagrams illustrating a convolution operation for determining a fusion-to-graft ratio of a user's fingerprint, in accordance with various embodiments.
Figs. 9A-9D are exemplary diagrams for explaining the operation of estimating the fusion-bone ratio in the acquired fingerprint image, without using the filter bank, according to various embodiments. Fig.
Figures 10A and 10B illustrate an operation for determining the manner of processing a fingerprint image based preferentially on the size of the width for a goal in a captured fingerprint image, without using a filter bank, in accordance with various embodiments. Fig.
11A and 11B illustrate an operation for estimating the fusion-to-bone ratio by summing the sizes of the regions corresponding to the integers and the sizes of the regions corresponding to the integers without using the filter banks according to various embodiments Fig.
12 is an exemplary diagram illustrating a method of operating an electronic device, in accordance with various embodiments.
13A and 13B are exemplary diagrams for comparing the resolution before the first algorithm for increasing the resolution and after the first algorithm is applied, according to various embodiments.
14A to 14D are illustrative diagrams illustrating an operation in which a fingerprint of a user is registered according to various embodiments.
15 and 16 are illustrative diagrams illustrating a method of operating an electronic device, in accordance with various embodiments.
17A to 17C are exemplary diagrams for explaining an operation in which user authentication is failed due to a difference in fusion-bone ratio between a registered fingerprint and a fingerprint for authentication according to various embodiments.
18A and 18B are exemplary diagrams illustrating a method of operating an electronic device, in accordance with various embodiments.

In this document, terms including ordinal numbers such as first, second, etc. may be used to describe various elements, but the elements are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present document, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. Furthermore, the term < RTI ID = 0.0 > and / or < / RTI > may include any combination of a plurality of related listed items or any of a plurality of related listed items.

Figure 1 is a block diagram of an electronic device 101 in a network environment 100 for determining a manner of processing a fingerprint image based on an attribute of the fingerprint, in accordance with various embodiments.

1, an electronic device 101 in a network environment 100 communicates with an electronic device 102 via a first network 198 (e.g., a short-range wireless communication network) (E. G., A < / RTI > remote wireless communication network). According to one embodiment, the electronic device 101 is capable of communicating with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input device 150, an audio output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identity module 196, ). In some embodiments, at least one (e.g., display 160 or camera module 180) of these components may be omitted from the electronic device 101, or one or more other components may be added. In some embodiments, some of these components may be implemented as a single integrated circuit. For example, a sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or a light sensor) may be implemented embedded in the display device 160 (e.g., a display)

Processor 120 executes at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120 by executing software (e.g., program 140) And can perform various data processing or arithmetic operations. According to one embodiment, as part of a data processing or computation, the processor 120 may provide instructions or data received from other components (e.g., sensor module 176 or communication module 190) Process the instructions or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or application processor), and a secondary processor 123 (e.g., a graphics processing unit, an image signal processor , A sensor hub processor, or a communications processor). Additionally or alternatively, the coprocessor 123 may use less power than the main processor 121, or it may be set to be specific to the specified function. The coprocessor 123 may be implemented separately from, or as part of, the main processor 121.

 The coprocessor 123 may be configured to execute on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, At least one component (e.g., display device 160, sensor module 176, or communication module 190) of the components of electronic device 101, along with main processor 121, Lt; RTI ID = 0.0 > and / or < / RTI > According to one embodiment, the coprocessor 123 (e.g., an image signal processor or communications processor) may be implemented as part of a functionally related other component (e.g., camera module 180 or communication module 190) have.

Memory 130 may store various data used by at least one component (e.g., processor 120 or sensor module 176) of electronic device 101. The data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144,

The input device 150 may receive commands or data to be used for components (e.g., processor 120) of the electronic device 101 from the outside (e.g., a user) of the electronic device 101. The input device 150 may include, for example, a microphone, a mouse, or a keyboard.

The sound output device 155 can output the sound signal to the outside of the electronic device 101. [ The sound output device 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes, such as multimedia playback or record playback, and receivers can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker, or as part thereof.

Display device 160 may visually provide information to an external (e.g., user) of electronic device 101. Display device 160 may include, for example, a display, a hologram device, or a projector and control circuitry for controlling the device. According to one embodiment, the display device 160 may comprise a touch circuitry configured to sense a touch, or a sensor circuit (e.g., a pressure sensor) configured to measure the force generated by the touch have.

The audio module 170 may convert the sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 is configured to acquire sound through the input device 150, or to output audio to the audio output device 155, or to an external electronic device (e.g., Electronic device 102) (e.g., a speaker or headphone)).

The sensor module 176 senses the operating state (e.g., power or temperature) of the electronic device 101 or an external environmental condition (e.g., a user state) and generates an electrical signal or data value corresponding to the sensed condition can do. According to one embodiment, the sensor module 176 may be, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, A temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to connect directly or wirelessly with an external electronic device (e.g., the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (e.g., the electronic device 102). According to one embodiment, connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (e.g., vibrations or movements) or electrical stimuli that the user may perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture a still image and a moving image. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage the power supplied to the electronic device 101. [ According to one embodiment, the power management module 388 may be implemented as at least a portion of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module 190 may be a direct (e.g., wired) communication channel between the electronic device 101 and an external electronic device (e.g., an electronic device 102, an electronic device 104, or a server 108) Establishment, and communication through the established communication channel. Communication module 190 may include one or more communication processors that operate independently of processor 120 (e.g., an application processor) and that support direct (e.g., wired) or wireless communication. According to one embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 : A local area network (LAN) communication module, or a power line communication module). A corresponding one of these communication modules may be a first network 198 (e.g., a short range communication network such as Bluetooth, WiFi direct or IrDA (infrared data association)) or a second network 199 (e.g. a cellular network, (E.g., a telecommunications network, such as a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into one component (e.g., a single chip) or a plurality of components (e.g., a plurality of chips) that are separate from each other. The wireless communication module 192 may be configured to communicate with the subscriber identity module 196 in a communication network such as the first network 198 or the second network 199 using subscriber information (e.g., International Mobile Subscriber Identity (IMSI) The electronic device 101 can be confirmed and authenticated.

The antenna module 197 can transmit signals or power to the outside (e.g., an external electronic device) or receive it from the outside. According to one embodiment, the antenna module 197 may include one or more antennas from which at least one antenna suitable for a communication scheme used in a communication network, such as the first network 198 or the second network 199, For example, be selected by the communication module 190. A signal or power may be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna.

At least some of the components are connected to each other via a communication method (e.g., bus, general purpose input and output, SPI, or mobile industry processor interface (MIPI) For example, commands or data).

 According to one embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic devices 102 and 104 may be the same or a different kind of device as the electronic device 101. [ According to one embodiment, all or a portion of the operations performed on the electronic device 101 may be performed on one or more external devices of the external electronic devices 102, 104, or 108. For example, in the event that the electronic device 101 has to perform some function or service automatically, or in response to a request from the user or another device, the electronic device 101 may, instead of executing the function or service itself Or in addition, to one or more external electronic devices to perform the function or at least part of the service. One or more external electronic devices that have received the request may execute at least a portion of the requested function or service, or an additional function or service associated with the request, and deliver the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or in addition to provide at least a portion of the response to the request. For this purpose, for example, cloud computing, distributed computing, or client- Can be used.

Various embodiments may be performed by biometric sensors (e.g., fingerprint sensors) included in electronic device 101 in various manners. With reference to Figures 2 to 3B, an electronic device 101 to which various embodiments may be applied is illustrated by way of example.

In this document, in the case of authenticating a user's fingerprint, a fingerprint image used as a reference fingerprint image (for example, an image that is a basis for comparison with a newly obtained fingerprint image) is referred to as a "registered fingerprint image" . ≪ / RTI > Further, in this document, a fingerprint image acquired by a biosensor (e.g., fingerprint sensor 380 in Fig. 3A) to perform authentication of a user may be referred to as "authenticated fingerprint image" .

FIG. 2 is an exemplary view for explaining the structure of the display device 160, according to various embodiments.

Referring to FIG. 2, the display device 160 according to various embodiments may include a protective cover 210, a touch panel 220, and a display panel 230. The display device 160 according to various embodiments may include a pressure sensor (not shown) that senses pressure additionally or alternatively to the touch panel 220.

According to various embodiments, the protective cover 210 may be used to protect the display device 160 (e.g., the touch panel 220 and / or the display panel 230) from external shocks and the like, Plastic, or glass.

According to various embodiments, the touch panel 220 may include at least one of a capacitive, a pressure sensitive, an infrared, or an ultrasound type of touch input using a stylus or a user's body, a gesture input , Proximity, and hovering input (e. G., Sensed). The touch panel 220 according to various embodiments may further include a control circuit for controlling the touch panel 220. The touch panel 220 according to various embodiments may include a tactile layer to provide a tactile response to the user.

According to various embodiments, the display panel 230 may include, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting (OLED) display, or a microelectromechanical systems (MEMS) display, or an electronic paper display. The display panel 230 according to various embodiments may be implemented as a flexible display or a folderble display. The display panel 230 according to various embodiments may be stretched or twisted by an externally applied force. The display panel 230 according to various embodiments may display various objects (e.g., text, images, video, icons, or symbols, etc.).

3A and 3B are exemplary diagrams for illustrating the structure of a display device 160 including a fingerprint sensor 380 according to various embodiments.

Referring to FIG. 3A, according to various embodiments, the display device 160 may further include a fingerprint sensor 380. FIG. According to various embodiments, the fingerprint sensor 380 may be implemented to correspond to or correspond to a partial area of the display device 160. According to various embodiments, the fingerprint sensor 380 can detect (e.g., acquire a fingerprint image) a fingerprint of a user based on at least one of an optical scheme, a capacitive scheme, and an ultrasound scheme. According to various embodiments, the optical system may include a light source such as a light emitting diode (e.g., an LED (light emitting diode)) to illuminate a user ' s fingerprint and to generate a fingerprint image based on the light reflected by the fingerprint (E.g., acquire) the information. According to various embodiments, the capacitive method includes a method of detecting the fusing and scoring of a finger based on a change in the capacitance of a fingerprint sensor (e.g., a fingerprint sensor 380) can do. According to various embodiments, the capacitive scheme may include a self capacitance scheme and a mutual capacitance scheme. According to various embodiments, the ultrasound method is a method in which an ultrasound signal output from an electronic device (e.g., a fingerprint sensor 380) is subjected to fingerprint detection based on a change in intensity of an ultrasound signal after the fingerprint And < / RTI >

According to various embodiments, the fingerprint sensor 380 (e.g., display device 160) includes an image sensor for acquiring a fingerprint image according to an optical scheme, a transceiver module for acquiring a fingerprint image according to an ultrasound method, And an electrode pattern for acquiring a fingerprint image according to the capacitance type.

A fingerprint sensor 380 according to various embodiments may be formed between the adhesive material 340 and the touch panel 220, as shown in FIG. The fingerprint sensor 380 according to various embodiments may be formed on the PCB 370 (e.g., with a structure covering at least a portion of the PCB), as shown in FIG. 3B. The fingerprint sensor 380 according to various embodiments may be implemented as one sensor that is integrated (e.g., integral) in at least a portion of the touch sensor 220 to perform both fingerprint sensing and touch sensing.

According to various embodiments, the display device 160 includes an adhesive material 340 for adhering the protective cover 210 and the fingerprint sensor 380 to each other, a sealing structure for protecting the fingerprint sensor 380, An elastic body 360 for alleviating the impact applied to the display panel 230 or preventing the entry of foreign matter into the display panel 230 and at least one of the PCBs 370 . ≪ / RTI >

2 to 3B are illustrative for illustrating various embodiments of an electronic device (e.g., display device 160) that includes a fingerprint sensor (e.g., fingerprint sensor 380) Various embodiments are not limited by the description with reference to FIG. 3B. According to various embodiments, various embodiments may be implemented on-screen based on a sensor capable of performing both fingerprint sensing and touch sensing via a display device (e.g., display device 160) (E.g., implemented).

4A to 4D are exemplary diagrams illustrating an operation in which a fingerprint image is obtained by a fingerprint sensor using a capacitive method, according to various embodiments.

4A, a fingerprint sensor (e.g., fingerprint sensor 380 in FIG. 3A) using a capacitive method in accordance with various embodiments is configured to detect finger 402 and finger 402 of fingerprint 400 relative to protective layer 420, It is possible to detect a capacitance change due to the contact of the valley 404. According to various embodiments, the fingerprint sensor may generate (e.g., acquire) an image that includes the shape of the fingerprint 400 based on changes in capacitance. According to various embodiments, the fingerprint sensor may include a protective layer 420 and a fingerprint sensing electrode 410. Referring to FIG. 4B, in accordance with the contact of the fingerprint 400 as shown in FIG. 4A, a fingerprint image including the shape of the finger 402 and the valley 404 can be obtained.

In FIG. 4C, there is contact with fingerprint 400 (e.g., having a large fused-bone ratio) having troughs 402 and troughs 404 having a gentle slope than the fingerprint 400 shown in FIG. 4A Are illustrated by way of example. The fingerprint 400 having a large fused-ridge ratio can narrow the interval between the fins 402 and the valleys 404 in the obtained fingerprint image 430, as shown in FIG. 4D.

For convenience of description herein, when data for an object (e.g., image, algorithm, etc.) is stored in an electronic device (e.g., memory 130 of FIG. 1) 1 < / RTI > memory 130). "

Figs. 5A and 5B are illustrations for explaining the fusion-bone ratio of a fingerprint according to various embodiments. Fig.

5A, an electronic device 101 in accordance with various embodiments estimates the fusion-bone image of a user's fingerprint (e.g. fingerprint 400 of FIG. 4) from the obtained fingerprint image 430 : Judgment or confirmation). The fusion-to-bone ratio according to various embodiments may be determined based on the area corresponding to the jung 402 in the fingerprint image 430 (referred to herein as "first area" (Hereinafter referred to as "second region" for convenience of description in this document) corresponding to the size of the width of the fingerprint image 430 (the dot hatching region in the fingerprint image 500) (Which may be simply referred to as "width" in the present document for the sake of convenience of explanation) of the width (for example, the area other than the dot hatched area in the enlarged image 500) .

Referring to FIG. 5A, the finger-to-bone ratio can be estimated to be 1.15: 1 for the fingerprint 400 shown in FIG. 4A. Referring to FIG. 5B, the finger-to-bone ratio can be estimated to be 2.31: 1 for the fingerprint 400 shown in FIG. 4C. According to various embodiments, the ratio of jung-bones may have different characteristics depending on sex or age, respectively. In other words, the fusion-to-bone ratio can be used as one feature point in authenticating the user's fingerprint. According to various embodiments, the fusion-to-bone ratio may have a smaller ratio than a male (e.g., 1.15: 1) to an female (e.g., 2.31: 1).

6 is an exemplary diagram illustrating a method of operating an electronic device, in accordance with various embodiments.

6, an electronic device (e.g., processor 120 of FIG. 1) in accordance with various embodiments may be configured to detect, at act 600, a biometric sensor (e.g., fingerprint sensor 380 of FIG. A fingerprint image based on at least the fingerprint of the user can be obtained.

6, an electronic device (e.g., processor 120 of FIG. 1) in accordance with various embodiments may use the fingerprint image (e.g., fingerprint image 430 of FIG. 4b) The ratio of the width of the fingerprint (for example, the finger 402 in FIG. 4A) to the width of the fingerprint (for example, the fingerprint 404 in FIG. 4A) can be estimated. According to various embodiments, at least a portion of the region of the acquired fingerprint image may be used to determine (e.g., verify) the fusion-to-bone ratio. According to various embodiments, an electronic device (e.g., processor 120 of FIG. 1) may extract some images (e.g., regions) of the fingerprint image to estimate the fusion-to-bone ratio of the user's fingerprint . According to various embodiments, an electronic device (e.g., the processor of FIG. 1) may include, for example, a central point located at a central portion of a fingerprint image, an end point at which a single ridge ends in a continuous line, An image of a portion where there is no feature point such as a bifurcation point divided into two branches can be extracted as an image for estimating the fusion-bone ratio. According to various embodiments, the image to be extracted may be extracted, for example, to include seven or fewer fins (e.g., Jung 402 in FIG. 4A) in the extracted image. However, the operation of extracting a part of images from the fingerprint image is exemplarily described for explaining various embodiments, and thus various embodiments are not limited thereto. According to various embodiments, some of the fingerprint images extracted by an electronic device (e.g., processor 120 of FIG. 1) may be extracted in a random manner. According to various embodiments, the entire acquired fingerprint image may be used to determine the fusion-to-bone ratio.

According to various embodiments, with respect to operation 610, an electronic device (e.g., processor 120 of FIG. 1) may use a filter bank to provide a filter bank of user fingerprint (e.g. fingerprint 400 of FIG. 4) Bone ratio can be estimated. Alternatively, in accordance with various embodiments, the electronic device (e.g., processor 120 of FIG. 1) may use fingerprints obtained by a fingerprint sensor (e.g., fingerprint sensor 380 of FIG. 3A) An image (e.g., the fingerprint image 430 of FIG. 4B) may be used to estimate the fusion-to-bone ratio of the user's fingerprint (e.g. fingerprint 400 of FIG. 4A). 7 to 8C illustrate an embodiment for estimating the fusion-bone ratio of a user's fingerprint using a filter bank. Figs. 9A to 11B show an embodiment for estimating the fusion-bone ratio of a fingerprint of a user without using a filter bank.

FIG. 7 is an exemplary diagram for describing filters 700a, 700b, 700c, 700d, 700e, 700f included in a filter bank according to various embodiments.

7, filters (e.g., sample images) 700a, 700b, 700c, and 700d having various ratios of ridge-to-bore are embedded in electronic devices (e.g., memory 130 of FIG. 1) 700d, 700e, and 700f may be stored. In Fig. 7, various filters are shown as images for the purpose of explaining the various embodiments. According to various embodiments, a gabor filter may be applied to estimate the fusion-to-bone ratio of the user's fingerprint (e.g. fingerprint 400 of FIG. 4A). According to various embodiments, a Gabor filter may refer to a filter designed to detect edges of various thicknesses and orientations from an image. According to various embodiments, the Gabor filter function representing the Gabor filter may be a product of a Gaussian function and a sinusoidal function, for example, as in Equation (1) below.

In Equation (1), the parameters?,?,?,?, And? May denote the wavelength, orientation, phase, Gaussian sigma, and Gaussian aspect ratio of the filter, respectively. Therefore, if it is desired to detect edges in eight directions (0 °, 22.5 °, 45 °, 67.5 °, 90 °, 112.5 °, 135 ° and 157.5 °) of the image, The eight edges of the image can be detected by convoluting the image and each filter (e.g., performing a convolution operation). In equation (1), (x, y) may refer to a pixel location within an image (e.g., an acquired fingerprint image) and a feature of the Gabor filter function g (x, y) .

According to various embodiments, an electronic device (e.g., processor 120 of FIG. 1) may store pixel values of various filters stored in an electronic device (e.g., memory 130 of FIG. 1) (Fingerprint image 430 of fingerprint image 4b). According to various embodiments, an electronic device (e.g., processor 120 of FIG. 1) may be configured to determine, as a result of the convolution operation, the ratio of the jaw- Can be estimated by the fusion-to-bone ratio of the fingerprint (e.g., the fingerprint 400 of the user of FIG. 4A). A description thereof will be described with reference to Figs. 8A to 8C.

8A-8C are exemplary diagrams illustrating a convolution operation for determining a fusion-to-graft ratio of a user's fingerprint, in accordance with various embodiments.

8A), an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be coupled to each of the filters (e.g., Images)) and the pixel value of the fingerprint image. For example, a 3 x 3 matrix (e.g., 8 bits), as shown below filter coefficients (e.g., W1 through W9) (e.g., pixel values) and pixel values of the fingerprint image (e.g., X1 through X9) Can be performed.

Referring to FIG. 8B, a case where a maximum response 800 is output as a result of performing a convolution operation according to various embodiments is exemplarily shown. In equation (2), (R) may mean that the term response is abbreviated as the letter "R ". An electronic device (e.g., processor 120 of FIG. 1) in accordance with various embodiments performs a convolution operation on each of the filters stored in an electronic device (e.g., memory 130 of FIG. 1) The filter outputting unit 800 can be determined. Referring to FIG. 8C, a case where a minimum response 810 is output as a result of a convolution operation between a filter and a fingerprint image is exemplarily shown. According to various embodiments, as a result of application of a filter (e.g., a Gabor filter), if the maximum response is output for a filter having a fusing-bone ratio of 1.15: 1, .

Figs. 9A-9D are exemplary diagrams for explaining the operation of estimating the fusion-bone ratio in the acquired fingerprint image, without using the filter bank, according to various embodiments. Fig.

9A, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be configured to generate a fingerprint image (e.g., fingerprint image 430 of FIG. 4B) Can be extracted. According to various embodiments, for operation 900, a description of extracting a portion of a fingerprint image, described in connection with operation 600, may be equally applicable. According to various embodiments, operation 900 may be omitted and performed.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at act 910, estimate the orientation of the fusion-bone based on a gradient of the extracted fingerprint image. 9B, the electronic device (e.g., processor 101 of FIG. 1) according to various embodiments may be configured to position the extracted fingerprint image 905 on the X and Y axes, for example, (402) and / or the valley (404). However, it is to be understood that this is illustratively illustrated to illustrate various embodiments, and various methods may be applied to estimate the orientation of the jug 402 and / or the valley 404 based on the gradient.

Electronic processor (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at act 920, rotate the extracted fingerprint image such that the extracted fingerprint image is in a vertical orientation, Operation. Referring to Figure 9C, the electronic device (e.g., processor 120 of Figure 1) is configured to determine whether the fins 402 and / or the valleys 404 are oriented in the vertical direction Direction).

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may determine, at act 930, the number of pixels contained in the first region within the specified region of the rotated fingerprint image, The ratio of the number of pixels to the number of pixels can be determined. 9D, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may extract a designated region 925 from a rotated image 915. FIG. According to various embodiments, an electronic device (e.g., processor 101 of FIG. 1) may be configured to include a first region and a second region in a designated region 925, as shown in FIG. 9D. Can be extracted. However, this is illustrative to illustrate various embodiments, and an electronic device (e.g., processor 101 of FIG. 1) may extract a designated area 925 according to various methods. According to various embodiments, an electronic device (e.g., processor 101 of FIG. 1) includes 30 pixels in an area corresponding to a first area included in a designated area 925, When 13 pixels are included in the corresponding area, the fog-to-fog ratio of the fingerprint of the user (e.g. fingerprint 400 in Fig. 4A) can be estimated to be 2.307: 1 (i.e., 30:13).

According to various embodiments, an electronic device (e.g., processor 120 of FIG. 1) in accordance with various embodiments may be configured such that after operation 920, to remove noise, pixels included in the first region, And performing averaging on the pixel values of the pixels included in the image data.

Figures 10A and 10B illustrate an operation for determining the manner of processing a fingerprint image based preferentially on the size of the width for a goal in a captured fingerprint image, without using a filter bank, in accordance with various embodiments. Fig.

10A, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments includes, at operation 1000, a fingerprint image (e.g., fingerprint image 430 of FIG. 4B) Can be extracted. For operation 1000, the description of operation 900 can be equally applied.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at operation 1010, estimate the orientation of the fusion-bone based on the gradient of the extracted fingerprint image. For operation 1010, the description of operation 910 may be equally applied.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments includes, at operation 1020, an operation to rotate the extracted fingerprint image to be vertical, based on the direction of the estimated finger- can do. For operation 1020, the description of operation 920 may be equally applied.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at operation 1030, determine the width of the second area of the rotated fingerprint image. According to various embodiments, with respect to operation 1020, various techniques for determining distances on the image (e.g., width Wv in Figure 10B) may be applied. For example, referring to FIG. 10B, an electronic device (e.g., processor 120 of FIG. 1) according to various embodiments may be configured to rotate a fingerprint based on the number of pixels extending in a horizontal axis The size of the width Wv of the area corresponding to the valley 404 in the image 915 can be calculated.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may determine at operation 1040 whether the size of the width determined in accordance with operation 1030 exceeds a specified range of values (e.g., a threshold) It can be judged. According to various embodiments, when the magnitude of the width determined according to operation 1030 exceeds a threshold (e.g., 20 micrometers), the electronic device (e.g., processor 101 of FIG. 1) (For example, 1.15: 1) of the fingerprint of the user (e.g. fingerprint 430 of FIG. 4A) is small. Conversely, when the magnitude of the width determined in accordance with operation 1030 does not exceed a threshold (e.g., 20 micrometers), the electronic device (e.g., processor 101 of FIG. 1) (E.g., fingerprint 430 in FIG. 4A) is large (e.g., 4: 1). In this document, whether the fusion-bone ratio exceeds the threshold value can be judged based on the fusion (for example, the fusion ratio). For example, when the threshold value is set to 3: 1, 4: 1 exceeds the threshold value, and 2: 1 does not exceed the threshold value.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be configured such that, at operation 1050, the width of the second region (e.g., the width of the valley 404) (E.g., the fingerprint image 430 of FIG. 4D) in accordance with the first processing method when the fingerprint image is not exceeded (e.g., below the threshold value). According to various embodiments, the first processing scheme is a pre-processing algorithm for fingerprint images (e.g. fingerprint image 430 of FIG. 4B), referred to herein as "first algorithm" (Which may be referred to as the term " second algorithm "for convenience of description in this document) for increasing the resolution.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be configured such that, at operation 1060, the width of the second region (e.g., the width of the valley 404) The fingerprint image (for example, the fingerprint image 430 in Fig. 4B) may be processed in accordance with the second processing method. According to various embodiments, the second processing scheme may refer to a pre-processing algorithm for the fingerprint image and a processing scheme that does not apply an algorithm for increasing the resolution. Alternatively, according to various embodiments, the second processing scheme may refer to a processing scheme that applies only a pre-processing algorithm to the fingerprint image.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may use the first processing method or the second processing method to transfer the processed fingerprint image to an electronic device (e.g., Memory 130).

FIGS. 11A and 11B are diagrams for explaining the case where the filter bank is not used, the sizes of the regions corresponding to the Yug are summed, the sizes of the regions corresponding to the bones are summed, And FIG.

Referring now to FIG. 11A, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments is operable to display, at operation 1100, a portion of a fingerprint image (e.g., fingerprint image 430 of FIG. 4B) Can be extracted. For operation 1100, the description of operation 900 may be equally applicable.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at act 1110, estimate the orientation of the fusion-bone based on a gradient of the extracted fingerprint image. For operation 1110, the description of operation 910 may be equally applied.

The electronic device (e.g., processor 101 of FIG. 1) according to various embodiments includes, at operation 1120, an operation to rotate the extracted fingerprint image to be in the vertical direction, based on the orientation of the estimated fusion- can do. For operation 1020, the description of operation 920 may be equally applied.

The electronic device (e.g., processor 101 of FIG. 1) according to various embodiments may sum the magnitude of the width of the first region included in the designated region of the rotated fingerprint image at operation 1130.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may sum the magnitudes of the widths of the second regions included in a designated one of the rotated fingerprint images at operation 1140. According to various embodiments, an electronic device (e.g., processor 101 of FIG. 1) may be configured to have a first region of widths (e.g., width 1, width 2, width 3) The widths of the regions (e.g., width A, width B, width C) can be summed, respectively. According to various embodiments, the term "summing" can be used generically / interchangeably with the term "integral ".

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments is configured to determine whether the fingerprint of the user based on the value of the width of the summed first region and the value of the width of the second region, Can be estimated. According to various embodiments, an electronic device (e.g., processor 101 of FIG. 1) may include a user's fingerprint (e.g., width 1 + width 2 + width 3) : The fingerprint 400 of FIG. 4A). For example, if width 1 is 480 micrometers, width 2 is 479 micrometers, width 3 is 481 micrometers, width A is 350 micrometers, width B is 370 micrometers, and width C is 361 micrometers , The estimated fusion-to-bone ratio can be estimated at 1440: 1081, i.e., 1.33: 1. According to various embodiments, the designated area 1105 may be determined according to various methods.

According to various embodiments, for each filter included in the filter bank, information about the width of each of the ridges and bones, as well as the ridge-to-ridge ratio, may be stored together. An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may include information about the stored Jung Width corresponding to a filter having a maximum response according to a convolution operation (e.g., Equation 2) The processing method and / or the authentication method for the fingerprint image may be determined based on at least a part of the information on the width.

12 is an exemplary diagram illustrating a method of operating an electronic device, in accordance with various embodiments. In FIG. 12, an embodiment is shown for storing (e.g., registering) a fingerprint image in an electronic device (e.g., memory 130 in FIG. 1), based on estimated fusion-bone rates according to various embodiments.

12, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be implemented in an operation 1200, using a biometric sensor (e.g., fingerprint sensor 380 of FIG. 3A) It is possible to estimate the fusion-to-bone ratio of the user's fingerprint (e.g. fingerprint 400 in FIG. 4A) based on the fingerprint image (e.g., registered fingerprint image). For operation 1200, a method for estimating the fusion-bone ratio according to various embodiments may be applied.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at operation 1210, determine whether the fusion-to-bone ratio of the estimated user's fingerprint exceeds a threshold. According to various embodiments, the threshold according to operation 1210 may be, for example, 3: 1, but is not limited thereby.

(E.g., processor 101 of FIG. 1), in operation 1220, if the estimated fusing-bone ratio exceeds a threshold value as a result of the determination at operation 1210 (e.g., A ratio of 4: 1), a first algorithm for preprocessing may be applied to the acquired fingerprint image (e.g., the fingerprint image 300 of FIG. 4B). According to various embodiments, the first algorithm may be implemented using a contrast enhancement algorithm, a normalization algorithm, a deblur algorithm, a noise reduction algorithm, a histogram equalization algorithm, And an isotropic filtering algorithm.

(E.g., processor 101 of FIG. 1), in operation 1230, if the estimated fusing-bone ratio exceeds the threshold, as a result of the determination at operation 1210, A second algorithm may be applied to the preprocessed fingerprint image according to operation 1220. [ The second algorithm according to various embodiments may be implemented using at least one of a single-frame-based super-resolution algorithm, a multi-frame-based super-resolution algorithm, an example-based super-resolution algorithm and an iterative back- Algorithm. The electronic device (e.g., processor 101 of FIG. 1) according to various embodiments may apply the at least one second algorithm to the fingerprint image to which the first algorithm is applied to increase the resolution.

13A and 13B are exemplary diagrams for comparing the resolution before the first algorithm for increasing the resolution and after the first algorithm is applied, according to various embodiments.

13A and 13B, when comparing the resolution of the image 1300 before applying the second algorithm to the fingerprint image (e.g., the fingerprint image 430 of FIG. 4B), a fingerprint image (e.g., It can be seen that the resolution of the image 1210 after applying the second algorithm to the fingerprint image 430 of FIG.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at operation 1240, store the fingerprint image and the estimated fusion-to-bone ratio in an electronic device (e.g., memory 130 of FIG. 1) . According to various embodiments, the electronic device (e.g., processor 101 of FIG. 1) may determine that the first algorithm and the second algorithm do not exceed the threshold if the estimated fusion- A fingerprint image to which the algorithm is not applied may be stored in an electronic device (e.g., memory 130 of FIG. 1). An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may generate a fingerprint image to which a first algorithm and a second algorithm have been applied in action 1240 according to act 1220 and act 1230, 1 < / RTI > memory 130). According to various embodiments, a fingerprint image stored in an electronic device (e.g., memory 130 of FIG. 1) in accordance with operation 1240 may be stored as a registered image. According to various embodiments, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may include information about a first algorithm applied to a fingerprint image in accordance with act 1220 and act 1230, (E. G., Memory 130 of FIG. 1). ≪ / RTI >

According to various embodiments, when the fingerprint is set to be input repeatedly (e.g., 5 times) for the registration of the fingerprint, the fingerprint image finally determined as the registered fingerprint image, An estimation method and a fingerprint image processing method can be applied.

14A to 14D are illustrative diagrams illustrating an operation in which a fingerprint of a user is registered according to various embodiments.

14A, an electronic device 101 according to various embodiments is configured to display an application (e.g., Samsung) that requires user authentication to use (e.g., execute) an application on a display device 160 Quot; connect " application) can be displayed. According to various embodiments, the electronic device 101 may display a notification message 1402 requesting fingerprint registration for user authentication on the execution screen 160 of the application if the fingerprint of the user is not registered have. In Fig. 14A, an electronic device 101 is illustrated illustratively, which, according to various embodiments, senses a user's fingerprint based on an on-screen method. The on-screen method according to various embodiments may be based on at least one of an optical method, a capacitive method and an ultrasonic method. The electronic device 101 according to various embodiments is configured to display a user interface (e.g., a dotted line) that guides a fingerprint input area 1410 for receiving a fingerprint of a user as a display device (e.g., 160). The fingerprint input area 1410 according to various embodiments may correspond to at least a portion of the area of the display device 160. [ The electronic device 101 according to various embodiments may display a user interface (e.g., an arrow) that guides the user to the fingerprint input area 1410 on a display device (e.g., an application's execution screen 160) . However, according to various embodiments, various user interfaces for displaying the fingerprint input area 1410 and various user interfaces for guiding the user to the fingerprint input area 1410 can be displayed.

14B, the electronic device 101 according to various embodiments may obtain information about the fingerprint of the user 1420 from the user 1420 through the fingerprint input area 1410. [ The electronic device 101 according to various embodiments is capable of displaying on the execution screen 1400 of the application a notification message (e.g., "Registering a fingerprint") indicating that the fingerprint is being registered (e.g., Can be displayed.

14C, the electronic device 101 in accordance with various embodiments may obtain information about the fingerprint of the user 1420 and then, in accordance with various embodiments, Bone ratio can be estimated. The electronic device 101 in accordance with various embodiments may provide a notification message (e.g., extracting a fusion-bone rate) indicating that the finger-bone rate of the fingerprint of the user 1420 is being estimated, Can be displayed on the execution screen 1400 of FIG.

14C, an electronic device 101 according to various embodiments may be configured so that fingerprint images and finger-bone ratios of a user 1420 are stored in an electronic device (e.g., memory 130 of FIG. 1) The notification message 1404 indicating that the application is registered can be displayed on the execution screen 1400 of the application.

14A to 14D show only a case where various notification messages are displayed on the display device 160, according to various embodiments, the notification message may include auditory effects (e.g., audio) and / or tactile effects E.g., vibration) to the user 1420.

Figures 15 and 16 are illustrative diagrams illustrating a method of operating an electronic device (e.g., electronic device 101 of Figure 1), in accordance with various embodiments. In Fig. 15, a method of processing a fingerprint image using a predetermined algorithm (e.g., a second algorithm) according to an estimated fusion-to-bone ratio is shown. In FIG. 16, a method of authenticating a user according to the fusion-to-bone ratio of the registered fingerprint image and the registered fingerprint image and whether the fusion fingerprint image and the authentication fingerprint image match the fusion-bone ratio are shown.

15, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be used in an operation 1500 to obtain an electronic device (e. G., A fingerprint sensor 380) (E.g. fingerprint 400 of FIG. 4A) of a user (e.g., user 1420 of FIG. 14B) based on a fingerprint image (e.g. fingerprint image 430 of FIG. 4A) . According to various embodiments, various methods of estimating the fusion-bone ratio can be applied to operation 1500, according to various embodiments.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may determine, at operation 1510, a second algorithm that is predetermined based on the fusion-to-bone ratio, based on the estimated fusion- Can be applied. For example, if the estimated fusion-to-bone ratio exceeds the first threshold value and is less than the second threshold, if a predetermined algorithm is applied to the fingerprint image in a single-frame method as the designated algorithm, : Processor 120 of FIG. 1) may apply a single-frame-based super resolution algorithm to the fingerprint image if the estimated fused-to-bone ratio exceeds the first threshold and is less than the second threshold. Alternatively, if the estimated fusion-to-bone ratio exceeds a second threshold, it is possible to use an electronic device (e.g., processor 120 of FIG. 1 ) May apply the multi-frame method of super resolution algorithm to the fingerprint image when the estimated fusion-to-bone ratio exceeds the second threshold value. According to various embodiments, the operations described in connection with Fig. 15 can be equally applied to the first algorithm.

16, an electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be implemented in a computer system, such as the processor 101 of FIG. 1, using a biometric sensor (e.g., fingerprint sensor 380 of FIG. Based on the fingerprint image, the fusion-bone ratio of the user's fingerprint (e.g. fingerprint 400 of FIG. 4A) can be estimated. For operation 1600, various methods for estimating the fusion-to-bone ratio can be applied, according to various embodiments.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at act 1610, determine whether the estimated fusing-bone ratio exceeds a threshold. According to various embodiments, the threshold according to operation 1610 may be, for example, 3: 1, but is not limited thereby.

(E.g., processor 101 of FIG. 1), in accordance with various embodiments, may determine, at operation 1620, if the estimated fusing-bone ratio exceeds a threshold value (e.g., A ratio of 4: 1), a first algorithm for preprocessing may be applied to the acquired fingerprint image (e.g., the fingerprint image 300 of FIG. 4B). According to various embodiments, the first algorithm may be applied to one or more first algorithms in the fingerprint image.

(E.g., processor 101 of FIG. 1), at operation 1630, if the estimated fusing-bone ratio exceeds the threshold value as a result of the determination at operation 1610, The second algorithm can be applied to the preprocessed fingerprint image. According to various embodiments, the second algorithm may be applied to the fingerprint image by one or more second algorithms.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be operable to generate a fingerprint image (e.g., a registered fingerprint image) stored in an electronic device (e.g., memory 130 of FIG. 1) , And determine whether the fingerprint image (e.g., authenticated fingerprint image) to which the first algorithm and the second algorithm have been applied according to operation 1620 and operation 1630 are matched to each other. (E.g., processor 101 of FIG. 1) according to various embodiments may be configured such that at operation 1640, if the estimated fusing-bone ratio does not exceed the threshold, the first and second algorithms (E.g., registered fingerprint image) stored in an electronic device (e.g., the memory 130 in Fig. 1) and an unaffected fingerprint image (e.g., authenticated fingerprint image) match each other. According to various embodiments, the electronic device (e.g., processor 101 of FIG. 1) may determine, at operation 1640, not only the feature points (e.g., center point, end point, It is also possible to determine whether a match is found (including a match within a specified error range). According to various embodiments, the electronic device (e.g., the processor 101 of FIG. 1) may determine that the feature points of the registered fingerprint image and the authenticated fingerprint image coincide with each other, .

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may, at operation 1650, authenticate the user according to the matching result according to act 1640. According to various embodiments, the electronic device (e.g., the processor 101 of FIG. 1) may authenticate as a legitimate user if the feature points of the registered fingerprint image and the authenticated fingerprint image and the estimated fusion-to- .

17A to 17C are exemplary diagrams for explaining an operation in which user authentication fails due to a difference between a registered fingerprint and a fingerprint for authentication, in accordance with various embodiments.

17A, when an execution request for an application (for example, a Samsung® connect ™ application) requiring authentication for use is received from the user, the electronic device 101 according to various embodiments executes an application execution screen 1100), a notification message 1700 indicating that the fingerprint authentication is necessary can be displayed.

17B, an electronic device 101 in accordance with various embodiments obtains information about a fingerprint of a user 1420 (e.g., detects a fingerprint) through a fingerprint input area 1410 from a user 1420, can do. The electronic device 101 according to various embodiments can generate a fingerprint image using the information on the obtained fingerprint.

17C, electronic device 101 in accordance with various embodiments determines whether a fingerprint image obtained for user authentication and a fingerprint image stored in an electronic device (e.g., memory 130 of FIG. 1) Can be determined. As a result of the determination, if the fusion-bone ratios of the authentication fingerprint image and the registered fingerprint image do not coincide with each other, a notification message 1710 indicating that the authentication failed due to mismatching of the fusion- ). ≪ / RTI >

18A and 18B are exemplary diagrams illustrating a method of operating an electronic device, in accordance with various embodiments.

Referring now to Figure 18A, an electronic device (e.g., processor 101 of Figure 1) in accordance with various embodiments is operable to generate a fingerprint image (e.g., fingerprint image) using a biometric sensor (e.g., fingerprint sensor 380 of Figure 3a) Can be obtained.

(E.g., processor 101 of FIG. 1), at operation 1810, determines, at act 1810, the size of the width of the first region corresponding to the finger in the fingerprint image and the width of the second region The ratio of the size can be confirmed.

(E.g., processor 101 of FIG. 1), in accordance with various embodiments, may determine, based on the ratio identified in accordance with act 1810, at operation 1820, at least one of the plurality of image processing methods Can be selected.

An electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may process the fingerprint image at operation 1830 using the at least one image processing method.

Referring now to Figure 18B, an electronic device (e.g., processor 101 of Figure 1) in accordance with various embodiments may be configured to perform a first operation using a biometric sensor (e.g., fingerprint sensor 380 of Figure 3a) A fingerprint image can be obtained.

The electronic device (e.g., processor 101 of FIG. 1) according to various embodiments may, at act 1850, determine the magnitude of the width of the region corresponding to the goal among the first fingerprint images.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments may be configured such that, at operation 1860, if the magnitude of the width identified in accordance with operation 1850 falls within a first specified range, Authentication of the first fingerprint image can be performed.

The electronic device (e.g., processor 101 of FIG. 1) in accordance with various embodiments is configured such that, at act 1870, if the magnitude of the width identified according to act 1850 falls within a second specified range, Authentication of the first fingerprint image can be performed.

Electronic devices 101 (e.g., electronic device 101 of FIG. 1) in accordance with various embodiments may include a biometric sensor (e.g., fingerprint sensor 380 of FIG. 3A) and a processor (E.g., the processor 120 of FIG. 1), which enables the biometric sensor to acquire a fingerprint image (e.g., fingerprint image 430 of FIG. 4B) The ratio of the size of the width of the first area corresponding to the ridge 402 of FIG. 4A and the size of the width of the second area corresponding to the rib (e.g., the bones 404 of FIG. 4A) Based on the at least one image processing method, selecting at least one image processing method for the fingerprint image among the plurality of image processing methods, and processing the fingerprint image using the at least one image processing method.

According to various embodiments, the processor may be configured to identify the ratio using a plurality of filters (e.g., filters 700a through 700f in FIG. 7).

According to various embodiments, the processor may be configured to determine, based on the result of the convolution operation of the fingerprint image and the plurality of filters, the percentage of the filter having the largest response output, have.

According to various embodiments, the processor may be configured to: extract an image of a portion of the fingerprint image; identify a direction of the fusing-bone based on the gradient of the extracted fingerprint image; (E.g., image 915 in FIG. 9C), and the number of pixels included in the first area and the number of pixels included in the second area May be set to identify the ratio based on the number.

According to various embodiments, the processor may be configured to: extract an image of a portion of the fingerprint image; identify a direction of the fusing-bone based on the gradient of the extracted fingerprint image; Summing the magnitudes of the widths of the first regions, summing the magnitudes of the widths of the second regions, and calculating the sum of the magnitudes of the first and second regions in the first region of the rotated fingerprint image, The size of the width of the area and the size of the width of the summed second area may be compared to confirm the ratio.

According to various embodiments, the electronic device further comprises a memory (e.g., memory 130 of FIG. 1), wherein the processor performs a preprocessing on the fingerprint image if the ratio exceeds a specified percentage Applying at least one of a first algorithm to increase the resolution of the fingerprint image or a second algorithm to increase the resolution of the fingerprint image to the fingerprint image and to store data for the fingerprint image to which the at least one algorithm is applied Can be set.

According to various embodiments, the processor applies a first algorithm to the fingerprint image to perform a preprocessing on the fingerprint image if the ratio does not exceed a specified percentage, and if the first algorithm is applied And store the data for the fingerprint image in the memory.

Electronic device 101 (e.g., electronic device 101 of FIG. 1) according to various embodiments includes a biometric sensor (e.g., fingerprint sensor 380 of FIG. 3a) and a processor (E.g., the processor 120 of FIG. 1), and the processor is configured to cause the biometric sensor to acquire a first fingerprint image (e.g., a fingerprint image obtained in accordance with the operation shown in FIG. 17B) Checking the size of the width of the area corresponding to the bone among the first fingerprint images and performing authentication on the fingerprint image based on the first process when the size of the width belongs to the first specified range, If the size of the first fingerprint image belongs to the second specified range, authentication is performed on the first fingerprint image based on the second process.

According to various embodiments, the first specified range may include the case where the size of the width of the area corresponding to the goal is less than the specified size.

According to various embodiments, the first process may include at least one of a first algorithm for performing a pre-processing on the first fingerprint image or a second algorithm for increasing the resolution of the first fingerprint image, A process of applying the at least one algorithm to a first fingerprint image, and a process of comparing the second fingerprint image stored in the memory of the electronic device based on the fingerprint image to which the at least one algorithm is applied.

According to various embodiments, the second specified range may include a case where the size of the width of the area corresponding to the goal exceeds a specified size.

According to various embodiments, the second process may include a process of comparing the obtained first fingerprint image with a second fingerprint image stored in a memory of the electronic device.

According to various embodiments, the processor may determine the size of the width of the area corresponding to the fins in the first fingerprint image, and determine the size of the width of the area corresponding to the fins and the width of the area corresponding to the fins Size ratio. ≪ / RTI >

According to various embodiments, the processor is configured to compare the identified ratio with a fusion-to-bone ratio for a second fingerprint image stored in a memory (e.g., memory 130 of FIG. 1) May be set to perform authentication.

According to various embodiments, the processor includes a display module (e.g., display 160 of FIG. 1), a vibration module (e.g., haptic module 179 of FIG. 1) to provide information related to the authentication to a user, And an audio module (e.g., the audio module 170 of FIG. 1).

The method of controlling an electronic device according to various embodiments is characterized in that the electronic device (e.g., electronic device 101 of FIG. 1) uses a biometric sensor (e.g., fingerprint sensor 380 of FIG. 3a) (E.g. fingerprint image 430 of FIG. 4B); and the electronic device is adapted to obtain a size of a width of a first region corresponding to a finger (e.g., Jung 402 of FIG. 4A) (E.g., the bones 404 in FIG. 4A) of the plurality of image processing schemes, and the size of the width of the second area corresponding to the bones Selecting at least one image processing scheme for the fingerprint image, and processing the fingerprint image using the at least one image processing scheme.

According to various embodiments, the act of confirming the ratios may be accomplished by using one or more filters designated to identify the ratios of the plurality of filters (e.g., filters 700a-700f of FIG. 7) Operation.

According to various embodiments, the act of confirming the ratio may include determining, at the rate, the ratio of the filter that outputs the largest response based at least on the convolution operation of the fingerprint image and the plurality of filters Operation.

According to various embodiments, the act of selecting at least one image processing scheme for the fingerprint image further comprises: a first algorithm for performing a preprocessing on the fingerprint image, And applying at least one of a second algorithm to increase the resolution of the image to the first fingerprint image.

According to various embodiments, the act of selecting at least one image processing scheme for the fingerprint image further comprises: if the ratio does not exceed a specified percentage, determining a first algorithm for performing a preprocessing on the fingerprint image And applying to the fingerprint image.

The electronic device according to the various embodiments disclosed herein can be various types of devices. An electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of the present document and the terminology used herein are not intended to limit the technical features described in this document to the specific embodiments, but to include various modifications, equivalents, or alternatives of the embodiments. In the description of the drawings, like reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. At least one of A or B, at least one of A and B, at least one of A or B, A, B or C, at least one of A, B and C, , B, or C, "may include all possible combinations of items listed together in the corresponding phrase of the phrases. Terms such as "first", "second", or "first" or "second" may simply be used to distinguish the component from the other component, Order). It is to be understood that any (e.g., first) component may be referred to as being "coupled" or "connected" to another (eg, second) component, with or without the term "functionally" When mentioned, it means that said component can be connected directly (e. G. By wire) to said another component, wirelessly, or via a third component.

The term "module" as used herein may include units implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic blocks, components, or circuits. A module may be an integrally constructed component or a minimum unit of the component or part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

The various embodiments of the present document may include one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) readable by a machine (e.g., electronic device 101) (E. G., Program 140). ≪ / RTI > For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may invoke and execute at least one of the stored one or more instructions from a storage medium. This enables the device to be operated to perform at least one function in accordance with the at least one command being called. The one or more instructions may include code generated by the compiler or code that may be executed by the interpreter. A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transient' means that the storage medium is a tangible device and does not include a signal (e.g., electromagnetic waves), which means that data is permanently stored on the storage medium Do not distinguish between cases where they are temporarily stored.

According to one embodiment, a method according to various embodiments disclosed herein may be provided in a computer program product. A computer program product can be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine readable storage medium (e.g., compact disc read only memory (CD-ROM)), or via an application store (e.g., PlayStore ™) For example, smartphones), directly or online (e.g., downloaded or uploaded). In the case of on-line distribution, at least a portion of the computer program product may be temporarily stored, or temporarily created, on a storage medium readable by a machine, such as a manufacturer's server, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (e.g., a module or program) of the components described above may include one or more entities. According to various embodiments, one or more of the above-described components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into one component. In such a case, the integrated component may perform one or more functions of each component of each of the plurality of components in a manner similar or similar to that performed by the corresponding one of the plurality of components prior to the integration . In accordance with various embodiments, operations performed by a module, program, or other component may be performed sequentially, in parallel, repetitively, or heuristically, or one or more of the operations may be performed in a different order, Or one or more other operations may be added.

Claims (20)

In an electronic device,
Biometric sensor, and
The processor comprising:
Acquiring a fingerprint image using the biosensor,
A ratio of a size of a width of a first region corresponding to a ridge and a size of a width of a second region corresponding to a valley in the fingerprint image,
Select at least one image processing scheme for the fingerprint image from among a plurality of image processing schemes based on the ratio; and
And to process the fingerprint image using the at least one image processing scheme. The method according to claim 1,
Wherein the processor is configured to determine the ratio using one or more filters that are designated to determine the percentage of the plurality of filters. 3. The method of claim 2,
Wherein the processor is configured to determine, based on the convolution operation of the fingerprint image and the plurality of filters, a ratio of a filter outputting the largest response at the ratio. The method according to claim 1,
Wherein the processor extracts an image of a portion of the fingerprint image,
Determining a direction of the fusion-bone based on the gradient of the extracted fingerprint image,
Rotating the extracted image so as to be vertical in accordance with the identified gradient, and
And to determine the ratio based on the number of pixels included in the first area and the number of pixels included in the second area in a designated area of the rotated fingerprint image. The method according to claim 1,
Wherein the processor extracts an image of a portion of the fingerprint image,
Determining a direction of the fusion-bone based on the gradient of the extracted fingerprint image,
Rotating the extracted image so as to be vertical in accordance with the determined gradient,
Summing the magnitudes of the widths of the first regions, summing the magnitudes of the widths of the second regions in a specified region of the rotated fingerprint images, and
And to compare the magnitude of the width of the summed first region and the magnitude of the width of the summed second region to determine the ratio. The method according to claim 1,
Further comprising a memory,
The processor comprising:
Wherein at least one of a first algorithm for performing a pre-processing on the fingerprint image or a second algorithm for increasing a resolution of the fingerprint image is applied to the fingerprint image when the ratio exceeds a specified ratio, , And
And store data for the fingerprint image to which the at least one algorithm is applied in the memory. The method according to claim 1,
Further comprising a memory,
The processor comprising:
Applying a first algorithm to the fingerprint image to perform a preprocessing on the fingerprint image if the ratio does not exceed a specified percentage; and
And store data for the fingerprint image to which the first algorithm is applied in the memory. In an electronic device,
Biometric sensor, and
And a processor coupled to be operable with the biosensor,
Acquiring a first fingerprint image using the biometric sensor,
Checking a size of a width of a region corresponding to a valley in the first fingerprint image,
Perform authentication on the fingerprint image based on a first process if the width of the fingerprint belongs to a first specified range, and
And to perform authentication for the first fingerprint image based on a second process when the size of the width belongs to a second specified range. 9. The method of claim 8,
Wherein the first specified range includes a case where a size of a width of an area corresponding to the goal is less than a specified size. 10. The method of claim 9,
Wherein the first process comprises:
A process of applying at least one of a first algorithm for performing a pre-processing to the first fingerprint image or a second algorithm for increasing a resolution of the first fingerprint image to the first fingerprint image , And
And a second fingerprint image stored in the memory of the electronic device based on the fingerprint image to which the at least one algorithm is applied. 9. The method of claim 8,
Wherein the second specified range includes a case where the size of the width of the area corresponding to the goal exceeds a specified size. 12. The method of claim 11,
Wherein the second process comprises a process of comparing the obtained first fingerprint image with a second fingerprint image stored in a memory of the electronic device. 9. The method of claim 8,
The processor comprising:
Checking a size of a width of a region corresponding to a ridge in the first fingerprint image,
And to determine a ratio of the magnitude of the width of the region corresponding to the groove to the magnitude of the width of the region corresponding to the valley. 14. The method of claim 13,
Wherein the processor is configured to compare the identified ratio with a fusion-to-bone ratio for a second fingerprint image stored in a memory of the electronic device to perform the authentication. 9. The method of claim 8,
Wherein the processor controls at least one of a display module, a vibration module, and an audio module to provide information related to the authentication to a user. A method of controlling an electronic device,
Wherein the electronic device obtains a fingerprint image using a biometric sensor,
Wherein the electronic device is further operable to identify a ratio of a magnitude of a width of a first region corresponding to a ridge and a magnitude of a width of a second region corresponding to a valley in the obtained fingerprint image,
The electronic device selecting, based on the ratio, at least one image processing scheme for the fingerprint image from among a plurality of image processing schemes; and
Wherein the electronic device includes processing the fingerprint image using the at least one image processing method. 17. The method of claim 16,
Wherein the act of verifying the ratio comprises verifying the ratio using one or more filters designated to identify the percentage of the plurality of filters. 18. The method of claim 17,
Wherein the act of verifying the ratio comprises ascertaining, at the rate, the ratio of the filter that outputs the largest response based at least on the convolution operation of the fingerprint image with the plurality of filters. / RTI > 17. The method of claim 16,
Wherein the act of selecting at least one image processing scheme for the fingerprint image comprises:
And a second algorithm for increasing the resolution of the fingerprint image, wherein the first algorithm for performing pre-processing on the fingerprint image or the second algorithm for increasing the resolution of the fingerprint image, when the ratio exceeds the specified ratio, And applying the fingerprint image to the fingerprint image. 17. The method of claim 16,
Wherein the act of selecting at least one image processing scheme for the fingerprint image comprises:
And applying a first algorithm to the fingerprint image to perform a preprocessing on the fingerprint image if the ratio does not exceed a specified percentage.

Images