CN115909426A - Fingerprint identification device, module, method, electronic equipment and computer program product - Google Patents

Fingerprint identification device, module, method, electronic equipment and computer program product Download PDF

Info

Publication number
CN115909426A
CN115909426A CN202211229268.3A CN202211229268A CN115909426A CN 115909426 A CN115909426 A CN 115909426A CN 202211229268 A CN202211229268 A CN 202211229268A CN 115909426 A CN115909426 A CN 115909426A
Authority
CN
China
Prior art keywords
fingerprint
image
module
control chip
main control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211229268.3A
Other languages
Chinese (zh)
Inventor
刘晓龙
王海生
陈可卿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jihao Technology Co Ltd
Original Assignee
Beijing Jihao Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jihao Technology Co Ltd filed Critical Beijing Jihao Technology Co Ltd
Priority to CN202211229268.3A priority Critical patent/CN115909426A/en
Publication of CN115909426A publication Critical patent/CN115909426A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Input (AREA)

Abstract

The application relates to the technical field of fingerprint identification, and provides a fingerprint identification device, a fingerprint identification module, a fingerprint identification method, electronic equipment and a computer program product. Wherein, fingerprint identification device includes: the fingerprint module and the master control chip; the fingerprint module is used for detecting whether touch operation exists or not, and if the touch operation exists, a trigger signal is sent to the main control chip; the fingerprint image acquisition device is used for acquiring image data of a fingerprint image and sending the acquired image data to the main control chip in the acquisition process; the main control chip is used for responding to the trigger signal, making data receiving preparation and informing the fingerprint module to collect image data of the fingerprint image; and the image data that is used for receiving the fingerprint module and sends obtains the fingerprint image according to image data to carry out fingerprint identification according to the fingerprint image. The device obviously improves the acquisition speed of the fingerprint image, further improves the efficiency of the fingerprint identification process and improves the user experience. In addition, the device has simple structure and is beneficial to saving the implementation cost.

Description

Fingerprint identification device, module, method, electronic equipment and computer program product
Technical Field
The invention relates to the technical field of fingerprint identification, in particular to a fingerprint identification device, a fingerprint identification module, a fingerprint identification method, electronic equipment and a computer program product.
Background
At present, along with the popularization of mobile devices such as mobile phones and the like, the application of fingerprint identification technology is more and more extensive. The fingerprint identification process mainly comprises two stages of fingerprint image acquisition and fingerprint image identification, the existing research generally focuses on the improvement of a fingerprint image identification algorithm, a large amount of time consumed by fingerprint image acquisition is ignored, so that the fingerprint identification efficiency is not high, and the use experience of a user is seriously influenced.
Disclosure of Invention
An embodiment of the present application provides a fingerprint identification apparatus, a fingerprint identification module, a fingerprint identification method, an electronic device, and a computer program product.
In order to achieve the above purpose, the present application provides the following technical solutions:
in a first aspect, an embodiment of the present application provides a fingerprint identification apparatus, including: the fingerprint module and the master control chip; the fingerprint module is used for detecting whether touch operation exists, and if the touch operation exists, a trigger signal is sent to the main control chip; the fingerprint image acquisition device is used for acquiring image data of a fingerprint image and sending the acquired image data to the main control chip in the acquisition process; the main control chip is used for responding to the trigger signal, preparing data receiving and informing the fingerprint module to acquire the image data of the fingerprint image; and the fingerprint identification module is used for receiving the image data sent by the fingerprint module, obtaining the fingerprint image according to the image data and carrying out fingerprint identification according to the fingerprint image.
In the above-mentioned device, the fingerprint module is when detecting touch operation, utilize triggering signal to inform the main control chip earlier, then just gather the fingerprint image under the notice of main control chip, consequently when the fingerprint image is gathered to the fingerprint module, the main control chip has made data reception preparation, thereby the fingerprint module can gather the image data of fingerprint image and send the image data who gathers for the main control chip on one side, and need not to wait until the image data of fingerprint image gathers and accomplish the back and then sends it to the main control chip, thereby the collection speed of fingerprint image has been showing and has been improved, and then just also improved the efficiency of whole fingerprint identification process, user's fingerprint identification experience has been improved.
In addition, fingerprint identification is directly carried out on the main control chip in the device, and no additional chip is arranged for fingerprint identification, so that the device is very simple in structure and beneficial to saving implementation cost.
In one implementation manner of the first aspect, the data reception preparation includes switching the master control chip from a state of lower power consumption to a state of higher power consumption.
In the implementation manner, the main control chip is switched from the state of lower power consumption to the state of higher power consumption, so that the image transmission operation is facilitated.
In an implementation manner of the first aspect, the fingerprint module includes a pixel array configured to acquire image data of the fingerprint image, and the fingerprint module is configured to acquire a first target pixel value acquired by a target pixel in the pixel array, determine, according to the first target pixel value, a first number of target pixel units that satisfy a touch determination condition, and determine whether the first number reaches a first total touch determination threshold, and if the first number reaches the first total touch determination threshold, determine that the touch operation exists; the target pixels are part of pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether the touch operation exists, and the target pixel unit is a pixel set formed by at least one target pixel.
In the implementation manner, only a part of pixels (target pixels) in the pixel array is used for detecting the touch operation, so that the power consumption of the device is saved, and the detection efficiency can be improved.
In an implementation manner of the first aspect, the determining, according to the first target pixel value, a first number of target pixel units that satisfy a touch determination condition, where the fingerprint module is a capacitor module, includes: determining a first number of target pixel units meeting a touch judgment condition according to a first target pixel value acquired by a target pixel in the target pixel units and a local touch judgment threshold, wherein the local touch judgment threshold is related to temperature.
Because the temperature can influence the electric capacity size, and then the pixel value that makes the pixel of electric capacity module gather changes, consequently, above-mentioned implementation considers the temperature factor when setting up local touch and judging the threshold value, is favorable to improving the accuracy that detects touch operation.
In one implementation manner of the first aspect, the target pixel unit includes: one target pixel, one row of target pixels, one column of target pixels, or one area of target pixels.
In the implementation manner, the target pixel unit can have different configuration manners, which is beneficial to more flexibly implementing the detection of the touch operation.
In an implementation manner of the first aspect, the main control chip is configured to determine whether the touch operation belongs to fast lift-up according to the fingerprint image, and terminate fingerprint identification if the touch operation belongs to fast lift-up.
In the implementation manner, if it is determined that the touch operation belongs to quick lifting, it indicates that the user may touch the fingerprint module carelessly, and fingerprint identification is not required, so that the fingerprint identification process can be terminated, and this is favorable for avoiding invalid fingerprint identification and improving the success rate of fingerprint identification.
In an implementation manner of the first aspect, the fingerprint module includes a pixel array configured to acquire image data of the fingerprint image, the main control chip is configured to acquire a second target pixel value acquired by a target pixel in the pixel array in the fingerprint image, determine, according to the second target pixel value, a second number of target pixel units that satisfy a touch determination condition, and determine whether the second number reaches a second total touch determination threshold, and if the second number does not reach the second total touch determination threshold, determine that the touch operation belongs to fast lift-up; the target pixels are part of pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether touch operation exists, the target pixel unit is a pixel set formed by at least one target pixel, and the second overall touch judgment threshold value is not larger than the first overall touch judgment threshold value.
In the above implementation manner, if the second number does not reach the second total touch determination threshold, it indicates that, when the fingerprint module collects a fingerprint image, the touch operation that triggered the image collection behavior before the fingerprint image collection behavior is not detected, so that it can be determined that the touch operation belongs to quick lift-up. The judgment method has simple logic and higher accuracy.
In an implementation manner of the first aspect, the main control chip is configured to determine whether the fingerprint image belongs to a low-quality image, and terminate fingerprint identification if the fingerprint image belongs to the low-quality image.
In the implementation mode, if the fingerprint image is judged to belong to the low-quality image, even if the fingerprint comparison is carried out on the image, the identification fails with high probability, so that the fingerprint identification process can be terminated, the number of times of fingerprint identification failure is reduced, and the success rate of fingerprint identification is improved.
In an implementation manner of the first aspect, the main control chip is configured to subtract a reference image from the fingerprint image to obtain a difference image, and determine whether the fingerprint image belongs to a low-quality image according to a pixel value in the difference image; wherein, the reference image is the image that the fingerprint module was gathered when not touching.
In the above implementation, since the reference image is an image captured by the fingerprint module without touch, and therefore includes the intrinsic noise of the module, subtracting the reference image from the fingerprint image is equivalent to filtering the intrinsic noise in the fingerprint image, so as to determine the image quality based on the difference image, and the result is more accurate.
In an implementation manner of the first aspect, the main control chip is configured to determine whether the fingerprint image belongs to a low-quality image, sharpen the fingerprint image if the fingerprint image belongs to the low-quality image, obtain a sharpened fingerprint image, and continue to perform fingerprint identification according to the sharpened fingerprint image.
In the implementation mode, if the fingerprint image is judged to belong to the low-quality image, the fingerprint image is sharpened firstly, the definition of the fingerprint image is improved as much as possible, and then fingerprint identification is carried out based on the sharpened fingerprint image, so that the success rate of fingerprint identification is favorably improved.
In an implementation manner of the first aspect, the main control chip is configured to compare the fingerprint image with a fingerprint template image in a base library to obtain a fingerprint identification result, and determine whether the fingerprint image belongs to a palm print image when the fingerprint identification result is identification failure; and if the fingerprint image belongs to the palm print image, the related operation of the identification failure is not executed, otherwise, the related operation of the identification failure is executed.
In the implementation manner, if the fingerprint image is judged to belong to the palm print image, the palm of the user is indicated to contact the fingerprint module, the user can only touch the fingerprint module with the palm carelessly under the condition and does not need to perform fingerprint identification, so that the user can not regard the fingerprint module as fingerprint identification failure and can not execute related operations (including one or more operations such as recording identification failure, recording equipment unlocking failure, vibration prompt and the like) of fingerprint identification failure, and the user experience is prevented from being reduced due to the operations.
In another implementation, the step of determining the palm print image may be performed before the fingerprint comparison, but considering that the fingerprint image belongs to the palm print image with a low frequency of occurrence, if the determination is performed before each fingerprint comparison, the fingerprint identification efficiency is affected, so the above implementation is performed after the fingerprint comparison.
In the case that the identification fails and the fingerprint image does not belong to the palm print image, the fingerprint identification fails in the true sense, so that the related operation of the identification failure needs to be executed.
In a second aspect, an embodiment of the present application provides an electronic device, which includes the fingerprint identification apparatus as provided in the first aspect or any one of the possible implementation manners of the first aspect.
In a third aspect, an embodiment of the present application provides a fingerprint module, where the fingerprint module is configured to be installed in an electronic device, and the electronic device further includes a main control chip; the fingerprint module is used for detecting whether touch operation exists, and if the touch operation exists, a trigger signal is sent to the main control chip; the fingerprint image acquisition device is used for acquiring image data of a fingerprint image and sending the acquired image data to the main control chip in the acquisition process; the trigger signal is used for indicating the main control chip to prepare for data receiving and enabling the main control chip to inform the fingerprint module to collect the image data of the fingerprint image.
In a fourth aspect, an embodiment of the present application provides a fingerprint identification method, which is applied to a main control chip of an electronic device, where the electronic device further includes a fingerprint module, and the method includes: receiving a trigger signal sent by the fingerprint module when touch operation is detected; responding to the trigger signal, preparing for data receiving, and informing the fingerprint module to collect image data of a fingerprint image; and receiving the collected image data sent by the fingerprint module in the collection process, obtaining the fingerprint image according to the image data, and carrying out fingerprint identification according to the fingerprint image.
In a fifth aspect, an embodiment of the present application provides a fingerprint identification device, configured in a main control chip of an electronic device, the electronic device further includes a fingerprint module, and the fingerprint identification device includes: the trigger receiving module is used for receiving a trigger signal sent by the fingerprint module when the touch operation is detected; the trigger response module is used for responding to the trigger signal, preparing data receiving and informing the fingerprint module to acquire image data of a fingerprint image; and the fingerprint identification module is used for receiving the acquired image data sent by the fingerprint module in the acquisition process, acquiring the fingerprint image according to the image data and performing fingerprint identification according to the fingerprint image.
In a sixth aspect, an embodiment of the present application provides a computer program product, which includes computer program instructions, and when the computer program instructions are read and executed by a main control chip of an electronic device, the fingerprint identification method provided in any possible implementation manner of the fourth aspect or the fourth aspect is executed.
In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores computer program instructions, and when the computer program instructions are read and executed by a processor, the fingerprint identification method provided in the fourth aspect or any one of the possible implementation manners of the fourth aspect is performed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 illustrates a structure of a fingerprint recognition device provided in an embodiment of the present application;
FIG. 2 illustrates a structure of a capacitor module that can be used in a fingerprint recognition device;
fig. 3 shows a structure of an electronic apparatus mounted with a fingerprint recognition device;
FIG. 4 illustrates a workflow of the fingerprint recognition device;
FIG. 5 (A) shows a fingerprinting timing sequence employed by the scheme of an embodiment of the present application;
fig. 5 (B) shows a fingerprint identification time series employed for the scheme of the comparative example.
Detailed Description
Before describing the technical solution in the embodiment of the present application, the basic principle of optical fingerprint identification and the problems thereof will be briefly described.
The following describes technical solutions in the embodiments of the present application in detail with reference to the drawings in the embodiments of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
The terms "first," "second," and the like, are used solely to distinguish one entity or action from another entity or action without necessarily being construed as indicating or implying any actual such relationship or order between such entities or actions.
Fig. 1 shows a structure of a fingerprint recognition device 100 provided in an embodiment of the present application. Referring to fig. 1, the fingerprint identification device 100 at least includes a fingerprint module 110 and a main control chip 120, which are connected to each other through a circuit. The fingerprint recognition device 100 may be, but is not limited to being, installed in an electronic device for implementing functions related to fingerprint recognition in the electronic device. For example, the electronic device may be, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a door access device, a vehicle-mounted device, a robot, a dedicated fingerprint recognition device, and the like. The fingerprint identification device 100 is installed in an electronic device and used for unlocking the electronic device.
Wherein, fingerprint module 110 mainly used gathers fingerprint image to send the fingerprint image of gathering to main control chip 120. The fingerprint module 110 may be a capacitive module, an optical module, an ultrasonic module, etc., and the capacitive module is mainly used as an example in the following description.
Referring to fig. 2, fig. 2 shows a structure of a capacitor module. The module comprises components such as an electromagnetic compatibility coating, a fingerprint chip, a packaging material, a PCB substrate, a flexible circuit board, a connector, a metal reinforcing plate and the like.
The fingerprint chip is provided with a pixel array for collecting a fingerprint image, each pixel in the array is used for collecting a pixel value in the fingerprint image, for a capacitor module, the main structure of the pixel comprises an electrode plate (hereinafter referred to as a pixel electrode plate), when fingerprint identification is carried out, a finger of a user contacts an electromagnetic compatibility coating, because the finger can be seen as a conductor, capacitors can be formed between the surface of the finger and each pixel electrode plate (the basic structure of the capacitors is two electrode plates, one of the two electrode plates is the pixel electrode plate, the other electrode plate is served by the surface of the finger, and a medium between the two electrode plates is mainly determined by an encapsulation material), and because of the existence of fingerprints on the surface of the finger, the sizes of the capacitors are different (the sizes of the capacitors are influenced by the distance between the electrode plates, and because the fingerprints have valleys and ridges, the distances between each point on the surface of the finger and the corresponding pixel electrode plate are different), the fingerprint chip can generate current signals to charge the capacitors, charge the capacitors are charged to the same voltage value, and then the charge amount accumulated by each capacitor is quantized, so as to obtain the corresponding pixel value.
In fig. 2, the connector is connected to a main board of the electronic device, and the main control chip 120 is also installed on the main board, so that the fingerprint image collected by the fingerprint chip can be finally transmitted to the main control chip 120 through the flexible circuit, the connector and the circuit on the main board.
It should be understood that even a capacitor module may have a different internal structure and operation from those described above, and thus fig. 2 is merely an example. Further, although there is a certain difference in structure between the non-capacitive module and the capacitive module, the pixel array and the fingerprint chip are basically included in various modules (the pixel array may be integrated in the fingerprint chip) except that the structure of the pixel is different from that of the capacitive module, for example, the pixel in the optical module mainly includes a photodiode for converting an optical signal into an electrical signal. Therefore, the following description will be made for the capacitor module, but the present invention is not limited to this.
The main control chip 120 is mainly used for performing fingerprint identification according to the received fingerprint image, and may also perform some operations related to an identification result, such as unlocking an electronic device, as needed. Of course, this is only for the function of the main control chip 120 in the fingerprint identification apparatus 100, and the main control chip 120 may also be used as a core control device (so-called "main control") of the electronic device, for example, it may be a Central Processing Unit (CPU) of the electronic device, a Micro Control Unit (MCU), and other devices, so that the main control chip 120 may also be used to implement other functions of the electronic device.
Further functional details regarding fingerprint module 110 and master control chip 120 will be described in the description of FIG. 4. It should be understood that the fingerprint identification device 100 may also include other components, such as memory, etc.
Referring to fig. 3, fig. 3 shows a structure of an electronic device 10 with a fingerprint identification apparatus 100 installed therein, taking a case that the electronic device 10 is a mobile phone as an example, a front surface thereof is a display screen, a gray portion around the display screen represents a side surface of the mobile phone, a fingerprint module 110 is installed on a right side of the mobile phone, and a main control chip 120 is installed inside the mobile phone (dotted line). Based on the fingerprint identification device 100, the mobile phone can implement a fingerprint unlocking function, and one possible flow of the function is as follows: when the mobile phone is turned off, the user picks up the mobile phone, a finger contacts the surface of the fingerprint module 110, the fingerprint module 110 collects a fingerprint image of the user and sends the fingerprint image to the main control chip 120, the main control chip 120 performs fingerprint identification based on the fingerprint image, if the identification is successful, the display screen of the mobile phone is lightened and enters the desktop of the mobile phone, meanwhile, the main control chip 120 can also control a vibration motor of the mobile phone to generate vibration to prompt that the user is successfully unlocked, if the identification is failed, the mobile phone continues to maintain the screen turning state, and meanwhile, the main control chip 120 can also control the vibration motor of the mobile phone to generate vibration to prompt that the user is unsuccessfully unlocked.
It should be understood that fig. 3 is merely an example, and the fingerprint recognition device 100 is not necessarily mounted on the side of the electronic device 10, and may be mounted on the front side of the electronic device 10 (e.g., embedded in a bezel or a screen on the front side of the mobile phone, integrated with a power key on the front side of the mobile phone), the back side, etc.
Fig. 4 shows a work flow of the fingerprint recognition device 100. Referring to fig. 4, the process includes:
s200: the fingerprint module 110 detects whether there is a touch operation.
Taking the capacitive module as an example, the touch operation refers to an operation of a user touching a surface of the module (e.g., the emc coating in fig. 2), but it should be noted that the touch operation is not necessarily a finger of the user touching the surface of the module, for example, a palm of the hand may touch the surface of the module while the user is holding the mobile phone, and such a touch operation is also included in the detection range. In addition, when a non-conductor (for example, the clothes of a user) touches the surface of the module, no capacitance is formed, and therefore detection is not performed.
One possible detection principle is: the capacitance module charges a capacitor formed by the pixels by using a current signal to acquire a pixel value, if a user does not contact the surface of the module, the distance between two electrode plates of the capacitor is infinite or at least a large value, so that the formed capacitor is small, the acquired pixel value is small (the pixel value representing the charge amount is in direct proportion to the size of the capacitor), and once the user contacts the surface of the module, the distance between the two electrode plates of the capacitor is a small value, so that the formed capacitor is relatively large, the acquired pixel value is also large, and therefore, a threshold value can be set, and if the acquired pixel value is found to reach the threshold value, the touch operation is indicated.
Based on the above principle, the following detection scheme of the touch operation (not limited to the capacitive module) can be designed:
(1) A portion of the pixels in the pixel array of the fingerprint module 110 is selected as the target pixels for detecting the touch operation. For example, 160 × 32 (rows × columns) pixels are totally included in the pixel array, and 6 rows of pixels can be selected from the 160 rows as the target pixel, and the selection is not limited to how, for example, 6 rows of pixels can be uniformly selected, or 6 rows of pixels at the center of the pixel array can be selected. The rest pixels except the target pixel in the pixel array do not work when the fingerprint module 110 detects whether touch operation exists, that is, the pixel value cannot be collected.
Therefore, only part of pixels are selected as target pixels, the power consumption of the device is mainly saved, the detection efficiency is improved, and the touch detection is not fingerprint identification after all and does not need to obtain a complete fingerprint image. Of course, it is also feasible to have all pixels in the pixel array as target pixels.
(2) The fingerprint module 110 obtains a pixel value collected by a target pixel, which is not called a first target pixel value, and determines the number of target pixel units meeting the touch determination condition according to the first target pixel value, which is not called a first number.
Different methods exist for acquiring the first target pixel value according to different module types and different working principles. For example, for a capacitive module, as mentioned above, the target pixel may be charged with the current signal to obtain the first target pixel value collected by the target pixel. Optionally, to save power consumption, the current signal for detection may be a small pulse signal with a low frequency (e.g., 50-60 Hz).
According to the difference of the module type and the detection logic, different touch judgment conditions can be adopted. For example, for the capacitive module, a local touch determination threshold may be set, and whether the touch determination condition is satisfied is determined according to a magnitude relationship (possibly in combination with other determination logic) between the first target pixel value and the local touch determination threshold.
For example, the local touch determination threshold is set to 5000, if a first target pixel value acquired by a certain target pixel is 3000 and is smaller than the local touch determination threshold, the touch determination condition is not satisfied (i.e., the target pixel is considered to have no touch), and if the first target pixel value acquired by the certain target pixel is 6000 and is greater than the local touch determination threshold, the touch determination condition is satisfied (i.e., the target pixel is considered to have a touch).
The example only shows how a single target pixel determines whether the touch determination condition is satisfied, and the single target pixel may be further generalized to a target pixel unit, where the target pixel unit may be defined as a pixel set formed by at least one target pixel.
In some implementations, the target pixel unit may be a target pixel, a row of target pixels, a column of target pixels, or an area of target pixels, and in short, the composition is flexible, and different touch detection requirements can be met more conveniently. The definition of the "region" is relatively broad, and at least one target pixel which is connected in space can be regarded as one region, and according to this definition, one target pixel, one row of target pixels, and one column of target pixels can also be regarded as one region, or three special cases of one target pixel, one row of target pixels, and one column of target pixels can also be excluded from the definition of the region.
For example, 6 rows of pixels are selected from the pixel array as target pixels, and if the target pixel unit is defined as one row of target pixels, there are 6 target pixel units in total; for another example, the selected 6 rows of pixels are divided into two parts, i.e., a left part and a right part, and each part is defined as a target pixel unit, so that 12 target pixel units are in total; for another example, if a pixel in 9 4 × 4 pixel blocks is extracted at equal intervals from the pixel array as a target pixel, and each pixel block is defined as one target pixel unit, there are 9 target pixel units in total, and so on. It should be understood that the number of target pixels in different target pixel units may be the same or different.
Referring to a single target pixel, for a single target pixel unit, whether a touch determination condition is satisfied may be determined according to a first target pixel value acquired by a target pixel in the target pixel unit and a local touch determination threshold (possibly in combination with other determination logic).
For example, if the mean value of the first target pixel values acquired by the target pixel in the target pixel unit is smaller than the local touch determination threshold, the touch determination condition is considered to be not satisfied, or the target pixel unit does not detect a touch, and if the mean value of the first target pixel values acquired by the target pixel in the target pixel unit is larger than the local touch determination threshold, the touch determination condition is considered to be satisfied, or the target pixel unit detects a touch. Of course, the mean value in this example may be changed to indexes such as median and maximum value.
For another example, if the first target pixel values acquired by more than half of the target pixels in the target pixel unit are all smaller than the local touch determination threshold, the touch determination condition is considered to be not satisfied, and if the first target pixel values acquired by more than half of the target pixels in the target pixel unit are all larger than the local touch determination threshold, the touch determination condition is considered to be satisfied.
For another example, if the target pixel unit is a row of target pixels, the row of target pixels is divided into a left part and a right part, where each part independently determines whether touch is detected according to a size relationship between a first target pixel value acquired by the target pixel and a local touch determination threshold (the determination method may refer to the above two examples), if at least one of the two parts detects touch, the row of target pixels is considered to satisfy the touch determination condition, otherwise, the row of target pixels is considered to not satisfy the touch determination condition.
If a certain target pixel unit meets the touch judgment condition, the first number is accumulated to be 1, otherwise, the first number is kept unchanged, and the initial value of the first number can be 0.
Optionally, a value of the local touch determination threshold is related to a temperature. The reason is that the temperature affects the capacitance, so that the first target pixel value changes, and therefore, the temperature factor is considered when the local touch judgment threshold is set, which is beneficial to improving the accuracy of touch detection operation.
For example, at normal temperature, when there is no touch operation, the average value of the first target pixel values collected by the target pixel in a certain target pixel unit is 3000, and when there is touch operation, the average value of the first target pixel values collected by the target pixel in the target pixel unit is 6000; at high temperature, these two mean values are 4000 and 7000, respectively; these two mean values are 2500 and 5500, respectively, at low temperature. If the local touch judgment threshold is set at 5000, the target pixel unit can correctly detect the touch operation no matter at normal temperature, high temperature or low temperature; if the local touch judgment threshold is set at 3800, the condition that no touch operation exists is wrongly judged as the existence of the touch operation at high temperature; if the local touch determination threshold is set at 5800, the presence of a touch operation may be erroneously determined as the absence of a touch operation at a low temperature.
Of course, the local touch determination threshold may be set to a fixed value without changing with temperature, or may be determined in consideration of other environmental factors other than temperature.
Further, the local touch determination threshold values set for different target pixel units may be the same or different. For example, the local touch determination threshold may be related to the position of the target pixel unit in the pixel array, for example, the target pixel unit near the center of the pixel array is easily touched, and the target pixel unit far from the center of the pixel array is not easily touched, so that the local touch determination threshold set for the target pixel unit near the center of the pixel array may be greater than the local touch determination threshold set for the target pixel unit far from the center of the pixel array, so that the target pixel unit near the center of the pixel array does not easily detect touches (because most of the touches are not for identifying fingerprints), and the target pixel unit far from the center of the pixel array does not easily ignore touches (because the touches are likely for identifying fingerprints).
(3) The fingerprint module 110 determines whether the first number reaches a first total touch determination threshold, and if the first number reaches the first total touch determination threshold, it is determined that there is a touch operation for the fingerprint module 110, otherwise, it is determined that there is no touch operation for the fingerprint module 110.
For example, if there are 6 target pixel units in total, each of the target pixel units is a row of target pixels, the first overall touch determination threshold is 4, and if the first number is 4 to 6, it indicates that most of the 6 target pixel units detect a touch operation, so that it may be determined that there is a touch operation for the fingerprint module 110 at this time, otherwise, it may be determined that there is no touch operation for the fingerprint module 110.
If the fingerprint module 110 detects a touch operation, step S201 is executed, and if the touch operation is not detected, the detection may be continued without executing the subsequent steps.
In some implementations, the fingerprint module 110 includes a plurality of operating states, such as an idle state, a touch detection state, an image capture state, and a sleep state. The fingerprint module 110 can be switched between various states under the control of the main control chip 120, for example, the main control chip 120 can configure a register of the fingerprint module 110, so that the state of the fingerprint module 110 is changed.
The fingerprint module 110 is in an idle state after being powered on, and when switching among the other three states, the fingerprint module can also be switched to the idle state first and then switched to a target state from the idle state. The fingerprint module 110 detects whether there is a touch state, for example, if the purpose of fingerprint identification is to unlock the electronic device, the fingerprint module 110 may be in the touch detection state to detect whether there is a touch operation when the electronic device is not unlocked (including screen-off unlocking and screen-on unlocking). The meaning of the latter two operating states will be explained later, it being understood that the fingerprint module 110 may have other operating states as well, these four operating states being merely examples.
S201: the fingerprint module 110 sends a trigger signal to the main control chip 120.
S202: the main control chip 120 is ready for data reception.
S203: the main control chip 120 sends a control instruction for collecting an image to the fingerprint module 110.
The above three steps are described together. The form of the trigger signal is not limited, and may be, for example, an interrupt signal. The function of the trigger signal includes instructing the main control chip 120 to perform steps S202 and S203, in other words, the main control chip 120 performing steps S202 and S203 can be regarded as a response action to receiving the trigger signal. The execution sequence of steps S202 and S203 is not strictly limited, or both steps may be executed in parallel.
In one implementation, the data receiving preparation in step S202 includes switching the main control chip 120 from a state of lower power consumption to a state of higher power consumption, because the power consumption of the main control chip 120 needs to be increased during subsequent transmission of image data. Of course, it is not excluded that the data reception preparation also comprises other operations.
The control command in step S203 is used to notify the fingerprint module 110 to collect a fingerprint image (i.e., execute step S204). For example, the main control chip 120 may configure a register inside the fingerprint module 110 (at this time, the configuration data is equivalent to a control command), so that the fingerprint module 110 is switched from the touch detection state to the image capture state, and the fingerprint module 110 mainly performs image capture in this state.
Step S204: fingerprint module 110 gathers fingerprint image.
The fingerprint image refers to an image to be used for fingerprint identification, but the fingerprint image does not necessarily contain a fingerprint. For example, as mentioned in the description of step S200, the touch of the palm of the hand is also detected, so that the content of the fingerprint image captured at this time may be the palm of the user' S hand rather than the finger. The fingerprint image may be one image or a plurality of images, depending on the algorithm used for fingerprint recognition.
Step S204 is further divided into two sub-steps, which are:
s204a: the fingerprint module 110 collects image data.
S204b: the fingerprint module 110 sends the acquired image data to the main control chip 120.
The fingerprint image is composed of image data (including at least pixel values), and the image data in steps S204a and S204b are both image data of the fingerprint image.
It should be noted that step S204b is not executed until the complete fingerprint image is acquired in step S204a, and steps S204a and S204b are actually executed repeatedly and iteratively, that is, a part of image data is acquired and a part of image data is sent, that is, the part of image data is sent while the fingerprint image is acquired, but the step S204b is not executed after the fingerprint image is acquired. Since the main control chip 120 is ready to receive data in step S202, the image data sent by the fingerprint module 110 each time can be successfully received by the main control chip 120, and after a while, the main control chip 120 will obtain a complete fingerprint image according to the received image data.
Note that the image data collected by the fingerprint module 110 is not necessarily sent to the main control chip 120 immediately, i.e. the operating frequencies of the steps S204a and S204b are not necessarily the same. For example, the fingerprint module 110 collects one line of image data at a time, which does not mean that one line of data is sent immediately after collecting one line of data, or sends the collected data once every 4 lines of data are collected.
In addition, when the fingerprint module 110 sends image data, it is not necessary to send all the acquired data. For example, the fingerprint module 110 collects 4 rows of data currently, but may send only the first two rows of data to the main control chip 120 this time.
Step S205: the main control chip 120 performs fingerprint identification according to the fingerprint image.
Fingerprint identification in the narrow sense mainly comprises fingerprint comparison, namely, fingerprint images are compared with fingerprint template images in a bottom library to obtain a fingerprint identification result. The fingerprint template images in the bottom library comprise pre-entered fingerprints, and the comparison mode can be characterized as follows: the method comprises the steps of obtaining the characteristics of fingerprint images and the characteristics of fingerprint template images, calculating the similarity of the two images, if a certain threshold value is exceeded, indicating that the fingerprints in the two images are matched, otherwise indicating that the fingerprints in the two images are not matched, and if the fingerprints in the fingerprint images are matched with the fingerprints in any one fingerprint template image, determining that the fingerprint identification result is successful, otherwise, determining that the fingerprint identification result is failed.
In addition, the fingerprint recognition may also include anti-counterfeit recognition, for example, whether the recognized object is a real finger is determined according to the fingerprint image, if the recognized object is a real finger, the anti-counterfeit recognition result is passed, otherwise, the recognized object is not passed. The anti-counterfeiting identification can also be carried out before the fingerprint comparison, if the anti-counterfeiting identification result is passed, the fingerprint comparison is carried out, and if the anti-counterfeiting identification result is not passed, the fingerprint identification result is directly determined as the identification failure. In the following, for simplicity, only the case where fingerprint identification includes fingerprint comparison is mainly considered.
The fingerprint recognition in step S205 can be implemented as the above-mentioned narrow fingerprint recognition, and after obtaining the fingerprint recognition result, the main control chip 120 can also perform some operations related to the fingerprint recognition result (these related operations can also be regarded as a part of step S205). For example, for the case of successful identification, the main control chip 120 may perform one or more operations of recording successful identification, unlocking the electronic device, recording successful unlocking, controlling a vibration motor of the electronic device to generate a vibration prompt, and the like; for the case of identification failure, the main control chip 120 may perform one or more operations of recording identification failure, recording unlocking failure, controlling a vibration motor of the electronic device to generate a vibration prompt, and the like.
Further, the fingerprint recognition in step S205 may also not be limited to the above-mentioned narrow sense of fingerprint recognition, for example, in fig. 4, several determination steps are added to the flow of fingerprint recognition to optimize the flow, and these steps are described in detail later.
Based on steps S200 to S205, the beneficial effects of the fingerprint identification device 100 are briefly summarized: fingerprint module 110 in the device is when detecting touch operation, utilize trigger signal to inform main control chip 120 earlier, then just gather the fingerprint image under main control chip 120's notice, consequently when fingerprint module 110 gathers the fingerprint image, main control chip 120 has made data reception preparation, thereby fingerprint module 110 can gather the image data of fingerprint image while sending the image data of gathering for main control chip 120, and need not to wait to send it to main control chip 120 after fingerprint image's image data gathers, thereby the collection speed of fingerprint image has been showing and improved, and then just also improve the efficiency of whole fingerprint identification process, user's fingerprint identification experience has been improved.
In addition, the fingerprint identification in the device is directly performed on the main control chip 120, and no additional chip is provided for fingerprint identification, so that the device has a very simple structure, and is beneficial to saving the implementation cost.
Fig. 5 (a) shows a fingerprint identification time sequence adopted by the scheme of the embodiment of the present application, and fig. 5 (B) shows a fingerprint identification time sequence adopted by the scheme of the comparative embodiment, and the above beneficial effects can be more easily understood by comparing fig. 5 (a) and fig. 5 (B):
referring to fig. 5a, INT indicates a trigger signal that changes from a low level to a high level (the low level may be considered as no trigger signal is generated) when a finger touch is detected, thereby playing a role of notifying the main control chip 120, and the trigger signal returns from the high level to the low level when a finger lift is detected. The touch operation may not be generated by a finger, which is only a simplified way, and the method for detecting the lifting of the finger may refer to the method for detecting the touch of the finger, which is not described in detail herein.
The IVDD represents a current signal corresponding to the supply voltage VDD of the fingerprint module 110 (capacitor module), and when the fingerprint module 110 is in the touch detection state, the IVDD is a low-frequency small pulse signal (narrow square wave), i.e., FDT in the drawing, and once the fingerprint module 110 is switched to the image acquisition state, the IVDD is continuously at a high level and is not restored to the low level until the image acquisition and transmission are completed.
In fig. 5 (a), since the fingerprint module 110 first sends the trigger signal to the main control chip 120, before the fingerprint module 110 starts to collect an image, the main control chip 120 has already made a data receiving preparation, so that the fingerprint module 110 can collect an image and send the collected image data to the main control chip 120, which intuitively means that two tasks of image collection and image transmission are completed in a wider square wave of the IVDD, so that the total time consumption of fingerprint identification is short.
In fig. 5 (B), after a finger touch is detected, the fingerprint module 110 starts to acquire an image first, because the main control chip 120 does not prepare for data reception at this time, the method of acquiring and transmitting while being unable to be adopted, and after the fingerprint image is acquired, the fingerprint module 110 sends a trigger signal to the main control chip 120, so that the main control chip 120 prepares for data reception, and then the fingerprint module 110 sends the image data of the fingerprint image to the main control chip 120.
Finally, it should be noted that if the fingerprint identification fails or the electronic device turns off the screen again, the fingerprint module 110 may be restored to the touch detection state, as shown in the FDT on the right side of fig. 5 (a) or fig. 5 (B).
Next, based on the above embodiment, the sub-steps that may be included in step S205 in fig. 4 are described as follows:
s205a: the main control chip 120 determines whether the touch operation belongs to fast lift-up according to the fingerprint image.
If the main control chip 120 determines that the touch operation does not belong to the fast lift-up, the subsequent sub-steps in S205 may be continuously performed. If the main control chip 120 determines that the touch operation is fast lift-off, the fingerprint recognition is terminated, i.e., the subsequent other sub-steps in S205 are not executed. Meanwhile, because the fingerprint identification result is not obtained at this time, the fingerprint identification is not regarded as a fingerprint identification failure, and related operations (one or more operations such as recording identification failure, recording unlocking failure, controlling a vibration motor of the electronic equipment to generate a vibration prompt and the like) of the fingerprint identification failure are not executed. In addition, after terminating the fingerprint identification, the fingerprint module 110 may restart to detect whether there is a touch operation (e.g., the main control chip controls the fingerprint module 110 to switch to the touch detection state again), as shown by the arrow from S205 to S200 in fig. 4.
Such a processing mode is reasonable, because if the user really will carry out fingerprint identification, generally can touch fingerprint module 110 relatively longer time, to the condition of lifting up fast, the user is most likely just touched fingerprint module 110 carelessly, not want to carry out fingerprint identification, thereby in time terminate the fingerprint identification process, can avoid follow-up invalid fingerprint comparison of carrying out, improve fingerprint identification's success rate (to the condition of lifting up fast, the fingerprint image of gathering often is unclear, even be used as the discernment, the high probability also is the discernment failure, can draw down the discernment success rate), and improve user's experience (for example, electronic equipment can not produce vibrations because of mistake touching fingerprint module 110). In particular, if fingerprint recognition is used for unlocking the electronic device, the recognition success rate, that is, the unlocking success rate, is increased.
Optionally, if the touch operation belongs to fast lifting, the reason (fast lifting) that the fingerprint is not successfully identified may be recorded, so that the reason that the fingerprint is not successfully identified may be analyzed subsequently, and corresponding optimization may be performed.
In one implementation, the following method may be used to determine whether the touch operation belongs to fast lift-off:
the main control chip 120 first obtains a pixel value collected by a target pixel (defined as the same as the previous pixel when detecting touch) in the fingerprint image, and the pixel value is different from the first target pixel value and is not called as a second target pixel value; then, the main control chip 120 determines, according to the second target pixel value, the number of target pixel units (defined as the same as that in the foregoing touch detection) that satisfy the touch determination condition, which is different from the first number and is not referred to as a second number; finally, the main control chip 120 determines whether the second quantity reaches a second overall touch determination threshold, and determines that the touch operation belongs to fast lift-up if the second quantity does not reach the second overall touch determination threshold, or determines that the touch operation does not belong to fast lift-up. And the second overall touch judgment threshold value is not greater than the first overall touch judgment threshold value.
The judgment principle is as follows: if the second quantity does not reach the second total touch judgment threshold, it indicates that, when the fingerprint module collects the fingerprint image, the touch operation that the image collection behavior is triggered before the fingerprint image is not detected (because the second total touch judgment threshold is not greater than the first total touch judgment threshold), so that it can be determined that the touch operation only lasts for a short time, and therefore the fingerprint module is raised quickly. The judgment method has simple logic and higher accuracy.
For example, the first total touch determination threshold and the second total touch determination threshold are both 4 rows, and if the second number is 3 rows, it may be determined that the touch operation belongs to fast lift-up.
Regarding the detailed determination method of the fast lift-off, reference may be made to the detection of the touch operation, and repeated contents are not described. It should be understood that there are other ways to determine whether a touch operation is a fast lift-off:
for example, the determination may be made at the fingerprint module 110, with the same logic as the determination (since the fingerprint image was captured by the fingerprint module 110, it may perform the above determination logic).
For another example, the fingerprint module 110 may also perform a fast lifting determination by using threshold comparison when detecting a touch operation: for example, the local touch determination threshold is set to 5000, when there is a touch operation, the average value of the first target pixel values acquired by the target pixels in a certain target pixel unit is 6000, and is greater than the local touch determination threshold, that is, the touch operation is detected in the target pixel unit. For the case of fast lift-off, since the charging time of the capacitor is shortened, although the first target pixel value acquired by the target pixel in the target pixel unit is increased relative to the value when the target pixel is not touched, the average value cannot reach 6000, and may only reach 4500, so that a threshold smaller than the local touch determination threshold may be set, for example 4200, and if the average value is between 4200 and 5000, it is considered that there is a fast lift-off in the target pixel unit. The fingerprint module 110 counts and judges the third number of the target pixel units with the fast lifting condition, and judges whether the third number reaches the third total touch judgment threshold, if the third number reaches the third total touch judgment threshold, it is determined that the fast lifting operation exists on the fingerprint module 110, otherwise, it is determined that the fast lifting operation does not exist on the fingerprint module 110.
If the fast lifting is determined on the fingerprint module 110, the determination result can be notified to the main control chip 120 by the fingerprint module 110. In addition, if the fingerprint module 110 determines that the touch operation is a fast lifting operation, the fingerprint image acquisition may not be performed subsequently, because the fingerprint identification is not performed at this time, the situation that the fingerprint image acquisition is not performed is certainly not excluded. In contrast, the determination of fast lifting on the main control chip 120 can simplify the internal logic of the fingerprint module 110 and speed up the image capturing process.
In addition to determining a quick lift-off, detecting a finger lift-off (e.g., detecting a finger lift-off operation in fig. 5 (a) and 5 (B)) may also take a similar approach to detecting a touch: the main control chip 120 first obtains a fourth target pixel value collected by the target pixel in the fingerprint image; then, the main control chip 120 determines a fourth number of target pixel units satisfying the touch determination condition according to the fourth target pixel value; finally, the main control chip 120 determines whether the fourth quantity reaches a fourth total touch determination threshold, determines that a lift-up operation exists if the fourth quantity does not reach the fourth total touch determination threshold, and otherwise determines that the lift-up operation does not exist. The fourth overall touch determination threshold is not greater than the first overall touch determination threshold and is greater than the second overall touch determination threshold (at this time, the second overall touch determination threshold should be less than the first overall touch determination threshold), because the lift-off operation is more relaxed in determination conditions than the fast lift-off operation. S205a is an optional step, and in some implementations, the determination of fast lift may not be made.
Step S205b: the main control chip 120 determines whether the fingerprint image belongs to a low quality image.
If the main control chip 120 determines that the fingerprint image does not belong to the low quality image, the subsequent sub-steps in S205 may be continuously performed. If the main control chip 120 determines that the fingerprint image belongs to a low-quality image, at least two methods can be adopted:
(A) Fingerprint recognition is terminated, i.e. no further subsequent sub-steps in S205 are performed.
Since the fingerprint identification result is not obtained at this time, the fingerprint identification is not considered to be failed, and related operations (one or more operations such as recording of the identification failure, recording of the unlocking failure, and generation of a vibration prompt by controlling a vibration motor of the electronic device) of the fingerprint identification failure are not executed. In addition, after terminating the fingerprint identification, the fingerprint module 110 may restart detecting whether there is a touch operation (for example, the main control chip controls the fingerprint module 110 to switch to the touch detection state again), as shown by the arrow from S205 to S200 in fig. 4.
Such a processing manner is reasonable, because if it is determined that the fingerprint image belongs to a low-quality image, even if subsequent fingerprint comparison is performed on such an image, the recognition success rate is lowered with a high probability, and the fingerprint recognition process is not terminated in advance, so as to reduce the number of times of fingerprint recognition failure and improve the success rate of fingerprint recognition. In particular, if fingerprint recognition is used for unlocking the electronic device, the recognition success rate, that is, the unlocking success rate, is increased.
Optionally, if the fingerprint image belongs to a low-quality image, the reason (low-quality image) that the fingerprint is not successfully identified may be recorded, so that the reason that the fingerprint is not successfully identified may be analyzed subsequently, and corresponding optimization may be performed.
(B) And sharpening the fingerprint image to obtain a sharpened fingerprint image, and continuously carrying out fingerprint identification according to the sharpened fingerprint image.
The sharpening process is beneficial to improving the definition of the fingerprint image, so that the sharpened fingerprint image is used for fingerprint identification, and the success rate of the fingerprint identification can be improved. Here, the sharpening processing algorithm is not limited to "proceed with fingerprinting" in the sense that the subsequent step of step S205b is continuously performed.
There are many methods for the main control chip 120 to determine whether the fingerprint image belongs to a low quality image, for example, the quality of the fingerprint image can be directly scored by using a model, the quality of the fingerprint image can be evaluated by using the variance of the fingerprint image, and so on. Another method of determination is described below:
first, a difference image is obtained by subtracting a reference image (corresponding pixel value subtraction) from a fingerprint image. The reference image is an image collected by the fingerprint module 110 when no touch is made. Then, whether the fingerprint image belongs to a low-quality image is determined based on the pixel values (all or only a part of the pixel values) in the difference image, and the determination method is not limited. For example, a mean value of pixel values in the difference image may be calculated, and if the mean value is smaller than a low-quality threshold, the fingerprint image is considered as a low-quality image, otherwise, the fingerprint image is not considered as a low-quality image, and the judgment principle is that the pixel values in the low-quality fingerprint image are generally smaller.
In the above determination method, since the reference image is an image collected by the fingerprint module when the fingerprint module is not touched, and therefore the intrinsic noise of the module is included, subtracting the reference image from the fingerprint image is equivalent to filtering the intrinsic noise in the fingerprint image, so that the image quality is determined based on the difference image, and the determination result is more accurate.
S205b is an optional step, and in some implementations, the determination of image quality may not be performed.
Step S205c: the main control chip 120 compares the fingerprint image with the fingerprint template image in the bottom library to obtain a fingerprint identification result.
Step S205c is the aforementioned narrowly defined fingerprint identification, and the process is not repeated. If the identification is successful, the process may jump directly to S205e to perform the operation related to the successful identification. If the identification fails, the step S205d may be continuously performed.
Step S205d: the main control chip 120 determines whether the fingerprint image belongs to a palm print image.
The palm print image is an image collected when the user touches the surface of the fingerprint module 110 with the palm, and whether the fingerprint image is the palm print image can be judged by using the model, or by analyzing the texture features in the image, and the like.
If the main control chip 120 determines that the fingerprint image does not belong to the palm print image, the step S205e may be continuously executed. If the main control chip 120 determines that the fingerprint image belongs to the palm print image, the step S205e is not executed, that is, the related operation of the identification failure is not executed.
The reason is that the user touches the fingerprint module 110 with the palm, and usually does not need to perform fingerprint identification, and is likely to touch the fingerprint module carelessly, so that the user may not regard the fingerprint module as a fingerprint identification failure, and may not perform related operations of the fingerprint identification failure (which may include one or more operations of recording identification failure, recording equipment unlocking failure, vibration prompt, and the like), thereby avoiding the user experience degradation caused by the operations, and also improving the success rate of the fingerprint identification (because the condition of the identification failure may not be recorded).
Optionally, if the fingerprint image belongs to a low-quality image, the reason (palm print image) of the unsuccessful fingerprint identification can be recorded, so that the reason of the unsuccessful fingerprint identification can be conveniently analyzed subsequently, and corresponding optimization is performed.
Optionally, if the fingerprint image does not belong to the low-quality image, but the identification fails, the reason that the fingerprint is not successfully identified may be recorded as the fingerprint miss, which means that the fingerprint in the fingerprint image and the fingerprint in the fingerprint template image have no overlapping area or an overlapping area is too small. For fingerprint miss, one possible optimization measure is to increase the fingerprint entry area of the fingerprint entry stage, e.g. letting the user press the finger several times from different angles while entering the fingerprint.
S205d is an optional step, and in some implementations, the determination of the palm print image may not be performed.
Step S205e: the main control chip 120 performs operations related to the fingerprint identification result.
If the identification is successful, the main control chip 120 may perform one or more operations of recording the identification success, unlocking the electronic device, recording the unlocking success, controlling a vibration motor of the electronic device to generate a vibration prompt, and the like. Optionally, the main control chip 120 may further control the fingerprint module 110 to switch to a sleep state, and the fingerprint module 110 does not perform touch detection nor perform fingerprint identification in the sleep state. For example, when the electronic device is unlocked, the user touches the surface of the fingerprint module 110, and the module will not generate any response. Alternatively, the main control chip 120 may control the fingerprint module 110 to switch to the sleep state after the identification is successful and the finger is detected to be lifted.
If the identification fails, the main control chip 120 may perform one or more operations of recording the identification failure, recording the unlocking failure, and controlling a vibration motor of the electronic device to generate a vibration prompt. Optionally, the main control chip 120 may further control the fingerprint module 110 to switch to the touch detection state, as shown by an arrow from S205 to S200 in fig. 4.
S205e is an optional step, and in some implementations, the main control chip 120 may only obtain the fingerprint identification result, but does not perform other operations temporarily.
The following analyzes the execution sequence problem of the sub-steps in step S205:
step S205a and step S205b may also be performed in the same order, or even in parallel.
For example, in step S205c, if the fingerprint identification result is identification failure, step S205a is executed, and if it is determined that the touch operation belongs to fast lift-up, the relevant operation of the identification failure is not executed (except for jumping to S200).
For example, in step S205c, if the fingerprint identification result is identification failure, step S205b is executed, and if the fingerprint image is determined to belong to a low-quality image, the relevant operation of identification failure is not executed (except for jumping to S200).
The step S205a and the step S205b are executed before the step S205c, which is beneficial to eliminating in advance the situation that some high probability may cause identification failure, and avoiding executing the fingerprint comparison operation, but for the scenario in which the fingerprint identification is successful and dominates, the step S205a and the step S205b are executed before the fingerprint comparison is not performed, which inevitably causes a reduction in the identification efficiency to a certain extent, and thus the scheme executed after the step S205a and the step S205b are executed after the step S205c is also of a certain value.
Step S205d may also be executed before step S205c, which is also beneficial to eliminating in advance some situations where a large probability may cause identification failure, and avoiding executing fingerprint comparison operation, but if the occurrence frequency of the fingerprint image belonging to the palm print image is not high, the fingerprint identification efficiency is inevitably affected by performing the judgment before each fingerprint comparison.
In implementation, the execution sequence of steps S205a, S205b, and S205d may be flexibly set according to requirements.
In step S205, various situations (including identification failure and termination of identification) that may result in unsuccessful fingerprint identification are combed well (fast lifting, low-quality image, palm print identification, and fingerprint miss), and some specific processing measures are provided, which are beneficial to improving the accuracy of fingerprint identification and improving user experience.
The embodiment of the application also provides electronic equipment, and the fingerprint identification device in any one of the embodiments is installed in the electronic equipment. By utilizing the fingerprint identification device, the electronic equipment can realize functions related to fingerprint identification, such as a quick and accurate unlocking function.
The embodiment of the application further provides a fingerprint module, wherein the fingerprint module is used for being installed in the electronic equipment, and the electronic equipment further comprises a main control chip; the fingerprint module is used for detecting whether touch operation exists, and if the touch operation exists, a trigger signal is sent to the main control chip; the fingerprint image acquisition device is used for acquiring image data of a fingerprint image and sending the acquired image data to the main control chip in the acquisition process; the trigger signal is used for indicating the main control chip to prepare for data receiving and enabling the main control chip to inform the fingerprint module to collect image data of the fingerprint image.
In an implementation manner of the fingerprint module, the fingerprint module includes a pixel array for acquiring image data of the fingerprint image, and the fingerprint module is configured to acquire a first target pixel value acquired by a target pixel in the pixel array, determine, according to the first target pixel value, a first number of target pixel units that satisfy a touch determination condition, and determine whether the first number reaches a first total touch determination threshold, and if the first number reaches the first total touch determination threshold, determine that the touch operation exists; the target pixels are part of the pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether the touch operation exists, and the target pixel unit is a pixel set formed by at least one target pixel.
In an implementation manner of the fingerprint module, the fingerprint module is a capacitor module, and determining, according to the first target pixel value, a first number of target pixel units that satisfy the touch determination condition includes: determining a first number of target pixel units meeting a touch judgment condition according to a first target pixel value acquired by a target pixel in the target pixel units and a local touch judgment threshold, wherein the local touch judgment threshold is related to temperature.
In an implementation manner of the fingerprint module, the target pixel unit includes: one target pixel, one row of target pixels, one column of target pixels, or one area of target pixels.
The implementation principle and the technical effect of the fingerprint module are described in the foregoing embodiments of the apparatus, and will not be described again.
The embodiment of the application further provides a fingerprint identification method, which is applied to a main control chip of electronic equipment, wherein the electronic equipment further comprises a fingerprint module, and the method comprises the following steps: receiving a trigger signal sent by the fingerprint module when touch operation is detected; responding to the trigger signal, preparing for data receiving, and informing the fingerprint module to collect image data of a fingerprint image; and receiving the acquired image data sent by the fingerprint module in the acquisition process, acquiring the fingerprint image according to the image data, and performing fingerprint identification according to the fingerprint image.
In one implementation of the fingerprint identification method, the data receiving preparation includes switching the main control chip from a state of lower power consumption to a state of higher power consumption.
In an implementation manner of the fingerprint identification method, the performing fingerprint identification according to the fingerprint image includes: and judging whether the touch operation belongs to quick lifting according to the fingerprint image, and if the touch operation belongs to quick lifting, terminating fingerprint identification.
In an implementation manner of the fingerprint identification method, the fingerprint module includes a pixel array for acquiring image data of the fingerprint image, and the determining whether the touch operation belongs to fast lift-up according to the fingerprint image includes: acquiring a second target pixel value acquired by a target pixel in the pixel array in the fingerprint image, determining a second number of target pixel units meeting a touch judgment condition according to the second target pixel value, judging that the second number reaches a second overall touch judgment threshold value, and if the second number does not reach the second overall touch judgment threshold value, determining that the touch operation belongs to quick lifting; the target pixels are part of pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether touch operation exists, the target pixel unit is a pixel set formed by at least one target pixel, and the second overall touch judgment threshold is not larger than the first overall touch judgment threshold.
In one implementation of the fingerprint identification method, the target pixel unit includes: one target pixel, one row of target pixels, one column of target pixels, or one area of target pixels.
In an implementation manner of the fingerprint identification method, the performing fingerprint identification according to the fingerprint image includes: and judging whether the fingerprint image belongs to a low-quality image, and if so, terminating fingerprint identification.
In an implementation manner of the fingerprint identification method, the determining whether the fingerprint image belongs to a low-quality image includes: subtracting a reference image from the fingerprint image to obtain a differential image, and judging whether the fingerprint image belongs to a low-quality image according to a pixel value in the differential image; wherein, the reference image is the image that the fingerprint module was gathered when not touching.
In an implementation manner of the fingerprint identification method, the performing fingerprint identification according to the fingerprint image includes: and judging whether the fingerprint image belongs to a low-quality image, if so, sharpening the fingerprint image to obtain a sharpened fingerprint image, and continuing fingerprint identification according to the sharpened fingerprint image.
In an implementation manner of the fingerprint identification method, the performing fingerprint identification according to the fingerprint image includes: comparing the fingerprint image with a fingerprint template image in a bottom library to obtain a fingerprint identification result, and judging whether the fingerprint image belongs to a palm print image or not when the fingerprint identification result is identification failure; and if the fingerprint image belongs to the palm print image, the related operation of the identification failure is not executed, otherwise, the related operation of the identification failure is executed.
The implementation principle and the technical effect of the fingerprint identification method are described in the foregoing embodiments of the apparatus, and will not be described again.
The embodiment of the present application further provides a fingerprint identification device, which is configured in the main control chip of the electronic device, and the electronic device further includes a fingerprint module, and the device includes: the trigger receiving module is used for receiving a trigger signal sent by the fingerprint module when the touch operation is detected; the trigger response module is used for responding to the trigger signal, making data receiving preparation and controlling the fingerprint module to collect image data of a fingerprint image; and the fingerprint identification module is used for receiving the acquired image data sent by the fingerprint module in the acquisition process, acquiring the fingerprint image according to the image data and carrying out fingerprint identification according to the fingerprint image.
In one implementation of the fingerprint identification device, the data receiving preparation includes the master control chip switching from a state of lower power consumption to a state of higher power consumption.
In an implementation manner of the fingerprint identification device, the fingerprint identification module performs fingerprint identification according to the fingerprint image, including: and judging whether the touch operation belongs to quick lifting according to the fingerprint image, and if the touch operation belongs to quick lifting, terminating fingerprint identification.
In an implementation manner of the fingerprint identification device, the fingerprint module includes a pixel array for collecting image data of the fingerprint image, and the fingerprint identification module determines whether the touch operation belongs to fast lifting according to the fingerprint image, including: acquiring a second target pixel value acquired by a target pixel in the pixel array in the fingerprint image, determining a second number of target pixel units meeting a touch judgment condition according to the second target pixel value, judging whether the second number reaches a second total touch judgment threshold value, and determining that the touch operation belongs to quick lifting if the second number does not reach the second total touch judgment threshold value; the target pixels are part of pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether touch operation exists, the target pixel unit is a pixel set formed by at least one target pixel, and the second overall touch judgment threshold is not larger than the first overall touch judgment threshold.
In one implementation of the fingerprint identification device, the target pixel unit includes: one target pixel, one row of target pixels, one column of target pixels, or one area of target pixels.
In an implementation manner of the fingerprint identification device, the fingerprint identification module performs fingerprint identification according to the fingerprint image, including: and judging whether the fingerprint image belongs to a low-quality image, and if so, terminating fingerprint identification.
In one implementation manner of the fingerprint identification device, the fingerprint identification module determines whether the fingerprint image belongs to a low-quality image, including: subtracting a reference image from the fingerprint image to obtain a differential image, and judging whether the fingerprint image belongs to a low-quality image according to a pixel value in the differential image; wherein, the reference image is the image that the fingerprint module was gathered when not touching.
In one implementation manner of the fingerprint identification apparatus, the fingerprint identification module performs fingerprint identification according to the fingerprint image, including: and judging whether the fingerprint image belongs to a low-quality image, if so, sharpening the fingerprint image to obtain a sharpened fingerprint image, and continuing fingerprint identification according to the sharpened fingerprint image.
In an implementation manner of the fingerprint identification device, the fingerprint identification module performs fingerprint identification according to the fingerprint image, including: comparing the fingerprint image with a fingerprint template image in a bottom library to obtain a fingerprint identification result, and judging whether the fingerprint image belongs to a palm print image or not when the fingerprint identification result is identification failure; and if the fingerprint image belongs to the palm print image, the related operation of the identification failure is not executed, otherwise, the related operation of the identification failure is executed.
The implementation principle and the technical effects of the fingerprint identification device are described in the embodiments of the device (referring to the device including the fingerprint module and the main control chip), and will not be described again.
The embodiment of the present application further provides a computer-readable storage medium, where computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are read and executed by a processor, the fingerprint identification method provided by the embodiment of the present application is executed.
Embodiments of the present application further provide a computer program product, where the computer program product includes computer program instructions, and when the computer program instructions are read and executed by a processor, the computer program instructions execute the fingerprint identification method provided by the embodiments of the present application.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (15)

1. A fingerprint recognition device, comprising: the fingerprint module and the master control chip;
the fingerprint module is used for detecting whether touch operation exists or not, and if the touch operation exists, a trigger signal is sent to the main control chip; the fingerprint image acquisition device is used for acquiring image data of a fingerprint image and sending the acquired image data to the main control chip in the acquisition process;
the main control chip is used for responding to the trigger signal, preparing data receiving and informing the fingerprint module to collect the image data of the fingerprint image; and the fingerprint identification module is used for receiving the image data sent by the fingerprint module, obtaining the fingerprint image according to the image data and carrying out fingerprint identification according to the fingerprint image.
2. The fingerprint recognition device of claim 1, wherein the data reception preparation comprises the master chip switching from a lower power consumption state to a higher power consumption state.
3. The fingerprint identification device according to claim 1, wherein the fingerprint module comprises a pixel array configured to collect image data of the fingerprint image, and is configured to obtain a first target pixel value collected by a target pixel in the pixel array, determine a first number of target pixel units satisfying a touch determination condition according to the first target pixel value, and determine whether the first number reaches a first total touch determination threshold, and if the first number reaches the first total touch determination threshold, determine that the touch operation exists;
the target pixels are part of pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether the touch operation exists, and the target pixel unit is a pixel set formed by at least one target pixel.
4. The fingerprint identification device according to claim 3, wherein the fingerprint module is a capacitive module, and the determining a first number of target pixel units satisfying the touch determination condition according to the first target pixel value comprises:
determining a first number of target pixel units meeting a touch judgment condition according to a first target pixel value acquired by a target pixel in the target pixel units and a local touch judgment threshold, wherein the local touch judgment threshold is related to temperature.
5. The fingerprint recognition device according to claim 3 or 4, wherein the target pixel unit comprises: one target pixel, one row of target pixels, one column of target pixels, or one area of target pixels.
6. The fingerprint identification device according to any one of claims 1 to 5, wherein the main control chip is configured to determine whether the touch operation belongs to fast lift-up according to the fingerprint image, and terminate fingerprint identification if the touch operation belongs to fast lift-up.
7. The fingerprint identification device according to claim 6, wherein the fingerprint module comprises a pixel array for collecting image data of the fingerprint image, the main control chip is configured to obtain a second target pixel value collected by a target pixel in the pixel array in the fingerprint image, determine a second number of target pixel units satisfying a touch determination condition according to the second target pixel value, and determine whether the second number reaches a second total touch determination threshold, and if the second number does not reach the second total touch determination threshold, determine that the touch operation belongs to fast lift-up;
the target pixels are part of pixels in the pixel array, the rest pixels in the pixel array do not work when detecting whether touch operation exists, the target pixel unit is a pixel set formed by at least one target pixel, and the second overall touch judgment threshold is not larger than the first overall touch judgment threshold.
8. The fingerprint identification device according to any one of claims 1-7, wherein the main control chip is configured to determine whether the fingerprint image belongs to a low quality image, and terminate fingerprint identification if the fingerprint image belongs to the low quality image.
9. The fingerprint identification device according to claim 8, wherein the main control chip is configured to subtract a reference image from the fingerprint image to obtain a difference image, and determine whether the fingerprint image belongs to a low quality image according to pixel values in the difference image;
wherein, the reference image is the image that the fingerprint module was gathered when not touching.
10. The fingerprint identification device according to any one of claims 1 to 7, wherein the main control chip is configured to determine whether the fingerprint image belongs to a low-quality image, perform sharpening processing on the fingerprint image if the fingerprint image belongs to the low-quality image, obtain a sharpened fingerprint image, and perform fingerprint identification continuously according to the sharpened fingerprint image.
11. The fingerprint identification device according to any one of claims 1 to 10, wherein the main control chip is configured to compare the fingerprint image with a fingerprint template image in a base library to obtain a fingerprint identification result, and determine whether the fingerprint image belongs to a palm print image when the fingerprint identification result is an identification failure;
and if the fingerprint image belongs to the palm print image, the related operation of the identification failure is not executed, otherwise, the related operation of the identification failure is executed.
12. An electronic device, characterized in that it comprises a fingerprint recognition device according to any one of claims 1-11.
13. The fingerprint module is characterized by being installed in electronic equipment, and the electronic equipment further comprises a main control chip;
the fingerprint module is used for detecting whether touch operation exists or not, and if the touch operation exists, a trigger signal is sent to the main control chip; the fingerprint image acquisition device is used for acquiring image data of a fingerprint image and sending the acquired image data to the main control chip in the acquisition process;
the trigger signal is used for indicating the main control chip to prepare for data receiving and enabling the main control chip to inform the fingerprint module to collect image data of the fingerprint image.
14. The fingerprint identification method is applied to a main control chip of electronic equipment, the electronic equipment further comprises a fingerprint module, and the method comprises the following steps:
receiving a trigger signal sent by the fingerprint module when touch operation is detected;
responding to the trigger signal, preparing for data receiving, and informing the fingerprint module to collect image data of a fingerprint image;
and receiving the acquired image data sent by the fingerprint module in the acquisition process, acquiring the fingerprint image according to the image data, and performing fingerprint identification according to the fingerprint image.
15. A computer program product comprising computer program instructions which, when read and executed by a main control chip of an electronic device, perform the method of claim 14.
CN202211229268.3A 2022-10-09 2022-10-09 Fingerprint identification device, module, method, electronic equipment and computer program product Pending CN115909426A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211229268.3A CN115909426A (en) 2022-10-09 2022-10-09 Fingerprint identification device, module, method, electronic equipment and computer program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211229268.3A CN115909426A (en) 2022-10-09 2022-10-09 Fingerprint identification device, module, method, electronic equipment and computer program product

Publications (1)

Publication Number Publication Date
CN115909426A true CN115909426A (en) 2023-04-04

Family

ID=86496335

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211229268.3A Pending CN115909426A (en) 2022-10-09 2022-10-09 Fingerprint identification device, module, method, electronic equipment and computer program product

Country Status (1)

Country Link
CN (1) CN115909426A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117173818A (en) * 2023-10-16 2023-12-05 东莞市安邦德智能锁具科技有限公司 Intelligent lock using method based on fingerprint identification

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117173818A (en) * 2023-10-16 2023-12-05 东莞市安邦德智能锁具科技有限公司 Intelligent lock using method based on fingerprint identification

Similar Documents

Publication Publication Date Title
KR101857933B1 (en) Fingerprint recognition system and method
CN109976500B (en) Fingerprint identification device, mobile terminal and awakening method of fingerprint identification device
CN102508591B (en) Prevention of accidental device activation
CN103376932B (en) Anti-misoperation system and method
CN102722297B (en) A kind of touch panel device and the method realized close to induction thereof
CN105224139A (en) Touch control device and carry out the method for fingerprint detection on touch control device
CN105388992A (en) Fingerprint recognition method and apparatus and terminal
EP3285205A1 (en) Fingerprint recognition component, pressure detection method and fingerprint recognition ic
CN104932753A (en) Touch screen, touch method of touch screen and display device
CN105809003A (en) Fingerprint-identification terminal screen unlocking method and terminal
KR102652844B1 (en) Method for detecting missing finger and fingerprint detection device
CN106886766A (en) A kind of fingerprint identification method, fingerprint recognition circuit and mobile terminal
CN105912918A (en) Fingerprint unlocking method and terminal
CN107831996A (en) Recognition of face starts method and Related product
CN115909426A (en) Fingerprint identification device, module, method, electronic equipment and computer program product
CN105825098A (en) Electronic terminal screen unlocking method and image acquisition method and device
CN107622193A (en) Unlocked by fingerprint method and Related product
CN105205377A (en) Device, method and mobile terminal for preventing mistakenly starting of camera
CN109376702A (en) Fingerprint identification method and Related product
CN102768594B (en) The management of touch-control device and application process and system
CN110245483B (en) Biometric identification method and related product
CN110119651B (en) Electronic equipment, fingerprint detection device and method
CN106056090A (en) Fingerprint image processing method and device
CN106022048A (en) Screen unlocking method for electronic terminal, image acquisition method and device
CN110458143B (en) Fingerprint identification device, fingerprint identification method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 201-1, 2nd Floor, Building 4, No. 188 Rixin Road, Binhai Science and Technology Park, Binhai New Area, Tianjin, 300450

Applicant after: Tianjin Jihao Technology Co.,Ltd.

Address before: 100082 Z, 17th floor, No. 1, Zhongguancun Street, Haidian District, Beijing

Applicant before: Beijing Jihao Technology Co.,Ltd.