CN110427741B

CN110427741B - Fingerprint identification method and related product

Info

Publication number: CN110427741B
Application number: CN201910704657.9A
Authority: CN
Inventors: 吴安平
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2019-07-31
Filing date: 2019-07-31
Publication date: 2021-07-27
Anticipated expiration: 2039-07-31
Also published as: WO2021017815A1; CN110427741A

Abstract

The embodiment of the application discloses a fingerprint identification method and a related product, which are applied to electronic equipment, wherein the electronic equipment comprises a display screen module, and the display screen module comprises an ultrasonic module and a display screen; the method comprises the following steps: when a first position of a display screen is in a touched state, a first fingerprint image is obtained through an ultrasonic module, and the first fingerprint image is matched with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending a prompt message to prompt a target object to adjust the position of finger touch, acquiring a second fingerprint image through the ultrasonic module, and matching the second fingerprint image with a preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, whether fingerprint identification is successful or not is determined according to the first matching result and the second matching result, and if the fingerprint identification is successful, a preset unlocking operation is executed, so that the fingerprint identification efficiency is improved.

Description

Fingerprint identification method and related product

Technical Field

The application relates to the technical field of electronic equipment, in particular to a fingerprint identification method and a related product.

Background

With the widespread use of electronic devices (such as mobile phones, tablet computers, and the like), the electronic devices have more and more applications and more powerful functions, and the electronic devices are developed towards diversification and personalization, and become indispensable electronic products in the life of users.

The fingerprint identification technology also becomes a standard matching technology of electronic equipment, and with the development of the fingerprint identification technology, the ultrasonic fingerprint identification technology is more and more favored by suppliers at present, but when stains are stuck on a display screen, the efficiency of fingerprint identification may be affected.

Disclosure of Invention

The embodiment of the application provides a fingerprint identification method and a related product, and the efficiency of fingerprint identification can be improved when stains are stuck on a display screen.

In a first aspect, an embodiment of the present application provides an electronic device, which includes a processing circuit, and a display screen module connected to the processing circuit, the display screen module including a display screen and an ultrasonic module, wherein,

the ultrasonic module is used for acquiring a first fingerprint image when a first position of the display screen is in a touched state;

the processing circuit is used for matching the first fingerprint image with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending prompt information, wherein the prompt information is used for prompting a target object to adjust the position of finger touch;

the ultrasonic module is further used for acquiring a second fingerprint image, and the second fingerprint image corresponds to a second position of the display screen;

the processing circuit is further configured to match the second fingerprint image with the preset fingerprint template to obtain a second matching result; and if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, and if the fingerprint identification is successful, executing preset unlocking operation.

In a second aspect, an embodiment of the present application provides a fingerprint identification method, which is applied to an electronic device, where the electronic device includes a display screen module, and the display screen module includes an ultrasonic module and a display screen; the method comprises the following steps:

when the first position of the display screen is in a touched state, acquiring a first fingerprint image through the ultrasonic module;

matching the first fingerprint image with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending prompt information, wherein the prompt information is used for prompting a target object to adjust the position of finger touch;

acquiring a second fingerprint image through the ultrasonic module, wherein the second fingerprint image corresponds to a second position of the display screen;

matching the second fingerprint image with the preset fingerprint template to obtain a second matching result; and if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, and if the fingerprint identification is successful, executing preset unlocking operation.

In a third aspect, an embodiment of the present application provides a fingerprint identification device, which is applied to an electronic device, where the electronic device includes a display screen module, and the display screen module includes an ultrasonic module and a display screen; the device comprises:

the acquisition unit is used for acquiring a first fingerprint image through the ultrasonic module when the first position of the display screen is in a touched state;

the matching unit is used for matching the first fingerprint image with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending prompt information, wherein the prompt information is used for prompting a target object to adjust the position of finger touch;

the acquisition unit is further used for acquiring a second fingerprint image through the ultrasonic module, and the second fingerprint image corresponds to a second position of the display screen;

the matching unit is further used for matching the second fingerprint image with the preset fingerprint template to obtain a second matching result; and if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, and if the fingerprint identification is successful, executing preset unlocking operation.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a display screen, an ultrasound module, a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the second aspect of the embodiment of the present application.

In a fifth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform some or all of the steps described in the second aspect of the present application.

In a sixth aspect, embodiments of the present application provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to cause a computer to perform some or all of the steps as described in the second aspect of embodiments of the present application. The computer program product may be a software installation package.

The embodiment of the application has the following beneficial effects:

the fingerprint identification method and the related product described in the embodiment of the application are applied to electronic equipment, the electronic equipment comprises a display screen module, the display screen module comprises an ultrasonic module and a display screen, a first fingerprint image is obtained through the ultrasonic module when a first position of the display screen is in a touched state, and the first fingerprint image is matched with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending a prompt message to prompt a target object to adjust the position of finger touch, acquiring a second fingerprint image through the ultrasonic module, and matching the second fingerprint image with a preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, whether fingerprint identification is successful or not is determined according to the first matching result and the second matching result, and if the fingerprint identification is successful, preset unlocking operation is executed.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1A is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 1B is a schematic structural diagram of another electronic device provided in the embodiment of the present application;

fig. 1C is a schematic flowchart of a fingerprint identification method according to an embodiment of the present application;

FIG. 1D is a schematic illustration showing an electronic device detecting a finger moving from a first position to a second position according to an embodiment of the present disclosure;

fig. 1E is a schematic illustration of an example of the application, which is used to divide a first fingerprint image into a plurality of first fingerprint areas;

fig. 1F is a schematic illustration showing a splicing of at least one first fingerprint region successfully matched and at least one non-overlapping region of at least one second fingerprint region successfully matched according to an embodiment of the present application;

FIG. 2 is a schematic flowchart of another fingerprint identification method provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 4 is a block diagram illustrating functional units of a fingerprint identification device according to an embodiment of the present disclosure.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The electronic device related to the embodiments of the present application may include various handheld devices, vehicle-mounted devices, wearable devices (smart watches, smart bracelets, wireless headsets, augmented reality/virtual reality devices, smart glasses), computing devices or other processing devices connected to wireless modems, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like, which have wireless communication functions. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.

The following describes embodiments of the present application in detail.

Referring to fig. 1A, fig. 1A is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application, the electronic device 100 includes a storage and processing circuit 110, and a sensor 170 connected to the storage and processing circuit 110, where:

the electronic device 100 may include control circuitry, which may include storage and processing circuitry 110. The storage and processing circuitry 110 may be a memory, such as a hard drive memory, a non-volatile memory (e.g., flash memory or other electronically programmable read-only memory used to form a solid state drive, etc.), a volatile memory (e.g., static or dynamic random access memory, etc.), etc., and the embodiments of the present application are not limited thereto. Processing circuitry in storage and processing circuitry 110 may be used to control the operation of electronic device 100. The processing circuitry may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

The storage and processing circuitry 110 may be used to run software in the electronic device 100, such as an Internet browsing application, a Voice Over Internet Protocol (VOIP) telephone call application, an email application, a media playing application, operating system functions, and so forth. Such software may be used to perform control operations such as, for example, camera-based image capture, ambient light measurement based on an ambient light sensor, proximity sensor measurement based on a proximity sensor, information display functionality based on status indicators such as status indicator lights of light emitting diodes, touch event detection based on a touch sensor, functionality associated with displaying information on multiple (e.g., layered) display screens, operations associated with performing wireless communication functionality, operations associated with collecting and generating audio signals, control operations associated with collecting and processing button press event data, and other functions in the electronic device 100, to name a few.

The electronic device 100 may include input-output circuitry 150. The input-output circuit 150 may be used to enable the electronic device 100 to input and output data, i.e., to allow the electronic device 100 to receive data from an external device and also to allow the electronic device 100 to output data from the electronic device 100 to the external device. The input-output circuit 150 may further include a sensor 170.

Sensor 170 can include the display screen module, and this display screen module can include display screen and ultrasonic wave module, and the ultrasonic wave module can be integrated in the display screen below, and perhaps, the ultrasonic wave module can set up in electronic equipment's side or back, does not do the restriction here, and this ultrasonic wave module can be used for gathering the fingerprint image.

The display screen module may include one or more display screens, such as display screen 130. The display 130 may include one or a combination of liquid crystal display, organic light emitting diode display, electronic ink display, plasma display, display using other display technologies. The display screen 130 may include an array of touch sensors (i.e., the display screen 130 may be a touch display screen). The touch sensor may be a capacitive touch sensor formed by a transparent touch sensor electrode (e.g., an Indium Tin Oxide (ITO) electrode) array, or may be a touch sensor formed using other touch technologies, such as acoustic wave touch, pressure sensitive touch, resistive touch, optical touch, and the like, and the embodiments of the present application are not limited thereto.

The sensors 170 may also include ambient light sensors, proximity sensors based on light and capacitance, touch sensors (e.g., based on optical touch sensors and/or capacitive touch sensors, where the touch sensors may be part of a touch display screen or used independently as a touch sensor structure), acceleration sensors, and other sensors, among others.

The electronic device 100 may also include an audio component 140. The audio component 140 may be used to provide audio input and output functionality for the electronic device 100. The audio components 140 in the electronic device 100 may include a speaker, a microphone, a buzzer, a tone generator, and other components for generating and detecting sound.

The communication circuit 120 may be used to provide the electronic device 100 with the capability to communicate with external devices. The communication circuit 120 may include analog and digital input-output interface circuits, and wireless communication circuits based on radio frequency signals and/or optical signals. The wireless communication circuitry in communication circuitry 120 may include radio-frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, the wireless Communication circuitry in Communication circuitry 120 may include circuitry to support Near Field Communication (NFC) by transmitting and receiving Near Field coupled electromagnetic signals. For example, the communication circuit 120 may include a near field communication antenna and a near field communication transceiver. The communications circuitry 120 may also include a cellular telephone transceiver and antenna, a wireless local area network transceiver circuitry and antenna, and so forth.

The electronic device 100 may further include a battery, power management circuitry, and other input-output units 160. The input-output unit 160 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

A user may input commands through input-output circuitry 150 to control the operation of electronic device 100, and may use output data of input-output circuitry 150 to enable receipt of status information and other outputs from electronic device 100.

In a possible example, taking the ultrasonic module below the display screen as an example, as shown in fig. 1B, fig. 1B is a schematic structural diagram of an electronic device, and the electronic device 100 may include a Glass Cover plate (Cover Glass)210, a display screen (OLED)220, an adhesion layer (Adhesive)230, a substrate (TFT Glass)240, a Pixel layer (Pixel)250, a piezoelectric material layer (polymer) 260, an Ag Ink layer 270, and a solidified glue layer (DAF) 280. Of course, the glass cover plate may further include a film layer (film), which may be a tempered film for protecting the display screen of the electronic device.

Further, the ultrasonic module may include: the TFT Glass layer, the Pixel layer, the Ag Ink layer and the solidification glue layer. The TFT Glass layer is used for metal wiring and material coating; the Pixel layer is used for embedding a Metal electrode on the TFT Glass, is used as a cathode for ultrasonic transmission/reception and is also called a piezoelectric transduction material, and can realize material deformation-voltage interconversion; an Ag Ink layer used as a positive electrode for ultrasonic transmission/reception; the DAF is a solidified glue and is used for protecting the ultrasonic module; the Adhesive layer is the Adhesive for standing the ultrasonic module at the bottom of the OLED screen.

In a specific implementation, the ultrasound module may include 2 states, a TX state (for transmitting ultrasound) and an RX state (for receiving ultrasound).

In a TX state, high-frequency (usually 10MHz level) oscillation signals such as sine waves are provided through electrodes (a Pixel negative electrode and an Ag Ink positive electrode) at two ends of a Copolymer (piezoelectric material), the Copolymer can generate vibration of response frequency and emit ultrasonic waves, the ultrasonic waves transmitted upwards reach fingerprints in contact with the surface of a display screen after penetrating through an OLED screen, and when a fingerprint valley ridge is attached to the display screen, the difference between the acoustic resistance characteristic of air in the fingerprint valley and the acoustic resistance characteristic of glass on the surface of the screen is large, the difference between the acoustic resistance characteristic of skin tissues of the fingerprint ridge and the acoustic resistance characteristic of the glass on the surface of the screen is large, and therefore the intensity of reflection signals of the fingerprint ridge to the ultrasonic waves is different.

In an RX state, after reflected ultrasonic waves pass through the display screen again and reach the ultrasonic module (Pixel-Copolymer-Ag Ink), the Copolymer is caused to vibrate to generate electric signals, the vibration intensity of the Copolymer in Pixel areas corresponding to fingerprint valley ridges at different positions is different, so that potential differences received by the pixels at different positions are different (the Ag Ink is equal potential), the potential differences are converted into two-dimensional image signals, and an ultrasonic fingerprint image is obtained.

The electronic device described with reference to fig. 1A and 1B may be configured to implement the following functions:

In the aspect of matching the first fingerprint image with a preset fingerprint template to obtain a first matching result, the processing circuit is specifically configured to:

dividing the first fingerprint image into a plurality of first fingerprint regions;

determining at least one of the plurality of first fingerprint regions for which a match was successful;

if the first ratio of the area of the first area corresponding to the at least one successfully matched first fingerprint area to the area of the first image of the first fingerprint image is larger than a first preset threshold value, it is determined that the first fingerprint image is successfully matched, and if the first ratio is smaller than or equal to the first preset threshold value, it is determined that the first fingerprint image is unsuccessfully matched.

In one possible example, the dividing of the first fingerprint image into a plurality of first fingerprint regions, the processing circuitry is specifically configured to:

performing feature extraction on the first fingerprint image to obtain a first feature point set;

and dividing the first fingerprint image into a plurality of first fingerprint areas according to the distribution condition of a plurality of corresponding feature matching results of a plurality of first feature points in the first feature point set.

In one possible example, in connection with the determining at least one of the plurality of first fingerprint regions for which a match was successful, the processing circuitry is specifically configured to:

obtaining a plurality of area matching results according to the characteristic matching result with the largest ratio in the plurality of characteristic matching results of a plurality of first characteristic points included in each fingerprint area in the plurality of first fingerprint areas as the area matching result of the corresponding fingerprint area;

and determining at least one first fingerprint area corresponding to at least one area matching result which is successfully matched in the plurality of area matching results.

In a possible example, in the aspect of matching the second fingerprint image with the preset fingerprint template to obtain a second matching result, the processing circuit is specifically configured to:

dividing the second fingerprint image into a plurality of second fingerprint areas;

determining at least one successfully matched second fingerprint area in the plurality of second fingerprint areas;

determining a second matching result of the second fingerprint image according to the at least one second fingerprint area successfully matched;

in said determining whether the fingerprint identification was successful based on the first and second match results, the processing circuitry is specifically configured to:

splicing the at least one successfully matched first fingerprint area and the at least one successfully matched second fingerprint area to obtain a fingerprint area image;

determining a target ratio of a target image area of the fingerprint area image to a preset image area of the preset fingerprint template;

if the target ratio is larger than a second preset threshold value, determining that the fingerprint identification is successful; and if the target ratio is less than or equal to the second preset threshold, determining that the fingerprint identification fails.

In one possible example, the display screen is further configured to:

when detecting that finger contact exists in a preset area on the display screen, determining that the display screen is in a touched state, wherein the area of the preset area is larger than a preset area threshold value, the first fingerprint image corresponds to the first position of the preset area, and the second fingerprint image corresponds to the second position of the preset area.

It can be seen that the electronic device described in the embodiment of the present application includes an ultrasonic module and a display screen, and when a first position of the display screen is in a touched state, a first fingerprint image is acquired through the ultrasonic module, and the first fingerprint image is matched with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending a prompt message to prompt a target object to adjust the position of finger touch, acquiring a second fingerprint image through the ultrasonic module, and matching the second fingerprint image with a preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, whether fingerprint identification is successful or not is determined according to the first matching result and the second matching result, and if the fingerprint identification is successful, preset unlocking operation is executed.

Referring to fig. 1C, fig. 1C is a schematic flowchart of a fingerprint identification method according to an embodiment of the present application, and as shown in the drawing, the fingerprint identification method is applied to the electronic device shown in fig. 1A, where the electronic device includes an ultrasonic module and a display screen, and the fingerprint identification method includes:

101. when the first position of display screen is in by the touch state, acquire first fingerprint image through the ultrasonic wave module.

Wherein, the ultrasonic wave module can be integrated in the display screen below, and the ultrasonic wave module corresponds fingerprint collection region, and fingerprint collection region corresponds the touch-control region of whole or partial display screen, and fingerprint collection region can realize carrying out fingerprint collection to one or more fingers. Touch-control is regional to or is close the touch-control of the display screen that the fingerprint collection area corresponds at the finger, and then electronic equipment can carry out the fingerprint collection through the ultrasonic wave module, obtains first fingerprint image.

Optionally, in this embodiment of the present application, the following steps may also be included:

The preset area is a part of touch control area corresponding to the ultrasonic module on the display screen.

In the embodiment of the application, the ultrasonic module can be correspondingly arranged in the preset area, so that the touch operation of the finger of the user contacting the display screen can be detected through the display screen, and when the finger contact in the preset area on the display screen is detected, the display screen is determined to be in a touched state.

102. Matching the first fingerprint image with a preset fingerprint template to obtain a first matching result; and if the first matching result is that the matching fails, sending prompt information, wherein the prompt information is used for prompting the target object to adjust the position of finger touch.

The preset fingerprint template can be pre-stored in the electronic equipment. If the first matching result is a matching failure, a prompt message can be sent, wherein the prompt message can be at least one of the following: text information, audio information, pattern information, identification information, and the like. Therefore, the target object may be prompted to adjust the position of the finger touch, so that the user moves the finger from the first position to the second position, please refer to fig. 1D, where fig. 1D is a schematic illustration of a demonstration that the electronic device detects that the finger moves from the first position to the second position according to the embodiment of the present disclosure.

Optionally, in the step 102, matching the first fingerprint image with a preset fingerprint template to obtain a first matching result may include the following steps 21 to 23:

21. dividing the first fingerprint image into a plurality of first fingerprint regions;

the manner of dividing the first fingerprint image into a plurality of first fingerprint regions may be preset, and optionally, the first fingerprint image may be divided into a plurality of equal first fingerprint regions on average, for example, the first fingerprint image is divided into 9 lattices, each lattice corresponds to one first fingerprint region, and the areas and the shapes of all the first fingerprint regions are the same. Or, a plurality of first fingerprint regions may be further divided according to the distribution of the pixel points in the first fingerprint image, for example, generally, the pixel points of the fingerprint region corresponding to the region near the middle of the finger in the first fingerprint image are clearer, and the pixel points of the fingerprint region corresponding to the region near the edge of the finger are more blurred, so that the first fingerprint image may be divided into a plurality of first fingerprint regions according to the difference between the middle and the edge of the first fingerprint image, wherein a part of the first fingerprint regions corresponds to the region near the middle of the finger, and a part of the first fingerprint regions corresponds to the region near the edge of the finger.

Optionally, in the step 21, dividing the first fingerprint image into a plurality of first fingerprint areas may include the following steps:

a1, performing feature extraction on the first fingerprint image to obtain a first feature point set;

a2, dividing the first fingerprint image into a plurality of first fingerprint areas according to the distribution of a plurality of corresponding feature matching results of a plurality of first feature points in the first feature point set.

In the embodiment of the application, in order to divide the first fingerprint image into a plurality of first fingerprint areas more reasonably and accurately, the first fingerprint image can be subjected to feature extraction to obtain a first feature point set, the first feature point set comprises a plurality of first feature points, in the process of fingerprint identification of the first fingerprint image, the matching can be performed on the plurality of first feature points to obtain the matching result of the plurality of first feature points, specifically, for any one first feature point in the plurality of first feature points, any one first feature point can be matched with a feature sample point in a preset fingerprint template, if there exists a sample feature point in the preset fingerprint template whose matching value with any one of the first feature points exceeds a preset matching value, the feature matching result of the arbitrary first feature point can be determined as successful matching, and thus, a plurality of feature matching results corresponding to a plurality of first feature points can be obtained. Furthermore, the first fingerprint image may be divided into a plurality of first fingerprint regions according to distribution conditions of a plurality of feature matching results, please refer to fig. 1E, where fig. 1E is a schematic diagram illustrating an embodiment of the present disclosure that the first fingerprint image is divided into a plurality of first fingerprint regions, where a part of the first fingerprint regions are concentrated regions that gather a plurality of first feature points whose feature matching results are mainly successful in matching, and another part of the first fingerprint regions are concentrated regions that gather a plurality of first features whose feature matching results are mainly failed in matching, so that which regions in the first fingerprint image are successfully matched and which regions are failed in matching can be more intuitively seen.

22. Determining at least one of the plurality of first fingerprint regions for which a match was successful;

after obtaining the plurality of first fingerprint areas, the area matching result of each first fingerprint area in the plurality of first fingerprint areas can be determined to obtain a plurality of area matching results, and then the area matching result can be selected as at least one first fingerprint area which is successfully matched.

Optionally, in the step 22, determining at least one first fingerprint area successfully matched with the plurality of first fingerprint areas may include the following steps:

b1, obtaining a plurality of area matching results according to the feature matching result with the largest ratio among the plurality of feature matching results of the plurality of first feature points included in each of the plurality of first fingerprint areas as the area matching result of the corresponding fingerprint area;

and B2, determining at least one first fingerprint area corresponding to at least one area matching result which is successfully matched in the plurality of area matching results.

The first fingerprint region may include a plurality of first feature points, each first feature point corresponds to one feature matching result, and the plurality of feature matching results of the plurality of first feature points may include a feature matching result that is successfully matched and a feature matching result that is unsuccessfully matched.

The method includes the steps that for each first fingerprint area in a plurality of first fingerprint areas, a plurality of feature matching results of a plurality of first feature points of the first fingerprint area can be counted, if the feature matching result of successful matching is the largest in proportion, the area matching result of the first fingerprint area is successful in matching, and if the feature matching result of unsuccessful matching is the largest in proportion, the area matching result of the first fingerprint area is failed in matching.

23. If the first ratio of the area of the first region corresponding to the at least one first fingerprint region successfully matched with the area of the first image of the first fingerprint image is larger than a first preset threshold value, the first fingerprint image is successfully matched, and if the first ratio is smaller than or equal to the first preset threshold value, the first fingerprint image is determined to be unsuccessfully matched.

In the embodiment of the present application, a first area corresponding to at least one successfully matched first fingerprint area may be determined, specifically, at least one area sub-area corresponding to at least one first fingerprint area may be added to obtain the first area, then a first ratio of the first area to the first image area is determined, if the first ratio is greater than a first preset threshold, it may be determined that the first fingerprint image matching is successful, and then a preset unlocking operation may be performed, otherwise, it is determined that the first fingerprint image matching is failed, and then prompt information is sent.

103. And acquiring a second fingerprint image through the ultrasonic module, wherein the second fingerprint image corresponds to a second position of the display screen.

In the embodiment of the application, if the first matching result of the first fingerprint image is matching failure, the user can be prompted to move the finger to the second position, and then the second fingerprint image of the second position touched by the finger is obtained.

104. Matching the second fingerprint image with the preset fingerprint template to obtain a second matching result; and if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, and if the fingerprint identification is successful, executing preset unlocking operation.

In this embodiment of the application, the second fingerprint image is matched with the preset fingerprint template to obtain the specific implementation details of the second matching result, and the first fingerprint image may be matched with the preset fingerprint template to obtain the specific implementation details of the first matching result, which is not limited herein.

If the second matching result of the second fingerprint image is matching success, the unlocking operation can be directly performed, if the second matching result is matching failure, whether the fingerprint identification is successful or not can be determined according to the first matching result and the second matching result, specifically, the first matching result can further include at least one first fingerprint area successfully matched in the first fingerprint image, the second matching result can further include at least one second fingerprint area successfully matched in the second fingerprint image, and because the first fingerprint image and the second fingerprint image are both fingerprint images of the same finger, whether the fingerprint identification is successful or not can be determined according to the at least one first fingerprint area and the at least one second fingerprint area.

Optionally, in the step 104, matching the second fingerprint image with the preset fingerprint template to obtain a second matching result may include the following steps:

41. dividing the second fingerprint image into a plurality of second fingerprint areas;

42. determining at least one successfully matched second fingerprint area in the plurality of second fingerprint areas;

43. determining a second matching result of the second fingerprint image according to the at least one second fingerprint area successfully matched;

determining whether the fingerprint recognition is successful according to the first matching result and the second matching result may include the steps of:

44. splicing the at least one successfully matched first fingerprint area and the at least one successfully matched second fingerprint area to obtain a fingerprint area image;

45. determining a target ratio of a target image area of the fingerprint area image to a preset image area of the preset fingerprint template;

46. if the target ratio is larger than a second preset threshold value, determining that the fingerprint identification is successful; and if the target ratio is less than or equal to the second preset threshold, determining that the fingerprint identification fails.

The mode of dividing the second fingerprint image into the plurality of second fingerprint areas is consistent with the mode of dividing the first fingerprint image into the plurality of first fingerprint areas, so that the accuracy of the result of determining whether the fingerprint identification is successful or not according to the first matching result and the second matching result can be ensured.

In consideration of the fact that a template region in a preset fingerprint template corresponding to at least one first fingerprint region is not identical to a template region in a preset fingerprint template corresponding to at least one second fingerprint region, so that at least one first fingerprint region successfully matched and at least one second fingerprint region successfully matched can be spliced without overlapping regions to obtain a fingerprint region image, please refer to fig. 1F, where fig. 1F is a schematic diagram illustrating how an at least one first fingerprint region successfully matched and at least one second fingerprint region successfully matched are spliced without overlapping regions according to an embodiment of the present application, so that a fingerprint region image can be obtained, and fingerprint feature points in the fingerprint region image are all successfully matched fingerprint feature points, and further, a target ratio of a target image area of the fingerprint region image to a preset image area of the preset fingerprint template can be determined, if the target ratio is larger than a second preset threshold value, determining that the fingerprint identification is successful; and if the target ratio is less than or equal to a second preset threshold value, determining that the fingerprint identification fails.

For example, if a first preset threshold is set to 85% for each fingerprint image, for example, a first fingerprint image or a second fingerprint image, for the first fingerprint image, if a first ratio of a first area corresponding to at least one first fingerprint area to a first image area of the first fingerprint image is 70%, for the second fingerprint image, if a second ratio of a second area corresponding to one second fingerprint area to a target image area of the second fingerprint image is 75%, a result of fingerprint identification failure is obtained according to a matching result of the first fingerprint image or the second fingerprint image alone, and further, at least one first fingerprint area successfully matched and at least one non-overlapping area in the second fingerprint area successfully matched can be spliced to obtain a fingerprint area image, assuming that the second preset threshold is set to 90%, if the target ratio of the target image area of the fingerprint area image to the preset image area of the preset fingerprint template is determined to be 91%, the target ratio is larger than the second preset threshold value, and then the fingerprint identification success can be determined.

The fingerprint identification method is applied to electronic equipment, the electronic equipment comprises a display screen module, the display screen module comprises an ultrasonic module and a display screen, when a first position of the display screen is in a touched state, a first fingerprint image is obtained through the ultrasonic module, and the first fingerprint image is matched with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending a prompt message to prompt a target object to adjust the position of finger touch, acquiring a second fingerprint image through the ultrasonic module, and matching the second fingerprint image with a preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, whether fingerprint identification is successful or not is determined according to the first matching result and the second matching result, and if the fingerprint identification is successful, preset unlocking operation is executed.

Referring to fig. 2, fig. 2 is a schematic flow chart of a fingerprint identification method according to an embodiment of the present application, and as shown in the figure, the fingerprint identification method is applied to the electronic device shown in fig. 1A, where the electronic device includes a display screen module, and the display screen module includes an ultrasonic module and a display screen; the fingerprint identification method comprises the following steps:

201. when the first position of display screen is in by the touch state, acquire first fingerprint image through the ultrasonic wave module.

202. The first fingerprint image is divided into a plurality of first fingerprint regions.

203. Determining at least one of the plurality of first fingerprint regions for which a match was successful.

204. And if the first ratio of the area of the first region corresponding to the at least one successfully matched first fingerprint region to the area of the first image of the first fingerprint image is greater than a first preset threshold value, determining that the first fingerprint image is successfully matched, and executing a preset unlocking operation.

205. And if the first ratio is smaller than or equal to the first preset threshold, determining that the first fingerprint image fails to be matched, and sending prompt information, wherein the prompt information is used for prompting a target object to adjust the position of finger touch.

206. And acquiring a second fingerprint image through the ultrasonic module, wherein the second fingerprint image corresponds to a second position of the display screen.

207. And dividing the second fingerprint image into a plurality of second fingerprint areas.

208. And determining at least one successfully matched second fingerprint area in the plurality of second fingerprint areas.

209. And determining a second matching result of the second fingerprint image according to the at least one second fingerprint area successfully matched.

210. And if the second matching result is matching failure, splicing the at least one successfully matched first fingerprint area and the at least one successfully matched second fingerprint area to obtain a fingerprint area image.

211. And determining the target ratio of the target image area of the fingerprint area image to the preset image area of the preset fingerprint template.

212. If the target ratio is larger than a second preset threshold value, determining that the fingerprint identification is successful, and executing a preset unlocking operation; and if the target ratio is less than or equal to the second preset threshold, determining that the fingerprint identification fails.

For the detailed description of the steps 201 to 212, reference may be made to the corresponding steps of the fingerprint identification method described in the foregoing fig. 1C, which are not described herein again.

It can be seen that the fingerprint identification method described in the embodiment of the present application is applied to an electronic device, the electronic device includes a display screen module, the display screen module includes an ultrasonic module and a display screen, and can divide a first fingerprint image into a plurality of first fingerprint regions, and then determine the matching result of the first fingerprint image according to the region matching result of the plurality of first fingerprint regions, so that the accuracy of fingerprint identification can be improved, in addition, stains can exist on the display screen, and when the matching result of the first fingerprint image and the second fingerprint image fails, a final fingerprint identification result is determined according to at least one first fingerprint region successfully matched and at least one second fingerprint region successfully matched, so that the fingerprint identification efficiency is improved.

Referring to fig. 3 in keeping with the above embodiments, fig. 3 is a schematic structural diagram of an electronic device 300 according to an embodiment of the present application, as shown in the figure, the electronic device 300 includes a processor 310, a memory 320, a communication interface 330, and one or more programs 321, the electronic device includes an ultrasound module 340 and a display 350, the one or more programs are stored in the memory and configured to be executed by the processor, and in an embodiment of the present application, the program 321 includes instructions for performing the following steps:

In one possible example, in the matching the first fingerprint image with the preset fingerprint template to obtain the first matching result, the program 321 includes instructions for performing the following steps:

In one possible example, in connection with said dividing of said first fingerprint image into a plurality of first fingerprint regions, the above-mentioned program 321 comprises instructions for performing the following steps:

In one possible example, in connection with the determining at least one of the plurality of first fingerprint regions for which a match was successful, the program 321 includes instructions for:

In one possible example, in the matching the second fingerprint image with the preset fingerprint template to obtain a second matching result, the program 321 further includes instructions for performing the following steps:

in said determining whether the fingerprint recognition is successful based on the first matching result and the second matching result, the above program further comprises instructions for:

In one possible example, the program further includes instructions for performing the steps of:

The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

Fig. 4 is a block diagram of functional units of a fingerprint identification device 400 according to an embodiment of the present application. The fingerprint identification device 400 is applied to electronic equipment, wherein the electronic equipment comprises a display screen module, and the display screen module comprises an ultrasonic module and a display screen; the apparatus 400 comprises: an acquisition unit 401, a matching unit 402 and an execution unit 403, wherein,

the acquiring unit 401 is configured to acquire a first fingerprint image through the ultrasonic module when a first position of the display screen is in a touched state;

a matching unit 402, configured to match the first fingerprint image with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending prompt information, wherein the prompt information is used for prompting a target object to adjust the position of finger touch;

the acquiring unit 401 is further configured to acquire a second fingerprint image through the ultrasonic module, where the second fingerprint image corresponds to a second position of the display screen;

the matching unit 402 is further configured to match the second fingerprint image with the preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result;

the execution unit 403 is configured to execute a preset unlocking operation when the fingerprint identification is successful.

The fingerprint identification device described in the embodiment of the application can be seen, the fingerprint identification device is applied to electronic equipment, the electronic equipment comprises an ultrasonic module and a display screen, when a first position of the display screen is in a touched state, a first fingerprint image is obtained through the ultrasonic module, and the first fingerprint image is matched with a preset fingerprint template to obtain a first matching result; if the first matching result is matching failure, sending a prompt message to prompt a target object to adjust the position of finger touch, acquiring a second fingerprint image through the ultrasonic module, and matching the second fingerprint image with a preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, whether fingerprint identification is successful or not is determined according to the first matching result and the second matching result, and if the fingerprint identification is successful, preset unlocking operation is executed.

Optionally, in the aspect of matching the first fingerprint image with a preset fingerprint template to obtain a first matching result, the matching unit 402 is specifically configured to:

Optionally, in terms of the dividing the first fingerprint image into a plurality of first fingerprint regions, the matching unit 402 is specifically configured to:

Optionally, in terms of the determining at least one successfully matched first fingerprint region of the plurality of first fingerprint regions, the matching unit 402 is specifically configured to:

Optionally, in the aspect of matching the second fingerprint image with the preset fingerprint template to obtain a second matching result, the matching unit 402 is specifically configured to:

in the aspect of determining whether the fingerprint identification is successful according to the first matching result and the second matching result, the matching unit 402 is specifically configured to:

Optionally, the execution unit 403 is further configured to:

It can be understood that the functions of each program module of the fingerprint identification device of this embodiment may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.

Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.

Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An electronic device, comprising a processing circuit and a display module connected to the processing circuit, wherein the display module comprises a display and an ultrasonic module,

the ultrasonic module is further used for acquiring a second fingerprint image, the second fingerprint image corresponds to a second position of the display screen, and the second position is different from the first position;

the processing circuit is further configured to match the second fingerprint image with the preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, and if the fingerprint identification is successful, executing a preset unlocking operation, wherein the preset fingerprint template is a fingerprint template pre-stored in the electronic equipment;

wherein, in the aspect of matching the first fingerprint image with a preset fingerprint template to obtain a first matching result, the processing circuit is specifically configured to:

determining a first matching result of the first fingerprint image according to at least one first fingerprint area successfully matched;

the dividing of the first fingerprint image into a plurality of first fingerprint regions, the processing circuit being specifically configured to:

and dividing the first fingerprint image into a plurality of first fingerprint areas according to the distribution condition of a plurality of corresponding feature matching results of a plurality of first feature points in the first feature point set, wherein the feature matching results comprise matching success and matching failure.

2. The electronic device according to claim 1, wherein, in said determining a first matching result of the first fingerprint image from the at least one first fingerprint region for which the matching was successful, the processing circuit is specifically configured to:

3. The electronic device of claim 2, wherein, in said determining at least one of the plurality of first fingerprint regions for which the match was successful, the processing circuit is specifically configured to:

4. The electronic device according to any one of claims 2 to 3, wherein in the aspect of matching the second fingerprint image with the preset fingerprint template to obtain a second matching result, the processing circuit is specifically configured to:

5. The electronic device of any of claims 1-3, wherein the ultrasound module is disposed below a predetermined area of the display screen, and wherein the display screen is further configured to:

6. The fingerprint identification method is characterized by being applied to electronic equipment, wherein the electronic equipment comprises a display screen module, and the display screen module comprises an ultrasonic module and a display screen; the method comprises the following steps:

acquiring a second fingerprint image through the ultrasonic module, wherein the second fingerprint image corresponds to a second position of the display screen, and the second position is different from the first position;

matching the second fingerprint image with the preset fingerprint template to obtain a second matching result; if the second matching result is matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, and if the fingerprint identification is successful, executing a preset unlocking operation, wherein the preset fingerprint template is a fingerprint template pre-stored in the electronic equipment;

wherein, the matching of the first fingerprint image and a preset fingerprint template is performed to obtain a first matching result, which comprises:

the dividing the first fingerprint image into a plurality of first fingerprint regions comprises:

7. The method according to claim 6, wherein said determining a first match result for the first fingerprint image based on the at least one first fingerprint region for which the match was successful comprises:

8. The method of claim 6, wherein the determining at least one of the plurality of first fingerprint regions for which the match was successful comprises:

9. The method according to any one of claims 6 to 8, wherein the matching the second fingerprint image with the preset fingerprint template to obtain a second matching result comprises:

the determining whether the fingerprint identification is successful according to the first matching result and the second matching result includes:

10. The method of any one of claims 6-8, wherein the ultrasound module is disposed below a predetermined area of the display screen, the method further comprising:

11. The fingerprint identification device is characterized by being applied to electronic equipment, wherein the electronic equipment comprises a display screen module, and the display screen module comprises an ultrasonic module and a display screen; the device comprises:

the acquisition unit is further used for acquiring a second fingerprint image through the ultrasonic module, wherein the second fingerprint image corresponds to a second position of the display screen, and the second position is different from the first position;

the matching unit is further used for matching the second fingerprint image with the preset fingerprint template to obtain a second matching result; if the second matching result is a matching failure, determining whether fingerprint identification is successful according to the first matching result and the second matching result, wherein the preset fingerprint template is a fingerprint template pre-stored in the electronic equipment;

the execution unit is used for executing preset unlocking operation when the fingerprint identification is successful;

in the aspect of matching the first fingerprint image with a preset fingerprint template to obtain a first matching result, the matching unit is specifically configured to:

in the aspect of dividing the first fingerprint image into a plurality of first fingerprint regions, the matching unit is specifically configured to:

12. The apparatus according to claim 11, wherein, in respect of said determining a first matching result of the first fingerprint image based on the at least one first fingerprint region for which the matching was successful, the matching unit is specifically configured to:

13. The apparatus according to claim 11, wherein, in said determining at least one of the plurality of first fingerprint regions for which a match was successful, the matching unit is specifically configured to:

14. The apparatus according to any one of claims 11 to 13, wherein in the matching of the second fingerprint image with the preset fingerprint template to obtain a second matching result, the matching unit is specifically configured to:

in the aspect that the determining whether the fingerprint identification is successful according to the first matching result and the second matching result, the matching unit is specifically configured to:

15. The device according to any one of claims 11-13, wherein the ultrasound module is disposed below a predetermined area of the display screen, and the execution unit is further configured to:

16. An electronic device comprising a display screen, an ultrasound module, a processor, a memory for storing one or more programs and configured for execution by the processor, the programs comprising instructions for performing the steps of the method of any of claims 6-10.

17. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any of the claims 6-10.