CN110263752B

CN110263752B - Fingerprint identification method and related product

Info

Publication number: CN110263752B
Application number: CN201910569655.3A
Authority: CN
Inventors: 吴安平
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2019-06-27
Filing date: 2019-06-27
Publication date: 2022-01-11
Anticipated expiration: 2039-06-27
Also published as: CN110263752A

Abstract

The embodiment of the application discloses fingerprint identification method and related product, is applied to electronic equipment, and this electronic equipment includes ultrasonic fingerprint identification module and optical device, and wherein the method includes: detecting whether the approaching object is a finger or not through the optical device; when the approaching object is a finger, fingerprint collection is carried out through the optical device to obtain a 2D fingerprint image, and fingerprint collection is carried out through the ultrasonic fingerprint identification module to obtain a 3D fingerprint image; performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result; and when the fingerprint identification result is that the fingerprint identification is successful, executing unlocking operation. Adopt this application embodiment can carry out finger identification through optical device, under the prerequisite of discerning the finger, just carry out fingerprint collection, consequently, possess certain mistake proofing and touch the function, in addition, gather 2D fingerprint image and 3D fingerprint image and be used for fingerprint identification, help the lifting means security.

Description

Fingerprint identification method and related product

Technical Field

The application relates to the technical field of electronic equipment, in particular to a fingerprint identification method and a related product.

Background

With the widespread use of electronic devices (such as mobile phones, tablet computers, and the like), the electronic devices have more and more applications and more powerful functions, and the electronic devices are developed towards diversification and personalization, and become indispensable electronic products in the life of users.

Fingerprint identification technique also becomes electronic equipment's standard and joins in marriage the technique, and along with the development of fingerprint identification technique, seeing at present, under the more condition of fingerprint identification module, the homoenergetic carries out fingerprint collection, consequently, causes the mistake probability of touching higher, and not intelligent enough.

Disclosure of Invention

The embodiment of the application provides a fingerprint identification method and a related product, which can reduce the false touch probability of a fingerprint identification module and improve the intelligence of the fingerprint identification module.

In a first aspect, an embodiment of the present application provides an electronic device, which includes a processing circuit, and an ultrasonic fingerprint identification module and an optical device connected to the processing circuit, wherein,

the optical device is used for detecting whether the approaching object is a finger or not, and when the approaching object is the finger, fingerprint collection is carried out to obtain a 2D fingerprint image;

the ultrasonic fingerprint identification module is used for fingerprint acquisition to obtain a 3D fingerprint image;

the processing circuit is used for carrying out fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result; and executing unlocking operation when the fingerprint identification result is that the fingerprint identification is successful.

In a second aspect, an embodiment of the present application provides a fingerprint identification method, which is applied to an electronic device, where the electronic device includes an ultrasonic fingerprint identification module and an optical device; the method comprises the following steps:

detecting whether the approaching object is a finger or not through the optical device;

when the approaching object is a finger, fingerprint collection is carried out through the optical device to obtain a 2D fingerprint image, and fingerprint collection is carried out through the ultrasonic fingerprint identification module to obtain a 3D fingerprint image;

performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result;

and when the fingerprint identification result is that the fingerprint identification is successful, executing unlocking operation.

In a third aspect, an embodiment of the present application provides a fingerprint identification apparatus, which is applied to an electronic device, where the electronic device includes an ultrasonic fingerprint identification module and an optical device; the device comprises: a detection unit, a collection unit, an identification unit and an execution unit, wherein,

the detection unit is used for detecting whether the approaching object is a finger or not through the optical device;

the acquisition unit is used for acquiring fingerprints through the optical device to obtain a 2D fingerprint image and acquiring fingerprints through the ultrasonic fingerprint identification module to obtain a 3D fingerprint image when the approaching object is a finger;

the identification unit is used for carrying out fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result;

and the execution unit is used for executing unlocking operation when the fingerprint identification result is that the fingerprint identification is successful.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the second aspect of the embodiment of the present application.

In a fifth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform some or all of the steps described in the second aspect of the present application.

In a sixth aspect, embodiments of the present application provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to cause a computer to perform some or all of the steps as described in the second aspect of embodiments of the present application. The computer program product may be a software installation package.

It can be seen that the fingerprint identification method and related products described in the embodiments of the present application are applied to an electronic device, the electronic device includes an ultrasonic fingerprint identification module and an optical device, the optical device detects whether an approaching object is a finger, when the approaching object is a finger, fingerprint acquisition is performed by the optical device to obtain a 2D fingerprint image, and fingerprint acquisition is performed by the ultrasonic fingerprint identification module to obtain a 3D fingerprint image, fingerprint identification is performed according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result, and when the fingerprint identification result is that the fingerprint identification is successful, an unlocking operation is performed, so that the optical device can perform finger identification, and fingerprint acquisition is performed on the premise that the finger is identified, thereby having a certain function of preventing accidental touch, and in addition, acquiring the 2D fingerprint image and the 3D fingerprint image for fingerprint identification, the safety of the equipment is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1A is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 1B is a schematic structural diagram of another electronic device provided in the embodiment of the present application;

fig. 1C is a schematic flowchart of a fingerprint identification method according to an embodiment of the present application;

FIG. 2 is a schematic flowchart of another fingerprint identification method provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 4 is a block diagram illustrating functional units of a fingerprint identification device according to an embodiment of the present disclosure.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The electronic device related to the embodiments of the present application may include various handheld devices, vehicle-mounted devices, wearable devices (smart watches, smart bracelets, wireless headsets, augmented reality/virtual reality devices, smart glasses), computing devices or other processing devices connected to wireless modems, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like, which have wireless communication functions. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.

The following describes embodiments of the present application in detail.

Referring to fig. 1A, fig. 1A is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application, the electronic device 100 includes a storage and processing circuit 110, and a sensor 170 connected to the storage and processing circuit 110, where:

the electronic device 100 may include control circuitry, which may include storage and processing circuitry 110. The storage and processing circuitry 110 may be a memory, such as a hard drive memory, a non-volatile memory (e.g., flash memory or other electronically programmable read-only memory used to form a solid state drive, etc.), a volatile memory (e.g., static or dynamic random access memory, etc.), etc., and the embodiments of the present application are not limited thereto. Processing circuitry in storage and processing circuitry 110 may be used to control the operation of electronic device 100. The processing circuitry may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

The storage and processing circuitry 110 may be used to run software in the electronic device 100, such as an Internet browsing application, a Voice Over Internet Protocol (VOIP) telephone call application, an email application, a media playing application, operating system functions, and so forth. Such software may be used to perform control operations such as, for example, camera-based image capture, ambient light measurement based on an ambient light sensor, proximity sensor measurement based on a proximity sensor, information display functionality based on status indicators such as status indicator lights of light emitting diodes, touch event detection based on a touch sensor, functionality associated with displaying information on multiple (e.g., layered) display screens, operations associated with performing wireless communication functionality, operations associated with collecting and generating audio signals, control operations associated with collecting and processing button press event data, and other functions in the electronic device 100, to name a few.

The electronic device 100 may include input-output circuitry 150. The input-output circuit 150 may be used to enable the electronic device 100 to input and output data, i.e., to allow the electronic device 100 to receive data from an external device and also to allow the electronic device 100 to output data from the electronic device 100 to the external device. The input-output circuit 150 may further include a sensor 170. Sensor 170 may include ultrasonic fingerprint identification module and optical device, may also include ambient light sensor, proximity sensor based on light and electric capacity, touch sensor (for example, based on optical touch sensor and/or capacitive touch sensor, wherein, touch sensor may be a part of touch display screen, also can regard as a touch sensor structure independent use), acceleration sensor, and other sensors etc., optical device may be the camera, the camera may be leading camera or rear camera, ultrasonic fingerprint identification module may integrate in the screen below, or, ultrasonic fingerprint identification module may set up in electronic equipment's side or the back, do not limit here, this ultrasonic fingerprint identification module may be used to gather the fingerprint image.

Input-output circuit 150 may also include one or more display screens, such as display screen 130. The display 130 may include one or a combination of liquid crystal display, organic light emitting diode display, electronic ink display, plasma display, display using other display technologies. The display screen 130 may include an array of touch sensors (i.e., the display screen 130 may be a touch display screen). The touch sensor may be a capacitive touch sensor formed by a transparent touch sensor electrode (e.g., an Indium Tin Oxide (ITO) electrode) array, or may be a touch sensor formed using other touch technologies, such as acoustic wave touch, pressure sensitive touch, resistive touch, optical touch, and the like, and the embodiments of the present application are not limited thereto.

The electronic device 100 may also include an audio component 140. The audio component 140 may be used to provide audio input and output functionality for the electronic device 100. The audio components 140 in the electronic device 100 may include a speaker, a microphone, a buzzer, a tone generator, and other components for generating and detecting sound.

The communication circuit 120 may be used to provide the electronic device 100 with the capability to communicate with external devices. The communication circuit 120 may include analog and digital input-output interface circuits, and wireless communication circuits based on radio frequency signals and/or optical signals. The wireless communication circuitry in communication circuitry 120 may include radio-frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, the wireless Communication circuitry in Communication circuitry 120 may include circuitry to support Near Field Communication (NFC) by transmitting and receiving Near Field coupled electromagnetic signals. For example, the communication circuit 120 may include a near field communication antenna and a near field communication transceiver. The communications circuitry 120 may also include a cellular telephone transceiver and antenna, a wireless local area network transceiver circuitry and antenna, and so forth.

The electronic device 100 may further include a battery, power management circuitry, and other input-output units 160. The input-output unit 160 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

A user may input commands through input-output circuitry 150 to control the operation of electronic device 100, and may use output data of input-output circuitry 150 to enable receipt of status information and other outputs from electronic device 100.

In a possible example, taking the ultrasonic fingerprint identification module as an example below the screen, as shown in fig. 1B, fig. 1B is a schematic structural diagram of an electronic device, and the electronic device 100 may include a Glass Cover plate (Cover Glass)210, a display screen (OLED)220, an adhesion layer (Adhesive)230, a substrate (TFT Glass)240, a Pixel layer (Pixel)250, a piezoelectric material layer (polymer) 260, an Ag Ink layer 270, and a solidified Adhesive layer (DAF) 280. Of course, the glass cover plate may further include a film layer (film), which may be a tempered film for protecting the display screen of the electronic device.

Further, the ultrasonic fingerprint identification module can include: the TFT Glass layer, the Pixel layer, the Ag Ink layer and the solidification glue layer. The TFT Glass layer is used for metal wiring and material coating; the Pixel layer is used for embedding a Metal electrode on the TFT Glass, is used as a cathode for ultrasonic transmission/reception and is also called a piezoelectric transduction material, and can realize material deformation-voltage interconversion; an Ag Ink layer used as a positive electrode for ultrasonic transmission/reception; the DAF is a solidified glue and is used for protecting the ultrasonic fingerprint identification module; the Adhesive layer is formed by bonding the ultrasonic fingerprint identification module at the bottom of the OLED screen.

In a specific implementation, the ultrasonic fingerprint identification module may include 2 states, a TX state (for transmitting ultrasonic waves) and an RX state (for receiving ultrasonic waves).

In a TX state, high-frequency (usually 10MHz level) oscillation signals such as sine waves are provided through electrodes (a Pixel negative electrode and an Ag Ink positive electrode) at two ends of a Copolymer (piezoelectric material), the Copolymer can generate vibration of response frequency and emit ultrasonic waves, the ultrasonic waves transmitted upwards reach fingerprints in contact with the surface of a screen after penetrating through an OLED screen, and when fingerprint valley ridges are attached to the screen, the difference between the acoustic resistance characteristic of air in the fingerprint valleys and the acoustic resistance characteristic of glass on the surface of the screen is large, the difference between the acoustic resistance characteristic of skin tissues of the fingerprint ridges and the acoustic resistance characteristic of glass on the surface of the screen is large, so the intensity of ultrasonic reflection signals of the fingerprint valley ridges is different.

In an RX state, after reflected ultrasonic waves pass through the display screen again and reach the ultrasonic fingerprint identification module (Pixel-Copolymer-Ag Ink), the Copolymer is caused to vibrate to generate electric signals, the vibration intensity of the Copolymer in Pixel areas corresponding to fingerprint ridges at different positions is different, so that the potential differences received by the pixels at different positions are different (the Ag Ink is equal potential), the potential differences are converted into two-dimensional image signals, and an ultrasonic fingerprint image is obtained.

The electronic device described with reference to fig. 1A and 1B may be configured to implement the following functions:

In one possible example, in terms of obtaining a fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the processing circuit is specifically configured to:

acquiring target environment parameters;

determining a target weight distribution proportion corresponding to the target environment parameter according to a mapping relation between a preset environment parameter and the weight distribution proportion, wherein the weight distribution proportion is a first weight value/a second weight value, the first weight value and the second weight value are 1, the first weight value is a weight value corresponding to 2D fingerprint identification, and the second weight value is a weight value corresponding to 3D fingerprint identification;

and performing fingerprint identification according to the target weight distribution proportion, the 2D fingerprint image and the 3D fingerprint image to obtain a first target matching value, and when the first target matching value is greater than a first preset matching value, determining that the fingerprint identification result is that the fingerprint identification is successful.

converting the 3D fingerprint image into a 2D fingerprint image to obtain a converted 2D fingerprint image;

carrying out image fusion on the converted 2D fingerprint image and the 2D fingerprint image to obtain a target 2D fingerprint image;

and matching the 2D fingerprint image with a preset synthetic fingerprint template to obtain a second target matching value, and confirming that the fingerprint identification result is successful when the second target matching value is greater than the second preset matching value.

matching the 2D fingerprint image with a first preset fingerprint template to obtain a first matching value, and confirming that the fingerprint identification result is successful when the first matching value is larger than the upper limit value of a first preset range;

when the first matching value is in the first preset range, matching the 3D fingerprint image with a second preset fingerprint template to obtain a second matching value, when the second matching value is larger than the lower limit value of the second preset range, confirming that the fingerprint identification result is successful in fingerprint identification, and when the second matching value is smaller than or equal to the lower limit value of the second preset range, confirming that the fingerprint identification result is failed in fingerprint identification;

when the first matching value is in the third preset range, matching the 3D fingerprint image with a second preset fingerprint template to obtain a third matching value, when the third matching value is larger than the upper limit value of the second preset range, confirming that the fingerprint identification result is successful in fingerprint identification, when the third matching value is smaller than or equal to the upper limit value of the second preset range, confirming that the fingerprint identification result is failed in fingerprint identification, and when the upper limit value of the third preset range is smaller than the lower limit value of the first preset range;

and when the first matching value is lower than the third preset range, confirming that the fingerprint identification result is fingerprint identification failure.

proximity detection by the optical device;

when the distance between a proximity object and the optical device is smaller than a preset distance, acquiring a target image of the proximity object;

carrying out contour extraction on the target image to obtain a target contour image;

and when the target contour image meets the preset requirement, determining that the approaching object is a finger, otherwise, determining that the approaching object is not a finger.

It can be seen that the electronic device described in the embodiments of the present application includes an ultrasonic fingerprint identification module and an optical device, and detects whether an approaching object is a finger through the optical device, when the approaching object is a finger, fingerprint acquisition is carried out through an optical device to obtain a 2D fingerprint image, and fingerprint collection is carried out through the ultrasonic fingerprint identification module to obtain a 3D fingerprint image, fingerprint identification is carried out according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result, when the fingerprint identification result is that the fingerprint identification is successful, the unlocking operation is executed, so that the optical device can carry out the finger identification, the fingerprint collection is carried out on the premise of identifying the finger, therefore, the fingerprint identification device has certain function of preventing mistaken touch, in addition, gather 2D fingerprint image and 3D fingerprint image and be used for fingerprint identification, help promoting the equipment security.

Referring to fig. 1C, fig. 1C is a schematic flow chart of a fingerprint identification method according to an embodiment of the present disclosure, and as shown in the drawing, the fingerprint identification method is applied to the electronic device shown in fig. 1A, where the electronic device includes an ultrasonic fingerprint identification module and an optical device, and the fingerprint identification method includes:

101. detecting whether the approaching object is a finger or not by the optical device.

Wherein, in this application embodiment, optical device can be camera or optics fingerprint identification module, and the camera can be visible light camera (wide angle camera or ordinary camera) or infrared camera, and the camera still can be single camera or two cameras, does not limit here. The ultrasonic fingerprint identification module can be integrated together with optical device, or, the ultrasonic fingerprint identification module is not integrated together with optical device.

In one possible example, in step 101, detecting whether the approaching object is a finger by the camera may include the following steps:

11. proximity detection by the optical device;

12. when the distance between a proximity object and the optical device is smaller than a preset distance, acquiring a target image of the proximity object;

13. carrying out contour extraction on the target image to obtain a target contour image;

14. and when the target contour image meets the preset requirement, determining that the approaching object is a finger, otherwise, determining that the approaching object is not a finger.

The preset distance can be set by the user or defaulted by the system. The proximity object may be a finger or other object. The preset requirements can also be set by a user or default by a system, for example, if the shape of the target contour image is a finger contour shape, it is determined that the target contour image meets the preset requirements, and if the average width of the target contour image is within a preset range, it is determined that the target contour image meets the preset requirements, and the like.

102. When being close the object for the finger, through optical device carries out fingerprint collection, obtains 2D fingerprint image, and passes through ultrasonic fingerprint identification module carries out fingerprint collection, obtains 3D fingerprint image.

Wherein, when being close the object for pointing, electronic equipment can carry out the fingerprint through optical device and gather, obtains 2D fingerprint image, can also carry out fingerprint collection through ultrasonic fingerprint identification module, obtains 3D fingerprint image. In specific implementation, the 2D fingerprint image and the 3D fingerprint image may be acquired synchronously, and of course, the 2D fingerprint image may be acquired first and then the 3D fingerprint image may be acquired, or the 3D fingerprint image may be acquired first and then the 2D fingerprint image may be acquired, which is not limited herein.

103. And carrying out fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result.

Wherein, can save at least one in advance in the electronic equipment and predetermine the fingerprint template, this at least one predetermines the fingerprint template and includes: the fingerprint template comprises a first preset fingerprint template, a second preset fingerprint template and a preset synthesized fingerprint template. The first preset fingerprint template is acquired by fingerprint acquisition of the optical device, the second preset fingerprint template is acquired by fingerprint acquisition of the ultrasonic fingerprint identification module, and the preset synthetic fingerprint template is acquired by image fusion of the first preset fingerprint template and the second preset fingerprint template. In specific implementation, the electronic equipment can perform fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result, and the fingerprint identification result can be successful fingerprint identification or failed fingerprint identification.

In a possible example, the step 103 of performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result may include the following steps:

a1, obtaining target environment parameters;

a2, determining a target weight distribution proportion corresponding to the target environment parameter according to a mapping relation between preset environment parameters and the weight distribution proportion, wherein the weight distribution proportion is a first weight value/a second weight value, the first weight value and the second weight value are 1, the first weight value is a weight value corresponding to 2D fingerprint identification, and the second weight value is a weight value corresponding to 3D fingerprint identification;

a3, performing fingerprint identification according to the target weight distribution proportion, the 2D fingerprint image and the 3D fingerprint image to obtain a first target matching value, and when the first target matching value is larger than a first preset matching value, determining that the fingerprint identification result is that the fingerprint identification is successful.

Wherein, the first preset matching value can be set by the user or the system defaults. In an embodiment of the present application, the environmental parameter may be at least one of: ambient light level, temperature, humidity, geographical location, magnetic field interference strength, etc., without limitation. The mapping relation between the preset environment parameters and the weight distribution proportion can be preset in the electronic equipment, and then the electronic equipment can determine the target weight distribution proportion corresponding to the target environment parameters according to the mapping relation after acquiring the target environment parameters, wherein the weight distribution proportion is a first weight value/a second weight value, the first weight value and the second weight value are 1, the first weight value is a weight value corresponding to 2D fingerprint identification, and the second weight value is a weight value corresponding to 3D fingerprint identification. Further, the target weight distribution ratio may include a first weight value and a second target weight value, and the target weight distribution ratio is a target first weight value/a target second weight value.

Further, in the step a3, performing fingerprint recognition according to the target weight distribution ratio, the 2D fingerprint image, and the 3D fingerprint image to obtain the first target matching value, the method may include the following steps:

a31, matching the 2D fingerprint image with a first preset fingerprint template to obtain a 2D fingerprint matching value;

a32, matching the 3D fingerprint image with a second preset fingerprint template to obtain a 3D fingerprint matching value;

and A33, performing weighting operation according to the 2D fingerprint matching value, the 3D fingerprint matching value, the target first weight value and the target second weight value to obtain the first target matching value.

The steps a31 and a32 may be executed in parallel, or the step a31 is executed first and then the step a32 is executed, or the step a32 is executed first and then the step a31 is executed. The electronic equipment can match the 2D fingerprint image with a first preset fingerprint template to obtain a 2D fingerprint matching value, and can also match the 3D fingerprint image with a second preset fingerprint template to obtain a 3D fingerprint matching value, and further, the electronic equipment performs weighting operation according to the 2D fingerprint matching value, the 3D fingerprint matching value, a target first weight value and a target second weight value to obtain a first target matching value, wherein the first target matching value is the 2D fingerprint matching value and the target first weight value + the 3D fingerprint matching value is the target second weight value.

b1, converting the 3D fingerprint image into a 2D fingerprint image to obtain a converted 2D fingerprint image;

b2, carrying out image fusion on the converted 2D fingerprint image and the 2D fingerprint image to obtain a target 2D fingerprint image;

and B3, matching the 2D fingerprint image with a preset synthetic fingerprint template to obtain a second target matching value, and confirming that the fingerprint identification result is successful when the second target matching value is greater than the second preset matching value.

In a specific implementation, the second preset matching value may be set by a user or default by the system. The electronic device may convert the 3D fingerprint image into a 2D fingerprint image, for example, perform planar projection on the 3D fingerprint image, or intercept a plane of the 3D fingerprint image to obtain a converted 2D fingerprint image, and then perform image fusion on the converted 2D fingerprint image and the 2D fingerprint image to obtain a target 2D fingerprint image, where an algorithm of the image fusion may be at least one of: wavelet transformation, laplace transformation, pyramid transformation, contourlet transformation, and the like, without limitation, then the 2D fingerprint image may be matched with a preset synthesized fingerprint template to obtain a second target matching value, and when the second target matching value is greater than the second preset matching value, the fingerprint identification result is confirmed as a successful fingerprint identification.

c1, matching the 2D fingerprint image with a first preset fingerprint template to obtain a first matching value, and when the first matching value is larger than the upper limit value of a first preset range, confirming that the fingerprint identification result is that the fingerprint identification is successful;

c2, when the first matching value is in the first preset range, matching the 3D fingerprint image with a second preset fingerprint template to obtain a second matching value, when the second matching value is larger than the lower limit value of the second preset range, confirming that the fingerprint identification result is successful in fingerprint identification, and when the second matching value is smaller than or equal to the lower limit value of the second preset range, confirming that the fingerprint identification result is failed in fingerprint identification;

c3, when the first matching value is in the third preset range, matching the 3D fingerprint image with a second preset fingerprint template to obtain a third matching value, when the third matching value is greater than the upper limit value of the second preset range, determining that the fingerprint identification result is a successful fingerprint identification, when the third matching value is less than or equal to the upper limit value of the second preset range, determining that the fingerprint identification result is a failed fingerprint identification, and when the upper limit value of the third preset range is less than the lower limit value of the first preset range;

and C4, when the first matching value is lower than the third preset range, confirming that the fingerprint identification result is fingerprint identification failure.

The first preset range, the second preset range and the third preset range can be set by a user or defaulted by a system, and the value ranges of the first preset range, the second preset range and the third preset range are all 0-1. The upper limit value of the third preset range is smaller than the lower limit value of the first preset range.

In a specific implementation, the electronic device may match the 2D fingerprint image with a first preset fingerprint template to obtain a first matching value, when the first matching value is greater than an upper limit of a first preset range, confirm that the fingerprint identification result is successful, when the first matching value is within the first preset range, match the 3D fingerprint image with a second preset fingerprint template to obtain a second matching value, when the second matching value is greater than a lower limit of the second preset range, confirm that the fingerprint identification result is successful, when the second matching value is less than or equal to the lower limit of the second preset range, confirm that the fingerprint identification result is failed, when the first matching value is within a third preset range, match the 3D fingerprint image with the second preset fingerprint template to obtain a third matching value, when the third matching value is greater than the upper limit of the second preset range, confirm that the fingerprint identification result is that fingerprint identification succeeds, when third matching value is less than or equal to the upper limit value of the second preset range, confirm that the fingerprint identification result is that fingerprint identification fails, in addition, when first matching value is less than the third preset range, confirm that the fingerprint identification result is that fingerprint identification fails, so, can pass through 2D fingerprint identification and 3D fingerprint identification, the dynamic management fingerprint identification mechanism promotes the fingerprint identification flexibility.

104. And when the fingerprint identification result is that the fingerprint identification is successful, executing unlocking operation.

Wherein the unlocking operation can be at least one of the following: entering a main page by locking or blank screen, or starting a preset application by locking or blank screen, or executing a preset operation, wherein the preset operation can be at least one of the following operations: deletion operation, modification operation, compression operation, selection operation, photographing operation, payment operation, and the like, without limitation.

In one possible example, the step 103 may include the following steps:

d1, matching the 2D fingerprint image with a first preset fingerprint template;

d2, matching the 3D fingerprint image with the second preset fingerprint template when the 2D fingerprint image is successfully matched with the first preset fingerprint template;

d3, when the 3D fingerprint image is successfully matched with the second preset fingerprint template, confirming that the fingerprint identification result is successful in fingerprint identification.

In the specific implementation, the 2D fingerprint image and the first preset fingerprint template can be matched firstly, when the 2D fingerprint image and the first preset fingerprint template are successfully matched, the 3D fingerprint image and the second preset fingerprint template can be matched, and when the 3D fingerprint image and the second preset fingerprint template are successfully matched, the fingerprint identification result is confirmed to be successful in fingerprint identification. Of course, in specific implementation, the 3D fingerprint image may be matched with the second preset fingerprint template, and when the 3D fingerprint image is successfully matched with the second preset fingerprint template, the 2D fingerprint image is matched with the first preset fingerprint template, and the principle is similar to that described above, and is not repeated herein.

In one possible example, the step D1 of matching the 2D fingerprint image with the first preset fingerprint template may include the following steps:

d11, carrying out image segmentation on the 2D fingerprint image to obtain a target fingerprint area image;

d12, analyzing the characteristic point distribution of the target fingerprint area image;

d13, performing circular image interception on the target fingerprint area image according to M different circle centers to obtain M circular fingerprint area images, wherein M is an integer greater than 3;

d14, selecting a target circular fingerprint area image from the M circular fingerprint area images, wherein the number of characteristic points contained in the target circular fingerprint area image is larger than that of other circular fingerprint area images in the M circular fingerprint area images;

d15, dividing the target circular fingerprint area image to obtain N circular rings, wherein the widths of the N circular rings are the same;

d16, starting from the circular ring with the smallest radius in the N circular rings, sequentially matching the N circular rings with the preset fingerprint template for feature points, and accumulating the matching values of the matched circular rings;

d17, stopping feature point matching immediately when the accumulated matching value is larger than the preset matching threshold value, and outputting a prompt message that the fingerprint identification of the 2D fingerprint image is successful.

Wherein, the electronic device can perform image segmentation on the 2D fingerprint image to obtain a target fingerprint area image, further analyze the feature point distribution of the target fingerprint area image, perform circular image interception on the target fingerprint area image according to M different circle centers to obtain M circular fingerprint area images, M is an integer greater than 3, select the target circular fingerprint area image from the M circular fingerprint area images, the number of the feature points contained in the target circular fingerprint area image is greater than that of other circular fingerprint area images in the M circular fingerprint area images, divide the target circular fingerprint area image to obtain N circular rings, the ring widths of the N circular rings are the same, perform feature point matching on the N circular rings with a preset fingerprint template in sequence from the circular ring with the smallest radius among the N circular rings, and accumulate the matching values of the matched circular rings, thus, in the fingerprint identification process, can be used for matching the characteristic point of different positions or different fingerprints, be equivalent to sampling whole fingerprint image, and this sampling can cover whole fingerprint region, thereby, all can find corresponding standard reaching nature characteristic in order to be used for the matching in every region, stop immediately when the matching value of accumulational is greater than predetermineeing the matching threshold and carry out the characteristic point and match, and output the successful suggestion message of 2D fingerprint image fingerprint identification, so, can be fast and accurate identification fingerprint identification.

It can be seen that the fingerprint identification method described in the embodiments of the present application is applied to an electronic device including an ultrasonic fingerprint identification module and an optical device, detecting whether an approaching object is a finger through the optical device, acquiring a 2D fingerprint image by performing fingerprint acquisition through the optical device when the approaching object is the finger, acquiring a 3D fingerprint image by performing fingerprint acquisition through the ultrasonic fingerprint identification module, performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result, and performing an unlocking operation when the fingerprint identification result is a successful fingerprint identification, so that the optical device can perform finger identification, and perform fingerprint acquisition only on the premise of identifying the finger, thereby having a certain function of preventing accidental touch, and additionally, acquiring the 2D fingerprint image and the 3D fingerprint image for fingerprint identification, the safety of the equipment is improved.

Referring to fig. 2 in a manner consistent with the embodiment shown in fig. 1C, fig. 2 is a schematic flowchart of a fingerprint identification method provided in an embodiment of the present application, and as shown in the drawing, the method is applied to the electronic device shown in fig. 1A, where the electronic device includes an ultrasonic fingerprint identification module and an optical device; the fingerprint identification method comprises the following steps:

201. detecting whether the approaching object is a finger or not by the optical device.

202. When being close the object for the finger, through optical device carries out fingerprint collection, obtains 2D fingerprint image, and passes through ultrasonic fingerprint identification module carries out fingerprint collection, obtains 3D fingerprint image.

203. And converting the 3D fingerprint image into a 2D fingerprint image to obtain a converted 2D fingerprint image.

204. And carrying out image fusion on the converted 2D fingerprint image and the 2D fingerprint image to obtain a target 2D fingerprint image.

205. And matching the 2D fingerprint image with a preset synthetic fingerprint template to obtain a second target matching value, and executing unlocking operation when the second target matching value is greater than the second preset matching value.

For the detailed description of the steps 201 to 205, reference may be made to the corresponding steps of the fingerprint identification method described in the foregoing fig. 1C, and details are not repeated here.

It can be seen that the fingerprint identification method described in the embodiments of the present application is applied to an electronic device, which includes an ultrasonic fingerprint identification module and an optical device, and detects whether an approaching object is a finger through the optical device, performs fingerprint acquisition through the optical device when the approaching object is a finger to obtain a 2D fingerprint image, performs fingerprint acquisition through the ultrasonic fingerprint identification module to obtain a 3D fingerprint image, converts the 3D fingerprint image into the 2D fingerprint image to obtain a converted 2D fingerprint image, performs image fusion on the converted 2D fingerprint image and the 2D fingerprint image to obtain a target 2D fingerprint image, matches the 2D fingerprint image with a preset synthetic fingerprint template to obtain a second target matching value, and performs an unlocking operation when the second target matching value is greater than the second preset matching value, and thus, optical device can carry out finger identification, just carries out fingerprint collection under the prerequisite of discerning the finger, consequently, possesses certain mistake proofing and touches the function, and in addition, collection 2D fingerprint image and 3D fingerprint image are used for fingerprint identification, and the 2D fingerprint image after utilizing 2D fingerprint image to convert adds the watermark in other words, helps promoting the equipment security.

In keeping with the above embodiments, please refer to fig. 3, fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in the drawing, the electronic device includes a processor, a memory, a communication interface, and one or more programs, the electronic device includes an ultrasonic fingerprint identification module and an optical device, the one or more programs are stored in the memory and configured to be executed by the processor, and in an embodiment of the present application, the programs include instructions for performing the following steps:

In one possible example, in the aspect of obtaining the fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the program includes instructions for performing the following steps:

acquiring target environment parameters;

In one possible example, in the detecting whether the approaching object is a finger by the camera, the program includes instructions for performing the steps of:

proximity detection by the optical device;

The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

Fig. 4 is a block diagram of functional units of a fingerprint identification device 400 according to an embodiment of the present application. The fingerprint identification device 400 is applied to electronic equipment, wherein the electronic equipment comprises an ultrasonic fingerprint identification module and an optical device; the apparatus 400 comprises: a detection unit 401, an acquisition unit 402, an identification unit 403 and an execution unit 404, wherein,

the detection unit 401 is configured to detect whether the approaching object is a finger through the optical device;

the acquisition unit 402 is configured to perform fingerprint acquisition through the optical device to obtain a 2D fingerprint image and perform fingerprint acquisition through the ultrasonic fingerprint identification module to obtain a 3D fingerprint image when the approaching object is a finger;

the identification unit 403 is configured to perform fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result;

the executing unit 404 is configured to execute an unlocking operation when the fingerprint identification result is that the fingerprint identification is successful.

It can be seen that the fingerprint identification apparatus described in the embodiments of the present application is applied to an electronic device including an ultrasonic fingerprint identification module and an optical device, detecting whether an approaching object is a finger through the optical device, acquiring a 2D fingerprint image by performing fingerprint acquisition through the optical device when the approaching object is the finger, acquiring a 3D fingerprint image by performing fingerprint acquisition through the ultrasonic fingerprint identification module, performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result, and performing an unlocking operation when the fingerprint identification result is a successful fingerprint identification, so that the optical device can perform finger identification, and perform fingerprint acquisition only on the premise that the finger is identified, thereby having a certain function of preventing accidental touch, and additionally, acquiring the 2D fingerprint image and the 3D fingerprint image for fingerprint identification, the safety of the equipment is improved.

In a possible example, in terms of obtaining a fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the identifying unit 403 is specifically configured to:

acquiring target environment parameters;

In one possible example, in the aspect of detecting whether the approaching object is a finger by using the camera, the detection unit 401 is specifically configured to:

proximity detection by the optical device;

It can be understood that the functions of each program module of the fingerprint identification device of this embodiment may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.

Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.

Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An electronic device, comprising a processing circuit, and an ultrasonic fingerprint identification module and an optical device connected to the processing circuit,

the processing circuit is used for carrying out fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result; and when the fingerprint identification result is that the fingerprint identification is successful, executing unlocking operation;

performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint identification result, including:

matching the 2D fingerprint image with a first preset fingerprint template;

when the 2D fingerprint image is successfully matched with the first preset fingerprint template, matching the 3D fingerprint image with a second preset fingerprint template;

when the 3D fingerprint image is successfully matched with the second preset fingerprint template, confirming that the fingerprint identification result is successful in fingerprint identification;

wherein, will the 2D fingerprint image matches with first preset fingerprint template, includes:

carrying out image segmentation on the 2D fingerprint image to obtain a target fingerprint area image;

analyzing the distribution of the characteristic points of the target fingerprint area image;

performing circular image interception on the target fingerprint area image according to M different circle centers to obtain M circular fingerprint area images, wherein M is an integer greater than 3;

selecting a target circular fingerprint area image from the M circular fingerprint area images, wherein the number of characteristic points contained in the target circular fingerprint area image is greater than that of other circular fingerprint area images in the M circular fingerprint area images;

dividing the target circular fingerprint area image to obtain N circular rings, wherein the widths of the N circular rings are the same;

sequentially matching the N circular rings with the preset fingerprint template for feature points from the circular ring with the smallest radius in the N circular rings, and accumulating the matching values of the matched circular rings;

and when the accumulated matching value is larger than a preset matching threshold value, immediately stopping the characteristic point matching, and outputting a prompt message that the fingerprint identification of the 2D fingerprint image is successful.

2. The electronic device according to claim 1, wherein in the aspect of obtaining the fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the processing circuit is specifically configured to:

acquiring target environment parameters;

3. The electronic device according to claim 1, wherein in the aspect of obtaining the fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the processing circuit is specifically configured to:

4. The electronic device according to claim 1, wherein in the aspect of obtaining the fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the processing circuit is specifically configured to:

when the first matching value is in a third preset range, matching the 3D fingerprint image with a second preset fingerprint template to obtain a third matching value, when the third matching value is larger than the upper limit value of the second preset range, confirming that the fingerprint identification result is successful in fingerprint identification, when the third matching value is smaller than or equal to the upper limit value of the second preset range, confirming that the fingerprint identification result is failed in fingerprint identification, and when the upper limit value of the third preset range is smaller than the lower limit value of the first preset range;

5. The electronic device according to any of claims 1-4, wherein in the aspect of obtaining the fingerprint identification result by performing fingerprint identification according to the 2D fingerprint image and the 3D fingerprint image, the processing circuit is specifically configured to:

proximity detection by the optical device;

6. The fingerprint identification method is characterized by being applied to electronic equipment, wherein the electronic equipment comprises an ultrasonic fingerprint identification module and an optical device; the method comprises the following steps:

when the fingerprint identification result is that the fingerprint identification is successful, executing unlocking operation;

matching the 2D fingerprint image with a first preset fingerprint template;

7. The method according to claim 6, wherein the performing fingerprint recognition according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint recognition result comprises:

acquiring target environment parameters;

8. The method according to claim 6, wherein the performing fingerprint recognition according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint recognition result comprises:

9. The method according to claim 6, wherein the performing fingerprint recognition according to the 2D fingerprint image and the 3D fingerprint image to obtain a fingerprint recognition result comprises:

10. The method according to any one of claims 6-9, wherein the detecting, by the camera, whether the approaching object is a finger comprises:

proximity detection by the optical device;

11. The fingerprint identification device is applied to electronic equipment, and the electronic equipment comprises an ultrasonic fingerprint identification module and an optical device; the device comprises: a detection unit, a collection unit, an identification unit and an execution unit, wherein,

the execution unit is used for executing unlocking operation when the fingerprint identification result is that the fingerprint identification is successful;

matching the 2D fingerprint image with a first preset fingerprint template;

12. An electronic device comprising a processor, a memory for storing one or more programs and configured for execution by the processor, the programs comprising instructions for performing the steps of the method of any of claims 6-10.

13. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any of the claims 6-10.