WO2020172773A1 - 指纹识别的方法、装置和电子设备 - Google Patents

指纹识别的方法、装置和电子设备 Download PDF

Info

Publication number
WO2020172773A1
WO2020172773A1 PCT/CN2019/076072 CN2019076072W WO2020172773A1 WO 2020172773 A1 WO2020172773 A1 WO 2020172773A1 CN 2019076072 W CN2019076072 W CN 2019076072W WO 2020172773 A1 WO2020172773 A1 WO 2020172773A1
Authority
WO
WIPO (PCT)
Prior art keywords
fingerprint
image
template
fingerprint image
processing
Prior art date
Application number
PCT/CN2019/076072
Other languages
English (en)
French (fr)
Inventor
包文成
曾杰民
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to CN201980000275.6A priority Critical patent/CN109997151A/zh
Priority to PCT/CN2019/076072 priority patent/WO2020172773A1/zh
Publication of WO2020172773A1 publication Critical patent/WO2020172773A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1347Preprocessing; Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1365Matching; Classification

Definitions

  • This application relates to the field of fingerprint technology, and more specifically, to methods, devices and electronic equipment for fingerprint identification.
  • Capacitive fingerprint technology has been widely used in terminal devices. With the advent of the full-screen era, capacitive fingerprint technology has gradually become an obstacle to the aesthetics of terminals. Optical fingerprint technology or ultrasonic fingerprint technology has increased the screen-to-body ratio, making the fingerprint recognition area larger and larger, and bringing a better user experience.
  • optical fingerprint technology or ultrasonic fingerprint technology can provide a larger screen-to-body ratio
  • fingerprint recognition time is often not as good as capacitive fingerprint technology.
  • optical fingerprint technology needs to collect more fingerprint data for fingerprint imaging This makes the fingerprint image after imaging larger, usually several times that of the fingerprint data using capacitive fingerprint technology. Therefore, subsequent more complicated algorithms are required to implement the fingerprint identification process, which increases the fingerprint identification time and affects the user experience. Therefore, how to reduce the fingerprint recognition time to improve user experience is an urgent problem to be solved.
  • the embodiments of the present application provide a fingerprint identification method, device, and electronic equipment, which can reduce fingerprint identification time and improve user experience.
  • a fingerprint identification method including:
  • the method includes: performing feature extraction processing on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the parallel fingerprint recognition processing on the first fingerprint image based on at least two fingerprint sub-templates includes:
  • a fingerprint recognition result of the first fingerprint image for the first fingerprint template is determined.
  • the method further includes:
  • the parallel fingerprint recognition processing on the first fingerprint image based on at least two fingerprint sub-templates includes:
  • fingerprint identification processing is performed on the first fingerprint image in parallel based on the at least two fingerprint sub-templates.
  • a fingerprint identification method comprising: performing fingerprint identification processing on a first fingerprint image, collecting at least one second fingerprint image in parallel, and preprocessing the at least one second fingerprint image.
  • the method further includes:
  • fingerprint identification processing is performed in parallel on the at least one second fingerprint image after preprocessing, to determine a fingerprint identification result of the at least one second fingerprint image.
  • the parallel performing fingerprint recognition processing on the at least one second fingerprint image after preprocessing based on at least one fingerprint template includes: the fingerprint recognition result of the first fingerprint image is In the case of fingerprint identification failure, fingerprint identification processing is performed on the at least one second fingerprint image in parallel based on the at least one fingerprint template.
  • the method further includes: determining whether to perform an operation that triggers fingerprint recognition according to a fingerprint recognition result of the at least one second fingerprint image.
  • the performing fingerprint recognition processing on the first fingerprint image includes: performing feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image;
  • the feature information of the first fingerprint image is matched with the feature information of at least one fingerprint template to determine the fingerprint recognition result of the first fingerprint image.
  • the performing fingerprint recognition processing on the first fingerprint image, collecting at least one second fingerprint image in parallel, and preprocessing the at least one second fingerprint image includes:
  • fingerprint recognition processing is performed on the first fingerprint image, the at least one second fingerprint image is collected in parallel, and the at least one second fingerprint image is preprocessed.
  • the parallel fingerprint recognition processing on the at least one second fingerprint image after the preprocessing includes: in the first security environment, performing the fingerprint recognition on the at least one second fingerprint image after the preprocessing The fingerprint image is processed in parallel for fingerprint recognition.
  • a fingerprint recognition method includes: performing first fingerprint recognition processing on a first fingerprint image, and performing decompression processing on a compressed first fingerprint template in parallel;
  • the fingerprint recognition processing of the first fingerprint image includes the first fingerprint recognition processing and the second fingerprint recognition processing, and the execution of the second fingerprint recognition processing is later than the execution of the first fingerprint recognition processing.
  • the method further includes:
  • the performing the first fingerprint identification processing on the first fingerprint image includes: performing feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the performing the second fingerprint identification processing on the first fingerprint image based on the decompressed first fingerprint template includes:
  • the feature information of the first fingerprint image and the feature information of the first fingerprint template are matched to determine the first fingerprint identification result of the first fingerprint image for the first fingerprint template.
  • the performing the second fingerprint recognition processing on the first fingerprint image based on the decompressed first fingerprint template includes: performing parallel processing on the first fingerprint image based on at least two fingerprint sub-templates Performing the second fingerprint identification processing on the first fingerprint image,
  • each of the at least two fingerprint sub-templates corresponds to a local area in the first fingerprint template, and any two of the at least two fingerprint sub-templates are in the first fingerprint template. At least part of a fingerprint template does not overlap.
  • the second fingerprint recognition process is performed on the first fingerprint image based on the decompressed first fingerprint template, and the compressed second fingerprint template is decompressed in parallel, include:
  • the second fingerprint identification process is performed on the first fingerprint image based on the decompressed first fingerprint template, and the second fingerprint template is decompressed in parallel.
  • the performing first fingerprint identification processing on the first fingerprint image and performing decompression processing on the compressed first fingerprint template in parallel includes:
  • the first fingerprint identification process is performed on the first fingerprint image, and the compressed first fingerprint template is decompressed in parallel.
  • a fingerprint identification device including: a fingerprint identification module for performing fingerprint identification processing on a first fingerprint image in parallel based on at least two fingerprint sub-templates,
  • each of the at least two fingerprint sub-templates corresponds to a local area in the first fingerprint template, and any two fingerprint sub-templates of the at least two fingerprint sub-templates are in the first fingerprint. At least part of the templates do not overlap.
  • the device further includes:
  • the feature extraction module is configured to perform feature extraction processing on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the fingerprint identification module is also used to:
  • a fingerprint recognition result of the first fingerprint image for the first fingerprint template is determined.
  • the fingerprint identification module is also used to:
  • the fingerprint identification module is specifically configured to:
  • fingerprint identification processing is performed on the first fingerprint image in parallel based on the at least two fingerprint sub-templates.
  • a fingerprint recognition device including:
  • the first fingerprint identification module is used to perform fingerprint identification processing on the first fingerprint image
  • a fingerprint sensor configured to collect at least one second fingerprint image to be identified in parallel when the first fingerprint identification module performs fingerprint identification processing on the first fingerprint image
  • the second fingerprint identification module is configured to preprocess the at least one second fingerprint image to be identified in parallel when the first fingerprint identification module performs fingerprint identification processing on the first fingerprint image.
  • the second fingerprint identification module is further used for:
  • fingerprint identification processing is performed in parallel on the at least one second fingerprint image after preprocessing, to determine a fingerprint identification result of the at least one second fingerprint image.
  • the second fingerprint identification module is specifically configured to: in the case where the fingerprint identification result of the first fingerprint image is a fingerprint identification failure, based on the at least one fingerprint template, At least one second fingerprint image undergoes fingerprint identification processing in parallel.
  • the second fingerprint identification module is further configured to determine whether to perform an operation that triggers fingerprint identification according to a fingerprint identification result of the at least one second fingerprint image.
  • the first fingerprint identification module is further configured to: perform feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image;
  • the feature information of the first fingerprint image is matched with the feature information of at least one fingerprint template to determine the fingerprint recognition result of the first fingerprint image.
  • the first fingerprint identification module is specifically configured to: perform fingerprint identification processing on the first fingerprint image in a first security environment;
  • the fingerprint sensor is specifically used to collect the at least one second fingerprint image in the first security environment
  • the second fingerprint identification module is specifically configured to preprocess the at least one second fingerprint image in the first security environment.
  • the second fingerprint identification module is specifically configured to:
  • fingerprint identification processing is performed in parallel on the at least one second fingerprint image after preprocessing.
  • a fingerprint recognition device including:
  • the fingerprint identification module is used to perform first fingerprint identification processing on the first fingerprint image
  • a decompression module configured to decompress the compressed first fingerprint template in parallel when the first fingerprint recognition module performs the first fingerprint recognition processing on the first fingerprint image
  • the fingerprint recognition processing of the first fingerprint image includes the first fingerprint recognition processing and the second fingerprint recognition processing, and the execution of the second fingerprint recognition processing is later than the execution of the first fingerprint recognition processing.
  • the fingerprint identification module is also used to:
  • the fingerprint identification module is specifically configured to: perform feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the fingerprint identification module is specifically configured to:
  • the feature information of the first fingerprint image and the feature information of the first fingerprint template are matched to determine the first fingerprint identification result of the first fingerprint image for the first fingerprint template.
  • the fingerprint identification module is further configured to: perform the second fingerprint identification processing on the first fingerprint image in parallel based on at least two fingerprint sub-templates,
  • each of the at least two fingerprint sub-templates corresponds to a local area in the first fingerprint template, and any two of the at least two fingerprint sub-templates are in the first fingerprint template. At least part of a fingerprint template does not overlap.
  • the fingerprint identification module is specifically configured to perform the second fingerprint identification processing on the fingerprint image to be identified based on the decompressed first fingerprint template in a first security environment ;
  • the decompression module is configured to decompress the second fingerprint template in the first security environment.
  • the fingerprint identification module is specifically configured to: perform the first fingerprint identification processing on the first fingerprint image in a first security environment;
  • the decompression module is configured to decompress the compressed first fingerprint template in the first security environment.
  • a chip in a seventh aspect, includes an input/output interface, at least one processor, at least one memory, and a bus.
  • the at least one memory is used to store instructions
  • the at least one processor is used to call Instruction to execute the method in the first aspect or any possible implementation of the first aspect, or the method in any possible implementation of the second or second aspect, or the third aspect or the third aspect Any possible implementation method.
  • an electronic device including a fingerprint recognition device as in the fourth aspect or any possible implementation of the fourth aspect, or as the fifth aspect or any possible implementation of the fifth aspect
  • the device for fingerprint recognition in, or the device for fingerprint recognition in the sixth aspect or any possible implementation of the sixth aspect is provided, including a fingerprint recognition device as in the fourth aspect or any possible implementation of the fourth aspect, or as the fifth aspect or any possible implementation of the fifth aspect.
  • a computer-readable medium for storing a computer program, the computer program comprising instructions for executing the first aspect or any possible implementation of the first aspect, or the second aspect Or an instruction in any possible implementation manner of the second aspect, or an instruction in the third aspect or any possible implementation manner of the third aspect.
  • a computer program product including instructions is provided.
  • the computer runs the instructions of the computer program product, the computer executes the first aspect or any of the possible implementations of the first aspect.
  • the computer program product can be run on the electronic device in the eighth aspect.
  • Fig. 1A is a directional view of an electronic device according to an embodiment of the present application.
  • Fig. 1B is a schematic diagram of a partial cross-sectional structure of the electronic device shown in Fig. 1A along A-A'.
  • FIG. 2 is a flowchart of a typical fingerprint identification method.
  • Fig. 3 is a schematic flowchart of a fingerprint identification method according to an embodiment of the present application.
  • FIG. 4 is an overall flowchart of the fingerprint identification method described in FIG. 3.
  • Fig. 5 is a schematic flowchart of a fingerprint identification method according to another embodiment of the present application.
  • FIG. 6 is an overall flowchart of the fingerprint identification method described in FIG. 5.
  • Fig. 7 is a schematic flowchart of a fingerprint identification method according to still another embodiment of the present application.
  • FIG. 8 is an overall flowchart of the fingerprint identification method described in FIG. 7.
  • Fig. 9 is a schematic structural diagram of a fingerprint recognition device according to an embodiment of the present application.
  • Fig. 10 is a schematic structural diagram of a fingerprint identification device according to another embodiment of the present application.
  • Fig. 11 is a schematic structural diagram of a fingerprint recognition device according to still another embodiment of the present application.
  • Fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other terminal devices; more specifically, in the above-mentioned terminal devices, fingerprint identification
  • the device may specifically be an optical fingerprint device, which may be arranged in a partial area or an entire area under the display screen, thereby forming an under-display optical fingerprint system.
  • the fingerprint identification device can also be partially or fully integrated into the display screen of the terminal device, thereby forming an in-display optical fingerprint system.
  • FIG. 1A and 1B show schematic diagrams of electronic devices to which the embodiments of the present application can be applied.
  • FIG. 1 is a front schematic view of the electronic device 10
  • FIG. 1B is the electronic device 10 shown in FIG. 1A along A'-A' Partial sectional structure diagram.
  • the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120.
  • the optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array with a plurality of optical sensing units, and the area where the sensing array is located or the sensing area thereof is the fingerprint detection area 103 of the optical fingerprint device 130.
  • the fingerprint detection area 103 is located in the display area of the display screen 120.
  • the optical fingerprint device 130 may also be arranged in other positions, such as the side of the display screen 120 or the non-transmissive area at the edge of the electronic device 10, and the optical fingerprint device 130 may be designed to The optical signal of at least a part of the display area of the display screen 120 is guided to the optical fingerprint device 130, so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.
  • the area of the fingerprint detection area 103 may be different from the area of the sensing array of the optical fingerprint device 130, for example, through optical path design such as lens imaging, reflective folding optical path design, or other optical path design such as light convergence or reflection, etc.
  • the area of the fingerprint detection area 103 of the optical fingerprint device 130 can be made larger than the area of the sensing array of the optical fingerprint device 130.
  • the fingerprint detection area 103 of the optical fingerprint device 130 may also be designed to be substantially the same as the area of the sensing array of the optical fingerprint device 130.
  • the electronic device 10 adopting the above structure does not need to reserve space on the front side for setting fingerprint buttons (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 It can be basically extended to the front of the entire electronic device 10.
  • the optical fingerprint device 130 includes a light detecting part 134 and an optical component 132, and the light detecting part 134 includes the sensor array and is electrically connected to the sensor array.
  • the connected reading circuit and other auxiliary circuits can be fabricated on a chip (Die) by a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor.
  • the sensing array is specifically a photodetector (Photodetector) array, which includes A plurality of photodetectors distributed in an array, the photodetector can be used as the optical sensing unit as described above; the optical component 132 can be arranged above the sensing array of the photodetecting part 134, which can specifically include The filter layer (Filter), the light guide layer or the light path guide structure and other optical elements, the filter layer can be used to filter out the ambient light penetrating the finger, and the light guide layer or the light path guide structure is mainly used to remove The reflected light reflected from the finger surface is guided to the sensing array for optical detection.
  • the filter layer Finter
  • the light guide layer or the light path guide structure is mainly used to remove The reflected light reflected from the finger surface is guided to the sensing array for optical detection.
  • the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component.
  • the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 is attached above the chip, or some components of the optical assembly 132 are integrated into the chip.
  • the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes.
  • the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple A collimating unit or a micro-hole array.
  • the collimating unit can be specifically a small hole.
  • the reflected light reflected from the finger the light that is perpendicularly incident on the collimating unit can pass through and be passed by the optical sensing unit below it.
  • the light with an excessively large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it.
  • the sensor array can detect the fingerprint image of the finger.
  • the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, which The sensing array used to converge the reflected light reflected from the finger to the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger.
  • the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device to improve the optical The fingerprint imaging effect of the fingerprint device 130.
  • the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer.
  • the micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be grown by semiconductors.
  • a process or other processes are formed above the sensing array of the light detecting part 134, and each microlens may correspond to one of the sensing units of the sensing array.
  • other optical film layers may be formed between the microlens layer and the sensing unit, such as a dielectric layer or a passivation layer.
  • the microlens layer and the sensing unit may also include The light-blocking layer of the micro-hole, wherein the micro-hole is formed between the corresponding micro-lens and the sensing unit, the light-blocking layer can block the optical interference between the adjacent micro-lens and the sensing unit, and make the sensing
  • the light corresponding to the unit is condensed into the microhole through the microlens and is transmitted to the sensing unit through the microhole to perform optical fingerprint imaging.
  • a microlens layer can be further provided under the collimator layer or the optical lens layer.
  • the collimator layer or the optical lens layer is used in combination with the micro lens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.
  • the display screen 120 may be a display screen with a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display or a micro-LED (Micro-LED) display Screen.
  • OLED Organic Light-Emitting Diode
  • the optical fingerprint device 130 may use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection.
  • the display screen 120 emits a beam of light to the target finger above the fingerprint detection area 103. The light is reflected on the surface of the finger to form reflected light or is scattered inside the finger.
  • the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Because the ridge and valley of the fingerprint have different light reflection capabilities, the reflected light from the fingerprint ridge and the emitted light from the fingerprint ridge have different light intensities. After the reflected light passes through the optical components, it is optically fingerprinted.
  • the sensing array in the device 130 receives and converts into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed, thereby implementing the electronic device 10 Optical fingerprint recognition function.
  • the optical fingerprint device 130 may also use a built-in light source or an external light source to provide an optical signal for fingerprint detection.
  • the optical fingerprint device 130 may be suitable for non-self-luminous display screens, such as liquid crystal display screens or other passively-luminous display screens.
  • the optical fingerprint system of the electronic device 10 may also include an excitation light source for optical fingerprint detection.
  • the excitation light source may specifically be an infrared light source or a light source of non-visible light of a specific wavelength, which may be arranged under the backlight module of the liquid crystal display or in the edge area under the protective cover of the electronic device 10, and the The optical fingerprint device 130 can be arranged under the edge area of the liquid crystal panel or the protective cover and guided by the light path so that the fingerprint detection light can reach the optical fingerprint device 130; or, the optical fingerprint device 130 can also be arranged in the backlight module. Under the group, and the backlight module is designed to allow the fingerprint detection light to pass through the liquid crystal panel and the backlight module and reach the optical fingerprint device 130 through openings or other optical designs on the film layers such as diffuser, brightness enhancement film, and reflective film. .
  • the optical fingerprint device 130 adopts a built-in light source or an external light source to provide an optical signal for fingerprint detection, the detection principle is the same as that described above.
  • the electronic device 10 further includes a transparent protective cover, which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the electronic The front of the device 10.
  • a transparent protective cover which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the electronic The front of the device 10.
  • the optical fingerprint device 130 may include only one optical fingerprint sensor.
  • the fingerprint detection area 103 of the optical fingerprint device 130 has a small area and a fixed position, so the user is performing fingerprint input At this time, it is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the optical fingerprint device 130 may not be able to collect fingerprint images, resulting in poor user experience.
  • the optical fingerprint device 130 may specifically include multiple optical fingerprint sensors; the multiple optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the multiple optical fingerprint sensors The sensing area of the fingerprint sensor together constitutes the fingerprint detection area 103 of the optical fingerprint device 130.
  • the fingerprint detection area 103 of the optical fingerprint device 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint collection area 103 of the optical fingerprint device 130 It can be extended to the main area of the lower half of the display screen, that is, extended to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation.
  • the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.
  • FIG. 1A and FIG. 1B only take the optical fingerprint device as an example for description.
  • the fingerprint recognition device in the embodiment of the present application may also be an ultrasonic fingerprint device, that is, the fingerprint image in the embodiment of the present application may be based on an optical fingerprint.
  • the embodiment of this application does not limit the way of collecting fingerprint images.
  • TEE Trusted Execution Environment
  • DSP Digital Signal Processing
  • TEEs such as the TrustZone environment or Qualcomm's Secure DSP usually only support single-threaded applications. For example, if a user has registered multiple fingerprint templates, the fingerprint recognition function can only be performed according to each fingerprint template in turn. Fingerprint recognition takes longer long.
  • the user has registered 3 fingerprint templates as an example to illustrate the specific fingerprint identification process.
  • Figure 2 is a flow chart of fingerprint identification based on three fingerprint templates. As shown in Figure 2, the specific identification process may include the following steps:
  • S202 Judge whether the fingerprint recognition is successful, if successful, the process jumps to S212; otherwise, the process jumps to S203;
  • fingerprint recognition can only be performed according to each fingerprint template in turn, which results in a longer fingerprint recognition time and affects user experience.
  • the present application provides a fingerprint identification solution that can perform fingerprint identification processing based on multiple threads, thereby shortening fingerprint identification time and improving user experience.
  • the fingerprint identification process may be referred to as a fingerprint authentication process or a fingerprint matching process. Therefore, the fingerprint identification process may also be referred to as a fingerprint authentication process or a fingerprint matching process.
  • fingerprint recognition-related operations can be performed in the same secure environment.
  • the secure environment can be a TEE that supports multi-threading, or can be performed in multiple secure environments.
  • multiple threads can be created in the same TEE to perform operations related to fingerprint recognition processing in parallel, or multiple threads can be created in multiple security environments to perform operations related to fingerprint recognition processing in parallel. This embodiment of the application does not make specifics about this. limited.
  • the security environment for fingerprint recognition in the embodiment of the present application may be a TEE that supports multi-threading, or may also support a single-threaded TEE, so that only the multiple threads need to be executed in parallel in multiple TEEs.
  • the number of threads that can be created may be determined according to the number of CPUs in the secure environment.
  • the method of fingerprint identification of the embodiment of the present application can be executed by a fingerprint identification device. Specifically, the method can be performed by the fingerprint
  • the processing unit in the recognition device is executed.
  • the processing unit may be the Micro Control Unit (MCU) in the optical fingerprint device 130 described above, or it may also be the electronic fingerprint device described above.
  • the processor or controller of the device 10 may also include the MCU of the optical fingerprint device and the processor of the electronic device, that is, the method may be executed by the processor of the electronic device and the MCU of the optical fingerprint device.
  • the following embodiments describe the fingerprint recognition method according to the embodiments of the present application with the fingerprint recognition device as the execution subject.
  • FIG. 3 is a schematic flowchart of a fingerprint identification method 300 according to an embodiment of the present application. As shown in FIG. 3, the method 300 includes:
  • S301 Perform fingerprint recognition processing on a first fingerprint image in parallel based on at least two fingerprint sub-templates, where each fingerprint sub-template of the at least two fingerprint sub-templates corresponds to a local area in the first fingerprint template, and Any two fingerprint sub-templates of the at least two fingerprint sub-templates do not overlap at least partly in the first fingerprint template.
  • a single fingerprint template can be divided into at least two fingerprint sub-templates, and then the first fingerprint image to be recognized is subjected to fingerprint recognition processing in parallel according to the at least two fingerprint sub-templates, so as to determine the specific
  • the fingerprint recognition result of a fingerprint image is beneficial to shorten the fingerprint recognition time and improve the user experience.
  • the first fingerprint template can be divided into at least two fingerprint sub-templates, for example, a first fingerprint sub-template and a second fingerprint sub-template.
  • the first fingerprint sub-template and the second fingerprint sub-template are at least partially No overlap.
  • the first fingerprint sub-template corresponds to the edge area of the first fingerprint template
  • the second fingerprint sub-template corresponds to the central area of the first fingerprint template; or
  • the first fingerprint sub-template corresponds to the left half of the first fingerprint template
  • the second fingerprint sub-template corresponds to the right half of the first fingerprint template.
  • S301 may specifically include:
  • the fingerprint recognition device can perform fingerprint recognition processing on the first fingerprint image according to other fingerprint sub-templates in parallel, for example, based on the third fingerprint in parallel.
  • the fingerprint sub-template performs fingerprint recognition processing on the first fingerprint image, and the embodiment of the present application is not limited thereto.
  • the fingerprint recognition device may perform fingerprint recognition on the first fingerprint image based on the first fingerprint sub-template based on the first fingerprint recognition result obtained by performing fingerprint recognition processing on the first fingerprint image, and perform the fingerprint recognition on the first fingerprint based on the second fingerprint sub-template.
  • a fingerprint image is subjected to fingerprint recognition processing to obtain a second fingerprint recognition result, and then the fingerprint recognition result of the first fingerprint image for the first fingerprint template can be determined according to the first fingerprint recognition result and the second fingerprint recognition result.
  • the fingerprint recognition device may determine that the first fingerprint image is for the first fingerprint template when one of the fingerprint recognition results is that the fingerprint recognition is successful in the first fingerprint recognition result and the second fingerprint recognition result
  • the fingerprint identification result of is a successful fingerprint identification; otherwise, it is determined that the fingerprint identification fails.
  • the fingerprint recognition device may determine the fingerprint recognition result of the first fingerprint image for the first fingerprint template when the first fingerprint recognition result and the second fingerprint recognition result are both successful fingerprint recognition Fingerprint recognition is successful; otherwise, it is determined that the fingerprint recognition has failed.
  • the fingerprint recognition device may also perform fingerprint recognition when the first fingerprint recognition result is When it succeeds, it is determined that the fingerprint recognition result of the first fingerprint image for the first fingerprint template is a successful fingerprint recognition; when the first fingerprint recognition result is a fingerprint recognition failure, it is determined that the first fingerprint image is for the first fingerprint.
  • the fingerprint recognition result of the fingerprint template is fingerprint recognition failure.
  • performing fingerprint recognition processing on the first fingerprint image based on the first fingerprint sub-template may specifically include:
  • Matching the first fingerprint sub-template and the first fingerprint image for example, matching the characteristic information of the first fingerprint image and the characteristic information of the first fingerprint sub-template.
  • the performing fingerprint recognition processing on the first fingerprint image based on the first fingerprint sub-template may also include:
  • the fingerprint recognition device may first preprocess the collected first fingerprint image to obtain a fingerprint image in a specific file format, for example, A fingerprint image in the bmp (Bitmap) format, and further, feature extraction is performed on the fingerprint image in the bmp format to determine the feature information of the first fingerprint image.
  • the feature information may include, but is not limited to, the position of the feature point in the fingerprint image, The number, type, direction of the ridge and other information.
  • the characteristic points can be ridge end points and bifurcation points.
  • the characteristic information of the first fingerprint image can be used to match the characteristic information of the fingerprint template to determine the fingerprint recognition result.
  • the fingerprint recognition processing performed on the first fingerprint image based on the first fingerprint sub-template may not include processing operations such as preprocessing or feature extraction of the first fingerprint image, that is, The performing fingerprint recognition processing on the first fingerprint image based on the first fingerprint sub-template may only include: matching the first fingerprint sub-template with the first fingerprint image.
  • performing fingerprint recognition processing on the first fingerprint image based on other sub-templates, such as the second fingerprint sub-template, is the same, and will not be repeated here.
  • S301 may also specifically include:
  • the feature information of the first fingerprint image and the feature information of the at least two fingerprint sub-templates are matched in parallel to determine at least two fingerprint recognition results.
  • the fingerprint identification result of the first fingerprint image for the first fingerprint template may be determined according to the at least two fingerprint identification results.
  • the fingerprint recognition device can perform the function of the characteristic information of the first fingerprint image and the characteristic information of the first fingerprint sub-template. Matching determines the first fingerprint recognition result; at the same time, the characteristic information of the first fingerprint image and the characteristic information of the second fingerprint sub-template are matched to determine the second fingerprint recognition result. Then, according to the first fingerprint identification result and the second fingerprint identification result, the fingerprint identification result of the first fingerprint image for the first fingerprint template is determined.
  • matching the feature information of the first fingerprint image with the feature information of the first fingerprint sub-template may include: comparing the feature information of the first fingerprint sub-template with the extracted first fingerprint sub-template The feature information of a fingerprint image is matched, the similarity between the first fingerprint template and the corresponding feature points of the first fingerprint image is determined, and the similarity matrix is obtained.
  • the matching area between the first fingerprint sub-template and the first fingerprint image according to the obtained similarity matrix determines the matching degree information between the fingerprint sub-template and the fingerprint image in each matching area, and further determine the fingerprint recognition result according to the matching degree information For example, when the degree of matching is greater than a certain threshold, it is determined that the fingerprint recognition is successful, otherwise it is determined that the fingerprint recognition fails.
  • the fingerprint identification method 40 may include at least part of the following content:
  • a filtering algorithm may be used to process the first fingerprint image to remove interference information such as noise, burrs, or breaks in the first fingerprint image to obtain a fingerprint image in a specific format;
  • S402 Perform feature extraction on the preprocessed first fingerprint image to obtain feature information of the first fingerprint image.
  • a feature extraction algorithm can be used to process the preprocessed first fingerprint image to determine the feature information of the first fingerprint image, for example, the location, number, type, and direction of the ridges of the feature points in the fingerprint image,
  • the characteristic points can be ridge end points and bifurcation points.
  • the first fingerprint image is matched according to the first fingerprint sub-template to obtain the first fingerprint recognition result; at the same time, in S406, in thread 2, according to the second fingerprint The sub-template matches the first fingerprint image to obtain the second fingerprint recognition result;
  • the fingerprint identification result of the first fingerprint image to the first fingerprint template can be determined. So far, the identification process of the first fingerprint image for the first fingerprint template ends.
  • more threads such as thread 3 can be created to perform fingerprint matching processing in parallel with thread 1 and thread 2.
  • the multiple fingerprint templates can also be divided into multiple fingerprint sub-templates, and corresponding threads are established respectively to be used according to each fingerprint sub-template.
  • the template performs matching processing on the first fingerprint image to determine a fingerprint recognition result for the first fingerprint image.
  • the second fingerprint template is divided into a third fingerprint sub-template and a fourth fingerprint sub-template.
  • four threads can be created, thread 1 to thread 4, respectively.
  • the first fingerprint image is matched to determine the corresponding fingerprint recognition result.
  • the fingerprint recognition device may determine that the fingerprint recognition result for the first fingerprint image is the fingerprint recognition success when any fingerprint recognition result is the fingerprint recognition success.
  • the operation that triggers fingerprint recognition may be a screen unlock operation, a payment operation, etc., then in the case of successful fingerprint recognition, the fingerprint recognition device may also trigger the execution of the corresponding operation .
  • the judgment condition for determining whether the fingerprint recognition is successful is only an example, and should not constitute any limitation in the embodiment of the present application.
  • different judgment conditions can be configured according to the security level of the operation that triggers fingerprint recognition. For example, fingerprint recognition triggered by operations with a higher security level, such as payment operations, can be used for each fingerprint.
  • fingerprint recognition results of the template are all successful, the fingerprint recognition is determined to be successful, or for fingerprint recognition triggered by operations with lower security levels such as screen unlocking, it can be determined that the fingerprint recognition is successful when any fingerprint recognition result is successful. .
  • fingerprint recognition is performed on the first fingerprint image based on at least one fingerprint template, it is determined that the fingerprint recognition fails, and multiple retries are allowed for fingerprint recognition. In this case, more fingerprint images can be collected. It is used for retry recognition, but it takes time to collect fingerprint images, and further fingerprint recognition based on the collected fingerprint images also takes time, which also increases the fingerprint recognition time.
  • the embodiment of the present application also provides a fingerprint recognition solution, which can simultaneously collect more fingerprint images for retry recognition when performing fingerprint recognition processing based on the first fingerprint image collected.
  • fingerprint recognition is performed directly based on the subsequent fingerprint images, which can reduce fingerprint recognition time and improve user experience.
  • FIG. 5 is a schematic flowchart of a fingerprint identification method according to another embodiment of the present application. As shown in FIG. 5, the method 500 includes at least the following parts:
  • S501 Perform fingerprint recognition processing on the first fingerprint image, collect at least one second fingerprint image in parallel, and perform preprocessing on the at least one second fingerprint image.
  • At least one second fingerprint image for subsequent fingerprint recognition can also be collected.
  • the fingerprint recognition can be directly performed according to the at least one second fingerprint image, which saves fingerprint collection time and thereby can reduce fingerprint recognition time.
  • At least one second fingerprint image collected may also be preprocessed, and the specific content of the preprocessing operation can be referred to as shown in FIG. 3. The relevant description of the embodiment will not be repeated here.
  • the method 500 further includes:
  • fingerprint identification processing is performed in parallel on the at least one second fingerprint image after preprocessing, to determine a fingerprint identification result of the at least one second fingerprint image.
  • At least one second fingerprint image can be collected while performing fingerprint recognition processing on the first fingerprint image. If there are multiple second fingerprint images, the subsequent fingerprint recognition is performed. At this time, fingerprint identification processing can also be performed in parallel based on the multiple fingerprint images to determine the final fingerprint identification result, which can shorten the fingerprint identification time.
  • the fingerprint recognition device may further perform subsequent fingerprint recognition on the at least one second fingerprint image when the fingerprint recognition of the first fingerprint image fails to determine the final fingerprint recognition result, and then determine Whether to perform an operation that triggers fingerprint recognition.
  • the fingerprint recognition device may not perform subsequent fingerprint recognition on the at least one second fingerprint image.
  • the performing fingerprint recognition processing on the first fingerprint image includes:
  • the feature information of the first fingerprint image is matched with the feature information of at least one fingerprint template to determine the fingerprint recognition result of the first fingerprint image.
  • performing fingerprint recognition processing on the first fingerprint image may include performing fingerprint recognition processing on the first fingerprint image according to at least one fingerprint template, similar to the embodiment shown in FIG. 3, in this implementation
  • the fingerprint template can also be divided into multiple fingerprint sub-templates, and then the first fingerprint image is subjected to parallel fingerprint recognition processing based on the multiple fingerprint sub-templates to determine the fingerprint recognition result.
  • the specific implementation can refer to the embodiment shown in Figure 3 Related description.
  • FIG. 3 and FIG. 5 may be implemented separately, or may be implemented in combination, which is not limited in the embodiments of the present application.
  • the fingerprint identification method 60 may include at least part of the following content:
  • S601 Perform feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the first fingerprint image may be preprocessed.
  • a feature extraction algorithm can be used to process the preprocessed first fingerprint image to determine the feature information of the first fingerprint image, for example, the location, number, type, and ridge direction of the feature points in the fingerprint image.
  • Feature points can be the end points and bifurcation points of the lines.
  • a fingerprint matching algorithm is used to match the first fingerprint image and the fingerprint template to determine the fingerprint recognition result.
  • a new thread is created for collecting at least one second fingerprint image and preprocessing the at least one second fingerprint image.
  • the fingerprint recognition device collects at least one second fingerprint image, and preprocesses the at least one second fingerprint image.
  • S605 it is determined whether the fingerprint recognition of the first fingerprint image is successful. If the recognition is successful, the recognition ends, and then an operation that triggers the fingerprint recognition may be performed, such as unlocking the screen or payment operation. Or, if the recognition fails, the process jumps to S606.
  • At least one thread is created to perform fingerprint recognition on at least one second fingerprint image collected in parallel.
  • a feature extraction algorithm and a matching algorithm can be executed for each second fingerprint image to determine the The fingerprint recognition result of the image. For example, it may be determined that the fingerprint recognition is successful when there is a fingerprint recognition result that the fingerprint recognition is successful, or when each fingerprint recognition result is a fingerprint recognition failure, it may be determined that the fingerprint recognition failed.
  • the judgment conditions for determining the success or failure of fingerprint recognition are only examples, and should not constitute any limitation to the embodiments of this application.
  • the embodiments of this application can perform fingerprint recognition operations based on triggers. Configure different judgment conditions. For example, for fingerprint recognition triggered by payment operations, you can determine that the fingerprint recognition is successful when the fingerprint recognition result of each fingerprint image to be recognized is successful, or for the screen unlock The triggered fingerprint recognition can determine that the fingerprint recognition is successful when the fingerprint recognition result of any fingerprint image to be recognized is successful.
  • the amount of fingerprint data collected by optical fingerprint devices or ultrasonic fingerprint devices is usually large, while the operating memory provided by the system for fingerprint templates is small. If the decompressed version of each fingerprint template is stored in the system, It takes up a lot of memory, especially when the user has registered multiple fingerprint templates, or if the compressed version of the fingerprint template is stored in the system, the fingerprint template needs to be decompressed for fingerprint matching, and the fingerprint is decompressed Templates are often time-consuming, which also leads to longer time-consuming fingerprint recognition.
  • the embodiment of the present application also provides a fingerprint recognition solution, which can decompress the fingerprint template to be matched in parallel when the fingerprint image to be recognized performs the operation before the fingerprint matching process, so as to avoid decompressing the fingerprint in advance.
  • the fingerprint template occupies the memory, and can save decompression time, thereby shortening the fingerprint identification time.
  • FIG. 7 is a schematic flowchart of a fingerprint identification method according to an embodiment of the present application. As shown in FIG. 7, the method 700 may include at least part of the following content:
  • the performing the first fingerprint recognition processing on the first fingerprint image may include various operations related to the fingerprint recognition processing but does not require the participation of the fingerprint template, for example, performing the first fingerprint recognition processing on the first fingerprint image
  • the preprocessing operation of the first fingerprint image, or the feature extraction operation of the first fingerprint image, etc., are not limited in the embodiment of the present application.
  • the first fingerprint identification processing may be a processing operation not related to the fingerprint template
  • the second fingerprint identification processing may be a processing operation related to the fingerprint template
  • the embodiment of the present application decompresses the first fingerprint template to be matched while performing the first fingerprint recognition processing on the first fingerprint image to be recognized, which can save decompression time, thereby shortening the fingerprint recognition time, and avoiding pre-decompression. Reduce the memory usage of the fingerprint template.
  • the method 700 further includes:
  • the subsequent fingerprint matching operation may be performed according to the decompressed first fingerprint template and the processing result of the first fingerprint image after the first fingerprint identification processing.
  • the fingerprint recognition device may match the characteristic information of the first fingerprint image with the characteristic information of the first fingerprint template to determine that the first fingerprint image is for the first fingerprint recognition of the first fingerprint template result.
  • the fingerprint recognition device may match the characteristic information of the first fingerprint image with the characteristic information of the first fingerprint template to determine that the first fingerprint image is for the first fingerprint recognition of the first fingerprint template result.
  • the compressed second fingerprint template can also be decompressed in parallel, where: The second fingerprint template is the next fingerprint template to be matched in the first fingerprint image.
  • the second fingerprint recognition process is performed on the first fingerprint image directly according to the decompressed second fingerprint template, which can save the solution of the second fingerprint template. Compress time, shorten fingerprint recognition time.
  • the performing the second fingerprint identification processing on the first fingerprint image based on the decompressed first fingerprint template includes:
  • the second fingerprint identification process is performed on the first fingerprint image in parallel based on at least two fingerprint sub-templates, wherein each fingerprint sub-template of the at least two fingerprint sub-templates corresponds to the first fingerprint template Local area, and any two fingerprint sub-templates in the at least two fingerprint sub-templates do not overlap at least partially in the first fingerprint template.
  • FIG. 7 and the embodiment shown in FIG. 3 can be implemented separately, or can also be implemented in combination, which is not limited in the embodiment of the present application.
  • the embodiment shown in FIG. 7 and the embodiment shown in FIG. 5 may be implemented separately, or may be implemented in combination.
  • the first fingerprint image may be matched according to the first fingerprint template.
  • at least one second fingerprint image is collected in parallel, and operations such as preprocessing are performed on the at least one second fingerprint image.
  • FIG. 3, FIG. 5, and FIG. 7 can be implemented separately, or any at least two embodiments can be implemented in combination, which is not limited in the embodiments of the present application.
  • the fingerprint identification method 80 may include at least part of the following content:
  • the first fingerprint template can be obtained from the memory.
  • preprocessing and feature extraction are performed on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the first fingerprint template is the fingerprint template currently to be matched, for example, it may be the fingerprint template with the highest priority, or It can also be the first fingerprint template.
  • fingerprint matching is performed on the first fingerprint image and the decompressed first fingerprint template to determine the fingerprint identification result.
  • S807 can be executed to create a new thread for decompressing the next fingerprint template to be matched.
  • the fingerprint template to be matched while performing the first fingerprint recognition processing on the first fingerprint image, the fingerprint template to be matched can be decompressed in parallel. After the decompression is completed, the decompressed fingerprint template can be directly used Perform the second fingerprint recognition processing on the first fingerprint image. If the user has registered multiple fingerprint templates, while performing the second fingerprint recognition processing on the first fingerprint image, the next fingerprint template to be matched can also be decompressed In this way, the decompression time in the fingerprint identification process can be saved, and at the same time, the storage of the decompressed fingerprint template in the memory can be avoided, resulting in the occupation of the system memory.
  • the fingerprint template to be matched can be decompressed in parallel when the fingerprint image to be identified is preprocessed or feature extraction is performed, or the fingerprint template to be identified can be decompressed according to the fingerprint template and the fingerprint image to be identified.
  • the next fingerprint template to be matched can also be decompressed, which can save decompression time.
  • the fingerprint template when performing fingerprint matching based on the fingerprint template and the fingerprint image to be recognized, can be divided into multiple fingerprint sub-templates, and the fingerprint image can be matched based on the multiple fingerprint sub-templates in parallel. Shorten the fingerprint matching time.
  • fingerprint matching when fingerprint matching is performed based on the fingerprint template and the first fingerprint image to be recognized, more fingerprint images can be collected in parallel for repetition if the first fingerprint image fails to match. Try identification.
  • processing operations such as preprocessing or feature extraction processing can be performed on the subsequently collected fingerprint images, which can shorten the fingerprint matching time.
  • multiple threads processed in parallel may be executed in the same security environment, or may be executed in multiple security environments, so that the parallel execution of functional modules can pass through Shared memory interaction information.
  • FIG. 9 is a schematic block diagram of a fingerprint recognition device according to an embodiment of the present application. As shown in FIG. 9, the fingerprint recognition device 900 includes:
  • the fingerprint identification module 901 is configured to perform fingerprint identification processing on the first fingerprint image in parallel based on at least two fingerprint sub-templates, wherein each of the at least two fingerprint sub-templates corresponds to a part of the first fingerprint template Region, and any two fingerprint sub-templates of the at least two fingerprint sub-templates do not overlap at least partly in the first fingerprint template.
  • the fingerprint recognition device 900 may be provided in a fingerprint device, or the fingerprint recognition device may be the fingerprint device, or the fingerprint recognition device may include the fingerprint device, or the fingerprint recognition device
  • the fingerprint identification device 900 is an electronic device.
  • the fingerprint device here may correspond to the optical fingerprint device 130 described above, or may also be an ultrasonic fingerprint device, which is not limited in the embodiment of the present application.
  • the device 900 further includes: a feature extraction module, configured to perform feature extraction processing on the first fingerprint image to obtain feature information of the first fingerprint image.
  • a feature extraction module configured to perform feature extraction processing on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the fingerprint identification module 901 is also used to:
  • a fingerprint recognition result of the first fingerprint image for the first fingerprint template is determined.
  • the fingerprint identification module 901 is also used to:
  • the fingerprint identification module 901 is specifically configured to:
  • fingerprint identification processing is performed on the first fingerprint image in parallel based on the at least two fingerprint sub-templates.
  • the first security environment may be a TEE that supports multi-threading.
  • the fingerprint identification module and the feature extraction module may be independent functional modules, or the feature extraction module and the fingerprint identification module may be the same functional module, that is, the fingerprint identification module and the feature
  • the functions executed by the extraction module can be executed by the same functional module, for example, by the MCU in the fingerprint device, or can also be executed by the processor or controller in the electronic device.
  • the fingerprint recognition device 900 may further include a fingerprint sensor for collecting at least one fingerprint image, which may correspond to the optical fingerprint sensor in the optical fingerprint device 130 in the foregoing embodiment. .
  • FIG. 10 is a schematic block diagram of a fingerprint recognition device according to an embodiment of the present application. As shown in FIG. 10, the fingerprint recognition device 1000 includes:
  • the first fingerprint identification module 1001 is configured to perform fingerprint identification processing on the first fingerprint image
  • the fingerprint sensor 1002 is configured to collect at least one second fingerprint image to be identified in parallel when the first fingerprint identification module performs fingerprint identification processing on the first fingerprint image;
  • the second fingerprint identification module 1003 is used for preprocessing the at least one second fingerprint image to be identified in parallel when the first fingerprint identification module performs fingerprint identification processing on the first fingerprint image.
  • the fingerprint recognition device 1000 may be provided in a fingerprint device, or the fingerprint recognition device may be the fingerprint device, or the fingerprint recognition device may include the fingerprint device, or the fingerprint recognition device
  • the fingerprint recognition device 1000 is an electronic device.
  • the fingerprint device here may correspond to the optical fingerprint device 130 described above, or may also be an ultrasonic fingerprint device, which is not limited in the embodiment of the present application.
  • the second fingerprint identification module 1003 is also used to:
  • fingerprint identification processing is performed in parallel on the at least one second fingerprint image after preprocessing, to determine a fingerprint identification result of the at least one second fingerprint image.
  • the second fingerprint identification module 1003 is specifically configured to: in the case that the fingerprint identification result of the first fingerprint image is fingerprint identification failure, based on the at least one fingerprint template, perform the identification of the at least one second fingerprint The fingerprint image is processed in parallel for fingerprint recognition.
  • the second fingerprint identification module 1003 is further configured to determine whether to perform an operation that triggers fingerprint identification according to the fingerprint identification result of the at least one second fingerprint image.
  • the first fingerprint identification module 1001 is further configured to: perform feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image;
  • the feature information of the first fingerprint image is matched with the feature information of at least one fingerprint template to determine the fingerprint recognition result of the first fingerprint image.
  • the first fingerprint identification module 1001 is specifically configured to: perform fingerprint identification processing on the first fingerprint image in a first security environment;
  • the fingerprint sensor 1002 is specifically used to collect the at least one second fingerprint image in the first security environment
  • the second fingerprint identification module 1003 is specifically configured to preprocess the at least one second fingerprint image in the first security environment.
  • the second fingerprint identification module 1003 is specifically configured to:
  • fingerprint identification processing is performed in parallel on the at least one second fingerprint image after preprocessing.
  • the first security environment may be a TEE that supports multi-threading.
  • the first fingerprint identification module and the second fingerprint identification module may be independent functional modules, or the first fingerprint identification module and the second fingerprint identification module may be the same functional module, namely
  • the functions executed by the first fingerprint identification module and the second fingerprint identification module can be executed by the same functional module, for example, by the MCU in the fingerprint device, or can also be executed by the processor or controller in the electronic device.
  • the fingerprint sensor 1002 is a module for fingerprint collection in the fingerprint recognition device. In some embodiments, it may correspond to the optical fingerprint sensor in the optical fingerprint device 130 described above, or in other embodiments. , It can be the ultrasonic detection part of the ultrasonic fingerprint device.
  • FIG. 11 is a schematic block diagram of a fingerprint recognition device according to an embodiment of the present application. As shown in FIG. 11, the fingerprint recognition device 1100 includes:
  • the fingerprint identification module 1101 is configured to perform first fingerprint identification processing on the first fingerprint image
  • the decompression module 1102 is configured to decompress the compressed first fingerprint template in parallel when the first fingerprint recognition module performs the first fingerprint recognition processing on the first fingerprint image;
  • the fingerprint recognition processing of the first fingerprint image includes the first fingerprint recognition processing and the second fingerprint recognition processing, and the execution of the second fingerprint recognition processing is later than the execution of the first fingerprint recognition processing.
  • the fingerprint recognition device 1100 may be provided in a fingerprint device, or the fingerprint recognition device may be the fingerprint device, or the fingerprint recognition device may include the fingerprint device, or the fingerprint recognition device
  • the fingerprint identification device 1100 is an electronic device.
  • the fingerprint device here may correspond to the optical fingerprint device 130 described above, or may also be an ultrasonic fingerprint device, which is not limited in the embodiment of the present application.
  • the fingerprint identification module 1101 is also used to:
  • the fingerprint identification module 1101 is specifically configured to: perform feature extraction on the first fingerprint image to obtain feature information of the first fingerprint image.
  • the fingerprint identification module 1101 is specifically configured to:
  • the feature information of the first fingerprint image and the feature information of the first fingerprint template are matched to determine the first fingerprint identification result of the first fingerprint image for the first fingerprint template.
  • the fingerprint identification module 1101 is also used to:
  • the second fingerprint identification process is performed on the first fingerprint image in parallel based on at least two fingerprint sub-templates, wherein each fingerprint sub-template of the at least two fingerprint sub-templates corresponds to the first fingerprint template Local area, and any two fingerprint sub-templates in the at least two fingerprint sub-templates do not overlap at least partially in the first fingerprint template.
  • the fingerprint identification module 1101 is specifically configured to perform the second fingerprint identification processing on the fingerprint image to be identified based on the decompressed first fingerprint template in a first security environment;
  • the decompression module 1102 is configured to decompress the second fingerprint template in the first security environment.
  • the fingerprint identification module 1101 is specifically configured to: perform the first fingerprint identification processing on the first fingerprint image in a first security environment;
  • the decompression module 1102 is configured to decompress the compressed first fingerprint template in the first security environment.
  • the first security environment may be a TEE that supports multi-threading.
  • the fingerprint identification module and the decompression module may be independent functional modules, or the fingerprint identification module and the decompression module may be the same functional module, that is, the fingerprint identification module and the decompression module execute
  • the functions can be executed by the same functional module, for example, by the MCU in the fingerprint device, or can also be executed by the processor or controller in the electronic device.
  • the fingerprint recognition device 1100 may further include a fingerprint sensor for collecting at least one fingerprint image, which may correspond to the optical fingerprint sensor in the optical fingerprint device 130 in the foregoing embodiment. .
  • an embodiment of the present application also provides an electronic device 1200.
  • the electronic device 1200 may include a fingerprint recognition device 1210.
  • the device 1210 may be the fingerprint recognition device 900 in the foregoing embodiment.
  • the device 1000 for fingerprint recognition or the device 1100 for fingerprint recognition are used to execute the content in the method embodiments shown in FIG. 3, FIG. 5, and FIG. 7, respectively.
  • the electronic device 1200 may be a portable or mobile computing device such as a smart phone, a notebook computer, a tablet computer, and a game device, as well as an electronic database, a car, a bank automated teller machine (Automated Teller Machine, ATM), etc. Electronic equipment, but the embodiment of the present application does not limit this.
  • the processing module such as the processing unit or processor in the embodiments of the present application may be an integrated circuit chip with signal processing capability.
  • the steps of the foregoing method embodiments can be completed by hardware integrated logic circuits in the processor or instructions in the form of software.
  • the aforementioned processor may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (ASIC), a ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP Digital Signal Processor
  • ASIC application specific integrated circuit
  • FPGA Field Programmable Gate Array
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
  • the terminal or the electronic device of the embodiment of the present application may further include a memory
  • the memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), and electrically available Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be a random access memory (Random Access Memory, RAM), which is used as an external cache.
  • RAM random access memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • SDRAM double data rate synchronous dynamic random access memory
  • Double Data Rate SDRAM DDR SDRAM
  • ESDRAM enhanced synchronous dynamic random access memory
  • Synchlink DRAM SLDRAM
  • DR RAM Direct Rambus RAM
  • the embodiment of the present application also proposes a computer-readable storage medium that stores one or more programs, and the one or more programs include instructions.
  • the instructions When the instructions are included in a portable electronic device that includes multiple application programs When executed, the portable electronic device can be made to execute the method of the embodiment shown in FIGS. 3 to 8.
  • the embodiment of the present application also proposes a computer program, the computer program includes instructions, when the computer program is executed by the computer, the computer can execute the method of the embodiment shown in FIG. 3 to FIG. 8.
  • An embodiment of the present application also provides a chip, which includes an input and output interface, at least one processor, at least one memory, and a bus.
  • the at least one memory is used to store instructions, and the at least one processor is used to call the at least one memory. To execute the method of the embodiment shown in FIG. 3 to FIG. 8.
  • the size of the sequence numbers of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, rather than corresponding to the embodiments of the present application.
  • the implementation process constitutes any limitation.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Collating Specific Patterns (AREA)
  • Image Input (AREA)

Abstract

一种指纹识别的方法、装置和电子设备,能够缩短指纹识别时间,该方法包括:基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。

Description

指纹识别的方法、装置和电子设备 技术领域
本申请涉及指纹技术领域,并且更具体地,涉及指纹识别的方法、装置和电子设备。
背景技术
随着生物识别技术的发展,越来越多的终端设备搭载了指纹识别技术,电容指纹技术已在终端设备得到广泛应用,随着全面屏时代的到来,电容指纹技术逐渐成为终端美观的阻碍,光学指纹技术或超声波指纹技术提高了屏占比,使得指纹识别面积越来越大,带来了更好的用户体验。
虽然光学指纹技术或超声波指纹技术能够提供更大的屏占比,但是,指纹识别时间往往不如电容指纹技术,以光学指纹技术为例,采用光学指纹技术需要采集更多的指纹数据用于指纹成像,这就使得成像后的指纹图像较大,通常是采用电容指纹技术的指纹数据的几倍,因此,导致后续需要更复杂的算法实现指纹识别流程,增长了指纹识别时间,影响用户体验。因此,如何降低指纹识别时间,以提升用户体验是一项亟需解决的问题。
发明内容
本申请实施例提供一种指纹识别的方法、装置和电子设备,能够降低指纹识别时间,提升用户体验。
第一方面,提供了一种指纹识别的方法,所述方法包括:
基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
在一种可能的实现方式中,所述方法包括:对所述第一指纹图像进行特征提取处理,得到所述第一指纹图像的特征信息。
在一种可能的实现方式中,所述基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,包括:
并行将所述第一指纹图像的特征信息和所述至少两个指纹子模板的特 征信息进行匹配,确定至少两个指纹识别结果;
根据所述至少两个指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
在一种可能的实现方式中,所述方法还包括:
将所述第一指纹模板划分为所述至少两个指纹子模板。
在一种可能的实现方式中,所述基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,包括:
在第一安全环境中,基于所述至少两个指纹子模板并行对所述第一指纹图像进行指纹识别处理。
第二方面,提供了一种指纹识别的方法,所述方法包括:对第一指纹图像进行指纹识别处理,并行采集至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理。
在一种可能的实现方式中,所述方法还包括:
基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,确定所述至少一个第二指纹图像的指纹识别结果。
在一种可能的实现方式中,所述基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,包括:在所述第一指纹图像的指纹识别结果为指纹识别失败的情况下,基于所述至少一个指纹模板,对所述至少一个第二指纹图像并行进行指纹识别处理。
在一种可能的实现方式中,所述方法还包括:根据所述至少一个第二指纹图像的指纹识别结果确定是否执行触发指纹识别的操作。
在一种可能的实现方式中,所述对第一指纹图像进行指纹识别处理,包括:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息;
将所述第一指纹图像的特征信息和至少一个指纹模板的特征信息进行匹配,确定所述第一指纹图像的指纹识别结果。
在一种可能的实现方式中,所述对第一指纹图像进行指纹识别处理,并行采集至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理,包括:
在第一安全环境中,对所述第一指纹图像进行指纹识别处理,并行采集所述至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理。
在一种可能的实现方式中,所述对预处理后的所述至少一个第二指纹图 像并行进行指纹识别处理,包括:在第一安全环境中,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理。
第三方面,提供了一种指纹识别的方法,所述方法包括:对第一指纹图像进行第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理;
其中,对所述第一指纹图像的指纹识别处理包括所述第一指纹识别处理和第二指纹识别处理,所述第二指纹识别处理的执行晚于所述第一指纹识别处理的执行。
在一种可能的实现方式中,所述方法还包括:
基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,其中,所述第二指纹模板为所述第一指纹图像下一个待匹配的指纹模板。
在一种可能的实现方式中,所述对第一指纹图像进行第一指纹识别处理,包括:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息。
在一种可能的实现方式中,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,包括:
将所述第一指纹图像的特征信息和所述第一指纹模板的特征信息进行匹配,确定所述第一指纹图像针对所述第一指纹模板的第一指纹识别结果。
在一种可能的实现方式中,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,包括:基于至少两个指纹子模板并行对所述第一指纹图像进行所述第二指纹识别处理,
其中,所述至少两个指纹子模板中的每个指纹子模板对应所述第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
在一种可能的实现方式中,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,包括:
在第一安全环境中,基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对所述第二指纹模板进行解压缩处理。
在一种可能的实现方式中,所述对第一指纹图像进行第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理,包括:
在第一安全环境中,对所述第一指纹图像进行所述第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理。
第四方面,提供了一种指纹识别的装置,包括:指纹识别模块,用于基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,
其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
在一种可能的实现方式中,所述装置还包括:
特征提取模块,用于对所述第一指纹图像进行特征提取处理,得到所述第一指纹图像的特征信息。
在一种可能的实现方式中,所述指纹识别模块还用于:
并行将所述第一指纹图像的特征信息和所述至少两个指纹子模板的特征信息进行匹配,确定至少两个指纹识别结果;
根据所述至少两个指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
在一种可能的实现方式中,所述指纹识别模块还用于:
将所述第一指纹模板划分为所述至少两个指纹子模板。
在一种可能的实现方式中,所述指纹识别模块具体用于:
在第一安全环境中,基于所述至少两个指纹子模板并行对所述第一指纹图像进行指纹识别处理。
第五方面,提供了一种指纹识别的装置,包括:
第一指纹识别模块,用于对第一指纹图像进行指纹识别处理;
指纹传感器,用于在所述第一指纹识别模块对所述第一指纹图像进行指纹识别处理时,并行采集至少一个第二待识别指纹图像;
第二指纹识别模块,用于在所述第一指纹识别模块对所述第一指纹图像进行指纹识别处理时,并行对所述至少一个第二待识别指纹图像进行预处理。
在一种可能的实现方式中,所述第二指纹识别模块还用于:
基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,确定所述至少一个第二指纹图像的指纹识别结果。
在一种可能的实现方式中,所述第二指纹识别模块具体用于:在所述第 一指纹图像的指纹识别结果为指纹识别失败的情况下,基于所述至少一个指纹模板,对所述至少一个第二指纹图像并行进行指纹识别处理。
在一种可能的实现方式中,所述第二指纹识别模块还用于:根据所述至少一个第二指纹图像的指纹识别结果确定是否执行触发指纹识别的操作。
在一种可能的实现方式中,所述第一指纹识别模块还用于:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息;
将所述第一指纹图像的特征信息和至少一个指纹模板的特征信息进行匹配,确定所述第一指纹图像的指纹识别结果。
在一种可能的实现方式中,所述第一指纹识别模块具体用于:在第一安全环境中,对所述第一指纹图像进行指纹识别处理;
所述指纹传感器具体用于:在所述第一安全环境中,采集所述至少一个第二指纹图像;
所述第二指纹识别模块具体用于:在所述第一安全环境中,对所述至少一个第二指纹图像进行预处理。
在一种可能的实现方式中,所述第二指纹识别模块具体用于:
在第一安全环境中,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理。
第六方面,提供了一种指纹识别的装置,包括:
指纹识别模块,用于对第一指纹图像进行第一指纹识别处理;
解压缩模块,用于在所述第一指纹识别模块对所述第一指纹图像进行所述第一指纹识别处理时,并行对压缩的第一指纹模板进行解压缩处理;
其中,对所述第一指纹图像的指纹识别处理包括所述第一指纹识别处理和第二指纹识别处理,所述第二指纹识别处理的执行晚于所述第一指纹识别处理的执行。
在一种可能的实现方式中,所述指纹识别模块还用于:
基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,其中,所述第二指纹模板为所述第一指纹图像下一个待匹配的指纹模板。
在一种可能的实现方式中,所述指纹识别模块具体用于:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息。
在一种可能的实现方式中,所述指纹识别模块具体用于:
将所述第一指纹图像的特征信息和所述第一指纹模板的特征信息进行匹配,确定所述第一指纹图像针对所述第一指纹模板的第一指纹识别结果。
在一种可能的实现方式中,所述指纹识别模块还用于:基于至少两个指纹子模板并行对所述第一指纹图像进行所述第二指纹识别处理,
其中,所述至少两个指纹子模板中的每个指纹子模板对应所述第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
在一种可能的实现方式中,所述指纹识别模块具体用于:在第一安全环境中,基于解压缩的所述第一指纹模板对所述待识别指纹图像进行所述第二指纹识别处理;
所述解压缩模块用于:在所述第一安全环境中对所述第二指纹模板进行解压缩处理。
在一种可能的实现方式中,所述指纹识别模块具体用于:在第一安全环境中,对所述第一指纹图像进行所述第一指纹识别处理;
所述解压缩模块用于:在所述第一安全环境中对压缩的所述第一指纹模板进行解压缩处理。
第七方面,提供了一种芯片,该芯片包括输入输出接口、至少一个处理器、至少一个存储器和总线,该至少一个存储器用于存储指令,该至少一个处理器用于调用该至少一个存储器中的指令,以执行第一方面或第一方面的任一可能的实现方式中的方法,或第二方面或第二方面的任一可能的实现方式中的方法,或第三方面或第三方面的任一可能的实现方式中的方法。
第八方面,提供了一种电子设备,包括如第四方面或第四方面的任一可能的实现方式中的指纹识别的装置,或如第五方面或第五方面的任一可能的实现方式中的指纹识别的装置,或第六方面或第六方面的任一可能的实现方式中的指纹识别的装置。
第九方面,提供了一种计算机可读介质,用于存储计算机程序,所述计算机程序包括用于执行上述第一方面或第一方面的任一可能的实现方式中的指令,或第二方面或第二方面的任一可能的实现方式中的指令,或第三方面或第三方面的任一可能的实现方式中的指令。
第十方面,提供了一种包括指令的计算机程序产品,当计算机运行所述计算机程序产品的所述指令时,所述计算机执行上述第一方面或第一方面的 任一可能的实现方式中的方法,或第二方面或第二方面的任一可能的实现方式中的方法,或第三方面或第三方面的任一可能的实现方式中的方法。
具体地,该计算机程序产品可以运行于上述第八方面中的电子设备上。
附图说明
图1A是根据本申请一实施例的电子设备的定向视图。
图1B是图1A所示的电子设备沿A-A’的部分剖面结构示意图。
图2是一种典型的指纹识别方法的流程图。
图3是根据本申请一实施例的指纹识别方法的示意性流程图。
图4是图3所述的指纹识别的方法的整体流程图。
图5是根据本申请另一实施例的指纹识别方法的示意性流程图。
图6是图5所述的指纹识别的方法的整体流程图。
图7是根据本申请再一实施例的指纹识别方法的示意性流程图。
图8是图7所述的指纹识别的方法的整体流程图。
图9是根据本申请一实施例的指纹识别的装置的示意性结构图。
图10是根据本申请另一实施例的指纹识别的装置的示意性结构图。
图11是根据本申请再一实施例的指纹识别的装置的示意性结构图。
图12是根据本申请实施例的电子设备的示意性结构图。
具体实施方式
下面将结合附图,对本申请中的技术方案进行描述。
作为一种常见的应用场景,本申请实施例提供的光学指纹系统可以应用在智能手机、平板电脑以及其他具有显示屏的移动终端或者其他终端设备;更具体地,在上述终端设备中,指纹识别装置可以具体为光学指纹装置,其可以设置在显示屏下方的局部区域或者全部区域,从而形成屏下(Under-display)光学指纹系统。或者,所述指纹识别装置也可以部分或者全部集成至所述终端设备的显示屏内部,从而形成屏内(In-display)光学指纹系统。
图1A和图1B示出了本申请实施例可以适用的电子设备的示意图,其中,图1为电子设备10的正面示意图,图1B为图1A所示的电子设备10沿A’-A’的部分剖面结构示意图。
如图1A和图1B所示,所述电子设备10包括显示屏120和光学指纹装置130,其中,所述光学指纹装置130设置在所述显示屏120下方的局部区域。所述光学指纹装置130包括光学指纹传感器,所述光学指纹传感器包括具有多个光学感应单元的感应阵列,所述感应阵列所在区域或者其感应区域为所述光学指纹装置130的指纹检测区域103。如图1A所示,所述指纹检测区域103位于所述显示屏120的显示区域之中。在一种替代实施例中,所述光学指纹装置130还可以设置在其他位置,比如所述显示屏120的侧面或者所述电子设备10的边缘非透光区域,并通过光路设计来将所述显示屏120的至少部分显示区域的光信号导引到所述光学指纹装置130,从而使得所述指纹检测区域103实际上位于所述显示屏120的显示区域。
应当理解,所述指纹检测区域103的面积可以与所述光学指纹装置130的感应阵列的面积不同,例如通过例如透镜成像的光路设计、反射式折叠光路设计或者其他光线汇聚或者反射等光路设计,可以使得所述光学指纹装置130的指纹检测区域103的面积大于所述光学指纹装置130感应阵列的面积。在其他替代实现方式中,如果采用例如光线准直方式进行光路引导,所述光学指纹装置130的指纹检测区域103也可以设计成与所述光学指纹装置130的感应阵列的面积基本一致。
因此,使用者在需要对所述电子设备进行解锁或者其他指纹验证的时候,只需要将手指按压在位于所述显示屏120的指纹检测区域103,便可以实现指纹输入。由于指纹检测可以在屏内实现,因此采用上述结构的电子设备10无需其正面专门预留空间来设置指纹按键(比如Home键),从而可以采用全面屏方案,即所述显示屏120的显示区域可以基本扩展到整个电子设备10的正面。
作为一种可选的实现方式,如图1B所示,所述光学指纹装置130包括光检测部分134和光学组件132,所述光检测部分134包括所述感应阵列以及与所述感应阵列电性连接的读取电路及其他辅助电路,其可以在通过半导体工艺制作在一个芯片(Die),比如光学成像芯片或者光学指纹传感器,所述感应阵列具体为光探测器(Photo detector)阵列,其包括多个呈阵列式分布的光探测器,所述光探测器可以作为如上所述的光学感应单元;所述光学组件132可以设置在所述光检测部分134的感应阵列的上方,其可以具体包括滤光层(Filter)、导光层或光路引导结构以及其他光学元件,所述滤光层可 以用于滤除穿透手指的环境光,而所述导光层或光路引导结构主要用于从手指表面反射回来的反射光导引至所述感应阵列进行光学检测。
在具体实现上,所述光学组件132可以与所述光检测部分134封装在同一个光学指纹部件。比如,所述光学组件132可以与所述光学检测部分134封装在同一个光学指纹芯片,也可以将所述光学组件132设置在所述光检测部分134所在的芯片外部,比如将所述光学组件132贴合在所述芯片上方,或者将所述光学组件132的部分元件集成在上述芯片之中。
其中,所述光学组件132的导光层或者光路引导结构有多种实现方案,比如,所述导光层可以具体为在半导体硅片制作而成的准直器(Collimator)层,其具有多个准直单元或者微孔阵列,所述准直单元可以具体为小孔,从手指反射回来的反射光中,垂直入射到所述准直单元的光线可以穿过并被其下方的光学感应单元接收,而入射角度过大的光线在所述准直单元内部经过多次反射被衰减掉,因此每一个光学感应单元基本只能接收到其正上方的指纹纹路反射回来的反射光,从而所述感应阵列便可以检测出手指的指纹图像。
在另一种实施例中,所述导光层或者光路引导结构也可以为光学透镜(Lens)层,其具有一个或多个透镜单元,比如一个或多个非球面透镜组成的透镜组,其用于将从手指反射回来的反射光汇聚到其下方的光检测部分134的感应阵列,以使得所述感应阵列可以基于所述反射光进行成像,从而得到所述手指的指纹图像。可选地,所述光学透镜层在所述透镜单元的光路中还可以形成有针孔,所述针孔可以配合所述光学透镜层扩大所述光学指纹装置的视场,以提高所述光学指纹装置130的指纹成像效果。
在其他实施例中,所述导光层或者光路引导结构也可以具体采用微透镜(Micro-Lens)层,所述微透镜层具有由多个微透镜形成的微透镜阵列,其可以通过半导体生长工艺或者其他工艺形成在所述光检测部分134的感应阵列上方,并且每一个微透镜可以分别对应于所述感应阵列的其中一个感应单元。并且,所述微透镜层和所述感应单元之间还可以形成其他光学膜层,比如介质层或者钝化层,更具体地,所述微透镜层和所述感应单元之间还可以包括具有微孔的挡光层,其中所述微孔形成在其对应的微透镜和感应单元之间,所述挡光层可以阻挡相邻微透镜和感应单元之间的光学干扰,并使得所述感应单元所对应的光线通过所述微透镜汇聚到所述微孔内部并经由所述 微孔传输到所述感应单元以进行光学指纹成像。
应当理解,上述光路引导结构的几种实现方案可以单独使用也可以结合使用,比如,可以在所述准直器层或者所述光学透镜层下方进一步设置微透镜层。当然,在所述准直器层或者所述光学透镜层与所述微透镜层结合使用时,其具体叠层结构或者光路可能需要按照实际需要进行调整。
作为一种可选的实施例,所述显示屏120可以采用具有自发光显示单元的显示屏,比如有机发光二极管(Organic Light-Emitting Diode,OLED)显示屏或者微型发光二极管(Micro-LED)显示屏。以采用OLED显示屏为例,所述光学指纹装置130可以利用所述OLED显示屏120位于所述指纹检测区域103的显示单元(即OLED光源)来作为光学指纹检测的激励光源。当手指按压在所述指纹检测区域103时,显示屏120向所述指纹检测区域103上方的目标手指发出一束光,该光在手指的表面发生反射形成反射光或者经过所述手指内部散射而形成散射光,在相关专利申请中,为便于描述,上述反射光和散射光统称为反射光。由于指纹的嵴(ridge)与峪(vally)对于光的反射能力不同,因此,来自指纹嵴的反射光和来自指纹峪的发射光具有不同的光强,反射光经过光学组件后,被光学指纹装置130中的感应阵列所接收并转换为相应的电信号,即指纹检测信号;基于所述指纹检测信号便可以获得指纹图像数据,并且可以进一步进行指纹匹配验证,从而在所述电子设备10实现光学指纹识别功能。
在其他实施例中,所述光学指纹装置130也可以采用内置光源或者外置光源来提供用于进行指纹检测的光信号。在这种情况下,所述光学指纹装置130可以适用于非自发光显示屏,比如液晶显示屏或者其他的被动发光显示屏。以应用在具有背光模组和液晶面板的液晶显示屏为例,为支持液晶显示屏的屏下指纹检测,所述电子设备10的光学指纹系统还可以包括用于光学指纹检测的激励光源,所述激励光源可以具体为红外光源或者特定波长非可见光的光源,其可以设置在所述液晶显示屏的背光模组下方或者设置在所述电子设备10的保护盖板下方的边缘区域,而所述光学指纹装置130可以设置液晶面板或者保护盖板的边缘区域下方并通过光路引导以使得指纹检测光可以到达所述光学指纹装置130;或者,所述光学指纹装置130也可以设置在所述背光模组下方,且所述背光模组通过对扩散片、增亮片、反射片等膜层进行开孔或者其他光学设计以允许指纹检测光穿过液晶面板和背光模 组并到达所述光学指纹装置130。当采用所述光学指纹装置130采用内置光源或者外置光源来提供用于进行指纹检测的光信号时,其检测原理与上面描述内容是一致的。
应当理解的是,在具体实现上,所述电子设备10还包括透明保护盖板,所述盖板可以为玻璃盖板或者蓝宝石盖板,其位于所述显示屏120的上方并覆盖所述电子设备10的正面。因为,本申请实施例中,所谓的手指按压在所述显示屏120实际上是指按压在所述显示屏120上方的盖板或者覆盖所述盖板的保护层表面。
另一方面,在某些实施例中,所述光学指纹装置130可以仅包括一个光学指纹传感器,此时光学指纹装置130的指纹检测区域103的面积较小且位置固定,因此用户在进行指纹输入时需要将手指按压到所述指纹检测区域103的特定位置,否则光学指纹装置130可能无法采集到指纹图像而造成用户体验不佳。在其他替代实施例中,所述光学指纹装置130可以具体包括多个光学指纹传感器;所述多个光学指纹传感器可以通过拼接方式并排设置在所述显示屏120的下方,且所述多个光学指纹传感器的感应区域共同构成所述光学指纹装置130的指纹检测区域103。也即是说,所述光学指纹装置130的指纹检测区域103可以包括多个子区域,每个子区域分别对应于其中一个光学指纹传感器的感应区域,从而将所述光学指纹装置130的指纹采集区域103可以扩展到所述显示屏的下半部分的主要区域,即扩展到手指惯常按压区域,从而实现盲按式指纹输入操作。可替代地,当所述光学指纹传感器数量足够时,所述指纹检测区域130还可以扩展到半个显示区域甚至整个显示区域,从而实现半屏或者全屏指纹检测。
应理解,图1A和图1B仅以光学指纹装置为例进行说明,本申请实施例的指纹识别的装置也可以是超声波指纹装置,也就是说,本申请实施例的指纹图像可以是基于光学指纹技术或超声波指纹技术采集的,本申请实施例对于指纹图像的采集方式不作限定。
由于指纹识别功能对安全性的需求较高,因此需要运行在安全可靠环境(Trusted Execution Environment,TEE)中,例如,TrustZone环境,或者,高通的QSEE TEE,安全(Secure)数字信号处理(Digital Signal Processing,DSP)等。
但是,TrustZone环境或高通的Secure DSP等TEE通常只支持单线程的 应用,例如,如果用户注册了多个指纹模板,则只能依次根据每个指纹模板执行指纹识别功能,指纹识别的耗时较长。结合图2,以用户注册了3个指纹模板为例,说明具体的指纹识别过程。其中,图2为根据3个指纹模板进行指纹识别的流程图,如图2所示,具体识别过程可以包括如下步骤:
S201,加载指纹模板1进行指纹识别;
S202,判断指纹识别是否成功,若成功,流程跳转到S212;否则,流程跳转至S203;
S203,加载指纹模板2进行指纹识别;
S204,判断指纹识别是否成功,若成功,流程跳转到S212;否则,流程跳转至S205;
S205,加载指纹模板3进行指纹识别;
S206,判断指纹识别是否成功,若成功,流程跳转到S212;否则,流程跳转至S211;
S211,确定指纹识别失败;
S212,确定指纹识别成功。
由此可见,在用户注册多个指纹模板的情况下,只能依次根据每个指纹模板进行指纹识别,导致指纹识别时间较长,影响用户体验。
有鉴于此,本申请提供了一种指纹识别方案,能够基于多线程进行指纹识别处理,从而能够缩短指纹识别时间,提升用户体验。
应理解,在本申请实施例中,该指纹识别过程可以称为是指纹认证过程或指纹匹配过程,因此,指纹识别处理也可以称为指纹认证处理或指纹匹配处理。
还应理解,在本申请实施例中,指纹识别相关的操作可以在同一安全环境中进行,此情况下,该安全环境可以为支持多线程的TEE,或者也可以在多个安全环境中进行,例如,可以在同一TEE中创建多个线程并行执行指纹识别处理相关的操作,或者也可以在多个安全环境中创建多个线程并行执行指纹识别处理相关的操作,本申请实施例对此不作具体限定。
也就是说,本申请实施例的用于指纹识别的安全环境可以是支持多线程的TEE,或者也可以支持单线程的TEE,这样只需在多个TEE中并行执行该多个线程即可。
应理解,在本申请实施例中,可创建的线程的数量可以根据安全环境中 CPU的数量确定。
以下,结合图3至图8,说明根据本申请实施例的指纹识别的方法,应理解,本申请实施例的指纹识别的方法可以由指纹识别的装置执行,具体地,该方法可以由该指纹识别的装置中的处理单元执行,在一些实施例中,该处理单元可以为前文所述的光学指纹装置130中的微控制器(Micro Control Unit,MCU),或者也可以为前文所述的电子设备10的处理器或控制器,或者也可以包括该光学指纹装置的MCU和电子设备的处理器,即该方法可以由电子设备的处理器和光学指纹装置的MCU共同执行。以下实施例,以指纹识别的装置为执行主体来描述根据本申请实施例的指纹识别的方法。
图3是根据本申请一实施例的指纹识别的方法300的示意性流程图,如图3所示,该方法300包括:
S301,基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
因此,在本申请实施例中,可以将单个指纹模板划分为至少两个指纹子模板,然后根据该至少两个指纹子模板并行对待识别的第一指纹图像进行指纹识别处理,以确定针对该第一指纹图像的指纹识别结果,有利于缩短指纹识别时间,提升用户体验。
在本申请实施例中,该第一指纹模板可以划分为至少两个指纹子模板,例如,第一指纹子模板和第二指纹子模板,该第一指纹子模板和第二指纹子模板至少部分不重叠,可选地,在一些实施例中,所述第一指纹子模板对应所述第一指纹模板的边缘区域,所述第二指纹子模板对应所述第一指纹模板的中心区域;或者,在另一些实施例中,所述第一指纹子模板对应所述第一指纹模板的左半区域,所述第二指纹子模板对应所述第一指纹模板的右半区域,以上划分方式仅为示例,但本申请实施例并不限于此。
此情况下,S301可以具体包括:
基于第一指纹子模板对第一指纹图像进行指纹识别处理,并行基于第二指纹子模板对所述第一指纹图像进行指纹识别处理。
可以理解,当该第一指纹模板被划分为更多个指纹子模板时,该指纹识别的装置可以并行根据其他指纹子模板对所述第一指纹图像进行指纹识别 处理,例如,并行基于第三指纹子模板对第一指纹图像进行指纹识别处理等,本申请实施例并不限于此。
进一步地,该指纹识别的装置可以根据基于所述第一指纹子模板对所述第一指纹图像进行指纹识别处理得到的第一指纹识别结果,以及基于所述第二指纹子模板对所述第一指纹图像进行指纹识别处理得到的第二指纹识别结果,然后可以根据该第一指纹识别结果和第二指纹识别结果确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
例如,该指纹识别的装置可以在所述第一指纹识别结果和所述第二指纹识别结果中存在一个指纹识别结果为指纹识别成功时,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果为指纹识别成功;否则,确定指纹识别失败。
又例如,该指纹识别的装置可以在所述第一指纹识别结果和所述第二指纹识别结果都为指纹识别成功时,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果为指纹识别成功;否则,确定指纹识别失败。
再例如,若第一指纹子模板对应第一指纹模板的中心区域,所述第二指纹子模板对应第一指纹模板的外围区域,该指纹识别的装置也可以在第一指纹识别结果为指纹识别成功时,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果为指纹识别成功,在第一指纹识别结果为指纹识别失败时,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果为指纹识别失败。
可选地,在本申请实施例中,基于第一指纹子模板对第一指纹图像进行指纹识别处理,可以具体包括:
将所述第一指纹子模板和所述第一指纹图像进行匹配,例如,将所述第一指纹图像的特征信息和所述第一指纹子模板的特征信息进行匹配。
可选地,在一些实施例中,所述基于第一指纹子模板对第一指纹图像进行指纹识别处理,也可以包括:
对所述第一指纹图像预处理或特征提取等处理操作。具体地,在将第一指纹子模板和所述第一指纹图像进行匹配之前,该指纹识别的装置可以首先对采集的该第一指纹图像进行预处理,得到特定文件格式的指纹图像,例如,bmp(Bitmap)格式的指纹图像,进一步地,对该bmp格式的指纹图像进行特征提取,确定该第一指纹图像的特征信息,该特征信息可以包括但不限于 指纹图像中的特征点的位置、数量,类型,纹线方向等信息,特征点可以为纹线端点和分叉点等,该第一指纹图像的特征信息可以用于与指纹模板的特征信息进行匹配,确定指纹识别结果。
可选地,在一些实施例中,所述基于第一指纹子模板对第一指纹图像进行指纹识别处理也可以不包括对所述第一指纹图像预处理或特征提取等处理操作,也就是说,该基于第一指纹子模板对第一指纹图像进行指纹识别处理可以只包括:将第一指纹子模板和所述第一指纹图像进行匹配的操作。
类似地,基于其他子模板,例如第二指纹子模板对第一指纹图像进行指纹识别处理,亦是如此,这里不再赘述。
可选地,在一些实施例中,所述S301还可以具体包括:
并行将所述第一指纹图像的特征信息和所述至少两个指纹子模板的特征信息进行匹配,确定至少两个指纹识别结果。
进一步地,可以根据所述至少两个指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
以至少两个指纹子模板包括第一指纹子模板和第二指纹子模板为例,该指纹识别的装置可以将所述第一指纹图像的特征信息和所述第一指纹子模板的特征信息进行匹配,确定第一指纹识别结果;同时将所述第一指纹图像的特征信息和所述第二指纹子模板的特征信息进行匹配,确定第二指纹识别结果。然后根据所述第一指纹识别结果和所述第二指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
可选地,在一些实施例中,将所述第一指纹图像的特征信息和所述第一指纹子模板的特征信息进行匹配,可以包括:将第一指纹子模板的特征信息和提取的第一指纹图像的特征信息进行匹配,确定第一指纹模板和第一指纹图像的对应特征点的相似度,得到相似度矩阵。然后根据得到的相似度矩阵确定第一指纹子模板和第一指纹图像的匹配区域,确定每个匹配区域中指纹子模板和指纹图像的匹配度信息,进一步地,根据匹配度信息确定指纹识别结果,例如可以在匹配度大于特定阈值时,确定指纹识别成功,否则确定指纹识别失败。
应理解,以上将指纹子模板和指纹图像进行匹配确定指纹识别结果的具体实现仅为示例,本申请实施例也可以采用其他匹配算法来实现,本申请实施例对此不作限定。
结合图4,以至少两个指纹子模板包括第一指纹子模板和第二指纹子模板为例,说明根据图3所示的指纹识别的方法的整体流程。如图4所示,该指纹识别的方法40可以包括如下中的至少部分内容:
S401,对第一指纹图像进行预处理;
可选地,可以采用滤波算法对第一指纹图像进行处理,去除该第一指纹图像中的噪声、毛刺或断裂等干扰信息,得到特定格式的指纹图像;
S402,对预处理后的第一指纹图像进行特征提取,得到第一指纹图像的特征信息。
具体地,可以采用特征提取算法对预处理后的第一指纹图像进行处理,确定第一指纹图像的特征信息,例如,指纹图像中的特征点的位置、数量,类型,纹线方向等信息,特征点可以为纹线端点和分叉点等。
在S403和S405中,创建两个线程,线程1和线程2,分别用于并行根据第一指纹子模板和第二指纹子模板对第一指纹图像进行匹配处理。
进一步地,在S404中,在线程1中,根据第一指纹子模板对第一指纹图像进行匹配,得到第一指纹识别结果;与此同时,在S406中,在线程2中,根据第二指纹子模板对第一指纹图像进行匹配,得到第二指纹识别结果;
然后,可以根据该第一指纹识别结果和第二指纹识别结果,确定该第一指纹图像对第一指纹模板的指纹识别结果,至此,第一指纹图像针对第一指纹模板的识别过程结束。
可以理解,若第一指纹模板被划分为更多个指纹子模板,还可以创建更多个线程,例如线程3,与线程1和线程2并行进行指纹匹配处理。
可选地,在本申请实施例中,若用户注册了多个指纹模板,也可以将该多个指纹模板都划分为多个指纹子模板,分别建立对应的线程,用于根据每个指纹子模板对该第一指纹图像进行匹配处理,以确定针对该第一指纹图像的指纹识别结果。
例如,用户还注册了第二指纹模板,该第二指纹模板划分为第三指纹子模板和第四指纹子模板,则可以在S402之后,可以创建四个线程,线程1~线程4,分别用于根据第一指纹子模板,第二指纹子模板,第三指纹子模板和第四指纹子模板对第一指纹图像进行匹配,以确定对应的指纹识别结果。例如,该指纹识别的装置可以在任一指纹识别结果为指纹识别成功的情况下,确定针对该第一指纹图像的指纹识别结果为指纹识别成功。
或者,也可以在S404和S406之后,即确定了第一指纹图像对于第一指纹模板的指纹识别结果之后,进一步在该线程1和线程2中,并行根据第三指纹子模板和第四指纹子模板对第一指纹图像进行匹配,确定该第一指纹图像对于第二指纹模板的指纹识别结果。
可选地,在本申请实施例中,触发进行指纹识别的操作可以为屏幕解锁操作,支付类操作等操作,则在指纹识别成功的情况下,该指纹识别的装置还可以触发执行对应的操作。
应理解,在本申请实施例中,确定指纹识别是否成功的判断条件仅为示例,而不应对本申请实施例构成任何限定。例如,本申请实施例可以根据触发进行指纹识别的操作的安全等级,配置不同的判断条件,比如,对于支付类操作等安全等级较高的操作所触发的指纹识别,可以在针对每个指纹子模板的指纹识别结果都为指纹识别成功时,确定指纹识别成功,或者对于屏幕解锁等安全等级较低的操作所触发的指纹识别,可以在任一指纹识别结果为指纹识别成功时,确定指纹识别成功。
在一些情况下,若基于至少一个指纹模板对该第一指纹图像进行指纹识别,都确定指纹识别失败,并且允许重试多次进行指纹识别,此情况下,还可以采集更多个指纹图像,用于重试识别,但是采集指纹图像也需要花费时间,进一步根据采集的指纹图像进行指纹识别也需要花费时间,这也增大了指纹识别时间。
因此,本申请实施例还提供一种指纹识别方案,能够在根据采集的第一个指纹图像进行指纹识别处理时,同时采集用于重试识别的更多个指纹图像,这样,也就可以在第一个指纹图像识别失败的情况下,直接根据后续采集的指纹图像进行指纹识别,能够降低指纹识别时间,提升用户体验。
图5是根据本申请另一实施例的指纹识别的方法的示意性流程图,如图5所示,该方法500至少包括如下部分内容:
S501,对第一指纹图像进行指纹识别处理,并行采集至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理。
因此,在本申请实施例中,在对第一指纹图像进行指纹识别处理的同时,还可以采集用于后续指纹识别(或者说,重试识别)的至少一个第二指纹图像,这样,可以在对第一指纹图像识别失败的情况下,直接可以根据该至少一个第二指纹图像进行指纹识别,节约了指纹采集时间,进而能够降低指纹 识别时间。
可选地,在一些实施例中,在对第一指纹图像进行指纹识别处理时,还可以对采集的至少一个第二指纹图像进行预处理,该预处理操作的具体内容可以参考图3所示实施例的相关描述,这里不再赘述。
可选地,在一些实施例中,所述方法500还包括:
基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,确定所述至少一个第二指纹图像的指纹识别结果。
也就是说,本申请实施例中,在对第一指纹图像进行指纹识别处理的同时还可以采集至少一个第二指纹图像,如果该至少一个第二指纹图像有多个,在进行后续的指纹识别时,还可以根据该多个指纹图像并行进行指纹识别处理,以确定最终的指纹识别结果,能够缩短指纹识别时间。
在一些具体实施例中,该指纹识别的装置可以在对第一指纹图像指纹识别失败的情况下,进一步对该至少一个第二指纹图像进行后续的指纹识别,确定最终的指纹识别结果,进而确定是否执行触发指纹识别的操作。
可选地,在对第一指纹图像指纹识别成功的情况下,该指纹识别的装置可以不对该至少一个第二指纹图像进行后续的指纹识别。
可选地,在该实施例中,所述对第一指纹图像进行指纹识别处理,包括:
对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息;
将所述第一指纹图像的特征信息和至少一个指纹模板的特征信息进行匹配,确定所述第一指纹图像的指纹识别结果。
具体实现可以参考图3所示实施例的相关描述,这里不再赘述。
应理解,对至少一个第二指纹图像进行指纹识别处理的具体实现类似,这里不再赘述。
可选地,在该实施例中,对第一指纹图像进行指纹识别处理可以包括根据至少一个指纹模板对该第一指纹图像进行指纹识别处理,与图3所示的实施例类似,在该实施例中,也可以将指纹模板划分为多个指纹子模板,然后根据多个指纹子模板对该第一指纹图像并行进行指纹识别处理,确定指纹识别结果,具体实现可以参考图3所示实施例的相关描述。
也就是说,图3和图5所示的实施例可以单独实施,或者也可以合并实施,本申请实施例对此不作限定。
结合图6,说明根据图5所示的指纹识别的方法的整体流程。如图6所示,该指纹识别的方法60可以包括如下中的至少部分内容:
S601,对第一指纹图像进行特征提取,得到第一指纹图像的特征信息。
可选地,在S601之前,还可以对该第一指纹图像进行预处理。
具体实现请参考前文实施例的相关描述,这里不再赘述。
具体地,可以采用特征提取算法对预处理后的第一指纹图像进行处理,确定该第一指纹图像的特征信息,例如,指纹图像中的特征点的位置、数量,类型,纹线方向等信息,特征点可以为纹线端点和分叉点等。
进一步地,在S602,采用指纹匹配算法对第一指纹图像和指纹模板进行匹配,确定指纹识别结果。
具体实现请参考前文实施例的相关描述,这里不再赘述。
与此同时,在S603中,创建新的线程,用于采集至少一个第二指纹图像,并对该至少一个第二指纹图像进行预处理。
在S604中,该指纹识别的装置采集至少一个第二指纹图像,并对该至少一个第二指纹图像进行预处理。
在S605中,确定对第一指纹图像的指纹识别是否成功,若识别成功则识别结束,然后可以执行触发指纹识别的操作,例如解锁屏幕或支付操作等。或者,若识别失败,流程跳转至S606。
在S606中,创建至少一个线程,用于对采集的至少一个第二指纹图像并行进行指纹识别,具体地,可以每个第二指纹图像执行特征提取算法和匹配算法,确定对每个第二指纹图像的指纹识别结果。例如,可以在存在一个指纹识别结果为指纹识别成功的情况下,确定指纹识别成功,或者,在每个指纹识别结果都为指纹识别失败的情况下,确定指纹识别失败。
应理解,在本申请实施例中,确定指纹识别成功或指纹识别失败的判断条件仅为示例,而不应对本申请实施例构成任何限定,例如,本申请实施例可以根据触发进行指纹识别的操作的安全等级,配置不同的判断条件,比如,对于支付类操作触发的指纹识别,可以在每个待识别的指纹图像的指纹识别结果都为指纹识别成功时,确定指纹识别成功,或者对于屏幕解锁触发的指纹识别,可以在任一待识别的指纹图像的指纹识别结果都为指纹识别成功时,确定指纹识别成功。
由前文描述可知,采用光学指纹装置或超声波指纹装置采集的指纹数据 的数据量通常较大,而系统提供给指纹模板的运行内存较小,若在系统中存储每个指纹模板的解压缩版本,则对内存的占用较大,尤其是在用户注册了多个指纹模板的情况下,或者,若在系统中存储指纹模板的压缩版本,则需要解压缩指纹模板以进行指纹匹配,而解压缩指纹模板往往比较耗时,这也导致指纹识别耗时较长。
有鉴于此,本申请实施例还提供了一种指纹识别方案,可以在对待识别的指纹图像执行指纹匹配处理之前的操作时,并行解压缩待匹配的指纹模板,这样,能够避免提前解压缩该指纹模板对内存的占用,并且,能够节约解压缩时间,进而缩短指纹识别时间。
图7是根据本申请实施例提供的一种指纹识别的方法的示意性流程图,如图7所示,该方法700可以包括如下至少部分内容:
S701,对第一指纹图像进行第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理;其中,对所述第一指纹图像的指纹识别处理包括所述第一指纹识别处理和第二指纹识别处理,所述第二指纹识别处理的执行晚于所述第一指纹识别处理的执行。
可选地,在本申请实施例中,所述对第一指纹图像进行第一指纹识别处理可以包括各种与指纹识别处理相关的但不需要指纹模板参与的操作,例如,对第一指纹图像的预处理操作,或对第一指纹图像的特征提取操作等,本申请实施例对此不作限定。
也就是说,在该实施例中,该第一指纹识别处理可以为与指纹模板不相关的处理操作,第二指纹识别处理为与指纹模板相关的处理操作。
因此,本申请实施例在对待识别的第一指纹图像进行第一指纹识别处理的同时,解压缩待匹配的第一指纹模板,能够节约解压缩时间,进而缩短指纹识别时间,同时能够避免提前解压缩该指纹模板对内存的占用。
可选地,在一些实施例中,所述方法700还包括:
基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理。
即在解压缩第一指纹模板后,可以根据解压缩后的第一指纹模板和第一指纹图像经过第一指纹识别处理后的处理结果,进行后续的指纹匹配操作。
例如,该指纹识别的装置可以将所述第一指纹图像的特征信息和所述第一指纹模板的特征信息进行匹配,确定所述第一指纹图像针对所述第一指纹 模板的第一指纹识别结果。具体实现参考前文实施例的相关描述,这里不再赘述。
可选地,若用户注册了多个指纹模板,在基于第一指纹模板对第一指纹图像进行第二指纹识别处理的同时,还可以并行对压缩的第二指纹模板进行解压缩处理,其中,所述第二指纹模板为所述第一指纹图像下一个待匹配的指纹模板。这样,在基于第一指纹模板对第一指纹图像进行指纹识别失败的情况下,直接根据解压缩的第二指纹模板对第一指纹图像进行第二指纹识别处理,能够节约第二指纹模板的解压缩时间,缩短指纹识别时间。
与图3所示的实施例类似,在该实施例中,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,包括:
基于至少两个指纹子模板并行对所述第一指纹图像进行所述第二指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应所述第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
也就是说,图7所示实施例和图3所示的实施例可以单独实施,或者也可以合并实施,本申请实施例对此不作限定。
或者,在另一些实施例中,图7所示实施例和图5所示的实施例可以单独实施,或者也可以合并实施,例如,可以在根据第一指纹模板对第一指纹图像进行匹配处理时,并行采集至少一个第二指纹图像,并对所述至少一个第二指纹图像进行预处理等操作。
综上,图3,图5和图7所示的实施例可以单独实施,或者,任意至少两个实施例可以合并实施,本申请实施例对此不作限定。
结合图8,说明根据图7所示的指纹识别的方法的整体流程。如图8所示,该指纹识别的方法80可以包括如下中的至少部分内容:
S801,获取压缩的第一指纹模板。
具体地,可以从内存中获取该第一指纹模板。
S802中,对采集的第一指纹图像进行第一指纹识别处理。
例如,对该第一指纹图像进行预处理和特征提取等处理,得到第一指纹图像的特征信息。
与此同时,在S803中,创建新的线程,用于解压缩该第一指纹模板,其中,该第一指纹模板为当前待匹配的指纹模板,例如,可以为优先级最高 的指纹模板,或者也可以为第一个指纹模板。
在S804中,在对所述第一指纹图像进行所述第一指纹识别处理时,解压缩所述第一指纹模板。
在解压缩完毕后,在S805中,将第一指纹图像和解压缩后的第一指纹模板进行指纹匹配,确定指纹识别结果。
可选地,若用户注册了多个指纹模板,在S805的同时,还可以执行S807,创建新的线程,用于解压缩下一个待匹配的指纹模板。
在S808中,解压缩下一个待匹配的指纹模板。
在S806中,判断第一指纹图像的指纹识别结果是否成功,若成功,则识别结束,否则,流程进行到S809。
在S809中,确定是否为最后一个指纹模板,若是,则识别结束,否则,流程进行到S805,将解压缩的下一个指纹模板与该第一指纹图像进行匹配。
因此,在本申请实施例中,可以在对第一指纹图像进行第一指纹识别处理的同时,并行对待匹配的指纹模板进行解压缩处理,在解压缩完毕之后,可以直接根据解压缩的指纹模板对第一指纹图像进行第二指纹识别处理,若用户注册了多个指纹模板,在对第一指纹图像进行第二指纹识别处理的同时,还可以对下一个待匹配的指纹模板进行解压缩处理,从而能能够节约指纹识别过程中的解压缩时间,同时也可以避免在内存中存储解压缩的指纹模板,导致对系统内存的占用。
综上,在本申请实施例中,可以在对待识别的指纹图像进行预处理或特征提取等处理操作时,并行解压缩待匹配的指纹模板,或者,在根据指纹模板和待识别的指纹图像进行指纹匹配时,还可以解压缩下一个待匹配的指纹模板,能够节约解压缩时间。
或者,在一些情况中,在根据指纹模板和待识别的指纹图像进行指纹匹配时,可以将指纹模板分为多个指纹子模板,并行根据该多个指纹子模板对该指纹图像进行匹配,能够缩短指纹匹配时间。
或者,在一些情况下,在根据指纹模板和待识别的第一指纹图像进行指纹匹配时,还可以并行采集更多个指纹图像,用于在第一个指纹图像匹配失败的情况下,进行重试识别,可选地,与此同时,还可以对后续采集的指纹图像进行预处理或特征提取处理等处理操作,能够缩短指纹匹配时间。
应理解,在本申请实施例中,并行处理的多个线程可以是在同一个安全 环境中进行的,或者可以是在多个安全环境中执行的,这样,并行执行的功能模块之间可以通过共享内存交互信息。
上文结合图3至图8,详细描述了本申请的方法实施例,下文结合图9至图12,详细描述本申请的装置实施例,应理解,装置实施例与方法实施例相互对应,类似的描述可以参照方法实施例。
图9是根据本申请实施例的指纹识别的装置的示意性框图,如图9所示,该指纹识别的装置900包括:
指纹识别模块901,用于基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
可选地,在一些实施例中,该指纹识别的装置900可以设置于指纹装置中,或者该指纹识别的装置可以为该指纹装置,或者,该指纹识别的装置可以包括该指纹装置,或者该指纹识别的装置900为电子设备。
这里的指纹装置可以对应前文所述的光学指纹装置130,或者也可以为超声波指纹装置,本申请实施例对此不作限定。
可选地,所述装置900还包括:特征提取模块,用于对所述第一指纹图像进行特征提取处理,得到所述第一指纹图像的特征信息。
可选地,所述指纹识别模块901还用于:
并行将所述第一指纹图像的特征信息和所述至少两个指纹子模板的特征信息进行匹配,确定至少两个指纹识别结果;
根据所述至少两个指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
可选地,所述指纹识别模块901还用于:
将所述第一指纹模板划分为所述至少两个指纹子模板。
可选地,所述指纹识别模块901具体用于:
在第一安全环境中,基于所述至少两个指纹子模板并行对所述第一指纹图像进行指纹识别处理。
可选地,在本申请实施例中,所述第一安全环境可以为支持多线程的TEE。
应理解,在本申请实施例中,该指纹识别模块和特征提取模块可以为独 立的功能模块,或者,该特征提取模块和该指纹识别模块可以为同一功能模块,即该指纹识别模块和该特征提取模块所执行的功能可以由同一功能模块来执行,例如,由指纹装置中的MCU,或者也可以由电子设备中的处理器或控制器执行。
可选地,在一些实施例中,所述指纹识别的装置900还可以包括指纹传感器,用于采集至少一个指纹图像,可以对应于前文所述实施例中的光学指纹装置130中的光学指纹传感器。
图10是根据本申请实施例的指纹识别的装置的示意性框图,如图10所示,该指纹识别的装置1000包括:
第一指纹识别模块1001,用于对第一指纹图像进行指纹识别处理;
指纹传感器1002,用于在所述第一指纹识别模块对所述第一指纹图像进行指纹识别处理时,并行采集至少一个第二待识别指纹图像;
第二指纹识别模块1003,用于在所述第一指纹识别模块对所述第一指纹图像进行指纹识别处理时,并行对所述至少一个第二待识别指纹图像进行预处理。
可选地,在一些实施例中,该指纹识别的装置1000可以设置于指纹装置中,或者该指纹识别的装置可以为该指纹装置,或者,该指纹识别的装置可以包括该指纹装置,或者该指纹识别的装置1000为电子设备。
这里的指纹装置可以对应前文所述的光学指纹装置130,或者也可以为超声波指纹装置,本申请实施例对此不作限定。
可选地,所述第二指纹识别模块1003还用于:
基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,确定所述至少一个第二指纹图像的指纹识别结果。
可选地,所述第二指纹识别模块1003具体用于:在所述第一指纹图像的指纹识别结果为指纹识别失败的情况下,基于所述至少一个指纹模板,对所述至少一个第二指纹图像并行进行指纹识别处理。
可选地,所述第二指纹识别模块1003还用于:根据所述至少一个第二指纹图像的指纹识别结果确定是否执行触发指纹识别的操作。
可选地,所述第一指纹识别模块1001还用于:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息;
将所述第一指纹图像的特征信息和至少一个指纹模板的特征信息进行 匹配,确定所述第一指纹图像的指纹识别结果。
可选地,所述第一指纹识别模块1001具体用于:在第一安全环境中,对所述第一指纹图像进行指纹识别处理;
所述指纹传感器1002具体用于:在所述第一安全环境中,采集所述至少一个第二指纹图像;
所述第二指纹识别模块1003具体用于:在所述第一安全环境中,对所述至少一个第二指纹图像进行预处理。
可选地,所述第二指纹识别模块1003具体用于:
在第一安全环境中,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理。
可选地,在本申请实施例中,所述第一安全环境可以为支持多线程的TEE。
应理解,在本申请实施例中,该第一指纹识别模块和第二指纹识别模块可以为独立的功能模块,或者,该第一指纹识别模块和第二指纹识别模块可以为同一功能模块,即该第一指纹识别模块和第二指纹识别模块所执行的功能可以由同一功能模块来执行,例如,由指纹装置中的MCU,或者也可以由电子设备中的处理器或控制器执行。
应理解,该指纹传感器1002为该指纹识别的装置中用于指纹采集的模块,在一些实施例中,其可以对应前文所述的光学指纹装置130中的光学指纹传感器,或者在另一些实施例中,其可以为超声波指纹装置中的超声波检测部分。
图11是根据本申请实施例的指纹识别的装置的示意性框图,如图11所示,该指纹识别的装置1100包括:
指纹识别模块1101,用于对第一指纹图像进行第一指纹识别处理;
解压缩模块1102,用于在所述第一指纹识别模块对所述第一指纹图像进行所述第一指纹识别处理时,并行对压缩的第一指纹模板进行解压缩处理;
其中,对所述第一指纹图像的指纹识别处理包括所述第一指纹识别处理和第二指纹识别处理,所述第二指纹识别处理的执行晚于所述第一指纹识别处理的执行。
可选地,在一些实施例中,该指纹识别的装置1100可以设置于指纹装置中,或者该指纹识别的装置可以为该指纹装置,或者,该指纹识别的装置 可以包括该指纹装置,或者该指纹识别的装置1100为电子设备。
这里的指纹装置可以对应前文所述的光学指纹装置130,或者也可以为超声波指纹装置,本申请实施例对此不作限定。
可选地,所述指纹识别模块1101还用于:
基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,其中,所述第二指纹模板为所述第一指纹图像下一个待匹配的指纹模板。
可选地,所述指纹识别模块1101具体用于:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息。
可选地,所述指纹识别模块1101具体用于:
将所述第一指纹图像的特征信息和所述第一指纹模板的特征信息进行匹配,确定所述第一指纹图像针对所述第一指纹模板的第一指纹识别结果。
可选地,所述指纹识别模块1101还用于:
基于至少两个指纹子模板并行对所述第一指纹图像进行所述第二指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应所述第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
可选地,所述指纹识别模块1101具体用于:在第一安全环境中,基于解压缩的所述第一指纹模板对所述待识别指纹图像进行所述第二指纹识别处理;
所述解压缩模块1102用于:在所述第一安全环境中对所述第二指纹模板进行解压缩处理。
可选地,所述指纹识别模块1101具体用于:在第一安全环境中,对所述第一指纹图像进行所述第一指纹识别处理;
所述解压缩模块1102用于:在所述第一安全环境中对压缩的所述第一指纹模板进行解压缩处理。
可选地,在本申请实施例中,所述第一安全环境可以为支持多线程的TEE。
应理解,在本申请实施例中,该指纹识别模块和解压缩模块可以为独立的功能模块,或者,该指纹识别模块和解压缩模块可以为同一功能模块,即该指纹识别模块和解压缩模块所执行的功能可以由同一功能模块来执行,例 如,由指纹装置中的MCU,或者也可以由电子设备中的处理器或控制器执行。
可选地,在一些实施例中,所述指纹识别的装置1100还可以包括指纹传感器,用于采集至少一个指纹图像,可以对应于前文所述实施例中的光学指纹装置130中的光学指纹传感器。
本申请实施例还提供了一种电子设备1200,如图12所示,所述电子设备1200可以包括指纹识别的装置1210,该装置1210可以为前述实施例中的指纹识别的装置900,指纹识别的装置1000或指纹识别的装置1100,分别用于执行图3,图5,和图7所示方法实施例中的内容。
在一些实施例中,该电子设,1200可以为例如智能手机、笔记本电脑、平板电脑、游戏设备等便携式或移动计算设备,以及电子数据库、汽车、银行自动柜员机(Automated Teller Machine,ATM)等其他电子设备,但本申请实施例对此并不限定。
应理解,本申请实施例的处理单元或处理器等处理模块可以是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。
可以理解,本申请实施例的终端或电子设备还可以包括存储器,存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储 器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DR RAM)。应注意,本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
本申请实施例还提出了一种计算机可读存储介质,该计算机可读存储介质存储一个或多个程序,该一个或多个程序包括指令,该指令当被包括多个应用程序的便携式电子设备执行时,能够使该便携式电子设备执行图3至图8所示实施例的方法。
本申请实施例还提出了一种计算机程序,该计算机程序包括指令,当该计算机程序被计算机执行时,使得计算机可以执行图3至图8所示实施例的方法。
本申请实施例还提供了一种芯片,该芯片包括输入输出接口、至少一个处理器、至少一个存储器和总线,该至少一个存储器用于存储指令,该至少一个处理器用于调用该至少一个存储器中的指令,以执行图3至图8所示实施例的方法。
应理解,在本申请的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描 述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (39)

  1. 一种指纹识别的方法,其特征在于,所述方法包括:
    基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,
    其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
  2. 根据权利要求1所述的方法,其特征在于,所述方法包括:
    对所述第一指纹图像进行特征提取处理,得到所述第一指纹图像的特征信息。
  3. 根据权利要求2所述的指纹识别方法,其特征在于,所述基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,包括:
    并行将所述第一指纹图像的特征信息和所述至少两个指纹子模板的特征信息进行匹配,确定至少两个指纹识别结果;
    根据所述至少两个指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
  4. 根据权利要求1至3中任一项所述的方法,其特征在于,所述方法还包括:
    将所述第一指纹模板划分为所述至少两个指纹子模板。
  5. 根据权利要求1至4中任一项所述的方法,其特征在于,所述基于至少两个指纹子模板并行对第一指纹图像进行指纹识别处理,包括:
    在第一安全环境中,基于所述至少两个指纹子模板并行对所述第一指纹图像进行指纹识别处理。
  6. 一种指纹识别的方法,其特征在于,所述方法包括:
    对第一指纹图像进行指纹识别处理,并行采集至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理。
  7. 根据权利要求6所述的指纹识别方法,其特征在于,所述方法还包括:
    基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,确定所述至少一个第二指纹图像的指纹识别结果。
  8. 根据权利要求7所述的方法,其特征在于,所述基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,包 括:
    在所述第一指纹图像的指纹识别结果为指纹识别失败的情况下,基于所述至少一个指纹模板,对所述至少一个第二指纹图像并行进行指纹识别处理。
  9. 根据权利要求7或8所述的方法,其特征在于,所述方法还包括:
    根据所述至少一个第二指纹图像的指纹识别结果确定是否执行触发指纹识别的操作。
  10. 根据权利要求6至9中任一项所述的方法,其特征在于,所述对第一指纹图像进行指纹识别处理,包括:
    对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息;
    将所述第一指纹图像的特征信息和至少一个指纹模板的特征信息进行匹配,确定所述第一指纹图像的指纹识别结果。
  11. 根据权利要求6至10中任一项所述的指纹识别方法,其特征在于,所述对第一指纹图像进行指纹识别处理,并行采集至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理,包括:
    在第一安全环境中,对所述第一指纹图像进行指纹识别处理,并行采集所述至少一个第二指纹图像以及对所述至少一个第二指纹图像进行预处理。
  12. 根据权利要求7至9中任一项所述的指纹识别方法,其特征在于,所述对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,包括:
    在第一安全环境中,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理。
  13. 一种指纹识别的方法,其特征在于,所述方法包括:
    对第一指纹图像进行第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理;
    其中,对所述第一指纹图像的指纹识别处理包括所述第一指纹识别处理和第二指纹识别处理,所述第二指纹识别处理的执行晚于所述第一指纹识别处理的执行。
  14. 根据权利要求13所述的方法,其特征在于,所述方法还包括:
    基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指 纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,其中,所述第二指纹模板为所述第一指纹图像下一个待匹配的指纹模板。
  15. 根据权利要求14所述的方法,其特征在于,所述对第一指纹图像进行第一指纹识别处理,包括:
    对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息。
  16. 根据权利要求15所述的指纹识别方法,其特征在于,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,包括:
    将所述第一指纹图像的特征信息和所述第一指纹模板的特征信息进行匹配,确定所述第一指纹图像针对所述第一指纹模板的第一指纹识别结果。
  17. 根据权利要求14至16中任一项所述的指纹识别方法,其特征在于,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,包括:
    基于至少两个指纹子模板并行对所述第一指纹图像进行所述第二指纹识别处理,
    其中,所述至少两个指纹子模板中的每个指纹子模板对应所述第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
  18. 根据权利要求14至17中任一项所述的指纹识别方法,其特征在于,所述基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,包括:
    在第一安全环境中,基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对所述第二指纹模板进行解压缩处理。
  19. 根据权利要求13至18中任一项所述的指纹识别方法,其特征在于,所述对第一指纹图像进行第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理,包括:
    在第一安全环境中,对所述第一指纹图像进行所述第一指纹识别处理,并行对压缩的第一指纹模板进行解压缩处理。
  20. 一种指纹识别的装置,其特征在于,包括:
    指纹识别模块,用于基于至少两个指纹子模板并行对第一指纹图像进行 指纹识别处理,
    其中,所述至少两个指纹子模板中的每个指纹子模板对应第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
  21. 根据权利要求20所述的装置,其特征在于,所述装置还包括:
    特征提取模块,用于对所述第一指纹图像进行特征提取处理,得到所述第一指纹图像的特征信息。
  22. 根据权利要求21所述的装置,其特征在于,所述指纹识别模块还用于:
    并行将所述第一指纹图像的特征信息和所述至少两个指纹子模板的特征信息进行匹配,确定至少两个指纹识别结果;
    根据所述至少两个指纹识别结果,确定所述第一指纹图像针对所述第一指纹模板的指纹识别结果。
  23. 根据权利要求20至22中任一项所述的装置,其特征在于,所述指纹识别模块还用于:
    将所述第一指纹模板划分为所述至少两个指纹子模板。
  24. 根据权利要求20至23中任一项所述的装置,其特征在于,所述指纹识别模块具体用于:
    在第一安全环境中,基于所述至少两个指纹子模板并行对所述第一指纹图像进行指纹识别处理。
  25. 一种指纹识别的装置,其特征在于,包括:
    第一指纹识别模块,用于对第一指纹图像进行指纹识别处理;
    指纹传感器,用于在所述第一指纹识别模块对所述第一指纹图像进行指纹识别处理时,并行采集至少一个第二待识别指纹图像;
    第二指纹识别模块,用于在所述第一指纹识别模块对所述第一指纹图像进行指纹识别处理时,并行对所述至少一个第二待识别指纹图像进行预处理。
  26. 根据权利要求25所述的装置,其特征在于,所述第二指纹识别模块还用于:
    基于至少一个指纹模板,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理,确定所述至少一个第二指纹图像的指纹识别结果。
  27. 根据权利要求26所述的装置,其特征在于,所述第二指纹识别模块具体用于:在所述第一指纹图像的指纹识别结果为指纹识别失败的情况下,基于所述至少一个指纹模板,对所述至少一个第二指纹图像并行进行指纹识别处理。
  28. 根据权利要求27所述的装置,其特征在于,所述第二指纹识别模块还用于:
    根据所述至少一个第二指纹图像的指纹识别结果确定是否执行触发指纹识别的操作。
  29. 根据权利要求25至28中任一项所述的装置,其特征在于,所述第一指纹识别模块还用于:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息;
    将所述第一指纹图像的特征信息和至少一个指纹模板的特征信息进行匹配,确定所述第一指纹图像的指纹识别结果。
  30. 根据权利要求25至29中任一项所述的装置,其特征在于,所述第一指纹识别模块具体用于:在第一安全环境中,对所述第一指纹图像进行指纹识别处理;
    所述指纹传感器具体用于:在所述第一安全环境中,采集所述至少一个第二指纹图像;
    所述第二指纹识别模块具体用于:在所述第一安全环境中,对所述至少一个第二指纹图像进行预处理。
  31. 根据权利要求26至28中任一项所述的装置,其特征在于,所述第二指纹识别模块具体用于:
    在第一安全环境中,对预处理后的所述至少一个第二指纹图像并行进行指纹识别处理。
  32. 一种指纹识别的装置,其特征在于,所述方法包括:
    指纹识别模块,用于对第一指纹图像进行第一指纹识别处理;
    解压缩模块,用于在所述第一指纹识别模块对所述第一指纹图像进行所述第一指纹识别处理时,并行对压缩的第一指纹模板进行解压缩处理;
    其中,对所述第一指纹图像的指纹识别处理包括所述第一指纹识别处理和第二指纹识别处理,所述第二指纹识别处理的执行晚于所述第一指纹识别处理的执行。
  33. 根据权利要求32所述的装置,其特征在于,所述指纹识别模块还用于:
    基于解压缩的所述第一指纹模板对所述第一指纹图像进行所述第二指纹识别处理,并行对压缩的第二指纹模板进行解压缩处理,其中,所述第二指纹模板为所述第一指纹图像下一个待匹配的指纹模板。
  34. 根据权利要求33所述的装置,其特征在于,所述指纹识别模块具体用于:对所述第一指纹图像进行特征提取,得到所述第一指纹图像的特征信息。
  35. 根据权利要求34所述的装置,其特征在于,所述指纹识别模块具体用于:
    将所述第一指纹图像的特征信息和所述第一指纹模板的特征信息进行匹配,确定所述第一指纹图像针对所述第一指纹模板的第一指纹识别结果。
  36. 根据权利要求33至35中任一项所述的装置,其特征在于,所述指纹识别模块还用于:
    基于至少两个指纹子模板并行对所述第一指纹图像进行所述第二指纹识别处理,其中,所述至少两个指纹子模板中的每个指纹子模板对应所述第一指纹模板中的局部区域,且所述至少两个指纹子模板中的任意两个指纹子模板在所述第一指纹模板中至少部分不重叠。
  37. 根据权利要求33至36中任一项所述的装置,其特征在于,所述指纹识别模块具体用于:在第一安全环境中,基于解压缩的所述第一指纹模板对所述待识别指纹图像进行所述第二指纹识别处理;
    所述解压缩模块用于:在所述第一安全环境中对所述第二指纹模板进行解压缩处理。
  38. 根据权利要求32至37中任一项所述的装置,其特征在于,所述指纹识别模块具体用于:在第一安全环境中,对所述第一指纹图像进行所述第一指纹识别处理;
    所述解压缩模块用于:在所述第一安全环境中对压缩的所述第一指纹模板进行解压缩处理。
  39. 一种电子设备,其特征在于,包括如权利要求20至24中任一项所述的指纹识别的装置,或如权利要求25至31中任一项所述的指纹识别的装置,或如权利要求32至38中任一项所述的指纹识别的装置。
PCT/CN2019/076072 2019-02-25 2019-02-25 指纹识别的方法、装置和电子设备 WO2020172773A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980000275.6A CN109997151A (zh) 2019-02-25 2019-02-25 指纹识别的方法、装置和电子设备
PCT/CN2019/076072 WO2020172773A1 (zh) 2019-02-25 2019-02-25 指纹识别的方法、装置和电子设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/076072 WO2020172773A1 (zh) 2019-02-25 2019-02-25 指纹识别的方法、装置和电子设备

Publications (1)

Publication Number Publication Date
WO2020172773A1 true WO2020172773A1 (zh) 2020-09-03

Family

ID=67136908

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/076072 WO2020172773A1 (zh) 2019-02-25 2019-02-25 指纹识别的方法、装置和电子设备

Country Status (2)

Country Link
CN (1) CN109997151A (zh)
WO (1) WO2020172773A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112580605A (zh) * 2020-12-31 2021-03-30 敦泰电子(深圳)有限公司 指纹图像采集方法、装置、电子设备及存储介质
CN117711032A (zh) * 2023-08-18 2024-03-15 荣耀终端有限公司 指纹识别方法及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105912916A (zh) * 2016-05-27 2016-08-31 广东欧珀移动通信有限公司 一种指纹解锁方法及终端
CN106022069A (zh) * 2016-05-30 2016-10-12 广东欧珀移动通信有限公司 一种解锁控制方法及移动终端
CN106096515A (zh) * 2016-05-31 2016-11-09 广东欧珀移动通信有限公司 一种解锁控制方法及终端设备

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8817981B2 (en) * 2004-11-18 2014-08-26 Biogy, Inc. Generation of registration codes, keys and passcodes using non-determinism
CN101097597A (zh) * 2007-03-23 2008-01-02 北京紫光捷通科技有限公司 基于SoC的指纹识别模块
CN101751550B (zh) * 2008-12-19 2012-02-01 杭州中正生物认证技术有限公司 快速指纹搜索方法及快速指纹搜索系统
US20140093144A1 (en) * 2012-10-01 2014-04-03 Dannie Gerrit Feekes More-Secure Hardware Token
CN106682608A (zh) * 2016-12-23 2017-05-17 努比亚技术有限公司 指纹匹配装置及方法
CN106909900A (zh) * 2017-02-27 2017-06-30 努比亚技术有限公司 指纹识别方法及装置
CN107480609B (zh) * 2017-07-31 2020-01-14 Oppo广东移动通信有限公司 指纹识别方法及相关产品

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105912916A (zh) * 2016-05-27 2016-08-31 广东欧珀移动通信有限公司 一种指纹解锁方法及终端
CN106022069A (zh) * 2016-05-30 2016-10-12 广东欧珀移动通信有限公司 一种解锁控制方法及移动终端
CN106096515A (zh) * 2016-05-31 2016-11-09 广东欧珀移动通信有限公司 一种解锁控制方法及终端设备

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112580605A (zh) * 2020-12-31 2021-03-30 敦泰电子(深圳)有限公司 指纹图像采集方法、装置、电子设备及存储介质
CN112580605B (zh) * 2020-12-31 2024-05-24 敦泰电子(深圳)有限公司 指纹图像采集方法、装置、电子设备及存储介质
CN117711032A (zh) * 2023-08-18 2024-03-15 荣耀终端有限公司 指纹识别方法及电子设备

Also Published As

Publication number Publication date
CN109997151A (zh) 2019-07-09

Similar Documents

Publication Publication Date Title
EP3693887B1 (en) Fingerprint recognition apparatus and method, and electronic device
EP3674856B1 (en) Multi-sensor-based on-screen fingerprint collection method and system and electronic device
US11157716B2 (en) Multi-sensor-based under-screen fingerprint capturing method and system and electronic device
WO2020093251A1 (zh) 基于双感应区的识别指纹方法、指纹识别系统和电子设备
CN111095275B (zh) 指纹识别的装置、方法和电子设备
EP3764277B1 (en) Fingerprint recognition method, apparatus, and electronic device
WO2020186415A1 (zh) 指纹识别的装置、方法和电子设备
EP3731134A1 (en) Method and apparatus for fingerprint recognition, and terminal device
WO2020164055A1 (zh) 功能界面的进入方法、装置和终端设备
WO2020227986A1 (zh) 图像采集的装置、方法和电子设备
WO2020172773A1 (zh) 指纹识别的方法、装置和电子设备
CN111242111B (zh) 指纹识别方法、装置和电子设备
US11132523B2 (en) Method and apparatus for fingerprint identification and electronic device
WO2020061754A1 (zh) 基于多传感器的屏下指纹认证方法、系统和电子设备
WO2020061734A1 (zh) 注册指纹的方法、指纹注册装置和电子设备
WO2021056318A1 (zh) 指纹识别的方法、装置和电子设备
WO2021217476A1 (zh) 指纹识别方法、装置和电子设备
WO2020146984A1 (zh) 基于多安全环境的指纹识别方法、指纹识别系统和电子设备
US10997393B2 (en) Method and apparatus for identifying fingerprint logo and electronic device
WO2020199178A1 (zh) 指纹识别的方法、装置和电子设备
WO2020227938A1 (zh) 引导用户注册指纹的方法和电子设备
WO2020061751A1 (zh) 指纹识别的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19916883

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19916883

Country of ref document: EP

Kind code of ref document: A1