WO2020146984A1

WO2020146984A1 - Multiple security environments-based fingerprint recognition method and system, and electronic device

Info

Publication number: WO2020146984A1
Application number: PCT/CN2019/071659
Authority: WO
Inventors: 李明采; 王波
Original assignee: 深圳市汇顶科技股份有限公司
Priority date: 2019-01-14
Filing date: 2019-01-14
Publication date: 2020-07-23
Also published as: CN109891431B; CN109891431A

Abstract

A multiple security environments-based in-display fingerprint recognition method and system, and an electronic device. The method comprises: in a first duration, performing, according to a second fingerprint template in a first security environment, first fingerprint recognition processing on a fingerprint image to be recognized, and performing, according to a first fingerprint template in a second security environment, second fingerprint recognition processing on the fingerprint image to be recognized, wherein the fingerprint recognition processing performed on the fingerprint image to be recognized comprises the first fingerprint recognition processing and the second fingerprint recognition processing, and the execution of the second fingerprint recognition processing based on the same fingerprint template is later than the execution of the first fingerprint recognition processing.

Description

Fingerprint identification method, fingerprint identification system and electronic equipment based on multiple security environments

Technical field

This application relates to the field of fingerprint technology, and more specifically, to a fingerprint identification method, a fingerprint identification system, and an electronic device based on a multi-security environment.

Background technique

The fingerprint recognition technology under the screen increases the screen-to-body ratio, making the fingerprint recognition area larger and larger. This means that more image processing modules are required, and the corresponding fingerprint recognition takes longer, especially when the user has registered multiple fingerprints. In the case of templates, the fingerprint recognition process is longer, which affects the user experience.

Summary of the invention

The embodiments of the present application provide a fingerprint identification method, fingerprint identification system, and electronic device based on multiple security environments, which can reduce fingerprint identification time and improve user experience.

In the first aspect, a fingerprint identification method based on multiple security environments is provided, the method including:

In the first time period, perform the first fingerprint recognition process on the fingerprint image to be recognized based on the second fingerprint template in the first security environment, and perform the first fingerprint recognition process on the fingerprint image to be recognized based on the first fingerprint template in the second security environment. 2. Fingerprint recognition processing.

In a possible implementation manner, the method further includes:

In the second time period, perform the second fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the second security environment, wherein the second time period is later than the The first time period.

In a possible implementation manner, the performing the second fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the second security environment includes:

Based on the fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized in the first secure environment according to the second fingerprint template, in the second secure environment according to the second fingerprint The template performs the second fingerprint identification processing on the fingerprint image to be identified.

In a possible implementation manner, the method further includes:

Acquiring, from the shared memory, a fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized according to the second fingerprint template.

In a possible implementation, after the first fingerprint recognition processing is performed on the fingerprint image to be recognized according to the second fingerprint template in the first security environment, the method further includes:

Store the fingerprint recognition result of the first fingerprint recognition process in the shared memory.

In a possible implementation manner, the method further includes:

Receive a control instruction from the processor, where the control instruction is used to instruct to perform the first fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the first security environment, and In the second security environment, the second fingerprint identification process is performed on the fingerprint image to be identified according to the first fingerprint template.

In a possible implementation manner, if the first fingerprint template is the first fingerprint template, the method further includes:

In the first time period, the first fingerprint identification process is performed on the fingerprint image to be identified according to the first fingerprint template in the second security environment.

In a possible implementation manner, the first fingerprint identification process is a coarse matching process, the second fingerprint identification process is a fine matching process, and the coarse matching process includes the characteristic information of the fingerprint template and the fingerprint image to be identified. The fine matching process includes performing fine matching according to the fingerprint information in the matching area of the fingerprint template and the fingerprint image to be identified.

In a possible implementation manner, the performing the first fingerprint recognition processing on the fingerprint image to be recognized according to the second fingerprint template in the first security environment includes:

Extracting the feature information of the second fingerprint template and the feature information of the fingerprint image to be identified;

The feature information of the second fingerprint template and the feature information of the fingerprint image to be recognized are matched to obtain a similarity matrix, and the values in the similarity matrix are used to indicate the second fingerprint template and the to-be-recognized The similarity of the corresponding feature points of the fingerprint image.

In a possible implementation manner, the performing second fingerprint recognition processing on the fingerprint image to be recognized according to the first fingerprint template in the second security environment includes:

Determining a matching area between the first fingerprint template and the fingerprint image to be recognized according to the similarity matrix between the first fingerprint template and the fingerprint image to be recognized;

Matching the first fingerprint template with the corresponding pixels in the matching area of the fingerprint image to be identified to obtain matching degree data;

According to the matching degree data, the fingerprint recognition result is determined.

In a possible implementation manner, the determining the fingerprint recognition result according to the matching degree information includes: determining that the pattern recognition is successful if the matching degree data is greater than or equal to a certain threshold; or

If the matching degree data is less than the specific threshold, it is determined that the fingerprint recognition fails.

In a possible implementation manner, the absolute value of the difference between the time consuming of the second fingerprint identification process and the time consuming of the first fingerprint identification process is less than the first time threshold.

In a possible implementation manner, the first security environment is a SecureDsp environment, and the second security environment is a TrustZone environment.

In the second aspect, a fingerprint identification system based on multiple security environments is provided, including:

The first fingerprint identification module is configured to perform the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template in the first security environment in the first time period;

The second fingerprint identification module is configured to perform a second fingerprint identification process on the fingerprint image to be identified according to the first fingerprint template in the second security environment in the first time period.

In a possible implementation manner, the second fingerprint identification module is further used for:

In a possible implementation manner, the second fingerprint identification module is specifically configured to:

In a possible implementation manner, the first fingerprint identification module is further used for:

After performing the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template, the fingerprint identification result of the first fingerprint identification process is stored in a shared memory.

In a possible implementation manner, the fingerprint identification system further includes:

The control module is configured to send a first control instruction to the first fingerprint identification module, where the first control instruction is used to instruct the first fingerprint identification module to perform according to the second fingerprint template in the first security environment Performing the first fingerprint identification processing on the fingerprint image to be identified; and

Send a second control instruction to the second fingerprint identification module, where the second control instruction is used to instruct the second fingerprint identification module to perform the identification according to the first fingerprint template in the second security environment The fingerprint image undergoes the first fingerprint identification process.

In a possible implementation, if the first fingerprint template is the first fingerprint template, the second fingerprint identification module is also used to:

In a possible implementation manner, the first fingerprint identification module is specifically configured to:

If the matching degree data is greater than or equal to a specific threshold, it is determined that the pattern recognition is successful; or

In a possible implementation manner, the difference between the time-consuming process of the second fingerprint identification process and the time-consuming process of the first fingerprint identification process is less than the first time threshold.

In a third aspect, a chip is provided. The chip includes an input/output interface, at least one processor, at least one memory, and a bus. The at least one memory is used to store instructions, and the at least one processor is used to call Instructions to execute the method in the first aspect or any possible implementation of the first aspect.

In a fourth aspect, an electronic device is provided, including the fingerprint identification system as in the second aspect or any possible implementation of the second aspect.

In a fifth aspect, a computer-readable medium is provided for storing a computer program, and the computer program includes instructions for executing the foregoing first aspect or any possible implementation manner of the first aspect.

In a sixth aspect, a computer program product including instructions is provided. When a computer runs the instructions of the computer program product, the computer executes the first aspect or any of the possible implementations of the first aspect Fingerprint identification method.

Specifically, the computer program product can run on the electronic device in the fourth aspect.

Based on the above technical solution, the fingerprint recognition processing of the fingerprint to be recognized can be split into multiple fingerprint recognition processing operations, for example, the first fingerprint recognition processing and the second fingerprint recognition processing, wherein the second fingerprint recognition based on the same fingerprint template The processing is later than the first fingerprint recognition processing, so that the first fingerprint recognition processing and the second fingerprint recognition processing can be performed in parallel according to multiple fingerprint templates in different security environments, so that the fingerprint recognition time can be shortened and the user experience can be improved.

BRIEF DESCRIPTION

Fig. 1A is a directional view of an electronic device according to an embodiment of the present application.

Fig. 1B is a schematic diagram of a partial cross-sectional structure of the electronic device shown in Fig. 1A along A-A'.

Figure 2 is a flowchart of a typical fingerprint identification method.

Figure 3 is a timing diagram of a typical fingerprint identification method.

Fig. 4 is a schematic flowchart of a fingerprint identification method according to an embodiment of the present application.

Fig. 5 is a flowchart of a fingerprint identification method using five fingerprint templates as an example.

Fig. 6 is a sequence diagram of the fingerprint recognition process shown in Fig. 5.

Fig. 7 is a schematic flowchart of rough matching processing.

Fig. 8 is a schematic flowchart of fine matching processing.

Fig. 9 is a schematic structural diagram of a fingerprint identification system according to an embodiment of the present application.

Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

detailed description

The technical solution in this application will be described below in conjunction with the drawings.

As a common application scenario, the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other terminal devices; more specifically, in the above-mentioned terminal devices, fingerprint identification The device may specifically be an optical fingerprint device, which may be arranged in a partial area or an entire area below the display screen, thereby forming an under-display optical fingerprint system. Alternatively, the fingerprint identification device may be partially or fully integrated into the display screen of the terminal device, thereby forming an in-display optical fingerprint system.

1A and 1B show schematic diagrams of electronic devices to which the embodiments of the present application can be applied. Among them, FIG. 1 is a front schematic view of the electronic device 10, and FIG. 1B is the electronic device 10 shown in FIG. Partial sectional structure diagram.

As shown in FIG. 1A and FIG. 1B, the electronic device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a partial area below the display screen 120. The optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array with a plurality of optical sensing units, and the area where the sensing array is located or its sensing area is the fingerprint detection area 103 of the optical fingerprint device 130. As shown in FIG. 1A, the fingerprint detection area 103 is located in the display area of the display screen 120. In an alternative embodiment, the optical fingerprint device 130 may also be arranged in other positions, such as the side of the display screen 120 or the non-transmissive area at the edge of the electronic device 10, and the optical fingerprint device 130 may be designed to The optical signal of at least part of the display area of the display screen 120 is guided to the optical fingerprint device 130, so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.

It should be understood that the area of the fingerprint detection area 103 may be different from the area of the sensing array of the optical fingerprint device 130, for example, through an optical path design such as lens imaging, a reflective folding optical path design, or other optical path design such as light convergence or reflection. The area of the fingerprint detection area 103 of the optical fingerprint device 130 can be made larger than the area of the sensing array of the optical fingerprint device 130. In other alternative implementations, if for example a light collimation method is used for light path guidance, the fingerprint detection area 103 of the optical fingerprint device 130 may also be designed to be substantially the same as the area of the sensing array of the optical fingerprint device 130.

Therefore, when the user needs to unlock the terminal device or perform other fingerprint verification, he only needs to press his finger on the fingerprint detection area 103 located in the display screen 120 to realize fingerprint input. Since fingerprint detection can be implemented in the screen, the electronic device 10 adopting the above structure does not need to reserve space on the front side to set fingerprint buttons (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 It can be basically extended to the front of the entire electronic device 10.

As an optional implementation, as shown in FIG. 1B, the optical fingerprint device 130 includes a light detecting part 134 and an optical component 132, and the light detecting part 134 includes the sensor array and is electrically connected to the sensor array. The connected reading circuit and other auxiliary circuits can be fabricated on a chip (Die) by a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor. The sensing array is specifically a photodetector (Photodetector) array, which includes A plurality of photodetectors distributed in an array, the photodetectors can be used as the above-mentioned optical sensing unit; the optical component 132 can be arranged above the sensing array of the photodetecting part 134, which can specifically include The filter layer (Filter), the light guide layer or the light path guide structure and other optical elements, the filter layer can be used to filter out the ambient light penetrating the finger, and the light guide layer or the light path guide structure is mainly used to remove The reflected light reflected from the finger surface is guided to the sensing array for optical detection.

In terms of specific implementation, the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component. For example, the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 is attached above the chip, or some components of the optical assembly 132 are integrated into the chip.

Wherein, the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes. For example, the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple A collimating unit or a micro-hole array, the collimating unit can be specifically a small hole, the reflected light reflected from the finger, the light that is perpendicularly incident on the collimating unit can pass through and be the optical sensing unit below it The light with an excessively large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensor unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it. The sensor array can detect the fingerprint image of the finger.

In another embodiment, the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, which The sensing array used to converge the reflected light reflected from the finger to the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger. Optionally, the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device to improve the optical The fingerprint imaging effect of the fingerprint device 130.

In other embodiments, the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer. The micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be grown by semiconductors. A process or other processes are formed above the sensing array of the light detecting part 134, and each microlens may correspond to one of the sensing units of the sensing array. In addition, other optical film layers may be formed between the micro lens layer and the sensing unit, such as a dielectric layer or a passivation layer. More specifically, the micro lens layer and the sensing unit may also include The light-blocking layer of the micro-hole, wherein the micro-hole is formed between its corresponding micro-lens and the sensing unit, the light-blocking layer can block the optical interference between the adjacent micro-lens and the sensing unit, and make the sensing The light corresponding to the unit is condensed into the microhole through the microlens and is transmitted to the sensing unit through the microhole to perform optical fingerprint imaging.

It should be understood that several implementation solutions of the above-mentioned optical path guiding structure can be used alone or in combination. For example, a microlens layer can be further provided under the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the microlens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.

As an optional embodiment, the display screen 120 may be a display screen with a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display or a micro-LED (Micro-LED) display Screen. Taking an OLED display screen as an example, the optical fingerprint device 130 may use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection. When a finger is pressed on the fingerprint detection area 103, the display screen 120 emits a beam of light to the target finger above the fingerprint detection area 103. The light is reflected on the surface of the finger to form reflected light or is scattered inside the finger. Form scattered light. In related patent applications, for ease of description, the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Because the ridge and valley of the fingerprint have different light reflection capabilities, the reflected light from the fingerprint ridge and the emitted light from the fingerprint ridge have different light intensities. After the reflected light passes through the optical components, it is affected by the optical fingerprint. The sensing array in the device 130 receives and converts into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed, thereby implementing the electronic device 10 Optical fingerprint recognition function.

In other embodiments, the optical fingerprint device 130 may also use a built-in light source or an external light source to provide an optical signal for fingerprint detection. In this case, the optical fingerprint device 130 may be suitable for non-self-luminous display screens, such as liquid crystal display screens or other passively-luminous display screens. Taking a liquid crystal display with a backlight module and a liquid crystal panel as an example, in order to support the under-screen fingerprint detection of the liquid crystal display, the optical fingerprint system of the electronic device 10 may also include an excitation light source for optical fingerprint detection. The excitation light source may specifically be an infrared light source or a light source of non-visible light of a specific wavelength, which may be arranged under the backlight module of the liquid crystal display screen or arranged in the edge area under the protective cover of the electronic device 10, and the The optical fingerprint device 130 can be arranged under the edge area of the liquid crystal panel or the protective cover and guided by the light path so that the fingerprint detection light can reach the optical fingerprint device 130; or, the optical fingerprint device 130 can also be arranged in the backlight module. Under the group, and the backlight module is designed to allow the fingerprint detection light to pass through the liquid crystal panel and the backlight module and reach the optical fingerprint device 130 by opening holes or other optical designs on the film layers such as diffuser, brightness enhancement film, and reflective film. . When the optical fingerprint device 130 adopts a built-in light source or an external light source to provide an optical signal for fingerprint detection, the detection principle is the same as that described above.

It should be understood that, in specific implementation, the electronic device 10 further includes a transparent protective cover, which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the electronic The front of the device 10. Because, in the embodiment of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.

On the other hand, in some embodiments, the optical fingerprint device 130 may include only one optical fingerprint sensor. At this time, the fingerprint detection area 103 of the optical fingerprint device 130 has a small area and a fixed position, so the user is performing fingerprint input At this time, it is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the optical fingerprint device 130 may not be able to collect fingerprint images, resulting in poor user experience. In other alternative embodiments, the optical fingerprint device 130 may specifically include multiple optical fingerprint sensors; the multiple optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the multiple optical fingerprint sensors The sensing area of the fingerprint sensor together constitutes the fingerprint detection area 103 of the optical fingerprint device 130. In other words, the fingerprint detection area 103 of the optical fingerprint device 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint collection area of the optical fingerprint module 130 103 can be extended to the main area of the lower half of the display screen, that is, to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation. Alternatively, when the number of optical fingerprint sensors is sufficient, the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.

Because fingerprint recognition has high requirements for security, it needs to run in a safe and reliable environment (Trusted Execution Environment, TEE), such as the TrustZone environment, or Qualcomm’s QSEE TEE, secure digital signal processing (Digital Signal Processing) Signal Processing, DSP), etc., where the TrustZone is an isolated and trusted operating system that runs on electronic devices and can be used for applications with higher security requirements.

However, TEEs such as TrustZone or Qualcomm’s Secure DSP support single-threaded applications. That is to say, when performing fingerprint recognition functions, if there are multiple fingerprint templates, the fingerprint recognition function can only be performed according to each fingerprint template in sequence. Fingerprint recognition takes a long time. Combining Figure 2 and Figure 3, the user has registered 5 fingerprint templates as an example to illustrate the specific fingerprint identification process. Among them, Figure 2 is a flow chart of fingerprint identification based on five fingerprint templates. As shown in Figure 2, the specific identification process may include the following steps:

S201: Load the fingerprint template 1 to perform the fingerprint identification function;

S202: Judge whether the fingerprint recognition is successful, if successful, the process jumps to S212; otherwise, the process jumps to S203;

S203: Load the fingerprint template 2 to execute the fingerprint identification function;

S204: Judge whether the fingerprint recognition is successful, if successful, the process jumps to S212; otherwise, the process jumps to S205;

S205, load the fingerprint template 3 to execute the fingerprint identification function;

S206: Judge whether the fingerprint recognition is successful, if successful, the process jumps to S212; otherwise, the process jumps to S207;

S207: Load the fingerprint template 4 to perform the fingerprint identification function;

S208: Judge whether the fingerprint recognition is successful, if successful, the process jumps to S212; otherwise, the process jumps to S209;

S209: Load the fingerprint template 5 to perform the fingerprint identification function;

S210: Judge whether the fingerprint recognition is successful, if successful, the process jumps to S212; otherwise, the process jumps to S211.

S211: Determine that the fingerprint recognition fails;

S212: Determine that the fingerprint recognition is successful.

Fig. 3 is a sequence diagram of the embodiment shown in Fig. 2. As can be seen from Fig. 3, when a user registers multiple fingerprint templates, the fingerprint identification function can only be performed according to each fingerprint template in turn. If the time-consuming process of fingerprint identification based on a single fingerprint template is 100ms, in the worst case, the total time-consuming of fingerprint identification needs 5*100ms=500ms.

In view of this, this application provides a fingerprint recognition solution that can split the fingerprint recognition function into multiple functional modules, and use multiple security environments to execute the multiple functional modules in parallel, thereby shortening the fingerprint recognition time and improving users Experience.

It should be understood that, in the embodiments of the present application, the fingerprint identification process may be referred to as a fingerprint authentication process, and the fingerprint identification process may also be referred to as a fingerprint authentication process.

4 is a schematic flowchart of a fingerprint identification method 400 based on multiple security environments according to an embodiment of the present application. The method 400 may be applied to a fingerprint identification system based on multiple security environments. As shown in FIG. 4, the method 400 includes:

S401. In the first time period, perform the first fingerprint recognition process on the fingerprint image to be recognized according to the second fingerprint template in the first secure environment, and perform the first fingerprint recognition process on the fingerprint image to be recognized according to the first fingerprint template in the second secure environment Perform the second fingerprint identification process;

Wherein, the fingerprint recognition processing of the fingerprint image to be recognized includes the first fingerprint recognition processing and the second fingerprint recognition processing, and the second fingerprint recognition processing based on the same fingerprint template is executed later than the first fingerprint recognition processing Implementation.

In some embodiments, the method 400 may be executed by a processing unit in the fingerprint identification system, and the processing unit may be a microcontroller (Micro Control Unit, MCU) in a fingerprint device, or may also be a processor of an electronic device Or the controller, or may also include the MCU of the fingerprint device and the processor of the electronic device, that is, the method 400 can be executed by the processor of the electronic device and the MCU of the fingerprint device together. Below, the fingerprint recognition system is used as the execution subject to describe The fingerprint identification method according to the embodiment of the present application.

In the embodiment of the present application, the fingerprint recognition function can be split into multiple processing modules, for example, a first fingerprint recognition module and a second fingerprint recognition module. The first fingerprint recognition module and the second fingerprint recognition module can be identified separately The fingerprint image is subjected to the first fingerprint recognition processing and the second fingerprint recognition processing, wherein the second fingerprint recognition processing based on the same fingerprint template is later than the first fingerprint recognition processing, that is to say, after executing the fingerprint based on a certain fingerprint template After the first fingerprint identification process, the second fingerprint identification process is executed according to the fingerprint template.

In the embodiment of the present application, the fingerprint recognition function can be performed in multiple security environments, where the multiple security environments include a first security environment and a second security environment, and the first security environment and the second security environment can be used for Run applications or functions with high safety requirements.

In some embodiments, the first security environment may be a SecureDsp environment, and the second security environment may be the aforementioned TrustZone environment; or, in other optional embodiments, the first security environment may be a QSEE environment, and the The second security environment may be a TrustZone environment; alternatively, the second security environment may be a SecureDsp environment, and the first security environment may be a TrustZone environment, etc. The embodiment of the present application is not limited thereto.

In this embodiment of the application, when fingerprint recognition is required on the fingerprint image to be recognized, the fingerprint recognition system may perform fingerprint recognition on the fingerprint image to be recognized according to multiple fingerprint templates, where the multiple fingerprint templates include the first fingerprint template and The second fingerprint template, specifically, within the same time period, the fingerprint identification system can perform the second fingerprint identification process on the fingerprint image to be identified according to the first fingerprint template in the second security environment, and at the same time in the first security environment Perform the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template, that is, the fingerprint identification system can use multiple security environments to execute the fingerprint identification process in parallel based on multiple fingerprint templates at the same time, which can shorten the fingerprint identification time. Improve user experience.

Optionally, in an embodiment of the present application, the first fingerprint recognition processing may include rough matching processing operations on the fingerprint image, such as fingerprint image preprocessing, feature information extraction, similarity matching, etc.; the second fingerprint recognition The processing may include fine matching processing operations on the fingerprint image, for example, comparing the detailed information (or partial information) of the fingerprint image and the fingerprint template to determine the degree of matching between the two, and then determining whether the fingerprint recognition is successful.

In the embodiment of the present application, the first fingerprint identification module and the second fingerprint identification module can be divided according to the execution time (or time-consuming) of each functional module of the fingerprint identification function, so that the first fingerprint identification The processing time is equivalent to the time consumption of the second fingerprint identification process, that is, the time consumption of the first fingerprint identification process and the second fingerprint identification process are the same or similar. Assuming that the total time consumption of the fingerprint recognition function is 100ms, the divided time of the second fingerprint recognition module and the first fingerprint recognition module can be or approximately 50ms. In this way, in the same time period, the Performing the second fingerprint identification processing function and the first fingerprint identification processing function separately in the environment is beneficial to shorten the total time-consuming of the fingerprint identification function.

In some embodiments, the second fingerprint recognition process is performed on the fingerprint image to be recognized according to the first fingerprint template, and the final fingerprint recognition result can be obtained. If the fingerprint recognition result is that the fingerprint recognition failed, the method 400 may further include:

Specifically, in the first time period, the first fingerprint recognition module performs the first fingerprint recognition process on the fingerprint image to be recognized based on the second fingerprint template, and the second fingerprint recognition template may perform the first fingerprint recognition process on the fingerprint image to be recognized based on the first fingerprint template. 2. Fingerprint recognition processing. If the fingerprint recognition result obtained by performing the second fingerprint recognition processing according to the first fingerprint recognition template is fingerprint recognition failure, that is, the fingerprint image to be recognized fails to match the first fingerprint template, then after the first time period, the The second fingerprint recognition module may further perform second fingerprint recognition processing on the fingerprint image to be recognized according to the second fingerprint template, and determine the fingerprint recognition result for the second fingerprint template, that is, determine whether the fingerprint image to be recognized matches the second fingerprint template .

Since the second fingerprint recognition processing and the first fingerprint recognition processing are sequential, in some embodiments, the second fingerprint recognition module performs the second fingerprint recognition processing on the second fingerprint template based on the second fingerprint template The fingerprint identification result obtained by performing the first fingerprint identification process can reduce the time consumption of the first fingerprint identification process in the total time consumption of the fingerprint identification function. Optionally, if the first fingerprint recognition processing includes processing operations such as feature information extraction and feature similarity matching, the second fingerprint recognition processing may perform further fingerprint recognition processing based on the similarity matrix obtained by the first fingerprint recognition processing .

In some embodiments, if the first fingerprint template is the first fingerprint template, the fingerprint identification process of the first fingerprint template does not need to be split, that is, the fingerprint identification system can be based on the first fingerprint template in the second security environment. The template sequentially performs the first fingerprint recognition processing and the second fingerprint recognition processing on the fingerprint image to be recognized. This is because the second fingerprint identification process and the first fingerprint identification process are sequential, and the first fingerprint identification process and the second fingerprint identification process cannot be performed simultaneously based on the same fingerprint template.

Since the first fingerprint identification process and the second fingerprint identification process are executed in different security environments, the security environments are usually isolated, and direct communication between the security environments is usually not possible. In some embodiments, it is used to execute the first fingerprint identification process. 2. The second fingerprint identification module for fingerprint identification processing and the first fingerprint identification module for performing the first fingerprint identification processing can exchange information through shared memory. For example, the second fingerprint identification module may obtain the fingerprint identification result obtained by the first fingerprint identification module from the shared memory, for example, similarity matrix information. Similarly, the first fingerprint identification module may also perform the first fingerprint identification After the identification processing operation, the result obtained by the first fingerprint identification processing operation is stored in the shared memory.

In some embodiments, the second fingerprint identification module and the first fingerprint identification module can execute the corresponding fingerprint identification processing function based on the control command of the processor, that is, the processor can control the second fingerprint identification module and the first fingerprint identification module. Perform corresponding fingerprint recognition processing functions together in a specific time period. In some embodiments, the processor may be a processor or a controller of an electronic device, or may also be an MCU of a fingerprint device.

Hereinafter, in conjunction with Figures 5 and 6, the fingerprint templates registered by the user are five fingerprint templates (fingerprint template 1 to fingerprint template 5), the second security environment is the TrustZone environment, and the first security environment is the SecureDsp environment as an example. The fingerprint identification method according to the embodiment of the present application is described in detail. Among them, FIG. 5 is a schematic flowchart of a fingerprint identification method using five fingerprint templates as an example, and FIG. 6 is a sequence diagram of the fingerprint identification process shown in FIG. 5.

As shown in Figure 5, the fingerprint identification method may include the following:

In the first time period, namely P1, in the TrustZone environment, execute S501, and perform the first fingerprint recognition processing and the second fingerprint recognition processing on the fingerprint image to be recognized according to the fingerprint template 1;

Further, in S502, it is determined whether the fingerprint recognition is successful, if yes, the process proceeds to S512, otherwise, the process proceeds to S503.

At the same time, that is, within the first time period, in the SecureDsp environment, execute S601, and perform the first fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 2;

Further, in S602, it is determined whether there is an unmatched fingerprint template, if yes, the process proceeds to S603, otherwise, the process ends.

In the second time period, namely P2, in TrustZone, execute S503, and perform the second fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 2;

Specifically, the second fingerprint identification process may be performed on the fingerprint image to be identified according to the fingerprint identification result obtained in S601.

Further, in S504, it is judged whether the fingerprint recognition is successful, if yes, the process proceeds to S512, otherwise, the process proceeds to S505.

At the same time, that is, during the second time period, in the SecureDsp environment, execute S603, and perform the first fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 3;

Further, in S604, it is judged whether there is an unmatched fingerprint template, if yes, the process proceeds to S605, otherwise, the process ends;

In the third time period, namely P2, in TrustZone, execute S505, and perform the second fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 3;

Specifically, the second fingerprint identification process may be performed on the fingerprint image to be identified according to the fingerprint identification result obtained in S603.

Further, in S506, it is determined whether the fingerprint recognition is successful, if yes, the process proceeds to S512, otherwise, the process proceeds to S507.

At the same time, that is, in the third time period, in the SecureDsp environment, execute S605, and perform the first fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 4;

Further, in S606, it is judged whether there is an unmatched fingerprint template, if yes, the process proceeds to S607, otherwise, the process ends;

In the fourth time period, namely P4, in TrustZone, execute S507 to perform the second fingerprint recognition process on the fingerprint image to be recognized according to the fingerprint template 4;

Specifically, the second fingerprint identification process may be performed on the fingerprint image to be identified according to the fingerprint identification result obtained in S605.

Further, in S508, it is determined whether the fingerprint recognition is successful, if so, the process proceeds to S512, otherwise, the process proceeds to S509.

At the same time, in the fourth time period, in the SecureDsp environment, execute S607, and perform the first fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 5;

Further, in S608, it is judged whether there is an unmatched fingerprint template, there is no unmatched fingerprint template, and the process ends;

In the fifth time period, namely P5, in TrustZone, execute S509 to perform the second fingerprint identification process on the fingerprint image to be identified according to the fingerprint template 5;

Specifically, the second fingerprint identification process may be performed on the fingerprint image to be identified according to the fingerprint identification result obtained in S607.

Further, in S510, it is judged whether the fingerprint recognition is successful, if yes, the process proceeds to S512, otherwise, the process proceeds to S511.

S511. It is determined that the fingerprint authentication fails, in other words, the fingerprint recognition fails;

S512, it is determined that the fingerprint authentication is successful, or in other words, the fingerprint identification is successful.

If the total time for the fingerprint identification process of a single fingerprint template is 100ms, the time for the first fingerprint identification process and the second fingerprint identification process are 50ms respectively. According to the fingerprint identification process shown in Figure 3, the fingerprint identification process can take up to 100*5=500ms, and according to the fingerprint identification method of the present application, the maximum time for fingerprint identification is the total duration of P1～P5, where P1 is a complete fingerprint identification process, namely 100ms, and P2～P5 are all 50ms , That is, the maximum time-consuming is 100+50*4=300ms. It can be seen that, compared with the single-threaded fingerprint identification scheme, the fingerprint identification scheme according to the embodiment of the present application shortens the fingerprint identification time by 40%, thereby bringing a better user experience.

Table 1 shows the comparison between the single-threaded fingerprint identification scheme and the parallel fingerprint identification scheme according to the embodiment of the present application under different numbers of fingerprint templates. As can be seen from Table 1, the more the number of fingerprint templates, the more obvious the advantages of the parallel fingerprint identification scheme.

Table 1

In the following, in conjunction with Figures 7 to 8, taking the first fingerprint identification process as coarse matching processing and the second fingerprint identification process as fine matching processing as an example, it is described in detail that the first fingerprint identification process and the second fingerprint identification process of the present application include The specific content.

Fig. 7 is a schematic flowchart of rough matching processing. As shown in Fig. 7, the rough matching processing process may include the following steps:

S701: Obtain a pre-stored fingerprint template;

Specifically, the fingerprint template registered by the user can be obtained from the memory of the electronic device.

S702: Extract characteristic information of the fingerprint template;

Optionally, the characteristic information of the fingerprint template may include, but is not limited to, information such as the position and number of the end points and bifurcation points of the lines.

S703: Obtain a fingerprint sample to be identified;

Specifically, the user's fingerprint sample collected by the fingerprint sensor is copied to the memory of the first security environment, so as to perform subsequent processing operations in the first security environment.

S704: Extract characteristic information of the fingerprint sample;

Optionally, before S704, the fingerprint samples may be preprocessed to improve the accuracy of feature extraction. For example, a filtering algorithm may be used to remove interference information such as noise, burrs, or breaks in the fingerprint image.

S705: Determine the similarity matrix between the fingerprint template and the fingerprint sample.

Specifically, the feature information of the fingerprint template extracted in S702 can be matched with the feature information of the fingerprint sample extracted in S704 to determine the similarity of the corresponding feature points of the fingerprint template and the fingerprint sample to obtain a similarity matrix.

After the rough matching processing is performed, further, fine matching processing may be performed on the fingerprint samples. As shown in FIG. 8, the fine matching processing process may include the following steps:

S801: Determine the matching area between the fingerprint template and the fingerprint sample according to the similarity matrix obtained in S705;

Further, in S802, determine the matching degree information between the fingerprint template and the fingerprint sample in each matching area;

S803: Determine the fingerprint recognition result according to the matching degree information. For example, when the matching degree is greater than a certain threshold, it is determined that the fingerprint recognition is successful, otherwise it is determined that the fingerprint recognition fails.

It should be understood that the above description only takes the first fingerprint identification process as the coarse matching process and the second fingerprint identification process as the fine matching process as an example. The embodiment of the present application may also adopt other function division methods, or the fingerprint identification function may also be used. Divided into more functional modules. It can be understood that when the fingerprint recognition algorithm is different, the functions performed by the first fingerprint recognition process and the second fingerprint recognition process are also different, which is not specifically limited in the embodiment of the present application.

The method embodiments of the present application are described in detail above with reference to Figs. 4 to 8, and the device embodiments of the present application are described in detail below in conjunction with Figs. 9 to 10. It should be understood that the device embodiments and the method embodiments correspond to each other and are similar The description can refer to the method embodiment.

FIG. 9 is a schematic block diagram of a fingerprint identification system according to an embodiment of the present application. As shown in FIG. 9, the fingerprint identification system 900 includes:

The first fingerprint identification module 901 is configured to perform the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template in the first security environment in the first time period;

The second fingerprint identification module 902 is configured to perform a second fingerprint identification process on the fingerprint image to be identified according to the first fingerprint template in the second security environment in the first time period.

Optionally, in an embodiment of the present application, the second fingerprint identification module 902 is further configured to:

Optionally, in an embodiment of the present application, the second fingerprint identification module 902 is specifically configured to:

Obtain from the shared memory a fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized according to the second fingerprint template.

Optionally, in an embodiment of the present application, the first fingerprint identification module 901 is further configured to:

Optionally, in an embodiment of the present application, the fingerprint identification system 900 further includes:

The control module 903 is configured to send a first control instruction to the first fingerprint identification module, where the first control instruction is used to instruct the first fingerprint identification module to perform the operation according to the second fingerprint in the first security environment The template performs the first fingerprint identification processing on the fingerprint image to be identified; and

Optionally, in an embodiment of the present application, if the first fingerprint template is the first fingerprint template, the second fingerprint identification module 902 is further configured to:

Optionally, in an embodiment of the present application, the first fingerprint identification process is a coarse matching process, the second fingerprint identification process is a fine matching process, and the coarse matching process includes the characteristic information and the waiting process according to the fingerprint template. The feature information of the fingerprint image is recognized for matching, and the fine matching processing includes performing minutiae matching according to the fingerprint template and the fingerprint information in the matching area of the fingerprint image to be recognized.

Optionally, in an embodiment of the present application, the first fingerprint identification module 901 is specifically configured to:

Optionally, in an embodiment of the present application, the difference between the time consumption of the second fingerprint identification process and the time consumption of the first fingerprint identification process is less than a first time threshold.

Optionally, in an embodiment of the present application, the first security environment is a SecureDsp environment, and the second security environment is a TrustZone environment.

Optionally, in some embodiments, the fingerprint identification system 900 may be provided in a fingerprint module, or the fingerprint identification system may be the fingerprint module, or the fingerprint identification system may include the fingerprint module.

It should be understood that in the method embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution, and the execution order of the processes should be determined by their functions and internal logic, and should not correspond to the differences in the embodiments of the present application. The implementation process constitutes any limitation.

An embodiment of the present application also provides an electronic device 300. As shown in FIG. 10, the electronic device 800 may include a fingerprint identification system 310, and the fingerprint identification system 310 may be the fingerprint identification system 900 in the foregoing embodiment. In addition, the fingerprint identification system 310 can be used to execute the content in the method embodiments shown in FIGS. 4 to 6.

In some embodiments, the electronic device may be an electronic device supporting the Android system, such as portable or mobile computing devices such as smart phones, laptops, tablet computers, and gaming devices, as well as electronic databases, automobiles, and bank automated teller machines (Automated Teller Machine). , ATM) and other electronic devices, but the embodiments of the present application are not limited thereto.

It should be understood that the processor of the embodiment of the present application may be an integrated circuit chip with signal processing capability. In the implementation process, the steps of the foregoing method embodiments may be completed by instructions in the form of hardware integrated logic circuits or software in the processor. The above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in combination with the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

It can be understood that the terminal or the electronic device of the embodiment of the present application may further include a memory, and the memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory can be Read-Only Memory (ROM), Programmable Read-Only Memory (Programmable ROM, PROM), Erasable Programmable Read-Only Memory (Erasable PROM, EPROM), and Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. The volatile memory may be a random access memory (Random Access Memory, RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synchlink DRAM, SLDRAM) ) And direct memory bus random access memory (Direct Rambus RAM, DR RAM). It should be noted that the memories of the systems and methods described herein are intended to include, but are not limited to these and any other suitable types of memories.

The embodiment of the present application also proposes a computer-readable storage medium that stores one or more programs, and the one or more programs include instructions. When the instructions are included in a portable electronic device that includes multiple application programs When executed, the portable electronic device can be made to execute the method of the embodiment shown in FIG. 4 to FIG. 6.

The embodiment of the present application also proposes a computer program, which includes instructions. When the computer program is executed by a computer, the computer can execute the method of the embodiments shown in FIG. 4 to FIG. 6.

An embodiment of the present application also provides a chip that includes an input and output interface, at least one processor, at least one memory, and a bus. The at least one memory is used to store instructions, and the at least one processor is used to call the at least one memory. To execute the method of the embodiment shown in FIG. 4 to FIG. 6.

It should be understood that in the various embodiments of the present application, the size of the sequence numbers of the foregoing processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not correspond to the embodiments of the present application. The implementation process constitutes any limitation.

Those of ordinary skill in the art may realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in hardware or software depends on the specific application of the technical solution and design constraints. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and conciseness of the description, the specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the unit is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical, or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

The above are only specific implementations of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

A fingerprint identification method based on multiple security environments, characterized in that the method includes:

In the first time period, perform the first fingerprint recognition process on the fingerprint image to be recognized based on the second fingerprint template in the first security environment, and perform the first fingerprint recognition process on the fingerprint image to be recognized based on the first fingerprint template in the second security environment. 2. Fingerprint recognition processing;

Wherein, the fingerprint recognition processing of the fingerprint image to be recognized includes the first fingerprint recognition processing and the second fingerprint recognition processing, and the second fingerprint recognition processing based on the same fingerprint template is executed later than the first fingerprint recognition processing Implementation.
The method according to claim 1, wherein the method further comprises:

In the second time period, perform the second fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the second security environment, wherein the second time period is later than the The first time period.
The method according to claim 2, wherein the performing the second fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the second security environment comprises:

Based on the fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized in the first secure environment according to the second fingerprint template, in the second secure environment according to the second fingerprint The template performs the second fingerprint identification processing on the fingerprint image to be identified.
The fingerprint identification method according to any one of claims 1 to 3, wherein the method further comprises:

Acquiring, from the shared memory, a fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized according to the second fingerprint template.
The fingerprint identification method according to any one of claims 1 to 4, wherein after the first fingerprint identification process is performed on the fingerprint image to be identified according to the second fingerprint template in the first security environment, The method also includes:

Store the fingerprint recognition result of the first fingerprint recognition process in the shared memory.
The fingerprint identification method according to any one of claims 1 to 5, wherein the method further comprises:

Receive a control instruction from the processor, where the control instruction is used to instruct to perform the first fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the first security environment, and The second fingerprint identification process is performed on the fingerprint image to be identified in the second security environment according to the first fingerprint template.
The fingerprint identification method according to any one of claims 1 to 6, wherein if the first fingerprint template is the first fingerprint template, the method further comprises:

In the first time period, the first fingerprint identification process is performed on the fingerprint image to be identified according to the first fingerprint template in the second security environment.
The fingerprint identification method according to any one of claims 1 to 7, wherein the first fingerprint identification process is a coarse matching process, the second fingerprint identification process is a fine matching process, and the coarse matching process is It includes matching according to the characteristic information of the fingerprint template and the characteristic information of the fingerprint image to be recognized, and the fine matching processing includes performing minutiae matching according to the fingerprint information in the matching area of the fingerprint template and the fingerprint image to be recognized.
8. The fingerprint identification method according to claim 8, wherein the performing the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template in the first security environment comprises:

Extracting the feature information of the second fingerprint template and the feature information of the fingerprint image to be identified;

The feature information of the second fingerprint template and the feature information of the fingerprint image to be recognized are matched to obtain a similarity matrix, and the values in the similarity matrix are used to indicate the second fingerprint template and the to-be-recognized The similarity of the corresponding feature points of the fingerprint image.
The fingerprint identification method according to claim 8 or 9, wherein the second fingerprint identification process is performed on the fingerprint image to be identified according to the first fingerprint template in the second security environment, comprising:

Determining a matching area between the first fingerprint template and the fingerprint image to be recognized according to the similarity matrix between the first fingerprint template and the fingerprint image to be recognized;

Matching the first fingerprint template with the corresponding pixels in the matching area of the fingerprint image to be identified to obtain matching degree data;

According to the matching degree data, the fingerprint recognition result is determined.
The fingerprint identification method according to claim 10, wherein the determining the fingerprint identification result according to the matching degree information comprises:

If the matching degree data is greater than or equal to a specific threshold, it is determined that the pattern recognition is successful; or

If the matching degree data is less than the specific threshold, it is determined that the fingerprint recognition fails.
The fingerprint identification method according to any one of claims 1 to 11, wherein the absolute value of the difference between the time consumption of the second fingerprint identification process and the time consumption of the first fingerprint identification process is smaller than the first fingerprint identification process. A time threshold.
The fingerprint identification method according to any one of claims 1 to 12, wherein the first security environment is a SecureDsp environment, and the second security environment is a TrustZone environment.
A fingerprint identification system based on multiple security environments, which is characterized in that it includes:

The first fingerprint identification module is configured to perform the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template in the first security environment in the first time period;

The second fingerprint identification module is configured to perform a second fingerprint identification process on the fingerprint image to be identified according to the first fingerprint template in the second security environment in the first time period.
The fingerprint identification system according to claim 14, wherein the second fingerprint identification module is further used for:

In the second time period, perform the second fingerprint identification processing on the fingerprint image to be identified according to the second fingerprint template in the second security environment, wherein the second time period is later than the The first time period.
The fingerprint identification system according to claim 15, wherein the second fingerprint identification module is specifically configured to:

Based on the fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized in the first secure environment according to the second fingerprint template, in the second secure environment according to the second fingerprint The template performs the second fingerprint identification processing on the fingerprint image to be identified.
The fingerprint identification system according to claim 16, wherein the second fingerprint identification module is further used for:

Acquiring, from the shared memory, a fingerprint recognition result of performing the first fingerprint recognition processing on the fingerprint image to be recognized according to the second fingerprint template.
The fingerprint identification system according to any one of claims 14 to 17, wherein the first fingerprint identification module is further used for:

After performing the first fingerprint identification process on the fingerprint image to be identified according to the second fingerprint template, the fingerprint identification result of the first fingerprint identification process is stored in a shared memory.
The fingerprint identification system according to any one of claims 14 to 18, wherein the fingerprint identification system further comprises:

The control module is configured to send a first control instruction to the first fingerprint identification module, where the first control instruction is used to instruct the first fingerprint identification module to perform according to the second fingerprint template in the first security environment Performing the first fingerprint identification processing on the fingerprint image to be identified; and

Send a second control instruction to the second fingerprint identification module, where the second control instruction is used to instruct the second fingerprint identification module to perform the identification according to the first fingerprint template in the second security environment The fingerprint image undergoes the first fingerprint identification process.
The fingerprint identification system according to any one of claims 14 to 19, wherein if the first fingerprint template is the first fingerprint template, the second fingerprint identification module is further configured to:

In the first time period, the first fingerprint identification process is performed on the fingerprint image to be identified according to the first fingerprint template in the second security environment.
The fingerprint identification system according to any one of claims 14 to 20, wherein the first fingerprint identification process is a coarse matching process, the second fingerprint identification process is a fine matching process, and the coarse matching process is It includes matching according to the characteristic information of the fingerprint template and the characteristic information of the fingerprint image to be recognized, and the fine matching processing includes performing minutiae matching according to the fingerprint information in the matching area of the fingerprint template and the fingerprint image to be recognized.
The fingerprint identification system according to claim 21, wherein the first fingerprint identification module is specifically configured to:

Extracting the feature information of the second fingerprint template and the feature information of the fingerprint image to be identified;

The feature information of the second fingerprint template and the feature information of the fingerprint image to be recognized are matched to obtain a similarity matrix, and the values in the similarity matrix are used to indicate the second fingerprint template and the to-be-recognized The similarity of the corresponding feature points of the fingerprint image.
The fingerprint identification system according to claim 21 or 22, wherein the second fingerprint identification module is specifically configured to:

Determining a matching area between the first fingerprint template and the fingerprint image to be recognized according to the similarity matrix between the first fingerprint template and the fingerprint image to be recognized;

Matching the first fingerprint template with the corresponding pixels in the matching area of the fingerprint image to be identified to obtain matching degree data;

According to the matching degree data, the fingerprint recognition result is determined.
The fingerprint identification system according to claim 23, wherein the second fingerprint identification module is specifically configured to:

If the matching degree data is greater than or equal to a specific threshold, it is determined that the pattern recognition is successful; or

If the matching degree data is less than the specific threshold, it is determined that the fingerprint recognition fails.
The fingerprint identification system according to any one of claims 14 to 24, wherein the difference between the time consumption of the second fingerprint identification process and the time consumption of the first fingerprint identification process is less than a first time threshold .
The fingerprint identification system according to any one of claims 14 to 25, wherein the first security environment is a SecureDsp environment, and the second security environment is a TrustZone environment.
An electronic device, characterized by comprising the fingerprint identification system according to any one of claims 14 to 26.