CN109496312B

CN109496312B - Biological feature recognition method and device and electronic equipment

Info

Publication number: CN109496312B
Application number: CN201880002031.7A
Authority: CN
Inventors: 青小刚; 杨乐; 李顺展
Original assignee: Shenzhen Goodix Technology Co Ltd
Current assignee: Shenzhen Goodix Technology Co Ltd
Priority date: 2018-10-15
Filing date: 2018-10-15
Publication date: 2022-02-15
Anticipated expiration: 2038-10-15
Also published as: WO2020077490A1; CN109496312A

Abstract

The application provides a biological feature recognition method and device and electronic equipment, which can realize biological feature recognition under a strong infrared light scene based on an optical fingerprint technology under a screen. The biological feature recognition method comprises the following steps: acquiring first optical signals respectively acquired by an optical sensor in a plurality of scanning areas within first exposure time, wherein the first exposure time is less than a first threshold value; and determining a light supplement mode of the optical sensor during biological feature recognition according to the first optical signals respectively acquired in the plurality of scanning areas.

Description

Biological feature recognition method and device and electronic equipment

Technical Field

The present application relates to the field of biometric identification, and more particularly, to a biometric identification method, apparatus, and electronic device.

Background

With the rapid development of the electronic device industry, especially the rapid development of mobile communication devices (e.g., mobile phones), people pay more attention to the biometric identification technology, and the practicability of the more convenient and faster biometric identification technology under the screen, such as the optical fingerprint identification technology under the Liquid Crystal Display (LCD), has become a requirement of the public.

The optical fingerprint technology under the screen selects an infrared lamp for light supplement based on the characteristics of strong infrared light penetrability and invisibility. The mobile communication device has a rich application scene, can follow the user to appear in scenes such as high temperature, low temperature, outdoors and the like, particularly has strong sunlight in outdoor scenes, for example, the intensity can reach 12 million LUX (LUX) in summer, and simultaneously, the sunlight contains a large amount of infrared light wavelengths. In a scene with strong sunlight, the optical sensor may not work normally due to overexposure caused by strong infrared light, and the optical fingerprint identification is influenced.

Therefore, how to realize the off-screen optical fingerprint technology in the strong infrared light scene becomes a technical problem to be solved urgently.

Disclosure of Invention

The application provides a biological feature recognition method and device and electronic equipment, which can realize biological feature recognition under a strong infrared light scene based on an optical fingerprint technology under a screen.

In a first aspect, a biometric identification method is provided, including:

acquiring first optical signals respectively acquired by an optical sensor in a plurality of scanning areas within first exposure time, wherein the first exposure time is less than a first threshold value;

and determining a light supplement mode of the optical sensor during biological feature recognition according to the first optical signals respectively acquired in the plurality of scanning areas.

Alternatively, the biometric characteristic may be a fingerprint.

It should be noted that the first exposure time is short, so as to achieve the purpose of rapidly acquiring the first optical signal, thereby improving the user experience.

Alternatively, the biometric identification method may be applied to a strong sunlight environment.

Therefore, in the biometric identification method provided by the embodiment of the application, the light supplement mode of the optical sensor during biometric identification can be determined based on the optical signals respectively collected in the plurality of scanning areas within a short exposure time, so that different light supplement modes can be flexibly selected based on the optical signals, and further, the problem that the optical sensor cannot normally work due to overexposure caused by strong infrared light is avoided.

In some possible implementations, the method further includes:

the plurality of scanning areas are configured, and each scanning area in the plurality of scanning areas corresponds to a plurality of pixel points of the optical sensor.

Therefore, in the embodiment of the present application, the scanning area can be flexibly configured, and at the same time, the optical sensor also supports the fast scanning function.

In some possible implementations, the plurality of scan areas equally divide the light-sensing surface of the optical sensor.

When the light-sensitive surfaces of the optical sensors are equally divided among the plurality of scanning areas, the light supplement mode of the optical sensors during biometric identification can be more easily determined based on the light signals respectively collected in the plurality of scanning areas.

In some possible implementations, the plurality of scanning areas are arranged on the light-sensing surface of the optical sensor in a checkerboard pattern.

In some possible implementations, the method further includes: the first exposure time is configured.

Therefore, the first exposure time can be flexibly configured, so that the first exposure time can be made short enough to meet the requirement of acquiring the first optical signal by fast scanning.

In some possible implementations, the first threshold is 10 milliseconds.

In some possible implementations, the supplementary lighting mode includes external strong light supplementary lighting and infrared supplementary lighting light source supplementary lighting.

In some possible implementations, the method further includes:

when the optical sensor collects a first optical signal within the first exposure time, the optical sensor is configured to be started to expose and the infrared light supplementing source is configured to be closed.

It should be noted that, when the configuration turns on the exposure of the optical sensor and turns off the infrared light supplement light source, external strong light may supplement light to the optical sensor.

In some possible implementations, the determining, according to the first optical signals respectively collected in the plurality of scanning areas, a light supplement mode of the optical sensor during biometric identification includes:

averaging the first light signals collected in each of the plurality of scanning areas to obtain a first light intensity of each of the plurality of scanning areas;

determining a first scanning area according to the first light intensity of each scanning area, wherein the first scanning area is the brightest scanning area in the plurality of scanning areas under the first light intensity;

and determining a light supplementing mode of the optical sensor during the biological characteristic identification according to the first light intensity of the first scanning area.

It should be understood that each scanning area corresponds to a plurality of pixels, each pixel collects a first light signal, and the average value of the first light signals collected by the plurality of pixels is the first light intensity of each scanning area.

For example, the scanning area a corresponds to 25 pixels, each pixel collects one light signal X, and the light intensity Y of the scanning area a can be obtained by averaging the 25 light signals X collected by the 25 pixels.

In some possible implementations, before averaging the first light signals acquired in each of the plurality of scan areas, the method further includes:

and performing dead pixel removing processing on the first optical signals collected in each scanning area.

The dead pixel can be understood as a pixel point where the collected first optical signal is abnormal.

It should be noted that the dead pixel removing process is to remove the first optical signals collected by some pixels with abnormal optical signal collection in each scanning area, and these dead pixels are not considered when averaging.

For example, the scanning area a corresponds to 25 pixels, and each pixel collects one light signal X, where the light signals X collected by the pixels 3, 5, and 12 are abnormal, and then the 22 light signals X collected by the 22 pixels except the pixels 3, 5, and 12 are averaged to obtain the light intensity Y of the scanning area a.

It should be understood that when the light signals X collected by the pixel 3, the pixel 5, and the pixel 12 are obviously different from the light signals X collected by the surrounding pixels, it can be considered that the light signals X collected by the pixel 3, the pixel 5, and the pixel 12 are abnormal.

In some possible implementations, the method further includes:

if the first scanning area is located at the edge position of the photosensitive surface of the optical sensor, the brightest scanning area is determined again in the scanning areas except the first scanning area.

Alternatively, if the first scanning area is located at the edge of the photosensitive surface of the optical sensor, it may be determined that the finger is not fully pressed or strong light is incident through the edge, and at this time, the external light intensity (ambient light intensity) cannot be determined through the brightest scanning area.

In some possible implementations, the determining, according to the first light intensity of the first scanning area, a fill-in mode of the optical sensor when performing biometric identification includes:

according to the formula

Determining a second exposure time, wherein T represents the second exposure time, Vm represents the target light intensity of the linear region, Vn represents the first light intensity of the brightest scanning region, and Dk represents the reference light intensity of the optical sensor;

if the second exposure time is less than or equal to a second threshold, determining that the optical sensor adopts external strong light for light supplement when performing biological feature recognition, or

And if the second exposure time is greater than a second threshold value, determining that the optical sensor adopts an infrared light supplement light source for light supplement when the biological feature recognition is carried out.

It should be understood that Vm and Dk are known parameters.

In some possible implementations, if the second exposure time is less than or equal to a second threshold, the method further includes:

and determining the second exposure time as the exposure time of the optical sensor when the biological characteristic identification is carried out.

In some possible implementations, the method further includes:

and the optical sensor is configured to acquire an optical signal bearing biological characteristic information within the second exposure time in an external strong light supplementing mode.

In some possible implementations, if the second exposure time is greater than a second threshold, the method further includes:

configuring and starting the exposure of the optical sensor and the light supplement of an infrared light supplement light source;

acquiring second optical signals respectively acquired by the optical sensor in the plurality of scanning areas within the first exposure time;

averaging the second light signals collected in each of the plurality of scanning areas to obtain a second light intensity of each of the plurality of scanning areas;

determining a second scanning area according to the second light intensity of each scanning area, wherein the second scanning area is the brightest scanning area in the plurality of scanning areas under the second light intensity;

and determining a third exposure time for the optical sensor to perform biological feature recognition according to the second light intensity of the second scanning area.

In some possible implementations, before averaging the second light signals acquired in each of the plurality of scan areas, the method further includes:

and performing dead pixel removing processing on the second optical signals collected in each scanning area.

In some possible implementations, the method further includes:

if the second scanning area is located at the edge position of the photosensitive surface of the optical sensor, the brightest scanning area is determined again in the scanning areas except the second scanning area.

In some possible implementations, the determining a third exposure time for biometric identification by the optical sensor based on the light intensity of the second scanning area includes:

according to the formula

Is determined to beAnd three exposure times, wherein T 'represents a third exposure time, Vm represents a target light intensity of a linear region, Vn' represents a second light intensity of a brightest scanning region, and Dk represents a reference light intensity of the optical sensor.

In some possible implementation manners, the infrared light supplement light source works in a direct current driving manner, and when light supplement is performed, the infrared light supplement light source is driven based on the maximum current.

In some possible implementations, the method further includes:

and configuring the optical sensor to acquire an optical signal bearing the biological characteristic information within the third exposure time by adopting an infrared light supplementing light source light supplementing mode.

Therefore, in the biometric identification method provided by the embodiment of the application, the exposure time of the optical sensor during biometric identification can be determined based on the optical signals respectively collected in the plurality of scanning areas within a shorter exposure time, so that the exposure time can be accurately determined based on the optical signals, and further, the biometric identification efficiency is increased.

In a second aspect, there is provided a biometric identification apparatus comprising:

the device comprises an acquisition unit, a processing unit and a control unit, wherein the acquisition unit is used for acquiring first optical signals respectively acquired by an optical sensor in a plurality of scanning areas within a first exposure time, and the first exposure time is less than a first threshold value;

and the processing unit is used for determining a light supplement mode of the optical sensor during biological feature recognition according to the first optical signals respectively acquired in the plurality of scanning areas.

In some possible implementations, the processing unit is further configured to configure the plurality of scanning areas, and each of the plurality of scanning areas corresponds to a plurality of pixel points of the optical sensor.

In some possible implementations, the processing unit is further configured to configure the first exposure time.

In some possible implementations, the first threshold is 10 milliseconds.

In some possible implementations, the processing unit is further configured to turn on the optical sensor to expose and turn off the infrared fill light source when the optical sensor collects the first light signal within the first exposure time.

In some possible implementations, the processing unit is specifically configured to:

In some possible implementations, before averaging the first optical signal collected in each of the plurality of scanning areas, the processing unit is further configured to perform a dead-pixel removing process on the first optical signal collected in each of the plurality of scanning areas.

In some possible implementations, the processing unit is further configured to:

according to the formula

In some possible implementations, if the second exposure time is less than or equal to a second threshold, the processing unit is further configured to determine the second exposure time as the exposure time of the optical sensor when performing biometric identification.

In some possible implementations, the processing unit is further configured to configure the optical sensor to acquire the optical signal carrying the biometric information in the second exposure time by using an external bright light fill-in mode.

In some possible implementations, if the second exposure time is greater than a second threshold, the processing unit is further configured to:

controlling the acquisition unit to acquire second optical signals respectively acquired by the optical sensor in the plurality of scanning areas within the first exposure time;

In some possible implementations, before averaging the second optical signals collected in each of the plurality of scanning areas, the processing unit is further configured to perform a dead-pixel removing process on the second optical signals collected in each of the plurality of scanning areas.

In some possible implementations, the processing unit is further configured to:

according to the formula

A third exposure time is determined, where T 'represents the third exposure time, Vm represents the target light intensity of the linear region, Vn' represents the second light intensity of the brightest scanning region, and Dk represents the reference light intensity of the optical sensor.

In some possible implementation manners, the processing unit is further configured to configure the optical sensor to acquire the optical signal carrying the biometric information within the third exposure time by using an infrared fill-in light source fill-in light mode.

In a third aspect, an electronic device is provided, including:

an optical sensor for acquiring an optical signal;

the infrared light supplementing light source is used for performing infrared light supplementing on the optical sensor; and

a controller comprising a memory for storing programs and data and a processor for invoking and executing the programs and data stored in the memory, the controller configured to:

the method of the first aspect or any possible implementation thereof is performed.

In a fourth aspect, there is provided a biometric identification apparatus comprising:

an optical sensor for acquiring an optical signal carrying biometric information;

and the optical filter is used for filtering the infrared light outside the first waveband before the optical sensor acquires the optical signal bearing the biological characteristic information.

It should be noted that the biometric identification device can be applied to a strong sunlight environment.

In some possible implementations, the optical sensor has a sensitivity in the first band that is greater than the sensitivity of the other bands.

In some possible implementations, the first wavelength band is a 940nm wavelength band.

In some possible implementations, the optical sensor uses an infrared fill-in light source for fill-in light.

In some possible implementations, the biometric device is applied to face recognition or fingerprint recognition.

In a fifth aspect, a chip is provided, where the chip includes an input/output interface, at least one processor, at least one memory, and a bus, where the at least one memory is used to store instructions, and the at least one processor is used to call the instructions in the at least one memory to perform the first aspect or the method in any possible implementation manner of the first aspect.

In a sixth aspect, there is provided an electronic device comprising a chip as in the fifth aspect.

In a seventh aspect, a computer storage medium is provided, in which program code is stored, and the program code can be used to instruct the execution of the method in the first aspect or any possible implementation manner thereof.

In an eighth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the first aspect described above or any possible implementation thereof.

Based on the technical scheme, the biological feature recognition scheme provided by the embodiment of the application can determine the light supplement mode and the exposure time of the optical sensor during biological feature recognition based on the light signals respectively collected in the scanning areas within the short exposure time, so that the light supplement mode can be flexibly selected based on the light signals, the exposure time can be accurately determined, further, the problem that the optical sensor cannot normally work due to overexposure caused by strong infrared light is avoided, and the biological feature recognition efficiency is increased.

Drawings

Fig. 1 is a schematic diagram of an application scenario according to an embodiment of the present application.

Fig. 2 is a schematic flow chart of a biometric identification method according to an embodiment of the present application.

FIG. 3 is a schematic diagram of a plurality of scan regions according to an embodiment of the present application.

Fig. 4 is a flow diagram of biometric identification according to an embodiment of the application.

Fig. 5 is a schematic block diagram of a biometric apparatus according to an embodiment of the present application.

FIG. 6 is a schematic block diagram of an electronic device according to an embodiment of the present application.

Fig. 7 is a schematic block diagram of another biometric device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application.

It should be understood that the embodiments of the present application can be applied to fingerprint systems, including but not limited to optical, ultrasonic or other fingerprint identification systems and medical diagnostic products based on optical, ultrasonic or other fingerprint imaging, and the embodiments of the present application are only illustrated by way of example of an optical fingerprint system, but should not constitute any limitation to the embodiments of the present application, and the embodiments of the present application are also applicable to other systems using optical, ultrasonic or other imaging technologies, and the like.

It should also be understood that, the technical solution of the embodiment of the present application may perform other biometric identification besides fingerprint identification, for example, living body identification, and the like, which is also not limited in the embodiment of the present application.

As a common application scenario, the optical fingerprint system provided by the embodiment of the application can be applied to smart phones, tablet computers and other mobile terminals or other terminal devices with display screens; more specifically, in the terminal device, the fingerprint acquisition device may be embodied as an optical fingerprint device, which may be disposed in a partial area or an entire area below the display screen, thereby forming an Under-screen (Under-display) optical fingerprint system.

As shown in fig. 1, which is a schematic structural diagram of a terminal device to which the embodiment of the present application may be applied, the terminal device 100 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is disposed in a local area below the display screen 120. The optical fingerprint device 130 includes a sensing array having a plurality of optical sensing units, and the sensing array is located in a fingerprint detection area 103 of the optical fingerprint device 130. As shown in fig. 1, the fingerprint detection area 103 is located in the display area 102 of the display screen 120, so that when a user needs to unlock or otherwise verify the fingerprint of the terminal device, the user only needs to press a finger on the fingerprint detection area 103 located on the display screen 120 to input the fingerprint. Since fingerprint detection can be implemented in the screen, the terminal device 100 adopting the above structure does not need a special reserved space on the front surface thereof to set a fingerprint key (such as a Home key), and thus a full-screen scheme can be adopted, that is, the display area of the display screen 120 can be basically extended to the whole front surface of the terminal device 100.

The Display 120 may be a Liquid Crystal Display (LCD) or other passive light emitting Display.

Optionally, the display screen 120 may be a touch display screen, which not only performs image display, but also detects a touch or pressing operation of a user, so as to provide a human-computer interaction interface for the user. For example, in an embodiment, the terminal device 100 may include a Touch sensor, which may be embodied as a Touch Panel (TP), and may be disposed on a surface of the display screen 120, or may be partially integrated or entirely integrated inside the display screen 120, so as to form the Touch display screen.

It should be appreciated that in particular implementations, the terminal device 100 also includes a transparent protective cover plate, which may be a glass cover plate or a sapphire cover plate, positioned over the display screen 120 and covering the front face of the terminal device 100. Because, in the present embodiment, the pressing of the finger on the display screen 120 actually means pressing on the cover plate above the display screen 120 or the surface of the protective layer covering the cover plate.

As an alternative implementation, as shown in fig. 1, the optical fingerprint device 130 includes at least one light detecting portion 134 and a plurality of optical components 132, the light detecting portion 134 includes the sensing array and the reading circuit and other auxiliary circuits electrically connected to the sensing array, which can be fabricated on a chip (Die) through a semiconductor process; the optical element 132 may be disposed above the sensing array of the light detecting portion 134, and may specifically include a Filter layer (Filter) for filtering ambient light penetrating through the finger, a light guiding layer for guiding the reflected light reflected from the surface of the finger to the sensing array for optical detection, and other optical elements.

In particular implementations, the plurality of optical components 132 may be packaged with the at least one light detecting portion 134 on the same optical fingerprint chip. The light guide layer may be a Lens (Lens) layer made of a semiconductor silicon wafer, and has a plurality of Lens units. When a finger presses the fingerprint detection area 103 of the display screen 120, the light signal emitted by the light source is reflected on the surface of the finger to form a reflected light, and the reflected light reflected from the finger is received by the optical sensing unit below the lens unit, so that the sensing array can detect the fingerprint image of the finger.

Optionally, as shown in fig. 1, the terminal device 100 further includes an infrared supplementary lighting light source 140, where the infrared supplementary lighting light source 140 may be, for example, an infrared lamp, and is used for performing infrared supplementary lighting when the optical fingerprint apparatus 130 is exposed. It should be understood that the position of the infrared fill-in light source 140 in fig. 1 is merely an example, and the infrared fill-in light source 140 may also be located at other positions, which is not limited in this embodiment of the present application.

It should be understood that in the embodiments of the present application, the optical Sensor may also be referred to as an image Sensor (Sensor), or a photosensor, and may be fabricated as a chip (DIE) through a semiconductor process, i.e., the DIE includes the image Sensor.

It should still understand, optical sensor in this application embodiment also can be called optical fingerprint device, optical fingerprint identification module, fingerprint device, fingerprint identification module, fingerprint collection device etc..

It should be further understood that the biometric feature recognition scheme in the embodiment of the present application is suitable for using an infrared light supplement optical fingerprint system, including fields such as fingerprint access control, fingerprint card readers, fingerprint mobile phones under screens, face recognition mobile phones, living body recognition mobile phones, computers, automobiles, and the like, and different environments can be adapted by adjusting a light supplement mode, light supplement intensity, and exposure time under strong light.

Fig. 2 is a schematic flow chart of a biometric method 200 according to an embodiment of the application, as shown in fig. 2, the method 200 including:

s210, acquiring first optical signals respectively acquired by the optical sensor in a plurality of scanning areas within first exposure time, wherein the first exposure time is less than a first threshold value;

and S220, determining a light supplement mode of the optical sensor during biological feature recognition according to the first optical signals respectively collected in the plurality of scanning areas.

Alternatively, the method 200 may be applied to a strong sunlight environment.

It should be understood that, in the embodiment of the present application, the method 200 may be performed by an electronic device, in particular, the method 200 may be performed by a controller (Host) (e.g., a micro programmed Control Unit (MCU)) or a processor (e.g., a Central Processing Unit (CPU)) in the electronic device, the method 200 may also be performed by a specific software controlled by the controller or the processor, the electronic device may include an optical sensor, the optical sensor may correspond to the optical fingerprint apparatus 130 in fig. 1, a plurality of optical sensors may be included in the method 200, and the method may be used to realize large-area fingerprint identification.

The method 200 is specifically described below by taking as an example that the method is executed by a controller in the electronic device.

In the embodiment of the application, a proper light supplement mode is selected, so that most of the area of the optical sensor works in a linear area, and therefore biological characteristic information can be correctly acquired.

Optionally, in some embodiments, the controller may configure the plurality of scanning areas, and each of the plurality of scanning areas corresponds to a plurality of pixel points of the optical sensor.

For example, the controller may configure 5 × 5 scan regions, each corresponding to 10 × 10 pixels.

That is, in the embodiment of the present application, the controller can flexibly configure the scanning area, and at the same time, the optical sensor also supports the fast scanning function.

It should be noted that only reading the first optical signals in the plurality of scanning areas avoids reading the first optical signals on the entire optical sensor, so that the speed of reading the sensor and the speed of processing the first optical signals can be increased, and the efficiency of determining the light supplement mode is increased.

Optionally, the plurality of scanning areas equally divide the photosensitive surface of the optical sensor. Specifically, the light sensing surface of the optical sensor may be equally divided into a plurality of regular scanning areas. For example, the light sensing surface of the optical sensor is equally divided into a plurality of circular scanning areas. For another example, the light-sensing surface of the optical sensor is equally divided into a plurality of square scanning areas.

For another example, as shown in fig. 3, the plurality of scanning areas are arranged on the light-sensing surface of the optical sensor in a checkerboard pattern.

It should be noted that the first optical signal may or may not carry the biometric information.

It should be understood that when the plurality of scanning areas equally divide the light-sensing surface of the optical sensor, the light supplement mode of the optical sensor during biometric identification can be more easily determined based on the light signals respectively collected in the plurality of scanning areas.

Optionally, in some embodiments, the controller may configure the first exposure time.

In other words, the first exposure time can be flexibly configured, so that the first exposure time can be made short enough to meet the requirement of fast scanning and acquiring the first optical signal.

Optionally, in some embodiments, the first threshold is 10 milliseconds. I.e., the first exposure time is ≦ 10 msec.

Optionally, in some embodiments, the supplementary lighting manner includes external bright light supplementary lighting and infrared supplementary lighting light source supplementary lighting.

Optionally, in some embodiments, the controller is configured to turn on the optical sensor to expose and turn off the infrared fill light source when the optical sensor collects the first light signal within the first exposure time.

It should be noted that, when the controller is configured to turn on the exposure of the optical sensor and turn off the infrared light supplement source, external strong light may supplement light to the optical sensor.

Specifically, in the embodiment of the present application, the controller may determine a light supplement manner of the optical sensor during biometric identification according to the following manner:

Optionally, in some embodiments, before averaging the first optical signal collected in each of the plurality of scanning areas, the controller performs a dead-pixel removal process on the first optical signal collected in each of the plurality of scanning areas.

Optionally, in some embodiments, if the first scanning area is located at an edge position of the photosensitive surface of the optical sensor, the controller re-determines a brightest scanning area in scanning areas other than the first scanning area among the plurality of scanning areas.

Optionally, when a portion of the first scanning area greater than a certain threshold is located at an edge position of the photosensitive surface of the optical sensor, it may be determined that the first scanning area is located at the edge position of the photosensitive surface of the optical sensor.

It should be understood that if the first scanning area is located at the edge of the photosensitive surface of the optical sensor, it can be determined that the finger is not fully pressed or strong light is incident through the edge, and at this time, the external light intensity (ambient light intensity) cannot be determined through the brightest scanning area.

determining a second exposure time according to equation 1;

Where T denotes a second exposure time, Vm denotes a target light intensity of a linear region, Vn denotes a first light intensity of a brightest scanning region, and Dk denotes a reference light intensity of the optical sensor.

It should be understood that Vm and Dk are known parameters.

Optionally, in some embodiments, if the second exposure time is less than or equal to a second threshold, the controller determines the second exposure time as the exposure time of the optical sensor when performing biometric identification.

That is, when it is determined that the optical sensor performs light compensation using external strong light at the time of biometric recognition, the controller determines the second exposure time as the exposure time of the optical sensor at the time of biometric recognition.

Optionally, in some embodiments, the controller configures the optical sensor to acquire the optical signal carrying the biometric information in the second exposure time by using an external fill-in light.

Optionally, in some embodiments, if the second exposure time is greater than the second threshold, the controller may determine the exposure time when the infrared fill-in light source is used for light fill-in according to the following manner:

Optionally, the controller performs a dead-pixel removing process on the second optical signal collected in each of the plurality of scanning areas before averaging the second optical signal collected in each of the plurality of scanning areas.

Optionally, in some embodiments, if the second scanning area is located at an edge position of the photosensitive surface of the optical sensor, the controller re-determines a brightest scanning area in scanning areas other than the second scanning area among the plurality of scanning areas.

Optionally, when a portion of the second scanning area greater than a certain threshold is located at an edge position of the photosensitive surface of the optical sensor, it may be determined that the second scanning area is located at the edge position of the photosensitive surface of the optical sensor.

Specifically, in the embodiment of the present application, the controller may determine the third exposure time for biometric recognition by the optical sensor according to the following manner:

the third exposure time is determined according to equation 2.

Where T 'denotes a third exposure time, Vm denotes a target light intensity of a linear region, Vn' denotes a second light intensity of a brightest scanning region, and Dk denotes a reference light intensity of the optical sensor.

Optionally, in some embodiments, the infrared light supplement light source operates in a direct current driving manner, and is driven based on a maximum current when light supplement is performed.

Optionally, in some embodiments, the controller configures the optical sensor to acquire the optical signal carrying the biometric information within the third exposure time by using an infrared fill-in light source fill-in light mode.

Alternatively, as an embodiment, as shown in fig. 4, the biometric identifier 300 may include the following steps:

s301, configuring a first exposure time.

Optionally, the first exposure time is less than a first threshold, for example, the first threshold is 10 milliseconds.

S302, a plurality of scanning regions are arranged.

It should be noted that each of the plurality of scanning regions corresponds to a plurality of pixels of the optical sensor.

Optionally, the plurality of scanning areas equally divide the photosensitive surface of the optical sensor.

For example, the plurality of scanning areas are arranged on the light-sensing surface of the optical sensor in a checkerboard manner.

S303, a first optical signal is obtained.

Specifically, first optical signals respectively acquired by an optical sensor in a plurality of scanning areas in a first exposure time are acquired.

It should be noted that, when the first optical signal is acquired, the optical sensor is configured to be turned on to expose and the infrared fill-in light source is configured to be turned off.

S304, a first scanning area is determined.

In particular, the first scanning area (not shown in fig. 4) may be determined by:

s3041, performing a dead-pixel removing process on the first optical signal collected in each of the plurality of scanning areas;

s3042, averaging the first optical signals collected in each of the plurality of scanning areas to obtain a first light intensity of each of the scanning areas;

s3043, determining a first scanning area according to the first light intensity of each scanning area, where the first scanning area is the brightest scanning area in the plurality of scanning areas under the first light intensity.

It should be noted that the first scanning area is a scanning area with the largest first light intensity among the plurality of scanning areas.

S305, determining whether the first scanning area is located at an edge position.

Specifically, whether the first scanning area is located at the edge position of the photosensitive surface of the optical sensor is judged.

If the first scanning area is located at the edge position, executing S306-S307, otherwise, executing S307.

S306, the brightest scanning area under the first light intensity is determined again.

Specifically, the brightest scanning area is newly determined in the scanning areas other than the first scanning area among the plurality of scanning areas.

And S307, determining a second exposure time.

Specifically, the second exposure time is determined according to the above equation 1.

S308, judging whether the second exposure time is larger than a second threshold value.

If the second exposure time is less than or equal to the second threshold, executing S309-S310; if the second exposure time is greater than the second threshold, S311-S316 are performed.

And S309, supplementing light by adopting external strong light.

Specifically, the optical sensor adopts external strong light for light supplement when biological feature recognition is carried out.

And S310, determining the second exposure time as the exposure time of the optical sensor during the biometric identification.

And S311, performing supplementary lighting by using an infrared supplementary lighting light source.

Specifically, the optical sensor adopts an infrared light supplement light source for supplementing light when biological feature recognition is carried out.

S312, a second optical signal is obtained.

Specifically, second optical signals respectively acquired by the optical sensor in a plurality of scanning areas in the first exposure time are acquired.

It should be noted that, when the second optical signal is acquired, the optical sensor is configured to be turned on for exposure and the infrared light supplement light source is configured to supplement light.

Optionally, the infrared light supplement light source works in a direct current driving mode, and when light supplement is performed, the infrared light supplement light source is driven based on the maximum current.

S313, a second scanning area is determined.

In particular, the second scanning area (not shown in fig. 4) may be determined by:

s3131, performing a dead pixel removing process on the second optical signal collected in each of the plurality of scanning areas;

s3132, averaging the second light signals collected in each of the plurality of scanning areas to obtain a second light intensity of each of the plurality of scanning areas;

s3133, determining a second scanning area, which is a brightest scanning area of the plurality of scanning areas at the second light intensity, according to the second light intensity of each scanning area.

It should be noted that the second scanning area is a scanning area with the largest second light intensity among the plurality of scanning areas.

S314, judging whether the second scanning area is located at the edge position.

Specifically, whether the second scanning area is located at the edge of the photosensitive surface of the optical sensor is determined.

If the second scanning area is located at the edge position, S315-S316 are executed, otherwise, S316 is executed.

And S315, re-determining the brightest scanning area under the second light intensity.

Specifically, the brightest scanning region is newly determined in the scanning regions other than the second scanning region among the plurality of scanning regions.

And S316, determining a third exposure time.

It should be noted that the third exposure time is an exposure time for the optical sensor to perform biometric identification when the infrared fill-in light source is used for performing fill-in.

Specifically, the third exposure time is determined according to the above formula 2.

And S317, collecting the optical signal carrying the biological characteristic information.

Optionally, if step S310 is executed, the optical sensor is configured to acquire the optical signal carrying the biometric information within the second exposure time by using an external strong light supplement manner.

Optionally, if step S316 is executed, the optical sensor is configured to acquire the optical signal carrying the biometric information within the third exposure time by using an infrared fill-in light source fill-in light mode.

Therefore, the biological feature recognition scheme provided by the embodiment of the application can determine the light supplement mode and the exposure time of the optical sensor during biological feature recognition based on the optical signals respectively collected in the scanning areas within the shorter exposure time, so that the light supplement mode can be flexibly selected based on the optical signals, the exposure time can be accurately determined, further, the problem that the optical sensor cannot normally work due to overexposure caused by strong infrared light is avoided, and the biological feature recognition efficiency is increased.

Fig. 5 is a schematic block diagram of a biometric recognition apparatus 400 according to an embodiment of the present application, and as shown in fig. 5, the biometric recognition apparatus 400 includes:

an obtaining unit 410, configured to obtain first optical signals respectively collected by the optical sensor in the multiple scanning areas within a first exposure time, where the first exposure time is less than a first threshold;

the processing unit 420 is configured to determine a light supplement mode of the optical sensor during biometric identification according to the first optical signals respectively collected in the plurality of scanning areas.

Optionally, the processing unit 420 is further configured to configure the plurality of scanning areas, and each of the plurality of scanning areas corresponds to a plurality of pixel points of the optical sensor.

Optionally, the plurality of scanning areas are arranged on the light-sensing surface of the optical sensor in a checkerboard pattern.

Optionally, the processing unit 420 is further configured to configure the first exposure time.

Optionally, the first threshold is 10 milliseconds.

Optionally, the supplementary lighting mode includes external strong light supplementary lighting and infrared supplementary lighting light source supplementary lighting.

Optionally, the processing unit 420 is further configured to turn on the optical sensor for exposure and turn off the infrared fill light source when the optical sensor collects the first light signal within the first exposure time.

Optionally, the processing unit 420 is specifically configured to:

Optionally, before averaging the first optical signals collected in each of the plurality of scanning areas, the processing unit 420 is further configured to perform a dead-pixel removing process on the first optical signals collected in each of the plurality of scanning areas.

Optionally, the processing unit 420 is further configured to:

Optionally, the processing unit 420 is specifically configured to:

according to the formula

Optionally, if the second exposure time is less than or equal to a second threshold, the processing unit 320 is further configured to determine the second exposure time as the exposure time of the optical sensor during biometric identification.

Optionally, the processing unit 420 is further configured to configure the optical sensor to acquire an optical signal carrying the biometric information within the second exposure time by using an external strong light supplement manner.

Optionally, if the second exposure time is greater than a second threshold, the processing unit 420 is further configured to:

controlling the obtaining unit 410 to obtain second optical signals respectively collected by the optical sensor in the plurality of scanning areas within the first exposure time;

Optionally, before averaging the second optical signals collected in each of the plurality of scanning areas, the processing unit 420 is further configured to perform a dead-pixel removing process on the second optical signals collected in each of the plurality of scanning areas.

Optionally, the processing unit 420 is further configured to:

Optionally, the processing unit 420 is specifically configured to:

according to the formula

Optionally, the processing unit 420 is further configured to configure the optical sensor to acquire the optical signal carrying the biometric information within the third exposure time by using an infrared fill-in light source fill-in light mode.

Fig. 6 is a schematic block diagram of an electronic device 500 according to an embodiment of the application, as shown in fig. 6, the electronic device 500 comprising:

an optical sensor 510 for acquiring an optical signal;

an infrared supplementary lighting light source 520, configured to perform infrared supplementary lighting on the optical sensor; and

a controller 530 comprising a memory 531 for storing programs and data and a processor 532 for invoking and executing the programs and data stored in the memory, the controller configured to: the method illustrated in fig. 2 to 4 described above is performed.

Fig. 7 is a schematic block diagram of a biometric apparatus 600 according to an embodiment of the present application, and as shown in fig. 7, the biometric apparatus 600 includes:

an optical sensor 610 for acquiring an optical signal carrying biometric information;

and an optical filter 620 for filtering out the infrared light outside the first wavelength band before the optical sensor acquires the optical signal carrying the biometric information.

Optionally, the optical sensor has a sensitivity in the first band that is greater than the sensitivity of the other bands.

Optionally, the first wavelength band is a 940nm wavelength band.

It should be noted that in the solar spectrum, the infrared light intensity at the 940nm wavelength band is significantly weaker than the infrared light intensity at the wavelength band around the 940nm wavelength band (for example, 800nm to 1000nm), that is, at the 940nm wavelength band, even if the surroundings are in a strong sunlight environment, the influence of the infrared light supplement on the optical sensor 610 is weak, and the optical sensor 610 can still work in a linear region.

Therefore, biological characteristic collection is carried out at the 940nm wave band, and the effect of resisting ambient strong light can be achieved.

Alternatively, the biometric device is applied to face recognition or fingerprint recognition.

Optionally, the optical sensor performs light supplement by using an infrared light supplement light source.

Alternatively, the biometric device 600 may be applied in a high sunlight environment.

It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method embodiments may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic device, discrete hardware component. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.

It will be appreciated that the terminal or electronic device of embodiments of the present application can also include memory, which can be volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of example, but not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double Data Rate Synchronous Dynamic random access memory (DDR SDRAM), Enhanced Synchronous SDRAM (ESDRAM), Synchronous link SDRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

Embodiments of the present application also provide a computer-readable storage medium storing one or more programs, the one or more programs including instructions, which when executed by a portable electronic device including a plurality of application programs, enable the portable electronic device to perform the method of the embodiments shown in fig. 2 to 4.

The embodiments of the present application also provide a computer program, which includes instructions, when the computer program is executed by a computer, the computer may execute the method of the embodiments shown in fig. 2 to fig. 4.

The embodiment of the present application further provides a chip, where the chip includes an input/output interface, at least one processor, at least one memory, and a bus, where the at least one memory is used to store instructions, and the at least one processor is used to call the instructions in the at least one memory to execute the method of the embodiment shown in fig. 2 to 4.

It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A biometric identification method, comprising:

determining a light supplement mode of the optical sensor during biological feature recognition according to the first optical signals respectively collected in the plurality of scanning areas, wherein the light supplement mode comprises external strong light supplement and infrared light supplement;

the method further comprises the following steps:

when the optical sensor collects a first optical signal within the first exposure time, configuring to turn on the optical sensor for exposure and turn off an infrared light supplementing source;

the determining a light supplement mode of the optical sensor during the biometric feature recognition according to the first optical signals respectively collected in the plurality of scanning areas includes:

averaging the first light signals collected in each of the plurality of scanning areas to obtain a first light intensity for each of the plurality of scanning areas,

determining a first scanning area according to the first light intensity of each scanning area, wherein the first scanning area is the brightest scanning area in the plurality of scanning areas under the first light intensity,

and determining a light supplementing mode of the optical sensor during biological feature recognition according to the first light intensity of the first scanning area.

2. The method of claim 1, further comprising:

3. The method of claim 1 or 2, wherein the plurality of scan areas each divide a photosensitive surface of the optical sensor.

4. The method of claim 1 or 2, wherein the plurality of scanning areas are arranged on the light-sensing surface of the optical sensor in a checkerboard pattern.

5. The method according to claim 1 or 2, characterized in that the method further comprises: and configuring the first exposure time.

6. The method according to claim 1 or 2, characterized in that the first threshold value is 10 milliseconds.

7. The method of claim 1 or 2, wherein prior to averaging the acquired first light signals within each of the plurality of scan areas, the method further comprises:

8. The method according to claim 1 or 2, characterized in that the method further comprises:

and if the first scanning area is located at the edge position of the photosensitive surface of the optical sensor, re-determining the brightest scanning area in the scanning areas except the first scanning area in the plurality of scanning areas.

9. The method according to claim 1 or 2, wherein the determining a light supplement mode of the optical sensor during the biometric identification according to the first light intensity of the first scanning area comprises:

according to the formula

if the second exposure time is less than or equal to a second threshold value, determining that the optical sensor adopts external strong light for light supplement when performing biological feature recognition, or

10. The method of claim 9, wherein if the second exposure time is less than or equal to a second threshold, the method further comprises:

and determining the second exposure time as the exposure time of the optical sensor in biometric identification.

11. The method of claim 10, further comprising:

and configuring the optical sensor to acquire an optical signal bearing biological characteristic information within the second exposure time by adopting an external strong light supplementing mode.

12. The method of claim 9, wherein if the second exposure time is greater than a second threshold, the method further comprises:

configuring and starting exposure of the optical sensor and light supplement of an infrared light supplement light source;

13. The method of claim 12, wherein prior to averaging the second light signals acquired in each of the plurality of scan areas, the method further comprises:

14. The method according to claim 12 or 13, characterized in that the method further comprises:

and if the second scanning area is located at the edge position of the photosensitive surface of the optical sensor, re-determining the brightest scanning area in the scanning areas except the second scanning area in the plurality of scanning areas.

15. The method according to claim 12 or 13, wherein determining a third exposure time for biometric identification of the optical sensor based on the light intensity of the second scanning area comprises:

according to the formula

16. The method according to claim 12 or 13,

the infrared light supplementing light source works in a direct current driving mode, and is driven based on the maximum current when light supplementing is carried out.

17. The method according to claim 12 or 13, characterized in that the method further comprises:

18. A biometric identification device, comprising:

the processing unit is used for determining a light supplement mode of the optical sensor during biological feature recognition according to the first optical signals respectively collected in the plurality of scanning areas, wherein the light supplement mode comprises external strong light supplement and infrared light supplement light source supplement;

the processing unit is further used for configuring to turn on the optical sensor for exposure and turn off the infrared light supplementing light source when the optical sensor collects a first light signal within the first exposure time;

the processing unit is specifically configured to:

19. The biometric identification device of claim 18, wherein the processing unit is further configured to configure the plurality of scanning zones, and each scanning zone of the plurality of scanning zones corresponds to a plurality of pixels of the optical sensor.

20. The biometric identification device of claim 18 or 19 wherein the plurality of scan areas each divide a light-sensitive surface of the optical sensor.

21. The biometric apparatus according to claim 18 or 19, wherein the plurality of scanning areas are arranged on the light-sensing surface of the optical sensor in a checkerboard pattern.

22. The biometric identification device of claim 18 or 19, wherein the processing unit is further configured to configure the first exposure time.

23. The biometric identification device of claim 18 or 19, wherein the first threshold is 10 milliseconds.

24. The biometric apparatus according to claim 18 or 19, wherein the processing unit is further configured to perform a dead-pixel processing on the first optical signal acquired in each of the plurality of scanning areas before averaging the first optical signals acquired in each of the plurality of scanning areas.

25. The biometric identification device of claim 18 or 19, wherein the processing unit is further configured to:

26. The biometric apparatus according to claim 18 or 19, wherein the processing unit is specifically configured to:

according to the formula

27. The apparatus according to claim 26, wherein if the second exposure time is less than or equal to a second threshold, the processing unit is further configured to determine the second exposure time as the exposure time of the optical sensor during biometric identification.

28. The apparatus according to claim 27, wherein the processing unit is further configured to configure the optical sensor to acquire the optical signal carrying the biometric information during the second exposure time by using an external fill-in light.

29. The biometric apparatus of claim 26, wherein if the second exposure time is greater than a second threshold, the processing unit is further configured to:

30. The biometric identification device of claim 29, wherein the processing unit is further configured to perform a dead-pixel processing on the second optical signal collected in each of the plurality of scanning areas before averaging the second optical signal collected in each of the plurality of scanning areas.

31. The biometric identification device of claim 29 or 30, wherein the processing unit is further configured to:

32. The biometric apparatus according to claim 29 or 30, wherein the processing unit is specifically configured to:

according to the formula

33. The biometric identification device according to claim 29 or 30,

34. The apparatus according to claim 29 or 30, wherein the processing unit is further configured to configure the optical sensor to acquire the optical signal carrying the biometric information within the third exposure time by using an infrared fill-in light source.

35. An electronic device, comprising:

an optical sensor for acquiring an optical signal;

performing the method of any one of claims 1 to 17.