WO2022126665A1

WO2022126665A1 - Detection apparatus and detection method of biometric information, and electronic device

Info

Publication number: WO2022126665A1
Application number: PCT/CN2020/137796
Authority: WO
Inventors: 丁大禹; 青小刚; 廖志川; 杨小强
Original assignee: 深圳市汇顶科技股份有限公司
Priority date: 2020-12-18
Filing date: 2020-12-18
Publication date: 2022-06-23

Abstract

A detection apparatus and detection method of biometric information, and an electronic device. A detection apparatus (200) of the biometric information is provided below a display screen (170) of an electronic device (10). The detection apparatus (200) comprises: a detection module (210), configured to collect a fingerprint optical signal (112) obtained by reflecting or scattering, by fingers of a user, an optical signal (111) emitted by the display screen (170) so as to obtain at least one frame of first fingerprint image and multiple frames of second fingerprint images, the data volume of the first fingerprint image being greater than that of the second fingerprint images. The at least one frame of first fingerprint image signal is configured to perform fingerprint detection of the user, and the multiple frames of second fingerprint images are configured to obtain a Photo Plethyamo Graphy (PPG) signal for detecting a respiratory frequency of the user. The detection apparatus and detection method of the biometric information, and the electronic device can achieve detection of multiple biometric information and reduce the cost of the electronic device.

Description

Detection device, detection method and electronic device for biometric information

technical field

The present application relates to the field of electronic technology, and more particularly, to a detection device, detection method and electronic device for biometric information.

Background technique

In recent years, with the rapid development of electronic technology, consumers have increased functional requirements for various electronic terminal devices. The role of disease prevention has received widespread attention. For example, respiratory rate is a medical term for the number of breaths per minute, a rise and fall of the chest cavity is a breath, and a breath per minute is the respiratory rate. Respiratory rate is a sensitive indicator of acute respiratory dysfunction, and also an important indicator to measure whether a person's heart function is good or not and whether gas exchange is normal.

At present, in some wearable electronic devices, such as smart watches, a pulse wave detection module is provided on the surface of the electronic device to detect the user's pulse wave signal for analysis and extraction of respiratory rate information. However, in this embodiment, the pulse wave detection module is arranged on the surface of the electronic device, which affects the overall aesthetics of the electronic device, and the separate arrangement of the pulse wave detection module will also increase the cost of the electronic device. In addition, the pulse wave detection module can only realize the detection of biological features related to the pulse wave, and the function is relatively single.

Therefore, a detection device and detection method for biometric information are provided, so as to realize the detection of various biometric information and reduce the cost of the electronic equipment in which the biometric information is located, which has great application prospect and market value.

SUMMARY OF THE INVENTION

The present application provides a biometric information detection device, a detection method and an electronic device, which can realize the detection of various biometric information and reduce the cost of the electronic device.

In a first aspect, a detection device for biometric information is provided, which is arranged below a display screen of an electronic device, and the detection device includes: a detection module, which is used for collecting light signals emitted by the display screen after reflection or reflection by a user's finger. The scattered fingerprint light signal is used to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, the data volume of the first fingerprint image is greater than that of the second fingerprint image, wherein the at least one frame of the first fingerprint image The image signal is used to detect the user's fingerprint, and the multiple frames of the second fingerprint images are used to obtain a photoplethysmography PPG signal to detect the user's breathing frequency.

Through the technical solutions of the embodiments of the present application, the detection module is arranged below the display screen, and the display unit of the display screen is used as the excitation light source, so as to obtain the fingerprint light signal reflected or scattered by the finger above the display screen, and based on the fingerprint light The signal acquires at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, and then performs the user's fingerprint detection based on the at least one frame of the first fingerprint image signal, and acquires the PPG signal based on the multiple frames of the second fingerprint image to detect the user's breathing frequency. , so as to realize the detection of various biometric information of the detection device. In addition, compared with the technical solution of separately disposing a pulse wave detection module including the first excitation light source and the first light detection device, and separately disposing the fingerprint detection module of the second excitation light source and the second light detection device, the embodiments of the present application In the technical solution, the display unit of the multiplexed display screen is used as the excitation light source for fingerprint detection and pulse wave detection, which can reduce the cost of the biometric information detection device. Further, the detection module that realizes fingerprint detection and PPG detection is disposed below the display screen instead of the surface or other areas of the electronic device, which is beneficial to improve the overall aesthetics of the electronic device.

In addition, in the embodiment of the present application, the data volume of the first fingerprint image used for fingerprint detection is larger than the data volume of the second fingerprint image used for respiratory frequency detection, and the data volume of the first fingerprint image is large, which is beneficial to improve the fingerprint detection efficiency. The accuracy of the second fingerprint image is small, which is beneficial to improve the transmission speed of the second fingerprint image and the sampling rate of the second fingerprint image, thereby improving the quality of the PPG signal and improving the accuracy of respiratory rate detection.

In some possible implementations, each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal undergoes a plurality of eigenmode functions after empirical mode decomposition EMD The IMF and the upper envelope of the PPG signal are used to detect the breathing frequency of the user.

With the technical solutions of the embodiments of the present application, the fluctuation degree of the upper envelope of the PPG signal can reflect the breathing change of the user. Therefore, the user's breathing frequency signal is determined according to the upper envelopes of multiple IMF and PPG signals, and then breathing is performed. Frequency detection can obtain more accurate detection results of respiratory frequency.

In some possible implementations, the correlation between the plurality of IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF in the plurality of IMFs; the at least one target IMF is used to reconstruct the respiratory frequency signal; the spectrogram of the breathing frequency signal is used to determine the breathing frequency of the user.

In some possible implementations, the detection module includes: a first photodetector, including: a first photodetection array formed by a plurality of first photodetection units; during the first period, the first photodetector in the first photodetection array A light detection area is used to collect the fingerprint light signal to obtain the at least one frame of the first fingerprint image; in the second period, the second light detection area in the first light detection array is used to collect the fingerprint light signal to obtain the fingerprint image. Multiple frames of second fingerprint images; wherein the number of first light detection units in the first light detection area is greater than the number of first light detection units in the second light detection area.

By adopting the technical solutions of the embodiments of this application, two functions of fingerprint image detection and PPG signal detection can be realized through one optical detection device, that is, the first optical detector. While improving user experience, the detection device and its electronic components are further reduced. The overall cost of the equipment.

In some possible implementations, the sum or average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal.

In some possible implementations, the first photodetector further includes: an arithmetic unit connected to the first photodetection array; the arithmetic unit is used for data detected by the first photodetection unit in the second photodetection area Summing or averaging is performed to form each frame of the second fingerprint image in the multiple frames of the second fingerprint image; wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used for A signal value that forms the PPG signal.

With this embodiment, each frame of the second fingerprint image is processed to include only one pixel value, and the processed second fingerprint image of each frame is used for transmission to the processor of the electronic device where the detection device is located, and can be further processed to form a PPG A value in the signal. By adopting this embodiment, the data transmission speed between the first photodetector and the processor can be further improved, so as to further improve the sampling rate of the second fingerprint image.

In some possible implementations, the first photodetector further includes: a control unit connected to the first photodetection array; the control unit is configured to configure the first photodetection units in the second photodetection area to be turned on at the same time, Obtain the multi-frame second fingerprint image by collecting the fingerprint light signal; wherein, each frame of the second fingerprint image in the multi-frame second fingerprint image includes a pixel value, and the pixel value is used to form a signal of the PPG signal value.

In some possible implementations, in the first time period, the first light detection area is used for collecting the fingerprint light signal at a first frequency, and in the second time period, the second light detection area is used for collecting the fingerprint light signal at a second frequency Collect the fingerprint optical signal, wherein the first frequency is less than or equal to the second frequency.

In some possible implementations, the detection module includes: a first photodetector, including: a first photodetection array formed by a plurality of first photodetection units; a second photodetector, including: at least one second photodetector The second photodetection array formed by the unit; in the first period, the first photodetection array is used to collect the fingerprint light signal to obtain the at least one frame of the first fingerprint image; in the second period, the second photodetection array uses collecting the fingerprint light signal to obtain the multiple frames of the second fingerprint image; wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.

By adopting the technical solutions of the embodiments of this application, the fingerprint image detection function is realized by the first photodetector, and the PPG signal detection is realized by the second photodetector. Independent control, and in the event of failure, it is easy to carry out maintenance separately. The fingerprint image detection and PPG signal detection functions are independent of each other and do not affect each other. When one of the detection functions fails, the other detection function can still be used normally, thereby further improving the user experience.

In some possible implementations, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form a signal value of the PPG signal.

In this embodiment, the second photodetector only includes one second photodetecting unit, so each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and the second photodetector can have a higher The sampling rate collects the fingerprint light signal to obtain multiple frames of the second fingerprint image signal, and the data transmission speed of the second fingerprint image is fast.

In some possible implementations, during the first time period, the first light detection array is used to collect the fingerprint light signal at a first frequency, and during the second time period, the second light detection array is used to collect the fingerprint light signal at a second frequency Collect the fingerprint optical signal, wherein the first frequency is less than or equal to the second frequency.

In some possible implementations, the second time period is greater than a first preset threshold, and the second frequency is greater than a second preset threshold, so as to ensure the signal quality of the PPG signal.

In some possible implementations, the first preset threshold is 20 seconds, and the second preset threshold is 100 Hz.

In some possible implementations, the detection module further includes: a first optical component disposed above the first photodetector, including a filter layer and an optical path guiding structure, the optical path guiding structure is used for receiving the fingerprint light signal, and directing the fingerprint light signal to the first light detector.

In some possible implementations, the optical path guiding structure includes at least one of the following structures: a collimation layer, an optical lens layer, a microlens and at least one diaphragm layer.

In some possible implementations, the detection module is connected to a processor of the electronic device, and the processor is configured to detect the user's fingerprint according to the at least one frame of the first fingerprint image signal, and detect the user's fingerprint according to the multiple frames of the second fingerprint image The PPG signal is acquired for detection of the user's breathing rate.

In some possible implementation manners, the processor is configured to: decompose the PPG signal by using an empirical mode decomposition (EMD) algorithm to obtain a plurality of eigenmode functions IMF; according to the plurality of IMFs and the upper envelope of the PPG signal The user's breathing frequency signal is acquired to detect the user's breathing frequency.

In some possible implementations, the processor is configured to: determine at least one target IMF in the plurality of IMFs according to the correlation between the plurality of IMFs and the upper envelope of the PPG signal; The breathing frequency signal is formed; the breathing frequency of the user is determined according to the spectrogram of the breathing frequency signal.

In a second aspect, a method for detecting biometric information is provided, which is applied to a device for detecting biometric information disposed below a display screen of an electronic device, the detection method comprising: collecting an optical signal emitted by the display screen to pass through a user's finger The reflected or scattered fingerprint light signal to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, the data volume of the first fingerprint image is greater than the data volume of the second fingerprint image; transmitting the at least one frame of the first fingerprint image The fingerprint image and the multiple frames of the second fingerprint image are sent to the processor, the at least one frame of the first fingerprint image signal is used for fingerprint detection of the user, and the multiple frames of the second fingerprint image is used to obtain the photoplethysmography PPG signal to The detection of the breathing frequency of the user is performed.

In some possible implementations, the detection device includes: a first light detector, the first light detector includes: a first light detection array formed by a plurality of first light detection units; the collection of light emitted by the display screen The fingerprint light signal after the signal is reflected or scattered by the user's finger to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, including: in the first period, the first light detection area in the first light detection array collecting the fingerprint light signal to obtain the at least one frame of the first fingerprint image; during the second period, the second light detection area in the first light detection array collects the fingerprint light signal to obtain the multiple frames of the second fingerprint image; wherein , the number of the first light detection units in the first light detection area is greater than the number of the first light detection units in the second light detection area.

In some possible implementations, collecting the fingerprint light signal in the second light detection area in the first light detection array to obtain the multiple frames of the second fingerprint image includes: detecting the first light in the second light detection area The data detected by the unit is summed or averaged to form the multi-frame second fingerprint image; wherein, each frame of the second fingerprint image in the multi-frame second fingerprint image includes a pixel value, and the one pixel value is used to form the multi-frame second fingerprint image. A signal value of the PPG signal.

In some possible implementations, collecting the fingerprint light signal in the second light detection area in the first light detection array to acquire the multiple frames of the second fingerprint image includes: configuring the first light detection area in the second light detection area The unit is turned on at the same time to collect the fingerprint light signal to obtain the multiple frames of the second fingerprint image; wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form the PPG A signal value for the signal.

In some possible implementations, the first light detection area in the first light detection array collects the fingerprint light signal to acquire the at least one frame of the first fingerprint image, including: the first light detection area collects at a first frequency the fingerprint optical signal to acquire the at least one frame of the first fingerprint image; the second optical detection area in the first optical detection array collects the fingerprint optical signal to acquire the multiple frames of the second fingerprint image, including: the second optical detection The area is used to collect the fingerprint light signal at a second frequency to obtain the multiple frames of the second fingerprint image, wherein the first frequency is less than or equal to the second frequency.

In some possible implementations, the detection device includes: a first photodetector and a second photodetector, the first photodetector includes: a first photodetection array formed by a plurality of first photodetection units, the first photodetector The two-light detector includes: a second light detection array formed by at least one second light detection unit; the fingerprint light signal after the light signal emitted by the display screen is reflected or scattered by the user's finger is collected to obtain at least one frame of the first fingerprint An image and multiple frames of second fingerprint images, including: in a first period of time, the first light detection array collects the fingerprint light signal to obtain the at least one frame of the first fingerprint image; in a second period of time, the second light detection array collects The fingerprint light signal is used to obtain the multiple frames of the second fingerprint image; wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.

In some possible implementations, collecting the fingerprint light signal by the first light detection array to obtain the at least one frame of the first fingerprint image includes: the first light detection array collects the fingerprint light signal at a first frequency to obtain the fingerprint light signal. At least one frame of the first fingerprint image; the second light detection array collects the fingerprint light signal to obtain the multiple frames of the second fingerprint image, comprising: the second light detection array collects the fingerprint light signal at a second frequency to obtain the multiple frames. Frame a second fingerprint image, wherein the first frequency is less than or equal to the second frequency.

In a third aspect, an electronic device is provided, comprising: a display screen, and a detection device for biometric information in the first aspect or any embodiment of the first aspect, wherein the detection device is arranged below the display screen .

In some possible implementations, the electronic device further includes a processor, and the processor is configured to: control the detection module in the detection device to collect the fingerprint light signal after the light signal emitted by the display screen is reflected or scattered by the user's finger to Obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image; perform fingerprint detection of the user according to the at least one frame of the first fingerprint image signal; detection.

By using the electronic device provided by the embodiments of the present application, the cost of the electronic device can be reduced on the basis of realizing the detection of various biometric information.

Description of drawings

FIG. 1 is a structural block diagram of an electronic device to which the biometric information detection system in the present application is applied.

FIG. 2 is a schematic front view of an electronic device to which the device for detecting biometric information provided by the embodiment of the present application is applied.

Fig. 3 is a schematic view of a partial cross-sectional structure of the electronic device shown in Fig. 2 along A-A'.

FIG. 4 is a schematic structural diagram of a detection module provided by an embodiment of the present application.

FIG. 5 is a schematic structural diagram of another detection module provided by an embodiment of the present application.

FIG. 6 is a schematic diagram of a PPG signal provided by an embodiment of the present application.

FIG. 7 is a schematic structural diagram of another electronic device to which the apparatus for detecting biometric information provided by the embodiment of the present application is applied.

FIG. 8 is a schematic flowchart of a method for detecting biometric information provided by an embodiment of the present application.

FIG. 9 is a schematic flowchart of step S340 in FIG. 8 .

10 to 15 are schematic diagrams of some waveforms provided by the embodiments of the present application.

FIG. 16 is a schematic flowchart of another method for detecting biometric information provided by an embodiment of the present application.

FIG. 17 is a schematic flowchart of another method for detecting biometric information provided by an embodiment of the present application.

FIG. 18 is a schematic flowchart of another method for detecting biometric information provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

It should be understood that the specific examples herein are only for helping those skilled in the art to better understand the embodiments of the present application, rather than limiting the scope of the embodiments of the present application.

It should also be understood that, in various embodiments of the present application, the size of the sequence numbers of each process does not imply the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, rather than the embodiment of the present application. implementation constitutes any limitation.

It should also be understood that the various implementation manners described in this specification may be implemented individually or in combination, which are not limited by the embodiments of the present application.

Unless otherwise specified, all technical and scientific terms used in the embodiments of the present application have the same meaning as commonly understood by those skilled in the technical field of the present application. The terminology used in this application is for the purpose of describing specific embodiments only and is not intended to limit the scope of the application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

The present application can be applied to a biometric information detection system, including but not limited to a respiratory rate detection system. The biometric information detection system can be applied to various types of electronic devices, and the electronic devices can be mobile terminals, including but not limited to mobile phones, smart wearable devices, tablet computers, mobile medical devices, and the like.

FIG. 1 shows a structural block diagram of an electronic device to which the biometric information detection system in this application is applicable.

As shown in FIG. 1 , the electronic device 10 may include a bus 110 , a processor 120 , a memory 130 , an input/output interface 140 , a display 150 , a communication interface 160 and a detection system 170 for biometric information.

Bus 110 may include circuitry that enables communication (eg, control messages or data) between components in electronic device 10 . As an example, the bus 110 may include: a serial peripheral interface (Serial Peripheral Interface, SPI) communication bus, which is used to implement data communication between the biometric information detection system 170 and the processor 120. Alternatively, the bus 110 may further include other types of communication buses, which are not specifically limited in this embodiment of the present application.

Processor 120 may include one or more types of data processors for performing data processing. As an example, the processor 120 may be a microcontroller unit (Microcontroller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or other types of processors, which are not specifically limited in this embodiment of the present application.

Memory 130 may include volatile memory and/or non-volatile memory. It may store instructions or data related to other functional components in the electronic device 10 .

The input/output interface 140 may be used to receive instructions or data input from a user or an external device, and then transmit them to other functional components in the electronic device 10, or may output instructions or data generated by other functional components in the electronic device 10 to the electronic device 10. user or external device.

The display 150 may include, for example, a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED) display, or other types of displays. The display 150 may display various types of content, such as text, images, videos, icons, etc., to the user. Further, the display 150 may include a touch screen, and the user may input relevant instruction information through the touch screen.

The communication interface 160 may be used to implement communication between the electronic device 10 and external devices, such as a web server or other electronic devices. As an example, the communication interface 160 may be connected to a communication network through wireless or wired communication to communicate with external devices. The wireless communication includes but is not limited to cellular communication or short-range communication. Wired communication includes but is not limited to at least one of Universal Serial Bus (Universal Serial Bus, USB), High Definition Multimedia Interface (High Definition Multimedia Interface, HDMI), Recommended Standard 232 (RS-232) or other communication methods.

The biometric information detection system 170 is used to detect the user's biometric information, the biometric information includes but is not limited to: the user's fingerprint, heart rate, respiratory rate, blood oxygen saturation, blood pressure and other parameter information, which can pass the test The optical signal after passing through the user's finger, from which biometric signals such as fingerprint images and pulse waves are obtained. In other words, the biometric information detection system 170 in this embodiment of the present application can be used to detect the user's biometric signal. to obtain one or more biometric information of users.

In some embodiments, the electronic device 10 may omit at least one of the above components, or may further include other components, which will not be described in detail here.

Specifically, the embodiment of the present application relates to an apparatus for detecting biometric information, which can be applied to the biometric information detection system 170 in FIG. 1 and is provided in the electronic device 10 in FIG. 1 . And more specifically, the biometric information detection device involved in the embodiments of the present application can be arranged below the display screen without occupying the surface space of the electronic device, which is conducive to realizing a full-screen design of the electronic device and improving the overall appearance of the electronic device. Spend.

As an example, FIGS. 2 and 3 show schematic diagrams of an electronic device 10 to which the apparatus 200 for detecting biometric information according to an embodiment of the present application can be applied, wherein FIG. 3 is a schematic front view of the electronic device 10 , and FIG. The schematic diagram of the partial cross-sectional structure of the electronic device 10 along AA'.

As shown in FIG. 3 , in the embodiment of the present application, the detection device 200 is configured to be disposed below the above-mentioned display screen 170 , and the detection device 200 for biometric information includes:

The detection module 210 is configured to receive the fingerprint light signal 112 after the light signal 111 of the display screen 170 is reflected or scattered by the user's finger 180 above the display screen 170 to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, The data volume of the first fingerprint image is greater than the data volume of the second fingerprint image, wherein at least one frame of the first fingerprint image signal is used for fingerprint detection and/or fingerprint identification of the user, and multiple frames of the second fingerprint image are used to obtain Pulse wave signal for detection of user's breathing rate.

As shown in FIGS. 2 and 3 , the user's finger 180 may be pressed against the display area in the display screen 170 . As an optional embodiment, the display screen 170 may be a display screen having a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display screen or a micro-light-emitting diode (Micro-LED) display screen. Taking an OLED display screen as an example, the detection module 210 can use a display unit (ie, an OLED light source) located in the pressing area of the finger 180 in the OLED display screen 170 as an excitation light source for optical fingerprint detection. When the finger 180 presses the display area in the display screen 170, the display screen 170 emits a light beam 111 to the finger 180, and the light 111 is reflected on the surface of the finger 180 to form reflected light or scattered inside the finger 180 to form scattered light. In the patent application, for the convenience of description, the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Since the ridges and valleys of the fingerprint have different reflection capabilities for light, the reflected light from the fingerprint ridges and the reflected light from the fingerprint valleys have different light intensities, and the reflected light is the fingerprint light signal 112, The fingerprint information includes fingerprint ridges and fingerprint valleys. After the fingerprint light signal 112 passes through the display screen 170, it is received by the detection module 210 located below the display screen 170, and a fingerprint image signal can be further formed.

In addition, when the user's finger 180 is pressed against the display area in the display screen 170, the detection module 210 may also use the display unit (ie, the OLED light source) located in the pressed area of the finger 180 in the OLED display screen 170 as the excitation light source for pulse wave detection. When the excitation light source emits the light beam 111 to irradiate the surface of the finger 180, the contraction and expansion of the blood vessel will affect the transmission, reflection or scattering of light during each heartbeat. When light passes through the skin tissue and then reflects, the light signal will be attenuated to a certain extent. The absorption of light by muscles, bones, veins and other connecting tissues is basically unchanged (if there is no large-scale movement of the measurement site), but the arteries will be different. Because of the pulsation of blood in the arteries, the absorption of light is naturally also subject to change. Therefore, the light intensity of the fingerprint light signal 112 after being reflected, transmitted or scattered by the finger will change with time. A pulse wave signal may be further formed, or, hereinafter, the pulse wave signal may also be referred to as a photoplethysmography (PPG) signal.

Further, the above-mentioned PPG signal can be used for detection of various biometric information of the user, and the biometric information includes but is not limited to the user's breathing frequency, heart rate, blood pressure, blood oxygen, etc., which is not specifically described in this embodiment of the present application. limited. By analyzing and studying the features in the PPG signal and extracting the biometric information contained in it, it is convenient for users to know their own physical status at any time, and provides help for the early diagnosis and prevention of cardiovascular system-related diseases.

Through the technical solutions of the embodiments of the present application, the detection module is arranged below the display screen, and the display unit of the display screen is used as the excitation light source, so as to obtain the fingerprint light signal reflected or scattered by the finger above the display screen, and based on the fingerprint light The signal acquires at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, and then performs the user's fingerprint detection based on the at least one frame of the first fingerprint image signal, and acquires the PPG signal based on the multiple frames of the second fingerprint image to detect the user's breathing frequency. . Therefore, compared to the technical solutions of separately arranging the pulse wave detection module including the first excitation light source and the first light detection device, and the fingerprint detection module of the second excitation light source and the second light detection device separately, the embodiments of the present application In the technical solution, the display unit of the multiplexed display screen is used as the excitation light source for fingerprint detection and pulse wave detection, which can reduce the cost of the biometric information detection device. Further, the detection module that realizes fingerprint detection and PPG detection is disposed below the display screen instead of the surface or other areas of the electronic device, which is beneficial to improve the overall aesthetics of the electronic device.

In order to realize that the data amount of the first fingerprint image is larger than that of the second fingerprint image, any one of the following various implementation manners may be adopted.

Optionally, as Embodiment 1:

FIG. 4 shows a schematic structural diagram of a detection module 210 .

As shown in FIG. 4 , the detection module 210 includes a first photodetector 211 , and the first photodetector 211 includes: a first photodetection array formed by a plurality of first photodetection units 2111 . The first photodetection units 2111 specifically It may include a photodiode (PD) or other types of light detection devices, for correspondingly receiving the fingerprint light signal 112 and converting the fingerprint light signal into a corresponding fingerprint image signal through a photoelectric conversion effect. It can be understood that, in this embodiment of the present application, the first photodetector 211 may further include other auxiliary circuits for electrical connection with the first photodetection array, for controlling the operation and reading of the first photodetector array The fingerprint image signal generated by the first photodetection array is taken and transmitted, and the first photodetection array and its auxiliary circuits can be fabricated in a chip (Die) by a semiconductor process, such as an optical imaging chip or an optical imaging sensor.

In the first period of time, in the above-mentioned first photodetector 211 , the first photodetection area in the first photodetection array is used to collect the fingerprint light signal 112 to acquire at least one frame of the first fingerprint image. In the second period, the second photodetection area in the first photodetection array is used to acquire multiple frames of second fingerprint images after collecting the fingerprint light signal 112 .

Specifically, the area of the first photodetection area is larger than the area of the second photodetection area, or in other words, the number of the first photodetection units 2111 in the first photodetection area is larger than that of the first photodetection units in the second photodetection area 2111 quantity. Optionally, the above-mentioned first light detection area includes all the first light detection units 2111 in the first light detection array, and the above-mentioned second light detection area only includes a part of the first light detection units 2111 in the first light detection array.

In this embodiment of the present application, the first fingerprint image and the second fingerprint image can be directly detected through the first light detection area and the second light detection area, and the number of the first light detection units 2111 in the first light detection area is larger than that of the second fingerprint image. The number of first photodetection units 2111 in the photodetection area, that is, the number of pixels in the first fingerprint image is greater than the number of pixels in the second fingerprint image, so that the data volume of the first fingerprint image is greater than that of the second fingerprint image.

Optionally, as an optional implementation manner, the above-mentioned multiple frames of the second fingerprint image can be transmitted to the processor of the electronic device where the detection apparatus 200 is located, or to the processor in the detection apparatus 200, where the processor is used for A summation or averaging operation is performed for each frame of the second fingerprint images in the multiple frames of the second fingerprint images to form a value in the PPG signal.

Optionally, as another optional implementation manner, as shown in FIG. 4 , in this embodiment of the present application, the first photodetector 211 may include an arithmetic unit 2112, and the arithmetic unit 2112 is connected to the above-mentioned first photodetector In the process of collecting the second fingerprint image of each frame, the arithmetic unit 2112 is used to sum or average the data detected by all the first photodetection units in the second photodetection area of the first photodetection array , each frame of the second fingerprint image is processed to include only one pixel value, and each frame of the processed second fingerprint image is used for transmission to the processor of the electronic device where the detection device 200 is located, or the processor in the detection device 200, Further processing may be performed to form a value in the PPG signal. By adopting this embodiment, the data transmission speed between the first photodetector 2111 and the processor can be further improved, so as to further improve the sampling rate of the second fingerprint image.

Optionally, as a third optional implementation manner, as shown in FIG. 4 , in this embodiment of the present application, the first photodetector 211 may include a control unit 2113, and the control unit 2113 is connected to the above-mentioned first photodetector The control unit 2113 is used to configure all the first photodetection units in the second photodetection area in the first photodetection array to be turned on at the same time, so as to collect the fingerprint optical signal 112 and acquire multiple frames of second fingerprint images. At this time, all the first light detection units in the second light detection area can be equivalent to one large light detection unit, and each frame of the second fingerprint images in the multiple frames of the second fingerprint images obtained by the second light detection area only includes one pixel value, the one pixel value is used to form one signal value of the PPG signal.

In this embodiment of the present application, each frame of the second fingerprint image acquired by the second detection area includes only one pixel value, and each frame of the second fingerprint image is used for transmission to the processor of the electronic device where the detection apparatus 200 is located, or The processor in the detection device 200 may further process to form a value in the PPG signal. By adopting this embodiment, the data transmission speed between the first photodetector 2111 and the processor can be further improved, so as to further improve the sampling rate of the second fingerprint image.

Optionally, in the above-mentioned first time period, the operating frequency of the first light detection area is the first frequency, that is, the first light detection area collects the fingerprint light signal 112 at the first frequency f1, and within the first time period t1, t1/ The f1 frame of the first fingerprint image signal, and one or more frames of the first fingerprint image signal in the t1/f1 frame of the first fingerprint image signal is used for fingerprint detection and/or fingerprint identification. In the second time period, the operating frequency of the second light detection area is the second frequency, that is, the second light detection area collects the fingerprint light signal 112 at the second frequency f2, and in the second time period t2, a second fingerprint frame of t2/f2 is formed The image signal, the second fingerprint image signal of the t2/f2 frame is used to form the PPG signal. Wherein, the first frequency f1 is less than or equal to the second frequency f2, and the first time period t1 is less than the second time period t2.

As an example, in the embodiment of the present application, the second frequency f2 is greater than or equal to 100 Hz, and the second time period t2 is greater than or equal to 20 s.

Specifically, ensuring that the second frequency f2 is greater than a certain preset threshold, for example, the second frequency f2 is greater than or equal to 100 Hz, can ensure the accuracy of the collected second fingerprint image signal, and ensure that the second time period t2 is greater than a certain preset threshold, The second period t2 is greater than or equal to 20s, which can ensure that sufficient frames of the second fingerprint image signal are collected to form the PPG signal within the second period t2, which can improve the accuracy of the biometric information detected based on the PPG signal.

In addition, in the embodiment of the present application, the area of the first light detection area is larger than the area of the second light detection area, so that the large area of the first light detection area can be used to detect a large area of fingerprint images, thereby improving the fingerprint detection efficiency. Accuracy, the second light detection area with a small area is used to detect the PPG signal. On the basis of ensuring the accuracy of the PPG signal, the exposure time of the second light detection area is reduced, and the data transmission time is reduced, taking into account the first light detector. On the basis of the detection performance, the power consumption is reduced and the detection efficiency is improved.

In the above application embodiments, different light detection areas in the first light detector 211 are used to detect fingerprint light signals in different time periods to form fingerprint image signals and PPG signals. By adopting the technical solution of the embodiment of the application, two functions of fingerprint image detection and PPG signal detection can be realized through the first photodetector 211, so that the biometric information detection device 200 in the embodiment of the application can realize fingerprint detection and detection of PPG signals. The detection of various biometric information such as respiratory rate detection provides the user with various biometric information, which not only improves user experience, but also reduces the overall cost of the detection device 200 and the electronic equipment in which it is located.

Optionally, in this embodiment of the present application, as shown in FIG. 4 , the detection module 210 further includes a first optical component 212 , and the first optical component 212 may be disposed in the first light detection array of the first light detector 211 Above, it can specifically include a filter layer (Filter), a light guide layer or a light path guiding structure and other optical elements, the filter layer can be used to filter out ambient light that penetrates the finger, for example, the filter layer can be The infrared filter layer is used to filter out ambient light signals in the infrared band. The light guide layer or the light path guide structure is mainly used to guide the reflected light reflected from the finger surface to the first light detection array for optical detection.

In terms of specific implementation, the first optical component 212 and the first photodetector 211 may be packaged in the same component. For example, the first optical component 212 and the first optical detector 211 can be packaged in the same optical imaging chip, or the first optical component 212 can be arranged outside the chip where the first optical detector 211 is located, for example, the first optical The component 212 is attached above the chip, or some components of the first optical component 212 are integrated into the above-mentioned chip.

There are various implementation schemes for the light guide layer or the light path guide structure of the first optical component 212. For example, the light guide layer may be a collimator layer fabricated on a semiconductor silicon wafer, which has multiple A collimation unit or a micro-hole array, the collimation unit can be specifically a small hole, in the fingerprint light signal 112 reflected from the finger, the light incident perpendicular to the collimation unit can pass through and be detected by the first light below it The unit 2111 receives, and the light with an excessively large incident angle is attenuated by multiple reflections inside the collimation unit, so each first light detection unit 2111 can basically only receive the reflected light from the fingerprint pattern directly above it, Therefore, the first light detector 211 can detect the fingerprint image signal of the finger.

In another embodiment, the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspherical lenses, which are used for The reflected light reflected from the finger is concentrated to the first light detection array formed by the first light detection unit 2111 of the first light detector 211 below it, so that the first light detection array can perform imaging based on the reflected light , so as to obtain the fingerprint image of the finger. Optionally, the optical lens layer may further be formed with pinholes in the optical path of the lens unit, and the pinholes may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device to improve the fingerprint imaging effect of the optical fingerprint device 130 .

In other embodiments, the light guide layer or the light path guide structure may also specifically use a micro-lens (Micro-Lens) layer, and the micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be produced by a semiconductor growth process or other The process is formed over the first light detection array of the first light detector 211, and each microlens may correspond to one or more of the first light detection units 2111 of the first light detection array, respectively. In addition, other optical film layers, such as a dielectric layer or a passivation layer, may also be formed between the microlens layer and the first light detection array, and more specifically, between the microlens layer and the first light detection array It includes at least one diaphragm layer, each diaphragm layer of the at least one diaphragm layer is formed with a small hole corresponding to the microlens and the first light detection unit 2111, and the at least one diaphragm layer can block the phase. The optical interference between the adjacent microlens and the first light detection unit 2111, and the small holes in at least one diaphragm layer can form a light guide channel in a specific direction, which is used to condense the light signal in a specific direction by the microlens The transmission is directed into the first light detection unit 2111 corresponding to the microlens. It can be understood that if the microlens corresponds to a first light detection unit 2111, a light guide channel in one direction is formed in at least one diaphragm layer between the microlens and the first light detection unit 2111; The lens corresponds to a plurality of first light detection units 2111 , and light guide channels in multiple directions are formed in at least one diaphragm layer between the microlenses and the first light detection units 2111 .

It should be understood that several implementation solutions of the above-mentioned optical path guiding structure may be used alone or in combination, for example, a microlens layer may be further provided under the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the microlens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.

Optionally, as shown in FIG. 4 , the detection module 210 further includes a first circuit board 213 , and the first circuit board 213 is disposed below the first photodetector 211 . The first photodetector 211 can be adhered to the first circuit board 213 through an adhesive layer, and is electrically connected to the first circuit board 213 through an electrical connection device. The first circuit board 213 includes, but is not limited to, a Printed Circuit Board (PCB), a Flexible Printed Circuit (FPC), a rigid-flex board or other types of circuit boards. The electrical connection device includes However, it is not limited to metal wires, electrical connectors, or other types of electrical connection devices, which are not specifically limited in the embodiments of the present application.

The first photodetector 211 can realize electrical interconnection and signal transmission with other peripheral circuits or other electrical components through the first circuit board 213 . For example, the first photodetector 211 can receive the control signal of the processor of the electronic device where it is located through the first circuit board 213 , and can also output the fingerprint image signal to the processor of the electronic device where it is located through the first circuit board 213 .

Optionally, as Example 2:

FIG. 5 shows a schematic structural diagram of another detection module 210 .

As shown in FIG. 5 , the detection module 210 may include the first light detector 211 and the second light detector 214 , and the second light detector 214 and the first light detector 211 are disposed below the display screen 170 together. The above-mentioned first light detector 211 is used to collect the fingerprint light signal 112 to obtain at least one frame of the first fingerprint image; and the second light detector 214 is used to collect the fingerprint light signal 112 to obtain multiple frames of the second fingerprint image.

Optionally, the structure of the second light detector 214 may be similar to the structure of the first light detector 211 described above. Specifically, the second light detector 214 may include: at least one second light detection unit 2141 formed Two light detection arrays, for example, the second light detector 214 may include only one second light detection unit 2141 . In addition, optionally, as shown in FIG. 5 , the second photodetector 214 may be disposed on the above-mentioned first circuit board 215 , or a second circuit board may be separately disposed below it. In this embodiment of the present application, for the related technical solutions of the second light detection unit 2141 and the second light detector 214, reference may be made to the relevant descriptions of the first light detection unit 2111 and the first light detector 211 above, which will not be repeated here. .

Specifically, the number of the first light detection units 2111 in the first photodetector 211 is greater than the number of the second light detection units 2141 in the second photodetector 214, so that the number of pixel values in the first fingerprint image is greater than The number of pixel values in the second fingerprint image, so that the data volume of the first fingerprint image is larger than the data volume of the second fingerprint image.

Optionally, as an optional implementation manner, the second light detector 214 includes only one second light detection unit 2141, and at this time, the second light detector 214 can collect fingerprint light signals at a higher sampling rate 112 to acquire multiple frames of the second fingerprint image signal, wherein each frame of the second fingerprint image signal only includes one pixel value, so the data transmission speed of the second fingerprint image is fast.

Optionally, as another optional implementation manner, the second light detector 214 may also include a plurality of second light detection units 2141, and each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes multiple pixel values. , the multi-frame second fingerprint images can be transmitted to the processor of the electronic device where the detection apparatus 200 is located, or the processor in the detection apparatus 200, the processor is used for each frame of the second fingerprint in the multi-frame second fingerprint images The images are summed or averaged to form a value in the PPG signal.

Optionally, in the third embodiment, if the second photodetector 214 includes a plurality of second photodetection units 2141, the second photodetector 214 may further include an arithmetic unit, and the arithmetic unit is connected to the above-mentioned second photodetector Array, in the process of collecting the second fingerprint image of each frame, the arithmetic unit is used to sum or average the data detected by all the second light single detection units in the above-mentioned second light detection array to obtain the second fingerprint image of each frame , therefore, each frame of the second fingerprint image is processed to include only one pixel value, and the processed second fingerprint image of each frame is used for transmission to the processor of the electronic device where the detection apparatus 200 is located, or the processing in the detection apparatus 200 In the processor, further processing may be performed to form a value in the PPG signal.

Alternatively, in the fourth embodiment, if the second light detector 214 includes a plurality of second light detection units 2141, the second light detector 214 may further include a control unit, and the control unit is connected to the above-mentioned second light detection units The control is used to configure all the second light detection units in the second light detection array to be turned on at the same time, so as to collect the fingerprint light signal 112 and acquire multiple frames of the second fingerprint image. At this time, all the second light detection units in the second light detection array may be equivalent to one large light detection unit, similar to the above case where the second light detection array only includes one second light detection unit, the second light detection unit Each frame of the second fingerprint images obtained by the array detection includes only one pixel value, and the one pixel value is used to form one signal value of the PPG signal.

Optionally, the working frequency of the first light detector 211 is the first frequency, that is, the first light detection array in the first light detector 211 collects the fingerprint light signal 112 at the first frequency f1, and within the first time period t1, A t1/f1 frame of the first fingerprint image signal is formed, and one or more frames of the first fingerprint image signal in the t1/f1 frame of the first fingerprint image signal are used for fingerprint detection and/or fingerprint identification. The operating frequency of the second photodetector 214 is the second frequency, that is, the second photodetector array in the second photodetector 214 collects the fingerprint optical signal 112 at the second frequency f2, and in the second time period t2, t2/f2 is formed frame the second fingerprint image signal, the t2/f2 frame of the second fingerprint image signal is used to form the PPG signal. Wherein, the first frequency f1 is less than or equal to the second frequency f2, and the first time period t1 is less than the second time period t2.

In the above application embodiment, the detection module 210 includes a first light detector 211 and a second light detector 214, wherein the first light detector 211 is used to acquire at least one frame of the first fingerprint image signal, and the second light The detector 214 is used to acquire multiple frames of the second fingerprint image signal to form a PPG signal. By adopting the technical solutions of the embodiments of this application, the fingerprint image detection function is realized by the first photodetector 211, and the PPG signal detection is realized by the second photodetector. Independent control and easy maintenance in case of failure. The fingerprint image detection and PPG signal detection functions are independent of each other and do not affect each other. When one of the detection functions fails, the other detection function can still be used normally, thereby further improving the user experience.

It can be understood that, in the above-mentioned embodiments shown in FIGS. 4 and 5 , the first time period and the second time period are different time periods. The fingerprint detection function is performed in conjunction with the electronic device where the display screen 170 is located, and the detection module 210 is configured to collect the fingerprint light signal 112 to acquire at least one frame of the first fingerprint image. During the second period, when the user's finger 180 is pressed on the display screen 170, the electronic device performs a respiratory rate detection function, and the detection module 210 is used for collecting the fingerprint light signal 112 to obtain multiple frames of the second fingerprint image.

Optionally, before the second period of time, the electronic device where the detection apparatus 200 is located may receive indication information input by the user, where the indication information is used to instruct to start executing the respiratory rate detection function. Further, a local area in the display screen 170 emits light to display a light spot on the display screen 170, and the user's finger 180 is pressed on the light spot. Furthermore, in the second period, the detection module 210 acquires multiple frames of second fingerprint images. Optionally, the electronic device may determine whether to prompt the user to continue pressing by judging the number of frames of the acquired second fingerprint image, so that multiple frames of the second fingerprint image are used to form a PPG signal that meets certain requirements.

Optionally, the light signal emitted by the display screen 170 to the user's finger 180 during the first period may be different from the light signal emitted by the display screen 170 to the user's finger 180 during the second period. As an example, in the first period, the display screen 170 is used to transmit a white light signal to the user's finger, and in the second period, the display screen 170 is used to transmit a green light signal to the user's finger. By adopting this embodiment, the white light signal with higher intensity can be used to form the first fingerprint image with better quality, so as to improve the accuracy of fingerprint detection. In addition, the absorption degree of the green light signal by blood is the highest. Therefore, the green light signal The formed second fingerprint image can obtain a PPG signal with better quality, so as to improve the accuracy of respiratory rate detection. Of course, during the first period and the second period, the display screen 170 may also transmit other different types of light signals to the user's finger 180 or may transmit the same light signal to the user's finger 180 , which is not specifically limited in this embodiment of the present application .

It can also be understood that, in the above-mentioned embodiments shown in FIG. 4 and FIG. 5 , in the second fingerprint image signal of the t2/f2 frame, all pixel values of the second fingerprint image signal of each frame are used to process and form the PPG signal. One signal value, the t2/f2 frame second fingerprint image signal is used to form t2/f2 signal values to form the PPG signal. As an example, the sum of all pixel values of the second fingerprint image signal of each frame, or the average value of all pixel values, or the maximum value of all pixel values is used for processing to form one signal value in the PPG signal.

Or, in other cases, in the above-mentioned embodiment shown in FIG. 4 , the first photodetection area and the second photodetection area in the first photodetection array of the first photodetector 211 collect the fingerprint optical signal 112 at the same time period to Acquire at least one frame of the first fingerprint image and multiple frames of the second fingerprint image. It can be understood that, if the second photodetection area is a local area in the first photodetection area, the second fingerprint image is a local area image in the first fingerprint image.

In the above-mentioned embodiment shown in FIG. 5 , the first photodetector array in the first photodetector 211 and the second photodetector array in the second photodetector 214 collect the fingerprint optical signal 112 at the same time period to acquire at least one frame A first fingerprint image and multiple frames of a second fingerprint image. At this time, the detection device 200 can acquire the first fingerprint image and the second fingerprint image in the same time period, and complete the functions of fingerprint detection and respiratory rate detection in the same time period.

Illustratively, FIG. 6 shows a schematic diagram of a PPG signal.

As shown in FIG. 6 , due to the influence of blood flow in the human body, the amplitude of the PPG signal varies with time. It should be noted that the PPG signal in FIG. 6 is a PPG signal formed by the above-mentioned t2/f2 signal values after signal processing such as filtering and denoising, and the PPG signal may be one of the signals formed by the above-mentioned t2/f2 signal values. Alternating Current (AC) component.

In the above, the detection module 210 included in the biometric information detection device 200 is used to detect the fingerprint light signal, specifically, the detection module 210 includes the first photodetector 211, or the detection module 210 includes the first photodetector 211 and a second photodetector 214, the photodetector is used for receiving the fingerprint light signal and performing photoelectric conversion to obtain the first fingerprint image signal and the second fingerprint image signal.

FIG. 7 shows another schematic structural diagram of the electronic device 10 where the detection apparatus 200 is located in the present application.

As shown in FIG. 7 , in this embodiment of the present application, in addition to the detection device 200, the electronic device 10 further includes a processor 120, and the processor 120 is electrically connected to the detection module 210 in the detection device 200. Electrically connected to the first photodetector 211 in the detection module 210, or alternatively, also electrically connected to the first photodetector 211 and the second photodetector 214 in the detection module 210, the processor 120 is configured to receive the above The detection module 210 detects the fingerprint image signal, and detects various biometric information according to the fingerprint image signal.

It can be understood that, in addition to that the processor 120 in the above electronic device 10 is configured to receive the fingerprint image signal detected by the detection module 210, and perform detection of various biometric information according to the fingerprint image signal, in other embodiments , the detection device 200 further includes a microprocessor, which is electrically connected to the detection module 210, and the microprocessor is configured to receive the fingerprint image signal detected by the above-mentioned detection module 210, and perform various biological processes according to the fingerprint image signal. Detection of feature information.

FIG. 8 shows a schematic flowchart of a method 300 for detecting biological feature information configured and executed by the processor 120 of the electronic device where the detection apparatus 200 is located or the microprocessor in the detection apparatus 200 as an execution subject.

As shown in Figure 8, the detection method 300 includes:

S310: Control the detection module to collect the fingerprint light signal to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image signal;

S320: Receive at least one frame of the first fingerprint image, and perform fingerprint detection and/or fingerprint identification according to the at least one frame of the first fingerprint image;

S330: Receive multiple frames of second fingerprint image signals, and process based on the multiple frames of second fingerprint image signals to obtain a PPG signal;

S340: Detect the breathing frequency of the user according to the PPG signal.

As an example, in step S310, in the first period of time, the detection module is controlled to collect fingerprint light signals to obtain at least one frame of the first fingerprint image, and in the second period of time, the detection module is controlled to collect the fingerprint light signals to obtain multiple frames of second fingerprint images Signal.

Specifically, for the process of controlling the detection module to collect the fingerprint light signal to obtain the first fingerprint image and the second fingerprint image, please refer to the above-mentioned related processes of the execution of the first photodetector and the second photodetector. It can be understood that the above The image acquisition functions of the first photodetector and the second photodetector herein can be controlled and performed by the processor.

As an example, in step S320, the processor receives at least one frame of the first fingerprint image signal sent by the detection module 210. Optionally, the processor may directly receive one or more frames of the at least one frame of the first fingerprint image signal. Fingerprint detection and/or fingerprint recognition is performed on the frame of the first fingerprint image signal, or the processor may perform digital image processing on the at least one frame of the first fingerprint image signal, and then perform fingerprint detection and/or fingerprint recognition. Optionally, the digital image processing process includes, but is not limited to, digital image processing processes such as binning and filtering, which are not specifically limited in this embodiment of the present application.

Further, fingerprint detection and/or fingerprint identification can be performed based on at least one frame of the first fingerprint image signal. Specifically, the specific algorithm for fingerprint detection and/or fingerprint identification according to the fingerprint image can be implemented by any algorithm in the related art. The application examples also do not specifically discuss this.

For step S330, in this embodiment of the present application, within a preset period of time, for example, within the second period of time t2 above, multiple frames of second fingerprint image signals are received, and each frame of the multiple frames of second fingerprint image signals has a second fingerprint signal. The fingerprint image signal is used to form a signal value in the PPG signal. Specifically, multiple frames of the second fingerprint image signal form a plurality of signal values that vary with time within the second period t2 to form the PPG signal within the second period t2.

For step S340, it can be understood that, in addition to detecting the user's breathing frequency according to the PPG signal, other biometric information such as the user's blood pressure, blood oxygen, and heart rate can also be performed according to the PPG.

Optionally, in some embodiments, an empirical mode decomposition (Empirical Mode Decomposition, EMD) algorithm can be used to decompose the PPG signal to obtain multiple eigenmode functions (Intrinsic Mode Function, IMF), and according to the multiple eigenmode functions (Intrinsic Mode Function, IMF) The upper envelope of the IMF and PPG signals acquires the user's breathing frequency signal, so as to detect the user's breathing frequency.

Specifically, using the technical solutions of the embodiments of the present application, the fluctuation degree of the upper envelope of the PPG signal can reflect the breathing change of the user. Therefore, the user's breathing frequency signal is determined according to the upper envelopes of multiple IMFs and PPG signals, Further, the respiratory frequency detection is performed, and a relatively accurate detection result of the respiratory frequency can be obtained.

Alternatively, in other implementations, other algorithms may be used to process the PPG signal to obtain the user's breathing frequency signal, or the EMD algorithm may be used to determine and obtain multiple IMFs, and then the user's breathing frequency signal may be obtained directly based on multiple IMFs. The embodiments of the application do not limit the specific algorithm for detecting the breathing frequency of the user according to the PPG signal.

FIG. 9 shows a schematic flowchart of the above step S340.

As shown in FIG. 9, the above step S340 may include:

S341: Decompose the PPG signal by using the empirical mode decomposition EMD algorithm to obtain a plurality of eigenmode functions IMF of the PPG signal;

S342: Determine at least one target IMF in the multiple IMFs according to the correlation between the multiple IMFs and the upper envelope of the PPG signal;

S343: According to the at least one target IMF, reconstruct to obtain a respiratory frequency signal;

S344: Perform Fourier transform on the breathing frequency signal to obtain a spectrogram of the breathing frequency signal;

S345: Determine the breathing frequency of the user according to the spectrogram.

Specifically, in the above step S341, the PPG signal is represented as s(t), and the process of decomposing the PPG signal by using the EMD algorithm to obtain multiple IMFs includes:

(1) Let x(t)=s(t);

(2) Find all the maxima and minima of the signal x(t);

(3) Use the interpolation method to process all the maximum values, and fit to form the upper envelope emax(t) of x(t), use the interpolation method to process all the minimum values, and fit to form the upper envelope of x(t). lower envelope emin(t);

(4) Calculate the mean value of the upper and lower envelopes m(t)=(emax(t)-emin(t))/2, and calculate the difference between s(t) and m(t) d(t)=s( t)-m(t)=x(t)-m(t);

(5) Determine whether d(t) is IMF;

(6) If not, make x(t)=d(t), and repeat the above steps (2) to (5) until it is determined that di(t) is the first IMF;

(7) Calculate the remainder of s(t) and di(t) ri(t)=s(t)-di(t), let x(t)=ri(t), and repeat the above steps (2) to Step (6), determine the second IMF. By analogy, multiple IMFs of the PPG signal can be determined.

Specifically, in the above step (5), to judge whether d(t) is IMF, it is necessary to judge whether d(t) satisfies two conditions of the IMF signal: (1) In the entire data segment, the number of extreme points and The number of zero crossings must be equal or differ by at most one. (2) At any time, the average value of the upper envelope formed by the local maximum points and the lower envelope formed by the local minimum points is zero, that is, the upper and lower envelopes are local relative to the time axis. symmetry. If d(t) satisfies the above two conditions at the same time, it is considered that d(t) is IMF, otherwise, d(t) is not IMF.

In addition, for the process of decomposing a signal by using the EMD algorithm to obtain multiple IMFs, reference may also be made to the related solutions in the related art, which will not be described in detail here.

Specifically, in the above step S342, the correlation between each of the multiple IMFs and the upper envelope of the PPG signal is determined, and the correlation is used to measure whether each IMF is "like" with the upper envelope. Optionally, the correlation between the IMF and the upper envelope can be determined by determining the covariance or the correlation coefficient between the IMF and the upper envelope.

For signals X and Y, the covariance is defined as: Cov(X, Y)=E[(X–E(X))(Y–E(Y))], which can be described as: (Signal X minus X expectation) multiplied by the expectation of (signal Y minus Y expectation).

For signals X and Y, the correlation coefficient is defined as: Corr(X, Y)=Cov(X, Y)/σXσY; that is to say, divide the covariance of X and Y by the standard deviation of X and Y to get Correlation coefficient of signals X and Y.

Optionally, in this embodiment of the present application, among multiple IMFs, if the covariance or correlation coefficient between an IMF and the upper envelope is greater than or equal to a preset threshold, it may be determined that the IMF is more similar to the upper envelope. If the covariance or correlation coefficient between an IMF and the upper envelope is smaller than the preset threshold, it can be determined that the similarity between the IMF and the upper envelope is small, and the IMF is not the target IMF.

It can be understood that, in addition to using the covariance or correlation coefficient of the signals to determine the correlation between the IMF and the upper envelope, other parameters in the related art for determining the correlation or similarity between the signals can also be used. The correlation between the IMF and the upper envelope is determined, which is not specifically limited in this embodiment of the present application.

For the above step S343, at least some of the target IMFs in the at least one target IMF determined in the above step S342 are reconstructed to obtain a respiratory frequency signal. Preferably, all target IMFs determined in the above step S342 are reconstructed to obtain a respiratory frequency signal. Specifically, among all target IMFs, the i-th target IMF can be expressed as imfi, and the respiratory frequency signal f(t) can be expressed as f(t)=Σimfi.

For the above steps S344 and S345, Fourier transform is performed on the above-mentioned respiratory frequency signal f(t) to obtain a spectrogram of the respiratory frequency signal f(t), and the maximum amplitude value is determined according to the maximum amplitude value in the spectrogram. The corresponding frequency point is the user's breathing rate (number of breaths) per second, and then the user's breathing rate (number of breaths) per minute is determined.

As an example, FIGS. 10 to 15 show schematic diagrams of some waveforms in the above step S340.

The upper envelope of the PPG signal is shown in Figure 10;

FIG. 11 to FIG. 13 show the first IMF, the second IMF and the third IMF of the PPG signal, wherein the second IMF and the third IMF are determined as the above-mentioned target IMF after correlation calculation.

FIG. 14 shows the respiration frequency signal after reconstruction of the second IMF and the third IMF.

FIG. 15 shows the spectrum of FIG. 14 after Fourier transformation.

As can be seen from Figure 15, in this spectrogram, the frequency point corresponding to the maximum amplitude value is about 0.3 Hz, that is, the user's breathing frequency (breathing times) per second is about 0.3 times, then the user's breathing per minute is about 0.3 times. The frequency (number of breaths) is about 18 times.

In addition to the method 300 for detecting biometric information using a processor as an execution subject provided by the above embodiments of the application, the embodiments of the present application also provide a method 400 for detecting biometric information using the above detection apparatus 200 as an execution subject. It should be understood that the following embodiments of the detection method 400 correspond to the above-mentioned embodiments of the detection apparatus 200, and for similar descriptions, reference may be made to the above-mentioned apparatus embodiments.

FIG. 16 shows a schematic flowchart of a detection method 400 provided by an embodiment of the present application.

As shown in FIG. 16 , the method 400 for detecting biometric information is applied to a device for detecting biometric information disposed below a display screen of an electronic device, and the method 400 includes:

S410: Collect the fingerprint light signal reflected or scattered by the user's finger from the light signal emitted by the display screen to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, where the data volume of the first fingerprint image is larger than that of the second fingerprint image amount of data;

S420: Transmit at least one frame of the first fingerprint image and multiple frames of the second fingerprint image to the processor, where the at least one frame of the first fingerprint image signal is used for fingerprint detection of the user, and the multiple frames of the second fingerprint image are used to acquire the photoplethysmography The PPG signal is traced for detection of the user's breathing rate.

Optionally, the processor in this embodiment of the present application may be the processor 120 in the above electronic device or the microprocessor in the detection apparatus 200, for executing the above detection method 300.

In some possible implementations, each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal is subjected to the empirical mode decomposition EMD of multiple eigenmode functions IMF and PPG The upper envelope of the signal is used to detect the user's breathing rate.

In some possible implementations, the correlation between the multiple IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF among the multiple IMFs; the at least one target IMF is used to reconstruct the respiratory rate signal; the respiratory rate The spectrogram of the signal is used to determine the user's breathing rate.

In some possible implementations, the detection device includes: a first light detector, and the first light detector includes: a first light detection array formed by a plurality of first light detection units;

FIG. 17 shows a schematic flowchart of another detection method 400 provided by an embodiment of the present application.

As shown in FIG. 17 , the above step S410 may include:

S411: in the first period, the first light detection area in the first light detection array collects the fingerprint light signal to obtain at least one frame of the first fingerprint image;

S412: During the second period, the second light detection area in the first light detection array collects fingerprint light signals to acquire multiple frames of second fingerprint images.

In the embodiment of the present application, the number of the first light detection units in the first light detection area is greater than the number of the first light detection units in the second light detection area.

In some possible implementations, the sum or average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form one signal value of the PPG signal.

In some possible implementations, the first photodetector further includes: an arithmetic unit, and in the foregoing step S412, it may further include: the arithmetic unit sums or sums the data detected by the first photodetection unit in the second photodetection area Averaging is performed to form multiple frames of the second fingerprint image, wherein each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and one pixel value is used to form one signal value of the PPG signal.

In some possible implementations, the first light detector further includes: a control unit. In the above step S412, it may further include: the control unit configures the first light detection unit in the second light detection area to be turned on at the same time to collect fingerprint light signal to obtain multiple frames of second fingerprint images; wherein, each frame of the second fingerprint images in the multiple frames of second fingerprint images includes one pixel value, and one pixel value is used to form one signal value of the PPG signal.

In some possible implementations, in the above step S411, the first light detection area collects the fingerprint light signal at the first frequency to obtain at least one frame of the first fingerprint image; in the above step S412, the second light detection area is used for The fingerprint light signal is collected at a second frequency to obtain multiple frames of second fingerprint images, wherein the first frequency is less than or equal to the second frequency.

In some possible implementations, the detection device includes: a first photodetector and a second photodetector, the first photodetector includes: a first photodetection array formed by a plurality of first photodetection units, and the second photodetector The device includes: a second light detection array formed by at least one second light detection unit;

FIG. 18 shows a schematic flowchart of another detection method 400 provided by an embodiment of the present application.

As shown in FIG. 18, the above step S410 may include:

S413: in the first period, the first light detection array collects the fingerprint light signal to obtain at least one frame of the first fingerprint image;

S414: During the second period, the second light detection array collects fingerprint light signals to acquire multiple frames of second fingerprint images.

Wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.

In some possible implementations, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and one pixel value is used to form one signal value of the PPG signal.

In some possible implementations, the above step S413 may include: the first light detection array collects the fingerprint light signal at the first frequency to obtain at least one frame of the first fingerprint image; the above step S414 may include: the second light detection array The fingerprint optical signal is collected at two frequencies to obtain multiple frames of second fingerprint images, wherein the first frequency is less than or equal to the second frequency.

In some possible implementations, the second time period is greater than the first preset threshold, and the second frequency is greater than the second preset threshold, so as to ensure the signal quality of the PPG signal.

In addition to the biometric information detection apparatus 200 , the biometric information detection method 300 , and the detection method 400 provided in the above-mentioned embodiments of the application, the present application further provides an electronic device, which may include any of the above-mentioned embodiments. A detection device 200 for biometric information.

The electronic device may be any electronic device with a display screen, optionally, the display screen may be the display screen 170 described above, wherein the biometric information detection device 200 is disposed below the display screen 170 .

Optionally, in the embodiment of the present application, the detection device 200 may be arranged under the display screen 170 in any manner. As an example, in some embodiments, the detection device 200 may be fixedly connected under the display screen 170 through an adhesive layer, or , in other embodiments, the detection device 200 can be fixedly connected under the display screen 170 through a bracket, or, in other embodiments, the detection device 200 can also be fixedly arranged on the middle frame of the electronic device, thereby being arranged in the Below the display screen 170 , the embodiment of the present application does not specifically limit the arrangement of the detection device 200 below the display screen 170 .

It can be understood that, in this embodiment of the present application, in order to ensure the display effect of the display screen 170, the lower surface of the display screen 170 is generally provided with a light shielding layer. The detection module 210 receives that a window needs to be provided in the shading layer, and the detection module 210 is correspondingly arranged below the window, so that the detection module 210 can receive the fingerprint light signal 112 passing through the window.

Optionally, the electronic device in this embodiment of the present application may further include the processor 120 in the above-mentioned embodiment of the application.

Optionally, the processor 120 may be configured to execute the above method 300 for detecting biometric information.

It should be understood that the processor or processing unit in this embodiment of the present application may be an integrated circuit chip, which has a signal processing capability. In the implementation process, each step of the above method embodiments may be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processor can be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other available Programming logic devices, discrete gate or transistor logic devices, discrete hardware components. The methods, steps, and logic block diagrams disclosed in the embodiments of this application can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.

It can be understood that the detection apparatus and/or the electronic device in this embodiment of the present application may further include a memory, and the memory may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memory. It should be noted that the memory of the systems and methods described herein is intended to include, but not be limited to, these and any other suitable types of memory.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art or the parts of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes .

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

A detection device for biometric information, characterized in that it is arranged below a display screen of an electronic device, and the detection device comprises:

The detection module is used to collect the fingerprint light signal after the light signal emitted by the display screen is reflected or scattered by the user's finger to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image. The amount of data is greater than the amount of data of the second fingerprint image, wherein the at least one frame of the first fingerprint image signal is used for fingerprint detection of the user, and the multiple frames of the second fingerprint image are used to obtain a photoplethysmographic wave The PPG signal is traced for detection of the user's breathing rate.
The detection device according to claim 1, wherein each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal is subjected to empirical modal decomposition The multiple eigenmode functions IMF after EMD and the upper envelope of the PPG signal are used to detect the breathing frequency of the user.
The detection device according to claim 2, wherein the correlation between the multiple IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF in the multiple IMFs;

The at least one target IMF is used to reconstruct a respiratory rate signal;

The spectrogram of the breathing frequency signal is used to determine the breathing frequency of the user.
The detection device according to any one of claims 1 to 3, wherein the detection module comprises:

a first light detector, comprising: a first light detection array formed by a plurality of first light detection units;

During the first period, the first light detection area in the first light detection array is used to collect the fingerprint light signal to obtain the at least one frame of the first fingerprint image;

During the second period, the second light detection area in the first light detection array is used to collect the fingerprint light signal to obtain the multiple frames of second fingerprint images;

Wherein, the number of the first light detection units in the first light detection area is greater than the number of the first light detection units in the second light detection area.
The detection device according to claim 4, wherein a sum or an average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form one signal value of the PPG signal.
The detection device according to claim 4, wherein the first light detector further comprises:

an arithmetic unit, connected to the first light detection array;

The arithmetic unit is configured to sum or average the data detected by the first light detection unit in the second light detection area to form each frame of the second fingerprint image in the multiple frames of the second fingerprint image;

Wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and the one pixel value is used to form one signal value of the PPG signal.
The detection device according to claim 4, wherein the first light detector further comprises:

a control unit, connected to the first light detection array;

The control unit is configured to configure the first light detection units in the second light detection area to be turned on at the same time, so as to collect the fingerprint light signals to obtain the multiple frames of the second fingerprint images;

Wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and the one pixel value is used to form one signal value of the PPG signal.
The detection device according to any one of claims 4 to 7, wherein in the first period, the first light detection area is used to collect the fingerprint light signal at a first frequency, and in the first period During the second period, the second light detection area is used to collect the fingerprint light signal at a second frequency, wherein the first frequency is less than or equal to the second frequency.
The detection device according to any one of claims 1 to 3, wherein the detection module comprises:

a first light detector, comprising: a first light detection array formed by a plurality of first light detection units;

The second light detector includes: a second light detection array formed by at least one second light detection unit;

During the first period, the first light detection array is used to collect the fingerprint light signal to obtain the at least one frame of the first fingerprint image;

During the second period, the second light detection array is used for collecting the fingerprint light signal to obtain the multiple frames of the second fingerprint image;

Wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.
The detection device according to claim 9, wherein each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form a signal value of the PPG signal .
The detection device according to claim 9, wherein in the first period, the first light detection array is used to collect the fingerprint light signal at a first frequency, and in the second period, the The second light detection array is used for collecting the fingerprint light signal at a second frequency, wherein the first frequency is less than or equal to the second frequency.
The detection device according to claim 8 or 11, wherein the second period is greater than a first preset threshold, and the second frequency is greater than a second preset threshold, so as to ensure the signal quality of the PPG signal .
The detection device according to claim 12, wherein the first preset threshold is 20 seconds, and the second preset threshold is 100 Hz.
The detection device according to any one of claims 4 to 11, wherein the detection module further comprises:

A first optical assembly, disposed above the first light detector, includes a filter layer and an optical path guiding structure, the optical path guiding structure is used to receive the fingerprint light signal and guide the fingerprint light signal to the first light Detector.
The detection device according to claim 14, wherein the optical path guiding structure comprises at least one of the following structures: a collimation layer, an optical lens layer, a microlens and at least one diaphragm layer.
The detection device according to any one of claims 1 to 15, characterized in that, the detection device further comprises: a processor, the detection module is connected to the processor, and the processor is used for according to the at least One frame of the first fingerprint image signal is used to detect the user's fingerprint, and a PPG signal is acquired according to the multiple frames of the second fingerprint image to detect the user's breathing frequency.
The detection device according to claim 16, wherein the processor is used for:

The PPG signal is decomposed by using the empirical mode decomposition EMD algorithm to obtain a plurality of eigenmode functions IMF;

The breathing frequency signal of the user is acquired according to the multiple IMFs and the upper envelope of the PPG signal, so as to detect the breathing frequency of the user.
The detection device according to claim 17, wherein the processor is configured to:

determining at least one target IMF in the plurality of IMFs according to the correlation of the plurality of IMFs with the upper envelope of the PPG signal;

reconstructing the at least one target IMF to form the respiratory rate signal;

The breathing frequency of the user is determined from the spectrogram of the breathing frequency signal.
A method for detecting biometric information, characterized in that it is applied to a detection device for biometric information disposed below a display screen of an electronic device, the detection method comprising:

Collecting the optical signal of the fingerprint reflected or scattered by the user's finger from the optical signal emitted by the display screen to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, the data amount of the first fingerprint image is larger than that of the The data volume of the second fingerprint image;

Transmitting the at least one frame of the first fingerprint image and the multiple frames of the second fingerprint image to the processor, the at least one frame of the first fingerprint image signal is used for fingerprint detection of the user, and the multiple frames of the second fingerprint The images are used to acquire photoplethysmography PPG signals for detection of the user's breathing rate.
The detection method according to claim 19, wherein each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal is subjected to empirical modal decomposition The multiple eigenmode functions IMF after EMD and the upper envelope of the PPG signal are used to detect the breathing frequency of the user.
The detection method according to claim 20, wherein the correlation between the multiple IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF in the multiple IMFs;

The at least one target IMF is used to reconstruct the respiratory rate signal;

The spectrogram of the breathing frequency signal is used to determine the breathing frequency of the user.
The detection method according to any one of claims 19 to 21, wherein the detection device comprises: a first light detector, and the first light detector comprises: a plurality of first light detection units formed by a first light detection array;

The collecting of the fingerprint light signal after the light signal emitted by the display screen is reflected or scattered by the user's finger to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, including:

During the first period, the first light detection area in the first light detection array collects the fingerprint light signal to obtain the at least one frame of the first fingerprint image;

During the second period, the second light detection area in the first light detection array collects the fingerprint light signal to obtain the multiple frames of second fingerprint images;

Wherein, the number of the first light detection units in the first light detection area is greater than the number of the first light detection units in the second light detection area.
The detection method according to claim 22, wherein the sum or average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form one signal value of the PPG signal.
The detection method according to claim 22, wherein the second light detection area in the first light detection array collects the fingerprint light signal to obtain the multi-frame second fingerprint images, comprising:

summing or averaging the data detected by the first light detection unit in the second light detection area to form the multiple frames of second fingerprint images;

Wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and the one pixel value is used to form one signal value of the PPG signal.
The detection method according to claim 22, wherein collecting the fingerprint light signal from the second light detection area in the first light detection array to obtain the multiple frames of the second fingerprint image, comprising:

configuring the first light detection units in the second light detection area to be turned on at the same time to collect the fingerprint light signals to obtain the multiple frames of the second fingerprint images;

Wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and the one pixel value is used to form one signal value of the PPG signal.
The detection method according to any one of claims 22 to 25, wherein the first light detection area in the first light detection array collects the fingerprint light signal to obtain the at least one frame of the first fingerprint images, including:

The first light detection area collects the fingerprint light signal at a first frequency to obtain the at least one frame of the first fingerprint image;

The second light detection area in the first light detection array collects the fingerprint light signal to obtain the multiple frames of the second fingerprint image, including:

The second light detection area is used to collect the fingerprint light signal at a second frequency to obtain the multiple frames of the second fingerprint image, wherein the first frequency is less than or equal to the second frequency.
The detection method according to any one of claims 19 to 21, wherein the detection device comprises: a first light detector and a second light detector, and the first light detector comprises: a plurality of first light detectors A first light detection array formed by a light detection unit, the second light detector includes: a second light detection array formed by at least one second light detection unit;

The acquisition of at least one frame of the first fingerprint image and multiple frames of the second fingerprint image by collecting the fingerprint light signal reflected or scattered by the user's finger from the light signal emitted by the display screen includes:

During the first period, the first light detection array collects the fingerprint light signal to obtain the at least one frame of the first fingerprint image;

During the second period, the second light detection array collects the fingerprint light signal to obtain the multi-frame second fingerprint images;

Wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.
The detection method according to claim 27, wherein each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form a signal value of the PPG signal .
The detection method according to claim 27, wherein collecting the fingerprint light signal by the first light detection array to obtain the at least one frame of the first fingerprint image comprises:

The first light detection array collects the fingerprint light signal at a first frequency to obtain the at least one frame of the first fingerprint image;

The second light detection array collects the fingerprint light signal to obtain the multiple frames of the second fingerprint image, including:

The second light detection array collects the fingerprint light signal at a second frequency to acquire the multiple frames of the second fingerprint image, wherein the first frequency is less than or equal to the second frequency.
The detection method according to claim 26 or 29, wherein the second period is greater than a first preset threshold, and the second frequency is greater than a second preset threshold, so as to ensure the signal quality of the PPG signal .
The detection method according to claim 30, wherein the first preset threshold is 20 seconds, and the second preset threshold is 100 Hz.
An electronic device, comprising: a display screen, and

The detection device for biometric information according to any one of claims 1 to 15, wherein the detection device is arranged below the display screen.
The electronic device of claim 32, wherein the electronic device further comprises a processor, the processor being configured to:

Controlling the detection module in the detection device to collect the optical signal of the fingerprint after the optical signal emitted by the display screen is reflected or scattered by the user's finger to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image;

performing fingerprint detection of the user according to the at least one frame of the first fingerprint image signal;

The PPG signal is acquired according to the multiple frames of the second fingerprint images to detect the breathing frequency of the user.
The electronic device of claim 33, wherein the processor is configured to:

The PPG signal is decomposed by using the empirical mode decomposition EMD algorithm to obtain a plurality of eigenmode functions IMF;

The breathing frequency signal of the user is acquired according to the multiple IMFs and the upper envelope of the PPG signal, so as to detect the breathing frequency of the user.
The electronic device of claim 34, wherein the processor is configured to:

determining at least one target IMF in the plurality of IMFs according to the correlation of the plurality of IMFs with the upper envelope of the PPG signal;

reconstructing the at least one target IMF to form the respiratory rate signal;

The breathing frequency of the user is determined from the spectrogram of the breathing frequency signal.