WO2022126665A1 - Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique - Google Patents

Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique Download PDF

Info

Publication number
WO2022126665A1
WO2022126665A1 PCT/CN2020/137796 CN2020137796W WO2022126665A1 WO 2022126665 A1 WO2022126665 A1 WO 2022126665A1 CN 2020137796 W CN2020137796 W CN 2020137796W WO 2022126665 A1 WO2022126665 A1 WO 2022126665A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
signal
fingerprint
fingerprint image
detection
Prior art date
Application number
PCT/CN2020/137796
Other languages
English (en)
Chinese (zh)
Inventor
丁大禹
青小刚
廖志川
杨小强
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to PCT/CN2020/137796 priority Critical patent/WO2022126665A1/fr
Publication of WO2022126665A1 publication Critical patent/WO2022126665A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons

Definitions

  • the present application relates to the field of electronic technology, and more particularly, to a detection device, detection method and electronic device for biometric information.
  • respiratory rate is a medical term for the number of breaths per minute, a rise and fall of the chest cavity is a breath, and a breath per minute is the respiratory rate.
  • Respiratory rate is a sensitive indicator of acute respiratory dysfunction, and also an important indicator to measure whether a person's heart function is good or not and whether gas exchange is normal.
  • a pulse wave detection module is provided on the surface of the electronic device to detect the user's pulse wave signal for analysis and extraction of respiratory rate information.
  • the pulse wave detection module is arranged on the surface of the electronic device, which affects the overall aesthetics of the electronic device, and the separate arrangement of the pulse wave detection module will also increase the cost of the electronic device.
  • the pulse wave detection module can only realize the detection of biological features related to the pulse wave, and the function is relatively single.
  • a detection device and detection method for biometric information are provided, so as to realize the detection of various biometric information and reduce the cost of the electronic equipment in which the biometric information is located, which has great application prospect and market value.
  • the present application provides a biometric information detection device, a detection method and an electronic device, which can realize the detection of various biometric information and reduce the cost of the electronic device.
  • a detection device for biometric information which is arranged below a display screen of an electronic device, and the detection device includes: a detection module, which is used for collecting light signals emitted by the display screen after reflection or reflection by a user's finger.
  • the scattered fingerprint light signal is used to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, the data volume of the first fingerprint image is greater than that of the second fingerprint image, wherein the at least one frame of the first fingerprint image
  • the image signal is used to detect the user's fingerprint, and the multiple frames of the second fingerprint images are used to obtain a photoplethysmography PPG signal to detect the user's breathing frequency.
  • the detection module is arranged below the display screen, and the display unit of the display screen is used as the excitation light source, so as to obtain the fingerprint light signal reflected or scattered by the finger above the display screen, and based on the fingerprint light
  • the signal acquires at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, and then performs the user's fingerprint detection based on the at least one frame of the first fingerprint image signal, and acquires the PPG signal based on the multiple frames of the second fingerprint image to detect the user's breathing frequency. , so as to realize the detection of various biometric information of the detection device.
  • the embodiments of the present application compared with the technical solution of separately disposing a pulse wave detection module including the first excitation light source and the first light detection device, and separately disposing the fingerprint detection module of the second excitation light source and the second light detection device, the embodiments of the present application
  • the display unit of the multiplexed display screen is used as the excitation light source for fingerprint detection and pulse wave detection, which can reduce the cost of the biometric information detection device.
  • the detection module that realizes fingerprint detection and PPG detection is disposed below the display screen instead of the surface or other areas of the electronic device, which is beneficial to improve the overall aesthetics of the electronic device.
  • the data volume of the first fingerprint image used for fingerprint detection is larger than the data volume of the second fingerprint image used for respiratory frequency detection, and the data volume of the first fingerprint image is large, which is beneficial to improve the fingerprint detection efficiency.
  • the accuracy of the second fingerprint image is small, which is beneficial to improve the transmission speed of the second fingerprint image and the sampling rate of the second fingerprint image, thereby improving the quality of the PPG signal and improving the accuracy of respiratory rate detection.
  • each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal undergoes a plurality of eigenmode functions after empirical mode decomposition EMD
  • the IMF and the upper envelope of the PPG signal are used to detect the breathing frequency of the user.
  • the fluctuation degree of the upper envelope of the PPG signal can reflect the breathing change of the user. Therefore, the user's breathing frequency signal is determined according to the upper envelopes of multiple IMF and PPG signals, and then breathing is performed. Frequency detection can obtain more accurate detection results of respiratory frequency.
  • the correlation between the plurality of IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF in the plurality of IMFs; the at least one target IMF is used to reconstruct the respiratory frequency signal; the spectrogram of the breathing frequency signal is used to determine the breathing frequency of the user.
  • the detection module includes: a first photodetector, including: a first photodetection array formed by a plurality of first photodetection units; during the first period, the first photodetector in the first photodetection array A light detection area is used to collect the fingerprint light signal to obtain the at least one frame of the first fingerprint image; in the second period, the second light detection area in the first light detection array is used to collect the fingerprint light signal to obtain the fingerprint image. Multiple frames of second fingerprint images; wherein the number of first light detection units in the first light detection area is greater than the number of first light detection units in the second light detection area.
  • two functions of fingerprint image detection and PPG signal detection can be realized through one optical detection device, that is, the first optical detector. While improving user experience, the detection device and its electronic components are further reduced. The overall cost of the equipment.
  • the sum or average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal.
  • the first photodetector further includes: an arithmetic unit connected to the first photodetection array; the arithmetic unit is used for data detected by the first photodetection unit in the second photodetection area Summing or averaging is performed to form each frame of the second fingerprint image in the multiple frames of the second fingerprint image; wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used for A signal value that forms the PPG signal.
  • each frame of the second fingerprint image is processed to include only one pixel value, and the processed second fingerprint image of each frame is used for transmission to the processor of the electronic device where the detection device is located, and can be further processed to form a PPG A value in the signal.
  • the data transmission speed between the first photodetector and the processor can be further improved, so as to further improve the sampling rate of the second fingerprint image.
  • the first photodetector further includes: a control unit connected to the first photodetection array; the control unit is configured to configure the first photodetection units in the second photodetection area to be turned on at the same time, Obtain the multi-frame second fingerprint image by collecting the fingerprint light signal; wherein, each frame of the second fingerprint image in the multi-frame second fingerprint image includes a pixel value, and the pixel value is used to form a signal of the PPG signal value.
  • the first light detection area in the first time period, is used for collecting the fingerprint light signal at a first frequency, and in the second time period, the second light detection area is used for collecting the fingerprint light signal at a second frequency Collect the fingerprint optical signal, wherein the first frequency is less than or equal to the second frequency.
  • the detection module includes: a first photodetector, including: a first photodetection array formed by a plurality of first photodetection units; a second photodetector, including: at least one second photodetector The second photodetection array formed by the unit; in the first period, the first photodetection array is used to collect the fingerprint light signal to obtain the at least one frame of the first fingerprint image; in the second period, the second photodetection array uses collecting the fingerprint light signal to obtain the multiple frames of the second fingerprint image; wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.
  • the fingerprint image detection function is realized by the first photodetector, and the PPG signal detection is realized by the second photodetector. Independent control, and in the event of failure, it is easy to carry out maintenance separately.
  • the fingerprint image detection and PPG signal detection functions are independent of each other and do not affect each other. When one of the detection functions fails, the other detection function can still be used normally, thereby further improving the user experience.
  • each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form a signal value of the PPG signal.
  • the second photodetector only includes one second photodetecting unit, so each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and the second photodetector can have a higher
  • the sampling rate collects the fingerprint light signal to obtain multiple frames of the second fingerprint image signal, and the data transmission speed of the second fingerprint image is fast.
  • the first light detection array is used to collect the fingerprint light signal at a first frequency
  • the second light detection array is used to collect the fingerprint light signal at a second frequency Collect the fingerprint optical signal, wherein the first frequency is less than or equal to the second frequency.
  • the second time period is greater than a first preset threshold
  • the second frequency is greater than a second preset threshold, so as to ensure the signal quality of the PPG signal.
  • the first preset threshold is 20 seconds
  • the second preset threshold is 100 Hz.
  • the detection module further includes: a first optical component disposed above the first photodetector, including a filter layer and an optical path guiding structure, the optical path guiding structure is used for receiving the fingerprint light signal, and directing the fingerprint light signal to the first light detector.
  • a first optical component disposed above the first photodetector, including a filter layer and an optical path guiding structure, the optical path guiding structure is used for receiving the fingerprint light signal, and directing the fingerprint light signal to the first light detector.
  • the optical path guiding structure includes at least one of the following structures: a collimation layer, an optical lens layer, a microlens and at least one diaphragm layer.
  • the detection module is connected to a processor of the electronic device, and the processor is configured to detect the user's fingerprint according to the at least one frame of the first fingerprint image signal, and detect the user's fingerprint according to the multiple frames of the second fingerprint image
  • the PPG signal is acquired for detection of the user's breathing rate.
  • the processor is configured to: decompose the PPG signal by using an empirical mode decomposition (EMD) algorithm to obtain a plurality of eigenmode functions IMF; according to the plurality of IMFs and the upper envelope of the PPG signal The user's breathing frequency signal is acquired to detect the user's breathing frequency.
  • EMD empirical mode decomposition
  • the processor is configured to: determine at least one target IMF in the plurality of IMFs according to the correlation between the plurality of IMFs and the upper envelope of the PPG signal; The breathing frequency signal is formed; the breathing frequency of the user is determined according to the spectrogram of the breathing frequency signal.
  • a method for detecting biometric information is provided, which is applied to a device for detecting biometric information disposed below a display screen of an electronic device, the detection method comprising: collecting an optical signal emitted by the display screen to pass through a user's finger The reflected or scattered fingerprint light signal to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, the data volume of the first fingerprint image is greater than the data volume of the second fingerprint image; transmitting the at least one frame of the first fingerprint image The fingerprint image and the multiple frames of the second fingerprint image are sent to the processor, the at least one frame of the first fingerprint image signal is used for fingerprint detection of the user, and the multiple frames of the second fingerprint image is used to obtain the photoplethysmography PPG signal to The detection of the breathing frequency of the user is performed.
  • each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal undergoes a plurality of eigenmode functions after empirical mode decomposition EMD
  • the IMF and the upper envelope of the PPG signal are used to detect the breathing frequency of the user.
  • the correlation between the plurality of IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF in the plurality of IMFs; the at least one target IMF is used to reconstruct the respiratory frequency signal; the spectrogram of the breathing frequency signal is used to determine the breathing frequency of the user.
  • the detection device includes: a first light detector, the first light detector includes: a first light detection array formed by a plurality of first light detection units; the collection of light emitted by the display screen The fingerprint light signal after the signal is reflected or scattered by the user's finger to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, including: in the first period, the first light detection area in the first light detection array collecting the fingerprint light signal to obtain the at least one frame of the first fingerprint image; during the second period, the second light detection area in the first light detection array collects the fingerprint light signal to obtain the multiple frames of the second fingerprint image; wherein , the number of the first light detection units in the first light detection area is greater than the number of the first light detection units in the second light detection area.
  • the sum or average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal.
  • collecting the fingerprint light signal in the second light detection area in the first light detection array to obtain the multiple frames of the second fingerprint image includes: detecting the first light in the second light detection area The data detected by the unit is summed or averaged to form the multi-frame second fingerprint image; wherein, each frame of the second fingerprint image in the multi-frame second fingerprint image includes a pixel value, and the one pixel value is used to form the multi-frame second fingerprint image.
  • a signal value of the PPG signal is detecting the first light in the second light detection area The data detected by the unit is summed or averaged to form the multi-frame second fingerprint image; wherein, each frame of the second fingerprint image in the multi-frame second fingerprint image includes a pixel value, and the one pixel value is used to form the multi-frame second fingerprint image.
  • collecting the fingerprint light signal in the second light detection area in the first light detection array to acquire the multiple frames of the second fingerprint image includes: configuring the first light detection area in the second light detection area The unit is turned on at the same time to collect the fingerprint light signal to obtain the multiple frames of the second fingerprint image; wherein, each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form the PPG A signal value for the signal.
  • the first light detection area in the first light detection array collects the fingerprint light signal to acquire the at least one frame of the first fingerprint image, including: the first light detection area collects at a first frequency the fingerprint optical signal to acquire the at least one frame of the first fingerprint image; the second optical detection area in the first optical detection array collects the fingerprint optical signal to acquire the multiple frames of the second fingerprint image, including: the second optical detection The area is used to collect the fingerprint light signal at a second frequency to obtain the multiple frames of the second fingerprint image, wherein the first frequency is less than or equal to the second frequency.
  • the detection device includes: a first photodetector and a second photodetector
  • the first photodetector includes: a first photodetection array formed by a plurality of first photodetection units
  • the two-light detector includes: a second light detection array formed by at least one second light detection unit; the fingerprint light signal after the light signal emitted by the display screen is reflected or scattered by the user's finger is collected to obtain at least one frame of the first fingerprint An image and multiple frames of second fingerprint images, including: in a first period of time, the first light detection array collects the fingerprint light signal to obtain the at least one frame of the first fingerprint image; in a second period of time, the second light detection array collects The fingerprint light signal is used to obtain the multiple frames of the second fingerprint image; wherein, the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.
  • each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes a pixel value, and the one pixel value is used to form a signal value of the PPG signal.
  • collecting the fingerprint light signal by the first light detection array to obtain the at least one frame of the first fingerprint image includes: the first light detection array collects the fingerprint light signal at a first frequency to obtain the fingerprint light signal. At least one frame of the first fingerprint image; the second light detection array collects the fingerprint light signal to obtain the multiple frames of the second fingerprint image, comprising: the second light detection array collects the fingerprint light signal at a second frequency to obtain the multiple frames. Frame a second fingerprint image, wherein the first frequency is less than or equal to the second frequency.
  • the second time period is greater than a first preset threshold
  • the second frequency is greater than a second preset threshold, so as to ensure the signal quality of the PPG signal.
  • the first preset threshold is 20 seconds
  • the second preset threshold is 100 Hz.
  • an electronic device comprising: a display screen, and a detection device for biometric information in the first aspect or any embodiment of the first aspect, wherein the detection device is arranged below the display screen .
  • the electronic device further includes a processor, and the processor is configured to: control the detection module in the detection device to collect the fingerprint light signal after the light signal emitted by the display screen is reflected or scattered by the user's finger to Obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image; perform fingerprint detection of the user according to the at least one frame of the first fingerprint image signal; detection.
  • the processor is configured to: decompose the PPG signal by using an empirical mode decomposition (EMD) algorithm to obtain a plurality of eigenmode functions IMF; according to the plurality of IMFs and the upper envelope of the PPG signal The user's breathing frequency signal is acquired to detect the user's breathing frequency.
  • EMD empirical mode decomposition
  • the processor is configured to: determine at least one target IMF in the plurality of IMFs according to the correlation between the plurality of IMFs and the upper envelope of the PPG signal; The breathing frequency signal is formed; the breathing frequency of the user is determined according to the spectrogram of the breathing frequency signal.
  • the cost of the electronic device can be reduced on the basis of realizing the detection of various biometric information.
  • FIG. 1 is a structural block diagram of an electronic device to which the biometric information detection system in the present application is applied.
  • FIG. 2 is a schematic front view of an electronic device to which the device for detecting biometric information provided by the embodiment of the present application is applied.
  • Fig. 3 is a schematic view of a partial cross-sectional structure of the electronic device shown in Fig. 2 along A-A'.
  • FIG. 4 is a schematic structural diagram of a detection module provided by an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of another detection module provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a PPG signal provided by an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of another electronic device to which the apparatus for detecting biometric information provided by the embodiment of the present application is applied.
  • FIG. 8 is a schematic flowchart of a method for detecting biometric information provided by an embodiment of the present application.
  • FIG. 9 is a schematic flowchart of step S340 in FIG. 8 .
  • 10 to 15 are schematic diagrams of some waveforms provided by the embodiments of the present application.
  • FIG. 16 is a schematic flowchart of another method for detecting biometric information provided by an embodiment of the present application.
  • FIG. 17 is a schematic flowchart of another method for detecting biometric information provided by an embodiment of the present application.
  • FIG. 18 is a schematic flowchart of another method for detecting biometric information provided by an embodiment of the present application.
  • the present application can be applied to a biometric information detection system, including but not limited to a respiratory rate detection system.
  • the biometric information detection system can be applied to various types of electronic devices, and the electronic devices can be mobile terminals, including but not limited to mobile phones, smart wearable devices, tablet computers, mobile medical devices, and the like.
  • FIG. 1 shows a structural block diagram of an electronic device to which the biometric information detection system in this application is applicable.
  • the electronic device 10 may include a bus 110 , a processor 120 , a memory 130 , an input/output interface 140 , a display 150 , a communication interface 160 and a detection system 170 for biometric information.
  • Bus 110 may include circuitry that enables communication (eg, control messages or data) between components in electronic device 10 .
  • the bus 110 may include: a serial peripheral interface (Serial Peripheral Interface, SPI) communication bus, which is used to implement data communication between the biometric information detection system 170 and the processor 120.
  • SPI Serial Peripheral Interface
  • the bus 110 may further include other types of communication buses, which are not specifically limited in this embodiment of the present application.
  • Processor 120 may include one or more types of data processors for performing data processing.
  • the processor 120 may be a microcontroller unit (Microcontroller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or other types of processors, which are not specifically limited in this embodiment of the present application.
  • MCU microcontroller Unit
  • CPU Central Processing Unit
  • Memory 130 may include volatile memory and/or non-volatile memory. It may store instructions or data related to other functional components in the electronic device 10 .
  • the input/output interface 140 may be used to receive instructions or data input from a user or an external device, and then transmit them to other functional components in the electronic device 10, or may output instructions or data generated by other functional components in the electronic device 10 to the electronic device 10. user or external device.
  • the display 150 may include, for example, a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED) display, or other types of displays.
  • the display 150 may display various types of content, such as text, images, videos, icons, etc., to the user. Further, the display 150 may include a touch screen, and the user may input relevant instruction information through the touch screen.
  • the communication interface 160 may be used to implement communication between the electronic device 10 and external devices, such as a web server or other electronic devices.
  • the communication interface 160 may be connected to a communication network through wireless or wired communication to communicate with external devices.
  • the wireless communication includes but is not limited to cellular communication or short-range communication.
  • Wired communication includes but is not limited to at least one of Universal Serial Bus (Universal Serial Bus, USB), High Definition Multimedia Interface (High Definition Multimedia Interface, HDMI), Recommended Standard 232 (RS-232) or other communication methods.
  • the biometric information detection system 170 is used to detect the user's biometric information
  • the biometric information includes but is not limited to: the user's fingerprint, heart rate, respiratory rate, blood oxygen saturation, blood pressure and other parameter information, which can pass the test The optical signal after passing through the user's finger, from which biometric signals such as fingerprint images and pulse waves are obtained.
  • the biometric information detection system 170 in this embodiment of the present application can be used to detect the user's biometric signal. to obtain one or more biometric information of users.
  • the electronic device 10 may omit at least one of the above components, or may further include other components, which will not be described in detail here.
  • the embodiment of the present application relates to an apparatus for detecting biometric information, which can be applied to the biometric information detection system 170 in FIG. 1 and is provided in the electronic device 10 in FIG. 1 .
  • the biometric information detection device involved in the embodiments of the present application can be arranged below the display screen without occupying the surface space of the electronic device, which is conducive to realizing a full-screen design of the electronic device and improving the overall appearance of the electronic device. Spend.
  • FIGS. 2 and 3 show schematic diagrams of an electronic device 10 to which the apparatus 200 for detecting biometric information according to an embodiment of the present application can be applied, wherein FIG. 3 is a schematic front view of the electronic device 10 , and FIG. The schematic diagram of the partial cross-sectional structure of the electronic device 10 along AA'.
  • the detection device 200 is configured to be disposed below the above-mentioned display screen 170 , and the detection device 200 for biometric information includes:
  • the detection module 210 is configured to receive the fingerprint light signal 112 after the light signal 111 of the display screen 170 is reflected or scattered by the user's finger 180 above the display screen 170 to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image,
  • the data volume of the first fingerprint image is greater than the data volume of the second fingerprint image, wherein at least one frame of the first fingerprint image signal is used for fingerprint detection and/or fingerprint identification of the user, and multiple frames of the second fingerprint image are used to obtain Pulse wave signal for detection of user's breathing rate.
  • the user's finger 180 may be pressed against the display area in the display screen 170 .
  • the display screen 170 may be a display screen having a self-luminous display unit, such as an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display screen or a micro-light-emitting diode (Micro-LED) display screen.
  • OLED Organic Light-Emitting Diode
  • Micro-LED micro-light-emitting diode
  • the detection module 210 can use a display unit (ie, an OLED light source) located in the pressing area of the finger 180 in the OLED display screen 170 as an excitation light source for optical fingerprint detection.
  • the display screen 170 When the finger 180 presses the display area in the display screen 170, the display screen 170 emits a light beam 111 to the finger 180, and the light 111 is reflected on the surface of the finger 180 to form reflected light or scattered inside the finger 180 to form scattered light.
  • the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Since the ridges and valleys of the fingerprint have different reflection capabilities for light, the reflected light from the fingerprint ridges and the reflected light from the fingerprint valleys have different light intensities, and the reflected light is the fingerprint light signal 112,
  • the fingerprint information includes fingerprint ridges and fingerprint valleys. After the fingerprint light signal 112 passes through the display screen 170, it is received by the detection module 210 located below the display screen 170, and a fingerprint image signal can be further formed.
  • the detection module 210 may also use the display unit (ie, the OLED light source) located in the pressed area of the finger 180 in the OLED display screen 170 as the excitation light source for pulse wave detection.
  • the excitation light source emits the light beam 111 to irradiate the surface of the finger 180
  • the contraction and expansion of the blood vessel will affect the transmission, reflection or scattering of light during each heartbeat.
  • light passes through the skin tissue and then reflects, the light signal will be attenuated to a certain extent.
  • the absorption of light by muscles, bones, veins and other connecting tissues is basically unchanged (if there is no large-scale movement of the measurement site), but the arteries will be different.
  • a pulse wave signal may be further formed, or, hereinafter, the pulse wave signal may also be referred to as a photoplethysmography (PPG) signal.
  • PPG photoplethysmography
  • the above-mentioned PPG signal can be used for detection of various biometric information of the user, and the biometric information includes but is not limited to the user's breathing frequency, heart rate, blood pressure, blood oxygen, etc., which is not specifically described in this embodiment of the present application. limited.
  • the biometric information includes but is not limited to the user's breathing frequency, heart rate, blood pressure, blood oxygen, etc., which is not specifically described in this embodiment of the present application. limited.
  • the detection module is arranged below the display screen, and the display unit of the display screen is used as the excitation light source, so as to obtain the fingerprint light signal reflected or scattered by the finger above the display screen, and based on the fingerprint light
  • the signal acquires at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, and then performs the user's fingerprint detection based on the at least one frame of the first fingerprint image signal, and acquires the PPG signal based on the multiple frames of the second fingerprint image to detect the user's breathing frequency.
  • the embodiments of the present application In the technical solution, the display unit of the multiplexed display screen is used as the excitation light source for fingerprint detection and pulse wave detection, which can reduce the cost of the biometric information detection device. Further, the detection module that realizes fingerprint detection and PPG detection is disposed below the display screen instead of the surface or other areas of the electronic device, which is beneficial to improve the overall aesthetics of the electronic device.
  • the data volume of the first fingerprint image used for fingerprint detection is larger than the data volume of the second fingerprint image used for respiratory frequency detection, and the data volume of the first fingerprint image is large, which is beneficial to improve the fingerprint detection efficiency.
  • the accuracy of the second fingerprint image is small, which is beneficial to improve the transmission speed of the second fingerprint image and the sampling rate of the second fingerprint image, thereby improving the quality of the PPG signal and improving the accuracy of respiratory rate detection.
  • FIG. 4 shows a schematic structural diagram of a detection module 210 .
  • the detection module 210 includes a first photodetector 211
  • the first photodetector 211 includes: a first photodetection array formed by a plurality of first photodetection units 2111 .
  • the first photodetection units 2111 specifically It may include a photodiode (PD) or other types of light detection devices, for correspondingly receiving the fingerprint light signal 112 and converting the fingerprint light signal into a corresponding fingerprint image signal through a photoelectric conversion effect.
  • PD photodiode
  • the first photodetector 211 may further include other auxiliary circuits for electrical connection with the first photodetection array, for controlling the operation and reading of the first photodetector array
  • the fingerprint image signal generated by the first photodetection array is taken and transmitted, and the first photodetection array and its auxiliary circuits can be fabricated in a chip (Die) by a semiconductor process, such as an optical imaging chip or an optical imaging sensor.
  • the first photodetection area in the first photodetection array is used to collect the fingerprint light signal 112 to acquire at least one frame of the first fingerprint image.
  • the second photodetection area in the first photodetection array is used to acquire multiple frames of second fingerprint images after collecting the fingerprint light signal 112 .
  • the area of the first photodetection area is larger than the area of the second photodetection area, or in other words, the number of the first photodetection units 2111 in the first photodetection area is larger than that of the first photodetection units in the second photodetection area 2111 quantity.
  • the above-mentioned first light detection area includes all the first light detection units 2111 in the first light detection array, and the above-mentioned second light detection area only includes a part of the first light detection units 2111 in the first light detection array.
  • the first fingerprint image and the second fingerprint image can be directly detected through the first light detection area and the second light detection area, and the number of the first light detection units 2111 in the first light detection area is larger than that of the second fingerprint image.
  • the number of first photodetection units 2111 in the photodetection area that is, the number of pixels in the first fingerprint image is greater than the number of pixels in the second fingerprint image, so that the data volume of the first fingerprint image is greater than that of the second fingerprint image.
  • the above-mentioned multiple frames of the second fingerprint image can be transmitted to the processor of the electronic device where the detection apparatus 200 is located, or to the processor in the detection apparatus 200, where the processor is used for A summation or averaging operation is performed for each frame of the second fingerprint images in the multiple frames of the second fingerprint images to form a value in the PPG signal.
  • the first photodetector 211 may include an arithmetic unit 2112, and the arithmetic unit 2112 is connected to the above-mentioned first photodetector
  • the arithmetic unit 2112 is used to sum or average the data detected by all the first photodetection units in the second photodetection area of the first photodetection array
  • each frame of the second fingerprint image is processed to include only one pixel value
  • each frame of the processed second fingerprint image is used for transmission to the processor of the electronic device where the detection device 200 is located, or the processor in the detection device 200, Further processing may be performed to form a value in the PPG signal.
  • the data transmission speed between the first photodetector 2111 and the processor can be further improved, so as to further improve the sampling rate of the second fingerprint image.
  • the first photodetector 211 may include a control unit 2113, and the control unit 2113 is connected to the above-mentioned first photodetector
  • the control unit 2113 is used to configure all the first photodetection units in the second photodetection area in the first photodetection array to be turned on at the same time, so as to collect the fingerprint optical signal 112 and acquire multiple frames of second fingerprint images.
  • all the first light detection units in the second light detection area can be equivalent to one large light detection unit, and each frame of the second fingerprint images in the multiple frames of the second fingerprint images obtained by the second light detection area only includes one pixel value, the one pixel value is used to form one signal value of the PPG signal.
  • each frame of the second fingerprint image acquired by the second detection area includes only one pixel value, and each frame of the second fingerprint image is used for transmission to the processor of the electronic device where the detection apparatus 200 is located, or The processor in the detection device 200 may further process to form a value in the PPG signal.
  • the data transmission speed between the first photodetector 2111 and the processor can be further improved, so as to further improve the sampling rate of the second fingerprint image.
  • the operating frequency of the first light detection area is the first frequency, that is, the first light detection area collects the fingerprint light signal 112 at the first frequency f1, and within the first time period t1, t1/
  • the f1 frame of the first fingerprint image signal, and one or more frames of the first fingerprint image signal in the t1/f1 frame of the first fingerprint image signal is used for fingerprint detection and/or fingerprint identification.
  • the operating frequency of the second light detection area is the second frequency, that is, the second light detection area collects the fingerprint light signal 112 at the second frequency f2, and in the second time period t2, a second fingerprint frame of t2/f2 is formed
  • the image signal, the second fingerprint image signal of the t2/f2 frame is used to form the PPG signal.
  • the first frequency f1 is less than or equal to the second frequency f2
  • the first time period t1 is less than the second time period t2.
  • the second frequency f2 is greater than or equal to 100 Hz, and the second time period t2 is greater than or equal to 20 s.
  • ensuring that the second frequency f2 is greater than a certain preset threshold, for example, the second frequency f2 is greater than or equal to 100 Hz, can ensure the accuracy of the collected second fingerprint image signal, and ensure that the second time period t2 is greater than a certain preset threshold,
  • the second period t2 is greater than or equal to 20s, which can ensure that sufficient frames of the second fingerprint image signal are collected to form the PPG signal within the second period t2, which can improve the accuracy of the biometric information detected based on the PPG signal.
  • the area of the first light detection area is larger than the area of the second light detection area, so that the large area of the first light detection area can be used to detect a large area of fingerprint images, thereby improving the fingerprint detection efficiency.
  • the second light detection area with a small area is used to detect the PPG signal.
  • the exposure time of the second light detection area is reduced, and the data transmission time is reduced, taking into account the first light detector.
  • the power consumption is reduced and the detection efficiency is improved.
  • different light detection areas in the first light detector 211 are used to detect fingerprint light signals in different time periods to form fingerprint image signals and PPG signals.
  • two functions of fingerprint image detection and PPG signal detection can be realized through the first photodetector 211, so that the biometric information detection device 200 in the embodiment of the application can realize fingerprint detection and detection of PPG signals.
  • the detection of various biometric information such as respiratory rate detection provides the user with various biometric information, which not only improves user experience, but also reduces the overall cost of the detection device 200 and the electronic equipment in which it is located.
  • the detection module 210 further includes a first optical component 212 , and the first optical component 212 may be disposed in the first light detection array of the first light detector 211
  • the filter layer can be used to filter out ambient light that penetrates the finger, for example, the filter layer can be
  • the infrared filter layer is used to filter out ambient light signals in the infrared band.
  • the light guide layer or the light path guide structure is mainly used to guide the reflected light reflected from the finger surface to the first light detection array for optical detection.
  • the first optical component 212 and the first photodetector 211 may be packaged in the same component.
  • the first optical component 212 and the first optical detector 211 can be packaged in the same optical imaging chip, or the first optical component 212 can be arranged outside the chip where the first optical detector 211 is located, for example, the first optical The component 212 is attached above the chip, or some components of the first optical component 212 are integrated into the above-mentioned chip.
  • the light guide layer may be a collimator layer fabricated on a semiconductor silicon wafer, which has multiple A collimation unit or a micro-hole array
  • the collimation unit can be specifically a small hole, in the fingerprint light signal 112 reflected from the finger, the light incident perpendicular to the collimation unit can pass through and be detected by the first light below it
  • the unit 2111 receives, and the light with an excessively large incident angle is attenuated by multiple reflections inside the collimation unit, so each first light detection unit 2111 can basically only receive the reflected light from the fingerprint pattern directly above it, Therefore, the first light detector 211 can detect the fingerprint image signal of the finger.
  • the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspherical lenses, which are used for The reflected light reflected from the finger is concentrated to the first light detection array formed by the first light detection unit 2111 of the first light detector 211 below it, so that the first light detection array can perform imaging based on the reflected light , so as to obtain the fingerprint image of the finger.
  • the optical lens layer may further be formed with pinholes in the optical path of the lens unit, and the pinholes may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device to improve the fingerprint imaging effect of the optical fingerprint device 130 .
  • the light guide layer or the light path guide structure may also specifically use a micro-lens (Micro-Lens) layer, and the micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be produced by a semiconductor growth process or other The process is formed over the first light detection array of the first light detector 211, and each microlens may correspond to one or more of the first light detection units 2111 of the first light detection array, respectively.
  • a micro-lens Micro-Lens
  • the micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be produced by a semiconductor growth process or other The process is formed over the first light detection array of the first light detector 211, and each microlens may correspond to one or more of the first light detection units 2111 of the first light detection array, respectively.
  • optical film layers such as a dielectric layer or a passivation layer, may also be formed between the microlens layer and the first light detection array, and more specifically, between the microlens layer and the first light detection array It includes at least one diaphragm layer, each diaphragm layer of the at least one diaphragm layer is formed with a small hole corresponding to the microlens and the first light detection unit 2111, and the at least one diaphragm layer can block the phase.
  • a dielectric layer or a passivation layer may also be formed between the microlens layer and the first light detection array, and more specifically, between the microlens layer and the first light detection array It includes at least one diaphragm layer, each diaphragm layer of the at least one diaphragm layer is formed with a small hole corresponding to the microlens and the first light detection unit 2111, and the at least one diaphragm layer can block the phase.
  • the optical interference between the adjacent microlens and the first light detection unit 2111, and the small holes in at least one diaphragm layer can form a light guide channel in a specific direction, which is used to condense the light signal in a specific direction by the microlens
  • the transmission is directed into the first light detection unit 2111 corresponding to the microlens.
  • the microlens corresponds to a first light detection unit 2111
  • a light guide channel in one direction is formed in at least one diaphragm layer between the microlens and the first light detection unit 2111
  • the lens corresponds to a plurality of first light detection units 2111 , and light guide channels in multiple directions are formed in at least one diaphragm layer between the microlenses and the first light detection units 2111 .
  • a microlens layer may be further provided under the collimator layer or the optical lens layer.
  • a microlens layer may be further provided under the collimator layer or the optical lens layer.
  • the collimator layer or the optical lens layer is used in combination with the microlens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.
  • the detection module 210 further includes a first circuit board 213 , and the first circuit board 213 is disposed below the first photodetector 211 .
  • the first photodetector 211 can be adhered to the first circuit board 213 through an adhesive layer, and is electrically connected to the first circuit board 213 through an electrical connection device.
  • the first circuit board 213 includes, but is not limited to, a Printed Circuit Board (PCB), a Flexible Printed Circuit (FPC), a rigid-flex board or other types of circuit boards.
  • the electrical connection device includes However, it is not limited to metal wires, electrical connectors, or other types of electrical connection devices, which are not specifically limited in the embodiments of the present application.
  • the first photodetector 211 can realize electrical interconnection and signal transmission with other peripheral circuits or other electrical components through the first circuit board 213 .
  • the first photodetector 211 can receive the control signal of the processor of the electronic device where it is located through the first circuit board 213 , and can also output the fingerprint image signal to the processor of the electronic device where it is located through the first circuit board 213 .
  • FIG. 5 shows a schematic structural diagram of another detection module 210 .
  • the detection module 210 may include the first light detector 211 and the second light detector 214 , and the second light detector 214 and the first light detector 211 are disposed below the display screen 170 together.
  • the above-mentioned first light detector 211 is used to collect the fingerprint light signal 112 to obtain at least one frame of the first fingerprint image; and the second light detector 214 is used to collect the fingerprint light signal 112 to obtain multiple frames of the second fingerprint image.
  • the structure of the second light detector 214 may be similar to the structure of the first light detector 211 described above.
  • the second light detector 214 may include: at least one second light detection unit 2141 formed Two light detection arrays, for example, the second light detector 214 may include only one second light detection unit 2141 .
  • the second photodetector 214 may be disposed on the above-mentioned first circuit board 215 , or a second circuit board may be separately disposed below it.
  • the relevant descriptions of the first light detection unit 2111 and the first light detector 211 above which will not be repeated here. .
  • the number of the first light detection units 2111 in the first photodetector 211 is greater than the number of the second light detection units 2141 in the second photodetector 214, so that the number of pixel values in the first fingerprint image is greater than The number of pixel values in the second fingerprint image, so that the data volume of the first fingerprint image is larger than the data volume of the second fingerprint image.
  • the second light detector 214 includes only one second light detection unit 2141, and at this time, the second light detector 214 can collect fingerprint light signals at a higher sampling rate 112 to acquire multiple frames of the second fingerprint image signal, wherein each frame of the second fingerprint image signal only includes one pixel value, so the data transmission speed of the second fingerprint image is fast.
  • the second light detector 214 may also include a plurality of second light detection units 2141, and each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes multiple pixel values.
  • the multi-frame second fingerprint images can be transmitted to the processor of the electronic device where the detection apparatus 200 is located, or the processor in the detection apparatus 200, the processor is used for each frame of the second fingerprint in the multi-frame second fingerprint images The images are summed or averaged to form a value in the PPG signal.
  • the second photodetector 214 may further include an arithmetic unit, and the arithmetic unit is connected to the above-mentioned second photodetector Array, in the process of collecting the second fingerprint image of each frame, the arithmetic unit is used to sum or average the data detected by all the second light single detection units in the above-mentioned second light detection array to obtain the second fingerprint image of each frame , therefore, each frame of the second fingerprint image is processed to include only one pixel value, and the processed second fingerprint image of each frame is used for transmission to the processor of the electronic device where the detection apparatus 200 is located, or the processing in the detection apparatus 200 In the processor, further processing may be performed to form a value in the PPG signal.
  • the second light detector 214 may further include a control unit, and the control unit is connected to the above-mentioned second light detection units The control is used to configure all the second light detection units in the second light detection array to be turned on at the same time, so as to collect the fingerprint light signal 112 and acquire multiple frames of the second fingerprint image.
  • all the second light detection units in the second light detection array may be equivalent to one large light detection unit, similar to the above case where the second light detection array only includes one second light detection unit, the second light detection unit
  • Each frame of the second fingerprint images obtained by the array detection includes only one pixel value, and the one pixel value is used to form one signal value of the PPG signal.
  • the working frequency of the first light detector 211 is the first frequency, that is, the first light detection array in the first light detector 211 collects the fingerprint light signal 112 at the first frequency f1, and within the first time period t1, A t1/f1 frame of the first fingerprint image signal is formed, and one or more frames of the first fingerprint image signal in the t1/f1 frame of the first fingerprint image signal are used for fingerprint detection and/or fingerprint identification.
  • the operating frequency of the second photodetector 214 is the second frequency, that is, the second photodetector array in the second photodetector 214 collects the fingerprint optical signal 112 at the second frequency f2, and in the second time period t2, t2/f2 is formed frame the second fingerprint image signal, the t2/f2 frame of the second fingerprint image signal is used to form the PPG signal.
  • the first frequency f1 is less than or equal to the second frequency f2
  • the first time period t1 is less than the second time period t2.
  • the second frequency f2 is greater than or equal to 100 Hz, and the second time period t2 is greater than or equal to 20 s.
  • the detection module 210 includes a first light detector 211 and a second light detector 214, wherein the first light detector 211 is used to acquire at least one frame of the first fingerprint image signal, and the second light The detector 214 is used to acquire multiple frames of the second fingerprint image signal to form a PPG signal.
  • the fingerprint image detection function is realized by the first photodetector 211
  • the PPG signal detection is realized by the second photodetector. Independent control and easy maintenance in case of failure.
  • the fingerprint image detection and PPG signal detection functions are independent of each other and do not affect each other. When one of the detection functions fails, the other detection function can still be used normally, thereby further improving the user experience.
  • the first time period and the second time period are different time periods.
  • the fingerprint detection function is performed in conjunction with the electronic device where the display screen 170 is located, and the detection module 210 is configured to collect the fingerprint light signal 112 to acquire at least one frame of the first fingerprint image.
  • the electronic device performs a respiratory rate detection function, and the detection module 210 is used for collecting the fingerprint light signal 112 to obtain multiple frames of the second fingerprint image.
  • the electronic device where the detection apparatus 200 is located may receive indication information input by the user, where the indication information is used to instruct to start executing the respiratory rate detection function. Further, a local area in the display screen 170 emits light to display a light spot on the display screen 170, and the user's finger 180 is pressed on the light spot. Furthermore, in the second period, the detection module 210 acquires multiple frames of second fingerprint images. Optionally, the electronic device may determine whether to prompt the user to continue pressing by judging the number of frames of the acquired second fingerprint image, so that multiple frames of the second fingerprint image are used to form a PPG signal that meets certain requirements.
  • the light signal emitted by the display screen 170 to the user's finger 180 during the first period may be different from the light signal emitted by the display screen 170 to the user's finger 180 during the second period.
  • the display screen 170 in the first period, is used to transmit a white light signal to the user's finger, and in the second period, the display screen 170 is used to transmit a green light signal to the user's finger.
  • the white light signal with higher intensity can be used to form the first fingerprint image with better quality, so as to improve the accuracy of fingerprint detection.
  • the absorption degree of the green light signal by blood is the highest.
  • the green light signal The formed second fingerprint image can obtain a PPG signal with better quality, so as to improve the accuracy of respiratory rate detection.
  • the display screen 170 may also transmit other different types of light signals to the user's finger 180 or may transmit the same light signal to the user's finger 180 , which is not specifically limited in this embodiment of the present application .
  • the second fingerprint image signal of the t2/f2 frame in the second fingerprint image signal of the t2/f2 frame, all pixel values of the second fingerprint image signal of each frame are used to process and form the PPG signal.
  • One signal value, the t2/f2 frame second fingerprint image signal is used to form t2/f2 signal values to form the PPG signal.
  • the sum of all pixel values of the second fingerprint image signal of each frame, or the average value of all pixel values, or the maximum value of all pixel values is used for processing to form one signal value in the PPG signal.
  • the first photodetection area and the second photodetection area in the first photodetection array of the first photodetector 211 collect the fingerprint optical signal 112 at the same time period to Acquire at least one frame of the first fingerprint image and multiple frames of the second fingerprint image. It can be understood that, if the second photodetection area is a local area in the first photodetection area, the second fingerprint image is a local area image in the first fingerprint image.
  • the first photodetector array in the first photodetector 211 and the second photodetector array in the second photodetector 214 collect the fingerprint optical signal 112 at the same time period to acquire at least one frame A first fingerprint image and multiple frames of a second fingerprint image.
  • the detection device 200 can acquire the first fingerprint image and the second fingerprint image in the same time period, and complete the functions of fingerprint detection and respiratory rate detection in the same time period.
  • FIG. 6 shows a schematic diagram of a PPG signal.
  • the PPG signal in FIG. 6 is a PPG signal formed by the above-mentioned t2/f2 signal values after signal processing such as filtering and denoising, and the PPG signal may be one of the signals formed by the above-mentioned t2/f2 signal values.
  • Alternating Current (AC) component is a PPG signal formed by the above-mentioned t2/f2 signal values after signal processing such as filtering and denoising.
  • AC Alternating Current
  • the detection module 210 included in the biometric information detection device 200 is used to detect the fingerprint light signal, specifically, the detection module 210 includes the first photodetector 211, or the detection module 210 includes the first photodetector 211 and a second photodetector 214, the photodetector is used for receiving the fingerprint light signal and performing photoelectric conversion to obtain the first fingerprint image signal and the second fingerprint image signal.
  • FIG. 7 shows another schematic structural diagram of the electronic device 10 where the detection apparatus 200 is located in the present application.
  • the electronic device 10 in addition to the detection device 200, the electronic device 10 further includes a processor 120, and the processor 120 is electrically connected to the detection module 210 in the detection device 200. Electrically connected to the first photodetector 211 in the detection module 210, or alternatively, also electrically connected to the first photodetector 211 and the second photodetector 214 in the detection module 210, the processor 120 is configured to receive the above The detection module 210 detects the fingerprint image signal, and detects various biometric information according to the fingerprint image signal.
  • the detection device 200 further includes a microprocessor, which is electrically connected to the detection module 210, and the microprocessor is configured to receive the fingerprint image signal detected by the above-mentioned detection module 210, and perform various biological processes according to the fingerprint image signal. Detection of feature information.
  • FIG. 8 shows a schematic flowchart of a method 300 for detecting biological feature information configured and executed by the processor 120 of the electronic device where the detection apparatus 200 is located or the microprocessor in the detection apparatus 200 as an execution subject.
  • the detection method 300 includes:
  • S310 Control the detection module to collect the fingerprint light signal to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image signal;
  • S320 Receive at least one frame of the first fingerprint image, and perform fingerprint detection and/or fingerprint identification according to the at least one frame of the first fingerprint image;
  • S330 Receive multiple frames of second fingerprint image signals, and process based on the multiple frames of second fingerprint image signals to obtain a PPG signal;
  • step S310 in the first period of time, the detection module is controlled to collect fingerprint light signals to obtain at least one frame of the first fingerprint image, and in the second period of time, the detection module is controlled to collect the fingerprint light signals to obtain multiple frames of second fingerprint images Signal.
  • the process of controlling the detection module to collect the fingerprint light signal to obtain the first fingerprint image and the second fingerprint image please refer to the above-mentioned related processes of the execution of the first photodetector and the second photodetector. It can be understood that the above The image acquisition functions of the first photodetector and the second photodetector herein can be controlled and performed by the processor.
  • the processor receives at least one frame of the first fingerprint image signal sent by the detection module 210.
  • the processor may directly receive one or more frames of the at least one frame of the first fingerprint image signal.
  • Fingerprint detection and/or fingerprint recognition is performed on the frame of the first fingerprint image signal, or the processor may perform digital image processing on the at least one frame of the first fingerprint image signal, and then perform fingerprint detection and/or fingerprint recognition.
  • the digital image processing process includes, but is not limited to, digital image processing processes such as binning and filtering, which are not specifically limited in this embodiment of the present application.
  • fingerprint detection and/or fingerprint identification can be performed based on at least one frame of the first fingerprint image signal.
  • the specific algorithm for fingerprint detection and/or fingerprint identification according to the fingerprint image can be implemented by any algorithm in the related art.
  • the application examples also do not specifically discuss this.
  • step S330 in this embodiment of the present application, within a preset period of time, for example, within the second period of time t2 above, multiple frames of second fingerprint image signals are received, and each frame of the multiple frames of second fingerprint image signals has a second fingerprint signal.
  • the fingerprint image signal is used to form a signal value in the PPG signal.
  • multiple frames of the second fingerprint image signal form a plurality of signal values that vary with time within the second period t2 to form the PPG signal within the second period t2.
  • step S340 it can be understood that, in addition to detecting the user's breathing frequency according to the PPG signal, other biometric information such as the user's blood pressure, blood oxygen, and heart rate can also be performed according to the PPG.
  • an empirical mode decomposition (Empirical Mode Decomposition, EMD) algorithm can be used to decompose the PPG signal to obtain multiple eigenmode functions (Intrinsic Mode Function, IMF), and according to the multiple eigenmode functions (Intrinsic Mode Function, IMF)
  • IMF Intrinsic Mode Function
  • IMF Intrinsic Mode Function
  • the upper envelope of the IMF and PPG signals acquires the user's breathing frequency signal, so as to detect the user's breathing frequency.
  • the fluctuation degree of the upper envelope of the PPG signal can reflect the breathing change of the user. Therefore, the user's breathing frequency signal is determined according to the upper envelopes of multiple IMFs and PPG signals, Further, the respiratory frequency detection is performed, and a relatively accurate detection result of the respiratory frequency can be obtained.
  • the EMD algorithm may be used to determine and obtain multiple IMFs, and then the user's breathing frequency signal may be obtained directly based on multiple IMFs.
  • the embodiments of the application do not limit the specific algorithm for detecting the breathing frequency of the user according to the PPG signal.
  • FIG. 9 shows a schematic flowchart of the above step S340.
  • step S340 may include:
  • S341 Decompose the PPG signal by using the empirical mode decomposition EMD algorithm to obtain a plurality of eigenmode functions IMF of the PPG signal;
  • S342 Determine at least one target IMF in the multiple IMFs according to the correlation between the multiple IMFs and the upper envelope of the PPG signal;
  • S344 Perform Fourier transform on the breathing frequency signal to obtain a spectrogram of the breathing frequency signal
  • S345 Determine the breathing frequency of the user according to the spectrogram.
  • the PPG signal is represented as s(t), and the process of decomposing the PPG signal by using the EMD algorithm to obtain multiple IMFs includes:
  • step (5) to judge whether d(t) is IMF, it is necessary to judge whether d(t) satisfies two conditions of the IMF signal: (1) In the entire data segment, the number of extreme points and The number of zero crossings must be equal or differ by at most one. (2) At any time, the average value of the upper envelope formed by the local maximum points and the lower envelope formed by the local minimum points is zero, that is, the upper and lower envelopes are local relative to the time axis. symmetry. If d(t) satisfies the above two conditions at the same time, it is considered that d(t) is IMF, otherwise, d(t) is not IMF.
  • the correlation between each of the multiple IMFs and the upper envelope of the PPG signal is determined, and the correlation is used to measure whether each IMF is "like" with the upper envelope.
  • the correlation between the IMF and the upper envelope can be determined by determining the covariance or the correlation coefficient between the IMF and the upper envelope.
  • Cov(X, Y) E[(X–E(X))(Y–E(Y))], which can be described as: (Signal X minus X expectation) multiplied by the expectation of (signal Y minus Y expectation).
  • Corr(X, Y) Cov(X, Y)/ ⁇ X ⁇ Y; that is to say, divide the covariance of X and Y by the standard deviation of X and Y to get Correlation coefficient of signals X and Y.
  • the covariance or correlation coefficient between an IMF and the upper envelope is greater than or equal to a preset threshold, it may be determined that the IMF is more similar to the upper envelope. If the covariance or correlation coefficient between an IMF and the upper envelope is smaller than the preset threshold, it can be determined that the similarity between the IMF and the upper envelope is small, and the IMF is not the target IMF.
  • the correlation between the IMF and the upper envelope is determined, which is not specifically limited in this embodiment of the present application.
  • the target IMFs in the at least one target IMF determined in the above step S342 are reconstructed to obtain a respiratory frequency signal.
  • all target IMFs determined in the above step S342 are reconstructed to obtain a respiratory frequency signal.
  • the i-th target IMF can be expressed as imfi
  • FIGS. 10 to 15 show schematic diagrams of some waveforms in the above step S340.
  • FIG. 11 to FIG. 13 show the first IMF, the second IMF and the third IMF of the PPG signal, wherein the second IMF and the third IMF are determined as the above-mentioned target IMF after correlation calculation.
  • FIG. 14 shows the respiration frequency signal after reconstruction of the second IMF and the third IMF.
  • FIG. 15 shows the spectrum of FIG. 14 after Fourier transformation.
  • the frequency point corresponding to the maximum amplitude value is about 0.3 Hz, that is, the user's breathing frequency (breathing times) per second is about 0.3 times, then the user's breathing per minute is about 0.3 times.
  • the frequency (number of breaths) is about 18 times.
  • the embodiments of the present application also provide a method 400 for detecting biometric information using the above detection apparatus 200 as an execution subject. It should be understood that the following embodiments of the detection method 400 correspond to the above-mentioned embodiments of the detection apparatus 200, and for similar descriptions, reference may be made to the above-mentioned apparatus embodiments.
  • FIG. 16 shows a schematic flowchart of a detection method 400 provided by an embodiment of the present application.
  • the method 400 for detecting biometric information is applied to a device for detecting biometric information disposed below a display screen of an electronic device, and the method 400 includes:
  • S410 Collect the fingerprint light signal reflected or scattered by the user's finger from the light signal emitted by the display screen to obtain at least one frame of the first fingerprint image and multiple frames of the second fingerprint image, where the data volume of the first fingerprint image is larger than that of the second fingerprint image amount of data;
  • S420 Transmit at least one frame of the first fingerprint image and multiple frames of the second fingerprint image to the processor, where the at least one frame of the first fingerprint image signal is used for fingerprint detection of the user, and the multiple frames of the second fingerprint image are used to acquire the photoplethysmography
  • the PPG signal is traced for detection of the user's breathing rate.
  • the processor in this embodiment of the present application may be the processor 120 in the above electronic device or the microprocessor in the detection apparatus 200, for executing the above detection method 300.
  • each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form a signal value of the PPG signal, and the PPG signal is subjected to the empirical mode decomposition EMD of multiple eigenmode functions IMF and PPG The upper envelope of the signal is used to detect the user's breathing rate.
  • the correlation between the multiple IMFs and the upper envelope of the PPG signal is used to determine at least one target IMF among the multiple IMFs; the at least one target IMF is used to reconstruct the respiratory rate signal; the respiratory rate The spectrogram of the signal is used to determine the user's breathing rate.
  • the detection device includes: a first light detector, and the first light detector includes: a first light detection array formed by a plurality of first light detection units;
  • FIG. 17 shows a schematic flowchart of another detection method 400 provided by an embodiment of the present application.
  • step S410 may include:
  • the first light detection area in the first light detection array collects the fingerprint light signal to obtain at least one frame of the first fingerprint image
  • the second light detection area in the first light detection array collects fingerprint light signals to acquire multiple frames of second fingerprint images.
  • the number of the first light detection units in the first light detection area is greater than the number of the first light detection units in the second light detection area.
  • the sum or average value of pixel values of each frame of the second fingerprint image in the multiple frames of the second fingerprint image is used to form one signal value of the PPG signal.
  • the first photodetector further includes: an arithmetic unit, and in the foregoing step S412, it may further include: the arithmetic unit sums or sums the data detected by the first photodetection unit in the second photodetection area Averaging is performed to form multiple frames of the second fingerprint image, wherein each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and one pixel value is used to form one signal value of the PPG signal.
  • the first light detector further includes: a control unit.
  • the control unit configures the first light detection unit in the second light detection area to be turned on at the same time to collect fingerprint light signal to obtain multiple frames of second fingerprint images; wherein, each frame of the second fingerprint images in the multiple frames of second fingerprint images includes one pixel value, and one pixel value is used to form one signal value of the PPG signal.
  • the first light detection area collects the fingerprint light signal at the first frequency to obtain at least one frame of the first fingerprint image; in the above step S412, the second light detection area is used for The fingerprint light signal is collected at a second frequency to obtain multiple frames of second fingerprint images, wherein the first frequency is less than or equal to the second frequency.
  • the detection device includes: a first photodetector and a second photodetector, the first photodetector includes: a first photodetection array formed by a plurality of first photodetection units, and the second photodetector The device includes: a second light detection array formed by at least one second light detection unit;
  • FIG. 18 shows a schematic flowchart of another detection method 400 provided by an embodiment of the present application.
  • step S410 may include:
  • the first light detection array collects the fingerprint light signal to obtain at least one frame of the first fingerprint image
  • the second light detection array collects fingerprint light signals to acquire multiple frames of second fingerprint images.
  • the number of the first light detection units in the first light detection array is greater than the number of the second light detection units in the second light detection array.
  • each frame of the second fingerprint image in the multiple frames of the second fingerprint image includes one pixel value, and one pixel value is used to form one signal value of the PPG signal.
  • the above step S413 may include: the first light detection array collects the fingerprint light signal at the first frequency to obtain at least one frame of the first fingerprint image; the above step S414 may include: the second light detection array The fingerprint optical signal is collected at two frequencies to obtain multiple frames of second fingerprint images, wherein the first frequency is less than or equal to the second frequency.
  • the second time period is greater than the first preset threshold, and the second frequency is greater than the second preset threshold, so as to ensure the signal quality of the PPG signal.
  • the first preset threshold is 20 seconds
  • the second preset threshold is 100 Hz.
  • the present application further provides an electronic device, which may include any of the above-mentioned embodiments.
  • a detection device 200 for biometric information may include any of the above-mentioned embodiments.
  • the electronic device may be any electronic device with a display screen, optionally, the display screen may be the display screen 170 described above, wherein the biometric information detection device 200 is disposed below the display screen 170 .
  • the detection device 200 may be arranged under the display screen 170 in any manner.
  • the detection device 200 may be fixedly connected under the display screen 170 through an adhesive layer, or , in other embodiments, the detection device 200 can be fixedly connected under the display screen 170 through a bracket, or, in other embodiments, the detection device 200 can also be fixedly arranged on the middle frame of the electronic device, thereby being arranged in the Below the display screen 170 , the embodiment of the present application does not specifically limit the arrangement of the detection device 200 below the display screen 170 .
  • the lower surface of the display screen 170 is generally provided with a light shielding layer.
  • the detection module 210 receives that a window needs to be provided in the shading layer, and the detection module 210 is correspondingly arranged below the window, so that the detection module 210 can receive the fingerprint light signal 112 passing through the window.
  • the electronic device in this embodiment of the present application may further include the processor 120 in the above-mentioned embodiment of the application.
  • the processor 120 may be configured to execute the above method 300 for detecting biometric information.
  • the processor or processing unit in this embodiment of the present application may be an integrated circuit chip, which has a signal processing capability.
  • each step of the above method embodiments may be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software.
  • the above-mentioned processor can be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other available Programming logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art.
  • the storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.
  • the detection apparatus and/or the electronic device in this embodiment of the present application may further include a memory, and the memory may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memory. It should be noted that the memory of the systems and methods described herein is intended to include, but not be limited to, these and any other suitable types of memory.
  • the disclosed system, apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-readable storage medium.
  • the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art or the parts of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes .

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un appareil de détection et un procédé de détection d'informations biométriques, et un dispositif électronique. Un appareil de détection (200) des informations biométriques est disposé sous un écran d'affichage (170) d'un dispositif électronique (10). L'appareil de détection (200) comprend : un module de détection (210), conçu pour collecter un signal optique d'empreinte digitale (112) obtenu par réflexion ou diffusion, par les doigts d'un utilisateur, d'un signal optique (111) émis par l'écran d'affichage (170) de manière à obtenir au moins une trame de première image d'empreinte digitale et de multiples trames de secondes images d'empreinte digitale, le volume de données de la première image d'empreinte digitale étant supérieur à celui des secondes images d'empreinte digitale. La ou les trames du signal de première image d'empreinte digitale sont conçues pour effectuer une détection d'empreinte digitale de l'utilisateur, et les multiples trames de secondes images d'empreinte digitale sont conçues pour obtenir un signal de photopléthysmographie (PPG) afin de détecter une fréquence respiratoire de l'utilisateur. L'appareil de détection et le procédé de détection des informations biométriques et le dispositif électronique peuvent réaliser la détection de multiples informations biométriques et réduire le coût du dispositif électronique.
PCT/CN2020/137796 2020-12-18 2020-12-18 Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique WO2022126665A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/137796 WO2022126665A1 (fr) 2020-12-18 2020-12-18 Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/137796 WO2022126665A1 (fr) 2020-12-18 2020-12-18 Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique

Publications (1)

Publication Number Publication Date
WO2022126665A1 true WO2022126665A1 (fr) 2022-06-23

Family

ID=82060018

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/137796 WO2022126665A1 (fr) 2020-12-18 2020-12-18 Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique

Country Status (1)

Country Link
WO (1) WO2022126665A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115349854A (zh) * 2022-08-25 2022-11-18 合肥工业大学 用于腕背侧手指运动检测的光电成像装置及其应用方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170083779A1 (en) * 2014-08-26 2017-03-23 Gingy Technology Inc. Fingerprint identification apparatus and biometric signals sensing method using the same
WO2017113347A1 (fr) * 2015-12-31 2017-07-06 Shanghai Oxi Technology Co., Ltd Système et procédé de détection d'état de santé pour détecter un état de santé
US10331939B2 (en) * 2017-07-06 2019-06-25 Shenzhen GOODIX Technology Co., Ltd. Multi-layer optical designs of under-screen optical sensor module having spaced optical collimator array and optical sensor array for on-screen fingerprint sensing
CN109934137A (zh) * 2019-02-28 2019-06-25 维沃移动通信有限公司 一种光电指纹识别装置、终端及指纹识别方法
CN110383286A (zh) * 2019-05-22 2019-10-25 深圳市汇顶科技股份有限公司 用于生物识别的方法、指纹识别装置和电子设备
EP3603507A1 (fr) * 2018-08-01 2020-02-05 Samsung Electronics Co., Ltd. Appareil et procédé de mesure d'informations biologiques

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170083779A1 (en) * 2014-08-26 2017-03-23 Gingy Technology Inc. Fingerprint identification apparatus and biometric signals sensing method using the same
WO2017113347A1 (fr) * 2015-12-31 2017-07-06 Shanghai Oxi Technology Co., Ltd Système et procédé de détection d'état de santé pour détecter un état de santé
US10331939B2 (en) * 2017-07-06 2019-06-25 Shenzhen GOODIX Technology Co., Ltd. Multi-layer optical designs of under-screen optical sensor module having spaced optical collimator array and optical sensor array for on-screen fingerprint sensing
EP3603507A1 (fr) * 2018-08-01 2020-02-05 Samsung Electronics Co., Ltd. Appareil et procédé de mesure d'informations biologiques
CN109934137A (zh) * 2019-02-28 2019-06-25 维沃移动通信有限公司 一种光电指纹识别装置、终端及指纹识别方法
CN110383286A (zh) * 2019-05-22 2019-10-25 深圳市汇顶科技股份有限公司 用于生物识别的方法、指纹识别装置和电子设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LI WEN-BIAO, CHEN ZHEN-CHENG,LIU FU-BIN.LI WEN-BIAO: "Extraction of Respiratory Wave from Finger Tip Photolethysmography Signals Based on EMD Method", SPACE MEDICINE & MEDICAL ENGINEERING, vol. 23, no. 4, 15 August 2010 (2010-08-15), pages 279 - 282, XP055942478, ISSN: 1002-0837, DOI: 10.16289/j.cnki.1002-0837.2010.04.016 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115349854A (zh) * 2022-08-25 2022-11-18 合肥工业大学 用于腕背侧手指运动检测的光电成像装置及其应用方法

Similar Documents

Publication Publication Date Title
Nemcova et al. Monitoring of heart rate, blood oxygen saturation, and blood pressure using a smartphone
US20220104719A1 (en) Personal Healthcare Device
Sun et al. Photoplethysmography revisited: from contact to noncontact, from point to imaging
CN112674739B (zh) 生物特征信息的检测装置、检测方法和电子设备
US11538272B2 (en) Apparatus and method for measuring signal and obtaining bio-information
Wang et al. Multichannel reflective PPG earpiece sensor with passive motion cancellation
US10478078B2 (en) Device and method for determining vital signs of a subject
EP2967376B1 (fr) Dispositif et procédé pour déterminer des signes vitaux chez un sujet
US11009390B2 (en) Methods and systems for modulation and demodulation of optical signals
US20100113948A1 (en) Heart rate measurement
US20100331640A1 (en) Use of photodetector array to improve efficiency and accuracy of an optical medical sensor
CN107106017A (zh) 用于提取生理信息的设备、系统和方法
CN105009173A (zh) 用于确定对象的血氧饱和度的设备和方法
US11653883B2 (en) Systems and methods for acquiring PPG signals for measuring blood pressure
AU2015202922A1 (en) Systems and methods for processing signals with repetitive features
US10206582B2 (en) Human sleep monitoring device and monitoring method thereof
WO2011026986A1 (fr) Dispositif optique de détection d'un signal pléthysmographique à l'aide d'un imageur matriciel
CA3086402A1 (fr) Systemes, dispositifs et procedes pour effectuer une oxymetrie fƒtale trans-abdominale et/ou une oxymetrie de pouls fƒtale trans-abdominale a l'aide d'une analyse independante de composantes
Lu et al. A prototype of reflection pulse oximeter designed for mobile healthcare
WO2022126665A1 (fr) Appareil de détection et procédé de détection d'informations biométriques, et dispositif électronique
TWI563969B (zh) 生理資訊之計算機分析方法及裝置
US11025843B2 (en) Device and method for the continuous and non-invasive determination of physiological parameters of a test subject
Tamura et al. Photoplethysmogram
CN209951236U (zh) 光学影像脉象量测系统
RU2199943C2 (ru) Способ и устройство регистрации пульсовой волны и биометрическая система

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20965678

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20965678

Country of ref document: EP

Kind code of ref document: A1