CN110141197B

CN110141197B - Electronic equipment with display screen

Info

Publication number: CN110141197B
Application number: CN201910518507.9A
Authority: CN
Inventors: 彭赛煌; 曹焕杰; 张博
Original assignee: Mobvoi Information Technology Co Ltd
Current assignee: Mobvoi Information Technology Co Ltd
Priority date: 2019-06-15
Filing date: 2019-06-15
Publication date: 2022-04-12
Anticipated expiration: 2039-06-15
Also published as: CN110141197A

Abstract

The present disclosure provides an electronic device with a display screen for acquiring physiological and/or pathological characteristics of a user by collecting biometric information of the user. This electronic equipment with display screen includes: the PPG light receiving unit is used for receiving the light signals and converting the light signals into pulse wave signals; and a PPG acquisition unit for receiving and processing the pulse wave signals from the PPG light receiving unit to acquire the physiological and/or pathological characteristics of the user, wherein the display screen is arranged to enable the reflected part of the light emitted by the display screen to the first side to pass through the display screen to the second side opposite to the first side and be received by the PPG light receiving unit arranged on the second side, so that the electronic equipment with the display screen can acquire the biological characteristic information of the user based on the photoplethysmography.

Description

Electronic equipment with display screen

Technical Field

The present disclosure relates to an electronic device with a display screen, which may be used to obtain physiological and/or pathological characteristics of a user by collecting biometric information of the user.

Background

Wearable devices such as smart watches and bracelets can provide various functions as smart terminals for users, and can monitor the motion characteristics and even biological characteristics of the users through specific sensors, provide various information of the users from time tracking to health, including time reporting, step counting, position, motion track, heart rate or heartbeat detection, sleep tracking, blood pressure monitoring and the like, especially the information related to health, and after corresponding processing, the wearable devices can be used for reflecting the physiological and/or pathological characteristics of the users, so that potential problems of the users such as cardiovascular aspects can be analyzed. Similarly, a wearable device using an MCU (micro control unit), such as an earphone, may also monitor the motion characteristics and/or biological characteristics of the user through a specific sensor to implement the above functions corresponding to the wearable device.

In the existing wearable device providing the health-related features, the user's biometric features can be continuously and anytime acquired by keeping contact with the skin at the user's wrist through sensors for health measurement, such as PPG (photoplethysmography) sensors, ECG (ElectroCardioGram) sensors, etc., provided at the back of the smart watch, thereby providing corresponding health-related information.

However, when the biometric features of the user are collected by these sensors, if the wrist of the user is in a motion state, the credibility of the biometric features collected by the sensors may be affected, thereby affecting the credibility of the provided health-related information; furthermore, the manner in which the wearable device is worn at the user's wrist may result in the sensor not being able to make proper contact with the measured area of the wrist, such that the degree of trustworthiness of the sensor to acquire biometric characteristics may be affected, as well as the degree of trustworthiness of the provided health-related information.

Therefore, the biometric features of the user collected by the existing wearable device cannot be reliably used to obtain the physiological and/or pathological features of the user due to their lack of confidence.

On the other hand, even for other electronic devices with display screens that can provide a special location to set up the PPG sensor, including mobile phones with PPG units (e.g. set up the PPG sensor on the back of the mobile phone), tablet computers (e.g. set up the PPG sensor on the back of the tablet computer), and even medical PPG measurement devices (provided with a separate PPG sensor that can be clipped on the finger), although a more reliable biometric can be obtained by placing the user's finger properly over the PPG sensor, the PPG sensor must contain a special PPG light-emitting unit, and there is room for further improvement in such existing electronic devices, both from the viewpoint of product cost and from the viewpoint of product convenience.

Disclosure of Invention

To solve at least one of the above technical problems, the present disclosure provides an electronic device with a display screen for obtaining physiological and/or pathological characteristics of a user by collecting biometric information of the user. This electronic equipment with display screen includes: the PPG light receiving unit is used for receiving the light signals and converting the light signals into pulse wave signals; and a PPG acquisition unit for receiving and processing the pulse wave signals from the PPG light receiving unit to acquire the physiological and/or pathological characteristics of the user, wherein the display screen is arranged to enable the reflected part of the light emitted by the display screen to the first side to pass through the display screen to the second side opposite to the first side and be received by the PPG light receiving unit arranged on the second side, so that the electronic equipment with the display screen can acquire the biological characteristic information of the user based on the photoplethysmography.

According to some embodiments of the present disclosure, in an electronic device with a display screen, light emitted by the display screen to a first side is reflected by a finger of a user pressing on a surface of the first side of the display screen and transmitted through the display screen to a second side.

According to some embodiments of the present disclosure, the electronic device with a screen further includes a control unit, wherein the control unit controls the display screen such that at least a portion of display pixels in a contact area of the display screen with the finger and display pixels at a periphery of the contact area emit light so that the display screen can emit light to the first side, and such that at least another portion of the display pixels in the contact area is maximally transparent so that light reflected by the finger can pass through the contact area to the second side and be received by the PPG light receiving unit.

According to some embodiments of the present disclosure, in an electronic device with a display screen, the display screen includes a touch module, and the touch module is configured to implement human-computer interaction of the electronic device by detecting a contact state of a finger with a screen, wherein if a position of contact of the finger detected by the touch module with the display screen is not at a preset position, the control unit controls display pixels around a contact area of the display screen not to emit light and sends information to a user to remind the user to place the finger at the preset position.

According to some embodiments of the present disclosure, the electronic device with the display screen further includes an adjusting unit, wherein the adjusting unit controls the size of the contact area and/or the light-emitting intensity of the display pixels around the contact area according to the contact area, the contact time and/or the contact pressure of the finger with the display screen, which are detected by the touch module.

According to some embodiments of the present disclosure, in the electronic device with the display screen, an infrared light emitter is further disposed on the second side of the display screen and near the PPG light-receiving unit to emit infrared light toward the first side, and the control unit controls the infrared light emitter to emit infrared light and controls display pixels around the contact area to emit red light for the PPG acquisition unit to acquire the blood oxygen saturation and the blood perfusion index.

According to some embodiments of the present disclosure, the electronic device with a display screen further includes a motion sensor, the motion sensor is configured to detect a state of a user, and if the motion sensor detects that the user is in a motion state, the control unit controls display pixels around a contact area of the display screen not to emit light and sends a message to the user to remind the user to stop moving; and if the motion sensor detects that the user is in a static state, the control unit controls display pixels around a contact area of the display screen to emit light and the transparency degree of the display pixels in the contact area to be maximum.

According to some embodiments of the present disclosure, the electronic device with a display screen further includes a quality determination unit, wherein the quality determination unit is configured to determine quality of the pulse wave signal, and when the biometric information of the user is acquired, the adjustment unit adjusts emission brightness, emission time, and/or sampling frequency and/or exposure time of the PPG light-receiving unit of the display pixels around the contact area of the display screen according to a determination result of the quality of the pulse wave signal by the quality determination unit.

According to some embodiments of the present disclosure, in an electronic device with a display screen, when collecting biometric information of a user, a control unit determines whether to send information to the user to remind the user that the user should be in a stationary state or to remind the user to adjust the pressing of a finger on the display screen according to a determination result of the quality of a pulse wave signal by a quality determination unit.

According to some embodiments of the present disclosure, the electronic device with a display screen further comprises an amplification and filtering unit that amplifies and filters the pulse wave signal from the PPG light-receiving unit and provides the amplified and filtered signal to the PPG acquisition unit.

The electronic equipment with the display screen can conveniently and effectively create ideal measuring conditions, collect biological characteristics of a user and acquire information with high reliability, so that high-quality physiological/pathological characteristics can be acquired; on the other hand, the display screen of the electronic equipment can be fully utilized, and the product cost is reduced.

Drawings

The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the disclosure and together with the description serve to explain the principles of the disclosure.

Fig. 1 is a schematic view of an electronic device with a display screen according to an embodiment of the present disclosure.

Fig. 2 is a schematic diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

FIG. 3 is a schematic view of an electronic device with a display screen according to an embodiment of the present disclosure.

FIG. 4 is a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

Fig. 5 is a schematic cross-sectional view of a display of an electronic device with a display according to an embodiment of the present disclosure.

Fig. 6 is a schematic cross-sectional view of a display of an electronic device with a display according to an embodiment of the present disclosure.

FIG. 7 is a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

FIG. 8 is a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

FIG. 9 is a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

FIG. 10 is a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

FIG. 11 is a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure.

Detailed Description

The present disclosure will be described in further detail with reference to the drawings and embodiments. It is to be understood that the specific embodiments described herein are for purposes of illustration only and are not to be construed as limitations of the present disclosure. It should be further noted that, for the convenience of description, only the portions relevant to the present disclosure are shown in the drawings.

It should be noted that the embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.

The present disclosure provides an electronic device with a display screen, which may be used to obtain physiological and/or pathological characteristics of a user by collecting biometric information of the user. According to the electronic equipment with the display screen, the display screen can be fully utilized, ideal measuring conditions can be conveniently and effectively created, biological characteristics of a user are collected, and information with high reliability is obtained, so that high-quality physiological/pathological characteristics are obtained, and the product cost can be reduced by fully utilizing the electronic equipment. Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings, so as to describe an electronic device with a display screen according to the present disclosure.

Fig. 1 shows an electronic device with a screen, in particular a smart watch 10 as an example of a wearable device, the smart watch 10 being provided with a display screen 100, according to an embodiment of the present disclosure. As shown in fig. 1, the electronic device with a screen (smart watch) includes: a PPG light receiving unit 200 (not shown) for receiving the light signal and converting the light signal into a pulse wave signal; and a PPG acquisition unit 300 (not shown) that receives and processes the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user.

In the electronic apparatus 10, the display screen 100 may emit light to an outer side (hereinafter referred to as "first side") of the electronic apparatus 100, the emitted light may be reflected by an object (for example, a finger of a user) on a propagation path thereof, and the display screen 100 may enable a reflected portion of the emitted light to reach an inner side (opposite to the outer side with respect to the display screen 100, hereinafter referred to as "second side") of the electronic apparatus 100 through the display screen 100, and this light reaching the inner side of the electronic apparatus 100 through the display screen 100 may be received by a PPG light-receiving unit disposed at the second side. Therefore, the electronic equipment can collect the biological characteristic information of the user based on the photoplethysmography, and further obtain the physiological and/or pathological characteristics of the user by collecting the biological characteristic information of the user.

The electronic device with the display screen according to the present disclosure may be other wearable devices with a display screen, a tablet computer with a display screen, and even a medical electrocardiogram monitoring device, besides the smart watch shown in fig. 1. Fig. 2 schematically illustrates a mobile phone 10 with a display screen 100 that may be used to obtain physiological and/or pathological characteristics of a user by collecting biometric information of the user. Similarly, the handset 10 may include: a PPG light receiving unit 200 (not shown) for receiving the light signal and converting the light signal into a pulse wave signal; and a PPG acquisition unit 300 (not shown) that receives and processes the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user. In this cellular phone 10, the display screen 100 is provided so that a reflected portion of light emitted to the first side by the display screen 100 can pass through the display screen 100 to the second side opposite to the first side and be received by the PPG light-receiving unit 200 provided at the second side, so that the cellular phone 10 can collect biometric information of the user based on photoplethysmography.

Further, fig. 3 exemplarily shows a tablet computer 10 with a display screen 100, which may be used for obtaining physiological and/or pathological characteristics of a user by collecting biometric information of the user. Likewise, the tablet computer 10 may include: a PPG light receiving unit 200 (not shown) for receiving the light signal and converting the light signal into a pulse wave signal; and a PPG acquisition unit 300 (not shown) that receives and processes the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user. In the tablet pc 10, the display screen 100 is disposed such that a reflected portion of light emitted to the first side by the display screen 100 can pass through the display screen 100 to the second side opposite to the first side and be received by the PPG light-receiving unit 200 disposed at the second side, so that the tablet pc 10 can collect biometric information of the user based on the photoplethysmography.

The PPG light receiving unit, which may also be referred to as a photoplethysmography (PPG) light receiving unit, receives light reflected by the skin of a user's finger, for example, and converts it into a pulse wave signal containing biometric information, so that the biometric information of a human body can be acquired based on the photoplethysmography. The PPG light-receiving unit may be any photosensitive sensor that has a response and/or conversion function to external light signals or optical radiation and is capable of outputting digital signals after conversion. The PPG light receiving unit may receive visible light, or may receive invisible light having a wavelength other than the visible light, such as infrared light.

Similarly, the PPG acquisition unit may be referred to as a photoplethysmography (PPG) acquisition unit, which receives and processes a pulse wave signal containing biometric information from a PPG light receiving unit, so that physiological and/or pathological characteristics of the user may be acquired. In the embodiment shown in fig. 1, the PPG acquisition unit 300 is arranged within the electronic device with a display screen, i.e. the PPG acquisition unit can perform its respective operations locally. In other embodiments of the present disclosure, the PPG acquisition unit 300 may also be disposed in the cloud, and communicate with the electronic device with a display screen through a wireless or wired data link, so as to perform its corresponding operations.

The so-called photoplethysmography is a non-invasive detection method for detecting a change in blood volume in a living tissue by means of a photoelectric means. For example, in a conventional complete PPG device, a light beam of a certain wavelength is emitted by a light emitter (e.g. LED) therein towards the skin of a specific part of the human body, which may be transmitted by transmission or reflection to a photo-receiver in the PPG device. In the process, the light intensity received by the photoelectric receiver is reduced due to the absorption and attenuation effects of muscles and blood of the skin of the irradiated part (namely the detected part) of the human body on the light beam, the absorption of the muscles and tissues of the skin on the light is kept constant in the blood circulation process, the blood volume in the skin is changed in a pulsating manner under the action of the heart, when the heart contracts, the peripheral blood volume is the largest, so that the light absorption amount is also the largest, and the detected light intensity is also the smallest; on the contrary, when the heart is in diastole, the detected light intensity is the maximum, so that the light intensity received by the photoelectric receiver presents a pulsatile change, and the pulsatile change comprises the change of volume pulse blood flow, further comprises important physiological/pathological information of a plurality of cardiovascular systems such as blood flow and the like. Then, by converting the pulsatile light intensity signal into a corresponding electrical signal (i.e., a pulse wave signal), the required physiological/pathological information can be obtained through corresponding analysis.

In an embodiment according to the present disclosure, light emitted by the display screen towards the first side is reflected by a finger of a user pressing on a surface of the first side of the display screen and transmitted through the display screen to the second side. Specifically, for example, as shown in fig. 1, for the electronic device 10 with a display screen, the user presses the finger pad of the finger tip of the user against the display screen 100, that is, against the surface of the outer side (i.e., the first side) of the display screen 100, the light emitted from the outer side of the display screen 100 is reflected by the finger, and the reflected light can reach the inner side (i.e., the second side) of the display screen 100 through the display screen, so that the PPG light receiving unit disposed at the second side can receive the reflected light and generate a pulse wave signal, so that the PPG obtaining unit can process the pulse wave signal and obtain the physiological and/or pathological features of the user.

Therefore, the user can intentionally press the display screen of the electronic device by using the finger pad of the finger tip to generate the pulse wave signal, and the electronic device can collect the biological characteristic information of the user based on the photoplethysmography. In this way, the user can obtain a good measurement condition by adjusting the pressing state of the finger with the display screen.

FIG. 4 shows a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure. As shown in fig. 4, the electronic device 10 includes: a display screen 100; a PPG light receiving unit 200 for receiving a light signal and converting the light signal into a pulse wave signal; and a PPG acquisition unit 300 receiving and processing the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user. The display screen 100 is arranged such that a reflected portion of the light emitted by the display screen 100 towards the first side is able to pass through the display screen 100 to a second side opposite to the first side and is received by the PPG light-receiving unit 200 arranged at the second side, such that the electronic device 10 is able to collect biometric information of the user based on photoplethysmography.

As described above, the display screen 100 is disposed such that the reflected portion of the light emitted by the display screen 100 to the first side can pass through the display screen 100 to the second side opposite to the first side and be received by the PPG light-receiving unit 300 disposed at the second side, so that the electronic device with the display screen can acquire biometric information of the user based on the photoplethysmography. The display screen and the related arrangement of the electronic device with the display screen according to the present disclosure are described below with reference to fig. 5 and 6.

Fig. 5 is a schematic cross-sectional view of a display of an electronic device with a display according to an embodiment of the present disclosure. As shown in fig. 5, the display screen 100 includes a top plate glass 110, a touch module 120, and a screen module 130, wherein the touch module 120 is disposed on the top plate glass 110 and the fingertip of the screen module 130.

The touch module 120 may be configured to implement human-computer interaction of the electronic device by detecting a contact state of a finger with the screen, and specifically, the touch module 120 may detect a contact area, a contact time, and/or a contact pressure of the finger with the display screen 100. In the embodiment of the present disclosure, the top plate glass 110 and the touch module 120 are transparent, and light with various wavelengths can pass through the transparent.

The screen module 130 includes display pixels capable of self-emitting light, which can emit light of a specific wavelength or not as required under controlled conditions. As desired, the display pixels may emit light having a wavelength in the visible wavelength range in a controlled state, the display screen 100 may be capable of displaying a desired static or dynamic image, or the display pixels may emit, for example, green light, red light, etc. having a specific wavelength; on the other hand, the display pixels may emit invisible light having a wavelength in the invisible light wavelength range, for example, infrared light. In addition, the display pixels can be controlled to be in a transparent state in a non-light emitting state, and the transparency degree can be maximized, so that light can pass through the top plate glass 110 and the touch module 120, then pass through the display pixels in the transparent state in the screen module 130 to reach the inner side (i.e., the second side) of the display screen 100, and be received by the PP disposed at the second side for the light receiving unit 200.

In an embodiment according to the present disclosure, the display screen 100 may be an OLED (Organic Light-Emitting Diode) display screen, and specifically may be an AMOLED (Active-matrix Organic Light-Emitting Diode) display screen or a PMOLED (Passive-matrix Organic Light-Emitting Diode) display screen.

As shown in fig. 5, a finger pad of a finger tip of a user is pressed on a surface of the top plate glass 110 of the display screen 100, an area where the finger contacts the display screen may be referred to as a contact area, and display pixels corresponding to the contact area exist in the screen module 130. The display screen is further described below in conjunction with fig. 6.

Fig. 6 is a schematic cross-sectional view of the display screen of the electronic device of the display screen shown in fig. 5, wherein the display pixels 131 around the touch area and the display pixels 132 in the touch area of the screen module 130 of the display screen 100 are shown. According to the embodiment of the present disclosure, the display pixels 131 around the contact area of the display screen, which is in contact with the finger, may emit light so that the display screen 100 can emit light to the outside of the display screen (i.e., the first side), and the transparency of the display pixels 132 in the contact area may reach the maximum so that the light can reach the inside of the display screen (i.e., the second side) through the display pixels 132 in the contact area, and the light is received by the PPG light receiving unit 200 disposed at the second side, and then the PPG light receiving unit 200 processes the received light signal and converts it into a pulse wave signal, so that the electronic device with the display screen can collect the biometric information of the user based on the photoplethysmography.

For example, in the electronic device with a display screen according to the embodiment of the present disclosure, since the comprehensive information of the morphology (wave shape), intensity (wave amplitude), velocity (wave speed), rhythm (wave period), and the like represented by the pulse wave signal can reflect a lot of physiological and pathological features of the cardiovascular system of the human body, so that the potential cardiovascular problems of the user can be resolved therefrom and delivered to the user through the electronic device itself or other means; in addition, the change of the cardiovascular health condition of the user can be monitored by observing the pulse wave signals for a long time, and the user can be reminded to take prevention and improvement in time.

In addition, through research and application of an extended model of volume pulse blood flow, the pulse wave signal may further include more information, and specifically, may include a plurality of physiological and pathological information about the circulatory system, respiratory system, etc. of the human body, and may non-invasively detect information about parameters such as blood pressure, blood flow, blood oxygen, cerebral oxygen, muscle oxygen, blood sugar, pulse rate, microcirculation, vascular resistance, respiratory rate, respiratory volume, etc. of the human body.

Therefore, the electronic device with the display screen can conveniently acquire the pulse wave signals with higher reliability of the user, further acquire credible and rich physiological/pathological information, and can meet the requirements of the user in health care and even clinical aspects, for example, the blood oxygen state of human tissues can be measured, including blood oxygen saturation measurement and muscle blood oxygen measurement, and special blood sample measurement (brain blood oxygen measurement) can be performed on important organs such as the brain, and further blood sugar can be measured by measuring blood components of the human body; the peripheral blood circulation function is measured, and potential problems such as arteriosclerosis obliterans and primary deep vein valve insufficiency can be found in advance by measuring the blood circulation function of arteries and veins; the noninvasive detection of blood flow parameters such as blood pressure, blood flow, pulse rate and the like can be carried out; microcirculation detection involving microvessels (arterioles, capillaries) can be performed; the method can also be used for estimating the respiration rate and the respiration volume and is used for athlete selection, and the power spectrum of the pulse wave signal acquired by the PPG unit contains peaks obviously related to the heart rate and the respiration rate, so that a model of the respiration rate and the respiration volume can be established.

All of the above applications are based on the availability of reliable pulse wave signals, which can be measured by professional clinical measurement equipment to obtain signals with high reliability, but are too costly and inconvenient to use and efficient. When the electronic equipment with the display screen is portable wearable equipment, a mobile phone or a tablet personal computer, signals with high reliability can be conveniently and efficiently acquired at low cost; and when the electronic equipment with the display screen according to the present disclosure is medical measuring equipment, a specially provided PPG light emitting device can be omitted, reducing product cost, and providing a convenient choice for the user to measure by directly pressing the display screen with fingers.

Reference is again made to fig. 5 and 6. As shown, an infrared light emitter 140 may be further disposed on an inner side (i.e., the second side) of the display screen 100 and near the PPG light-receiving unit 200, and may emit infrared light toward an outer side (i.e., the first side) of the display screen 100. When the display pixels 131 around the contact area of the display screen 100 emit red light and the transparency of the display pixels 132 inside the contact area reaches the maximum, the infrared light may also be transmitted to the outside of the display screen 100 through the display pixels 132 inside the contact area, so that the infrared light and the red light are reflected by the fingers and reach the inside of the display screen 100 through the display pixels 132, and the PPG light receiving unit 200 receives and provides a pulse wave signal, which includes information related to hemoglobin in blood, so that the PPG acquisition unit 300 can further acquire the blood oxygen saturation and the blood perfusion index of the human body based on the information, thereby further enriching the physiological/pathological features that can be acquired by the electronic device with a display screen according to the present disclosure.

The electronic device with a display screen according to an embodiment of the present disclosure may further include a control unit. The control unit can control the display screen, so that at least one part of display pixels in a contact area of the display screen, which is in contact with the finger, and the display pixels at the periphery of the contact area emit light, so that the display screen can emit the light to the first side, and at least another part of display pixels in the contact area are made to be maximally transparent, so that the light reflected by the finger can reach the second side through the contact area and is received by the PPG light receiving unit. In the embodiments shown in fig. 5 and 6, all display pixels in the contact area do not emit light and the degree of transparency is maximized, and accordingly the display pixels around the contact area emit light; in other embodiments, some of the display pixels in the contact area do not emit light and have the greatest degree of transparency, while another portion of the display pixels in the contact area emit light, and accordingly, the display pixels around the contact area also emit light; in one embodiment of the present disclosure, the central portion of the display pixels in the contact area do not emit light and the degree of transparency is maximized, while the display pixels in the contact area surrounding the central portion emit light, and correspondingly the display pixels at the periphery of the contact area also emit light; in other embodiments, the 4 separate circular portions of the display pixels in the contact area do not emit light and the degree of transparency is maximized, while the display pixels in the portions of the contact area other than the 4 separate circular portions emit light, and accordingly the display pixels at the periphery of the contact area also emit light.

FIG. 7 shows a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure. As shown in fig. 7, the electronic device with a display screen 10 according to this embodiment may include a control unit 400 in addition to the display screen 100, the PPG light-receiving unit 200, and the PPG acquisition unit 300. As mentioned above, the PPG light-receiving unit 200 may be used to receive the light signal and convert the light signal into a pulse wave signal, and the PPG acquisition unit 300 may receive and process the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user. The display screen 100 is arranged such that a reflected portion of the light emitted by the display screen 100 towards the first side is able to pass through the display screen 100 to a second side opposite to the first side and is received by the PPG light-receiving unit 200 arranged at the second side, such that the electronic device 10 is able to collect biometric information of the user based on photoplethysmography. The control unit 400 may control the display screen 100 such that at least a portion of the display pixels in the contact area of the display screen 100 contacting the finger and the display pixels around the contact area emit light so that the display screen 100 can emit light to the first side, and such that at least another portion of the display pixels in the contact area is maximally transparent so that light reflected by the finger can pass through the contact area to the second side and be received by the PPG light-receiving unit 200, so that the PPG acquisition unit 300 may receive and process the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user.

In an embodiment according to the present disclosure, the control unit may be a separate circuit or may be integrated with other units in an integrated circuit.

In the electronic device with the display screen according to the embodiment of the disclosure, the display screen may include a touch module, and the touch module is used for realizing human-computer interaction of the electronic device by detecting a contact state of a finger with the screen. If the position of the contact between the finger and the display screen, which is detected by the touch module, is not at the preset position, the control unit controls the display pixels around the contact area of the display screen not to emit light and sends information to a user to remind the user to place the finger at the preset position. Therefore, the situation that the electronic equipment starts to collect the pulse wave when the finger of the user does not press the proper position of the display screen can be effectively avoided, on one hand, the energy consumption of the electronic equipment can be reduced, and on the other hand, the quality of collected information can be improved. The touch module has been described above, and will not be described herein again.

The electronic device with a display screen according to an embodiment of the present disclosure may further include an adjustment unit. The adjusting unit can control the size of the contact area and/or the luminous intensity of the display pixels at the periphery of the contact area according to the contact area, the contact time and/or the contact pressure of the finger and the display screen, which are detected by the touch module. Therefore, on the premise of ensuring the information acquisition quality, the energy consumption of the electronic equipment is further reduced, and the information acquisition quality is improved.

According to an embodiment of the present disclosure, an electronic device with a display screen may initiate acquisition of a pulse wave by: (1) when a user needs to use the electronic equipment to acquire pulse waves, for example, an instruction is sent to the electronic equipment through man-machine interaction, the electronic equipment sends prompt/guide information to the user through characters, voice, images and the like, the prompt/guide information comprises that the finger placement position is displayed on a display screen in a graph, the user starts the acquisition of the pulse waves after properly placing the finger at the correct position according to the prompt/guide information, specifically, display pixels around the contact area of the display screen emit light, the transparency degree of the display pixels in the contact area reaches the maximum, a PPG light receiving unit receives the reflected light and provides pulse wave signals, and a PPG acquisition unit receives and processes the pulse wave signals from a PPG light receiving unit to acquire the physiological and/or pathological characteristics of the user; (2) the user directly presses the finger belly of the finger tip on the display screen, the touch module of the display screen detects the contact position, the contact area, the contact time and/or the contact pressure of the finger and the display screen, and when the contact position, the contact area, the contact time and/or the contact pressure meet the preset conditions, the electronic equipment automatically starts the collection of the pulse waves.

FIG. 8 shows a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure. As shown in fig. 8, the electronic device with a display screen 10 according to this embodiment may include an adjustment unit 500 in addition to the display screen 100, the PPG light-receiving unit 200, the PPG acquisition unit 300, and the control unit 400. As described above, the PPG light-receiving unit 200 may be configured to receive the light signal and convert the light signal into a pulse wave signal; the PPG acquisition unit 300 may receive and process the pulse wave signals from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the display screen 100 is arranged such that a reflected portion of the light emitted by the display screen 100 towards the first side can pass through the display screen 100 to a second side opposite to the first side and be received by the PPG light-receiving unit 200 arranged at the second side, so that the electronic device 10 can collect biometric information of the user based on photoplethysmography; the control unit 400 may control the display screen 100 such that at least a portion of the display pixels in the contact area of the display screen 100 contacting the finger and the display pixels around the contact area emit light so that the display screen 100 can emit light to the first side, and such that at least another portion of the display pixels in the contact area is maximally transparent so that light reflected by the finger can pass through the contact area to the second side and be received by the PPG light-receiving unit 200, so that the PPG acquisition unit 300 may receive and process the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user. The adjusting unit 500 may control the size of the contact area and/or the light emitting intensity of the display pixels around the contact area according to the contact area, the contact time, and/or the contact pressure of the finger and the display screen detected by the touch module.

In an embodiment according to the present disclosure, the adjusting unit may be a separate circuit or may be integrated with other units in an integrated circuit

As described above, in the electronic device with a display screen according to the embodiment of the present disclosure, an infrared light emitter is further disposed on the second side of the display screen and near the PPG light-receiving unit to emit infrared light toward the first side, and the control unit controls the infrared light emitter to emit infrared light and controls display pixels around the contact region to emit red light for the acquisition unit to acquire the blood oxygen saturation and the blood perfusion index.

An electronic device with a display screen according to an embodiment of the present disclosure may further include a motion sensor. The motion sensor is used for detecting the state of a user, if the motion sensor detects that the user is in a motion state, the control unit controls the display pixels around the contact area of the display screen not to emit light and sends information to the user to remind the user to stop moving, for example, the user sends reminding information to the user through modes of characters, sound, vibration and the like or a combination of the modes, and the user can stop moving and be in a static state; and if the motion sensor detects that the user is in a static state, the control unit controls display pixels around a contact area of the display screen to emit light and the transparency degree of the display pixels in the contact area to be maximum. Therefore, the quality of the acquired information can be effectively improved, and the energy consumption of the PPG unit can be reduced.

FIG. 9 shows a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure. As shown in fig. 9, the electronic device with a display screen according to this embodiment may further include a motion sensor 600 for detecting a state of the user in addition to the display screen 100, the PPG light-receiving unit 200, the PPG acquisition unit 300, the control unit 400, and the adjustment unit 500. As described above, the PPG light-receiving unit 200 may be configured to receive the light signal and convert the light signal into a pulse wave signal; the PPG acquisition unit 300 may receive and process the pulse wave signals from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the display screen 100 is arranged such that a reflected portion of the light emitted by the display screen 100 towards the first side can pass through the display screen 100 to a second side opposite to the first side and be received by the PPG light-receiving unit 200 arranged at the second side, so that the electronic device 10 can collect biometric information of the user based on photoplethysmography; the control unit 400 may control the display screen 100 such that at least a portion of the display pixels in the contact area of the display screen 100 contacting the finger and the display pixels around the contact area emit light so that the display screen 100 can emit light to the first side, and such that at least another portion of the display pixels in the contact area is maximally transparent so that light reflected by the finger can pass through the contact area to the second side and be received by the PPG light-receiving unit 200, so that the PPG acquisition unit 300 may receive and process the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the adjusting unit 500 may control the size of the contact area and/or the light emitting intensity of the display pixels around the contact area according to the contact area, the contact time, and/or the contact pressure of the finger and the display screen detected by the touch module. If the motion sensor 600 detects that the user is in a motion state, the control unit 400 controls the display pixels around the contact area of the display screen 100 not to emit light and sends information to the user to remind the user to stop moving; and if the motion sensor 600 detects that the user is in a stationary state, the control unit 400 controls the display pixels around the touch region of the display screen 100 to emit light and the display pixels in the touch region to have the maximum degree of transparency.

In embodiments according to the present disclosure, the motion sensor includes any suitable motion sensor including an acceleration sensor, a gyroscope, or an electromagnetic sensor.

The electronic device with a display screen according to an embodiment of the present disclosure may further include a quality determination unit. The quality judgment unit is used for judging the quality of the pulse wave signals, and when the biological characteristic information of the user is acquired, the adjusting unit adjusts the light emitting brightness and the light emitting time of the display pixels around the contact area of the display screen and/or the sampling frequency and/or the exposure time of the PPG light receiving unit according to the judgment result of the quality judgment unit on the pulse wave signals. Thus, when the acquisition of the biometric information of the user is started, the quality judgment unit judges the quality of the pulse wave signal from the PPG light-receiving unit, where the quality of the pulse wave signal may include a signal-to-noise ratio or other indicators. The judgment of the quality of the pulse wave signal by the quality judgment unit may be performed by comparing the quality of the pulse wave signal with a previously determined quality threshold value, which may be the minimum quality that ensures the information quality. If the quality judgment unit judges that the signal quality is higher than the quality threshold value, the adjusting unit can adjust the brightness and the lighting time of the display pixels around the contact area of the display screen and/or the sampling frequency and/or the exposure time of the PPG light receiving unit, so that the energy consumption of the electronic equipment can be further reduced on the premise of ensuring the information acquisition quality.

FIG. 10 shows a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure. As shown in fig. 10, the electronic device 10 of the display screen according to this embodiment may further include a quality determination unit 700 in addition to the display screen 100, the PPG light-receiving unit 200, the PPG acquisition unit 300, the control unit 400, the adjustment unit 500, and the motion sensor 600, where the quality determination unit 700 is configured to determine the quality of the pulse wave signal. As described above, the PPG light-receiving unit 200 may be configured to receive the light signal and convert the light signal into a pulse wave signal; the PPG acquisition unit 300 may receive and process the pulse wave signals from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the display screen 100 is arranged such that a reflected portion of the light emitted by the display screen 100 towards the first side can pass through the display screen 100 to a second side opposite to the first side and be received by the PPG light-receiving unit 200 arranged at the second side, so that the electronic device 10 can collect biometric information of the user based on photoplethysmography; the control unit 400 may control the display screen 100 such that at least a portion of the display pixels in the contact area of the display screen 100 contacting the finger and the display pixels around the contact area emit light so that the display screen 100 can emit light to the first side, and such that at least another portion of the display pixels in the contact area is maximally transparent so that light reflected by the finger can pass through the contact area to the second side and be received by the PPG light-receiving unit 200, so that the PPG acquisition unit 300 may receive and process the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the adjusting unit 500 may control the size of the contact area and/or the light emitting intensity of the display pixels around the contact area according to the contact area, the contact time, and/or the contact pressure of the finger and the display screen detected by the touch module, and if the motion sensor 600 detects that the user is in a motion state, the control unit 400 controls the display pixels around the contact area of the display screen 100 not to emit light and sends information to the user to remind the user to stop moving; and if the motion sensor 600 detects that the user is in a static state, the control unit 400 controls at least one part of the display pixels in the contact area of the display screen 100 and the display pixels around the contact area to emit light and at least another part of the display pixels in the contact area to have the maximum transparency. When the biometric information of the user is collected, the adjusting unit 500 adjusts the light emitting brightness, the light emitting time, and/or the sampling frequency and/or the exposure time of the PPG light-receiving unit 200 of the display pixels around the contact area of the display screen 100 according to the determination result of the quality of the pulse wave signal by the quality determining unit 700.

In other embodiments of the present disclosure, the electronic device with a display screen may further include only the display screen, the PPG light-receiving unit, the PPG acquisition unit, the control unit, and the motion sensor, without the adjustment unit and the quality determination unit; or the electronic device with the display screen can only comprise the display screen, the PPG light receiving unit, the PPG acquisition unit, the control unit and the adjusting unit, but not comprise the motion sensor and the quality judgment unit; or the electronic device with the display screen can also only comprise the display screen, the PPG light receiving unit, the PPG acquisition unit, the control unit, the adjusting unit and the quality judging unit, and does not comprise the motion sensor.

In an embodiment according to the present disclosure, a sampling frequency of the PPG light-receiving unit may be set to 50Hz to 500Hz, one exemplary sampling frequency being 100 Hz.

In an embodiment according to the present disclosure, the quality determination unit and the adjustment unit may be separate circuits or may be integrated together with other units in an integrated circuit.

In the electronic equipment with the display screen according to the embodiment of the disclosure, when the biological characteristic information of the user is collected, the control unit determines whether to send information to the user according to the judgment result of the quality judgment unit on the quality of the pulse wave signal so as to remind the user of being in a static state or remind the user of adjusting the pressing of the finger on the display screen. As mentioned above, when starting to acquire the biometric information of the user, the quality determination unit may determine the quality of the pulse wave signal from the PPG light unit, where the quality of the pulse wave signal may include a signal-to-noise ratio or other indicators. If the quality judgment unit judges that the signal quality is lower than the quality threshold, the control unit can send information to a user to remind the user of being in a static state or remind the user of adjusting the pressing of a finger on the display screen, so that the quality of the acquired pulse wave signals can be improved to be higher than the quality threshold, the reliability and/or the quality of the acquired information are ensured, and meanwhile, the energy consumption of the electronic equipment can be reduced. Of course, if the quality determining unit determines that the signal quality is higher than the quality threshold, the control unit does not need to send information to the user to remind the user that the user should be in a static state or to remind the user to adjust the pressing of the finger on the display screen, but as described above, the adjusting unit may adjust the light emitting brightness, the light emitting time, and/or the sampling frequency and/or the exposure time of the PPG light receiving unit around the contact area of the display screen.

The electronic device with a display screen according to an embodiment of the present disclosure may further include an amplification filtering unit. The amplification and filtering unit amplifies and filters the pulse wave signal from the PPG light receiving unit and provides the amplified and filtered signal to the acquisition unit. Because the human body biological characteristic signal belongs to a low-frequency weak signal under a strong noise background, and the pulse wave signal is a weaker non-electrophysiological signal, the signal acquisition requirement can be met only by amplification and post-stage filtering. Differential amplification can be adopted in signal amplification, and a low-pass filter designed by a normalization method can be adopted and a proper cut-off frequency is set to filter the amplified pulse wave signals.

FIG. 11 shows a functional block diagram of an electronic device with a display screen according to an embodiment of the present disclosure. As shown in fig. 11, the electronic device 10 of the display screen according to this embodiment may include an amplification filtering unit 800 in addition to the display screen 100, the PPG light-receiving unit 200, the PPG acquisition unit 300, the control unit 400, the adjustment unit 500, the motion sensor 600, and the quality determination unit 700. As described above, the PPG light-receiving unit 200 may be configured to receive the light signal and convert the light signal into a pulse wave signal; the PPG acquisition unit 300 may receive and process the pulse wave signals from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the display screen 100 is arranged such that a reflected portion of the light emitted by the display screen 100 towards the first side can pass through the display screen 100 to a second side opposite to the first side and be received by the PPG light-receiving unit 200 arranged at the second side, so that the electronic device 10 can collect biometric information of the user based on photoplethysmography; the control unit 400 may control the display screen 100 such that at least a portion of the display pixels in the contact area of the display screen 100 contacting the finger and the display pixels around the contact area emit light so that the display screen 100 can emit light to the first side, and such that at least another portion of the display pixels in the contact area is maximally transparent so that light reflected by the finger can pass through the contact area to the second side and be received by the PPG light-receiving unit 200, so that the PPG acquisition unit 300 may receive and process the pulse wave signal from the PPG light-receiving unit 200 to acquire physiological and/or pathological characteristics of the user; the adjusting unit 500 may control the size of the contact area and/or the light emitting intensity of the display pixels around the contact area according to the contact area, the contact time, and/or the contact pressure of the finger and the display screen detected by the touch module, and if the motion sensor 600 detects that the user is in a motion state, the control unit 400 controls the display pixels around the contact area of the display screen 100 not to emit light and sends information to the user to remind the user to stop moving; and if the motion sensor 600 detects that the user is in a static state, the control unit 400 controls at least one part of the display pixels in the contact area of the display screen 100 and the display pixels around the contact area to emit light and controls at least another part of the display pixels in the contact area to have the maximum transparency; when the biometric information of the user is collected, the adjusting unit 500 adjusts the light emitting brightness, the light emitting time, and/or the sampling frequency and/or the exposure time of the PPG light-receiving unit 200 of the display pixels around the contact area of the display screen 100 according to the determination result of the quality of the pulse wave signal by the quality determining unit 700. The amplification and filtering unit 800 amplifies and filters the pulse wave signal from the PPG light-receiving unit 200 and provides the amplified and filtered signal to the PPG acquisition unit 300.

According to the embodiment of the disclosure, a plurality of PPG light receiving units can be arranged in the electronic equipment of the display screen, a user can press the display screen by a plurality of fingers at the same time, and a plurality of pulse wave signals from a plurality of fingers can be simultaneously acquired by the plurality of PPG light receiving units, so that the plurality of pulse wave signals can be properly processed by the signal processing unit arranged in the electronic equipment of the display screen, and the observation precision and quality of the signals are improved.

In the description herein, reference to the description of the terms "one embodiment/mode," "some embodiments/modes," "example," "specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment/mode or example is included in at least one embodiment/mode or example of the present disclosure. In this specification, the schematic representations of the terms used above are not necessarily intended to be the same embodiment/mode or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more of the embodiments or examples. Furthermore, the various embodiments/aspects or examples and features of the various embodiments/aspects or examples described in this specification can be combined and combined by one skilled in the art without conflicting therewith.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, "a plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise.

It will be understood by those skilled in the art that the foregoing embodiments are merely for clarity of illustration of the disclosure and are not intended to limit the scope of the disclosure. Other variations or modifications may occur to those skilled in the art, based on the foregoing disclosure, and are still within the scope of the present disclosure.

Claims

1. An electronic device with a display screen for acquiring biological characteristic information of a user to obtain physiological and/or pathological characteristics of the user, the electronic device with the display screen comprising:

the PPG light receiving unit is used for receiving a light signal and converting the light signal into a pulse wave signal; and

a PPG acquisition unit receiving and processing pulse wave signals from the PPG light receiving unit to acquire physiological and/or pathological characteristics of a user,

wherein the display screen is arranged such that light emitted by the display screen towards a first side is reflected by a finger of a user pressing on a surface of the first side of the display screen and transmitted through the display screen to a second side opposite to the first side and received by a PPG light receiving unit arranged at the second side, so that the electronic device with the display screen can acquire biometric information of the user based on photoplethysmography;

further comprising: the device comprises a control unit, a quality judgment unit and an adjustment unit;

the control unit controls the display screen to enable at least one part of display pixels in a contact area of the display screen, which is in contact with the finger, and display pixels around the contact area to emit light so that the display screen can emit the light to the first side, and enable at least another part of display pixels in the contact area to be maximally transparent so that the light reflected by the finger can pass through the contact area to the second side and be received by the PPG light receiving unit;

the quality judging unit is used for judging the quality of the pulse wave signals, and when the biological characteristic information of the user is collected, the adjusting unit adjusts the light emitting brightness and/or the light emitting time of the display pixels around the contact area of the display screen according to the judgment result of the quality of the pulse wave signals by the quality judging unit.

2. The electronic device with a display screen of claim 1, wherein the display screen comprises a touch module for realizing human-computer interaction of the electronic device by detecting a contact state of a finger with the screen, wherein,

if the position of the contact between the finger and the display screen, which is detected by the touch module, is not at the preset position, the control unit controls the display pixels around the contact area of the display screen not to emit light and sends information to the user to remind the user to place the finger at the preset position.

3. The electronic device with a display screen of claim 2,

the adjusting unit controls the size of the contact area and/or the luminous intensity of display pixels at the periphery of the contact area according to the contact area, the contact time and/or the contact pressure of the finger and the display screen, which are detected by the touch module.

4. An electronic device with a display screen according to claim 3, wherein an infrared light emitter is further provided on the second side of the display screen and in the vicinity of the PPG light-receiving unit to emit infrared light toward the first side,

the control unit controls the infrared light emitter to emit infrared light and controls display pixels on the periphery of the contact area to emit red light so that the PPG acquisition unit can acquire the blood oxygen saturation and the blood perfusion index.

5. An electronic device with a display screen according to claim 3 or 4, characterized in that the electronic device with a display screen further comprises a motion sensor for detecting a state of a user,

if the motion sensor detects that the user is in a motion state, the control unit controls display pixels around a contact area of the display screen not to emit light and sends information to the user to remind the user to stop moving; and

if the motion sensor detects that the user is in a static state, the control unit controls display pixels around a contact area of the display screen to emit light and the transparency degree of the display pixels in the contact area reaches the maximum.

6. An electronic device with a display screen as recited in claim 5,

when the biological characteristic information of the user is collected, the control unit determines whether to send information to the user according to the judgment result of the quality judgment unit on the quality of the pulse wave signal so as to remind the user that the user is in a static state or remind the user to adjust the pressing of fingers on the display screen.

7. The electronic device with display screen of claim 6, further comprising an amplification and filtering unit that amplifies and filters the pulse wave signal from the PPG light receiving unit and provides the amplified and filtered signal to the PPG acquisition unit.