CN114431891A

CN114431891A - Method for monitoring sleep and related electronic equipment

Info

Publication number: CN114431891A
Application number: CN202011194226.1A
Authority: CN
Inventors: 黄晓萍
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-10-30
Filing date: 2020-10-30
Publication date: 2022-05-06

Abstract

A method for monitoring sleep and related electronic equipment are provided, wherein the electronic equipment which is easy to obtain is used for detecting whether a user has apnea during sleep, when the apnea of the user is detected, the electronic equipment transmits ultrasonic waves to the user, the sleeping posture of the user is judged according to the ultrasonic waves reflected by the user, and when the sleeping posture of the user is supine, the electronic equipment outputs prompt information for prompting the user to adjust the sleeping posture. The method can realize the non-contact type sleeping posture detection of the electronic equipment on the user, so that the user can intervene in time to adjust the sleeping posture when the sleep apnea occurs, and the life safety of the user is protected.

Description

Method for monitoring sleep and related electronic equipment

Technical Field

The present application relates to the field of terminal device technologies, and in particular, to a sleep monitoring method and a related electronic device.

Background

Sleep apnea has great harm to health, nearly 10 hundred million people worldwide have sleep apnea problem, if apnea time is too long, blood oxygen can be caused to reduce, and low blood oxygen can damage organs such as heart, brain, etc., influence health. Hypoxemia caused by sleep apnea may provoke a malignant cardiovascular event, such as the common death of a nocturnal myocardial infarction. However, the awareness rate of the sleep apnea syndrome is less than 20%, and the screening is clinically needed under the monitoring of multiple sets of equipment, so that the method is not suitable for daily use in a family.

Disclosure of Invention

The embodiment of the application provides a sleep monitoring method and related electronic equipment, wherein the electronic equipment which is easy to obtain is used for detecting the sleeping posture of a user when the user has apnea during sleep, so that the non-contact sleeping posture detection of the user by the electronic equipment can be realized, and the prompt information for prompting the user to adjust the sleeping posture is output, so that the user can intervene in time when the user has apnea during sleep, and the life safety of the user is protected.

In a first aspect, an embodiment of the present application provides a method for monitoring sleep, which is applied to an electronic device, where the electronic device includes an ultrasonic wave transmitting device and an ultrasonic wave receiving device, and the method includes: when detecting that a user has a breath pause in a sleep state, transmitting first ultrasonic waves to the user through the ultrasonic wave transmitting device; receiving, by the ultrasonic receiving device, a second ultrasonic wave, which is a reflected first ultrasonic wave, the second ultrasonic wave including the first ultrasonic wave reflected by the user; determining the sleeping posture of the user according to the total power of the first ultrasonic waves reflected by the user; and when the sleeping posture of the user is supine, outputting prompt information, wherein the prompt information is used for prompting the user to adjust the sleeping posture.

The method provided by the first aspect can be performed by terminal electronic equipment, which is readily available, and thus is suitable for daily use. The electronic equipment identifies the sleeping posture of the user at a certain distance from the user, non-contact type sleeping posture detection is realized, the electronic equipment outputs prompt information to remind the user, and the user is protected by timely intervening when sleep apnea occurs to the user. Meanwhile, the electronic equipment continuously monitors the sleep of the user, and starts the sleep posture detection when the user is judged to have apnea, so that the function is started when necessary, and the energy consumption of the electronic equipment can be reduced.

With reference to the first aspect, in some embodiments, the determining the sleeping posture of the user according to the total power of the first ultrasonic waves reflected by the user specifically includes: when the total power of the first ultrasonic waves reflected by the user is smaller than a target threshold value, determining that the sleeping posture of the user is supine.

With reference to the first aspect, in some embodiments, before determining that the sleeping posture of the user is supine when the total power of the first ultrasonic waves reflected by the user is less than a target threshold, the method further comprises: determining the target threshold value according to the height of the user and the distance between the user and the electronic equipment; when the distance is unchanged, the larger the height is, the larger the target threshold is; when the height is unchanged, the larger the distance is, the smaller the target threshold is.

With reference to the first aspect, in some embodiments, the ultrasonic wave transmitting apparatus includes a plurality of transmitting array elements arranged in an array, and the transmitting a first ultrasonic wave to the user through the ultrasonic wave transmitting apparatus includes: acquiring the distance between the electronic equipment and the user; calculating the length of the upper half of the user according to the height of the user; determining the beam width according to the distance, the length and the position of the transmitting array element; transmitting, by the ultrasonic wave transmitting device, a first ultrasonic wave at the beam width to the user at the distance so that the first ultrasonic wave covers the upper body of the user.

With reference to the first aspect, in some embodiments, the obtaining the distance between the electronic device and the user includes: transmitting a third ultrasonic wave to the user through the ultrasonic wave transmitting device; receiving a fourth ultrasonic wave by the ultrasonic wave receiving device, wherein the fourth ultrasonic wave is the reflected third ultrasonic wave; and determining the distance according to the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.

With reference to the first aspect, in some embodiments, before the determining the sleeping posture of the user according to the total power of the first ultrasonic waves reflected by the user after the receiving of the second ultrasonic waves by the ultrasonic wave receiving device, the method further includes: and filtering power information of first ultrasonic waves reflected by obstacles except the user from power information of second ultrasonic waves to obtain the power information of the first ultrasonic waves reflected by the user, wherein the second ultrasonic waves comprise the first ultrasonic waves reflected by the user and the first ultrasonic waves reflected by the obstacles except the user.

In combination with the first aspect, in some embodiments, the method further comprises: when indication information sent by the wearable device is received, the fact that the user generates apnea in the sleep state is detected, and the indication information is used for indicating that the user generates apnea in the sleep state.

In combination with the first aspect, in some embodiments, the method further comprises: receiving physiological information sent by a wearable device, wherein the physiological information comprises blood oxygen saturation; determining that the user has sleep apnea when the user is detected to be in a sleep state and the blood oxygen saturation is less than a first blood oxygen threshold.

With reference to the first aspect, in some embodiments, the electronic device further includes an audio capture device, and the method further includes: when the user is detected to be in a sleep state, acquiring first sound of the environment through the audio acquisition device; the user experiences sleep apnea when the first sound does not include breathing sound or a breathing rate of breathing sound included by the first sound is less than a first threshold.

With reference to the first aspect, in some embodiments, the electronic device further includes an audio capture device, and the method further includes: acquiring a second sound of the environment through the audio acquisition device; and when the breathing rate of the breathing sound included by the second sound is smaller than a second threshold value, determining that the user is in a sleep state.

In combination with the first aspect, in some embodiments, the method further comprises: receiving a heart rate sent by the wearable device; when the heart rate is in a first heart rate range, determining that the user is in a sleep state, wherein the first heart rate range is a heart rate range taking a sleep reference heart rate of the user as a center, and the sleep reference heart rate is an average heart rate of the user in the sleep state.

With reference to the first aspect, in some embodiments, the outputting the prompt information includes: sending prompt information to a wearable device, so that the wearable device vibrates and displays the prompt information after receiving the prompt information.

In a second aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, an ultrasonic wave transmitting device, and an ultrasonic wave receiving device, where the processor is respectively coupled to the ultrasonic wave transmitting device, the ultrasonic wave receiving device, and the one or more memories through a bus; the one or more memories are for storing computer program code comprising computer instructions; the processor is configured to invoke the computer instructions to perform the following operations: when detecting that a user has a breath pause in a sleep state, transmitting first ultrasonic waves to the user through the ultrasonic wave transmitting device; receiving, by the ultrasonic receiving device, a second ultrasonic wave, which is a reflected first ultrasonic wave, the second ultrasonic wave including the first ultrasonic wave reflected by the user; determining the sleeping posture of the user according to the total power of the first ultrasonic waves reflected by the user; and when the sleeping posture of the user is supine, outputting prompt information, wherein the prompt information is used for prompting the user to adjust the sleeping posture.

With reference to the second aspect, in some embodiments, the processor performs determining the sleeping posture of the user from the total power of the first ultrasonic waves reflected by the user, including performing: when the total power of the first ultrasonic waves reflected by the user is smaller than a target threshold value, determining that the sleeping posture of the user is supine.

With reference to the second aspect, in some embodiments, the processor, before determining that the user's sleeping posture is supine when the total power of the first ultrasonic waves reflected by the user is less than a target threshold, comprises performing: determining the target threshold value according to the height of the user and the distance between the user and the electronic equipment; when the distance is unchanged, the larger the height is, the larger the target threshold is; the larger the distance, the smaller the target threshold, while the height is constant.

With reference to the second aspect, in some embodiments, the ultrasonic wave transmitting device includes a plurality of transmitting array elements arranged in an array, and the processor performs transmitting the first ultrasonic wave to the user through the ultrasonic wave transmitting device, including performing: acquiring the distance between the electronic equipment and the user; calculating the length of the upper body of the user according to the height of the user; determining the beam width according to the distance, the length and the position of the transmitting array element; transmitting, by the ultrasonic wave transmitting device, a first ultrasonic wave at the beam width to the user at the distance so that the first ultrasonic wave covers the upper body of the user.

With reference to the second aspect, in some embodiments, the processor performs the acquiring of the distance of the electronic device from the user, including performing: transmitting a third ultrasonic wave to the user through the ultrasonic wave transmitting device; receiving, by the ultrasonic receiving device, a fourth ultrasonic wave, which is the reflected third ultrasonic wave; and determining the distance according to the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.

With reference to the second aspect, in some embodiments, after the receiving, by the ultrasound receiving device, the second ultrasound wave, the processor performs, before determining the sleeping posture of the user according to the total power of the first ultrasound wave reflected by the user, further performing: and filtering power information of first ultrasonic waves reflected by obstacles except the user from power information of second ultrasonic waves to obtain the power information of the first ultrasonic waves reflected by the user, wherein the second ultrasonic waves comprise the first ultrasonic waves reflected by the user and the first ultrasonic waves reflected by the obstacles except the user.

In combination with the second aspect, in some embodiments, the processor further performs: receiving indication information sent by the wearable device through the communication module, wherein the indication information is used for indicating that the user has apnea in a sleep state.

In combination with the second aspect, in some embodiments, the processor further performs: receiving, by the communication module, physiological information sent by a wearable device, the physiological information including a blood oxygen saturation level; determining that the user has sleep apnea when the user is detected to be in a sleep state and the blood oxygen saturation is less than a first blood oxygen threshold.

With reference to the second aspect, in some embodiments, the electronic device further includes an audio acquisition apparatus, and the processor further performs: when the user is detected to be in a sleep state, acquiring a first sound of an environment through the audio acquisition device; the user experiences sleep apnea when the first sound does not include breathing sound or a breathing rate of breathing sound included by the first sound is less than a first threshold.

In combination with the second aspect, in some embodiments, the electronic device further includes an audio capturing apparatus, and the processor further performs: acquiring a second sound of the environment through the audio acquisition device; and when the breathing rate of the breathing sound included by the second sound is smaller than a second threshold value, determining that the user is in a sleep state.

In combination with the second aspect, in some embodiments, the processor further performs: receiving, by the communication module, a heart rate sent by the wearable device; when the heart rate is in a first heart rate range, determining that the user is in a sleep state, wherein the first heart rate range is a heart rate range taking a sleep reference heart rate of the user as a center, and the sleep reference heart rate is an average heart rate of the user in the sleep state.

In combination with the second aspect, in some embodiments, the processor executes the output hint information, including: sending prompt information to a wearable device, so that the wearable device vibrates and displays the prompt information after receiving the prompt information.

In a third aspect, an embodiment of the present application provides a computer storage medium, which includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device is caused to execute the method for monitoring sleep according to the first aspect.

It is to be understood that the electronic device provided by the second aspect and the computer-readable storage medium provided by the third aspect are both configured to perform the method provided by the first aspect. Therefore, the beneficial effects achieved by the method can refer to the beneficial effects in the corresponding method, and are not described herein again.

Drawings

Fig. 1 is a schematic explanatory diagram of a sleep intervention system provided by an embodiment of the present application;

fig. 2A is a schematic diagram of a hardware architecture of a first electronic device according to an embodiment of the present disclosure;

fig. 2B is a schematic diagram of a hardware architecture of a second electronic device according to an embodiment of the present disclosure;

fig. 3 is a flowchart illustrating a first method for monitoring sleep according to an embodiment of the present application;

fig. 4 is a schematic flowchart of a second method for monitoring sleep according to an embodiment of the present application;

fig. 5 is a flowchart illustrating a third method for monitoring sleep according to an embodiment of the present application.

Detailed Description

The terminology used in the following embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used in the specification of the present application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the listed items.

Referring first to a schematic illustration of a sleep intervention system provided in an embodiment of the present application, as shown in fig. 1, the system may include a first electronic device 11 and a second electronic device 12, where the first electronic device 11 may be a mobile phone, a tablet computer, and the like, and the second electronic device 12 may be a wearable device capable of implementing blood oxygen measurement, such as a smart watch, a smart bracelet, and the like.

The first electronic device 11 may include an ultrasonic wave transmitting means and an ultrasonic wave receiving means, and may be used for transmission and reception of ultrasonic waves to detect a sleep posture of the user by the ultrasonic waves.

The second electronic device 12 may be in communication connection with the first electronic device 11, for example a bluetooth connection, a WiFi connection, etc. The first electronic device 11 may also send a first instruction to the second electronic device 12 instructing it to detect sleep apnea or a second instruction to acquire physiological information, motion parameters, sound, and the like.

The second electronic device 12 may detect whether the user has sleep apnea in response to the first instruction. The second electronic device 12 may include a heart rate sensor, blood oxygen sensor, motion sensor, or the like. The heart rate sensor is used for acquiring a heart rate and heart rate related parameters, and the heart rate can be used for detecting whether a user enters a sleep state; the blood oxygen sensor can measure the blood oxygen saturation of the user, and the blood oxygen saturation can be used for detecting whether the user has sleep apnea; the motion sensor can acquire the motion information of the user, and further identify whether the user is in a static state or a motion state. In one implementation, the second electronic device 12 may detect whether the user has sleep apnea, and further, after detecting that the user has sleep apnea or after detecting that severe sleep apnea has occurred, send indication information indicating that severe sleep apnea has occurred to the first electronic device 11.

In another implementation, the second electronic device 12 may send, in response to the second instruction, information used by the heart rate sensor to obtain the heart rate and the heart rate related parameters, the blood oxygen saturation level of the user may be measured by the blood oxygen sensor, the motion information of the user may be obtained by the motion sensor, and the like to the first electronic device 11 in real time, and the first electronic device 11 identifies whether the sleep apnea occurs in the user based on the physiological information and the motion information.

After detecting that the user has sleep apnea, the first electronic device 11 may transmit a first ultrasonic wave through the ultrasonic wave transmitting device, where the first ultrasonic wave is reflected by an obstacle such as a user, a bed, a wall, or the like, and then received by the ultrasonic wave receiving device. The received transmitted first ultrasonic wave is referred to herein as a second ultrasonic wave. The second ultrasonic waves include first ultrasonic waves reflected by a user and first ultrasonic waves reflected by obstacles except the user. Further, the first electronic device 11 may determine the sleeping posture of the user according to the total power of the first ultrasonic waves reflected by the user, and when the total power is smaller than the target threshold, determine that the sleeping posture of the user is supine. When the user is in the supine sleeping posture, the user can give vibration or voice prompt, and the like, and can also send the vibration and/or play voice information and the like for prompting the user to adjust the sleeping posture to the second electronic equipment.

According to the sleep monitoring method, whether the user has apnea is judged by monitoring the breathing state of the user during sleep, when the user has apnea, the sleep posture of the user is detected by starting ultrasonic waves, and when the sleep posture of the user is detected to be supine, the electronic equipment can intervene the sleep of the user and send out prompt information for prompting the user to adjust the sleep posture so as to prompt the user to adjust the sleep posture and guarantee the life safety of the user.

In the embodiment of the application, the first electronic device can be a mobile phone, a tablet personal computer and other terminal devices, is an electronic device owned by the public, and is suitable for the daily life of a user. When the user is in a sleep state, the electronic equipment judges that the user has apnea, and starts the sleep posture recognition, so that the function is started when necessary, and the energy consumption of the electronic equipment can be reduced.

An exemplary first electronic device 100 provided in an embodiment of the present application is first described below.

Fig. 2A shows a hardware architecture diagram of the first electronic device 100. The first electronic device 100 may be an electronic device such as a mobile phone, a tablet computer, and a smart audio.

The first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, an audio acquisition device 170C, an earphone interface 170D, an ultrasonic transmitter 170E, an ultrasonic receiver 170F, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.

Wherein the controller may be a neural center and a command center of the first electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, such that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement the touch function of the first electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may communicate audio signals to the wireless communication module 160 via the I2S interface, enabling answering of calls via a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to implement a function of answering a call through a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the first electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the first electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the first electronic device 100, and may also be used to transmit data between the first electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other first electronic devices, such as AR devices and the like.

It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative and does not limit the structure of the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the first electronic device 100. The charging management module 140 may also supply power to the first electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the first electronic device 100 can be implemented by, for example, the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like. The above may be collectively referred to as a communication module.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the first electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to the first electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide a solution for wireless communication applied to the first electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, the antenna 1 of the first electronic device 100 is coupled to the mobile communication module 150 and the antenna 2 is coupled to the wireless communication module 160 so that the first electronic device 100 can communicate with networks and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The first electronic device 100 implements the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the first electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the first electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the first electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The first electronic device 100 may support one or more video codecs. In this way, the first electronic device 100 can play or record video in a plurality of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU may implement applications such as intelligent recognition of the first electronic device 100, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the first electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the first electronic device 100 by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, a phone book, etc.) created during the use of the first electronic device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The first electronic device 100 can implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the audio capture device 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The first electronic device 100 can listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into a sound signal. When the first electronic device 100 receives a call or voice information, it can receive voice by placing the receiver 170B close to the ear of the person.

And the audio acquisition device 170C is used for converting the sound signal into an electric signal. When making a call or sending voice information, the user may speak via the mouth of the user near the audio capture device 170C and input a voice signal to the audio capture device 170C. The first electronic device 100 may be provided with at least one audio capture device 170C. In other embodiments, the first electronic device 100 may be provided with two audio collecting apparatuses 170C, which may also implement a noise reduction function in addition to collecting sound signals. In other embodiments, the first electronic device 100 may further include three, four or more audio collecting devices 170C to collect sound signals, reduce noise, identify sound sources, and implement a directional recording function. The audio capture device 170C may be a microphone, also referred to as a "microphone" or "microphone".

The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be an Open Mobile Terminal Platform (OMTP) standard interface of 3.5mm, or a CTIA (cellular telecommunications industry association) standard interface of the USA.

An ultrasonic transmitter 170E for converting the electrical signal into an ultrasonic signal, and in some embodiments, the ultrasonic transmitter 170E may also be a speaker 170A. In other embodiments, the ultrasound transmitting device 170E may comprise a plurality of transmitting elements arranged in an array, each transmitting element being configured to transmit ultrasound. In a specific implementation, the ultrasound waves may be transmitted through some or all of the plurality of transmit elements.

An ultrasonic receiving device 170F for converting the ultrasonic signal into an electrical signal, and in some embodiments, the ultrasonic receiving device 170F may also be a microphone. In other embodiments, the ultrasonic receiving apparatus 170F may include a plurality of receiving elements arranged in an array, each receiving element for receiving ultrasonic waves. In a particular implementation, the ultrasound waves may be received by some or all of the plurality of receiving elements.

The pressure sensor 180A is used for sensing a pressure signal, and converting the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The first electronic device 100 determines the intensity of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the first electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The first electronic device 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 180B may be used to determine the motion attitude of the first electronic device 100. In some embodiments, the angular velocity of the first electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by the gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the first electronic device 100, calculates a distance to be compensated for the lens module according to the shake angle, and allows the lens to counteract the shake of the first electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the first electronic device 100 calculates altitude, aiding positioning and navigation from the barometric pressure value measured by the barometric pressure sensor 180C.

The magnetic sensor 180D includes a hall sensor. The first electronic device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the first electronic device 100 is a flip, the first electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.

The acceleration sensor 180E may detect the magnitude of acceleration of the first electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the first electronic device 100 is stationary. The method can also be used for recognizing the posture of the first electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The first electronic device 100 may measure the distance by infrared or laser. In some embodiments, the sleeping posture recognition scenario, the first electronic device 100 may measure the distance between the first electronic device and the user's body using the distance sensor 180F.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The first electronic device 100 emits infrared light to the outside through the light emitting diode. The first electronic device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the first electronic device 100. When insufficient reflected light is detected, the first electronic device 100 may determine that there is no object near the first electronic device 100. The first electronic device 100 can utilize the proximity light sensor 180G to detect that the user holds the first electronic device 100 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense the ambient light level. The first electronic device 100 may adaptively adjust the brightness of the display screen 194 according to the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the first electronic device 100 is in a pocket, so as to prevent accidental touch.

The fingerprint sensor 180H is used to collect a fingerprint. The first electronic device 100 may utilize the collected fingerprint characteristics to unlock a fingerprint, access an application lock, photograph a fingerprint, answer an incoming call with a fingerprint, and the like.

The temperature sensor 180J is used to detect temperature. In some embodiments, the first electronic device 100 executes a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the first electronic device 100 performs a performance reduction on a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the first electronic device 100 heats the battery 142 to avoid the abnormal shutdown of the first electronic device 100 caused by the low temperature. In other embodiments, when the temperature is lower than a further threshold, the first electronic device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the first electronic device 100, different from the position of the display screen 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, the bone conduction sensor 180M may acquire a vibration signal of the human vocal part vibrating the bone mass. The bone conduction sensor 180M may also contact the human pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part acquired by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The first electronic device 100 may receive a key input, and generate a key signal input related to user setting and function control of the first electronic device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization. In some embodiments of the present application, the motor 191 may vibrate to alert the user to turn over when the first electronic device detects that the user is asleep and asleep.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the first electronic device 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The first electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The first electronic device 100 interacts with the network through the SIM card to implement functions such as a call and data communication. In some embodiments, the first electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card may be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100.

An exemplary second electronic device 200 provided in an embodiment of the present application is described below. This second electronic device 200 may be a wearable device such as a smart watch, smart bracelet, smart glasses, and the like.

Referring to fig. 2B, the second electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a Universal Serial Bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, a display 250, a wireless communication module 260, an audio module 270, a sensor module 280, a button 290, a motor 291, an indicator 292, and the like.

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the second electronic device 200. In other embodiments of the present application, the second electronic device 200 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 210 may include one or more processing units, such as: the processor 210 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the second electronic device 200. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 221 may be used to store computer-executable program code, which includes instructions. The processor 210 executes various functional applications and data processing of the second electronic device 200 by executing instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, a phone book, etc.) created during the use of the second electronic device 200, and the like. In addition, the internal memory 221 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The USB interface 230 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 230 may be used to connect a charger to charge the second electronic device 200, and may also be used to transmit data between the second electronic device 200 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.

The charge management module 240 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 may receive charging input from a wired charger via the USB interface 230. In some wireless charging embodiments, the charging management module 240 may receive a wireless charging input through a wireless charging coil of the second electronic device 200. The charging management module 240 may also supply power to the first electronic device through the power management module 241 while charging the battery 242.

The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charge management module 240, and provides power to the processor 210, the internal memory 221, the external memory 220, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 241 may also be used to monitor parameters such as battery capacity, battery cycle number, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 241 may also be disposed in the processor 210. In other embodiments, the power management module 241 and the charging management module 240 may be disposed in the same device.

The display screen 250 is used to display images, video, and the like. The display screen 250 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the second electronic device 200 may include 1 or N display screens 250, N being a positive integer greater than 1.

The wireless communication module 260 is configured to receive and transmit wireless signals, and mainly integrates a communication module of the second electronic device, which may provide solutions for wireless communication applied to the second electronic device 200, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 260 may be one or more devices integrating at least one communication processing module.

The second electronic device 200 may implement an audio function through the audio module 270, the application processor, and the like. Such as music playing, recording, etc.

The pressure sensor 280A is used to sense a pressure signal, which can be converted into an electrical signal. In some embodiments, the pressure sensor 280A may be disposed on the display screen 250. The pressure sensor 280A can be of a wide variety of types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 280A, the capacitance between the electrodes changes. The second electronic device 200 determines the intensity of the pressure from the change in capacitance. When a touch operation is applied to the display screen 250, the second electronic device 200 detects the intensity of the touch operation according to the pressure sensor 280A. The second electronic device 200 may also calculate the touched position from the detection signal of the pressure sensor 280A.

The gyro sensor 280B may be used to determine the motion attitude of the second electronic device 200. In some embodiments, the angular velocity of the second electronic device 200 about three axes (i.e., x, y, and z axes) may be determined by the gyroscope sensor 280B.

The acceleration sensor 280C can detect the magnitude of acceleration of the second electronic device 200 in various directions (typically three axes). The magnitude and direction of the gravity can be detected when the second electronic device 200 is stationary. The method can also be used for recognizing the posture of the first electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 280D for measuring distance. The second electronic device 200 may measure the distance by infrared or laser. In some embodiments, the sleeping posture recognition scenario, the second electronic device 200 may measure the distance between the first electronic device and the user's body using the distance sensor 180F.

The fingerprint sensor 280E is used to capture a fingerprint. The second electronic device 200 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering and the like.

The touch sensor 280F is also referred to as a "touch panel". The touch sensor 280F may be disposed on the display screen 250, and the touch sensor 280F and the display screen 250 form a touch screen, which is also called a "touch screen". The touch sensor 280F is used to detect a touch operation applied thereto or thereabout. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 250. In other embodiments, the touch sensor 280F can be disposed on a surface of the second electronic device 200, different from the position of the display screen 250.

The heart rate sensor 280G is used to detect the heart rate of the user. In some embodiments, the heart rate sensor may employ the principles of photoplethysmography to measure heart rate and heart rate related parameters. The measurement principle is as follows: the reflection of light by the skin, bones, meat, fat and other tissues of the human body is fixed; the reflection of light is a fluctuation value due to the change of the volume rule of the blood capillary, the artery, the vein and the like along with the beating of the heart, and the frequency of the fluctuation is the heart rate. Optionally, the heart rate sensor may include a light emitting source and a photodetector, and the heart rate sensor detects a reflection amount of light emitted from the light emitting source by the photodetector to obtain a PPG signal, and detects the heart rate related parameter by the PPG signal. It is to be understood that the light used for detecting the heart rate and the heart rate related parameter may be red light, infrared light, green light, etc.

In some embodiments, the heart rate sensor 280G may be configured to detect an Electrocardiogram (ECG) signal, and the heart rate and heart rate related parameters may be derived by analyzing the ECG signal. At this point, the heart rate sensor may include a set of electrodes, which may include at least 2 electrodes, and an ECG circuit coupled to the at least 2 electrodes. Wherein, at least 2 electrodes are respectively used for contacting the skin of different positions of the user, for example, one group of electrodes comprises three electrodes, taking the wearable device worn by the left hand of the user as an example, the electrode 1 can contact the finger of the right hand of the user, and the electrode 2 and the electrode 3 can respectively contact the wrist of the left hand of the user. The ECG circuit is used to convert the electrical signals acquired by the set of electrodes into ECG signals.

The blood oxygen sensor 280H may include at least one light emitting source and at least one Photodetector (PD) for calculating oxygen saturation. Wherein, this at least one luminous source can launch ruddiness and infrared light, and the ruddiness and the infrared light of transmission reflect through human tissue, and at least one photoelectric detector can receive this reflected light and change it into photoplethysmography (PPG) signal respectively, and wherein, receiving ruddiness and changing into ruddiness PPG signal, the infrared light of receipt changes into infrared PPG signal. The red light PPG signal and the infrared PPG signal are used for calculating the blood oxygen saturation. For example, the blood oxygen sensor comprises 2 LEDs and 2 PDs, wherein one LED can emit red light, one LED can emit near infrared light, one PD is used for detecting red light, and one PD is used for detecting near infrared light.

The keys 290 include a power-on key, a volume key, etc. The keys 290 may be mechanical keys. Or may be touch keys. The second electronic device 200 may receive a key input, and generate a key signal input related to user setting and function control of the second electronic device 200.

The motor 291 may generate a vibration cue. The motor 291 can be used for both incoming call vibration prompting and touch vibration feedback. For example, touch operations applied to different applications may correspond to different vibration feedback effects. The motor 291 may also correspond to different vibration feedback effects for touch operations on different areas of the display 250. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization. In some embodiments of the present application, the motor 291 may vibrate to alert the user to turn over when the first electronic device detects that the user is asleep and asleep.

Indicator 292 may be an indicator light that may be used to indicate a state of charge, a change in charge, or may be used to indicate a message, missed call, notification, etc.

Referring to fig. 3, fig. 3 is a schematic flowchart of a method for monitoring sleep according to this embodiment. The method may be performed by the first electronic device shown in fig. 1 or fig. 2A, or may be implemented by the system shown in fig. 1. It should be understood that as shown in fig. 3, the method may include, but is not limited to, the following steps:

and S02, the first electronic equipment monitors whether the user is in a sleep state.

In one implementation, as shown in fig. 2A, the first electronic device 100 includes an audio capture device, which may be a microphone. The first electronic device obtains a second sound of the environment through the audio acquisition device. The second sound includes a breathing sound of the user, the first electronic device extracts a breathing rate of the user according to the breathing sound, and determines that the user is in a sleep state when the breathing rate is less than a second threshold, and further, step S04 may be executed. Otherwise, when the respiration rate is not less than the second threshold, the first electronic device determines that the user is not in the sleep state, and may return to S02. Wherein the second threshold may be an average of the breathing rate of the user while sleeping.

In another implementation, the first electronic device may receive indication information sent by the second electronic device to indicate whether the second electronic device is in a sleep state; further, whether the user is in a sleep state is identified based on the indication information.

In yet another implementation, the first electronic device may receive physiological information sent by the second electronic device in real time, and then detect whether the user is in a sleep state based on the physiological information. The physiological information may include PPG signals, heart rate, etc.

And S04, the first electronic equipment detects whether the user has sleep apnea.

In one implementation, the first electronic device continuously acquires a first sound of an environment through the audio acquisition device when detecting that the user is in a sleep state. When the first sound does not include the breathing sound, or the breathing rate of the breathing sound included in the first sound is less than the first threshold, the first electronic device determines that the user has sleep apnea, and further, step S06 may be performed. Wherein the first threshold is smaller than the second threshold. Conversely, if the first sound includes a breathing sound and the breathing rate is not less than the first threshold, the first electronic device determines that the user does not have sleep apnea, and further, the step S02 may be executed again. In some embodiments, when the first electronic device determines that the user has not experienced sleep apnea, execution may also return to S04.

In another implementation, a first electronic device may receive indication information sent by a second electronic device to indicate whether sleep apnea occurs; further, whether sleep apnea of the user occurs is identified based on the indication information.

In yet another implementation, the first electronic device may receive physiological information and motion parameters sent by the second electronic device in real time, and then detect whether the user has sleep apnea based on one or more of the physiological information and the motion parameters. The physiological information may include PPG signals, blood oxygen saturation, etc.

It should be understood that the first electronic device may also jointly detect whether the user has sleep apnea by combining the above physiological information, the motion parameter, the first sound, and the like.

And S06, the first electronic equipment transmits the first ultrasonic wave to the user through the ultrasonic wave generating device.

The first electronic equipment comprises an ultrasonic wave transmitting device and an ultrasonic wave receiving device, wherein the ultrasonic wave transmitting device comprises a plurality of transmitting array elements which are arranged in an array mode, and the arrangement mode of the transmitting array elements can influence the beam width of the transmitted ultrasonic waves. In the embodiment of the present application, the ultrasonic wave transmitting device transmits the first ultrasonic wave to the upper body of the user, and the sleeping posture of the user is determined by analyzing the first ultrasonic wave reflected by the upper body of the user. The beam width of the first ultrasonic wave may be determined by the arrangement of the transmitting array elements, the distance between the first electronic device and the user, and the length of the upper body of the user.

Wherein the ultrasonic wave emitting device may be a speaker 170A as shown in fig. 2A, the ultrasonic wave receiving device may be an audio collecting device 170C as shown in fig. 2A, and the audio collecting device 170C may be a microphone.

In a specific embodiment, S06 may include, but is not limited to, the following steps:

s061, the first electronic device obtains the distance between the first electronic device and the user.

In one embodiment, the distance measuring method of the first electronic device from the user may be implemented by ultrasonic ranging. Specifically, S061 may include, but is not limited to, the following steps:

A. the first electronic device transmits the third ultrasonic wave to the user through the ultrasonic wave transmitting device.

B. The first electronic device receives a fourth ultrasonic wave through the ultrasonic receiving device, wherein the fourth ultrasonic wave is a reflected third ultrasonic wave.

C. And determining the distance between the first electronic equipment and the user according to the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.

It can be understood that, in the embodiment of the present application, the first electronic device is placed on an object at the same height as that of the user lying on his back, the first electronic device transmits the third ultrasonic wave transmitted by the ultrasonic wave transmitting device along a straight line, the third ultrasonic wave may reach different positions on the body of the user, and the distance measured at the different positions is within a certain range of values within which the beam width of the first ultrasonic wave is determined to be the same.

In other embodiments, the distance between the first electronic device and the user may also be measured by a distance sensor 180F as in fig. 2A.

S062, the first electronic equipment calculates the length of the upper body of the user according to the height of the user.

S063, the first electronic device determines the beam width according to the distance acquired in S061, the length of the upper body of the user and the position of the transmitting array.

And S064, transmitting the first ultrasonic wave to the user at the beam width by the ultrasonic wave transmitting device under the distance, so that the first ultrasonic wave covers the upper half of the user.

It should be understood that the process of determining the beam width is a process of determining a transmitting array element for transmitting the first ultrasonic wave in the ultrasonic transmitting device and determining the radiation angle of the first ultrasonic wave.

S08, the first electronic device receives the second ultrasonic wave through the ultrasonic wave receiving device.

The first electronic equipment receives second ultrasonic waves through the ultrasonic receiving device, the second ultrasonic waves are reflected first ultrasonic waves, and the second ultrasonic waves comprise the first ultrasonic waves reflected by a user. The first ultrasonic wave reflected by the user is the first ultrasonic wave reflected by the upper body of the user.

And S10, filtering the power information of the first ultrasonic waves reflected by the obstacles except the user from the power information of the second ultrasonic waves to obtain the power information of the first ultrasonic waves reflected by the user.

After the first electronic device receives the second ultrasonic wave, a distance of the obstacle from the first electronic device may be determined based on a time delay between the transmitted first ultrasonic wave and the received second ultrasonic wave. Further, the first electronic device may filter, from the power information of the second ultrasonic waves, power information of the first ultrasonic waves reflected by an obstacle other than the user according to a distance range between the user and the first electronic device, to obtain the power information of the first ultrasonic waves reflected by the user.

It should be understood that the power information is a power spectrum.

And S12, the first electronic equipment detects whether the sleeping posture of the user is supine or not according to the total power of the first ultrasonic waves reflected by the user.

The first electronic equipment calculates the total power of the first ultrasonic waves reflected by the user by obtaining the power information of the first ultrasonic waves reflected by the user. The total power is the sum of the powers of the first ultrasonic waves reflected by all points of the upper half of the user.

When the total power of the first ultrasonic waves reflected by the user is less than the target threshold, the first electronic device determines that the user' S sleeping posture is supine, and the first electronic device performs the following step S14. When the total power of the first ultrasonic waves reflected by the user is not less than the target threshold, it is determined that the sleeping posture of the user is not supine, and the first electronic device may return to perform the above step S02 to detect whether the user is in a sleeping state. In some embodiments, when the first electronic device determines that the user is not supine, it may return to performing step S04 described above.

The first electronic device may determine the target threshold according to a height of a user and a distance between the user and the first electronic device. When the distance is not changed, the larger the height is, the larger the target threshold value is; when the height is constant, the larger the distance is, the smaller the target threshold value is.

And S14, the first electronic equipment outputs prompt information.

When the user lies on his back, the first electronic device outputs prompt information, where the prompt information is used to prompt the user to adjust the sleeping posture, and the prompt information may be vibration, sound, and the like.

The first electronic device, after performing S14, may return to S02, enabling continuous monitoring of the user' S sleep.

The method shown in fig. 3 can be performed by readily available electronic devices, and is suitable for daily use. The electronic equipment identifies the sleeping posture of the user at a certain distance from the user, non-contact sleeping posture detection is realized, and the electronic equipment outputs prompt information to remind the user of intervening sleep apnea of the user. Meanwhile, the electronic equipment continuously monitors the sleep of the user, and starts the sleep posture detection when the user is judged to have apnea, so that the function is started when necessary, and the energy consumption of the electronic equipment can be reduced.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a second sleep monitoring method according to the present embodiment. The method may be performed by the first electronic device shown in fig. 2A and the second electronic device shown in fig. 2B, where the hardware architecture of the first electronic device may be the architecture shown in fig. 2A, and the hardware architecture of the second electronic device may be the architecture shown in fig. 2B. It should be understood that as shown in fig. 4, the method may include, but is not limited to, the following steps:

s200, the first electronic device and the second electronic device establish communication connection through the wireless communication module.

S202, the second electronic device detects whether the user is in a sleep state.

In some embodiments, the second electronic device may acquire a heart rate of the user through a heart rate sensor, and identify whether the user is in a sleep state based on the heart rate.

The second electronic device includes a heart rate sensor as shown in fig. 2B, and obtains the heart rate of the user through the heart rate sensor, which may specifically refer to the related description of fig. 2B, and details are not repeated here. When the acquired heart rate is in the first heart rate range, the second electronic device determines that the user is in a sleep state, and further, step S204 may be executed. When the acquired heart rate is not in the first heart rate range, the second electronic device returns to execute step S202.

The first heart rate range is a heart rate range centered on the sleep reference heart rate of the user, and may be represented as "T ± Δ a". Wherein, T is a sleep reference heart rate, which may be an average heart rate of the user in a sleep state, reflecting a basic heart rate level of the user during sleep; Δ a is the variation amplitude of the heart rate of the user in the sleep state based on the average heart rate.

In other embodiments, the second electronic device may obtain the motion parameter of the user through a motion sensor such as an acceleration sensor or a gyroscope, and further, may analyze the motion condition of the user based on the motion parameter, and determine that the user is in a sleep state when the user is stationary.

It can be understood that the second electronic device may further detect the sleep state of the user by combining the data fusion obtained by the heart rate sensor and the motion sensor, and at this time, it is determined that the user is in the sleep state only when the acquired heart rate is in the first heart rate range and the user is still.

And S204, the second electronic equipment detects whether the user has sleep apnea.

The second electronic device includes an oximetry sensor as shown in fig. 2B, and the oximetry sensor is used to acquire the blood oxygen saturation of the user, which may be referred to the above description of fig. 2B, and is not described herein again. The second electronic device determines that the user has sleep apnea when detecting that the user is in a sleep state and the blood oxygen saturation is less than the first blood oxygen threshold, and further, may execute step S206. Otherwise, when the second electronic device detects that the user is in a sleep state but the blood oxygen saturation is not less than the first blood oxygen threshold, it is determined that the user does not have sleep apnea, and then the process returns to step S202.

S206, the second electronic device sends indication information used for indicating that the user has sleep apnea to the first electronic device.

When the first electronic device receives indication information sent by the second electronic device, it is detected that the user has apnea in the sleep state, and the indication information is used for indicating that the user has apnea in the sleep state. After the first electronic device receives the indication information sent by the second electronic device, steps S208 to S212 are executed, which may be specifically referred to as steps S06 to S10 in the above-mentioned (a), and details are not repeated here.

S214, the first electronic equipment detects whether the sleeping posture of the user is supine or not according to the total power of the first ultrasonic waves reflected by the user.

And calculating the total power of the first ultrasonic waves reflected by the user by obtaining the power information of the first ultrasonic waves reflected by the user. The total power is the sum of the powers of the first ultrasonic waves reflected by all points of the upper half of the user.

The first electronic device determines that the user is sleeping supine when the total power of the first ultrasonic waves reflected by the user is less than the target threshold, and further, may perform the following step S216. Conversely, when the total power of the first ultrasonic waves reflected by the user is not less than the target threshold, the first electronic device determines that the sleeping posture of the user is not supine, and then step S215 may be executed.

The first electronic device may determine the target threshold according to a height of the user and a distance between the user and the first electronic device. When the distance is not changed, the larger the height is, the larger the target threshold value is; when the height is constant, the larger the distance, the smaller the target threshold.

S215, stopping the sleep posture adjustment reminding.

S216, the first electronic device sends prompt information for prompting the user to adjust the sleeping posture to the second electronic device.

And S218, the second electronic equipment vibrates and displays the prompt message.

The second electronic device receives prompt information sent by the first electronic device for prompting the user to adjust the sleeping posture, vibrates through the motor as shown in fig. 2B, and displays the prompt information through the display screen as shown in fig. 2B.

After performing S218, the second electronic device may return to S202 to implement continuous monitoring of the user' S sleep.

Referring to fig. 5, fig. 5 is a schematic flowchart of a third sleep monitoring method according to this embodiment. The method may be performed by the first electronic device shown in fig. 2A and the second electronic device shown in fig. 2B, where the hardware architecture of the first electronic device may be the architecture shown in fig. 2A, and the hardware architecture of the second electronic device may be the architecture shown in fig. 2B. It should be understood that as shown in fig. 5, the method may include, but is not limited to, the following steps:

s300, the second electronic device acquires physiological information of the user.

The second electronic device acquires physiological information of the user through the heart rate sensor, the blood oxygen sensor, and the electrocardiogram sensor shown in fig. 2B, where the physiological information includes one or more of blood oxygen saturation, heart rate related parameters, pulse information (intensity and speed), and respiration rate, and reference may be made to the above description of fig. 2B, which is not repeated herein.

S301, the second electronic device sends the physiological information of the user to the first electronic device.

S302, the first electronic device detects whether the user is in a sleep state.

The first electronic device receives physiological information sent by the second electronic device, wherein the physiological information comprises the heart rate of the user. When the acquired heart rate is in the first heart rate range, the first electronic device determines that the user is in a sleep state, and further, step S304 may be executed. Otherwise, when the acquired heart rate is not in the first heart rate range, the first electronic device may return to perform step S302.

The first heart rate range is a heart rate range centered on the sleep reference heart rate of the user, and may be represented as "T ± Δ a". The sleep reference heart rate can be an average heart rate of a user in a sleep state, and reflects a basic heart rate level of the user in a sleep period; Δ a is the variation amplitude of the heart rate of the user in the sleep state based on the average heart rate.

S304, the first electronic device detects whether the user has apnea.

The first electronic device receives physiological information sent by the second electronic device, wherein the physiological information comprises the blood oxygen saturation of the user. The first electronic device determines that the user has sleep apnea when detecting that the user is in a sleep state and the blood oxygen saturation is less than the first blood oxygen threshold, and further, may execute step S306. Otherwise, when the first electronic device detects that the user is in the sleep state and the blood oxygen saturation is not less than the first blood oxygen threshold, it determines that the user does not have sleep apnea, and then returns to execute step S302.

After the first electronic device detects that the user has apnea, the first electronic device performs steps S306 to S310 shown in fig. 5, which may be specifically referred to steps S06 to S10 in the above (a), and details are not repeated herein.

In other embodiments, the second electronic device may further collect the motion parameters of the user through the motion sensor, and transmit the motion parameters to the first electronic device. The second electronic device can comprehensively judge whether the user is in a sleep state or not and whether apnea occurs or not based on the physiological information, the motion parameters, the first sound and the like. Specifically, the first electronic device determines that the user is in a sleep state and apnea occurs when the user is still, the blood oxygen saturation is lower than a first blood oxygen threshold value and the first sound cannot detect breathing sound based on the motion parameters; conversely, the first electronic device determines that the user is in a sleep state but no apnea has occurred when the user is identified as stationary based on the motion parameters, the blood oxygen saturation is not lower than the first blood oxygen threshold, and the first sound detects breathing sounds. Or the first electronic device determines that the user has apnea in the sleep state when the user is still and the blood oxygen saturation is lower than the first blood oxygen threshold or the first sound does not detect the breathing sound based on the motion parameters; conversely, the first electronic device determines that the user is not experiencing an apnea in the sleep state when the user is identified as being stationary based on the motion parameters, but the blood oxygen saturation is not lower than the first blood oxygen threshold and the first sound detects a breath sound. It is to be appreciated that the first electronic device may determine that the user is not in a sleep state upon identifying that the user is not stationary based on the motion parameters.

S312, the first electronic equipment detects whether the sleeping posture of the user is supine or not according to the total power of the first ultrasonic waves reflected by the user.

The first electronic device determines that the user is sleeping on the back when the total power of the first ultrasonic waves reflected by the user is less than the target threshold, and further, may perform the following step S314. Otherwise, when the total power of the first ultrasonic waves reflected by the user is not less than the target threshold, it is determined that the sleeping posture of the user is not supine, and the first electronic device may return to execute step 302 to detect whether the user is in a sleeping state.

The first electronic device may determine the target threshold according to a height of the user and a distance between the user and the first electronic device. When the distance is not changed, the height is larger, and the target threshold value is larger; when the height is constant, the larger the distance, the smaller the target threshold.

And S314, the first electronic equipment sends prompt information for prompting the user to adjust the sleeping posture to the second electronic equipment.

And S316, vibrating the second electronic device and displaying the prompt message.

After performing S316, the second electronic device may return to S300, so as to continuously monitor the sleep of the user.

As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection …", depending on the context. Similarly, depending on the context, the phrase "at the time of determination …" or "if (a stated condition or event) is detected" may be interpreted to mean "if the determination …" or "in response to the determination …" or "upon detection (a stated condition or event)" or "in response to detection (a stated condition or event)".

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), among others.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media capable of storing program codes, such as ROM or RAM, magnetic or optical disks, etc.

Claims

1. A method for monitoring sleep, which is applied to an electronic device, wherein the electronic device comprises an ultrasonic wave transmitting device and an ultrasonic wave receiving device, and the method comprises the following steps:

when detecting that a user has a breath pause in a sleep state, transmitting first ultrasonic waves to the user through the ultrasonic wave transmitting device;

receiving, by the ultrasonic receiving device, a second ultrasonic wave, which is a reflected first ultrasonic wave, the second ultrasonic wave including the first ultrasonic wave reflected by the user;

determining the sleeping posture of the user according to the total power of the first ultrasonic waves reflected by the user;

and when the sleeping posture of the user is supine, outputting prompt information, wherein the prompt information is used for prompting the user to adjust the sleeping posture.

2. The method according to claim 1, wherein the determining the sleeping posture of the user based on the total power of the first ultrasonic waves reflected by the user comprises:

when the total power of the first ultrasonic waves reflected by the user is smaller than a target threshold value, determining that the sleeping posture of the user is supine.

3. The method of claim 2, wherein before determining that the user's sleeping posture is supine when the total power of the first ultrasound waves reflected by the user is less than a target threshold, the method further comprises:

determining the target threshold value according to the height of the user and the distance between the user and the electronic equipment; when the distance is unchanged, the larger the height is, the larger the target threshold is; the larger the distance, the smaller the target threshold, while the height is constant.

4. The method according to any one of claims 1-3, wherein the ultrasonic wave emitting device comprises a plurality of emitting array elements arranged in an array, and the emitting the first ultrasonic wave to the user by the ultrasonic wave emitting device comprises:

acquiring the distance between the electronic equipment and the user;

calculating the length of the upper body of the user according to the height of the user;

determining the beam width according to the distance, the length and the position of the transmitting array element;

transmitting, by the ultrasonic wave transmitting device, a first ultrasonic wave at the beam width to the user at the distance so that the first ultrasonic wave covers the upper body of the user.

5. The method of claim 4, wherein obtaining the distance between the electronic device and the user comprises:

transmitting a third ultrasonic wave to the user through the ultrasonic wave transmitting device;

receiving, by the ultrasonic receiving device, a fourth ultrasonic wave, which is the reflected third ultrasonic wave;

and determining the distance according to the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.

6. The method according to any one of claims 1-5, wherein said method further comprises, after receiving a second ultrasonic wave by said ultrasonic receiving device, before said determining a sleeping posture of said user based on a total power of said first ultrasonic wave reflected by said user, said method further comprising:

and filtering power information of first ultrasonic waves reflected by obstacles except the user from power information of second ultrasonic waves to obtain the power information of the first ultrasonic waves reflected by the user, wherein the second ultrasonic waves comprise the first ultrasonic waves reflected by the user and the first ultrasonic waves reflected by the obstacles except the user.

7. The method according to any one of claims 1-6, further comprising:

when indication information sent by the wearable device is received, the fact that the user generates apnea in the sleep state is detected, and the indication information is used for indicating that the user generates apnea in the sleep state.

8. The method according to any one of claims 1-6, further comprising:

receiving physiological information sent by a wearable device, wherein the physiological information comprises blood oxygen saturation;

determining that the user has sleep apnea when the user is detected to be in a sleep state and the blood oxygen saturation is less than a first blood oxygen threshold.

9. The method of any of claims 1-6, wherein the electronic device further comprises an audio capture device, the method further comprising:

when the user is detected to be in a sleep state, acquiring first sound of the environment through the audio acquisition device;

the user experiences sleep apnea when the first sound does not include breathing sound or a breathing rate of breathing sound included by the first sound is less than a first threshold.

10. The method of any of claims 1-9, wherein the electronic device further comprises an audio capture device, the method further comprising:

acquiring a second sound of the environment through the audio acquisition device;

and when the breathing rate of the breathing sound included by the second sound is smaller than a second threshold value, determining that the user is in a sleep state.

11. The method according to any one of claims 1-9, further comprising:

receiving a heart rate sent by the wearable device;

when the heart rate is in a first heart rate range, determining that the user is in a sleep state, wherein the first heart rate range is a heart rate range taking a sleep reference heart rate of the user as a center, and the sleep reference heart rate is an average heart rate of the user in the sleep state.

12. The method according to any one of claims 1-11, wherein the outputting the prompt message comprises:

sending prompt information to a wearable device, so that the wearable device vibrates and displays the prompt information after receiving the prompt information.

13. An electronic device, comprising a processor, a memory, an ultrasonic transmitting device, and an ultrasonic receiving device, wherein the processor is coupled to the ultrasonic transmitting device, the ultrasonic receiving device, and the one or more memories via a bus, respectively;

the one or more memories are for storing computer program code comprising computer instructions; the processor is configured to invoke the computer instructions to perform the following operations:

14. The electronic device of claim 13, wherein the processor performs determining a sleeping posture of the user based on a total power of the first ultrasonic waves reflected by the user, comprises performing:

15. The electronic device of claim 14, wherein the processor is further configured to perform, before determining that the user's sleeping posture is supine when the total power of the first ultrasonic waves reflected by the user is less than a target threshold:

determining the target threshold value according to the height of the user and the distance between the user and the electronic equipment; when the distance is unchanged, the larger the height is, the larger the target threshold is; when the height is unchanged, the larger the distance is, the smaller the target threshold is.

16. The electronic device of any of claims 13-15, wherein the ultrasound transmitting device comprises a plurality of transmitting elements arranged in an array, and wherein the processor performs transmitting a first ultrasound wave to the user via the ultrasound transmitting device, comprising performing:

acquiring the distance between the electronic equipment and the user;

17. The electronic device of claim 16, wherein the processor performs obtaining a distance between the electronic device and the user comprises performing:

18. The electronic device according to any of claims 13-17, wherein after receiving the second ultrasonic wave by the ultrasonic receiving device, the processor performs the following before determining the sleeping posture of the user according to the total power of the first ultrasonic wave reflected by the user, further comprising:

19. The electronic device of any of claims 13-18, wherein the electronic device further comprises a communication module, and wherein the processor further performs:

receiving indication information sent by the wearable device through the communication module, wherein the indication information is used for indicating that the user has apnea in a sleep state.

20. The electronic device of any of claims 13-18, wherein the electronic device further comprises a communication module, and wherein the processor further performs:

receiving, by the communication module, physiological information sent by a wearable device, the physiological information including a blood oxygen saturation level;

21. The electronic device of any of claims 13-18, wherein the electronic device further comprises an audio capture device, and wherein the processor further performs:

22. The electronic device of any of claims 13-21, wherein the electronic device further comprises an audio capture device, and wherein the processor further performs:

23. The electronic device of any of claims 13-21, wherein the electronic device further comprises a communication module, and wherein the processor further performs:

receiving, by the communication module, a heart rate sent by the wearable device;

24. The electronic device of any of claims 13-23, wherein the processor executes the output prompt message, comprising:

25. A computer storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of monitoring sleep of claims 1-12.