WO2022247649A1 - Method and apparatus for evaluating respiratory function during sleep - Google Patents

Method and apparatus for evaluating respiratory function during sleep Download PDF

Info

Publication number
WO2022247649A1
WO2022247649A1 PCT/CN2022/092419 CN2022092419W WO2022247649A1 WO 2022247649 A1 WO2022247649 A1 WO 2022247649A1 CN 2022092419 W CN2022092419 W CN 2022092419W WO 2022247649 A1 WO2022247649 A1 WO 2022247649A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
sleep
detection scene
detection
equal
Prior art date
Application number
PCT/CN2022/092419
Other languages
French (fr)
Chinese (zh)
Inventor
许德省
李靖
许培达
沈东崎
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022247649A1 publication Critical patent/WO2022247649A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • A61B5/4809Sleep detection, i.e. determining whether a subject is asleep or not
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • A61B5/4812Detecting sleep stages or cycles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • A61B5/4815Sleep quality
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • A61B5/4818Sleep apnoea
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • A61B5/681Wristwatch-type devices

Definitions

  • the present application relates to the field of computer technology, and more specifically, to a method and device for evaluating sleep breathing function.
  • Sleep-disordered breathing is a major factor affecting sleep quality. Simple snoring, hypoventilation, and sleep apnea are the most common causes of sleep-disordered breathing. Respiratory diseases during sleep can be fatal. Therefore, effective real-time detection and early warning of abnormal sleep stages, simple snoring, hypoventilation, and sleep apnea during sleep are particularly important for personal health and family care.
  • apps applications for the evaluation of sleep breathing function on the market
  • apps applications for the evaluation of sleep breathing function on the market
  • apps applications for the evaluation of sleep breathing function on the market
  • apps set a threshold in the environment where the user (or the subject) sleeps or use a neural network method Identify the sound and breathing sound during sleep, and then evaluate the quality of the user's sleep breathing throughout the night.
  • This evaluation method requires the user to manually click the start and end of sleep, which is extremely unfriendly to the user experience.
  • the present application provides a method and device for evaluating sleep breathing function, which can conveniently evaluate a user's sleep breathing function and improve user experience.
  • a method for evaluating sleep breathing function includes: determining a current detection scene, and the current detection scene belongs to one of preset detection scenarios, wherein the preset The detection scene includes a first detection scene and a second detection scene, wherein the first detection scene is that the user is wearing a smart wearable device, and the second detection scene is that the user is not wearing a smart wearable device;
  • the selected detection method to determine the state of the user, wherein the state of the user includes that the user is in a sleeping state, or that the user is in a non-sleeping state;
  • the evaluation of the sleep breathing function of the user is turned on or off
  • the evaluation of sleep breathing function includes evaluating one or more of the following: sleep cycle stage, hypopnea, sleep apnea, and risk of snoring grade.
  • the current detection scene is determined, and a corresponding detection method is selected based on the current detection scene.
  • Different detection methods use different means to determine whether the user is in a sleep state. If it is determined that the user is in a sleep state, the evaluation of the sleep apnea function is automatically started. If it is determined that the user is in a non-sleeping state, the evaluation of the sleep apnea function is not started.
  • the user needs to manually click the sleep start or sleep end on the sleep monitoring device to turn on or off the sleep breathing function of the sleep monitoring device, the technical solution of the present application, in different detection scenarios
  • the user's status is obtained through different detection methods, so that the evaluation of the sleep breathing function can be automatically turned on or off, and the user experience is more friendly.
  • the selecting a detection method according to the current detection scenario includes:
  • the current detection scene is the first detection scene
  • select a first detection method wherein the first detection method is to judge the state of the user through the smart wearable device; or,
  • the current detection scene is the second detection scene
  • select the second detection method wherein the second detection method is to judge the the status of the user
  • the status of the smart wearable device includes one or more of the following: the duration of the smart wearable device being in a static state within a specified period of time is greater than or equal to the first duration threshold, the duration of the smart wearable device being in a large motion state The duration is greater than or equal to the second duration threshold;
  • the user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time.
  • the smart wearable device in the detection scenario where the user wears the smart wearable device, the smart wearable device is used to judge the user's state in real time, specifically, to judge the user's falling asleep and getting out of sleep.
  • the user when the user is not wearing the smart wearable device, it is necessary to combine the state of the smart wearable device and the user's historical sleep information to determine the user's state.
  • the user's state can be judged through an appropriate detection method, and then the evaluation can be automatically turned on or off, which improves the user experience.
  • the method further includes:
  • the available signals include one or more of the following:
  • the respiratory indicators include respiratory rate and/or respiratory wave decline;
  • one or more snore indicators including snore loudness
  • the user's action index includes the user's action range and/or frequency of major actions.
  • the evaluating the sleep breathing function of the user according to the available signal includes:
  • the available signal is predicted by using the trained light gradient lifting machine GBM model to evaluate the sleep breathing function of the user.
  • the trained light-weight GBM model is used to predict what is available in the current detection scene. Since the light-weight GBM model is obtained through a large amount of data training in advance, and the data used for training is only reserved for breathing, The frequency bands related to snoring and other signals have high sensitivity, which provides a good basis for the subsequent evaluation of sleep breathing function, and the evaluation accuracy is improved.
  • the method before using the trained lightweight GBM prediction model to predict the available signal, the method further includes:
  • Preprocessing the audio data and ultrasound data and performing feature extraction on the preprocessed audio data and ultrasound data to obtain extracted data
  • the feature extraction process includes processing the preprocessed audio Data and ultrasound data for the extraction of raw features and the aggregation of statistical features
  • the available signals obtained in the detection scene such as audio data and ultrasonic data
  • the extracted data thus obtained is used for the training of the lightweight GBM model, which can improve the performance of the lightweight GBM model.
  • the evaluation result of the technical scheme of the present application is more accurate and the sensitivity is higher.
  • the use of the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user includes:
  • the snoring loudness is greater than or equal to the first loudness threshold, and the duration is greater than or equal to the first duration threshold, it is determined that the user's snoring level risk is high risk;
  • the loudness of the snoring sound is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
  • the loudness of the snoring sound is greater than or equal to the second loudness threshold and the duration is greater than or equal to the second duration threshold, it is determined that the user's snoring level risk is low risk, wherein the second loudness threshold is smaller than the first loudness threshold a threshold, the second duration threshold is less than the first duration threshold;
  • the use of the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user includes:
  • the sleep staging stage is REM sleep
  • the sleep staging stage is light sleep
  • the sleep staging stage is deep sleep.
  • the use of the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user includes:
  • hypopnea If the decrease ratio of the amplitude of the respiratory wave is greater than the first percentage, it is judged as hypopnea
  • the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage, it is determined to be sleep apnea.
  • the second aspect provides a communication device, the communication device has the function of realizing the method in the first aspect or any possible implementation thereof, the function can be realized by hardware, or by executing corresponding software by hardware .
  • the hardware or software includes one or more units corresponding to the above functions.
  • a communication device including a processor and a communication interface, the communication interface is used to receive data and/or information, and transmit the received data and/or information to the processor, the processing The processor processes the data and/or information, so that the communication device executes the method in the first aspect or any possible implementation thereof.
  • the processor may be a processing circuit.
  • the aforementioned communication interface may be an interface circuit.
  • the communication interface may include an input interface and an output interface.
  • the input interface is used to receive data and/or information to be processed
  • the output interface is used to output processed data and/or information.
  • the present application provides a communication device, including at least one processor, the at least one processor is coupled to at least one memory, the at least one memory is used to store computer programs or instructions, and the at least one processor is used to The computer program or instruction is called and executed from the at least one memory, so that the communication device executes the method in the first aspect or any possible implementation manner thereof.
  • the at least one processor is integrated with the at least one memory.
  • the communication devices in the above second to fourth aspects may be a chip or a chip system, for example, a system on a chip (system on a chip, SOC) chip.
  • a system on a chip system on a chip, SOC
  • the present application provides a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium, and when the computer instructions are run on a computer, as in the first aspect or any possible implementation thereof, method is executed.
  • the present application provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on a computer, the method in the first aspect or any possible implementation thereof be executed.
  • the present application provides a smart wearable device, including the communication device as described in the second aspect.
  • Fig. 1 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application.
  • Fig. 2 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application.
  • FIG. 3 is a schematic block diagram of preprocessing and feature extraction performed by the evaluation device.
  • Fig. 4 is an exemplary flow chart of the method for evaluating sleep breathing function provided by the present application.
  • FIG. 5 is an evaluation device 500 for evaluating sleep breathing function provided by the present application.
  • Fig. 6 is a schematic block diagram of the evaluation device provided by the present application.
  • Fig. 7 is a schematic structural diagram of the evaluation device provided by the present application.
  • Fig. 8 is a schematic block diagram of a smart wearable device provided by the present application.
  • the technical solution of this application can be applied to smart wearable devices, which can automatically detect the user's sleep breathing function (for example, sleep staging, sleep apnea, snoring detection, snoring partial detection, hypoventilation and other sleep breathing related diseases)
  • the evaluation does not require the user to manually enable or disable the evaluation of the sleep breathing function, which improves the user experience.
  • the accuracy of the assessment has also improved.
  • the smart wearable devices mentioned in this application include, but are not limited to: smart electronic products such as smart bracelets, smart watches, smart phones, and iPads.
  • FIG. 1 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application.
  • the method 100 may be performed by an evaluation device.
  • the evaluation device may be a smart wearable device, or a chip (or chip system) built in the smart wearable device.
  • the method 100 mainly includes steps 110-140.
  • the evaluation device determines a current detection scene, where the current detection scene belongs to one of preset detection scenes.
  • the preset detection scenarios may include a first detection scenario and a second detection scenario.
  • the first detection scene is that the user wears the smart wearable device
  • the second detection scene is that the user does not wear the smart wearable device.
  • the evaluation device selects a detection mode according to the current detection scenario.
  • the evaluation device may select a detection method suitable for the detection scenario in different detection scenarios, so as to further determine whether the user is in a sleep state.
  • the evaluation device selects the first detection mode.
  • the first detection method is that the evaluation device judges the state of the user through the smart wearable device.
  • the evaluation device selects the second detection method, wherein, if the second detection method is adopted, the evaluation device needs to further obtain the status of the smart wearable device and the user's historical sleep information, and according to the smart wearable The status of the device and the historical sleep information of the user are used to determine the status of the user.
  • the state of the smart wearable device includes one or more of the following:
  • the duration of the smart wearable device being in a static state within a specified time period is greater than or equal to the first duration threshold, and the duration of the smart wearable device being in a large motion state is greater than or equal to the second duration threshold.
  • whether the smart wearable device is in a large motion state can be judged by the motion range of the smart wearable device. For example, set a threshold of motion range, if the motion range of the smart wearable device is greater than the threshold, it indicates that the smart wearable device is in a state of large motion, otherwise it is not in a state of large motion.
  • the user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time, and so on.
  • the sleep time preset by the user may be a preset time for falling asleep, or a preset time for getting up (that is, time for getting out of sleep), and the like.
  • the evaluation device judges the state of the user by using the selected detection mode.
  • the state of the user includes that the user is in a sleeping state, or the user is in a non-sleeping state.
  • the evaluation device enables or disables the evaluation of the sleep breathing function of the user according to the state of the user.
  • the evaluation of the user's sleep breathing function is started.
  • the evaluation of the user's sleep breathing function is not enabled or disabled.
  • turning off the sleep apnea function evaluation refers to turning off the sleep apnea function evaluation after the sleep apnea function evaluation is turned on by judging the user's state in real time.
  • the assessment of sleep breathing function may include, but is not limited to, assessing one or more of the following: sleep cycle stages, hypopnea, sleep apnea, and risk of snoring grade.
  • the evaluation device can determine whether the user is in a sleep state, and then automatically enable or disable the evaluation of sleep breathing function. Specifically, if the evaluation device determines that the user is in a sleep state, it automatically starts the evaluation of the sleep breathing function. On the contrary, if the evaluation device determines that the user is in a non-sleeping state, the evaluation of the sleep breathing function is not started. Alternatively, after the evaluation device automatically starts the evaluation of the sleep apnea function, it judges the state of the user in real time and determines that the user is out of sleep, and then automatically turns off the evaluation of the sleep apnea function.
  • the evaluation device is In different detection scenarios, the user's status is obtained through different detection methods, so that the evaluation of the sleep breathing function can be automatically turned on or off, and the user experience is more friendly.
  • the assessment device performs the sleep breathing function assessment process after it determines that the user is in a sleep state and starts the sleep breathing function assessment.
  • FIG. 2 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application. Similar to method 100, method 200 may be performed by an evaluation device. As shown in FIG. 2 , the method 200 mainly includes steps 210-240.
  • the evaluation device determines that the current detection scene is the first detection scene, that is, the user is wearing the smart wearable device.
  • the evaluation device selects a first detection manner corresponding to the first detection scene.
  • the evaluation device judges the state of the user through the smart wearable device, and obtains a judgment result.
  • the evaluation device starts the evaluation of the sleep breathing function.
  • the evaluation device After starting the evaluation of the sleep breathing function, the evaluation device continues to perform the following steps.
  • the evaluation device acquires available signals in the current detection scene through the smart wearable device.
  • available signals include one or more of the following:
  • the respiratory indicators include respiratory rate and/or respiratory wave decline;
  • one or more snore indicators including snore loudness
  • the user's action index includes the user's action range and/or frequency of major actions.
  • the evaluation device obtains available signals in the current detection scene through a microphone of the smart wearable device, an ultrasonic sending and/or receiving sensor, and the like.
  • the evaluation device uses a pre-trained machine learning prediction model to predict the obtained available signals and output a prediction result.
  • the machine learning model in this application adopts a lightweight GBM prediction model.
  • the evaluation device acquires audio data and ultrasound data of the user, and preprocesses the audio data and ultrasound data. Further, the evaluation device performs feature extraction on the preprocessed audio data and ultrasound data. Specifically, feature extraction may mainly include extraction of original features and aggregation of statistical features. For the convenience of description, hereinafter, the data obtained through feature extraction will be referred to as extracted data.
  • the evaluation device uses the extracted data to train the light GBM prediction model, and obtains the trained light GBM prediction model, which provides a good guarantee for the accuracy and sensitivity of the subsequent evaluation of sleep breathing function.
  • the detailed flow of preprocessing and feature extraction performed by the evaluation device may be as shown in FIG. 3 .
  • FIG. 3 is a schematic block diagram of preprocessing and feature extraction performed by the evaluation device.
  • the evaluation device obtains target audio data and/or ultrasonic data in the current detection scene through silent detection, judgment of sound segments and silent segments, and collection of audio data and ultrasonic data. Further, the evaluation device performs preprocessing on the obtained target audio data and/or ultrasound data, so as to eliminate the influence of the magnitude of the data and its own local fluctuations.
  • the preprocessing may include performing amplitude normalization, median filtering, and bandpass filtering on the target audio data and/or ultrasound data, so as to retain the frequency bands of the respiratory signal and the snoring signal as much as possible, so as to improve the sensitivity of the evaluation .
  • the evaluation device performs feature extraction on the preprocessed signal to obtain extracted data.
  • the process of feature extraction includes extraction of original features of target audio data and/or ultrasound data and aggregation of statistical features.
  • the original features include, but are not limited to: Mel-frequency cepstral coefficients, differential features, and spectral flatness.
  • Statistical features include, but are not limited to: mean, variance, peak, skewness, and distance features.
  • the machine learning model pair is trained by using the extracted data.
  • the machine learning model may adopt a light gradient boosting machine (light gradient boosting machine, light GBM) model.
  • the light GBM model analyzes the input signal to obtain the probability and label of the respiratory signal, snoring signal and non-snoring signal in the input signal, and statistics and caches them for subsequent predictions .
  • the evaluation device obtains available signals in the current detection scene
  • the obtained available signals are input into the lightweight GBM model, and prediction results are obtained to complete the evaluation of the user's sleep breathing function.
  • the risk of snoring is evaluated through the user's, breathing index, snoring sound index, motion index, and the like.
  • the loudness of snoring is greater than or equal to the first loudness threshold (denoted as DB1), and the duration is greater than or equal to the first duration threshold (denoted as T1), it is determined that the user's snoring risk level is high risk;
  • the snoring loudness is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
  • the snoring loudness is greater than or equal to the second loudness threshold (denoted as DB2), and the duration is greater than or equal to the second duration threshold (denoted as T2), it is determined that the user's snoring level risk is low risk;
  • the second loudness threshold is smaller than the first loudness threshold
  • the second duration threshold is smaller than the first duration threshold
  • the user's sleep staging stage is identified according to the user's breathing rate feature.
  • the respiratory rate is greater than the first frequency (for example, X1) and the slope is greater than the first value (for example, Y1), it is determined that the user's sleep staging stage is rapid eye movement sleep (rapid eye movement sleep, REM);
  • the breathing frequency is less than or equal to the first frequency (for example, X1) and greater than or equal to the second frequency (for example, X2), it is determined that the user's sleep stage is light sleep;
  • the breathing frequency is less than or equal to the second frequency (for example, X2), it is determined that the user's sleep staging stage is deep sleep;
  • X2 is smaller than X1.
  • the user's sleep apnea or hypopnea is judged according to the magnitude of the decrease of the user's respiratory wave.
  • a first percentage for example, X%), it is determined to be hypopnea
  • the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage (for example, Y%), it is determined to be sleep apnea.
  • FIG. 4 is an exemplary flowchart of a method 400 for evaluating sleep breathing function provided by the present application. It should be understood that the method 400 may be performed by an evaluation device.
  • the evaluation device may be executed by a smart wearable device or a module (for example, a chip or a chip system, etc.) with corresponding functions in the smart wearable device, which is not limited.
  • the chip may be a system on a chip (system on a chip, SOC).
  • judging whether the user wears the smart wearable device is to determine whether the current detection scene is specifically the first detection scene or the second detection scene.
  • step 402 If yes, go to step 402 . If not, go to step 403 .
  • step 404 If not, go to step 404 .
  • step 406 If not, go to step 406 .
  • step 408 is performed.
  • respiration indicators may include one or more, for example, the rate of respiration.
  • the snoring indicator may include one or more, for example, the loudness of the snoring.
  • step 410 If yes, go to step 410.
  • step 408 If not, go to step 408 .
  • step 411 is executed after the sleep breathing assessment function is automatically enabled.
  • FIG. 5 is an evaluation device 500 for evaluating sleep breathing function provided by the present application.
  • the evaluation device 500 may include an automatic detection module 510 , a data collection and preprocessing module 520 , a feature extraction and statistics module 530 , and a sleep breathing evaluation function module 540 .
  • the automatic detection module 510 is mainly used to automatically activate or deactivate the microphone, the ultrasonic receiving device and/or the ultrasonic transmitting device under different detection scenarios, and activate or deactivate the evaluation of sleep breathing function.
  • the data collection and preprocessing module 520 is mainly used for the collection of audio data and/or ultrasound data, the collection of available signals, and preprocessing such as judging the audio segment and the silent segment.
  • the audio data includes common recording data.
  • the feature extraction and statistics module 530 is used to perform feature extraction and statistics on the user's actions, breathing and snoring features.
  • the sleep breathing function evaluation module 540 is used to evaluate the sleep breathing function of the user according to the data completely extracted and counted by the feature extraction and statistics module 530 .
  • FIG. 6 is a schematic block diagram of the evaluation device provided by the present application.
  • the evaluation device 1000 includes a processing unit 1100 , a receiving unit 1200 and a sending unit 1300 .
  • the processing unit 1100 is configured to determine a current detection scene, where the current detection scene belongs to one of preset detection scenarios, wherein the preset detection scenarios include a first detection scene and a second detection scene, Wherein, the first detection scene is that the user is wearing a smart wearable device, and the second detection scene is that the user is not wearing a smart wearable device;
  • the selected detection method uses the selected detection method to determine the state of the user, wherein the state of the user includes that the user is in a sleeping state, or that the user is in a non-sleeping state;
  • the evaluation of the sleep breathing function of the user is turned on or off
  • the evaluation of sleep breathing function includes evaluating one or more of the following: sleep cycle stage, hypopnea, sleep apnea, and risk of snoring grade.
  • the sending unit 1300 is configured to output the evaluation result.
  • processing unit 1100 is further configured to:
  • the second detection method select the second detection method, wherein the second detection method is determined by the state of the smart wearable device and the historical sleep information of the user. the status of the user;
  • the status of the smart wearable device includes one or more of the following: the duration of the smart wearable device being in a static state within a specified period of time is greater than or equal to the first duration threshold, the duration of the smart wearable device being in a large motion state The duration is greater than or equal to the second duration threshold;
  • the user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time.
  • the receiving unit 1200 is configured to acquire available signals in the first detection scene or the second detection scene;
  • the processing unit 1100 is configured to evaluate the sleep breathing function of the user according to the available signals, wherein the available signals include one or more of the following:
  • the respiratory indicators include respiratory rate and/or respiratory wave decline;
  • one or more snore indicators including snore loudness
  • the user's action index includes the user's action range and/or frequency of major actions.
  • the processing unit 1100 is further configured to use a trained light-weight gradient boosting machine GBM model to predict the available signal, so as to evaluate the sleep breathing function of the user.
  • the receiving unit 1200 is configured to acquire audio data and ultrasound data of the user
  • the processing unit 1100 is further configured to preprocess the audio data and ultrasound data, and perform feature extraction on the preprocessed audio data and ultrasound data to obtain extracted data, wherein the feature extraction
  • the processing includes performing extraction of original features and aggregation of statistical features on the preprocessed audio data and ultrasound data;
  • processing unit 100 is specifically configured to:
  • the snoring loudness is greater than or equal to the first loudness threshold, and the duration is greater than or equal to the first duration threshold, it is determined that the user's snoring level risk is high risk;
  • the loudness of the snoring sound is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
  • the loudness of the snoring sound is greater than or equal to the second loudness threshold and the duration is greater than or equal to the second duration threshold, it is determined that the user's snoring level risk is low risk, wherein the second loudness threshold is smaller than the first loudness threshold a threshold, the second duration threshold is less than the first duration threshold;
  • the sleep staging stage is REM sleep
  • the sleep staging stage is light sleep
  • the sleep staging stage is deep sleep.
  • the trained lightweight GBM prediction model is used to predict the available signals to evaluate the sleep breathing function of the user, including:
  • hypopnea If the decrease ratio of the amplitude of the respiratory wave is greater than the first percentage, it is judged as hypopnea
  • the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage, it is determined to be sleep apnea.
  • the receiving unit 1200 and the sending unit 1300 may also be integrated into a transceiver unit, which has the functions of receiving and sending at the same time, which is not limited here.
  • the processing unit 1100 is configured to perform processing and/or operations implemented internally by the communication device 1000 except for the actions of sending and receiving.
  • the receiving unit 1200 is configured to perform an action of receiving
  • the sending unit 1300 is configured to perform an action of sending.
  • the functions of the automatic detection module 510, data collection and preprocessing module 520, feature extraction and statistics module 530 and sleep breathing function evaluation module 540 shown in Figure 5 can be integrated in the In the processing unit 1100.
  • the evaluation device 500 may further include a display unit 1400, configured to display (that is, present to the user) the evaluation result.
  • FIG. 7 is a schematic structural diagram of the evaluation device provided by the present application.
  • the communication device 10 includes: one or more processors 11 , one or more memories 12 and one or more communication interfaces 13 .
  • the processor 11 is used to control the communication interface 13 to send and receive signals
  • the memory 12 is used to store a computer program
  • the processor 11 is used to call and run the computer program from the memory 12, so that the communication device 10 executes the method described in each method embodiment of the present application. Processes and/or operations performed by the evaluation device.
  • the processor 11 may have the functions of the processing unit 1100 shown in FIG. 6
  • the communication interface 13 may have the functions of the receiving unit 1200 and/or the sending unit 1300 shown in FIG. 6 .
  • the processor 11 can be used to execute the processing and/or operations performed internally by the evaluation device in each method embodiment
  • the communication interface 13 is used to execute the sending and/or receiving operations performed by the evaluation device in each method embodiment. action.
  • the processor 11 is configured to execute steps 110-140.
  • the processor 11 is used to perform steps 210 - 240 , step 260 ; the receiving unit 1200 is used to perform step 250 ; and the sending unit 1300 is used to perform step 270 .
  • the processor 11 is configured to execute steps 401-411.
  • the communication device 10 can also include one or more memories 14, which can be used to store available signals obtained from detection scenarios, store data of the lightweight GBM model, and store intermediate processing results ,Wait.
  • the communication device 10 may be a smart wearable device.
  • the communication device 10 may be a chip or a chip system installed in a smart wearable device.
  • the communication interface 13 may be an interface circuit or an input/output interface.
  • the dotted box behind the device indicates that there may be more than one device.
  • Fig. 8 is a schematic block diagram of a smart wearable device provided by the present application.
  • the smart wearable device 30 may include a processor 310 , a memory 320 , a wireless communication module 330 , a display screen 340 , a camera 350 , an audio module 360 and a sensor module 370 , and so on.
  • the audio module 360 may include a speaker 360A, a receiver 360B, a microphone 360C and the like.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart wearable device 30 .
  • the smart wearable device 30 may include more or fewer components than shown in the illustration, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 310 may correspond to the processing unit 1100 in FIG. 6 , and is configured to execute the steps performed by the processing unit 1100 .
  • the processor 310 has the functions of the processor 11 in FIG. 7 .
  • the processor 310 may include one or more processing units, for example: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), Image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • Image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the memory 320 may be used to store computer executable program codes, and the executable program codes include instructions.
  • the processor 310 executes various functional applications and data processing of the smart wearable device 30 by executing instructions stored in the memory 320 .
  • the internal memory 320 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (for example, such as a sound playing function, an image playing function, etc.) and the like.
  • the data storage area can store data created during the use of the smart wearable device 30 (for example, audio data, phonebook, etc.) and the like.
  • the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. Exemplarily, the memory 320 has the function of the memory 12 in FIG. 7 .
  • the wireless communication module 330 can provide wireless local area networks (wireless local area networks, WLAN) such as wireless fidelity (Wireless fidelity, Wi-Fi) networks, bluetooth (bluetooth, BT), global navigation satellites, etc. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 360 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 330 may perform information exchange with other devices, modules or devices through the communication interface 13 as shown in FIG. 7 .
  • the display screen 340 is used for displaying images, videos, text information and the like.
  • the display screen 340 includes a display panel.
  • the display panel can adopt liquid crystal display (liquid crystal display, LCD), organic light-emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the smart wearable device 30 may include one or more display screens 340 .
  • the display screen 340 is used to display the evaluation result of the sleep apnea function, and may also display prompt information such as the evaluation of the sleep apnea function being in progress or in a closed state.
  • the object for capturing still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the smart wearable device 30 may include one or more cameras 350 .
  • the smart wearable device 30 can implement audio functions through the audio module 370 , the speaker 370A, the receiver 370B, the microphone 370C, and the application processor. For example, recording etc.
  • the audio module 370 can be set in the processor 310 , or some functional modules of the audio module 370 can be set in the processor 310 .
  • the microphone 370C on the smart wearable device 30 is used to collect sound signals, reduce noise, and can also implement a directional recording function, etc., so as to realize the collection of sound signals in the detection scene.
  • the sensor module 380 may include various sensors such as a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, an ambient light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, and a bone conduction sensor. ,Wait. Some or all of these sensors can be used in the solution of the present application to assist the evaluation device in judging the detection scene and signal acquisition during sleep breathing function evaluation.
  • the smart wearable device 30 may also include other sensors, which are not limited.
  • the memory and the processor in the foregoing apparatus embodiments may be physically independent units, or the memory and the processor may also be integrated together, which is not limited herein.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions are run on the computer, the operations performed by the evaluation device in each method embodiment of the present application are and/or processing is performed.
  • the present application also provides a computer program product.
  • the computer program product includes computer program codes or instructions. When the computer program codes or instructions are run on the computer, the operations performed by the evaluation device in each method embodiment of the present application and/or or processing is performed.
  • the present application also provides a chip, the chip includes a processor, a memory for storing computer programs is provided independently of the chip, and the processor is used for executing the computer programs stored in the memory, so that the device installed with the chip executes Operations and/or processing performed by the evaluation device in any one method embodiment.
  • the chip may further include a communication interface.
  • the communication interface may be an input/output interface, or an interface circuit or the like.
  • the chip may further include the memory.
  • processors there may be one or more processors, one or more memories, and one or more memories.
  • the processor may also be a processing circuit or the like.
  • the present application also provides a communication device (for example, it may be a chip or a chip system), including a processor and a communication interface, the communication interface is used to receive (or be referred to as input) data and/or information, and will receive The received data and/or information are transmitted to the processor, and the processor processes the data and/or information, and the communication interface is also used to output (or be referred to as output) the data and/or processed by the processor or information, so that the operations and/or processing performed by the evaluation device in any one method embodiment are performed.
  • a communication device for example, it may be a chip or a chip system
  • the communication interface is used to receive (or be referred to as input) data and/or information, and will receive The received data and/or information are transmitted to the processor, and the processor processes the data and/or information, and the communication interface is also used to output (or be referred to as output) the data and/or processed by the processor or information, so that the operations and/or processing performed by the evaluation device in any one method embodiment
  • the present application also provides a communication device, including at least one processor, the at least one processor is coupled to at least one memory, and the at least one processor is configured to execute computer programs or instructions stored in the at least one memory, The communication device is made to perform the operation and/or processing performed by the evaluation device in any one method embodiment.
  • the present application also provides a communication device, including a processor and a memory.
  • a transceiver may also be included.
  • the memory is used to store computer programs
  • the processor is used to call and run the computer programs stored in the memory, and control the transceiver to send and receive signals, so that the communication device performs the operation and/or processing performed by the evaluation device in any method embodiment .
  • the memory in the embodiments of the present application may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories.
  • the non-volatile memory can be read-only memory (read-only memory, ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically programmable Erases programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory can be random access memory (RAM), which acts as external cache memory.
  • RAM random access memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • SDRAM double data rate synchronous dynamic random access memory
  • ESDRAM enhanced synchronous dynamic random access memory
  • SLDRAM direct memory bus random access memory
  • direct rambus RAM direct rambus RAM
  • the disclosed systems, devices and methods may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disc and other media that can store program codes. .

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Anesthesiology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

An apparatus (1000) for evaluating a respiratory function during sleep. The apparatus comprises a processing unit (1100), a receiving unit (1200) and a sending unit (1300). The processing unit (1100) is used for automatically enabling or disabling, in different detection scenarios and by using different detection modes, the evaluation of respiratory functions of a user during sleep, which functions comprise a sleep cycle staging, hypopnea, sleep apnea, a snoring level risk, etc. In this way, a user does not need to manually click the start or end of sleeping, and the evaluation of respiratory functions during sleep is automatically enabled or disabled, such that the user experience is friendly. Moreover, the accuracy of evaluation is also improved.

Description

评估睡眠呼吸功能的方法和装置Method and device for assessing sleep breathing function
本申请要求于2021年05月24日提交国家知识产权局、申请号为202110567956.X、申请名称为“评估睡眠呼吸功能的方法和装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on May 24, 2021, with application number 202110567956.X, and application title "Method and device for evaluating sleep respiratory function", the entire contents of which are incorporated by reference in this application.
技术领域technical field
本申请涉及计算机技术领域,更具体地,涉及一种评估睡眠呼吸功能的方法和装置。The present application relates to the field of computer technology, and more specifically, to a method and device for evaluating sleep breathing function.
背景技术Background technique
随着人们生活压力的不断增大,睡眠质量也逐渐降低,人们开始关注睡眠的质量以及睡眠过程中的睡眠呼吸疾病的检测。睡眠呼吸紊乱是影响睡眠质量的主要因素。单纯鼾症、低通气、睡眠呼吸暂停是睡眠呼吸紊乱最常见的原因。睡眠过程中的呼吸疾病可能致命,因此对睡眠过程中的睡眠分期异常、单纯鼾症、低通气以及睡眠呼吸暂停等进行有效实时检测和早期预警,对于个人健康以及家庭护理尤为重要。With the continuous increase of people's life pressure, the quality of sleep is gradually reduced, and people begin to pay attention to the quality of sleep and the detection of sleep-breathing disease during sleep. Sleep-disordered breathing is a major factor affecting sleep quality. Simple snoring, hypoventilation, and sleep apnea are the most common causes of sleep-disordered breathing. Respiratory diseases during sleep can be fatal. Therefore, effective real-time detection and early warning of abnormal sleep stages, simple snoring, hypoventilation, and sleep apnea during sleep are particularly important for personal health and family care.
目前,通过超声获取呼吸信号进行睡眠分期、出入睡眠检测,以及基于录音数据进行鼾声、呼吸声以及非目标片段的划分等技术逐渐成熟。例如,市面上的多导睡眠监测仪,通过记录睡眠过程中的脑波、肌电图、心电图、口鼻腔气流、胸部腹部呼吸运动以及声音等多种信号,总和分析被检测者的睡眠状况和鼾症、低通气、睡眠呼吸暂停等疾病的严重程度。多导睡眠检测仪要求在专业场所由专业人员进行操作,舒适性差且费用昂贵,难以满足家庭日常生活中便捷和高效的要求。此外,市面上还有一些用于睡眠呼吸功能评估的应用(application,也简称为app),而这些app大多是在用户(或被测者)睡觉的环境下设定一个阈值或者使用神经网络方法对睡眠过程中的声音、呼吸声进行识别,进而评估用户整晚的睡眠呼吸的质量。这种评估方法需要用户手动点击睡眠的开始与结束,用户体验极不友好。At present, technologies such as obtaining respiratory signals through ultrasound for sleep staging, detection of sleep in and out, and division of snoring sounds, breathing sounds, and non-target segments based on recorded data are gradually mature. For example, polysomnography on the market, by recording brain waves, electromyography, electrocardiogram, oronasal airflow, chest and abdomen breathing movements, and sounds during sleep, sums up and analyzes the sleep status and Severity of snoring, hypoventilation, sleep apnea, etc. Polysomnography requires professionals to operate it in a professional place, which is poor in comfort and expensive, and it is difficult to meet the convenience and efficiency requirements of family daily life. In addition, there are some applications (applications, also referred to as apps) for the evaluation of sleep breathing function on the market, and most of these apps set a threshold in the environment where the user (or the subject) sleeps or use a neural network method Identify the sound and breathing sound during sleep, and then evaluate the quality of the user's sleep breathing throughout the night. This evaluation method requires the user to manually click the start and end of sleep, which is extremely unfriendly to the user experience.
发明内容Contents of the invention
本申请提供一种评估睡眠呼吸功能的方法和装置,可以便捷地对用户的睡眠呼吸功能进行评估,提升用户体验。The present application provides a method and device for evaluating sleep breathing function, which can conveniently evaluate a user's sleep breathing function and improve user experience.
第一方面,提供了一种评估睡眠呼吸功能的方法,该方法包括:确定当前的检测场景,所述当前的检测场景属于预设定的检测场景中的一个,其中,所述预设定的检测场景包括第一检测场景和第二检测场景,其中,所述第一检测场景为所述用户穿戴智能穿戴设备,所述第二检测场景为所述用户未穿戴智能穿戴设备;In a first aspect, a method for evaluating sleep breathing function is provided, the method includes: determining a current detection scene, and the current detection scene belongs to one of preset detection scenarios, wherein the preset The detection scene includes a first detection scene and a second detection scene, wherein the first detection scene is that the user is wearing a smart wearable device, and the second detection scene is that the user is not wearing a smart wearable device;
根据所述当前的检测场景,选择检测方式,Select a detection method according to the current detection scene,
采用所选择的检测方式,判断所述用户的状态,其中,所述用户的状态包括所述用户处于睡眠状态,或所述用户处于非睡眠状态;Using the selected detection method to determine the state of the user, wherein the state of the user includes that the user is in a sleeping state, or that the user is in a non-sleeping state;
根据所述用户的状态,开启或者关闭对用户的睡眠呼吸功能的评估,According to the state of the user, the evaluation of the sleep breathing function of the user is turned on or off,
其中,所述睡眠呼吸功能的评估包括对如下的一项或多项进行评估:睡眠周期分期、低通气、睡眠呼吸暂停以及鼾症等级风险。Wherein, the evaluation of sleep breathing function includes evaluating one or more of the following: sleep cycle stage, hypopnea, sleep apnea, and risk of snoring grade.
在本申请的技术方案中,首先确定当前的检测场景,并基于当前的检测场景选择相应的检测方式。不同的检测方式采用不同的手段判断用户是否处于睡眠状态。如果判定用户处于睡眠状态,自动开启睡眠呼吸功能的评估。如果判定用户处于非睡眠状态,则不开启睡眠呼吸功能的评估。In the technical solution of the present application, firstly, the current detection scene is determined, and a corresponding detection method is selected based on the current detection scene. Different detection methods use different means to determine whether the user is in a sleep state. If it is determined that the user is in a sleep state, the evaluation of the sleep apnea function is automatically started. If it is determined that the user is in a non-sleeping state, the evaluation of the sleep apnea function is not started.
可见,和现有的一些方案中,用户需要手动点击睡眠监测装置上的睡眠开始或者睡眠结束,才能开启或关闭睡眠监测装置的睡眠呼吸功能相比,本申请的技术方案,在不同的检测场景下,通过不同的检测方式获得用户的状态,从而可以自动开启或关闭睡眠呼吸功能的评估,用户体验更为友好。It can be seen that compared with some existing solutions, the user needs to manually click the sleep start or sleep end on the sleep monitoring device to turn on or off the sleep breathing function of the sleep monitoring device, the technical solution of the present application, in different detection scenarios In this case, the user's status is obtained through different detection methods, so that the evaluation of the sleep breathing function can be automatically turned on or off, and the user experience is more friendly.
结合第一方面,在第一方面的某些实现方式中,所述根据所述当前的检测场景,选择检测方式,包括:With reference to the first aspect, in some implementation manners of the first aspect, the selecting a detection method according to the current detection scenario includes:
若所述当前的检测场景为所述第一检测场景,选择第一检测方式,其中,所述第一检测方式是通过所述智能穿戴设备判断所述用户的状态的;或者,If the current detection scene is the first detection scene, select a first detection method, wherein the first detection method is to judge the state of the user through the smart wearable device; or,
若所述当前的检测场景为所述第二检测场景,选择第二检测方式,其中,所述第二检测方式是通过所述智能穿戴设备的状态和所述用户的历史睡眠信息,判断所述用户的状态的;If the current detection scene is the second detection scene, select the second detection method, wherein the second detection method is to judge the the status of the user;
其中,所述智能穿戴设备的状态包括如下一项或多项:所述智能穿戴设备在指定时间段内处于静止状态的时长大于或等于第一时长阈值、所述智能穿戴设备处于大动作状态的时长大于或等于第二时长阈值;Wherein, the status of the smart wearable device includes one or more of the following: the duration of the smart wearable device being in a static state within a specified period of time is greater than or equal to the first duration threshold, the duration of the smart wearable device being in a large motion state The duration is greater than or equal to the second duration threshold;
所述用户的历史睡眠信息包括如下一项或多项:所述用户的历史睡眠时间段、所述用户预设定的睡眠时间以及所述用户预设定的闹钟时间。The user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time.
在该实现方式中,在用户穿戴智能穿戴设备的检测场景下,通过智能穿戴设备实时判断用户的状态,具体地,判断用户的入睡以及出睡情况。而在用户未穿戴智能穿戴设备的情况下,需要结合智能穿戴设备的状态以及用户的历史睡眠信息,判断用户的状态。由此,不管用户是否穿戴智能穿戴设备,均可以通过合适的检测方式判断用户的状态,进而实现评估的自动开启或关闭,提高了用户体验。In this implementation, in the detection scenario where the user wears the smart wearable device, the smart wearable device is used to judge the user's state in real time, specifically, to judge the user's falling asleep and getting out of sleep. However, when the user is not wearing the smart wearable device, it is necessary to combine the state of the smart wearable device and the user's historical sleep information to determine the user's state. Thus, regardless of whether the user wears the smart wearable device, the user's state can be judged through an appropriate detection method, and then the evaluation can be automatically turned on or off, which improves the user experience.
结合第一方面,在第一方面的某些实现方式中,在开启对用户的睡眠呼吸功能的评估之后,所述方法还包括:With reference to the first aspect, in some implementations of the first aspect, after starting the evaluation of the user's sleep breathing function, the method further includes:
获取所述第一检测场景或所述第二检测场景中的可用信号;acquiring available signals in the first detection scene or the second detection scene;
根据所述可用信号对所述用户的睡眠呼吸功能进行评估,其中,所述可用信号包括如下一项或多项:Evaluate the sleep breathing function of the user according to the available signals, wherein the available signals include one or more of the following:
一个或多个呼吸指标,所述呼吸指标包括呼吸频率和/或呼吸波的下降幅度;one or more respiratory indicators, the respiratory indicators include respiratory rate and/or respiratory wave decline;
一个或多个鼾声指标,所述鼾声指标包括鼾声响度;以及one or more snore indicators including snore loudness; and
所述用户的动作指标,所述动作指标包括所述用户的动作幅度和/或大动作的频率。The user's action index, where the action index includes the user's action range and/or frequency of major actions.
结合第一方面,在第一方面的某些实现方式中,所述根据所述可用信号对所述用户的睡眠呼吸功能进行评估,包括:With reference to the first aspect, in some implementation manners of the first aspect, the evaluating the sleep breathing function of the user according to the available signal includes:
采用训练好的轻型梯度提升机GBM模型对所述可用信号进行预测,以对所述用户的 睡眠呼吸功能进行评估。The available signal is predicted by using the trained light gradient lifting machine GBM model to evaluate the sleep breathing function of the user.
在该实现方式中,采用训练好的轻型GBM模型对当前的检测场景中获取的可用进行预测,由于该轻型GBM模型是预先通过大量的数据训练得到,且用于训练的数据只保留与呼吸、鼾声等信号有关的频段,灵敏度较高,为后续的睡眠呼吸功能的评估提供了良好的基础,评估准确度获得提升。In this implementation, the trained light-weight GBM model is used to predict what is available in the current detection scene. Since the light-weight GBM model is obtained through a large amount of data training in advance, and the data used for training is only reserved for breathing, The frequency bands related to snoring and other signals have high sensitivity, which provides a good basis for the subsequent evaluation of sleep breathing function, and the evaluation accuracy is improved.
结合第一方面,在第一方面的某些实现方式中,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测之前,所述方法还包括:With reference to the first aspect, in some implementation manners of the first aspect, before using the trained lightweight GBM prediction model to predict the available signal, the method further includes:
获取所述用户的音频数据和超声数据;Obtain audio data and ultrasound data of the user;
对所述音频数据和超声数据进行预处理,并对经过预处理的音频数据和超声数据进行特征提取的处理,获得提取数据,其中,所述特征提取的处理包括对所述经过预处理的音频数据和超声数据进行原始特征的提取以及统计特征的聚合;Preprocessing the audio data and ultrasound data, and performing feature extraction on the preprocessed audio data and ultrasound data to obtain extracted data, wherein the feature extraction process includes processing the preprocessed audio Data and ultrasound data for the extraction of raw features and the aggregation of statistical features;
使用所述提取数据,对所述轻型GBM预测模型进行训练,获得所述训练好的轻型GBM预测模型。Using the extracted data, train the lightweight GBM prediction model to obtain the trained lightweight GBM prediction model.
在该实现方式中,对检测场景中获得的可用信号,例如,音频数据和超声数据,进行预处理以及特征提取等处理,由此获得的提取数据用于轻型GBM模型的训练,可以提升轻型GBM模型的预测性能,相比于现有的睡眠呼吸功能的评估方案,本申请的技术方案的评估结果更准确,灵敏度更高。In this implementation, the available signals obtained in the detection scene, such as audio data and ultrasonic data, are preprocessed and feature extracted, and the extracted data thus obtained is used for the training of the lightweight GBM model, which can improve the performance of the lightweight GBM model. For the predictive performance of the model, compared with the existing evaluation scheme of sleep breathing function, the evaluation result of the technical scheme of the present application is more accurate and the sensitivity is higher.
结合第一方面,在第一方面的某些实现方式中,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:With reference to the first aspect, in some implementation manners of the first aspect, the use of the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user includes:
若所述鼾声响度大于或等于第一响度门限,且时长大于或等于第一时长门限,判定所述用户的鼾症等级风险为高风险;If the snoring loudness is greater than or equal to the first loudness threshold, and the duration is greater than or equal to the first duration threshold, it is determined that the user's snoring level risk is high risk;
若所述鼾声响度大于或等于第一响度门限,且时长小于第一时长门限,判定所述用户的鼾症等级风险为中风险;If the loudness of the snoring sound is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
若所述鼾声响度大于或等于第二响度门限,且时长大于或等于第二时长门限,判定所述用户的鼾症等级风险为低风险,其中,所述第二响度门限小于所述第一响度门限,所述第二时长门限小于所述第一时长门限;If the loudness of the snoring sound is greater than or equal to the second loudness threshold and the duration is greater than or equal to the second duration threshold, it is determined that the user's snoring level risk is low risk, wherein the second loudness threshold is smaller than the first loudness threshold a threshold, the second duration threshold is less than the first duration threshold;
否则,判定所述用户的鼾症等级风险为正常。Otherwise, it is determined that the user's snoring level risk is normal.
结合第一方面,在第一方面的某些实现方式中,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:With reference to the first aspect, in some implementation manners of the first aspect, the use of the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user includes:
若所述呼吸频率大于第一频率且斜率大于第一数值,判定睡眠分期阶段为快动眼睡眠REM;If the respiratory rate is greater than the first frequency and the slope is greater than the first value, it is determined that the sleep staging stage is REM sleep;
若所述呼吸频率小于或等于第一频率,且大于或等于第二频率,判定所述睡眠分期阶段为浅睡;If the breathing frequency is less than or equal to the first frequency and greater than or equal to the second frequency, it is determined that the sleep staging stage is light sleep;
若所述呼吸频率小于或等于第二频率,判定所述睡眠分期阶段为深睡。If the breathing frequency is less than or equal to the second frequency, it is determined that the sleep staging stage is deep sleep.
结合第一方面,在第一方面的某些实现方式中,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:With reference to the first aspect, in some implementation manners of the first aspect, the use of the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user includes:
若所述呼吸波的幅度的下降比例大于第一百分比例,判定为低通气;If the decrease ratio of the amplitude of the respiratory wave is greater than the first percentage, it is judged as hypopnea;
若所述呼吸波的峰度的下降比例大于第二百分比例,判定为睡眠呼吸暂停。If the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage, it is determined to be sleep apnea.
在以上各实现方式中,通过设定合适的判断规则以及门限、时长或百分比例,可以提 高睡眠呼吸功能评估的准确性。In each of the above implementation manners, by setting appropriate judgment rules and thresholds, durations or percentages, the accuracy of sleep apnea function evaluation can be improved.
第二方面,提供了一种通信装置,所述通信装置具有实现第一方面或其任意可能的实现方式中的方法的功能,所述功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。所述硬件或软件包括一个或多个与上述功能相对应的单元。The second aspect provides a communication device, the communication device has the function of realizing the method in the first aspect or any possible implementation thereof, the function can be realized by hardware, or by executing corresponding software by hardware . The hardware or software includes one or more units corresponding to the above functions.
第三方面,提供一种通信装置,包括处理器和通信接口,所述通信接口用于接收数据和/或信息,并将接收到的数据和/或信息传输至所述处理器,所述处理器处理所述数据和/或信息,以使得所述通信装置执行如第一方面或其任意可能的实现方式中的方法。In a third aspect, a communication device is provided, including a processor and a communication interface, the communication interface is used to receive data and/or information, and transmit the received data and/or information to the processor, the processing The processor processes the data and/or information, so that the communication device executes the method in the first aspect or any possible implementation thereof.
可替换地,所述处理器可以为处理电路。Alternatively, the processor may be a processing circuit.
可选地,上述通信接口可以为接口电路。Optionally, the aforementioned communication interface may be an interface circuit.
可选地,所述通信接口可以包括输入接口和输出接口。其中,输入接口用于接收待处理的数据和/或信息,所述输出接口用于输出处理后的数据和/或信息。Optionally, the communication interface may include an input interface and an output interface. Wherein, the input interface is used to receive data and/or information to be processed, and the output interface is used to output processed data and/or information.
第四方面,本申请提供一种通信装置,包括至少一个处理器,所述至少一个处理器与至少一个存储器耦合,所述至少一个存储器用于存储计算机程序或指令,所述至少一个处理器用于从所述至少一个存储器中调用并运行该计算机程序或指令,使得所述通信装置执行第一方面或其任意可能的实现方式中的方法。In a fourth aspect, the present application provides a communication device, including at least one processor, the at least one processor is coupled to at least one memory, the at least one memory is used to store computer programs or instructions, and the at least one processor is used to The computer program or instruction is called and executed from the at least one memory, so that the communication device executes the method in the first aspect or any possible implementation manner thereof.
可选地,所述至少一个处理器与所述至少一个存储器集成在一起。Optionally, the at least one processor is integrated with the at least one memory.
可选地,以上第二方面至第四方面的通信装置可以为芯片或芯片系统,例如,片上系统(system on a chip,SOC)芯片。Optionally, the communication devices in the above second to fourth aspects may be a chip or a chip system, for example, a system on a chip (system on a chip, SOC) chip.
第五方面,本申请提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机指令,当计算机指令在计算机上运行时,使得如第一方面或其任意可能的实现方式中的方法被执行。In a fifth aspect, the present application provides a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium, and when the computer instructions are run on a computer, as in the first aspect or any possible implementation thereof, method is executed.
第六方面,本申请提供一种计算机程序产品,所述计算机程序产品包括计算机程序代码,当所述计算机程序代码在计算机上运行时,使得如第一方面或其任意可能的实现方式中的方法被执行。In a sixth aspect, the present application provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on a computer, the method in the first aspect or any possible implementation thereof be executed.
第七方面,本申请提供一种智能穿戴设备,包括如第二方面所述的通信装置。In a seventh aspect, the present application provides a smart wearable device, including the communication device as described in the second aspect.
附图说明Description of drawings
图1为本申请提供的评估睡眠呼吸功能的方法的一个示意性流程图。Fig. 1 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application.
图2为本申请提供的评估睡眠呼吸功能的方法的一个示意性流程图。Fig. 2 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application.
图3为评估装置执行预处理以及特征提取的示意性框图。FIG. 3 is a schematic block diagram of preprocessing and feature extraction performed by the evaluation device.
图4为本申请提供的评估睡眠呼吸功能的方法的示例性流程图。Fig. 4 is an exemplary flow chart of the method for evaluating sleep breathing function provided by the present application.
图5为本申请提供的评估睡眠呼吸功能的评估装置500。FIG. 5 is an evaluation device 500 for evaluating sleep breathing function provided by the present application.
图6为本申请提供的评估装置的示意性框图。Fig. 6 is a schematic block diagram of the evaluation device provided by the present application.
图7为本申请提供的评估装置的示意性结构图。Fig. 7 is a schematic structural diagram of the evaluation device provided by the present application.
图8是本申请提供的智能穿戴设备的示意性框图。Fig. 8 is a schematic block diagram of a smart wearable device provided by the present application.
具体实施方式Detailed ways
下面将结合附图,对本申请实施例中的技术方案进行描述。The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.
本申请的技术方案可以应用在智能穿戴设备中,能够实现自动对用户的睡眠呼吸功能 (例如,睡眠分期、睡眠呼吸暂停、鼾症检测、鼾症产生部分检测、低通气等睡眠呼吸相关疾病)进行评估,不需要用户手动开启或者关闭睡眠呼吸功能的评估,提升了用户体验。此外,评估的准确性也有所提升。The technical solution of this application can be applied to smart wearable devices, which can automatically detect the user's sleep breathing function (for example, sleep staging, sleep apnea, snoring detection, snoring partial detection, hypoventilation and other sleep breathing related diseases) The evaluation does not require the user to manually enable or disable the evaluation of the sleep breathing function, which improves the user experience. In addition, the accuracy of the assessment has also improved.
示例性地,本申请提及的智能穿戴设备包括但不限于:智能手环、智能手表、智能手机以及iPad等智能电子产品。Exemplarily, the smart wearable devices mentioned in this application include, but are not limited to: smart electronic products such as smart bracelets, smart watches, smart phones, and iPads.
参见图1,图1为本申请提供的评估睡眠呼吸功能的方法的一个示意性流程图。如图1,方法100可以由评估装置执行。示例性地,所述评估装置可以为智能穿戴设备,或者内置于智能穿戴设备中的芯片(或芯片系统)。方法100主要包括步骤110-140。Referring to FIG. 1 , FIG. 1 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application. As shown in FIG. 1 , the method 100 may be performed by an evaluation device. Exemplarily, the evaluation device may be a smart wearable device, or a chip (or chip system) built in the smart wearable device. The method 100 mainly includes steps 110-140.
110、评估装置确定当前的检测场景,其中,当前的检测场景属于预设定的检测场景中的一个。110. The evaluation device determines a current detection scene, where the current detection scene belongs to one of preset detection scenes.
示例性地,预设定的检测场景可以包括第一检测场景和第二检测场景。Exemplarily, the preset detection scenarios may include a first detection scenario and a second detection scenario.
其中,第一检测场景为用户穿戴智能穿戴设备,第二检测场景为用户未穿戴智能穿戴设备。Wherein, the first detection scene is that the user wears the smart wearable device, and the second detection scene is that the user does not wear the smart wearable device.
120、评估装置根据当前的检测场景,选择检测方式。120. The evaluation device selects a detection mode according to the current detection scenario.
在本申请中,评估装置在不同的检测场景下,可以选择与检测场景相适应的检测方式,以进一步判断用户是否处于睡眠状态。In the present application, the evaluation device may select a detection method suitable for the detection scenario in different detection scenarios, so as to further determine whether the user is in a sleep state.
具体地,若当前的检测场景为第一检测场景,则评估装置选择第一检测方式。其中,第一检测方式是评估装置通过智能穿戴设备判断用户的状态的。Specifically, if the current detection scene is the first detection scene, the evaluation device selects the first detection mode. Wherein, the first detection method is that the evaluation device judges the state of the user through the smart wearable device.
若当前的检测场景为第二检测场景,则评估装置选择第二检测方式,其中,若采用第二检测方式,评估装置需要进一步获取智能穿戴设备的状态以及用户的历史睡眠信息,并根据智能穿戴设备的状态和用户的历史睡眠信息,判断用户的状态。If the current detection scene is the second detection scene, the evaluation device selects the second detection method, wherein, if the second detection method is adopted, the evaluation device needs to further obtain the status of the smart wearable device and the user's historical sleep information, and according to the smart wearable The status of the device and the historical sleep information of the user are used to determine the status of the user.
可选地,智能穿戴设备的状态包括如下一项或多项:Optionally, the state of the smart wearable device includes one or more of the following:
智能穿戴设备在指定时间段内处于静止状态的时长大于或等于第一时长阈值、智能穿戴设备处于大动作状态的时长大于或等于第二时长阈值。The duration of the smart wearable device being in a static state within a specified time period is greater than or equal to the first duration threshold, and the duration of the smart wearable device being in a large motion state is greater than or equal to the second duration threshold.
示例性地,智能穿戴设备是否处于大动作状态,可以通过智能穿戴设备的动作幅度来判断。例如,设定一个动作幅度的阈值,如果智能穿戴设备的动作幅度大于该阈值,则表明智能穿戴设备处于大动作状态,否则就不是处于大动作状态。Exemplarily, whether the smart wearable device is in a large motion state can be judged by the motion range of the smart wearable device. For example, set a threshold of motion range, if the motion range of the smart wearable device is greater than the threshold, it indicates that the smart wearable device is in a state of large motion, otherwise it is not in a state of large motion.
可选地,用户的历史睡眠信息包括如下一项或多项:用户的历史睡眠时间段、用户预设定的睡眠时间以及用户预设定的闹钟时间,等。Optionally, the user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time, and so on.
示例性地,用户预设定的睡眠时间可以是预设定的入睡时间,或者预设定的起床时间(也即出睡时间),等。Exemplarily, the sleep time preset by the user may be a preset time for falling asleep, or a preset time for getting up (that is, time for getting out of sleep), and the like.
130、评估装置采用所选择的检测方式,判断用户的状态。130. The evaluation device judges the state of the user by using the selected detection mode.
其中,用户的状态包括用户处于睡眠状态,或者用户处于非睡眠状态。Wherein, the state of the user includes that the user is in a sleeping state, or the user is in a non-sleeping state.
140、评估装置根据用户的状态,开启或者关闭对用户的睡眠呼吸功能的评估。140. The evaluation device enables or disables the evaluation of the sleep breathing function of the user according to the state of the user.
具体地,在用户处于睡眠状态的情况下,开启对用户的睡眠呼吸功能的评估。在用户处于非睡眠状态的情况下,不开启或者关闭对用户的睡眠呼吸功能的评估。Specifically, when the user is in a sleeping state, the evaluation of the user's sleep breathing function is started. When the user is in a non-sleeping state, the evaluation of the user's sleep breathing function is not enabled or disabled.
应理解,关闭睡眠呼吸功能的评估,是指在开启了睡眠呼吸功能的评估之后,通过实时判断用户的状态,当用户出睡之后,则关闭睡眠呼吸功能的评估。It should be understood that turning off the sleep apnea function evaluation refers to turning off the sleep apnea function evaluation after the sleep apnea function evaluation is turned on by judging the user's state in real time.
可选地,睡眠呼吸功能的评估可以包括但不限于对如下一项或多项进行评估:睡眠周 期分期、低通气、睡眠呼吸暂停以及鼾症等级风险。Optionally, the assessment of sleep breathing function may include, but is not limited to, assessing one or more of the following: sleep cycle stages, hypopnea, sleep apnea, and risk of snoring grade.
在本申请中,基于当前的检测场景,评估装置可以判断用户是否处于睡眠状态,进而自动开启或者关闭睡眠呼吸功能的评估。具体地,评估装置如果判定用户处于睡眠状态,自动开启睡眠呼吸功能的评估。相反,如果评估装置判定用户处于非睡眠状态,则不开启睡眠呼吸功能的评估。或者,评估装置在自动开启睡眠呼吸功能的评估之后,通过实时判断用户的状态,判定用户处于出睡之后,则自动关闭睡眠呼吸功能的评估。In this application, based on the current detection scenario, the evaluation device can determine whether the user is in a sleep state, and then automatically enable or disable the evaluation of sleep breathing function. Specifically, if the evaluation device determines that the user is in a sleep state, it automatically starts the evaluation of the sleep breathing function. On the contrary, if the evaluation device determines that the user is in a non-sleeping state, the evaluation of the sleep breathing function is not started. Alternatively, after the evaluation device automatically starts the evaluation of the sleep apnea function, it judges the state of the user in real time and determines that the user is out of sleep, and then automatically turns off the evaluation of the sleep apnea function.
可以看出,和现有的一些方案中,用户需要手动点击睡眠监测装置上的睡眠开始或者睡眠结束,才能开启或关闭睡眠监测装置的睡眠呼吸功能相比,本申请的技术方案,评估装置在不同的检测场景下,通过不同的检测方式获得用户的状态,从而可以自动开启或关闭睡眠呼吸功能的评估,用户体验更为友好。It can be seen that, compared with some existing solutions, the user needs to manually click the sleep start or sleep end on the sleep monitoring device to turn on or off the sleep breathing function of the sleep monitoring device, compared with the technical solution of the present application, the evaluation device is In different detection scenarios, the user's status is obtained through different detection methods, so that the evaluation of the sleep breathing function can be automatically turned on or off, and the user experience is more friendly.
下面再结合图2详细说明,评估装置在判定用户处于睡眠状态的情况下,开启了睡眠呼吸功能的评估之后,执行睡眠呼吸功能的评估的过程。The following describes in detail with reference to FIG. 2 , the assessment device performs the sleep breathing function assessment process after it determines that the user is in a sleep state and starts the sleep breathing function assessment.
参见图2,图2为本申请提供的评估睡眠呼吸功能的方法的一个示意性流程图。与方法100类似,方法200可以由评估装置执行。如图2,方法200主要包括步骤210-240。Referring to FIG. 2 , FIG. 2 is a schematic flowchart of the method for evaluating sleep breathing function provided by the present application. Similar to method 100, method 200 may be performed by an evaluation device. As shown in FIG. 2 , the method 200 mainly includes steps 210-240.
210、评估装置确定当前的检测场景处于第一检测场景,也即,用户穿戴着智能穿戴设备。210. The evaluation device determines that the current detection scene is the first detection scene, that is, the user is wearing the smart wearable device.
220、评估装置选择与第一检测场景对应的第一检测方式。220. The evaluation device selects a first detection manner corresponding to the first detection scene.
230、评估装置通过智能穿戴设备,判断用户的状态,获得判断的结果。230. The evaluation device judges the state of the user through the smart wearable device, and obtains a judgment result.
240、若判定用户处于睡眠状态,则评估装置开启睡眠呼吸功能的评估。240. If it is determined that the user is in a sleep state, the evaluation device starts the evaluation of the sleep breathing function.
在开启睡眠呼吸功能的评估之后,评估装置继续执行如下步骤。After starting the evaluation of the sleep breathing function, the evaluation device continues to perform the following steps.
250、评估装置通过智能穿戴设备获取当前的检测场景中的可用信号。250. The evaluation device acquires available signals in the current detection scene through the smart wearable device.
可选地,可用信号包括如下一项或多项:Optionally, available signals include one or more of the following:
一个或多个呼吸指标,所述呼吸指标包括呼吸频率和/或呼吸波的下降幅度;one or more respiratory indicators, the respiratory indicators include respiratory rate and/or respiratory wave decline;
一个或多个鼾声指标,所述鼾声指标包括鼾声响度;以及one or more snore indicators including snore loudness; and
所述用户的动作指标,所述动作指标包括所述用户的动作幅度和/或大动作的频率。The user's action index, where the action index includes the user's action range and/or frequency of major actions.
示例性地,评估装置通过智能穿戴设备的麦克风、超声波发送和/或接收传感器等,获取当前的检测场景中的可用信号。Exemplarily, the evaluation device obtains available signals in the current detection scene through a microphone of the smart wearable device, an ultrasonic sending and/or receiving sensor, and the like.
260、评估装置采用预先训练好的机器学习预测模型,对获得的可用信号进行预测,输出预测结果。260. The evaluation device uses a pre-trained machine learning prediction model to predict the obtained available signals and output a prediction result.
具体地,作为一个示例,本申请中的机器学习模型采用轻型GBM预测模型。Specifically, as an example, the machine learning model in this application adopts a lightweight GBM prediction model.
应理解,在轻型GBM预测模型在用于预测之前,需要通过大量的训练来提高预测的准确度与灵敏度。It should be understood that before the light-weight GBM prediction model is used for prediction, a large amount of training is required to improve the accuracy and sensitivity of prediction.
示例性地,评估装置获取用户的音频数据以及超声数据,并对音频数据和超声数据进行预处理。进一步地,对于经过预处理的音频数据和超声数据,评估装置对其进行特征提取。具体地,特征提取主要可以包括原始特征的提取以及统计特征的聚合。为了描述上的方便,在下文中,将通过特征提取获得的数据,称为提取数据。Exemplarily, the evaluation device acquires audio data and ultrasound data of the user, and preprocesses the audio data and ultrasound data. Further, the evaluation device performs feature extraction on the preprocessed audio data and ultrasound data. Specifically, feature extraction may mainly include extraction of original features and aggregation of statistical features. For the convenience of description, hereinafter, the data obtained through feature extraction will be referred to as extracted data.
评估装置使用提取数据,对轻型GBM预测模型进行训练,获得训练好的轻型GBM预测模型,为后续睡眠呼吸功能的评估的准确度以及灵敏度提供良好的保证。The evaluation device uses the extracted data to train the light GBM prediction model, and obtains the trained light GBM prediction model, which provides a good guarantee for the accuracy and sensitivity of the subsequent evaluation of sleep breathing function.
示例性地,评估装置进行预处理以及特征提取的详细流程可以如图3所示。Exemplarily, the detailed flow of preprocessing and feature extraction performed by the evaluation device may be as shown in FIG. 3 .
参见图3,图3为评估装置执行预处理以及特征提取的示意性框图。如图3所示,评估装置通过静音检测、有声片段以及无声片段的判断,以及音频数据和超声数据的采集,获得当前的检测场景中的目标音频数据和/或超声数据。进一步地,评估装置对获得的目标音频数据和/或超声数据进行预处理,以消除数据数量级与本身局部波动的影响。Referring to FIG. 3 , FIG. 3 is a schematic block diagram of preprocessing and feature extraction performed by the evaluation device. As shown in FIG. 3 , the evaluation device obtains target audio data and/or ultrasonic data in the current detection scene through silent detection, judgment of sound segments and silent segments, and collection of audio data and ultrasonic data. Further, the evaluation device performs preprocessing on the obtained target audio data and/or ultrasound data, so as to eliminate the influence of the magnitude of the data and its own local fluctuations.
示例性地,预处理可以包括对目标音频数据和/或超声数据进行幅值归一化、中值滤波以及带通滤波等处理,以尽量保留呼吸信号、鼾声信号的频段,以提高评估的灵敏度。Exemplarily, the preprocessing may include performing amplitude normalization, median filtering, and bandpass filtering on the target audio data and/or ultrasound data, so as to retain the frequency bands of the respiratory signal and the snoring signal as much as possible, so as to improve the sensitivity of the evaluation .
此外,评估装置对预处理后的信号进行特征提取的处理,获得提取数据。示例性地,特征提取的处理包括对目标音频数据和/或超声数据的原始特征的提取以及统计特征的聚合。In addition, the evaluation device performs feature extraction on the preprocessed signal to obtain extracted data. Exemplarily, the process of feature extraction includes extraction of original features of target audio data and/or ultrasound data and aggregation of statistical features.
示例性地,原始特征包括但不限于:梅尔频率倒谱系数、差分特征以及光谱平坦度。统计特征包括但不限于:均值、方差、峰值、偏度以及距特征。Exemplarily, the original features include, but are not limited to: Mel-frequency cepstral coefficients, differential features, and spectral flatness. Statistical features include, but are not limited to: mean, variance, peak, skewness, and distance features.
进一步地,采用提取数据对机器学习模型对进行训练。示例性地,机器学习模型可以采用轻型梯度提升机(light gradient boosting machine,light GBM)模型。在训练模型的过程中,轻型GBM模型通过对输入信号进行分析,获得输入信号中的呼吸信号、鼾声信号以及非鼾声信号的概率以及标签,并对其进行统计和缓存,以用于后续的预测。Further, the machine learning model pair is trained by using the extracted data. Exemplarily, the machine learning model may adopt a light gradient boosting machine (light gradient boosting machine, light GBM) model. In the process of training the model, the light GBM model analyzes the input signal to obtain the probability and label of the respiratory signal, snoring signal and non-snoring signal in the input signal, and statistics and caches them for subsequent predictions .
当评估装置获得当前的检测场景中的可用信号,将获得的可用信号输入轻型GBM模型,将获得预测结果,完成对用户的睡眠呼吸功能的评估。When the evaluation device obtains available signals in the current detection scene, the obtained available signals are input into the lightweight GBM model, and prediction results are obtained to complete the evaluation of the user's sleep breathing function.
下面给出一些预测结果的示例说明。Some examples of prediction results are given below.
示例性地,通过用户的、呼吸指标、鼾声指标以及动作指标等,对鼾症风险进行评估。Exemplarily, the risk of snoring is evaluated through the user's, breathing index, snoring sound index, motion index, and the like.
例如,若鼾声的响度大于或等于第一响度门限(记作DB1),且时长大于或等于第一时长门限(记作T1),判定用户的鼾症风险等级为高风险;For example, if the loudness of snoring is greater than or equal to the first loudness threshold (denoted as DB1), and the duration is greater than or equal to the first duration threshold (denoted as T1), it is determined that the user's snoring risk level is high risk;
若鼾声响度大于或等于第一响度门限,且时长小于第一时长门限,判定用户的鼾症等级风险为中风险;If the snoring loudness is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
若鼾声响度大于或等于第二响度门限(记作DB2),且时长大于或等于第二时长门限(记作T2),判定用户的鼾症等级风险为低风险;If the snoring loudness is greater than or equal to the second loudness threshold (denoted as DB2), and the duration is greater than or equal to the second duration threshold (denoted as T2), it is determined that the user's snoring level risk is low risk;
若为其它情况,则判定用户的鼾症等级风险为正常;In other cases, it is determined that the user's snoring level risk is normal;
其中,第二响度门限小于第一响度门限,第二时长门限小于第一时长门限。Wherein, the second loudness threshold is smaller than the first loudness threshold, and the second duration threshold is smaller than the first duration threshold.
示例性地,根据用户的呼吸率特征,对用户的睡眠分期阶段进行识别。Exemplarily, the user's sleep staging stage is identified according to the user's breathing rate feature.
例如,若呼吸频率大于第一频率(例如,X1)且斜率大于第一数值(例如,Y1),判定用户的睡眠分期阶段为快动眼睡眠(rapid eye movement sleep,REM);For example, if the respiratory rate is greater than the first frequency (for example, X1) and the slope is greater than the first value (for example, Y1), it is determined that the user's sleep staging stage is rapid eye movement sleep (rapid eye movement sleep, REM);
若呼吸频率小于或等于第一频率(例如,X1),且大于或等于第二频率(例如,X2),判定用户的睡眠分期阶段为浅睡;If the breathing frequency is less than or equal to the first frequency (for example, X1) and greater than or equal to the second frequency (for example, X2), it is determined that the user's sleep stage is light sleep;
若呼吸频率小于或等于第二频率(例如,X2),判定用户的睡眠分期阶段为深睡;If the breathing frequency is less than or equal to the second frequency (for example, X2), it is determined that the user's sleep staging stage is deep sleep;
其中,X2小于X1。Wherein, X2 is smaller than X1.
示例性地,根据用户的呼吸波下降的幅度,判断用户的睡眠呼吸暂停或低通气。Exemplarily, the user's sleep apnea or hypopnea is judged according to the magnitude of the decrease of the user's respiratory wave.
例如,若用户的呼吸波的幅度的下降比例大于第一百分比例(例如,X%),判定为低通气;For example, if the decrease ratio of the amplitude of the user's respiratory wave is greater than a first percentage (for example, X%), it is determined to be hypopnea;
若呼吸波的峰度的下降比例大于第二百分比例(例如,Y%),判定为睡眠呼吸暂停。If the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage (for example, Y%), it is determined to be sleep apnea.
下面结合图4,给出评估装置的工作流程的一个示例说明。An example description of the workflow of the evaluation device is given below with reference to FIG. 4 .
参见图4,图4为本申请提供的评估睡眠呼吸功能的方法400的示例性流程图。应理解,方法400可以由评估装置执行。所述评估装置可以为智能穿戴设备或智能穿戴设备中具有相应功能的模块(例如,芯片或芯片系统等)执行,不作限定。示例性地,所述芯片可以为片上系统(system on a chip,SOC)。Referring to FIG. 4 , FIG. 4 is an exemplary flowchart of a method 400 for evaluating sleep breathing function provided by the present application. It should be understood that the method 400 may be performed by an evaluation device. The evaluation device may be executed by a smart wearable device or a module (for example, a chip or a chip system, etc.) with corresponding functions in the smart wearable device, which is not limited. Exemplarily, the chip may be a system on a chip (system on a chip, SOC).
401、判断用户是否穿戴智能穿戴设备。401. Determine whether the user wears the smart wearable device.
应理解,判断用户是否穿戴智能穿戴设备,也即确定当前的检测场景具体为第一检测场景,或是第二检测场景。It should be understood that judging whether the user wears the smart wearable device is to determine whether the current detection scene is specifically the first detection scene or the second detection scene.
在是的情况下,进入步骤402。在否的情况下,进入步骤403。If yes, go to step 402 . If not, go to step 403 .
402、通过智能穿戴设备判断用户是否入睡。402. Determine whether the user falls asleep by using the smart wearable device.
也即,判断用户处于睡眠状态或是非睡眠状态。That is, it is determined whether the user is in a sleep state or a non-sleep state.
如果否,执行步骤404。If not, go to step 404 .
如果是,执行步骤405。If yes, go to step 405.
404、不启动睡眠呼吸功能的评估。404. The evaluation of the sleep breathing function is not started.
405、自动开启睡眠呼吸功能的评估。405. Automatically start the evaluation of the sleep breathing function.
404、判断智能穿戴设备是否处于静止状态的时长等于或大于第一时长门限。404. Determine whether the duration of the smart wearable device being in the static state is equal to or greater than the first duration threshold.
如果否,执行步骤406。If not, go to step 406 .
如果是,执行步骤407。If yes, go to step 407.
406、不启动睡眠呼吸功能的评估。406. The evaluation of the sleep breathing function is not started.
407、自动启动睡眠呼吸功能的评估。407. Automatically start the evaluation of the sleep breathing function.
在启动睡眠呼吸功能的评估之后,执行步骤408。After the evaluation of sleep breathing function is initiated, step 408 is performed.
408、实时统计与分析呼吸指标以及鼾声指标。408. Real-time statistics and analysis of breathing indicators and snoring indicators.
可选地,呼吸指标可以包括一个或多个,例如,呼吸的频率。Optionally, respiration indicators may include one or more, for example, the rate of respiration.
可选地,鼾声指标可以包括一个或多个,例如,鼾声的响度。Optionally, the snoring indicator may include one or more, for example, the loudness of the snoring.
409、在进行睡眠呼吸评估的同时,通过智能穿戴设备判断用户是否出睡。409. While performing the sleep breathing assessment, judge whether the user is asleep through the smart wearable device.
如果是,执行步骤410。If yes, go to step 410.
如果否,继续执行步骤408。If not, go to step 408 .
410、自动关闭睡眠呼吸评估功能。410. Automatically shut down the sleep breathing evaluation function.
在步骤405中,自动开启睡眠呼吸评估功能之后,执行步骤411。In step 405, step 411 is executed after the sleep breathing assessment function is automatically enabled.
411、实时统计与分析呼吸指标以及鼾声指标。411. Real-time statistics and analysis of breathing indicators and snoring indicators.
412、在进行睡眠呼吸评估的同时,实时获取智能穿戴设备的状态,并判断智能穿戴设备是否处于大动作状态的时长超过第二时长门限。412. Acquiring the status of the smart wearable device in real time while performing the sleep breathing assessment, and judging whether the duration of the smart wearable device being in the state of major motion exceeds the second duration threshold.
如果是,执行步骤413。If yes, go to step 413.
如果否,继续执行步骤411。If not, go to step 411.
413、自动关闭睡眠呼吸评估功能。413. Automatically shut down the sleep breathing evaluation function.
下面给出本申请提供的评估装置的一个示意性框图。A schematic block diagram of the evaluation device provided by this application is given below.
参见图5,图5为本申请提供的用于评估睡眠呼吸功能的评估装置500。该评估装置500可以包括自动检测模块510、数据采集与预处理模块520、特征提取与统计模块530以及睡眠呼吸评估功能模块540。Referring to FIG. 5 , FIG. 5 is an evaluation device 500 for evaluating sleep breathing function provided by the present application. The evaluation device 500 may include an automatic detection module 510 , a data collection and preprocessing module 520 , a feature extraction and statistics module 530 , and a sleep breathing evaluation function module 540 .
自动检测模块510,主要用于在不同的检测场景下,自动启动或关闭麦克风、超声接 收设备和/或超声发送设备,启动或关闭睡眠呼吸功能的评估。The automatic detection module 510 is mainly used to automatically activate or deactivate the microphone, the ultrasonic receiving device and/or the ultrasonic transmitting device under different detection scenarios, and activate or deactivate the evaluation of sleep breathing function.
数据采集与预处理模块520,主要用于音频数据和/或超声数据的采集,可用信号的采集,以及有声片段与无声片段进行判断等预处理。示例性地,所述音频数据包括普通录音数据。The data collection and preprocessing module 520 is mainly used for the collection of audio data and/or ultrasound data, the collection of available signals, and preprocessing such as judging the audio segment and the silent segment. Exemplarily, the audio data includes common recording data.
特征提取与统计模块530,用于对用户的动作、呼吸以及鼾声特征进行特征提取与统计。The feature extraction and statistics module 530 is used to perform feature extraction and statistics on the user's actions, breathing and snoring features.
睡眠呼吸功能评估模块540,用于根据特征提取与统计模块530完整提取和统计的数据,对用户进行睡眠呼吸功能的评估。The sleep breathing function evaluation module 540 is used to evaluate the sleep breathing function of the user according to the data completely extracted and counted by the feature extraction and statistics module 530 .
以上本申请提供的睡眠呼吸的方法进行了详细说明,下面介绍本申请提供的评估装置。The sleep breathing method provided by this application has been described in detail above, and the evaluation device provided by this application will be introduced below.
参见图6,图6为本申请提供的评估装置的示意性框图。如图6,评估装置1000包括处理单元1100,接收单元1200以及发送单元1300。Referring to FIG. 6 , FIG. 6 is a schematic block diagram of the evaluation device provided by the present application. As shown in FIG. 6 , the evaluation device 1000 includes a processing unit 1100 , a receiving unit 1200 and a sending unit 1300 .
处理单元1100,用于确定当前的检测场景,所述当前的检测场景属于预设定的检测场景中的一个,其中,所述预设定的检测场景包括第一检测场景和第二检测场景,其中,所述第一检测场景为所述用户穿戴智能穿戴设备,所述第二检测场景为所述用户未穿戴智能穿戴设备;The processing unit 1100 is configured to determine a current detection scene, where the current detection scene belongs to one of preset detection scenarios, wherein the preset detection scenarios include a first detection scene and a second detection scene, Wherein, the first detection scene is that the user is wearing a smart wearable device, and the second detection scene is that the user is not wearing a smart wearable device;
以及,根据所述当前的检测场景,选择检测方式;And, according to the current detection scene, select a detection method;
以及,采用所选择的检测方式,判断所述用户的状态,其中,所述用户的状态包括所述用户处于睡眠状态,或所述用户处于非睡眠状态;And, using the selected detection method to determine the state of the user, wherein the state of the user includes that the user is in a sleeping state, or that the user is in a non-sleeping state;
根据所述用户的状态,开启或者关闭对用户的睡眠呼吸功能的评估,According to the state of the user, the evaluation of the sleep breathing function of the user is turned on or off,
其中,所述睡眠呼吸功能的评估包括对如下的一项或多项进行评估:睡眠周期分期、低通气、睡眠呼吸暂停以及鼾症等级风险。Wherein, the evaluation of sleep breathing function includes evaluating one or more of the following: sleep cycle stage, hypopnea, sleep apnea, and risk of snoring grade.
发送单元1300,用于输出评估的结果。The sending unit 1300 is configured to output the evaluation result.
可选地,作为一个实施例,所述处理单元1100,还用于:Optionally, as an embodiment, the processing unit 1100 is further configured to:
判断所述当前的检测场景,并在判定当前的检测场景为所述第一检测场景的情况下,选择第一检测方式,其中,所述第一检测方式是通过所述智能穿戴设备判断所述用户的状态的;或者,judging the current detection scene, and selecting a first detection mode when it is determined that the current detection scene is the first detection scene, wherein the first detection mode is to judge the the user's status; or,
在判定当前的检测场景为所述第二检测场景的情况下,选择第二检测方式,其中,所述第二检测方式是通过所述智能穿戴设备的状态和所述用户的历史睡眠信息,判断所述用户的状态的;In the case where it is determined that the current detection scene is the second detection scene, select the second detection method, wherein the second detection method is determined by the state of the smart wearable device and the historical sleep information of the user. the status of the user;
其中,所述智能穿戴设备的状态包括如下一项或多项:所述智能穿戴设备在指定时间段内处于静止状态的时长大于或等于第一时长阈值、所述智能穿戴设备处于大动作状态的时长大于或等于第二时长阈值;Wherein, the status of the smart wearable device includes one or more of the following: the duration of the smart wearable device being in a static state within a specified period of time is greater than or equal to the first duration threshold, the duration of the smart wearable device being in a large motion state The duration is greater than or equal to the second duration threshold;
所述用户的历史睡眠信息包括如下一项或多项:所述用户的历史睡眠时间段、所述用户预设定的睡眠时间以及所述用户预设定的闹钟时间。The user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time.
可选地,作为一个实施例,所述接收单元1200,用于获取所述第一检测场景或所述第二检测场景中的可用信号;Optionally, as an embodiment, the receiving unit 1200 is configured to acquire available signals in the first detection scene or the second detection scene;
以及,所述处理单元1100,用于根据所述可用信号对所述用户的睡眠呼吸功能进行评估,其中,所述可用信号包括如下一项或多项:And, the processing unit 1100 is configured to evaluate the sleep breathing function of the user according to the available signals, wherein the available signals include one or more of the following:
一个或多个呼吸指标,所述呼吸指标包括呼吸频率和/或呼吸波的下降幅度;one or more respiratory indicators, the respiratory indicators include respiratory rate and/or respiratory wave decline;
一个或多个鼾声指标,所述鼾声指标包括鼾声响度;以及one or more snore indicators including snore loudness; and
所述用户的动作指标,所述动作指标包括所述用户的动作幅度和/或大动作的频率。The user's action index, where the action index includes the user's action range and/or frequency of major actions.
可选地,作为一个实施例,所述处理单元1100,还用于采用训练好的轻型梯度提升机GBM模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估。Optionally, as an embodiment, the processing unit 1100 is further configured to use a trained light-weight gradient boosting machine GBM model to predict the available signal, so as to evaluate the sleep breathing function of the user.
可选地,作为一个实施例,所述接收单元1200,用于获取所述用户的音频数据和超声数据;Optionally, as an embodiment, the receiving unit 1200 is configured to acquire audio data and ultrasound data of the user;
以及,所述处理单元1100,还用于对所述音频数据和超声数据进行预处理,并对经过预处理的音频数据和超声数据进行特征提取的处理,获得提取数据,其中,所述特征提取的处理包括对所述经过预处理的音频数据和超声数据进行原始特征的提取以及统计特征的聚合;And, the processing unit 1100 is further configured to preprocess the audio data and ultrasound data, and perform feature extraction on the preprocessed audio data and ultrasound data to obtain extracted data, wherein the feature extraction The processing includes performing extraction of original features and aggregation of statistical features on the preprocessed audio data and ultrasound data;
使用所述提取数据,对所述轻型GBM预测模型进行训练,获得所述训练好的轻型GBM预测模型。Using the extracted data, train the lightweight GBM prediction model to obtain the trained lightweight GBM prediction model.
可选地,作为一个实施例,处理单元100,具体用于:Optionally, as an embodiment, the processing unit 100 is specifically configured to:
若所述鼾声响度大于或等于第一响度门限,且时长大于或等于第一时长门限,判定所述用户的鼾症等级风险为高风险;If the snoring loudness is greater than or equal to the first loudness threshold, and the duration is greater than or equal to the first duration threshold, it is determined that the user's snoring level risk is high risk;
若所述鼾声响度大于或等于第一响度门限,且时长小于第一时长门限,判定所述用户的鼾症等级风险为中风险;If the loudness of the snoring sound is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
若所述鼾声响度大于或等于第二响度门限,且时长大于或等于第二时长门限,判定所述用户的鼾症等级风险为低风险,其中,所述第二响度门限小于所述第一响度门限,所述第二时长门限小于所述第一时长门限;If the loudness of the snoring sound is greater than or equal to the second loudness threshold and the duration is greater than or equal to the second duration threshold, it is determined that the user's snoring level risk is low risk, wherein the second loudness threshold is smaller than the first loudness threshold a threshold, the second duration threshold is less than the first duration threshold;
否则,判定所述用户的鼾症等级风险为正常。Otherwise, it is determined that the user's snoring level risk is normal.
可选地,作为一个实施例,若所述呼吸频率大于第一频率且斜率大于第一数值,判定睡眠分期阶段为快动眼睡眠REM;Optionally, as an embodiment, if the respiratory rate is greater than the first frequency and the slope is greater than the first value, it is determined that the sleep staging stage is REM sleep;
若所述呼吸频率小于或等于第一频率,且大于或等于第二频率,判定所述睡眠分期阶段为浅睡;If the breathing frequency is less than or equal to the first frequency and greater than or equal to the second frequency, it is determined that the sleep staging stage is light sleep;
若所述呼吸频率小于或等于第二频率,判定所述睡眠分期阶段为深睡。If the breathing frequency is less than or equal to the second frequency, it is determined that the sleep staging stage is deep sleep.
可选地,作为一个实施例,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:Optionally, as an embodiment, the trained lightweight GBM prediction model is used to predict the available signals to evaluate the sleep breathing function of the user, including:
若所述呼吸波的幅度的下降比例大于第一百分比例,判定为低通气;If the decrease ratio of the amplitude of the respiratory wave is greater than the first percentage, it is judged as hypopnea;
若所述呼吸波的峰度的下降比例大于第二百分比例,判定为睡眠呼吸暂停。If the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage, it is determined to be sleep apnea.
在以上各实现方式中,接收单元1200和发送单元1300也可以集成为一个收发单元,同时具备接收和发送的功能,这里不作限定。In each of the above implementation manners, the receiving unit 1200 and the sending unit 1300 may also be integrated into a transceiver unit, which has the functions of receiving and sending at the same time, which is not limited here.
另外,在各实施例中,处理单元1100用于执行除了发送和接收的动作之外由通信装置1000内部实现的处理和/或操作。接收单元1200用于执行接收的动作,发送单元1300用于执行发送的动作。In addition, in various embodiments, the processing unit 1100 is configured to perform processing and/or operations implemented internally by the communication device 1000 except for the actions of sending and receiving. The receiving unit 1200 is configured to perform an action of receiving, and the sending unit 1300 is configured to perform an action of sending.
示例性地,作为一种实现,图5中所示的自动检测模块510、数据采集与预处理模块520、特征提取与统计模块530以及睡眠呼吸功能评估模块540的功能可以集成在图6中的处理单元1100中。Exemplarily, as an implementation, the functions of the automatic detection module 510, data collection and preprocessing module 520, feature extraction and statistics module 530 and sleep breathing function evaluation module 540 shown in Figure 5 can be integrated in the In the processing unit 1100.
可选地,在一种实现方式中,评估装置500还可以包括显示单元1400,用于显示(也 即,向用户呈现)评估结果。Optionally, in an implementation manner, the evaluation device 500 may further include a display unit 1400, configured to display (that is, present to the user) the evaluation result.
参见图7,图7为本申请提供的评估装置的示意性结构图。如图7,通信装置10包括:一个或多个处理器11,一个或多个存储器12以及一个或多个通信接口13。处理器11用于控制通信接口13收发信号,存储器12用于存储计算机程序,处理器11用于从存储器12中调用并运行该计算机程序,以使得通信装置10执行本申请各方法实施例中由评估装置执行的处理和/或操作。Referring to FIG. 7, FIG. 7 is a schematic structural diagram of the evaluation device provided by the present application. As shown in FIG. 7 , the communication device 10 includes: one or more processors 11 , one or more memories 12 and one or more communication interfaces 13 . The processor 11 is used to control the communication interface 13 to send and receive signals, the memory 12 is used to store a computer program, and the processor 11 is used to call and run the computer program from the memory 12, so that the communication device 10 executes the method described in each method embodiment of the present application. Processes and/or operations performed by the evaluation device.
例如,处理器11可以具有图6中所示的处理单元1100的功能,通信接口13可以具有图6中所示的接收单元1200和/或发送单元1300的功能。具体地,处理器11可以用于执行各方法实施例中由可评估装置内部执行的处理和/或操作,通信接口13用于执行各方法实施例中由评估装置执行的发送和/或接收的动作。For example, the processor 11 may have the functions of the processing unit 1100 shown in FIG. 6 , and the communication interface 13 may have the functions of the receiving unit 1200 and/or the sending unit 1300 shown in FIG. 6 . Specifically, the processor 11 can be used to execute the processing and/or operations performed internally by the evaluation device in each method embodiment, and the communication interface 13 is used to execute the sending and/or receiving operations performed by the evaluation device in each method embodiment. action.
示例性地,在图1示出的方法100中,处理器11用于执行步骤110-140。或者,在图2中,处理器11用于执行步骤210-240,步骤260;接收单元1200用于执行步骤250;以及,发送单元1300用于执行步骤270。或者,在图4中,处理器11用于执行步骤401-411。Exemplarily, in the method 100 shown in FIG. 1 , the processor 11 is configured to execute steps 110-140. Alternatively, in FIG. 2 , the processor 11 is used to perform steps 210 - 240 , step 260 ; the receiving unit 1200 is used to perform step 250 ; and the sending unit 1300 is used to perform step 270 . Alternatively, in FIG. 4, the processor 11 is configured to execute steps 401-411.
此外,通信装置10还可以包括一个或多个存储器14,所述一个或多个存储器14可以用于存储从检测场景中获取的可用信号、存储所述轻型GBM模型的数据,以及存储中间处理结果,等。In addition, the communication device 10 can also include one or more memories 14, which can be used to store available signals obtained from detection scenarios, store data of the lightweight GBM model, and store intermediate processing results ,Wait.
在一种实现方式中,通信装置10可以为智能穿戴设备。In an implementation manner, the communication device 10 may be a smart wearable device.
在另一种实现中,通信装置10可以为安装在智能穿戴设备中的芯片或者芯片系统。在这种实现方式中,通信接口13可以为接口电路或者输入/输出接口。In another implementation, the communication device 10 may be a chip or a chip system installed in a smart wearable device. In this implementation manner, the communication interface 13 may be an interface circuit or an input/output interface.
其中,图7中器件(例如,处理器、存储器或通信接口)后面的虚线框表示该器件可以为一个以上。Wherein, the dotted box behind the device (for example, processor, memory or communication interface) in FIG. 7 indicates that there may be more than one device.
图8是本申请提供的智能穿戴设备的示意性框图。参考图8,智能穿戴设备30可以包括处理器310,存储器320,无线通信模块330,显示屏340、摄像头350、音频模块360以及传感器模块370,等。其中,音频模块360可以包括扬声器360A,受话器360B,麦克风360C等。可选地,上述器件均可以是一个或多个。Fig. 8 is a schematic block diagram of a smart wearable device provided by the present application. Referring to FIG. 8 , the smart wearable device 30 may include a processor 310 , a memory 320 , a wireless communication module 330 , a display screen 340 , a camera 350 , an audio module 360 and a sensor module 370 , and so on. Wherein, the audio module 360 may include a speaker 360A, a receiver 360B, a microphone 360C and the like. Optionally, there may be one or more of the above-mentioned devices.
可以理解的是,本申请实施例示意的结构并不构成对智能穿戴设备30的具体限定。在本申请另一些实施例中,智能穿戴设备30可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart wearable device 30 . In other embodiments of the present application, the smart wearable device 30 may include more or fewer components than shown in the illustration, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.
示例性地,处理器310可以对应图6中的处理单元1100,用于执行处理单元1100执行的步骤。或者,处理器310具有图7中的处理器11的功能。Exemplarily, the processor 310 may correspond to the processing unit 1100 in FIG. 6 , and is configured to execute the steps performed by the processing unit 1100 . Alternatively, the processor 310 has the functions of the processor 11 in FIG. 7 .
可选地,处理器310可以包括一个或多个处理单元,例如:处理器310可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。Optionally, the processor 310 may include one or more processing units, for example: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), Image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
存储器320,可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器310通过运行存储在存储器320的指令,从而执行智能穿戴设备30的各种功能应 用以及数据处理。内部存储器320可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(例如,如声音播放功能,图像播放功能等)等。存储数据区可存储智能穿戴设备30使用过程中所创建的数据(例如,音频数据,电话本等)等。此外,存储器320可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。示例性地,存储器320具有图7中的存储器12的功能。The memory 320 may be used to store computer executable program codes, and the executable program codes include instructions. The processor 310 executes various functional applications and data processing of the smart wearable device 30 by executing instructions stored in the memory 320 . The internal memory 320 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (for example, such as a sound playing function, an image playing function, etc.) and the like. The data storage area can store data created during the use of the smart wearable device 30 (for example, audio data, phonebook, etc.) and the like. In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. Exemplarily, the memory 320 has the function of the memory 12 in FIG. 7 .
无线通信模块330,可以提供应用在智能穿戴设备30上的包括无线局域网(wireless local area networks,WLAN)如无线保真(wireless fidelity,Wi-Fi)网络,蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块360可以是集成至少一个通信处理模块的一个或多个器件。The wireless communication module 330 can provide wireless local area networks (wireless local area networks, WLAN) such as wireless fidelity (Wireless fidelity, Wi-Fi) networks, bluetooth (bluetooth, BT), global navigation satellites, etc. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 360 may be one or more devices integrating at least one communication processing module.
示例性地,无线通信模块330可以通过如图7中的通信接口13与其它器件、模块或设备等进行信息交互。Exemplarily, the wireless communication module 330 may perform information exchange with other devices, modules or devices through the communication interface 13 as shown in FIG. 7 .
显示屏340,用于显示图像,视频、文字信息等。示例性地,显示屏340包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。可选地,智能穿戴设备30可以包括1个或多个显示屏340。The display screen 340 is used for displaying images, videos, text information and the like. Exemplarily, the display screen 340 includes a display panel. The display panel can adopt liquid crystal display (liquid crystal display, LCD), organic light-emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. Optionally, the smart wearable device 30 may include one or more display screens 340 .
示例性地,显示屏340用于显示睡眠呼吸功能的评估结果,还可以显示睡眠呼吸功能的评估正在进行或者处于关闭状态等提示信息。Exemplarily, the display screen 340 is used to display the evaluation result of the sleep apnea function, and may also display prompt information such as the evaluation of the sleep apnea function being in progress or in a closed state.
摄像头350,用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,智能穿戴设备30可以包括1个或多个摄像头350。Camera 350 for capturing still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the smart wearable device 30 may include one or more cameras 350 .
此外,智能穿戴设备30可以通过音频模块370,扬声器370A,受话器370B,麦克风370C,以及应用处理器等实现音频功能。例如,录音等。In addition, the smart wearable device 30 can implement audio functions through the audio module 370 , the speaker 370A, the receiver 370B, the microphone 370C, and the application processor. For example, recording etc.
在一些实施例中,音频模块370可以设置于处理器310中,或将音频模块370的部分功能模块设置于处理器310中。In some embodiments, the audio module 370 can be set in the processor 310 , or some functional modules of the audio module 370 can be set in the processor 310 .
示例性地,智能穿戴设备30上的麦克风370C用于采集声音信号,降噪,还可以实现定向录音功能等,以实现检测场景中声音信号的采集。Exemplarily, the microphone 370C on the smart wearable device 30 is used to collect sound signals, reduce noise, and can also implement a directional recording function, etc., so as to realize the collection of sound signals in the detection scene.
传感器模块380可以包括多种传感器,例如,压力传感器、陀螺仪传感器、气压传感器、磁传感器、加速度传感器、距离传感器、接近光传感器、环境光传感器、指纹传感器、温度传感器、触摸传感器以及骨传导传感器,等。这些传感器中部分或全部可以应用在本申请的方案中用于辅助评估装置对检测场景的判断以及在睡眠呼吸功能评估过程中的信号采集。此外,智能穿戴设备30还可以包括其它更多的传感器,不作限定。The sensor module 380 may include various sensors such as a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, an ambient light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, and a bone conduction sensor. ,Wait. Some or all of these sensors can be used in the solution of the present application to assist the evaluation device in judging the detection scene and signal acquisition during sleep breathing function evaluation. In addition, the smart wearable device 30 may also include other sensors, which are not limited.
可选的,上述各装置实施例中的存储器与处理器可以是物理上相互独立的单元,或者, 存储器也可以和处理器集成在一起,本文不作限定。Optionally, the memory and the processor in the foregoing apparatus embodiments may be physically independent units, or the memory and the processor may also be integrated together, which is not limited herein.
此外,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机指令,当计算机指令在计算机上运行时,使得本申请各方法实施例中由评估装置执行的操作和/或处理被执行。In addition, the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions are run on the computer, the operations performed by the evaluation device in each method embodiment of the present application are and/or processing is performed.
此外,本申请还提供一种计算机程序产品,计算机程序产品包括计算机程序代码或指令,当计算机程序代码或指令在计算机上运行时,使得本申请各方法实施例中由评估装置执行的操作和/或处理被执行。In addition, the present application also provides a computer program product. The computer program product includes computer program codes or instructions. When the computer program codes or instructions are run on the computer, the operations performed by the evaluation device in each method embodiment of the present application and/or or processing is performed.
此外,本申请还提供一种芯片,所述芯片包括处理器,用于存储计算机程序的存储器独立于芯片而设置,处理器用于执行存储器中存储的计算机程序,使得安装有所述芯片的设备执行任意一个方法实施例中由评估装置执行的操作和/或处理。In addition, the present application also provides a chip, the chip includes a processor, a memory for storing computer programs is provided independently of the chip, and the processor is used for executing the computer programs stored in the memory, so that the device installed with the chip executes Operations and/or processing performed by the evaluation device in any one method embodiment.
进一步地,所述芯片还可以包括通信接口。所述通信接口可以是输入/输出接口,也可以为接口电路等。进一步地,所述芯片还可以包括所述存储器。Further, the chip may further include a communication interface. The communication interface may be an input/output interface, or an interface circuit or the like. Further, the chip may further include the memory.
可选地,上述处理器可以为一个或多个,所述存储器可以为一个或多个,所述存储器可以为一个或多个。Optionally, there may be one or more processors, one or more memories, and one or more memories.
可选地,所述处理器也可以为处理电路等。Optionally, the processor may also be a processing circuit or the like.
此外,本申请还提供一种通信装置(例如,可以为芯片或芯片系统),包括处理器和通信接口,所述通信接口用于接收(或称为输入)数据和/或信息,并将接收到的数据和/或信息传输至所述处理器,所述处理器处理所述数据和/或信息,以及,通信接口还用于输出(或称为输出)经处理器处理之后的数据和/或信息,以使得任意一个方法实施例中由评估装置执行的操作和/或处理被执行。In addition, the present application also provides a communication device (for example, it may be a chip or a chip system), including a processor and a communication interface, the communication interface is used to receive (or be referred to as input) data and/or information, and will receive The received data and/or information are transmitted to the processor, and the processor processes the data and/or information, and the communication interface is also used to output (or be referred to as output) the data and/or processed by the processor or information, so that the operations and/or processing performed by the evaluation device in any one method embodiment are performed.
此外,本申请还提供一种通信装置,包括至少一个处理器,所述至少一个处理器与至少一个存储器耦合,所述至少一个处理器用于执行所述至少一个存储器中存储的计算机程序或指令,使得所述通信装置执行任意一个方法实施例中由评估装置执行的操作和/或处理。In addition, the present application also provides a communication device, including at least one processor, the at least one processor is coupled to at least one memory, and the at least one processor is configured to execute computer programs or instructions stored in the at least one memory, The communication device is made to perform the operation and/or processing performed by the evaluation device in any one method embodiment.
此外,本申请还提供一种通信装置,包括处理器和存储器。可选地,还可以包括收发器。其中,存储器用于存储计算机程序,处理器用于调用并运行存储器中存储的计算机程序,并控制收发器收发信号,以使通信设备执行任意一个方法实施例中由评估装置执行的操作和/或处理。In addition, the present application also provides a communication device, including a processor and a memory. Optionally, a transceiver may also be included. Wherein, the memory is used to store computer programs, and the processor is used to call and run the computer programs stored in the memory, and control the transceiver to send and receive signals, so that the communication device performs the operation and/or processing performed by the evaluation device in any method embodiment .
本申请实施例中的存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(dynamic RAM,DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DRRAM)。应注意,本文描述的系统和方法的存 储器旨在包括但不限于这些和任意其它适合类型的存储器。The memory in the embodiments of the present application may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Among them, the non-volatile memory can be read-only memory (read-only memory, ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically programmable Erases programmable read-only memory (electrically EPROM, EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, many forms of RAM are available such as static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (synchlink DRAM, SLDRAM ) and direct memory bus random access memory (direct rambus RAM, DRRAM). It should be noted that the memory of the systems and methods described herein is intended to include, but not be limited to, these and any other suitable types of memory.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disc and other media that can store program codes. .
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。The above is only a specific implementation of the application, but the scope of protection of the application is not limited thereto. Anyone familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the application. Should be covered within the protection scope of this application. Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims (20)

  1. 一种评估睡眠呼吸功能的方法,其特征在于,包括:A method for evaluating sleep apnea function, comprising:
    确定当前的检测场景,所述当前的检测场景属于预设定的检测场景中的一个,其中,所述预设定的检测场景包括第一检测场景和第二检测场景,所述第一检测场景为所述用户穿戴智能穿戴设备,所述第二检测场景为所述用户未穿戴智能穿戴设备;Determine the current detection scene, the current detection scene belongs to one of the preset detection scenes, wherein the preset detection scene includes a first detection scene and a second detection scene, the first detection scene The user is wearing a smart wearable device, and the second detection scene is that the user is not wearing a smart wearable device;
    根据所述当前的检测场景,选择检测方式,Select a detection method according to the current detection scene,
    采用所选择的检测方式,判断所述用户的状态,其中,所述用户的状态包括所述用户处于睡眠状态,或所述用户处于非睡眠状态;Using the selected detection method to determine the state of the user, wherein the state of the user includes that the user is in a sleeping state, or that the user is in a non-sleeping state;
    根据所述用户的状态,开启或者关闭对所述用户的睡眠呼吸功能的评估,According to the state of the user, enable or disable the evaluation of the sleep breathing function of the user,
    其中,所述睡眠呼吸功能的评估包括对如下的一项或多项进行评估:睡眠周期分期、低通气、睡眠呼吸暂停以及鼾症等级风险。Wherein, the evaluation of sleep breathing function includes evaluating one or more of the following: sleep cycle stage, hypopnea, sleep apnea, and risk of snoring grade.
  2. 如权利要求1所述的方法,其特征在于,所述根据所述当前的检测场景,选择检测方式,包括:The method according to claim 1, wherein said selecting a detection method according to said current detection scene comprises:
    若所述当前的检测场景为所述第一检测场景,选择第一检测方式,其中,所述第一检测方式是通过所述智能穿戴设备判断所述用户的状态的;或者,If the current detection scene is the first detection scene, select a first detection method, wherein the first detection method is to judge the state of the user through the smart wearable device; or,
    若所述当前的检测场景为所述第二检测场景,选择第二检测方式,其中,所述第二检测方式是通过所述智能穿戴设备的状态和所述用户的历史睡眠信息,判断所述用户的状态的;If the current detection scene is the second detection scene, select the second detection method, wherein the second detection method is to judge the the status of the user;
    其中,所述智能穿戴设备的状态包括如下一项或多项:所述智能穿戴设备在指定时间段内处于静止状态的时长大于或等于第一时长阈值、所述智能穿戴设备处于大动作状态的时长大于或等于第二时长阈值;Wherein, the status of the smart wearable device includes one or more of the following: the duration of the smart wearable device being in a static state within a specified period of time is greater than or equal to the first duration threshold, the duration of the smart wearable device being in a large motion state The duration is greater than or equal to the second duration threshold;
    所述用户的历史睡眠信息包括如下一项或多项:所述用户的历史睡眠时间段、所述用户预设定的睡眠时间以及所述用户预设定的闹钟时间。The user's historical sleep information includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time.
  3. 如权利要求1或2所述的方法,其特征在于,在开启对用户的睡眠呼吸功能的评估之后,所述方法还包括:The method according to claim 1 or 2, wherein after starting the evaluation of the sleep breathing function of the user, the method further comprises:
    获取所述第一检测场景或所述第二检测场景中的可用信号;acquiring available signals in the first detection scene or the second detection scene;
    根据所述可用信号对所述用户的睡眠呼吸功能进行评估,evaluating sleep breathing function of the user based on the available signals,
    其中,所述可用信号包括如下一项或多项:Wherein, the available signals include one or more of the following:
    一个或多个呼吸指标,所述呼吸指标包括呼吸频率和/或呼吸波的下降幅度;one or more respiratory indicators, the respiratory indicators include respiratory rate and/or respiratory wave decline;
    一个或多个鼾声指标,所述鼾声指标包括鼾声响度;以及one or more snore indicators including snore loudness; and
    所述用户的动作指标,所述动作指标包括所述用户的动作幅度和/或大动作的频率。The user's action index, where the action index includes the user's action range and/or frequency of major actions.
  4. 如权利要求3所述的方法,其特征在于,所述根据所述可用信号对所述用户的睡眠呼吸功能进行评估,包括:The method according to claim 3, wherein the evaluating the sleep breathing function of the user according to the available signal comprises:
    采用训练好的轻型梯度提升机GBM模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估。The trained light-weight gradient boosting machine GBM model is used to predict the available signal, so as to evaluate the sleep breathing function of the user.
  5. 如权利要求4所述的方法,其特征在于,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测之前,所述方法还包括:The method according to claim 4, characterized in that, before using the trained lightweight GBM prediction model to predict the available signal, the method further comprises:
    获取所述用户的音频数据和超声数据;Obtain audio data and ultrasound data of the user;
    对所述音频数据和超声数据进行预处理,并对经过预处理的音频数据和超声数据进行特征提取的处理,获得提取数据,其中,所述特征提取的处理包括对所述经过预处理的音频数据和超声数据进行原始特征的提取以及统计特征的聚合;Preprocessing the audio data and ultrasound data, and performing feature extraction on the preprocessed audio data and ultrasound data to obtain extracted data, wherein the feature extraction process includes processing the preprocessed audio Data and ultrasound data for the extraction of raw features and the aggregation of statistical features;
    使用所述提取数据,对所述轻型GBM预测模型进行训练,获得所述训练好的轻型GBM预测模型。Using the extracted data, train the lightweight GBM prediction model to obtain the trained lightweight GBM prediction model.
  6. 如权利要求4或5所述的方法,其特征在于,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:The method according to claim 4 or 5, wherein said using the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user, including:
    若所述鼾声响度大于或等于第一响度门限,且时长大于或等于第一时长门限,判定所述用户的鼾症等级风险为高风险;If the snoring loudness is greater than or equal to the first loudness threshold, and the duration is greater than or equal to the first duration threshold, it is determined that the user's snoring level risk is high risk;
    若所述鼾声响度大于或等于第一响度门限,且时长小于第一时长门限,判定所述用户的鼾症等级风险为中风险;If the snoring loudness is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
    若所述鼾声响度大于或等于第二响度门限,且时长大于或等于第二时长门限,判定所述用户的鼾症等级风险为低风险,其中,所述第二响度门限小于所述第一响度门限,所述第二时长门限小于所述第一时长门限;If the loudness of the snoring sound is greater than or equal to the second loudness threshold and the duration is greater than or equal to the second duration threshold, it is determined that the user's snoring level risk is low risk, wherein the second loudness threshold is smaller than the first loudness threshold a threshold, the second duration threshold is less than the first duration threshold;
    否则,判定所述用户的鼾症等级风险为正常。Otherwise, it is determined that the user's snoring level risk is normal.
  7. 如权利要求4-6中任一项所述的方法,其特征在于,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:The method according to any one of claims 4-6, wherein said using the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user, including :
    若所述呼吸频率大于第一频率且斜率大于第一数值,判定睡眠分期阶段为快动眼睡眠REM;If the respiratory rate is greater than the first frequency and the slope is greater than the first value, it is determined that the sleep staging stage is REM sleep;
    若所述呼吸频率小于或等于第一频率,且大于或等于第二频率,判定所述睡眠分期阶段为浅睡;If the breathing frequency is less than or equal to the first frequency and greater than or equal to the second frequency, it is determined that the sleep staging stage is light sleep;
    若所述呼吸频率小于或等于第二频率,判定所述睡眠分期阶段为深睡。If the breathing frequency is less than or equal to the second frequency, it is determined that the sleep staging stage is deep sleep.
  8. 如权利要求4-7中任一项所述的方法,其特征在于,所述采用训练好的轻型GBM预测模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估,包括:The method according to any one of claims 4-7, wherein said using the trained lightweight GBM prediction model to predict the available signal to evaluate the sleep breathing function of the user, including :
    若所述呼吸波的幅度的下降比例大于第一百分比例,判定为低通气;If the decrease ratio of the amplitude of the respiratory wave is greater than the first percentage, it is judged as hypopnea;
    若所述呼吸波的峰度的下降比例大于第二百分比例,判定为睡眠呼吸暂停。If the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage, it is determined to be sleep apnea.
  9. 一种用于评估睡眠呼吸功能的装置,其特征在于,包括:A device for evaluating sleep apnea function, comprising:
    处理单元,用于确定当前的检测场景,所述当前的检测场景属于预设定的检测场景中的一个,其中,所述预设定的检测场景包括第一检测场景和第二检测场景,所述第一检测场景为所述用户穿戴智能穿戴设备,所述第二检测场景为所述用户未穿戴智能穿戴设备;A processing unit, configured to determine a current detection scene, where the current detection scene belongs to one of preset detection scenes, wherein the preset detection scene includes a first detection scene and a second detection scene, the The first detection scene is that the user is wearing a smart wearable device, and the second detection scene is that the user is not wearing a smart wearable device;
    根据所述当前的检测场景,选择检测方式;Selecting a detection method according to the current detection scenario;
    采用所选择的检测方式,判断所述用户的状态,其中,所述用户的状态包括所述用户处于睡眠状态,或所述用户处于非睡眠状态;Using the selected detection method to determine the state of the user, wherein the state of the user includes that the user is in a sleeping state, or that the user is in a non-sleeping state;
    以及,根据所述用户的状态,开启或关闭对所述用户的睡眠呼吸功能的评估,And, according to the state of the user, enable or disable the evaluation of the sleep breathing function of the user,
    其中,所述睡眠呼吸功能的评估包括对如下一项或多项进行评估:睡眠周期分期、低通气、睡眠呼吸暂停以及鼾症等级风险。Wherein, the evaluation of sleep breathing function includes evaluating one or more of the following: sleep cycle stage, hypopnea, sleep apnea, and risk of snoring grade.
  10. 根据权利要求9所述的装置,其特征在于,所述处理单元,具体用于:The device according to claim 9, wherein the processing unit is specifically used for:
    若所述当前的检测场景为所述第一检测场景,选择第一检测方式,其中,所述第一检 测方式是通过所述智能穿戴设备判断所述用户的状态的;或者,If the current detection scene is the first detection scene, select the first detection method, wherein the first detection method is to judge the state of the user through the smart wearable device; or,
    若所述当前的检测场景为所述第二检测场景,选择第二检测方式,其中,所述第二检测方式是通过所述智能穿戴设备的状态和所述用户的历史睡眠信息,判断所述用户的状态的;If the current detection scene is the second detection scene, select the second detection method, wherein the second detection method is to judge the the user's status;
    其中,所述智能穿戴设备的状态包括如下一项或多项:所述用户的历史睡眠时间段、所述用户预设定的睡眠时间以及所述用户预设定的闹钟时间。Wherein, the state of the smart wearable device includes one or more of the following: the user's historical sleep time period, the user's preset sleep time, and the user's preset alarm clock time.
  11. 根据权利要求9或10所述的装置,其特征在于,所述装置还包括:The device according to claim 9 or 10, wherein the device further comprises:
    通信接口,用于获取所述第一检测场景或所述第二检测场景中的可用信号;a communication interface, configured to acquire available signals in the first detection scene or the second detection scene;
    所述处理单元,还用于根据所述可用信号对所述用户的睡眠呼吸功能进行评估,The processing unit is further configured to evaluate the sleep breathing function of the user according to the available signal,
    其中,所述可用信号包括如下一项或多项:Wherein, the available signals include one or more of the following:
    一个或多个呼吸指标,所述呼吸指标包括呼吸频率和/或呼吸波的下降幅度;one or more respiratory indicators, the respiratory indicators include respiratory rate and/or respiratory wave decline;
    一个或多个鼾声指标,所述鼾声指标包括鼾声响度;以及one or more snore indicators including snore loudness; and
    所述用户的动作指标,所述动作指标包括所述用户的动作幅度和/或大动作的频率。The user's action index, where the action index includes the user's action range and/or frequency of major actions.
  12. 根据权利要求11所述的装置,其特征在于,所述处理单元,具体用于:The device according to claim 11, wherein the processing unit is specifically used for:
    采用训练好的轻型GBM模型对所述可用信号进行预测,以对所述用户的睡眠呼吸功能进行评估。The trained light GBM model is used to predict the available signals, so as to evaluate the sleep breathing function of the user.
  13. 根据权利要求12所述的装置,其特征在于,所述通信接口,还用于:The device according to claim 12, wherein the communication interface is also used for:
    获取所述用户的音频数据和超声数据;Obtain audio data and ultrasound data of the user;
    以及,所述处理单元,还用于:And, the processing unit is also used for:
    对所述音频数据和超声数据进行预处理,并对经过预处理的音频数据和超声数据进行特征提取的处理,获得提取数据,其中,所述特征提取的处理包括对所述经过预处理的音频数据和超声数据进行原始特征的提取以及统计特征的聚合;Preprocessing the audio data and ultrasound data, and performing feature extraction on the preprocessed audio data and ultrasound data to obtain extracted data, wherein the feature extraction process includes processing the preprocessed audio Data and ultrasound data for the extraction of raw features and the aggregation of statistical features;
    使用所述提取数据,对所述轻型GBM预测模型进行训练,获得所述训练好的轻型GBM预测模型。Using the extracted data, train the lightweight GBM prediction model to obtain the trained lightweight GBM prediction model.
  14. 根据权利要求12或13所述的装置,其特征在于,所述处理单元,具体用于:The device according to claim 12 or 13, wherein the processing unit is specifically used for:
    若所述鼾声响度大于或等于第一响度门限,且时长大于或等于第一时长门限,判定所述用户的鼾症等级风险为高风险;If the snoring loudness is greater than or equal to the first loudness threshold, and the duration is greater than or equal to the first duration threshold, it is determined that the user's snoring level risk is high risk;
    若所述鼾声响度大于或等于第一响度门限,且时长小于第一时长门限,判定所述用户的鼾症等级风险为中风险;If the loudness of the snoring sound is greater than or equal to the first loudness threshold and the duration is less than the first duration threshold, it is determined that the user's snoring level risk is medium risk;
    若所述鼾声响度大于或等于第二响度门限,且时长大于或等于第二时长门限,判定所述用户的鼾症等级风险为低风险,其中,所述第二响度门限小于所述第一响度门限,所述第二时长门限小于所述第一时长门限;If the loudness of the snoring sound is greater than or equal to the second loudness threshold and the duration is greater than or equal to the second duration threshold, it is determined that the user's snoring level risk is low risk, wherein the second loudness threshold is smaller than the first loudness threshold a threshold, the second duration threshold is less than the first duration threshold;
    否则,判定所述用户的鼾症等级风险为正常。Otherwise, it is determined that the user's snoring level risk is normal.
  15. 根据权利要求12-14中任一项所述的装置,其特征在于,所述处理单元,具体用于:The device according to any one of claims 12-14, wherein the processing unit is specifically configured to:
    若所述呼吸频率大于第一频率且斜率大于第一数值,判定睡眠分期阶段为快动眼睡眠REM;If the respiratory rate is greater than the first frequency and the slope is greater than the first value, it is determined that the sleep staging stage is REM sleep;
    若所述呼吸频率小于或等于第一频率,且大于或等于第二频率,判定所述睡眠分期阶段为浅睡;If the breathing frequency is less than or equal to the first frequency and greater than or equal to the second frequency, it is determined that the sleep staging stage is light sleep;
    若所述呼吸频率小于或等于第二频率,判定所述睡眠分期阶段为深睡。If the breathing frequency is less than or equal to the second frequency, it is determined that the sleep staging stage is deep sleep.
  16. 根据权利要求12-15中任一项所述的装置,其特征在于,所述处理单元,具体用于:The device according to any one of claims 12-15, wherein the processing unit is specifically configured to:
    若所述呼吸波的幅度的下降比例大于第一百分比例,判定为低通气;If the decrease ratio of the amplitude of the respiratory wave is greater than the first percentage, it is judged as hypopnea;
    若所述呼吸波的峰度的下降比例大于第二百分比例,判定为睡眠呼吸暂停。If the decrease ratio of the kurtosis of the respiratory wave is greater than the second percentage, it is determined to be sleep apnea.
  17. 一种通信装置,其特征在于,包括至少一个处理器,所述至少一个处理器与至少一个存储器耦合,所述至少一个处理器用于执行所述至少一个存储器中存储的计算机程序或指令,以使所述通信装置执行如权利要求1-8中任一项所述的方法。A communication device, characterized in that it includes at least one processor, the at least one processor is coupled to at least one memory, and the at least one processor is configured to execute a computer program or instructions stored in the at least one memory, so that The communication device executes the method according to any one of claims 1-8.
  18. 一种芯片,其特征在于,包括处理器和通信接口,所述通信接口用于接收数据和/或信息,并将接收到的数据和/或信息传输至所述处理器,所述处理器处理所述数据和/或信息,以执行如权利要求1-8中任一项所述的方法。A chip, characterized in that it includes a processor and a communication interface, the communication interface is used to receive data and/or information, and transmit the received data and/or information to the processor, and the processor processes Said data and/or information to perform the method according to any one of claims 1-8.
  19. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机指令,当计算机指令在计算机上运行时,使得如权利要求1-8中任一项所述的方法被实现。A computer-readable storage medium, characterized in that computer instructions are stored in the computer-readable storage medium, and when the computer instructions are run on a computer, the method according to any one of claims 1-8 is executed accomplish.
  20. 一种计算机程序产品,其特征在于,所述计算机程序产品包括计算机程序代码,当所述计算机程序代码在计算机上运行时,使得如权利要求1-8中任一项所述的方法被实现。A computer program product, characterized in that the computer program product includes computer program code, and when the computer program code is run on a computer, the method according to any one of claims 1-8 is implemented.
PCT/CN2022/092419 2021-05-24 2022-05-12 Method and apparatus for evaluating respiratory function during sleep WO2022247649A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110567956.XA CN115381396A (en) 2021-05-24 2021-05-24 Method and apparatus for assessing sleep breathing function
CN202110567956.X 2021-05-24

Publications (1)

Publication Number Publication Date
WO2022247649A1 true WO2022247649A1 (en) 2022-12-01

Family

ID=84114248

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/092419 WO2022247649A1 (en) 2021-05-24 2022-05-12 Method and apparatus for evaluating respiratory function during sleep

Country Status (2)

Country Link
CN (1) CN115381396A (en)
WO (1) WO2022247649A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117077812A (en) * 2023-09-13 2023-11-17 荣耀终端有限公司 Network training method, sleep state evaluation method and related equipment
CN117771508A (en) * 2024-02-26 2024-03-29 深圳智尚未来科技有限公司 Sleep quality intervention method, device and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120071741A1 (en) * 2010-09-21 2012-03-22 Zahra Moussavi Sleep apnea monitoring and diagnosis based on pulse oximetery and tracheal sound signals
CN105592777A (en) * 2013-07-08 2016-05-18 瑞思迈传感器技术有限公司 Method and system for sleep management
CN108852283A (en) * 2017-03-11 2018-11-23 菲特比特公司 Sleep scoring based on physiologic information
CN109528214A (en) * 2018-11-07 2019-03-29 深圳市新元素医疗技术开发有限公司 A kind of Multifunctional wrist BOLD contrast
CN109620158A (en) * 2018-12-28 2019-04-16 惠州Tcl移动通信有限公司 Method, intelligent terminal and the storage device of Sleep-Monitoring
CN109745011A (en) * 2019-02-20 2019-05-14 华为终端有限公司 User's sleep-respiratory risk monitoring and control method, terminal and computer-readable medium
CN110074778A (en) * 2019-05-29 2019-08-02 北京脑陆科技有限公司 A kind of extensive brain electrosleep monitoring system based on EEG equipment
CN111657948A (en) * 2020-05-25 2020-09-15 深圳市云中飞电子有限公司 Method, device and equipment for detecting sleep breathing state

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120071741A1 (en) * 2010-09-21 2012-03-22 Zahra Moussavi Sleep apnea monitoring and diagnosis based on pulse oximetery and tracheal sound signals
CN105592777A (en) * 2013-07-08 2016-05-18 瑞思迈传感器技术有限公司 Method and system for sleep management
CN108852283A (en) * 2017-03-11 2018-11-23 菲特比特公司 Sleep scoring based on physiologic information
CN109528214A (en) * 2018-11-07 2019-03-29 深圳市新元素医疗技术开发有限公司 A kind of Multifunctional wrist BOLD contrast
CN109620158A (en) * 2018-12-28 2019-04-16 惠州Tcl移动通信有限公司 Method, intelligent terminal and the storage device of Sleep-Monitoring
CN109745011A (en) * 2019-02-20 2019-05-14 华为终端有限公司 User's sleep-respiratory risk monitoring and control method, terminal and computer-readable medium
CN110074778A (en) * 2019-05-29 2019-08-02 北京脑陆科技有限公司 A kind of extensive brain electrosleep monitoring system based on EEG equipment
CN111657948A (en) * 2020-05-25 2020-09-15 深圳市云中飞电子有限公司 Method, device and equipment for detecting sleep breathing state

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117077812A (en) * 2023-09-13 2023-11-17 荣耀终端有限公司 Network training method, sleep state evaluation method and related equipment
CN117077812B (en) * 2023-09-13 2024-03-08 荣耀终端有限公司 Network training method, sleep state evaluation method and related equipment
CN117771508A (en) * 2024-02-26 2024-03-29 深圳智尚未来科技有限公司 Sleep quality intervention method, device and system
CN117771508B (en) * 2024-02-26 2024-05-10 深圳智尚未来科技有限公司 Sleep quality intervention method, device and system

Also Published As

Publication number Publication date
CN115381396A (en) 2022-11-25

Similar Documents

Publication Publication Date Title
WO2022247649A1 (en) Method and apparatus for evaluating respiratory function during sleep
US10206573B2 (en) Method of obtaining biometric information in electronic device and electronic device for the same
CN109710080A (en) A kind of screen control and sound control method and electronic equipment
KR20150107565A (en) Electronic apparatus for providing health status information, method for controlling the same, and computer-readable storage medium
CN110448779B (en) Method and device for adjusting biological rhythm
WO2021016931A1 (en) Integrated chip and sensor data processing method
US20160249852A1 (en) Information processing apparatus, information processing method, and program
US20140316216A1 (en) Pet medical checkup device, pet medical checkup method, and non-transitory computer readable recording medium storing program
US20210338103A1 (en) Screening of individuals for a respiratory disease using artificial intelligence
WO2021238460A1 (en) Risk pre-warning method, risk behavior information acquisition method, and electronic device
KR20200104759A (en) System for determining a dangerous situation and managing the safety of the user
KR20200104758A (en) Method and apparatus for determining a dangerous situation and managing the safety of the user
WO2020173152A1 (en) Facial appearance prediction method and electronic device
WO2022184084A1 (en) Skin test method and electronic device
CN114543313A (en) Air conditioner control method, server, air conditioner and user terminal
WO2022105830A1 (en) Sleep evaluation method, electronic device, and storage medium
KR20210060246A (en) The arraprus for obtaining biometiric data and method thereof
CN115719645A (en) Health management method and system and electronic equipment
JP5669302B2 (en) Behavior information collection system
WO2016143415A1 (en) Information processing apparatus, information processing method, and program
WO2021204036A1 (en) Sleep risk monitoring method, electronic device and storage medium
WO2022111704A1 (en) Heart rate measurement method and electronic device
WO2021233259A1 (en) Method for evaluating female emotion and related apparatus, and device
CN115336968A (en) Sleep state detection method and electronic equipment
CN113539487A (en) Data processing method and device and terminal equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22810376

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22810376

Country of ref document: EP

Kind code of ref document: A1