CN112806966B - Non-interference type early warning system for sleep apnea - Google Patents

Non-interference type early warning system for sleep apnea Download PDF

Info

Publication number
CN112806966B
CN112806966B CN202110146421.5A CN202110146421A CN112806966B CN 112806966 B CN112806966 B CN 112806966B CN 202110146421 A CN202110146421 A CN 202110146421A CN 112806966 B CN112806966 B CN 112806966B
Authority
CN
China
Prior art keywords
time
sleep
module
micro
alarm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110146421.5A
Other languages
Chinese (zh)
Other versions
CN112806966A (en
Inventor
辛学刚
汤胜男
陈心莲
杨欣艺
蔡翔
黄盛钊
周伟豪
李沅蓁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN202110146421.5A priority Critical patent/CN112806966B/en
Publication of CN112806966A publication Critical patent/CN112806966A/en
Application granted granted Critical
Publication of CN112806966B publication Critical patent/CN112806966B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4806Sleep evaluation
    • A61B5/4818Sleep apnoea
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1116Determining posture transitions
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0083Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus especially for waking up

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Physiology (AREA)
  • Hematology (AREA)
  • Acoustics & Sound (AREA)
  • Psychology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Anesthesiology (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

The invention discloses a non-interference type early warning system for apnea in sleep, which comprises: the system comprises a control center, an infrared temperature measurement module, a micro-pressure sensing module, an alarm module and a user terminal; the infrared temperature measurement module is used for collecting thermal imaging images, the micro-pressure sensing module is used for collecting pressure data, the alarm module is used for transmitting alarm signals of apnea, and the user terminal is used for displaying real-time pressure data, real-time thermal imaging images and alarm information; the control center receives the thermal imaging image and the pressure data, carries out target tracking on the thermal imaging image flow, classifies and records sleeping postures, and judges whether a breathing interference action occurs or not; judging and analyzing the pressure value detected by the micro-pressure sensing module, judging whether the breath of the user is normal or not according to the pressure change value between two breaths, judging whether the sleep breath is paused or not by combining the breath interference action, and outputting an alarm signal. The invention can realize non-interference measurement and multi-aspect combined monitoring.

Description

Non-interference type early warning system for apnea in sleep
Technical Field
The invention relates to the technical field of sleep monitoring, in particular to a non-interference type apnea early warning system in sleep.
Background
Sleep apnea is a serious sleep disorder that occurs primarily when an individual's breathing is interrupted during sleep. Therefore, it is necessary to monitor and alarm the apnea in sleep.
One common limitation of the prior art is that the sleep condition cannot be monitored without interference, and certain influence is caused on the sleep of people. The existing sleep apnea collecting and analyzing system based on dynamic electrocardiogram and respiratory wave collection adopts a set of wearable analyzing system, a dynamic electrocardiogram recorder is used for synchronously recording dynamic electrocardiogram and respiratory wave, the acquired data are subjected to derivation and image display analysis by utilizing 2 indexes of HRV and respiratory wave, and the method for monitoring the sleep apnea condition during sleep can generate certain influence on the sleep condition of a tested person. The existing monitoring device can also be made into a portable device so as to be used at home, but an external device needs to be worn, which also can affect the sleeping condition of the tested person.
In addition, infrared thermal imaging techniques have been used in some studies to monitor sleep breathing. The basic principle of this method is to capture the temperature fluctuation around the nose and mouth during breathing and determine the breathing condition by analyzing the results of the fluctuation. Meanwhile, some researches advocate that a face capture system is adopted when the infrared thermal imaging technology is used for monitoring the sleep breathing condition; the main limitation of monitoring by using the infrared thermal imaging technology is that if the sleeping posture is changed, the sleeping breathing condition is difficult to output accurately under the condition that the face tracking cannot be performed accurately. If a face recognition system is added, the difficulty in compiling the algorithm is increased for the first time, and point-to-point recognition needs to be carried out; the second monitoring data is richer, for example, if the face recognition system is not added, when the tested person embeds the head into a quilt, the temperature fluctuation is slightly insufficient only by testing.
There is also a wearable ring that can monitor heart rate, blood oxygen saturation level, perfusion index, and amount of movement during sleep, while only monitoring blood flow through the capillaries in the finger. Although sleep monitoring can be performed through data such as capillary flow, the products have the limitation that early warning cannot be timely achieved. The device adopts vibration prompt and can tell the user a complete sleep state report, but in terms of alarm effect, the alarm by using vibration is not enough to solve the early warning problem of sleep apnea, and the alarm cannot be given timely and effectively.
In summary, the prior art generally has some disadvantages, including: the monitoring method is greatly limited in use because of the incapability of achieving complete non-interference monitoring, single monitoring data, incapability of timely and effectively giving an alarm and the like.
Disclosure of Invention
In order to overcome the defects and shortcomings in the prior art, the invention provides a non-interference type sleep apnea early warning system, solves the problem that the sleep of a detected person is affected in the prior art, can monitor the breathing condition of the detected person in the sleep under the completely natural condition, and realizes non-interference measurement and multi-aspect combined monitoring.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention provides a non-interference type apnea early warning system in sleep, comprising: the system comprises a control center, an infrared temperature measurement module, a micro-pressure sensing module, an alarm module and a user terminal;
the infrared temperature measurement module, the micro-pressure sensing module, the alarm module and the user terminal are all connected with the control center;
the system comprises an infrared temperature measurement module, a micro-pressure sensing module, an alarm module and a user terminal, wherein the infrared temperature measurement module is used for collecting thermal imaging images, the micro-pressure sensing module is used for collecting pressure data, the alarm module is used for transmitting alarm signals of apnea, and the user terminal is used for displaying real-time pressure data, real-time thermal imaging images and alarm information;
the control center is used for receiving the thermal imaging image and the pressure data, carrying out target tracking on the thermal imaging image flow, classifying and recording sleeping postures and judging whether breathing interference action occurs or not;
judging and analyzing the pressure value detected by the micro-pressure sensing module, judging whether the breath of the user is normal according to the pressure change value between two breaths, judging whether the sleep breath is suspended or not by combining the breath interference action, and outputting an alarm signal.
According to the preferable technical scheme, the system is further provided with a camera module, the camera module is connected with the control center, and the camera module is used for collecting camera video stream data.
As a preferred technical solution, the pressure sensor is made of a flexible material.
The invention also provides an early warning method of the non-interference type apnea early warning system in sleep, which comprises the following steps:
carrying out target tracking on a thermal imaging image stream acquired by an infrared temperature measurement module, constructing a BP (back propagation) neural network for sleep posture classification training to obtain a sleep posture classifier, classifying and recording sleep postures by the sleep posture classifier, and judging whether the current sleep posture is the same as the sleep posture at the last moment or not;
detecting a face area as an interested area of the infrared temperature measurement module, acquiring an average gray value of the interested area, performing Kalman filtering on the average gray value, and calculating the time of adjacent wave crests of filtered data and taking the time as a breathing cycle;
setting the number n of breathing cycles, and if the number of the continuous n calculated breathing cycles exceeds the set range of the normal breathing cycle, judging that the breathing is abnormal;
judging and analyzing the pressure value detected by the micro-pressure sensing module, and judging that the breath of the user is normal if the pressure change value between two breaths is smaller than a preset value; if the pressure change value between two breaths is a preset value or exceeds the preset value and the next pressure value from the micro-pressure sensor is not received in the normal breathing time interval, recording the current time;
judging whether the sleeping posture of the current time is the same as the sleeping posture of the previous time by the sleeping posture classifier, and if not, judging that a breathing interference action occurs; if no breathing interference action occurs, the sleep apnea is judged, and an alarm signal is output.
As a preferred technical scheme, the sleeping posture classifier classifies and records sleeping postures, and the method specifically comprises the following steps:
let the set of user's sleep postures be C={C 1 ,C 2 ,C 3 Establishing a corresponding data set, wherein the data set comprises (1) supine lying, left lying and right lying;
the BP neural network is trained by adopting the corresponding data set to obtain a sleeping posture classifier;
the sleeping posture classifier outputs a judgment result, when the sleeping posture at the current time is different from the sleeping posture at the previous time, the time t when the sleeping posture changes is stored, and finally the ordered vector S of the sleeping posture change time in the sleeping process is obtained all =[t 1 ,t 2 ,… N ]。
As a preferred technical solution, the obtaining of the average gray value of the region of interest specifically includes:
Figure GDA0003629726390000041
where rm, rn are the width and height of the region of interest, respectively, and k represents an arbitrary time instant.
As a preferred technical scheme, kalman filtering is performed on the average gray value, and a specific calculation formula is as follows:
z k =AS kk
Figure GDA0003629726390000042
P k|k-1 =AP k-1|k-1 A T +Q
K k =P k|k-1 A T (AP k|k-1 A T +R) -1
Figure GDA0003629726390000043
P k|k =(I-K k A)P k|k-1
where A represents the measurement state transition matrix, upsilon k N (0, R) represents the observed noise satisfying the Gaussian distributionR represents the measurement noise covariance, z k Represents the observed value at time k and,
Figure GDA0003629726390000044
representing the a priori state estimates at time k,
Figure GDA0003629726390000045
respectively representing the posterior state estimated values of k-1 and k time; p is k|k-1 Representing the prior estimated covariance, P, of time k k-1|k-1 、P k|k Respectively representing the posterior state estimation covariance of k-1 and k time; q represents a process noise covariance matrix; k k Representing the kalman gain.
As a preferred technical solution, the calculating time of adjacent peaks of the filtered data and using the time as a breathing cycle includes:
at the k-th moment, if satisfied
Figure GDA0003629726390000051
And is provided with
Figure GDA0003629726390000052
Then the k time
Figure GDA0003629726390000053
Let it be C for the first peak point l =k;
The time difference between two adjacent peaks is the respiratory cycle calculated from the peak point of the first wave, i.e. T l =C l -C l-1
Normal breathing cycle range is set to [ T ] low ,T high ]。
As a preferred technical solution, the output alarm signal specifically adopts any one or more of the following alarm modes:
the method comprises the steps of waking up a user by vibration, notifying family members of the user by a bound mobile phone and notifying a rescue unit at the place by a network.
Compared with the prior art, the invention has the following advantages and beneficial effects:
(1) according to the invention, data acquisition is carried out through the infrared temperature measurement module and the micro-pressure sensing module, the infrared temperature measurement module acquires data in a mode of not directly contacting with a human body, and noise and light which influence sleep are not generated; and the micro-pressure sensing module collects data by embedding the micro-pressure sensing module in the mattress, if the micro-pressure sensing module is in a normal sleep condition, the vibration awakening mode can not be started, the problem that the sleep of a detected person is influenced in the prior art is solved, the breathing condition of the detected person in the sleep can be monitored under the completely natural condition, and interference-free measurement and multi-aspect combined monitoring are realized.
(2) The invention can immediately send out an alarm when the time for stopping breathing reaches the dangerous time (the brain can be irreversibly damaged in 4-6 minutes), thereby achieving the effect of timely alarming.
Drawings
FIG. 1 is a schematic structural framework diagram of a non-intrusive sleep apnea warning system in accordance with the present invention;
FIG. 2 is a schematic flow chart of a non-intrusive sleep apnea warning method according to the present invention;
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Examples
As shown in fig. 1, the present embodiment provides a non-interference apnea warning system in sleep, including: the device comprises a control center, a camera module, an infrared temperature measurement module, a micro-pressure sensing module and an alarm module.
In this embodiment, the control center is responsible for processing and analyzing all data monitored in the system, if the analysis result is normal, the data will not be used, and if the analysis result is abnormal, even after apnea occurs during sleep, the data is delivered to the alarm module to alarm in time.
Wherein the monitored data comprises: the system comprises camera shooting video stream data captured by a camera shooting module, a thermal imaging image obtained by an infrared temperature measurement module and pressure sensing data.
In this embodiment, the camera module is used for capturing the camera video stream data, and the camera module may not be used in the process of determining the sleep breathing, and the RGB diagram and the camera video stream data are not used, and the addition is to enrich the functions of the whole system.
The processing mode of the control center also comprises the step of transmitting the analysis data to the user terminal, and the user terminal can directly display real-time monitoring videos, real-time infrared imaging and related analysis information.
In this embodiment, the infrared temperature measurement module covers the bed and the area 0.5m nearby, and two sides of the bed head are respectively provided with one infrared temperature measurement module, so that the accurate temperature change can be obtained under the condition of sleeping on one side, and meanwhile, the infrared temperature measurement module is far away from the window, the air conditioner and other irrelevant factors influencing the temperature change.
As shown in fig. 2, the present embodiment provides a non-interference type method for early warning of apnea during sleep, which performs target tracking on a thermal imaging video stream obtained by an infrared temperature measurement module, classifies user behaviors, and analyzes a current sleeping posture of a user.
The sleeping posture analysis is carried out according to the following steps:
(1) defining a set of sleep postures of a user as C ═ C 1 ,C 2 ,C 3 Establishing a corresponding data set, wherein the data set is { supine, lying on the left side, lying on the right side };
(2) constructing a BP neural network for sleeping posture classification, and training by using the data set to obtain a sleeping posture classifier;
(3) using the classifier in (2) for real-time video analysis, a time-varying classifier result Ψ (t) ∈ C can be obtained, if Ψ (t) ═ Ψ (t) ∈ C - ) The sleeping posture is not changed at the time t, if psi (t) ≠ psi (t) - ) The sleeping position changes at the moment t, psi (t) - ) Storing the time of occurrence of the change of the sleeping posture into S as the result of the classifier at the previous time all Finally, the ordered vector S of the sleeping posture change moment in the sleeping process of the user can be obtained all =[t 1 ,t 2 ,…t N ];
(4) If t is present k ∈S all K > m satisfies t k -t k-m If the number of the positive changes is less than tau, m is a set normal number, tau is a set time parameter, the change of the sleeping posture can be regarded as the drastic change of the sleeping posture, and finally the total times of the drastic change of the sleeping posture can be counted as K;
in this embodiment, the face detection adopts a relatively mature algorithm, such as a V & J algorithm, which mainly uses haar features and an Adaboost classifier.
In this embodiment, the detected face region is used as the ROI (region of interest) of the infrared thermometry module, and H ∈ R rm *rn Wherein rm and rn are the width and height of the ROI respectively, and the period of estimating the nose temperature change can be converted into the period of estimating the change of the gray value of the infrared image because the temperature in the infrared image obtained by the infrared temperature measurement module can influence the gray value in the H image; since the video recording frame rate is usually 30fps, one frame is taken out every 3 frames, and the following strategies are adopted:
a. when k is obtained, the average gray scale value of the ROI is:
Figure GDA0003629726390000081
b. calculating the period of the change of the average gray value of the ROI area, wherein the change of the average gray value is the physiological activity of a similar period under the normal condition, so that the change of the average gray value is the similar period change corresponding to the change of the average gray value, and the period of respiration can be estimated by solving two peaks (or valleys) of the average gray value;
c. however, due to the noise existing in the environment and the like, in order to obtain small peaks and troughs caused by respiration rather than noise or other reasons, kalman filtering is introduced to reprocess the obtained average gray value:
z k =AS kk (1)
Figure GDA0003629726390000082
P k|k-1 =AP k-1|k-1 A T +Q (3)
K k =P k|k-1 A T (AP k|k-1 A T +R) -1 (4)
Figure GDA0003629726390000083
P k|k =(I-K k A)P k|k-1 (6)
where A is the measured state transition matrix, upsilon k N (0, R) is the observed noise satisfying the Gaussian distribution, R is the measured noise covariance, which can generally be observed, and is a known condition of the filter; z is a radical of formula k Is the observed value at time k;
Figure GDA0003629726390000084
is an estimate of the a priori state at time k,
Figure GDA0003629726390000085
posterior state estimates at k-1 and k times, respectively; p is k|k-1 Is the prior estimated covariance of time k, P k-1|k-1 、P k|k Estimating covariance for posterior state at k-1 and k time respectively; q is a process noise covariance matrix; k k Is the Kalman gain;
for a set of data obtained in succession, the peaks are obtained according to the following strategy:
if at the kth time, it is satisfied
Figure GDA0003629726390000086
And is provided with
Figure GDA0003629726390000087
Then the k time
Figure GDA0003629726390000088
Let it be C for the first peak point l =k;
The time difference between two adjacent wave peaks is the respiratory cycle calculated by the first wave peak point, namely T l =C l -C l-1
Setting Normal respiratory cycle Range [ T low ,T high ]And judging the abnormal breathing condition:
and if the continuous n calculated breathing cycles are not in the range, judging that the breathing is abnormal. The value of n influences the judgment accuracy, if n is too small, misjudgment is easy to occur, and if n is too large, the judgment time is delayed, and in severe cases, the treatment time may be missed.
In the embodiment, in the aspect of the micro-pressure sensing module, if the pressure variation value between two breaths is smaller than a preset value, it is determined that the user breathes normally, and the breath data is continuously monitored and analyzed; when the pressure change value between two breaths is a preset value or exceeds the preset value and the next pressure value from the micro-pressure sensor is not received in the normal breathing time interval, recording the current time t, combining the combined analysis of the infrared temperature measurement sleeping posture classifier, and if the result psi (t) ≠ psi (t) of the sleeping posture classifier is obtained - ) Namely, if the user has the actions of turning over and the like, the breathing interference action is judged, and the monitoring analysis is continuously carried out on the breathing data; if the imaging module does not display that the user has respiratory disturbance action, the sleep apnea of the user is judged. No matter what kind of sleeping posture a person takes during sleeping, the person can recognize and recognize the heat changed by breathing.
In this embodiment, the alarm mode in the emergency situation is: the method comprises the following steps of waking a user by vibration, notifying family members of the user by a bound mobile phone, notifying rescue units such as a hospital where the user is located by a network and timely performing first aid on the user, wherein any one or more of the alarm modes are adopted;
in the invention, a mode of monitoring by combining remote monitoring, infrared imaging and micro-pressure sensing is adopted, so that a measured person can have a plurality of variables monitored in one-time monitoring, thereby realizing the safe, effective and non-interference monitoring of the breathing condition in the sleeping process.
The invention also adopts a micro-pressure sensor for monitoring to prevent the following phenomena: when sleeping, the quilt covers the head to influence the recognition function of the camera. The operation and monitoring system of the invention is not in contact with the testee, and the pressure sensor is made of flexible material, so that the testee is in a natural sleep state, and the monitoring result is more accurate.
The above embodiments are preferred embodiments of the present invention, but the present invention is not limited to the above embodiments, and any other changes, modifications, substitutions, combinations, and simplifications which do not depart from the spirit and principle of the present invention should be construed as equivalents thereof, and all such changes, modifications, substitutions, combinations, and simplifications are intended to be included in the scope of the present invention.

Claims (7)

1. A non-interfering early warning system for apnea in sleep, comprising: the system comprises a control center, an infrared temperature measurement module, a micro-pressure sensing module, an alarm module and a user terminal;
the infrared temperature measuring module, the micro-pressure sensing module, the alarm module and the user terminal are all connected with the control center;
the system comprises an infrared temperature measurement module, a micro-pressure sensing module, an alarm module and a user terminal, wherein the infrared temperature measurement module is used for collecting thermal imaging images, the micro-pressure sensing module is used for collecting pressure data, the alarm module is used for transmitting alarm signals of apnea, and the user terminal is used for displaying real-time pressure data, real-time thermal imaging images and alarm information;
the control center is used for receiving the thermal imaging image and the pressure data, carrying out target tracking on the thermal imaging image flow, classifying and recording sleeping postures and judging whether breathing interference action occurs or not;
carrying out target tracking on the thermal imaging image stream, constructing a BP neural network for sleep posture classification training, and obtaining a sleep posture classifier, wherein the sleep posture classifier classifies and records the sleep posture;
the sleeping posture classifier judges whether the sleeping posture at the current time is the same as the sleeping posture at the previous time, and if not, the breathing interference action is judged to occur; if no breathing interference action occurs, judging sleep apnea and outputting an alarm signal;
performing target tracking on the thermal imaging image stream, taking a detected face area as an interested area of an infrared temperature measurement module, acquiring an average gray value of the interested area, performing Kalman filtering on the average gray value, and calculating the time of adjacent wave crests of filtered data and taking the time as a breathing cycle; setting the number n of breathing cycles, and if the number n of the calculated breathing cycles exceeds the set normal breathing cycle range, determining that the breathing is abnormal;
performing Kalman filtering on the average gray value, wherein a specific calculation formula is as follows:
z k =AS kk
Figure FDA0003629726380000011
P k|k-1 =AP k-1|k-1 A T +Q
K k =P k|k-1 A T (AP k|k-1 A T +R) -1
Figure FDA0003629726380000021
P k|k =(I-K k A)P k|k-1
where A represents the measurement state transition matrix, upsilon k N (0, R) represents the observed noise satisfying the Gaussian distribution, R represents the measurement noise covariance, z k Represents the observed value at time k and,
Figure FDA0003629726380000022
representing the a priori state estimates at time k,
Figure FDA0003629726380000023
respectively representing posterior state estimated values at k-1 and k moments; p is k|k-1 Represents the prior estimated covariance, P, of the time instant k k-1|k-1 、P k|k Respectively representing the posterior state estimation covariance of k-1 and k time; q represents a process noise covariance matrix; k is k Represents the Kalman gain, S k Representing the mean gray value of the region of interest;
judging and analyzing the pressure value detected by the micro-pressure sensing module, judging whether the breath of the user is normal according to the pressure change value between two breaths, judging whether the sleep breath is suspended or not by combining the breath interference action, and outputting an alarm signal.
2. The non-interfering early warning system for sleep apnea, according to claim 1, further comprising a camera module, wherein the camera module is connected to the control center, and the camera module is used for collecting camera video stream data.
3. The non-intrusive sleep apnea warning system as recited in claim 1, wherein said micro-pressure sensor of said micro-pressure sensing module is made of a flexible material.
4. The system of claim 1, wherein the sleep posture classifier classifies and records sleep postures, and the method comprises the following steps:
let C ═ C be the set of sleep postures of the user 1 ,C 2 ,C 3 Establishing a corresponding data set, wherein the data set is { supine, lying on the left side, lying on the right side };
the BP neural network is trained by adopting the corresponding data set to obtain a sleeping posture classifier;
the sleeping posture classifier outputs a judgment result, when the sleeping posture at the current time is different from the sleeping posture at the previous time, the time t when the sleeping posture changes is stored, and finally the ordered vector S of the sleeping posture change time in the sleeping process is obtained all =[t 1 ,t 2 ,…t N ]。
5. The system of claim 1, wherein the average gray-scale value of the region of interest is obtained according to the following formula:
Figure FDA0003629726380000031
where rm, rn are the width and height of the region of interest, respectively, and k represents an arbitrary time instant.
6. The non-interfering sleep apnea warning system of claim 1, wherein said calculating the time of adjacent peaks of filtered data and taking said peaks as a breathing cycle, and said peak obtaining step comprises:
at the k-th moment, if satisfied
Figure FDA0003629726380000032
And is
Figure FDA0003629726380000033
Then the k time
Figure FDA0003629726380000034
Let it be C for the first peak point l =k;
The time difference between two adjacent wave peaks is the respiratory cycle calculated by the first wave peak point, namely T l =C l -C l-1
Normal breathing cycle range is set to [ T ] low ,T high ]。
7. The non-interfering apnea warning system of claim 1, wherein said output alarm signal is one or more of the following:
the method comprises the steps of waking up a user by vibration, notifying family members of the user by a bound mobile phone and notifying a rescue unit at the place by a network.
CN202110146421.5A 2021-02-03 2021-02-03 Non-interference type early warning system for sleep apnea Active CN112806966B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110146421.5A CN112806966B (en) 2021-02-03 2021-02-03 Non-interference type early warning system for sleep apnea

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110146421.5A CN112806966B (en) 2021-02-03 2021-02-03 Non-interference type early warning system for sleep apnea

Publications (2)

Publication Number Publication Date
CN112806966A CN112806966A (en) 2021-05-18
CN112806966B true CN112806966B (en) 2022-07-26

Family

ID=75860814

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110146421.5A Active CN112806966B (en) 2021-02-03 2021-02-03 Non-interference type early warning system for sleep apnea

Country Status (1)

Country Link
CN (1) CN112806966B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113273967A (en) * 2021-05-20 2021-08-20 贵州优品睡眠健康产业有限公司 Sleep sign monitoring system
CN114190916B (en) * 2021-12-07 2023-05-23 河南省儿童医院郑州儿童医院 Fabric sensor-based child respiration monitoring method and system
CN113877033B (en) * 2021-12-09 2022-02-18 南京舒普思达医疗设备有限公司 Breathing machine regulation and control method and system based on sleep characteristics
CN114909790B (en) * 2022-03-28 2024-04-12 青岛海尔空调器有限总公司 Control method, device and equipment of air conditioner and storage medium
PL441747A1 (en) * 2022-07-15 2024-01-22 Healthnomic Spółka Akcyjna System and method for diagnosing obstructive sleep apnoea

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110010014A1 (en) * 2008-02-25 2011-01-13 Kingsdown, Inc. Systems and methods for controlling a bedroom environment and for providing sleep data
CN202648699U (en) * 2012-04-20 2013-01-02 北京西润电子设备有限公司 Multifunctional home monitoring and nursing network system
CN102973244A (en) * 2012-11-16 2013-03-20 西南石油大学 Non-contact type sleep apnea monitoring method based on infrared thermography technology and device
CN102973273A (en) * 2012-11-29 2013-03-20 中国人民解放军第四军医大学 Sleep respiratory function monitoring system based on infrared radiation detection
CN104834946A (en) * 2015-04-09 2015-08-12 清华大学 Method and system for non-contact sleep monitoring
CN105231995A (en) * 2015-09-29 2016-01-13 无锡市润华碳晶地暖设备有限公司 Sleep system
CN108309286A (en) * 2017-12-15 2018-07-24 中国人民解放军第二军医大学第二附属医院 Sleep disturbance detects treatment system
CN109310348A (en) * 2016-05-19 2019-02-05 汉考克医药公司 Posture obstructive sleep apnea detection system
CN110313897A (en) * 2019-07-04 2019-10-11 合肥赛为智能有限公司 Sleep monitoring device and its monitoring method based on silica gel air bag

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104504852A (en) * 2014-10-24 2015-04-08 天津科技大学 Image-based forewarning infant safety monitor and infant safety judging method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110010014A1 (en) * 2008-02-25 2011-01-13 Kingsdown, Inc. Systems and methods for controlling a bedroom environment and for providing sleep data
CN202648699U (en) * 2012-04-20 2013-01-02 北京西润电子设备有限公司 Multifunctional home monitoring and nursing network system
CN102973244A (en) * 2012-11-16 2013-03-20 西南石油大学 Non-contact type sleep apnea monitoring method based on infrared thermography technology and device
CN102973273A (en) * 2012-11-29 2013-03-20 中国人民解放军第四军医大学 Sleep respiratory function monitoring system based on infrared radiation detection
CN104834946A (en) * 2015-04-09 2015-08-12 清华大学 Method and system for non-contact sleep monitoring
CN105231995A (en) * 2015-09-29 2016-01-13 无锡市润华碳晶地暖设备有限公司 Sleep system
CN109310348A (en) * 2016-05-19 2019-02-05 汉考克医药公司 Posture obstructive sleep apnea detection system
CN108309286A (en) * 2017-12-15 2018-07-24 中国人民解放军第二军医大学第二附属医院 Sleep disturbance detects treatment system
CN110313897A (en) * 2019-07-04 2019-10-11 合肥赛为智能有限公司 Sleep monitoring device and its monitoring method based on silica gel air bag

Also Published As

Publication number Publication date
CN112806966A (en) 2021-05-18

Similar Documents

Publication Publication Date Title
CN112806966B (en) Non-interference type early warning system for sleep apnea
US12016655B2 (en) Video-based patient monitoring systems and associated methods for detecting and monitoring breathing
US8790269B2 (en) Monitoring respiration with a thermal imaging system
CN106413533B (en) Apparatus, system and method for detecting apnea of a subject
KR102054213B1 (en) Respiratory measurement system using thermovision camera
CN108272448B (en) Non-contact type infant physiological parameter day and night monitoring method
Liao et al. Video-based activity and movement pattern analysis in overnight sleep studies
CA2787170A1 (en) Multivariate residual-based health index for human health monitoring
CN104083160A (en) Sleep state monitoring method and device based on machine vision
US20140155774A1 (en) Non-invasively determining respiration rate using pressure sensors
CN109567756A (en) A kind of sleep state detection method based on artificial intelligence mattress
Massaroni et al. Comparison of two methods for estimating respiratory waveforms from videos without contact
CN111248890A (en) Non-contact newborn heart rate monitoring method and system based on facial video
CN111544001A (en) Non-contact apnea detection device and method
Wiede et al. Remote respiration rate determination in video data-vital parameter extraction based on optical flow and principal component analysis
Martinez et al. Breathing rate monitoring during sleep from a depth camera under real-life conditions
CN110811547A (en) Multi-guide sleep monitor and sleep monitoring method
CN114469004A (en) Human sleep health monitoring method based on fiber bragg grating sensor
KR101796871B1 (en) Apparatus for diagnosing sleep apnea using video and respiration sound
CN115100159A (en) Breathing state detection method, device, equipment and storage medium
Carter et al. Deep learning-enabled sleep staging from vital signs and activity measured using a near-infrared video camera
Lorato et al. Camera-based on-line short cessation of breathing detection
CN115607123A (en) Cardiopulmonary function monitoring and respirator closed-loop control integrated device
TWI766471B (en) System capable of detecting sleep breathing intensity based on wavelet transformation and spectral intensity
Hanawa et al. Nasal cavity detection in facial thermal image for non-contact measurement of breathing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Xin Xuegang

Inventor after: Tang Shengnan

Inventor after: Chen Xinlian

Inventor after: Yang Xinyi

Inventor after: Cai Xiang

Inventor after: Huang Shengzhao

Inventor after: Zhou Weihao

Inventor after: Li Yuanqin

Inventor before: Tang Shengnan

Inventor before: Xin Xuegang

Inventor before: Chen Xinlian

Inventor before: Yang Xinyi

Inventor before: Cai Xiang

Inventor before: Huang Shengzhao

Inventor before: Zhou Weihao

Inventor before: Li Yuanqin

GR01 Patent grant
GR01 Patent grant