KR101647431B1 - A real-time sleep monitoring system using a smartphone - Google Patents

Abstract

The present invention relates to a real-time sleep monitoring system using a smart phone capable of monitoring the sleep state of a person who sleeps.
A feature of the present invention is that it includes a motion detection sensor 200 for detecting the movement and direction of a smartphone 100 carried by a person who is sleeping and an audio sensor A motion management unit 510 for managing a motion sensed by the motion sensing sensor 200 and an audio management unit 520 for managing an audio signal transmitted through the audio sensor 300, And a sleep monitoring application 500 that monitors the sleep state of the sleeping person using the motion managed by the sleep mode monitoring unit 510 and the audio signal managed by the audio managing unit 520.

Description

TECHNICAL FIELD [0001] The present invention relates to a real-time sleep monitoring system using a smart phone,

The present invention relates to a real-time sleep monitoring system using a smart phone capable of monitoring the sleep state of a person who sleeps.

In general, sleep apnea refers to the temporary interruption of respiration during sleep, and can be classified as pathophysiologic obstructive apnea, central apnea, or mixed apnea. Of these, the most frequently occurring is obstructive sleep apnea, in which breathing decreases or stops for a certain period of time due to stenosis or obstruction of the upper limb. Such sleep apnea is repeatedly clogged during sleep, oxygen saturation falls and snoring is accompanied by sleep interruption and daytime sleepiness.

Sleep disconnection and excessive daytime sleepiness can cause cognitive impairment, such as memory impairment, judgmental impairment, concentration impairment, loss of libido, erectile dysfunction, and cardiovascular complications such as hypertension, arrhythmia, and ischemic symptoms. Mortality is also reported to increase, and excessive daytime sleepiness can increase the risk of accidents and trauma.

The criteria for the diagnosis and treatment of sleep apnea can be divided into history, physical examination, and special examination.

Of these, only 60% of the patients have a sensitivity of 60% and specificity of 63% is insufficient to evaluate sleep apnea. Therefore, the special condition test, especially the sleep polyp test, is performed to diagnose the sleep state and sleep apnea of the patient.

However, the sleep polyvalence test is a good diagnostic method for the total examination of sleeping disorders, but it is expensive, troublesome, and requires skilled manpower and effort.

Therefore, it is required to develop a device capable of monitoring the continuous heartbeat and respiration of a sleeping person in order to prevent death due to sudden death or cardiac arrest during sleep.

The background art of the present invention is disclosed in Korean Patent Registration No. 10-1096089 (Dec. 23, 2011) filed and filed with the Korean Intellectual Property Office.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a real-time sleep monitoring system using a smart phone capable of monitoring the sleep state of a person who sleeps.

Another object of the present invention is to provide a real-time sleep monitoring system using a smart phone capable of systematically managing an electrocardiogram and an audio signal inputted through a smart phone operated by a movement of a smartphone carried by a sleeping person, .

Another object of the present invention is to provide a real time sleep monitoring system using a smart phone capable of continuously monitoring heart rate and respiration to prevent death due to sudden death or cardiac arrest during sleep.

The real-time sleep monitoring system using a smartphone according to an embodiment of the present invention may include a motion detection sensor 200 for detecting a movement and direction of a smartphone 100 carried by a sleeping person, An audio sensor 300 for providing a signal to the smartphone 100, a motion management unit 510 for managing motion sensed by the motion sensing sensor 200, And a sleep monitoring application 500 that includes an audio management unit 520 and monitors the sleep state of the person using the motion managed by the motion management unit 510 and the audio signal managed by the audio management unit 520 .

The present invention is advantageous in that a person who is sleeping can monitor his / her sleeping state so that his / her sleeping state can be confirmed and apnea and stroke can be confirmed.

In addition, there is an advantage that the sleeping person operates with the movement of a smartphone carried by him / herself and systematically manages the electrocardiogram and the audio signal input through the smart phone.

In addition, it can continuously monitor heart rate and respiration, so there is an advantage of preventing sudden death during sleep and death due to cardiac arrest.

FIG. 1 shows a schematic diagram of a real-time sleep monitoring system using a smartphone according to an embodiment of the present invention.
2 is a block diagram schematically illustrating the configuration of a sleep monitoring application according to the present invention.
3 is a photograph showing a state in which a smartphone according to the present invention is worn by a person who sleeps on the body.
4 shows a loading screen and a main screen of a sleeping monitoring application through the smartphone of the present invention.
FIG. 5 shows a process for setting a delay time through the sleep monitoring application of the present invention.
6 is a photograph showing a state in which a sleeping person is fixed to a face of a microphone according to the present invention.
FIG. 7 is a graph showing signals transmitted from a motion sensing sensor, an audio sensor, and an electrocardiogram measuring apparatus through a sleep monitoring application of the present invention.
Figure 8 shows a process for identifying obstructive sleep apnea using the sleep monitoring application of the present invention.
FIG. 9 shows a process for confirming signs of stroke through the sleep monitoring application of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 and 2, a real-time sleep monitoring system using a smartphone according to an embodiment of the present invention includes a motion detection sensor 200, an audio sensor 300, a sleep monitoring application 500, .

First, the smartphone 100 can display a specific screen or a graph of an electrocardiogram according to the operation state of the sleeping monitoring application 500 through a display, can incorporate a motion detection sensor 200, And a Bluetooth module that is connected to the electrocardiogram measuring device 400 through a wired or wireless connection.

The motion detection sensor 200 may be configured as an acceleration sensor that detects the movement and direction of the smartphone 100 carried by the sleeping person. The acceleration sensor may be embedded in the smartphone 100 to sense the movement and direction of the smartphone 100 and provide it to the sleep monitoring application 500.

Here, the sleeping person can sleep while carrying the smartphone 100 in which the motion detection sensor 200 is built. That is, the sleeping person can put the smartphone 100 in a pocket or attach it to the body using a band and sleep in a fixed state.

The audio sensor 300 may include a microphone for receiving the sound of the person who is sleeping and providing an audio signal to the smartphone 100. The audio sensor 300 may be fixed close to the nose of the user to receive the breath sounds and provide the breath to the smartphone 100.

In addition, the audio sensor 300 can receive a breath sound in a state in which it is spaced apart from a sleeping person by being put on a throat or the like so as not to interfere with sleeping of a sleeping person.

Here, the sleeping person can sleep while fixing the audio sensor 300 by using an adhesive tape or a rubber band while bringing the audio sensor 300 close to his / her nose.

The sleep monitoring application 500 is installed in the smartphone 100 so as to recognize the sleeping state of the sleeping person inputted from the outside,

The sleep monitoring application 500 includes a motion management unit 510 for managing a motion sensed by the motion sensing sensor 200 and an audio management unit 520 for managing an audio signal transmitted through the audio sensor 300. The sleep monitoring application 500 can monitor the sleep state of the sleeping person using the motion managed by the motion managing unit 510 and the audio signal managed by the audio managing unit 520. [

The motion managing unit 510 includes a sleeping position measuring unit 511 for recognizing the sensing of the motion sensing sensor 200 and measuring the movement and direction of the smartphone 100 to measure various sleeping positions of the sleeping person. The sleeping posture measuring unit 511 can measure the posture of the sleeping person carrying the smartphone 100 using two pieces of data (movement and movement direction) transmitted from the motion detecting sensor 200. [

More specifically, a low-pass filter (LPF) should be applied to the data to buffer changes in the data value. When a low pass filter is used, it is calculated by the following equations (1) and (2) for the alpha value used for extracting the result data.

[Equation 1]

alpha = t / (t + dT)

In Equation (1)

t: Time constant of low-pass filter; Time constant is the time it takes the sensor to recognize 63% of the acceleration

dT: Event transfer rate or event transfer rate

We obtain the gravity data using low pass filter using alpha value.

&Quot; (2) "

Gravity data = alpha * immediate gravity + (1 - alpha) * low data

In Equation (2), acceleration is calculated by subtracting gravity data from raw data.

Acceleration = Low data - Gravity data

As described above, the sleeping posture measuring unit 511 can measure whether the posture of the sleeping person who is carrying the smartphone 100 and sleeps is in a lying state, a lying position, or a lying position.

Then, the sleep monitoring application 500 can calculate the actggly using the following equation (3) as the calculated acceleration.

&Quot; (3) "

magnitude =

The calculated actigraph may be recorded in a dat file, and the recorded actigraph may be output to the display of the smartphone 100. [

And a sleeping position check unit 512 for checking and recording various sleeping positions of the sleeping person measured by the sleeping position measuring unit 511. [

The posture checker 512 can check the posture of the sleeping person who has taken a certain number of times through the screen of the smartphone 100.

Accordingly, the sleeping person can confirm through his / her smartphone 100 how many times he or she is sleeping after going to sleep.

The movement management unit 510 includes a posture time counting unit 513 for counting the time when the posture of the sleeping person is a lying posture or a lying posture in the sleeping posture measurement unit 511, And a sleeping position warning unit 514 for comparing the counting time with a preset reference time to warn when the counting time is longer than a reference time. Here, the reference time may be set to about 20 to 30 minutes.

The audio management unit 520 includes an audio size recognition unit 521 for recognizing the size of an audio signal transmitted from the audio sensor 300 and a control unit 521 for controlling the size of the audio signal recognized by the audio size recognition unit 521, And an audio abnormality determination unit 522 for determining that the audio signal is abnormal if the size of the audio signal is larger than the reference signal size.

Here, the audio management unit 520 records the transmitted audio signal at 8 kHz using 16-bit pulse code modulation. In order to remove the fundamental noise due to the ambient noise, the value between 50 and -50 is removed. The audio data is also recorded as a dat file and a wav file.

The audio size recognizing unit 521 can recognize the magnitude of the amplitude in the audio signal.

The audio abnormality determination unit 522 may calculate an average of the sizes of the audio signals recognized from the beginning through the audio size recognition unit 521 for a predetermined time and set the reference signal size.

Accordingly, if the audio abnormality determination unit 522 determines that the abnormality is abnormal, it can be determined that the sleeping person sleeps while snoring.

The audio management unit 520 includes a transmission period check unit 523 for checking the transmission period of the audio signal transmitted from the audio sensor 300, a transmission period checking unit 523, And an apnea check unit 525 for checking the apnea if the apnea is determined to be apnea by the apnea determination unit 524. The apnea detection unit 524 determines that the apnea is apnea if the transmission period is longer than the reference period.

Here, the reference period is preferably set to 10 seconds.

Accordingly, the respective transmission periods checked in the transmission period check unit 523 are compared with the reference period through the apnea determining unit 524, and are checked in the apnea check unit 525 when it is determined to be apnea. That is, the number of times of being checked for apnea can be outputted through the display of the smartphone 100, so that the number of apneas during sleep can be confirmed.

The audio management unit 520 further includes an apnea alarm unit 526 that alerts the user if the number of apnea times checked in the apnea check unit 525 is equal to or greater than a preset reference number. The apnea alarm unit 526 activates a lamp provided in the smartphone 100 to warn the user of the light or activate the speaker of the smartphone 100 to warn the user of the sleeping person or the surrounding person. Therefore, the sleeping person can recognize the sleeping disorder due to oxygen deficiency due to apnea.

As described above, according to the present invention configured as described above, the sleeping person can check his / her sleeping posture so as to try to calibrate the sleeping posture, and can also confirm his / her apnea status, so that he / she can take care of it.

Therefore, the sleeping person can check his or her sleeping state that occurs during sleeping day by day and systematically manage it.

In addition, the present invention further includes an electrocardiogram measuring device (400) for measuring an activity current and an activity difference according to a contraction of a heart in a body of a sleeping person and transmitting the electrocardiogram to the smartphone (100).

The electrocardiogram measuring apparatus 400 includes an electrocardiogram pad 410 attached to the body of the person to sense an activity current and an action potential difference caused by a contraction of the heart and an ECG switch 410 for sensing ECG sensed by the ECG pad 410. [ And an ECG Bluetooth module 430 for transmitting the converted data from the electrocardiogram converting unit 420 to the smartphone 100 wirelessly.

The sleep monitoring application 500 may further include an electrocardiogram monitoring unit 530 for monitoring the electrocardiogram measured by the electrocardiogram measuring apparatus 400 and a heart rate monitor And an arrhythmia symptom judgment unit 531 for judging an abnormality of the rate of change and judging an arrhythmia.

Here, the arrhythmia symptom determination unit 531 determines an arrhythmia causing the invention of the stroke using the square root of the mean square differences of successive NN intervals (RMSSD) of the heart rate variability time series analysis based on the electrocardiographic cycle, You can judge the signs.

That is, a time series analysis (RMSSD) is obtained through an equation using the electrocardiogram cycle, and a stroke is judged to be RMSSD> 0.05.

 Equation (4) for determining a stroke symptom is as follows.

&Quot; (4) "

NN intervals = rrmedian / sampling rate

As shown in Equation (4), it is possible to determine the symptom of stroke by measuring the electrocardiogram of the sleeping person, so that it is possible to improve the quality of the sleeping state by taking care of the stroke, and manage the health carelessly.

Also, by using Shannon Entropy, it is possible to judge the arrhythmia by judging the abnormality of the heart rate variability caused by the instantaneous variation of the electrocardiographic amplitude and ECG cycle in the electrocardiogram. Here, Shannon entropy provides a quantitative measure of uncertainty for a random variable. Shannon entropy quantifies the feasibility of a pattern representing regularity during some period of data.

The sleep monitoring application 500 further includes a cardiac arresting unit 532 for warning the ECG management unit 530 of a change in the electrocardiographic amplitude and electrocardiogram period during a predetermined period of time. The cardiopulmonary alerting unit 532 may be a light-warning lamp or a sound alarm.

As described above, since it is determined that a cardiac arrest during sleep is not generated if a change in the electrocardiographic amplitude and electrocardiogram period is not generated for a predetermined time in the cardiopulmonary warning unit 532, It can prevent deaths caused by cardiac arrest.

Hereinafter, the operation of the present invention will be described.

First, as shown in Fig. 3, the sleeping person lies down on the bed while fixing the smartphone 100 to his / her body. As shown in FIG. 4, when the sleep monitoring application 500 is executed, the main screen is displayed on the smartphone 100 after being loaded. When the monitoring button is selected from the monitoring button, the data analysis button, the stroke analysis button, and the quality analysis buttons shown in the main screen, the sleep monitoring application 500 is operated. Here, if the data analysis button is selected, the posture data of the sleeping person, the breathing data, and the electrocardiogram data generated during sleeping can be checked. If the stroke analysis button is selected, it is possible to confirm whether or not the stroke is determined by the electrocardiogram management unit 530, If you select the quality analysis button, you can check whether the sleep quality is good.

As shown in FIG. 5, the time delay setting button of the sleep monitoring application 500 may be selected to set the delay time so that the sleep monitoring application 500 is operated after a predetermined time elapses. That is, it is possible to set a delay time suitable for the sleeping person himself so that the sleeping monitoring application 500 is operated in a state where the sleeping person is in a complete sleep state.

6, the audio sensor 300 is fixed close to the nose, and the electrocardiogram pad 410 of the electrocardiograph 400 is kept in close contact with the user's body.

7, the electrocardiogram signal ECG of the sleeping person transmitted from the electrocardiogram measuring device 400 through the sleeping monitoring application 500 is outputted as a graph, and the sensing state of the motion sensing sensor 200 is And the breathing and breathing input to the audio sensor 300 are also output as a graph. At this time, the number of times of apnea is also displayed.

After sleeping, as shown in FIG. 8, OSA can be confirmed by selecting the sleeping date through the sleep monitoring application 500, and as shown in FIG. 9, Select the desired date and select the ECG (ECG) button to see the signs of stroke on the screen.

As described above, the present invention can be applied to a health management system that can manage health and can be widely used as a very useful invention.

It will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is to be understood, therefore, that the embodiments described above are to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, All changes or modifications that come within the scope of the equivalent concept are to be construed as being included within the scope of the present invention.

100: Smartphone 200: Motion detection sensor
300: audio sensor 400: electrocardiogram measuring device
410: Electrocardiogram pad 420: Electrocardiographic conversion unit
430: Electrocardiogram Bluetooth module 500: Sleep monitoring application
510: motion management unit 511: sleeping position measurement unit
512: Sleeping position check unit 513: Posture time counting unit
514: Sleeping position warning section 520: Audio management section
521: Audio size recognizing unit 522: Audio error judging unit
523: Transmission period check unit 524: Apnea judgment unit
525: Apnea check section 526: Apnea warning section
530: Electrocardiogram management unit 531: Arrhythmia symptom judgment unit
532: Cardiac arrest warning section

Claims (15)

A motion detection sensor 200 for sensing the movement and direction of the smartphone 100 carried by the sleeping person,
An audio sensor 300 for receiving an audible sound of a sleeping person and providing an audio signal to the smartphone 100,
A motion management unit 510 for managing a motion sensed by the motion sensing sensor 200 and an audio management unit 520 for managing an audio signal transmitted through the audio sensor 300. In the motion management unit 510, And a sleep monitoring application 500 monitoring the sleep state of the sleeping person using the audio signal managed by the audio management unit 520,
The motion management unit 510
A sleeping position measuring unit 511 for recognizing the sensing of the motion detecting sensor 200 and measuring the movement and direction of the smartphone 100 to measure various sleeping positions of the sleeping person,
A sleeping position check unit 512 for checking and recording various sleeping positions of the sleeping person in the sleeping position measuring unit 511,
An attitude time counting unit 513 for counting the time when the posture of the sleeping person is a lying posture or a lying posture in the sleeping posture measuring unit 511,
And a sleeping position warning unit 514 for comparing the counting time counted by the posture time counting unit 513 with a preset reference time and warning the user if the counting time is longer than a reference time,
The audio management unit 520
An audio size recognizing unit 521 for recognizing the size of an audio signal transmitted from the audio sensor 300,
An audio abnormality determination unit 522 that compares the size of the audio signal recognized by the audio size recognition unit 521 with the preset reference signal size and determines that the size of the audio signal is greater than the reference signal size,
A transmission period check unit 523 for checking the transmission period of the audio signal transmitted from the audio sensor 300,
An apnea judgment unit 524 for comparing the transmission period checked in the transmission period check unit 523 with a predetermined reference period and judging that the transmission period is longer than the reference period,
An apnea check unit 525 for checking apnea if the apnea determination unit 524 determines that apnea is present,
The audio management unit 520 includes an apnea alarm unit 526 that alerts the user if the number of apneas checked in the apnea check unit 525 is equal to or greater than a preset reference number,
The audio abnormality determination unit 522 calculates an average of the sizes of the audio signals recognized for a predetermined time from the beginning through the audio size recognition unit 521,
And the reference period is set to 10 seconds.
The smartphone (100) according to claim 1, wherein the motion sensor (200) comprises an acceleration sensor for detecting the movement and direction of the smartphone (100) while being embedded in the smartphone Real - time sleep monitoring system using. The system according to claim 1, wherein the audio sensor (300) comprises a microphone for receiving a breathing sound of a sleeping person and providing an audio signal to the smartphone (100). delete delete delete delete delete delete delete The electrocardiogram measuring apparatus according to claim 1, further comprising: an electrocardiogram measuring device (400) measuring an electrocardiogram in the body of the person to be measured and transmitting the measured electrocardiogram data to the smartphone (100)
The sleep monitoring application 500
And an electrocardiogram managing unit (530) for managing the electrocardiogram measured by the electrocardiogram measuring apparatus (400). The electrocardiogram measuring apparatus according to claim 11,
An electrocardiogram pad 410 attached to the body of the person to sense an activity current and an action potential difference caused by contraction of the heart,
An electrocardiogram converting unit 420 for converting the electrocardiogram sensed by the electrocardiogram pad 410 into data,
And an ECG Bluetooth module (430) for wirelessly transmitting the converted data from the electrocardiogram converting unit (420) to the smartphone (100). The electrocardiogram monitoring unit (530) according to claim 11, wherein the electrocardiogram monitoring unit (530) comprises an arrhythmia symptom judging unit for judging an abnormality of heart rate variability caused by an instantaneous variation of the electrocardiographic amplitude and electrocardiogram period in the electrocardiogram measured by the electrocardiogram measuring apparatus (400) 531) for detecting a sleeping state of the smartphone. [14] The method according to claim 13, wherein the arrhythmia symptom determination unit (531) obtains a time series analysis (RMSSD) using an equation using an electrocardiogram cycle, judges a stroke if RMSSD> 0.05,

Here, NN intervals = rrmedian / sampling rate real time sleep monitoring system using smart phone. The electrocardiogram managing unit 530 may further include a cardiac arresting unit 532 for warning the ECG measured by the conduction measuring apparatus 400 if the electrocardiographic amplitude and the ECG cycle are not generated for a predetermined period of time Real-time sleep monitoring system using smart phone.

Images