KR20200139023A - Physiological monitoring devce, physiological monitoring system, and physiological monitoring method using the same - Google Patents

Abstract

The present specification relates to a biometric monitoring device, a biometric monitoring system, and a biometric monitoring method using the same. The present specification includes: a mattress-type sensing device disposed under a monitoring target and detecting the posture or motion of the monitoring target; a band-type sensing device installed on a neck of a monitoring target to detect a breathing signal of the monitoring target; a monitoring device collecting sensing values of the mattress-type device and the band-type sensing device and providing a sensing value to a server; and the server for determining a biometric status of the monitoring target based on the sensing value and transmitting an alarm message to the monitoring device when there is an abnormality in the biometric status. According to the present invention, more accurate biometric monitoring is performed by synthesizing various biometric information.

Description

A living body monitoring device, a living body monitoring system, and a living body monitoring method using the same {PHYSIOLOGICAL MONITORING DEVCE, PHYSIOLOGICAL MONITORING SYSTEM, AND PHYSIOLOGICAL MONITORING METHOD USING THE SAME}

The present invention relates to a living body monitoring device, a living body monitoring system, and a living body monitoring method using the same, and more particularly, to a living body state of a person, particularly an infant, the elderly, or an animal based on bio signals including breathing, movement, and pulse. It relates to a living body monitoring device for monitoring a (physiological condition), a living body monitoring system, and a living body monitoring method using the same.

Since infants and toddlers are sensitive to the external environment because their immune system is not perfect, the surrounding environment, such as temperature, humidity, and odor, must be maintained in an appropriate state. Recently, devices or systems that control the temperature or humidity of space occupied by infants and toddlers have been developed in various ways.

In order to provide an optimal environment for caring for infants and toddlers, it is essential to continuously check their health status and movements. Even if the external environment is maintained in an optimal state, there are individual differences in temperature and humidity that infants and toddlers feel, and monitoring whether the infant is breathing properly during sleep, maintaining proper body temperature, and lying in the correct posture is necessary. . In particular, when a caregiver with an infant is sleeping, it is difficult to determine whether the infant's body temperature is maintained at a normal level, and whether the infant's heartbeat or breathing pattern is stable.

One task to be solved is to provide a biometric monitoring device, a biometric monitoring system, and a biometric monitoring method for performing more accurate biometric monitoring by synthesizing various biometric information.

The problem to be solved by the present invention is not limited to the above-described problems, and problems that are not mentioned will be clearly understood by those of ordinary skill in the art from the present specification and the accompanying drawings. .

According to an aspect of the present invention, as a sensing device for sensing at least one of biometric information on a monitored object and environmental information around the monitored object, a plate-shaped body positioned under the monitoring object, and a main surface of the body A pressure sensor module that is installed in a two-dimensional array and senses at least one of the motion and posture of the monitored object using sensing values of the plurality of pressure sensors, including a plurality of pressure sensors that measure pressure at each installation location. A mattress-type sensing device comprising a mattress-type sensing device and a strap wrapped around the neck of the monitored object, and a breathing sensor installed on the strap and disposed at the airway portion of the monitoring object and detecting a vibration signal due to breathing of the monitoring object. A sensing device including a sensing device; A first communication module communicating with an external device, an output module including at least one of a display and a speaker, and information about at least one of the motion and posture of the monitored object are collected from the mattress-type sensing device through the first communication module A monitoring device including a first controller that collects information on the vibration signal from the band-type sensing device and transmits the collected information to a server; And a result value reflecting whether the biological state of the monitoring target is a normal state or an abnormal state from the received information using an artificial neural network and a second communication module that receives the information collected by the monitoring device from the monitoring device. A second controller that calculates and transmits an alarm message instructing the first controller of the monitoring device to output a warning sound through the speaker when the biological state is abnormal, to the monitoring device through the second communication module. Server comprising a; A living body monitoring system comprising a may be provided.

The solution means of the subject of the present invention is not limited to the above-described solution means, and solutions not mentioned will be clearly understood by those of ordinary skill in the art from the present specification and the accompanying drawings. I will be able to.

According to an embodiment of the present specification, by acquiring multimodal biometric information including a patient's breathing signal, and determining the patient's physiological condition by synthesizing it, accurate monitoring of the patient's condition is performed in real time. Can be done.

The effects of the present invention are not limited to the above-described effects, and effects that are not mentioned will be clearly understood by those of ordinary skill in the art from the present specification and the accompanying drawings.

1 is a block diagram of a living body monitoring system according to an embodiment of the present specification.
2 is a schematic diagram of a living body monitoring system according to an embodiment of the present specification.
3 is a perspective view of an example of a sensing device according to an embodiment of the present specification.
4 is a block diagram of an example of a sensing device according to an embodiment of the present specification.
5 is a perspective view of another example of a sensing device according to an embodiment of the present specification.
6 is an exploded perspective view of another example of a sensing device according to an embodiment of the present specification.
7 is a diagram illustrating an operation of another example of a sensing device according to an embodiment of the present specification.
8 is a flowchart of a biometric monitoring method according to an embodiment of the present specification.
9 is a diagram of a machine learning model according to an embodiment of the present specification.

The above objects, features and advantages of the present invention will become more apparent through the following detailed description in conjunction with the accompanying drawings. However, in the present invention, various changes may be made and various embodiments may be provided. Hereinafter, specific embodiments will be illustrated in the drawings and described in detail.

In the drawings, the thicknesses of layers and regions are exaggerated for clarity, and in addition, an element or layer is "on" or "on" of another component or layer. What is referred to includes not only directly above another component or layer, but also a case where another layer or other component is interposed in the middle. Throughout the specification, the same reference numerals represent the same elements in principle. In addition, components having the same function within the scope of the same idea shown in the drawings of each embodiment will be described with the same reference numerals.

If it is determined that a detailed description of known functions or configurations related to the present invention may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, numbers (eg, first, second, etc.) used in the description of the present specification are merely identification symbols for distinguishing one component from another component.

In addition, the suffixes "module" and "unit" for constituent elements used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not themselves have distinct meanings or roles.

In addition, in the following description, it should be noted in advance that "monitoring" should be interpreted as "living monitoring" unless otherwise stated. Thus, for example, "monitoring system 1000" may be used interchangeably with the same meaning as "biometric monitoring system 1000".

According to an aspect of the present invention, as a sensing device for sensing at least one of biometric information on a monitored object and environmental information around the monitored object, a plate-shaped body positioned under the monitoring object, and a main surface of the body A pressure sensor module that is installed in a two-dimensional array and senses at least one of the motion and posture of the monitored object using sensing values of the plurality of pressure sensors, including a plurality of pressure sensors that measure pressure at each installation location. A mattress-type sensing device comprising a mattress-type sensing device and a strap wrapped around the neck of the monitored object, and a breathing sensor installed on the strap and disposed at the airway portion of the monitoring object and detecting a vibration signal due to breathing of the monitoring object. A sensing device including a sensing device; A first communication module communicating with an external device, an output module including at least one of a display and a speaker, and information about at least one of the motion and posture of the monitored object are collected from the mattress-type sensing device through the first communication module A monitoring device including a first controller that collects information on the vibration signal from the band-type sensing device and transmits the collected information to a server; And a result value reflecting whether the biological state of the monitoring target is a normal state or an abnormal state from the received information using an artificial neural network and a second communication module that receives the information collected by the monitoring device from the monitoring device. A second controller that calculates and transmits an alarm message instructing the first controller of the monitoring device to output a warning sound through the speaker when the biological state is abnormal, to the monitoring device through the second communication module. Server comprising a; A living body monitoring system comprising a may be provided.

In addition, the monitoring target may be at least one of an infant, an infant, a pregnant woman, a pet, and the elderly.

In addition, the second controller divides the vibration signal into a plurality of time segments according to a predetermined time interval, extracts a frequency component for each of the divided time segments, and calculates a frequency component for each of the plurality of time segments. It is input to the input layer of the artificial neural network in the form of a two-dimensional matrix, and learns through a running set tagged with an identifier reflecting whether the plurality of time segment-specific frequency components and the monitoring target's breathing state is a normal or abnormal state. Using the artificial neural network, it is possible to calculate a result value reflecting whether the biological state related to the breathing state of the monitored object is a normal state or an abnormal state.

In addition, the mattress-type sensing device includes a first temperature sensor installed at an edge of the main surface of the body to measure the initial temperature of the body, and a first temperature sensor installed at the center of the main surface of the body to measure the temperature of the body changed due to the monitoring A second temperature sensor to be measured may be further included, and the body temperature of the monitored object may be sensed using sensing values of the first temperature sensor and the second temperature sensor.

In addition, the sensing device further includes a surveillance camera-type sensing device for photographing the monitoring target, and the first controller includes information on the image of the monitoring target from the surveillance camera-type sensing device through the first communication module. And, through the display, the image of the monitoring target may be output in real time.

In addition, the sensing device may be disposed around the monitoring target, and the monitoring device may be disposed at a remote location of the monitoring target.

In addition, communication between the sensing devices and the monitoring device is performed according to at least one short-range communication standard of BLE (Bluetooth Low Energy), Bluetooth, and Wi-Fi, and between the monitoring device and the server. Communication may be performed according to at least one telecommunication standard of 3G, 4G, and 5G.

Hereinafter, a living body monitoring system 1000 according to an embodiment of the present specification will be described.

The biometric monitoring system 1000 is a system that collects biometric information of the monitored object 10, monitors a patient's biometric status based on the collected patient information, and provides a monitoring result to a user. Here, the monitoring object 10 may be a person or an animal. For example, the monitoring target 10 may include infants or toddlers, the elderly, pregnant women, pets, and the like. Of course, since the monitoring target 10 is not necessarily limited to the above-described examples, the general public may also be the monitoring target 10.

1 is a block diagram of a living body monitoring system 1000 according to an embodiment of the present specification, and FIG. 2 is a schematic diagram of a living body monitoring system 1000 according to an embodiment of the present specification.

Referring to FIG. 1, the biometric monitoring system 1000 may include a sensing device 1200, a monitoring device 1400, and a server 1600.

In the monitoring system 1000, the sensing device 1200 acquires biometric information on the monitored object 10, the monitoring device 1400 collects biometric information from the sensing device 1200 and transmits it to the server 1600. , The server 1600 determines a biometric status based on the collected biometric information, and provides an alarm message to the user through the monitoring device 1400 when an abnormality in the biometric status is detected. Biometric monitoring of the monitored object 10 may be performed.

Here, the sensing device 1200 may be mainly disposed around the body of the monitored object 10 or around the monitored object 10, and the monitoring device 1400 may be disposed at a remote location of the monitored object 10. For example, in the case of performing biometric monitoring on infants and toddlers, the sensing device 1200 may be disposed in a room in which the infant is located, and the monitoring device 1400 may be disposed in a room in which a user such as a parent is present. Further, the monitoring system 1000 may include one or more sensing devices 1200. The plurality of sensing devices 1200 may sense different biometric information.

Referring to FIG. 2, the monitoring system 1000 may exemplarily monitor infants and toddlers. Specifically, the monitoring system 1000 shown in FIG. 2 is a sensing device 1200 using a mattress that supports the infant and detects the movement of the infant, a band attached to the infant's body to detect the infant's breathing, etc., using a camera or a microphone. It may be a device that acquires images or sounds for infants and toddlers. Accordingly, the monitoring system 1000 illustrated in FIG. 2 may monitor a biological condition including health of infants and toddlers using various acquired biometric information.

Hereinafter, each component of the living body monitoring system 1000 according to an embodiment of the present specification will be described with reference to FIGS. 1 and 2 again.

The sensing device 1200 may sense biometric information on the monitored object 10 or environmental information around the monitored object 10. For example, the biometric information may include breathing, body temperature, motion, posture, pulse, electrocardiogram, image, sound, etc. of the monitored object 10. In addition, the sensing device 1200 may sense environmental information around the monitored object 10 in addition to the biometric information. For example, environmental information may include temperature, humidity, ambient sound, and illuminance.

To this end, the sensing device 1200 may sense biometric information or environmental information by including a sensor 1220 that detects biometric information or environmental information to be acquired. For example, the sensor may include a vibration sensor that detects breathing, a temperature sensor that detects body temperature or temperature, an image sensor that captures an image of the monitored object 10, a microphone sensor that detects sound, and the like.

Here, one sensing device 1200 does not necessarily need to acquire only one biometric information. For example, the sensing device 1200 may be implemented in a form including a camera that photographs the monitored object 10 and a microphone that senses the sound produced by the monitoring object 10. In addition, the monitoring system 1000 may be implemented including a plurality of sensing devices 1200. For example, as shown in FIG. 2, the monitoring system 1000 may include a mattress-type sensing device 1200a, a band-type sensing device 1200b, and a device-type sensing device 1200c having a camera/microphone. have.

In addition, the sensing device 1200 may include a communication module 1240 and transmit biometric information or environmental information sensed through the communication module 1240 to the monitoring device 1400.

In addition, communication between the sensing device 1200 and the monitoring device 1400 may be performed according to a short-range communication standard of at least one of Bluetooth Low Energy (BLE), Bluetooth, and Wi-Fi.

The communication module 1240 is a wired/wireless wireless communication module that transmits data through various communication standards including BLE (Bluetooth Low Energy), Bluetooth module, Wi-Fi module, 3G, 4G or 5G. May contain modules.

Meanwhile, although not shown in the drawing, a controller (not shown) for processing various types of biometric information or environmental information to be sensed may be optionally provided in the sensing device 1200. For example, a controller (not shown) of the sensing device 1200 may perform signal processing such as processing noise of a sensed signal or converting an analog signal into a digital signal. As another example, a controller (not shown) of the sensing device 1200 may calculate a biometric state by performing an operation on a biosignal. Specifically, the controller (not shown) of the sensing device 1200 can calculate the respiratory rate or pulse rate from biometric information in the form of a vibration signal, or calculate the posture or motion of the monitored object 10 from biometric information in the form of a pressure signal. can do. In addition, although the sensing device 1200 is shown to communicate with the monitoring device 1400 in the drawing, the sensing device 1200 may directly communicate with the server 1600.

The sensing device 1200 may be implemented in various forms in order to obtain the above-described various biometric information or environmental information. As an example, the sensing device 1200 may be provided as a mattress 1200a for detecting the motion or posture of the monitored object 10. As another example, the sensing device 1200 may be provided in the form of a band 1200b that measures the breathing of the monitored object 10.

A detailed description of some exemplary implementation examples of the sensing device 1200 will be described later.

The monitoring device 1400 may collect the biometric information acquired by the sensing device 1200 and transmit it to the server 1600. In addition, the monitoring device 1400 may operate as a user interface that outputs an alarm message to the user.

The monitoring device 1400 may be mainly provided as a mobile device carried by a user freely. The monitoring device 1400 may be a dedicated device used only for the monitoring system 1000 according to the exemplary embodiment of the present specification, but an existing device such as a smart phone or tablet may be used as the monitoring device 1400.

Referring back to FIG. 1, the monitoring device 1400 may include an input module 1410, an output module 1420, a communication module 1430, a memory 1440, and a controller 1450.

The input module 1410 may receive an input from a user. In addition, the output module 1420 may output various types of information to a user. Examples of the input module 1410 include buttons, microphones, and touch pads. Also, examples of the output module 1420 include a display, a speaker, and a vibrator. Here, a touch screen in which a touch pad and a display are combined may be used in a form in which an input module and an output module are combined.

The output module 1420 may provide various information to a user.

For example, the monitoring device 1400 may output biometric information or a biometric state through the output module 1420. Specifically, when an image of the monitoring object 10 is captured as biometric information, an image of the monitoring object 10 may be output through a display. Alternatively, when a breathing signal for the monitoring object 10 is acquired as biometric information, a biometric state such as a respiration rate or a breathing state calculated based on the breathing signal may be output. Alternatively, when an abnormality occurs in the biological state of the monitored object 10, an alarm message may be output to the user through sound, video, or vibration.

The communication module 1430 may communicate with the sensing device 1200 or the server 1600. For example, the communication module 1430 may receive biometric information from the sensing device 1200. In addition, the communication module 1430 collects information on at least one of the motion and posture of the monitored object 10 and the body temperature of the monitored object 10 from the mattress-type sensing device 1200a, and the band-type sensing device Information about the breathing of the monitoring target 10 may be collected from 1200b, and the collected information may be transmitted to the server 1600. In addition, the communication module 1430 may collect information about an image of the monitored object 10 from the surveillance camera-type sensing device 1200c and transmit the collected information to a server.

For another example, the communication module 1430 may transmit biometric information to the server 1600 or may receive an alarm message or a biometric status from the server 1600.

The communication module 1430 may be implemented as a module of various standards for performing wired communication or wireless communication. Further, the monitoring device 1400 may be provided with a plurality of communication modules 1430. For example, communication between the monitoring device 1400 and the sensing device 1200 is performed according to a short-range communication standard such as BLE (Bluetooth Low Energy), Bluetooth or Wi-Fi, and 3G between the monitoring device 1400 and the server 1600 When performed according to a telecommunication standard such as 4G or 5G, the monitoring device 1400 may include a short-range communication module and a long-distance communication module, respectively.

Various types of information may be stored in the memory 1440. For example, the memory 1440 may store an operating system (OS) for driving the monitoring device 1400 or biometric information obtained from the sensing device 1200.

The memory 1440 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) magnetic memory, magnetic disk And at least one type of storage medium among optical disks. In addition, the memory may temporarily, permanently or semi-permanently store information, and may be provided as an internal or removable type.

The controller 1450 may control each component of the monitoring device 1400 or may process and calculate various types of information. For example, through the output module 1420, biometric information or biometric status of the monitored object 10 may be output. For another example, the controller 1450 may output an image of the monitored object 10 through a display. In this case, the image may be output in real time.

The controller 1450 may be implemented in software, hardware, and combinations thereof. For example, in hardware, the controller 1450 may be implemented as a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a semiconductor chip, and other various types of electronic circuits. In terms of software, the controller 1450 may be implemented as a logic program or various computer languages executed according to the above-described hardware.

In the following description, unless otherwise stated, the operation of the monitoring device 1400 may be understood as being performed under the control of the controller 1450.

The server 1600 may receive biometric information from the monitoring device 1400 and determine a biometric state based thereon. In addition, the server 1600 may transmit an alarm message to the monitoring device 1400 when the biological condition is abnormal, so that the monitoring device 1400 may output an alarm message to the user.

The server 1600 may include a communication module 1620, a memory 1640, and a controller 1660.

The server 1600 may transmit and receive data to and from the monitoring device 1400 through the communication module 1620. The communication module 1620 may receive the biometric information collected by the monitoring device 1400 from the monitoring device 1400 or transmit a biometric status or an alarm message to the monitoring device 1400. In addition, communication between the monitoring device 1400 and the server 1600 may be performed according to mobile communication standards such as 3G, 4G, and 5G.

Various types of information may be stored in the memory 1640, and the controller 1660 may control each configuration of the server 1600 or process and calculate various types of information. For example, the received biometric information may be stored in relation to the monitored object 10 in the memory 1640, and the controller 1660 can refer to this to determine the biometric state of the monitored object 10. Meanwhile, as will be described later, a machine learning model may be used to determine a living body state. In this case, a machine learning model is stored in the memory 1640, and the controller 1660 may use this to determine the living body state.

In addition, the controller 1660 calculates a result value reflecting whether the biological state of the monitored object 10 is a normal state or an abnormal state from information received from the monitoring device 1400 using an artificial neural network, and When the state is abnormal, the controller 1450 of the monitoring device 1400 may transmit an alarm message instructing to output a warning sound through the speaker to the monitoring device 1400 through the communication module 1620.

A more detailed description of this will be described later.

Since the configuration of these servers 1600 may be implemented in the same or similar to the communication module 1420, memory 1440, and controller 1450 of the monitoring device 1400 described above, detailed descriptions thereof will be omitted. . In addition, it may be understood that the operation of the server 1600 is performed under the control of the controller 1660 unless otherwise stated in the following description.

In addition, the monitoring system 1000 may include one or more servers 1600. For example, the server 1600 may be a single physical object that integrates the functions of the server 1600 described in the present specification, but a plurality of physical objects each performing the functions of the server 1600 described herein It can also be implemented as an object. For example, the server 1600 is a database server that stores biometric information, an artificial intelligence server that determines a biometric status from biometric information through an artificial intelligence algorithm, a web server that operates a web page for biometric monitoring through the Internet, etc. Can be distributed as

Hereinafter, some implementation examples of the sensing device 1200 according to an embodiment of the present specification will be described in more detail.

A representative example of the conventional sensing device 1200 is a surveillance camera-type device 1200c in which a camera and a speaker are combined. In the present specification, in addition to the surveillance camera-type device 1200c, the mattress-type device 1200a and the band-type device 1200b may be included in the sensing device 1200.

3 is a perspective view of an example of a sensing device 1200 according to an embodiment of the present specification.

According to an example, the sensing device 1200 may be provided in the form of a mattress disposed under the monitored object 10 as shown in FIG. 3. The mattress-type device 1200a can detect biometric information related to changes in the monitoring target 10, particularly, breathing, pulse, crying, position, posture, motion, and body heat during sleep of infants and toddlers using a non-constrained and insensitive sensor. have.

The mattress-type sensing device 1200a (hereinafter, referred to as a “mattress device”) may be provided in the form of a flat plate with a feeling of cushioning. In other words, the mattress device 1200a may have a plate-shaped body. The body of the mattress device 1200a may have a size suitable for the monitored object 10 to sleep on the mattress device 1200a or to sit and live.

Various sensors are attached to the mattress device 1200a to obtain various kinds of biometric information described above. The obtained biometric information will be transmitted to the monitoring device 1400.

4 is a block diagram of an example of a sensing device 1200 according to an embodiment of the present specification.

Referring to FIG. 4, the mattress device 1200a may include a plurality of sensors 1220. Here, the plurality of sensors 1220a, 1220b, and 1220c may include a vibration sensor 1220a, a temperature sensor 1220b, and a pressure sensor 1220c.

The vibration sensor 1220a may sense vibration generated from the monitored object 10 on the mattress device 1200a. Vibration generated by the monitored object 10 may be caused by firing, breathing, pulse, coughing, movement, etc. of the monitored object 10. For example, the vibration sensor 1220a may detect vibrations due to inhalation and exhalation of infants or infants, or may detect vibrations due to pulses of infants and young children, and convert them into electrical signals.

When the monitoring object 10 is in direct contact with the vibration sensor 1220a, the vibration sensor 1220a may directly detect the vibration from the monitoring object 10. Alternatively, when the monitoring object 10 is not in contact with the vibration sensor 1220a, the vibration sensor 1220a may detect vibration propagating from the monitoring object 10 using the mattress as a medium. The vibration sensor 1220a may be a PVDF (PolyVinyliDene Fluoride) sensor or other piezoelectric sensor.

The temperature sensor 1220b may measure the body temperature of the monitored object 10, the temperature of the mattress, or the temperature. The temperature sensor 1220b may contact the monitored object 10 to measure body temperature, or may be attached to the mattress to measure the temperature of the mattress, or may be exposed to the outside to measure the temperature. In this case, the temperature may be used for setting a reference value of the temperature change of the mattress according to the change in body heat of the monitored object 10.

In addition, the band device 1200b is installed at the edge of the main surface of the body to measure the initial temperature of the body, and the first temperature sensor 1220b-1 is installed at the center of the main surface of the body to be monitored. Including a second temperature sensor (1220b-2) for measuring the temperature of the body changed due to, and monitored using the sensing values of the first temperature sensor (1220b-1) and the second temperature sensor (1220b-2) It may include a temperature sensor module that senses the body temperature of the object 10.

The pressure sensor 1220c may be attached to the mattress to detect pressure applied from the monitored object 10. When the pressure is sensed, biometric information regarding a posture or motion of the monitored object 10 may be obtained. The pressure sensor 1220c may be provided in various forms, including a force-sensing resistor (FSR) sensor.

A plurality of sensors may be arranged in various forms in the mattress device 1200a described above. Here are some examples.

Sensors may be arranged in a two-dimensional array in the mattress device 1200a. For example, referring again to FIG. 3, sensors may be arranged in various forms on the mattress 1202, such as being disposed at each corner of the mattress 1202. Alternatively, the sensors may be arranged in a 3×3 array on the mattress 1202. The distance, location, and arrangement of the sensors may be determined according to the overall size of the mattress or the monitored object 10, for example, the height and weight of the infant.

Here, the sensor 1220 may be any one of the vibration sensor 1220a, the temperature sensor 1220b, and the pressure sensor 1220c described above, or a composite sensor including at least two or more. The vibration sensor provided in the composite sensor can detect changes in vibration caused by breathing, pulse, and crying. The vibration sensor 1220a is a piezoelectric sensor and may sense a voltage change according to a displacement or deformation occurring in the elastic body. For example, it is possible to detect vibrations caused by an infant's inhalation and exhalation, detect a vibration due to an infant's pulse, or detect a change in vibration caused by an infant's crying sound and convert it into an electrical signal.

At least some of the vibration sensors 1220a may be disposed in an area where the head is placed or an area adjacent thereto when the monitored object 10 is in a lying position. The vibration sensor 1220a disposed in or near the area where the head is placed detects the vibration generated by the breathing, pulse, or ignition of the monitored object 10 to detect the breathing state, respiration rate, pulse state, and pulse rate of the monitored object 10. , You can detect information related to crying.

The pressure sensor 1220c has a function of detecting the posture and movement of the monitored object 10. The pressure sensors 1220c arranged in a predetermined array form can detect the posture or movement of the monitored object 10 through a combination of pressures sensed by each individual pressure sensor 1220c. For example, the mattress device 1200a includes a plurality of pressure sensors installed in a two-dimensional array on the main surface of a plate-shaped body located under the monitored object 10 and measuring pressure at each installation position. It may include a pressure sensor module that senses at least one of the motion and posture of the monitored object 10 by using the sensing value of the pressure sensor of.

5 is a perspective view of another example of a sensing device according to an embodiment of the present specification, and FIG. 6 is an exploded perspective view of another example of the sensing device according to an embodiment of the present specification.

According to an example, the sensing device 1200 may be provided in the form of a band attached to the body of the monitored object 10 as shown in FIG. 5. The band-type sensing device 1200b may detect the monitoring target 10, particularly, biometric information related to changes in breathing, pulse, cries, and body heat during sleep of an infant.

The band-type sensing device 1200b (hereinafter referred to as “band device”) may be provided in the form of a band surrounding the neck. Referring to FIG. 5, the band device 1200b fixes the position of the body 1204 and the sensor with a breathing sensor that is closely disposed on the neck to detect a vibration signal generated by breathing or firing, so that the band device 1200b is in close contact with the neck. It may include a strap 1206 that is wound around the neck of the monitored object 10 by providing tension. In other words, the band-type sensing device 1200b is installed on the strap 1206 and the strap 1206 wrapped around the neck of the monitoring object 10 and disposed on the airway portion of the monitoring object 10, and It may include a breathing sensor 1220 for detecting a vibration signal by breathing.

Of course, the strap 1206 is not an essential component of the band device 1200b, and, for example, may be replaced with an adhesive means to allow the breathing sensor to be attached to the neck area. Accordingly, hereinafter, for convenience of description, the main body of the band device 1200b excluding the strap 1206 portion will be referred to as “band device 1200b”.

For example, the band device 1200b may be manufactured in a rectangular shape when viewed from above. Specifically, the band device 1200b may have a rectangular shape having a longer one end to surround the attachment portion 12.

The band device 1200b may have a structure in which a cover 1250, an adhesive layer 1255, an insulating film 1260, a piezoelectric film 1270, and a case 1275 are sequentially stacked. At this time, the communication module 1240b may be positioned horizontally with the piezoelectric film 1270 and positioned between the insulating film 1260 and the case 1275. That is, in the band device 1200b, the cover 1250 is located on the lowermost layer, the adhesive layer 1255 is located on the cover 1250, the piezoelectric film 1270 and the communication module 1240b are located on the adhesive layer 1255, It may be a stacked structure in which the case 1275 is positioned on the top layer. 5 and 6 illustrate that the communication module 1240b is a wireless communication module, it should be noted that the band device 1200b according to an embodiment of the present specification is not limited thereto.

The adhesive layer 1255 may be provided in the form of a thin film. The adhesive layer 1255 may be formed of a gel material having both adhesiveness, conductivity, and flexibility. Here, as an example of the gel material, a hydrogel may be used.

Since the adhesive layer 1255 may serve to fix the band device 1200b to the attachment portion 12, the strap 1206 may be removed from the band device 1200b if the adhesive layer 1255 has sufficient adhesive strength. Conversely, if the band device 1200b is provided with a strap 1206, and thus the sensor can be sufficiently fixed to the neck region, the adhesive layer 1255 may be excluded from the band device 1200b.

On the other hand, the gel-like material constituting the adhesive layer 1255 has an electrical channel function for grounding of the lower electrode 1273 and a filtering function for respiratory vibration in addition to bonding the band device 1200b to the attachment site 2. I can.

The insulating layer 1260 may be provided in the form of a thin film. The insulating layer 1260 may be interposed between the adhesive layer 1255 and the piezoelectric film 1270. When viewed from above, the area of the insulating layer 1260 may be provided larger than the area of the piezoelectric film 1270.

Meanwhile, a through hole 1261 may be formed in the insulating layer 1260. The through hole 1261 electrically connects the piezoelectric film 1270 and the adhesive layer 1255 to ground the piezoelectric film 1270 to the body through the adhesive layer 1255.

The through hole 1261 may be an empty space extending from the upper surface to the lower surface of the insulating layer 1260 while passing through the insulating layer 1260.

The through hole 1261 may be formed in a region of the insulating film 1260 in contact with the adhesive layer 1255 and the piezoelectric film 1270 when the adhesive layer 1255, the insulating film 1260, and the piezoelectric film 1270 are overlapped. . Accordingly, when the adhesive layer 1255, the insulating film 1260, and the piezoelectric film 1270 are in close contact with each other and overlap, a part of the adhesive layer 1255 corresponding to the through hole 1261 is inserted into the through hole 1261 and the piezoelectric film The lower electrode 1273 of the 1270 may be contacted. Accordingly, the piezoelectric film 1270 and the adhesive layer 1255 may be electrically connected in a region corresponding to the through hole 1261.

The piezoelectric film 1270 may include a piezoelectric element 1272, an upper electrode 1271, and a lower electrode 1273. In the piezoelectric film 1270, when vibration is transmitted to the piezoelectric element 1272, a potential difference is generated in the piezoelectric element 1272, and an electric signal is applied between the upper electrode 1271 and the lower electrode 1273 due to the potential difference, thereby preventing vibration. Can be detected. In other words, the band device 1200b according to the exemplary embodiment of the present specification may include a piezoelectric film 1270 that is a vibration sensor as a sensor module for sensing vibration. Accordingly, when the piezoelectric film 1270 is placed on the neck, the band device 1200b may sense a vibration signal generated by respiration, pulse, movement, or speech. The piezoelectric film 1270 may be made of, for example, the above-described PVDF material.

The case 1275 may be located on the top surface of the band device 1200b. The case 1275 may have a generally thin film shape. The case 1275 may have the same area as the insulating layer 1260 or larger than the insulating layer 1260 when viewed from above. The case 1275 may be overlapped while covering the insulating film 1260 on top, and a piezoelectric film 1270 and a communication module 1240b may be interposed therebetween.

7 is a diagram illustrating another example operation of the sensing device 1200 according to the exemplary embodiment of the present specification.

Referring to FIG. 7, the band device 1200b may sense vibration generated by breathing in a coupled state attached to the attachment portion 12, for example, the neck portion of the monitored object 10.

Specifically, vibration generated in the neck region may be transmitted to the adhesive layer 1255. The vibration may be transmitted to the piezoelectric film 1270 through the adhesive layer 1255 and the insulating film 1260. The piezoelectric film 1270 receives an external force due to vibration, and accordingly, an electric signal may be generated between the upper electrode 1271 and the lower electrode 1273 with the piezoelectric film 1270 interposed therebetween. In this case, the lower electrode 1273 may be electrically connected to the adhesive layer 1255 through the through hole 1261, and may be electrically connected to the body of the monitored object 10 through the adhesive layer 1255. Accordingly, since the lower electrode 1273 is grounded, noise in the electric signal generated by the piezoelectric film 1270 is reduced, and a more accurate vibration signal can be obtained. The insulating layer 1260 electrically blocks the main surface of the piezoelectric film 1270 from the body, thereby minimizing the occurrence of noise in the electric signal generated by the piezoelectric film 1270 due to a minute current of the body.

Hereinafter, a biometric monitoring method according to an embodiment of the present specification will be described. In the following description, it will be described that the biometric monitoring method is performed using the biometric monitoring system 1000 described above, but this is merely for convenience of description, and the biometric monitoring method according to an embodiment of the present invention is described above. In addition to the biometric monitoring system 1000, it may be performed by other devices or systems having similar functions.

8 is a flowchart of a biometric monitoring method according to an embodiment of the present specification.

Referring to FIG. 8, the biometric monitoring method includes: detecting biometric information (S1100), collecting biometric information (S1200), monitoring a biometric state based on the biometric information (S1300), and when an abnormality occurs. The step of outputting an alarm message (S1400) may be included.

Hereinafter, each of the above-described steps will be described in detail.

The biometric monitoring system 1000 may detect biometric information (S1100).

The sensing device 1200 may be attached to the monitored object 10 or disposed near the monitored object 10 to detect biometric information from the monitored object 10. Furthermore, the sensing device 1200 may detect environmental information on the surrounding environment of the monitored object 10.

For example, the monitoring system 1000 may include a mattress device 1200a, a band device 1200b, and a surveillance camera type sensing device 1200c having a camera/microphone as the sensing device 1200. The surveillance camera-type sensing device 1200c may photograph the monitored object 10 and record sound from or around the monitored object 10.

In this case, the mattress device 1200a, the band device 1200b, and the sensing device 1200c in the form of a surveillance camera may detect at least one or more of biometric information among breathing, pulse, body temperature, temperature, posture, movement, image, and sound, respectively. I can.

The biometric monitoring system 1000 may collect biometric information (S1200).

The monitoring device 1400 may collect biometric information detected by the sensing device 1200 from the sensing device 1200. Specifically, the monitoring device 1400 may receive biometric information from one or more sensing devices 1200 through the communication module 1430. The collection of biometric information may be mainly performed through short-range communication such as Bluetooth Low Energy (BLE), Bluetooth or Wi-Fi.

The living body monitoring system 1000 may monitor a living body condition based on the biometric information (S1300). Here, monitoring of the biological state may mean continuously determining what state the biological state of the monitored object 10 is in, and detecting whether an abnormality has occurred in the monitored object 10 according to the determination result.

The server 1600 may receive biometric information collected by the monitoring device 1400 from the monitoring device 1400. Specifically, the server 1600 may receive biometric information from the monitoring device 1400 through a communication module. Here, the transfer of biometric information may be mainly performed through long-distance communication such as mobile communication or wired communication such as LAN.

When the server 1600 collects various types of biometric information, it may determine, diagnose, or analyze a biometric state based on the collected biometric information. Specifically, the controller 1660 may determine the biological state of the monitored object 10 by comprehensively considering the biometric information. Here, the biometric status may mean a result of analyzing the biometric information, whereas the biometric information is a signal directly detected from the monitored object 10. For example, the biometric information is a vibration signal due to respiration, and the biometric state is a result of analyzing the corresponding respiration vibration signal, and may be the number of respirations, respiration status, hyperventilation status, apnea status, health status based on breathing status, etc have.

The determination, diagnosis, or analysis of a living body state based on biometric information can be implemented with various algorithms, for example, a machine learning model using an artificial neural network based on deep learning. Of course, the server 1600 does not necessarily have to use a deep learning-based machine learning model, and it is also possible to determine, diagnose, or analyze a living body state by using various other techniques. Meanwhile, a detailed description of an example of a machine learning model that performs determination, diagnosis, or analysis of a living body state will be described later.

When the server 1600 obtains information on the living body state, the server 1600 may check whether the monitored object 10 is abnormal based on the information. For example, in the case of infants and toddlers, the respiratory rate is more than 150 times per minute in a normal normal state, and if the number of breaths as a biological state extracted based on the respiratory rate detected as biometric information or the respiratory vibration signal is determined to be less than 120 times per minute, 1600) may determine this as an abnormal state.

The monitoring system 1000 may output an alarm message when an abnormality occurs (S1400).

The monitoring device 1400 may output a warning or an alarm message to a user. Specifically, the server 1600 generates an alarm message when an abnormality occurs/detects, and delivers it to the monitoring device 1400, and the monitoring device 1400 receiving the alarm message outputs a warning or alarm message to the user. can do.

Hereinafter, an algorithm for determining/diagnosing or analyzing a living body state according to an embodiment of the present specification will be described.

According to an example, the above-described algorithm may be implemented as a machine learning model using an artificial neural network of a deep learning series. In an embodiment of the present invention, the artificial neural network may store modeling in a memory of the server 1600, receive biometric information as an input value by the controller 1660 of the server 1600, and output the biometric state as an output value. .

9 is a diagram of a machine learning model according to an embodiment of the present specification.

Referring to FIG. 9, the artificial neural network may include an input layer, a hidden layer, and an output layer. The artificial neural network can be learned to derive an accurate output value from the input data after the input data to be input to the input layer and the output value checked in advance are highly learned through a running set tagged with each other.

In this specification, biometric information may be used as input data in the input layer.

As an example, the artificial neural network may be designed such that one type of biometric information is input to an input layer as input data and a result value related thereto is output to an output layer. For example, a breathing vibration signal may be input as input data, and as an output value, the number of breaths, breathing state, or abnormality of the breathing state may be output. In the case of an artificial neural network designed as described above, when there are several types of biometric information, as many artificial neural networks as the number of types of biometric information may be required.

As another example, the artificial neural network may be designed such that a plurality of types of biometric information is input to an input layer as input data, and a result value related thereto is output to an output layer. For example, a plurality of biometric information such as respiratory vibration signal, pressure detection signal, body temperature signal, image, sound, etc. is input as input data, and as output values, respiratory rate or breathing state, motion state, posture, crying status, health state, body temperature The state, whether each state is an individual abnormality, or whether each state is combined with a health abnormality may be output. The artificial neural network designed in this way can synthesize and process various types of biometric information through a single artificial neural network.

Meanwhile, in the present specification, a breathing vibration signal may be collected as biometric information through the mattress device 1200a or the band device 1200b, and the respiratory state or abnormality of the monitored object 10 may be monitored therefrom.

As an example of an artificial neural network for this, the input layer may be designed in two dimensions. In this case, the input layer may be designed as a two-dimensional matrix having two axes of a time axis and a frequency axis. When the controller 1660 receives a vibration signal as biometric information from the monitoring device 1400, it may divide it into wavelet-shaped segments. In other words, when a vibration signal defined in the time domain is transmitted, a region corresponding to a certain time period is extracted, the corresponding region is divided into a plurality of unit times, and then a Fourier transform is performed for each segment to obtain a frequency component. Can be extracted. Through such a process, the controller 1660 may generate 2D matrix data having a time axis and a frequency axis from the vibration signal.

In an embodiment of the present specification, an artificial neural network is designed to have an input layer that can receive such a two-dimensional matrix (frequency spectrum intensity information for each time segment), and a breathing state (for example, whether or not there is a breathing abnormality) You can create a running set by tagging. The artificial neural network learned with the generated running set can determine whether the monitoring target 10 is breathing or abnormal based on the vibration signal transmitted to the server 1600 in real time after the learning is completed. Through this, as a result, monitoring of a health state or an abnormal state of the monitored object 10 may be performed.

In other words, the controller 1660 divides the vibration signal received from the monitoring device 1400 into a plurality of time segments according to a predetermined time interval, and extracts a frequency component for each of the divided time segments of the complement, The frequency components of the plurality of time segments are input to the input layer of the artificial neural network in the form of a 2D matrix, and the frequency components of the plurality of time segments and the breathing state of the monitoring target 10 are reflected in a normal state or an abnormal state A result value reflecting whether the biological state related to the breathing state of the monitored object 10 is a normal state or an abnormal state may be calculated using the artificial neural network learned through the running sets tagged with each other.

Meanwhile, in the above, it has been described that the server 1600 calculates the above algorithm, but after the learning is completed, the server 1600 deploys the learned algorithm to the monitoring device 1400, and artificial intelligence monitoring is performed locally. It is also possible to become.

Since all the steps described in the biometric monitoring method according to the embodiment of the present specification described above are not essential, the biometric monitoring method may include not only all of the steps but also some of them. In addition, since the order in which the steps are described is only for convenience of description, the steps in the biometric monitoring method do not necessarily have to be performed in the order described.

In addition, in the biometric monitoring method according to the exemplary embodiment of the present specification described above, the step without a separate reference to the performing subject is performed by at least one of the controller 1450 of the monitoring device 1400 and the controller 1660 of the server 1600. Can be done by

The above description is merely illustrative of the technical idea of the present invention, and those of ordinary skill in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention. Accordingly, the embodiments of the present invention described above may be implemented separately or in combination with each other.

Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims (7)

A sensing device that senses at least one of biometric information on a monitored object and environmental information around the monitored object, and is installed in a plate-shaped body located under the monitoring object, and installed in a two-dimensional array on the main surface of the body. A mattress-type sensing device including a plurality of pressure sensors measuring pressure at a position, and a pressure sensor module that senses at least one of the motion and posture of the monitored object using sensing values of the plurality of pressure sensors, and the A sensing device including a strap wrapped around the neck of a monitoring target and a breathing sensor installed on the strap and disposed at an airway portion of the monitoring target and detecting a vibration signal by breathing of the monitoring target;
A first communication module communicating with an external device, an output module including at least one of a display and a speaker, and information about at least one of the motion and posture of the monitored object are collected from the mattress-type sensing device through the first communication module A monitoring device including a first controller collecting information on the vibration signal from the band-type sensing device and transmitting the collected information to a server; And
A result value reflecting whether the biological state of the monitoring object is a normal state or an abnormal state from the received information using an artificial neural network and a second communication module that receives the information collected by the monitoring device from the monitoring device A second controller that calculates and transmits an alarm message instructing the first controller of the monitoring device to output a warning sound through the speaker when the biological state is an abnormal state to the monitoring device through the second communication module Including; server including;
Biometric monitoring system. The method of claim 1,
The monitoring target is at least one of infants, infants, pregnant women, pets and the elderly
Biometric monitoring system. The method of claim 1,
The second controller divides the vibration signal into a plurality of time segments according to a predetermined time interval, extracts a frequency component for each of the divided time segments, and sets a frequency component for each of the plurality of time segments to 2 It is input to the input layer of the artificial neural network in the form of a dimensional matrix, and the frequency components of the plurality of time segments and the identifier reflecting whether the breathing state of the monitoring target is in a normal state or an abnormal state are learned through a running set tagged with each other. Using the artificial neural network to calculate a result value reflecting whether the biological state related to the breathing state of the monitoring target is a normal state or an abnormal state
Biometric monitoring system. The method of claim 1,
The mattress-type sensing device is installed at the edge of the main surface of the body to measure the initial temperature of the body, and the first temperature sensor is installed at the center of the main surface of the body to measure the temperature of the body changed due to the monitoring object. Further comprising a second temperature sensor,
Detecting the body temperature of the monitoring target using the sensing values of the first temperature sensor and the second temperature sensor,
Biometric monitoring system. The method of claim 1,
The sensing device further includes a surveillance camera type sensing device for photographing the monitoring object,
The first controller collects information on the image of the monitoring target from the surveillance camera-type sensing device through the first communication module, and outputs the image of the monitoring target in real time through the display.
Biometric monitoring system. The method of claim 1,
The sensing device is disposed around the monitoring target, and the monitoring device is disposed at a remote location of the monitoring target,
Biometric monitoring system. The method of claim 1,
Communication between the sensing devices and the monitoring device is performed according to a short-range communication standard of at least one of Bluetooth Low Energy (BLE), Bluetooth, and Wi-Fi,
Communication between the monitoring device and the server is performed according to at least one long-distance communication standard of 3G, 4G, and 5G,
Biometric monitoring system.

Images