KR101949799B1 - SYSTEM FOR MANAGING PROTECTION FACILITY USING mmWAVE RADER SENSOR FOR SENSING BIOLOGICAL SIGNAL - Google Patents

Abstract

A system for managing a protection facility comprises: at least one apparatus for sensing a biological signal installed in the protection facility; at least one camera and apparatus for sensing a biological signal installed in the protection facility; a network video recorder (NVR) server for managing the at least one camera, wherein an apparatus for sensing a biological signal includes: a radar sensor for transmitting an electromagnetic wave to a predetermined area of the protection facility, and receiving a reflected electromagnetic wave reflected by people in the protection facility; a phase preprocessing unit for extracting a frequency from data of the reflected electromagnetic wave, and preprocessing a phase of the frequency; a biological signal monitoring unit for performing a spectrum estimation on the frequency to determine a respiration rate and a heart rate of a person; and a unexpected situation information transmitting unit for transmitting unexpected situation information including the respiration rate and the heart rate to the NVR server based on changes in respiration rate and the heart rate. The apparatus for sensing a biological signal installed in a protection facility can be used for detecting an abnormal state of a respiration rate and heart rate of a person existing in the protection facility.

Description

TECHNICAL FIELD [0001] The present invention relates to a protection management system using a millimir wave radar sensor for detecting a biological signal,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a protection facility management system utilizing a millimirror radar sensor for detecting a biological signal.

A detention center is a facility within the police station to accommodate persons who have been sentenced or dismissed in accordance with procedures established by law or that limit the freedom of the body.

In recent years, people have committed suicide in the detention center, and this has become a social problem. Most self-harming or suicide in the detention center is carried out in the restroom, and CCTV is installed in the restroom so that people's behavior can be monitored to prevent unexpected behavior such as self-harm or suicide.

However, it can be pointed out that installing CCTV in the toilet does not guarantee the human rights of the person. In addition, the method of monitoring the behavior of a person using CCTV captures only the movement of a person but can not confirm the actual condition of the person.

In addition, there are many cases in which the clerk is not able to immediately detect the sudden movements in the lockup because they have to monitor the behavior of the person while reading the CCTV image directly.

Japanese Patent Application Laid-Open No. 2005-295241 (published on October 20, 2005)

Disclosure of Invention Technical Problem [7] Accordingly, the present invention has been made to solve the above problems occurring in the prior art, and it is an object of the present invention to provide a bio- To provide unexpected situation information. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to a first aspect of the present invention, there is provided a protection facility management system comprising at least one biological signal detection device installed in a protection facility; At least one camera installed in the protection facility; And an NVR server for managing the camera, wherein the bio-signal sensing device transmits an electromagnetic wave to a predetermined area of the protection facility, and the reflected electromagnetic wave reflected by a person in the protection facility A radar sensor for receiving the radar sensor; A phase preprocessing unit for extracting a frequency from the data of the reflected electromagnetic wave and preprocessing the phase of the frequency; A bio-signal monitoring unit for performing a spectrum estimation on the frequency to determine a respiration rate and a heart rate of the person; And an abrupt situation information transmission unit for transmitting the abrupt situation information including the respiration rate and the heart rate information to the NVR server based on the change of the respiration rate and the heart rate.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to one of the above-mentioned objects of the present invention, the present invention provides a biological signal detecting apparatus installed in a protection facility, which detects an anomalous state of a human being and a heart rate present in a protection facility, And the like.

In addition, the present invention can protect the privacy of the person and the human rights by monitoring the living state of a person existing in the protection facility through the bio-signal detection device installed in the protection facility.

In addition, the present invention can quickly respond to emergency situations (such as suicide or self-harm) occurring suddenly at a place by installing a bio-signal detection device in a place where camera installation is difficult, such as a restroom of a protection facility .

1 is a conceptual diagram schematically showing a protection facility management system according to an embodiment of the present invention.
2 is a block diagram of the biological signal sensing apparatus shown in FIG. 1 according to an embodiment of the present invention.
3 is a block diagram of the NVR server shown in FIG. 1, in accordance with an embodiment of the present invention.
FIGS. 4A and 4B are views showing unexpected situation information in a plurality of protection facilities according to an embodiment of the present invention.
5 is a flow diagram illustrating a method for monitoring an unexpected condition of a person present in a first care facility, in accordance with an embodiment of the present invention.
6 is a flow diagram illustrating a method for monitoring an unexpected condition of a person present in a first care facility, in accordance with an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as " comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

1 is a conceptual diagram schematically showing a protection facility management system according to an embodiment of the present invention.

Referring to FIG. 1, the protection facility management system is a system for detecting an unexpected situation of persons confined in the protection facility 100.

This protection facility management system includes at least one camera 110 and at least one biological signal sensing apparatus 120-1 and 120-2, a door controller 130 and a NVR (Network Video Recorder) server 140 can do.

A shelter (100) may be a facility for receiving and protecting persons who are forced to live independently in their daily lives due to physical and mental disabilities, and may be a place of detention for those who committed the offense or the offense Do not. The care facility 100 may include, for example, a poultry house, a prison, a detention center, a nursing home, a public facility, and the like.

The protection facility 100 includes a plurality of protection facilities 100-1, 100-2, 100-3 and 100-4, and each of the protection facilities 100-1, 100-2, 100-3, 100-4 A toilet 102 is provided. For example, the police station has a plurality of lockers, and each locker has a toilet.

Each of the plurality of the protection facilities 100-1, 100-2, 100-3, and 100-4 includes a first area corresponding to the area of the toilet 102 and a second area corresponding to the activity area excluding the area of the toilet 102 Region. ≪ / RTI >

The plurality of the protection facilities 100-1, 100-2, 100-3, and 100-4 are provided with at least one security camera 100-1, 100-2, 100-3, A camera 110 is installed. For example, each camera 110 can be installed on the ceiling of the second area to photograph the inner area of the second area and the area of the door area of the second area. In this case, the cameras 110 installed in the second area may be configured to correspond to the number of the plurality of the protection facilities 100-1, 100-2, 100-3, and 100-4, A plurality of cameras 110 may be provided for each of the cameras 100-1, 100-2, 100-3, and 100-4.

The camera 110 installed in each of the protection facilities 100-1, 100-2, 100-3 and 100-4 is connected to the video cameras 100-1, 100-2, 100-3, To the NVR server (140).

A plurality of the protection facilities 100-1, 100-2, 100-3 and 100-4 are connected to the protection facilities 100-1, 100-2, 100-3 and 100-4, At least one biological signal sensing device 120-1 or 120-2 for sensing the biological signal is provided. At this time, the biological signal sensing apparatuses 120-1 and 120-2 may be provided with a plurality of biological signal sensing apparatuses for each of the protection facilities 100-1, 100-2, 100-3, and 100-4.

The biological signal sensing devices 120-1 and 120-2 may include a first biological signal sensing device 120-1 and a second biological signal sensing device 120-2. Here, the first living body signal sensing device 120-1 is installed in a first area corresponding to the area of the toilet 102, and the second living body signal sensing device 120-2 is installed in an activity area As shown in FIG.

The first living body signal sensing device 120-1 and the second living body signal sensing device 120-2 installed in the respective protection facilities 100-1, 100-2, 100-3 and 100-4 are connected to the door controller 130 100-1, 100-2, 100-3, and 100-4 are confirmed by the first and second bio-signal detection devices 120-1 and 120-2, 120-2, respectively, and determine which area the person is located through the reflected electromagnetic waves.

In addition, the first and second bio-signal sensing devices 120-1 and 120-2 may include a first bio-signal sensing device 120-1 and a second bio- The transmission period of the electromagnetic wave of the sensing device 120-2 can be controlled.

For example, it is assumed that one person is present in the first protection facility 100-1, and the first living body signal detection device 120-1 detects the first area of the first protection facility 100-1, The first living body signal sensing device 120-1 installed in the first area transmits an electromagnetic wave at a predetermined cycle, and when the person is located in the second area The second living body signal sensing device 120-2 installed in the living room (area excluding the toilet room 102) can transmit electromagnetic waves at a period longer than a predetermined period. Accordingly, the energy used for driving the bio-signal sensing apparatus can be saved by controlling the transmission period of the electromagnetic waves to the human sensed region and the non-sensed region.

On the other hand, when it is detected that the person who has entered the first area (the area of the toilet 102) of the first protection facility 100-1 by the first living body signal detection device 120-1 moves to the second area The second biosignal sensing device 120-2 installed in the second area changes the period of the electromagnetic wave to a predetermined period in a long cycle to transmit the electromagnetic wave and the first biosignal sensing device 120- 1) can change the period of the electromagnetic wave to be long.

At this time, the first and second living body signal detecting devices 120-1 and 120-2 judge to which area the person is moving based on the measured amount of the reflected electromagnetic waves reflected by the person . If it is determined that the measured amount of the reflected electromagnetic wave reflected by the human being is reduced (that is, it is determined that the first area is being moved to the second area), the first biological signal sensing apparatus 120-1 It is possible to transmit a movement message indicating that the person is moving to the second area. On the contrary, when the second biological signal sensing device 120-2 determines that the measurement amount of the reflected electromagnetic wave reflected by the person is reduced (i.e., if it is determined that the second area is moving to the first area), the NVR server 140 It is possible to transmit a movement message indicating that the person is moving to the first area. Here, whether or not the first living body signal sensing device 120-1 and the second living body signal sensing device 120-2 are driven and the transmission period of the electromagnetic wave are controlled by the NVR server 140 based on the area where the person is located .

In another example, it is assumed that one person is present in the first protection facility 100-1, and the first living body signal detection device 120-1 detects the first living body signal of the first protection facility 100-1, The first living body signal detecting apparatus 120-1 transmits an electromagnetic wave at a predetermined cycle and a second area where no person is present (the toilet 102 ) Excluded area) may be stopped by the NVR server 140. The second bio-signal sensing device 120-2 may be installed in the second bio-signal sensing device 120-2. If the first living body signal sensing apparatus 120-1 detects that a person is moving from the first region to the second region based on the measured amount of the reflected electromagnetic waves, Receives the drive message received from the NVR server 140, and transmits the electromagnetic wave at a predetermined cycle based on the received drive message. At this time, the operation of the first living body signal sensing apparatus 120-1 can be stopped.

On the contrary, when it is detected by the second living body signal sensing device 120-2 that a person is located in the second area of the first care facility 100-1, the second living body signal sensing device 120-2, And the driving of the first living body signal sensing apparatus 120-1 may be stopped by the NVR server 140. [ If the second living body signal detecting device 120-2 detects that the person is moving from the second area to the first area based on the measured amount of the reflected electromagnetic waves, Receives the drive message received from the NVR server 140, and transmits the electromagnetic wave at a predetermined cycle based on the received drive message. At this time, the driving of the second biological signal sensing device 120-2 may be stopped by the NVR server 140. [

The biological signal sensing devices 120-1 and 120-2 can determine the respiration rate and the heart rate of a person on the basis of the reflected electromagnetic waves and determine the respiration rate and the heart rate of the person based on the change in the respiration rate and the heart rate of the person And may transmit the unexpected situation information to the NVR server 140.

It is known that the accuracy of human body signals is relatively low when only human respiration or heart rate is detected. Accordingly, in the present invention, by detecting both the respiration rate and the heart rate of a person, the accuracy of detection of the unexpected information is enhanced.

The biological signal sensing apparatuses 120-1 and 120-2 send out the unexpected situation information of the human biological signals sensed by the respective protection facilities 100-1, 100-2, 100-3, and 100-4 to the NVR server 140).

The door controller 130 is installed on one side of the doors of the respective protective facilities 100-1, 100-2, 100-3, and 100-4 to detect whether the doors are opened or closed. Specifically, the door controller 130 controls entrance and exit of each of the protection facilities 100-1, 100-2, 100-3, and 100-4, -3, 100-4) can be monitored.

The NVR server 140 includes at least one camera 110 installed in each of the protection facilities 100-1, 100-2, 100-3 and 100-4, at least one biological signal sensing device 120-1, 120- 2) and the door controller 130 can be managed.

Specifically, the NVR server 140 manages the images received from the cameras 110 installed in the respective protection facilities 100-1, 100-2, 100-3, and 100-4 and the images received from the plurality of biological signal sensing devices 120- 1, 120-2), the information of the protection facility where an unexpected situation has occurred, the image and respiration rate of the protection facility where the unexpected situation has occurred, and the information of the heart rate can be outputted .

In addition, the NVR server 140 may transmit the information of the protection facility in which an unexpected situation occurs, the image and respiration number of the protection facility in which an unexpected situation occurs, and the heart rate information to the administrator terminal (not shown) of the protection facility 100.

Hereinafter, the operation of each component of the protection facility management system of FIG. 1 will be described in more detail.

FIG. 2 is a block diagram of the biological signal sensing apparatuses 120-1 and 120-2 shown in FIG. 1 according to an embodiment of the present invention.

2, the biological signal sensing apparatuses 120-1 and 120-2 include a radar sensor 200, a phase preprocessing unit 210, a biological signal monitoring unit 220, and an unexpected state information transmission unit 230 . Here, the bio-signal monitoring unit 220 may include a respiratory rate determination unit 222 and a heart rate determination unit 224. However, the biological signal sensing apparatuses 120-1 and 120-2 shown in FIG. 2 are only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

Hereinafter, the biological signal sensing devices 120-1 and 120-2 installed in the first protection facility 100-1 of the plurality of protection facilities 100-1, 100-2, 100-3, I will explain.

The radar sensor 200 transmits an electromagnetic wave to a predetermined area of the first protection facility 100-1 when the entrance of a person to the first protection facility 100-1 is monitored by the door controller 130, It is possible to receive reflected electromagnetic waves reflected by a person present in the first protection facility 100-1. For example, the radar sensor 200 can transmit electromagnetic waves in a specific direction within a first area corresponding to the area of the toilet 102 of the first protection facility 100-1, and the first protection facility 100- The electromagnetic wave can be transmitted in a specific direction within the second area corresponding to the active area other than the area of the toilet 102 in the first area.

The radar sensor 200 may include, for example, a millimeter wave radar sensor, which transmits electromagnetic waves in a specific direction. The millimeter wave radar sensor is a sensor using frequencies between 61 GHz and 70 GHz. The frequency between 61 GHz and 70 GHz has directivity that can concentrate the electromagnetic wave in a specific direction. Since the electromagnetic wave constituted by the frequency having such a directivity characteristic is not affected by other external operations, . For example, when the electromagnetic waves output from the millimiri wave radar sensor are compared with data (RSS values) of reflected electromagnetic waves reflected by people and objects, the object and the person are subjected to different amounts of reflection It is possible to observe the reflection of the amount of the electromagnetic wave and it is possible to distinguish whether the object reflecting the electromagnetic wave is a thing or a person through a regression analysis on the reflected electromagnetic wave with respect to the output electromagnetic wave.

The phase preprocessing unit 210 can extract the frequency from the data of the reflected electromagnetic wave and preprocess the phase of the extracted frequency. Here, the reflected electromagnetic wave data may include a frequency domain including motion information on human respiration. A dominant frequency peak occurs in the frequency extracted from the data of the reflected electromagnetic wave, and the frequency of the frequency peak may be related to the respiration rate of the human being.

The phase preprocessing unit 210 converts the data of the reflected electromagnetic wave into a frequency domain through a Fast Fourier Transform (FFT), and outputs a peak value of a frequency in a frequency region corresponding to a preset frequency range And the phase value of the frequency with respect to time can be measured using the peak value of the detected frequency.

Specifically, the phase preprocessing unit 210 collects data on a plurality of reflected electromagnetic waves (for example, reflected electromagnetic waves that have been directly received and reflected electromagnetic waves that have been reflected N times) that are reflected and returned when the transmitted electromagnetic waves are reflected and returned, Only the data of the same frequency band among the plurality of collected reflected electromagnetic waves can be obtained.

The phase preprocessing unit 210 transforms the data of a plurality of reflection frequencies of the obtained same frequency band into a frequency domain through fast Fourier transform and extracts a frequency related to the respiratory rate and the heart rate from among the converted frequency domain .

The phase preprocessing unit 210 may convert the converted frequency domain into a time domain to detect a peak value and measure a distance between the detected peak values to calculate a correlation coefficient related to a heartbeat of a person.

The phase preprocessing unit 210 may perform phase unwrapping on the extracted frequency. For example, the phase preprocessing unit 210 processes the phase unwrapping by adding or subtracting 2? In phase when the phase difference between the continuous values is larger than or smaller than?, Since the phase value is between [-π, .

The phase preprocessing unit 210 may process a phase difference that subtracts the continuous phase value from the phase on which the phase unwrapping is performed. This processing of the phase difference can improve the accuracy of the human heartbeat data and can help to eliminate the phase deviation.

The bio-signal monitoring unit 220 can perform a spectrum estimation on the frequency at which the phase unwrapping and the phase difference have been processed, thereby determining the respiration rate and the heart rate of a person. Here, the human heart rate and respiratory rate can be determined using the data obtained through Equations (1) to (4). Equation (3) is a formula for filtering the reflection frequency when the distance is R, and Equation (4) is a formula for a frequency to be transmitted. Is a formula for the reflection frequency when only one person is present in the facility.

[Equation 1]

&Quot; (2) "

&Quot; (3) "

&Quot; (4) "

는 주파수이고,

은 위상이다.here,

Is a frequency,

Is a phase.

The frequency at which the phase unwrapping and phase difference are processed includes noise components. This noise component can affect the amplitude movement of the frequency associated with each breathing rate and heart rate of a person. Thus, in order to remove the noise component, the phase unwrapping and phase difference divide the processed frequency waveform into 20 segments per second, and if the frequency energy in the segment exceeds the predefined threshold, The frequency data (noise component) in which the magnitude of the magnitude changes in the presence of a magnitude variation in the waveform can be removed through the first bandpass filter and the second bandpass filter.

The data of the frequency at which the noise components are removed at the frequency where the phase unwrapping and the phase difference have been processed can be classified into the frequency data of the heart rate and the breath rate by the spectrum estimation. On the other hand, it is difficult to confirm the frequency of reflected data for each frequency data only by the frequency data of the separated heart rate and respiration rate. Accordingly, the autocorrelation coefficient is calculated in each frequency data of the separated heart rate and respiration rate, and it is possible to confirm how many frequency frequencies of the frequency data are reflected. Here, the autocorrelation coefficient is calculated through the difference between the frequency data (first reflection frequency) belonging to the first frequency data and the frequency data (second reflection frequency) belonging to the second frequency data in the frequency data of the heart rate and respiratory rate .

The respiration rate and the heart rate of a person can be determined stochastically using frequency data corresponding to the autocorrelation coefficients in the frequency data of the separated heart rate and respiration rate.

Specifically, the respiration number determining unit 222 may extract the frequency of the first band through the first band pass filter at the frequency at which the phase unwrapping and the phase difference are processed. Here, the first band-pass filter may be, for example, a series cascade Bi-Quad IIR filter. The frequency of the first band may be, for example, a frequency included in a frequency band corresponding to 0.1 Hz to 0.5 Hz.

Respiration number determination section 222 can perform spectrum estimation based on at least one of a fast Fourier transform and an auto-correlation function. For example, the respiratory rate determination unit 222 may estimate a spectrum based on a peak-to-peak distance of a time domain waveform using at least one of a fast Fourier transform and an autocorrelation function.

The breathing number determination unit 222 can determine the breathing number of a person based on the result of the spectrum estimation on the extracted frequency of the first band.

The respiratory rate determination unit 222 generates a correlation formula of the respiratory rate with respect to the frequency peak using the frequency related to the respiration rate extracted by the phase preprocessing unit 210, The number of breaths of a person can be determined based on the data of the frequency included in the frequency range (e.g., 0.1 Hz to 0.5 Hz).

The heart rate determining unit 224 may extract the frequency of the second band through the second band pass filter at the frequency at which the phase unwrapping and the phase difference are processed. Here, the second bandpass filter may be, for example, a series cascaded Bi-Quad IIR filter. The frequency of the second band may be, for example, a frequency included in a frequency band corresponding to 0.8 Hz to 4.0 Hz.

The heart rate determining unit 224 may determine whether a frequency peak related to the heartbeat motion exists at the extracted frequency of the second band and estimate a spectrum of the frequency of the second frequency band at which the frequency peak exists.

The heart rate determiner 224 may perform spectrum estimation using at least one of a fast Fourier transform and an autocorrelation function for a frequency of a second band in which a frequency peak exists. For example, the heart rate determiner 224 can estimate a spectrum based on a peak-to-peak distance at a frequency of a second band in which a frequency peak exists using at least one of a fast Fourier transform and an autocorrelation function.

The heart rate determining unit 224 generates a correlation equation of the heart rate with respect to the frequency peak by using the frequency related to the heart rate extracted by the phase preprocessing unit 210 and generates a correlated expression of the heart rate at a predetermined heart rate frequency region 0.0 > Hz) < / RTI > to 4.0 Hz).

The heart rate determining unit 224 can determine the heart rate of a person based on the result of the spectrum estimation on the frequency of the second band and the breath count. Here, the human heart rate is related to the heart rate at the time of autonomous breathing. This is because if the person does not change his / her breathing to his / her will, the respiratory rate will be correlated with the heart rate.

The outbreak state information transmission unit 230 may transmit the outbreak state information including the respiration rate and the heart rate information to the NVR server 140 based on the change of the respiration rate and the heart rate.

For example, the outbreak situation information transmission unit 230 may be configured to transmit the outbreak state information to a predetermined range (for example, a predefined respiration range includes 10 to 12 times per minute, and a predetermined heartbeat range is 70 to 170 times), it is possible to transmit to the NVR server 140 the unexpected condition information including the lower limit value and the upper limit value information of the respiratory rate and the lower limit value and the upper limit value information of the heart rate.

For example, when the respiration rate and the heart rate of a person are increased due to a person's exercise or the like, when the respiration rate and the heart rate of a person are measured as the upper limit value, the unexpected situation information transmission unit 230 It may not transmit the unexpected situation information to the NVR server 140. If sudden changes in the respiratory rate and heart rate of a person are detected within one minute, the abrupt situation information transmission unit 230 may transmit the abrupt status information to the NVR server 140. [

For example, the outbreak state information transmission unit 230 may transmit the respiration rate and duration information of the upper limit value information to the NVR server 140 together with the respiration rate and the heart rate information.

The person skilled in the art will appreciate that the radar sensor 200, the phase preprocessing unit 210, the bio-signal monitoring unit 220, the respiratory rate determination unit 222, the heart rate determination unit 224, May be implemented separately, or one or more of them may be implemented in unison.

3 is a block diagram of the NVR server 140 shown in FIG. 1, in accordance with one embodiment of the present invention.

Referring to FIG. 3, the NVR server 140 may include a controller 300, an image receiver 310, an image output unit 320, and an unexpected information receiver 330. However, the NVR server 140 shown in FIG. 3 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG. Hereinafter, FIGS. 4A and 4B will be described with reference to FIG.

The control unit 300 controls the driving of the plurality of cameras 110 and the biological signal sensing devices 120-1 and 120-2 provided in the plurality of protection facilities 100-1, 100-2, 100-3, Can be controlled. At this time, each of the plurality of the protection facilities 100-1, 100-2, 100-3, and 100-4 corresponds to the first area corresponding to the area of the toilet 102 and the area other than the area of the toilet 102 And a second area.

Specifically, the controller 300 controls each of the protection facilities 100-1, 100-2, 100-3, and 100-4 by each door controller 130 provided for each of the plurality of protection facilities 100-1, 100-2, 100-3, , 100-3 and 100-4 of the protection facilities 100-1, 100-2, 100-3, and 100-4, the plurality of cameras 110 and the biological signal sensing apparatuses 120-1, and 120-2 can be controlled by controlling the camera 110 and the biological signal sensing devices 120-1 and 120-2.

For example, if the entrance of the first person to the first protection facility 100-1 is confirmed by the door controller 130, the control unit 300 controls the camera 110 installed in the first protection facility 100-1, The first living body signal detecting device 120-1, and the second living body signal detecting device 120-2.

When the door controller 130 detects that a person is leaving the protection facilities 100-1, 100-2, 100-3 and 100-4, the control unit 300 controls the protection facilities 100-1, 100-2, 100-3, and 100-4 can stop driving the camera 110 and the biological signal sensing apparatuses 120-1 and 120-2.

For example, when the first person leaves the first protection facility 100-1, the controller 300 controls the camera 110 installed in the first protection facility 100-1, the first living body signal detection device 120 -1) and the second biological signal sensing apparatus 120-2.

The control unit 300 controls whether or not the first and second living body signal sensing apparatuses 120-1 and 120-2 are driven based on a region (first region or second region) in which a person is located can do.

For example, it is assumed that one person is present in the first protection facility 100-1, and the first living body signal detection device 120-1 detects the first area of the first protection facility 100-1, (The area of the toilet 102), the control unit 300 transmits a control command to the first living body signal sensing device 120-1 installed in the first area to transmit the electromagnetic wave at a predetermined cycle And transmits a control command to stop the driving to the second bio-signal sensing device 120-2 installed in the second area.

For example, when the control unit 300 receives a movement message indicating that a person is moving from the first area to the second area from the first living body signal sensing device 120-1, the second living body signal sensing device 120 -2 to the first living body signal sensing device 120-1, and transmits a message to stop the driving of the first living body signal sensing device 120-1.

The image receiving unit 310 can receive images from the plurality of cameras 110 in the plurality of protection facilities 100-1, 100-2, 100-3, and 100-4.

The video output unit 320 can output images in a plurality of the protection facilities 100-1, 100-2, 100-3, and 100-4 in real time using an administrator terminal (not shown) of the protection facility 100 .

For example, the video output unit 320 can output an internal image of each of the protection facilities 100-1, 100-2, 100-3, and 100-4, an image of a doorway area, and the like in real time.

The video output unit 320 outputs the video of the inside of each of the protection facilities 100-1, 100-2, 100-3, and 100-4 and the video of the entrance area to the administrator terminal ).

The screen of the video output unit 320 or the administrator terminal (not shown) is displayed on the number of cameras 110 installed in each of the protection facilities 100-1, 100-2, 100-3, and 100-4 The images photographed by the respective protection facilities 100-1, 100-2, 100-3, and 100-4 can be output for each divided screen area.

For example, an image photographed by the first camera of the first protection facility 100-1 is output to the first screen area 400, and a second protection facility 100-2 The third camera of the third protection facility 100-3 outputs an image photographed by the second camera of the third protection facility 100-3 and the fourth image area 406 , An image photographed by the fourth camera of the fourth protection facility 100-4 may be output.

The outbreak situation information receiving unit 330 receives a plurality of biological signal sensing devices 120-1 and 120-2 provided in a plurality of the protection facilities 100-1, 100-2, 100-3, and 100-4, (100-1, 100-2, 100-3, 100-4). Here, the unexpected condition information may include numerical information on the respiration rate and the heart rate of a person present in each of the protection facilities 100-1, 100-2, 100-3, and 100-4.

The image output unit 320 outputs image data of a person who exists in each of the protection facilities 100-1, 100-2, 100-3, and 100-4 received from the plurality of biological signal sensing apparatuses 120-1 and 120-2 It is possible to output the outbreak situation information in real time.

For example, as shown in FIG. 4A, the video output unit 320 displays images of the respective protection facilities 100-1, 100-2, 100-3, and 100-4, 2, 100 - 3, and 100 - 4) of the first living body signal is output from the first living body signal detecting device 120 - 1, And may output the unexpected condition information including numerical information on the respiration rate and the heart rate of the person measured by the signal sensing device 120-2.

The video output unit 320 outputs information on the protection facility where an unexpected situation has occurred, the image and respiration number of the protection facility in which an unexpected situation has occurred, and the information on the heart rate based on the unexpected situation information to the administrator terminal (not shown) .

Referring to FIG. 4B, the image output unit 320 may output the image data of a person in the first protection facility 100-1 among the plurality of protection facilities 100-1, 100-2, 100-3, When the human body abnormality signal (for example, the respiratory rate of a person is out of a predetermined breathing range (10 to 12 times per minute) or the heart rate of a person is out of a preset heart rate range (70 to 170 times per minute) An alarm screen 408 including numerical information of the first protection facility 100-1, the image of the first protection facility 100-1, the respiration rate of the person, the heart rate and the urgent heart rate is detected ) To the administrator terminal (not shown) of the protection facility 100.

Those skilled in the art will appreciate that the control unit 300, the image receiving unit 310, the image output unit 320, and the unexpected information receiving unit 330 may be separately implemented, or at least one of them may be integrated I will understand.

5 is a flowchart illustrating a method of monitoring an unexpected situation of a person present in the first care facility 100-1, according to an embodiment of the present invention.

5, in step S501, the NVR server 140 accesses the first protection facility 100-1 through the door controller 130 installed in the first protection facility 100-1, It is possible to monitor the departure of a person from the facility 100-1.

In step S503, when the entrance of a human being is confirmed to the first protection facility 100-1, the NVR server 140 sets the camera 110 and the bio-signal detection device (not shown) installed in the first protection facility 100-1 120-1, and 120-2.

In step S507, the NVR server 140 receives the image in the first protection facility 100-1 from the camera 110 installed in the first protection facility 100-1, And output the image to the administrator terminal (not shown) of the protection facility 100.

In step S509, the NVR server 140 receives the unexpected human condition information from the biological signal sensing apparatuses 120-1 and 120-2 installed in the first protection facility 100-1, 1 information of the protection facility 100-1, images, respiration rate and heart rate information of a person to the administrator terminal (not shown) of the protection facility 100. [

In the above description, steps S501 to S509 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

6 is a flowchart illustrating a method of monitoring an unexpected condition of a person existing in the first care facility 100-1, according to an embodiment of the present invention.

6, in step S601, the biological signal sensing devices 120-1 and 120-2 transmit radio waves to a predetermined area of the first care facility 100-1, and transmit the radio waves to the first care facility 100-1 Can receive reflected electromagnetic waves reflected by a person present in the antenna.

In step S603, the biological signal sensing apparatuses 120-1 and 120-2 can extract frequencies from the received reflected electromagnetic wave data.

In step S605, the biological signal sensing devices 120-1 and 120-2 can process phase unwrapping for the extracted frequency.

In step S607, the biological signal sensing apparatuses 120-1 and 120-2 can process the phase difference to the phase in which the phase unwrapping has been performed.

In step S609, the biological signal sensing devices 120-1 and 120-2 can extract the frequency of the first band through the first band pass filter at the frequency at which the phase unwrapping and the phase difference are processed.

In step S611, the biological signal sensing apparatuses 120-1 and 120-2 can perform a spectrum estimation on the frequency of the extracted first band to determine the number of breaths of a person.

In step S613, the biological signal sensing devices 120-1 and 120-2 may extract the frequency of the second band through the second band-pass filter at the frequency at which the phase unwrapping and the phase difference are processed.

In step S615, the biological signal sensing devices 120-1 and 120-2 can perform spectrum estimation on the extracted frequency of the second band.

In step S617, the biological signal sensing apparatuses 120-1 and 120-2 can determine the human heart rate based on the result of the spectrum estimation on the respiration rate of the determined person and the frequency of the second band.

In the above description, steps S601 to S617 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer readable medium may include both computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100: Protective Facility
110: camera
120-1, 120-2: biological signal detection device
130: Door control unit
140: NVR server
200: Radar sensor
210: Phase preprocessing section
220: biological signal monitoring unit
222: Respiration number determination unit
224: heart rate determining unit
230: an unexpected situation information transmission unit
300:
310:
320:
330:

Claims (15)

In a protected facility management system,
A plurality of biological signal detection devices installed in a protection facility;
A plurality of cameras installed in the protection facility; And
A plurality of biological signal sensing devices, an NVR (Network Video Recorder) server managing the plurality of cameras,
Lt; / RTI >
Wherein the plurality of bio-signal sensing devices comprise:
A radar sensor that transmits electromagnetic waves to a predetermined area of the protection facility and receives reflected electromagnetic waves reflected by a person in the protection facility;
A phase preprocessing unit for extracting a frequency from the data of the reflected electromagnetic wave and preprocessing the phase of the frequency;
A bio-signal monitoring unit for performing a spectrum estimation on the frequency to determine a respiration rate and a heart rate of the person; And
And an abrupt situation information transmission unit for transmitting the abrupt situation information including the respiration rate and the heart rate information to the NVR server based on the change of the respiration rate and the heart rate,
, ≪ / RTI &
Wherein the NVR server includes a controller for controlling driving of the plurality of cameras and the plurality of bio-signal sensing devices,
Wherein the control unit controls the plurality of cameras and the plurality of vital sign sensing devices so that the plurality of cameras and the plurality of vital sign sensing devices are driven after the person is confirmed to be in the protective facility,
The bio-signal monitoring unit may include a respiration number determination unit for extracting a frequency of a first band through a first band pass filter, performing a spectrum estimation on the frequency of the first band, ; And
A second band pass filter for extracting a frequency of a second band, performing a spectrum estimation on the frequency of the second band, performing a spectrum estimation on the frequency of the second band, A heart rate determining unit for determining a heart rate of a person,
Wherein the respiratory rate determining unit and the heart rate determining unit perform the spectral estimation based on at least one of a Fast Fourier Transform (FFT) and an Auto-Correlation function.
delete The method according to claim 1,
The NVR server,
An image receiving unit for receiving images from the plurality of cameras in the plurality of protection facilities; And
And a video output unit
The protection facility management system.
The method of claim 3,
The NVR server,
An abrupt situation information receiver for receiving the abrupt situation information from the plurality of bio-
Further comprising:
Wherein the image output unit outputs information of the protection facility where an unexpected situation occurred, information of the protection facility where the unexpected situation occurred, information of the respiratory rate and heart rate based on the unexpected situation information.
The method according to claim 1,
Wherein the protection facility comprises a first zone and a second zone,
Wherein the plurality of bio-signal sensing devices include a first bio-signal sensing device and a second bio-signal sensing device,
Wherein the first area is provided with the first living body signal sensing device and the second area is provided with the second living body signal sensing device.
The method according to claim 1,
Wherein the radar sensor is a millimeter wave radar sensor.
The method according to claim 6,
Wherein the millimeter wave radar sensor uses frequencies between 61 GHz and 70 GHz.
The method according to claim 1,
A door control unit for controlling entry / exit of the protection facility and monitoring the entrance of the person into the protection facility;
Further comprising: a protection system management system for managing the protected facility management system.
delete delete The method according to claim 1,
Wherein the phase preprocessing unit processes phase unwrapping for the frequency and processes the phase difference that subtracts a continuous phase value for the phase in which the phase unwrapping is processed. system.
delete delete The method according to claim 1,
Wherein the frequency of the first band is 0.1 Hz to 0.5 Hz.
The method according to claim 1,
Wherein the frequency of the second band is 0.8 Hz to 4.0 Hz.

Images