KR102250424B1 - Monitoring apparatus for self-quarantined person and method using the same - Google Patents

Abstract

The present invention provides a device and method, wherein control of a self-quarantined person monitoring device installed in a residence in an emergency such as an epidemic pandemic is transferred to national authorities or medical authorities, and if a self-quarantined person leaves a designated residence, the self-quarantined person out of the designated residence is automatically reported to the medical authority. Therefore, an epidemic management system for patients with suspected disease including the self-quarantined person is quickly established, and the patients with suspected disease are efficiently managed from epidemic spread.

Description

Self-isolator monitoring device and method using the same {MONITORING APPARATUS FOR SELF-QUARANTINED PERSON AND METHOD USING THE SAME}

The present invention transfers control of the “self-quarantine monitoring device” installed in the residence in an emergency country such as a pandemic pandemic to the national authorities or medical authorities, and automatically reports to the medical authorities when the person subject to self-isolation deviates from the designated residence. We provide devices and methods to quickly establish an infectious disease management system for patients with suspected diseases, including self-isolators, and to efficiently manage them from the spread of infectious diseases.

With the recent increase in hospital infrastructure along with cutting-edge medical equipment technology, many people are receiving abundant medical benefits, and humanity has been promoting more happiness than in the past by extending the lifespan and improving the quality of life.

However, due to the development of transportation and urbanization, it is difficult to prevent the spread of the disease with the existing hospital infrastructure and medical services when a global epidemic emerges. In particular, the unauthorized departure of a person subject to self-isolation has emerged as a potential public risk to the spread of these diseases, and to prevent this, the medical authorities recommend that the self-isolated person wear a wristband (electronic bracelet) to determine whether the self-isolation person has been separated. Watching and checking.

Such a wristband is a band-type wearable device worn on the wrist that is interlocked with a smartphone through Bluetooth wireless communication technology, and an'App for self-isolator management' is installed on the smartphone of the self-isolator. While operating by linking between the smartphone and the smartphone via Bluetooth, the self-isolator's GPS (Global Positioning System) information is reported to the authorities through the smartphone. Through this, it is possible to determine whether the self-isolator has left the residence. In addition, when the self-isolated person is more than 20m away from the smartphone, a “beep” alarm sounds in real time to the central government control. Therefore, self-isolators should always carry a wristband and a smartphone together. On the other hand, when the quarantine official who has confirmed the notification contacts the official in charge, the official in charge immediately visits the site and checks whether the self-quarantine has escaped. However, if you deliberately loosen the wristband and leave it at home with your smartphone and go out, it is difficult to detect the fact of unauthorized departure.

The technology behind the present application is disclosed in Korean Laid-Open Patent Publication No. 10-2020-0047457.

The present application is intended to solve the problems of the prior art described above, and when the control of the self-isolated person monitoring device of the present invention is transferred to a national authority or a medical authority in an emergency country such as an infectious disease pandemic, the person subject to self-isolation deviates from the designated residence. In one case, it provides a self-isolation monitoring device and a method using the same that can prevent the spread of disease by automatically reporting it to the medical authorities. In the case of the present invention, the self-isolator does not need to wear a wristband, and even when the mobile phone is placed at home (residential) and goes out, it provides an advantage of being able to grasp whether or not it has been separated in real time.

In addition, the present invention provides an advantage of being able to grasp in real time whether the mobile phone is disconnected, even if there is no cell phone or a breakdown, or even if the battery (battery) is discharged.

In addition, in the present invention, when such a self-isolator monitoring device is on the ceiling, it is possible to constantly monitor whether the self-isolator leaves the residence most optimally, including during sleep. It is preferred to have a structure that incorporates type lighting fixtures.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

The present invention was conceived to solve the problems of the prior art, and the self-isolator monitoring device of the present invention includes a high-resolution radar sensor for non-contact checking of the self-isolator's breathing pulse signal, and heat radiated from the self-isolator's body. A thermal imaging camera to determine the presence of a self-isolator in a given space by providing an image image or tracking heat and observing the heat change, an image sensor to determine whether the self-isolator is moving through an image variation check, and the body of the self-isolator A living body signal collecting means comprising at least one selected from an infrared human body detection sensor for detecting the movement of the self-isolator through an infrared fluctuation check emitted from the self-isolator and a microphone for determining the presence or absence of a breathing sound or a living sound of the self-isolator; A digital communication module that provides communication with medical authorities or provides a Bluetooth or Wi-Fi communication connection with a self-isolating cell phone; An energy fluctuation curve calculation unit for calculating an energy change over time from a signal obtained from the living body signal collecting means; A self-isolation departure discrimination unit implemented in an artificial intelligence neural network that has been learned in advance by a database formed by the energy fluctuation curves labeled as residence departure and non-departure; A control unit for driving the digital communication module to transmit a suspected departure signal to a medical authority terminal when it is determined that the self-isolated person has deviated from the designated residence; And a control right transfer means for transferring the control right of the control unit to the medical authority.

In addition, the living sounds include sound sounds generated when the self-isolator lives in a self-isolated residence, such as the sound of footsteps, the sound of the door, and the sound of speech generated when making a phone call.

The detection and collection information of the living signal obtained from the living signal collecting means may be used to determine the presence or absence of a living organism (self-price target) in the residence.

Preferably, another aspect of the living body signal collecting means is provided with a plurality of microphones that are connected to the digital communication module and Bluetooth/Wi-Fi/Internet of Things (Internet　of Things) to provide various spaces in the residence, such as living rooms, bedrooms, and crossing rooms. , Kitchen, characterized in that it further comprises a near-field noise collection microphone capable of listening to the noise from the door, voice, breathing sound and living sound in parallel.

Preferably, another aspect of the self-isolator monitoring device further includes an artificial intelligence neural network for detecting the door sound learned based on a database including various door closing sounds collected from the microphone input, so that the door closing sound is detected. If so, the control unit transmits a suspected departure signal for the self-isolated person to the terminal of the medical authority through the digital communication module and reports the report.

The door sound includes an electronic door sound (melody).

Preferably, the control unit may determine that the self-isolator has gone outside when recognizing the door sound by the door sound detection artificial intelligence neural network in a situation where the self-isolator is in the residence.

Preferably, the energy fluctuation curve calculation unit includes hourly sound energy for the breathing sound or life sound of the self-isolator obtained from the microphone or the high-resolution radar sensor, or a thermal image by time according to the movement change of the self-isolator obtained from the thermal imaging camera. It is preferred to calculate the variable energy value on the image.

The sound energy and the fluctuating energy in the thermal image can be used to determine whether a self-isolating person exists in the residence because it is possible to grasp a bio-signal or a degree of movement generated from the self-isolator.

Preferably, another aspect of the thermal imaging camera is provided with a plurality of thermal imaging cameras connected to the digital communication module via Bluetooth, Wi-Fi, and Internet of Things, such as a living room, a living room, a living room, a kitchen, a door. It is characterized in that it provides a variable energy value on a thermal image image over time according to a change in the motion of the self-isolator.

The transfer means of control of the present invention is for a self-isolated person to transfer control of a self-isolated person monitoring device to a national authority or a medical authority at the request of a medical authority in a national emergency, especially in an emergency such as an infectious disease pandemic. In the case of transfer, (1) the control unit automatically reports and reports whether the self-isolated person has left the residence by using the digital communication module, and (2) the national authority or medical authority monitors the self-isolated person. It is preferred to allow reading of recent self-isolator information (eg, personal information, overseas entry/exit information) and quarantine history information stored in the storage device of the device.

The high-resolution radar sensor is a radar that can measure the self-isolator's breathing pulse without direct contact with the human body using UWB (Ultra Wide Band) pulses. It is measured using a Doppler radar that measures minute vibrations on the skin surface of the human body according to the movement of the body.

Another aspect of the self-isolator monitoring device of the present invention is a GPS origin composed of a digital communication module installed in the self-isolator's residence to provide communication with medical authorities or to provide Bluetooth and Wi-Fi connection with the self-isolator's mobile phone. ; The self-isolator not only resides in the mobile phone of the self-isolator, but also determines whether the self-isolator is separated from the designated residence using information on the strength of the Bluetooth and Wi-Fi connection between the mobile phone and the GPS origin, or distance information between the GPS origin and the mobile phone, In case of departure, a “self-isolation management app” (App) equipped with a connection strength measuring unit that transmits a suspected departure signal to the terminal of the medical authority, is installed (mounted) in the “self-isolation management app”, and at the same time on the mobile phone of the self-isolating person. Equipped with a dialing unit that makes a call by auto dialing and an identity authentication unit for authenticating the identity of the self-isolating person, the self-isolator does not answer the phone or the identity is not authenticated by making a direct call to the self-isolating person through the dialing unit. If not, it is characterized by having an autodialing and check means for determining that the self-isolated person has deviated from the place of residence and transmits a signal of the self-isolator's departure to the terminal of the medical authority.

Preferably, the dialing unit installed in the “self-isolation management app” is a virtual telephone connection made through virtual dialing rather than a telephone connection through a base station, and the dialing unit generates a fake call reception sound, and when the self-isolator receives a call The self-isolator's identity is authenticated through the identity authentication unit.

Another aspect of the "self-isolation management app" preferably includes the GPS location of the self-isolator's mobile phone when the right to track the location of the mobile phone is transferred to the medical authority; The distance information between the GPS origin and the mobile phone calculated by the self-isolation management app is automatically reported to the digital communication module or the medical authority terminal at predetermined time intervals.

In this case, if the self-isolated departure determination unit determines that the self-isolated person has deviated from the radius of the residence based on the GPS location reported through the digital communication module or the distance information between the GPS origin and the mobile phone, the medical authority terminal suspects the self-isolator's departure. Report the transmission of a signal.

Preferably, the identity authentication unit makes a virtual call to the self-isolator's mobile phone by the dialing unit, and when the self-isolator receives the call, a voice reproducing unit and the voice query for making a voice query to the self-isolator or requesting fingerprint authentication Self-isolation of the self-isolator's response to the voice by performing speaker recognition (speaker recognition) or by providing a self-isolator identification unit that performs fingerprint recognition to perform self-isolator's identity authentication and self-isolation at the terminal of the medical authority It sends out a signal of suspicion of a person's departure.

The GPS origin in the present invention may be a GPS coordinate of the digital communication module.

Preferably, the “self-quarantine management app” may calculate the distance between the GPS origin and the mobile phone based on the strength information of the wireless communication (eg, Wi-Fi, Bluetooth) connection signal. In addition, when the strength of the connection signal is weakened below the reference value or the connection attempt is unsuccessful, the “self-isolation management app” determines that the self-isolator's mobile phone is out of the short-range communication area, and determines that the self-isolator has deviated from the radius of the residence. It is possible to transmit (report) a signal of suspicion of the self-isolator's departure to the authorities' terminal.

Preferably, another aspect of the “self-isolation management app” is to calculate the distance between the GPS origin and the mobile phone by using the GPS information of the mobile phone of the self-isolator, and if the distance is more than a predetermined distance from the GPS origin, the “self-isolation management App” can determine that the self-isolated person has left the residence and transmit (report) a signal of suspicion of the self-isolator's departure to the terminal of the medical authority.

The radius of the residence is preferably about 20 m.

The self-isolator's suspected departure signal reported to the medical authorities is a digitized message signal that the “self-isolation management app” sends to the medical authority terminal in a situation where the self-isolator's departure is suspected, and includes information of the self-isolator (e.g., residence address , Name, gender, mobile phone number, e-mail address, social security number, etc.) are preferred.

Preferably, another aspect of the connection strength measurement unit of the self-isolation management app further includes a mobile data stop means for temporarily stopping the use of mobile data of the self-isolator's mobile phone, and a period for checking whether the self-isolator is separated from the residence During the period, after pausing the use of mobile data, the self-isolator's cell phone and the GPS origin are checked for the strength of the Wi-Fi connection, and if the strength of the Wi-Fi connection signal is weakened below the reference value or the connection attempt fails, the self-isolator is deemed to have left the residence. It determines and transmits a signal of suspicion of the self-isolator's departure to the terminal of the medical authority.

This is to temporarily suspend the use of mobile data during the Wi-Fi strength measurement because it is difficult to measure the Wi-Fi strength with the GPS origin when the cell phone of the self-quarantine is using mobile data.

Preferably, another aspect of the connection strength measurement unit of the self-isolation management app further includes a mobile data connection means for forcibly activating the mobile data use of the self-isolator's mobile phone, and checks whether the self-isolator is separated from the residence During the period, after forcibly activating the use of mobile data using an app on the self-isolator's cell phone, the distance between the GPS origin and the location of the cell phone is determined to determine whether the self-isolator has escaped, and if the self-isolator has left the residence. When it is determined, the GPS origin and current location information of the self-isolator are transmitted to the terminal of the medical authority along with a signal of suspicion of departure of the self-isolated person.

The self-isolator is in the residence, but there are spaces where Wi-Fi does not work well. Therefore, in order to determine the GPS location of the self-isolator's mobile phone, the mobile data connection means must be forcibly switched (converted) to the mobile data use mode for about 1 to 10 seconds during the period in which the self-isolator's departure is checked.

Preferably, the mobile data stop means and the mobile data connection means return to the original mobile data usage state after completion of checking whether or not the self-isolator has been separated.

It is preferred that the mobile data stop means and the mobile data connection means are activated (executed) at regular time intervals to check whether the self-isolator is separated. For example, it is preferred to check whether or not to leave at a selected time interval from 10 to 60 minutes, depending on the degree of suspicion of departure or the frequency of the number of departures.

Preferably, the autodialing and check means includes the living organism signal collection means, a near-field noise collection microphone (see FIGS. 1B and 1C), a fingerprint recognition unit (see FIGS. 1B and 1C), and wireless communication technology. If there is a strong suspicion that the self-isolator does not exist in the residence by means (Wi-Fi and Bluetooth), it is preferred to use it as a final means to determine whether the self-isolator has left the residence. Depending on the frequency, it is more preferable to activate and check at a selected time interval among 10 to 60 minutes intervals.

Preferably, the autodialing and check means further includes a ringing size adjustment means, and if the self-isolator does not answer the phone several times, it is preferred to gradually increase the ringing volume and duration of the phone ringing. During auto dialing and check, the phone ring silence process set by the mobile phone user is temporarily ignored during auto dialing and check.

Another aspect of the autodialing and check means preferably resides on a mobile phone app, and a mobile phone ringtone generating means for outputting a phone ring tone while varying the size of the mobile phone ringing sound and the type of ring tone according to time; A fingerprint sensor unit for each space prepared for each individual space on the residence of the self-isolator, as well as wirelessly connected to the mobile phone based on the Internet of Things; A short-range noise collection microphone to be wirelessly connected to the mobile phone based on the Internet of Things, as well as to collect a phone call sound from the mobile phone call sound generating means; And a sound sound synchronization similarity calculation unit for calculating a similarity between the sound collected from the near-field noise collecting microphone and the phone call sound, wherein fingerprint authentication of the self-isolator succeeds by the space-specific fingerprint sensor unit, and at the same time, the sound sound synchronization similarity calculation unit When the similarity calculated by is equal to or greater than a predetermined value, it is characterized in that it is determined that the self-isolator is staying in the residence.

The sound-sound synchronization similarity calculation unit calculates how well the synchronization (synchronization) between the sound collected from the near-field noise collecting microphone and the telephone ringing sound is well matched and similar. When the self-isolator and the mobile phone live together in the same residence, the synchronization similarity is Big.

Preferably, another aspect of the control unit is self-isolation based on information obtained by the living body signal collection means, the near-field noise collection microphone (examples of FIGS. 1B and 1C) to the fingerprint recognition unit (examples of FIGS. 1B and 1C). When it is suspected that the self-isolator is separated by the determination unit, the control unit commands the self-isolation management app to forcibly execute (activate) the auto dialing and check means through the digital communication module.

Another aspect of the “self-isolation management app” is preferably, the walking movement of a self-isolator who walks with a mobile phone, the tilt of the mobile phone over time, or the ambient sound fluctuation through the microphone input of the mobile phone itself, calculated as energy over time. The mobile phone input energy calculation unit is further provided, and when the mobile phone input energy is less than or equal to a predetermined value, the autodialing and check means is periodically executed, and the identity of the isolator is authenticated every time through this. It is done.

Preferably, another aspect of the "self-isolation management app" is that the medical authority terminal is preferred to command the self-isolation management app on the self-isolator's mobile phone to execute an auto-dialing and check function when necessary, and from the medical authority terminal The self-isolation management app that has received an auto-dialing and check execution command is characterized by periodically activating an autodialing and check means, and performing self-isolator identity authentication each time.

The voice reproducing unit is characterized by reproducing a voice message for proceeding with a predetermined question to a self-isolator. For example, “Please tell me your name” “Please tell me where you live” “What time is it now?” Or, it may be a question such as "Please follow what I am saying" or "Please verify your fingerprint." In this case, the self-isolation management app records the self-isolator's response to the voice query and stores it in memory. Preferred.

The artificial intelligence neural network of the present invention is preferably machine learning, a convolutional neural network (CNN), or a recurrent neural network (RNN).

In the present invention, the artificial neural network is a neural network that allows deep running learning. Unpooling layer, 1x1 convolution layer, Skip connection, Global Average Pooling (GAP) layer, Fully Connected layer, SVM (support vector machine), LSTM (long short term memory), Atrous convolution ( Atrous Convolution), Atrous Spatial Pyramid Pooling, Separable Convolution, and Bilinear Upsampling. It is preferable that the artificial intelligence neural network further includes an operation unit for batch normalization calculation in front of the ReLu layer.

The thermal imaging camera of the present invention is a device that generates a thermal image, and tracks heat with a device that detects heat radiation emitted from the body using infrared rays, visualizes it in various colors according to the temperature of the body surface, and displays it in the form of an image. It is a device that detects and displays it on the screen at a glance.

Preferably, another aspect of the thermal image of the present invention is characterized in that an image of a general camera, such as an image sensor, is obtained by overlapping the thermal image, and in this case, the outline boundary and details of the body are displayed on the body image. It is very advantageous in obtaining a clearer body image.

Another aspect of the self-isolator monitoring method performed by the self-isolator monitoring device of the present invention includes the steps of registering a GPS origin by Bluetooth or Wi-Fi connection between the self-isolator monitoring device and the self-isolator's mobile phone; Requesting, by a terminal of the medical authority, the self-isolator for control of the self-isolator monitoring device; A step in which the self-isolator transfers the position tracking control right of the self-isolator monitoring device or the self-isolator's mobile phone to a terminal of the medical authority through a predetermined authentication procedure through a computer app or a mobile app using the self-isolator's mobile phone. ; If it is determined that the self-isolated person has deviated from the designated residence by the living organism signal collecting means, reporting a suspected departure to a medical authority terminal; Measuring Bluetooth and Wi-Fi connection strength information between the mobile phone of the self-isolator and the GPS origin, or determining whether the self-isolating person is separated from a designated residence using distance information between the GPS origin and the mobile phone ; It is characterized by providing a self-isolator monitoring method including an auto-dialing and check step of authenticating the identity of the self-isolator by making a virtual phone call to the self-isolator's mobile phone by auto dialing.

Preferably, the self-isolator monitoring method. Any selected from among the steps of collecting the living sound using a near-field noise collection microphone or the step of periodically executing the auto dialing and checking means when the input energy of the mobile phone is less than a predetermined value, and authenticating the identity of the self-isolating person through it every time. It characterized in that it further comprises one step.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-described means of solving the problems of the institute, the control of the “self-isolated person monitoring device” installed in the residence in an emergency country such as an infectious disease pandemic is transferred to the national authorities or medical authorities, and when the person subject to self-isolation deviates from the designated residence, medical treatment is automatically performed. By having them report to the authorities, we provide devices and methods to quickly establish an infectious disease management system for self-isolated and other suspected disease patients, and to efficiently manage them from the spread of infectious diseases.

However, the effect obtainable in the present application is not limited to the above-described effects, and other effects may exist.

1A is an embodiment for monitoring in real time whether a self-isolation subject lives in a designated residence without going outside the quarantine area using the self-isolation person monitoring device according to an embodiment of the present application.
1B is an embodiment of a self-isolator monitoring apparatus using a near-field noise collection microphone connected to a mobile phone of a self-isolator and an Internet of Things according to an embodiment of the present application.
FIG. 1C is an embodiment of a self-isolator monitoring apparatus when a cell phone of a self-isolator is broken, a battery (battery) is discharged, or the self-isolator does not have a cell phone according to an embodiment of the present invention.
2 is an exemplary embodiment in which a self-isolator monitoring device is integrated and installed in a ceiling type air conditioner body according to an exemplary embodiment of the present disclosure.
3 is an embodiment in which a self-isolator monitoring device is integrated and installed in a body of a ceiling light fixture according to an embodiment of the present application.
4 is an embodiment in which the self-isolator monitoring device according to an embodiment of the present application is installed in the form of a set top box.
5 to 6 is another embodiment of the signal collecting means for living organisms according to an embodiment of the present application, in parallel collecting noise, voices, and living sounds from several independent spaces in a residence, such as living room, master room, crossing room, kitchen, door This is an embodiment of a near-field noise collection microphone provided to the digital communication module through a Bluetooth connection or an Internet connection.
7 is an embodiment of an energy fluctuation curve calculation unit according to an embodiment of the present application.

Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout this specification, when a part is said to be "connected" with another part, it is not only the case that it is "directly connected", but also "electrically connected" or "indirectly connected" with another element interposed therebetween. It also includes the case where it is ”.

Throughout the present specification, when a member is positioned "on", "upper", "upper", "under", "lower", and "lower" of another member, this means that a member is located on another member. This includes not only the case where they are in contact but also the case where another member exists between the two members.

In the entire specification of the present application, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Patients in the present invention may be used in combination with self-isolation subjects and self-isolators.

In addition, the medical authorities in the present invention may be used interchangeably with national authorities, quarantine authorities or disease management authorities.

The mobile phone in the present invention refers to a mobile terminal including a tablet PC and a notebook computer. As an example, the mobile terminal is a device that is interlocked with the medical authority terminal 55 through a network, for example, a smartphone, a smart pad, a tablet PC, a wearable device, etc., and a personal communication system (PCS). , Global System for Mobile communication (GSM), Personal Digital Cellular (PDC), Personal Handyphone System (PHS), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT)-2000, Code Division Multiple Access (CDMA)-2000, It may be all kinds of wireless communication devices such as W-Code Division Multiple Access (W-CDMA) and Wireless Broadband Internet (Wibro) terminals, and fixed terminals such as desktop computers and smart TVs.

The subject of self-isolation is a person who has been in contact with an infected person, a person who has been suspected of being in contact with a person who has been infected, and is judged to have been exposed to an infectious agent, and must live alone in a designated place to prevent the spread of the disease to other people. It can be a patient.

1A is an implementation of a self-isolator monitoring device 40 for real-time monitoring whether a self-isolation target lives in a designated residence without going out of the quarantine area using the self-isolator monitoring device according to an embodiment of the present application Yes.

Referring to FIG. 1A, the self-isolator monitoring device 40 may include a high-resolution radar sensor 52 for non-contactly checking the breathing pulse signal of the self-isolator. In addition, it may include a thermal imaging camera 22 that provides a thermal image imaged of heat radiated from the body of the self-isolator. In addition, the self-isolator monitoring device 40 may include an image sensor 29 for determining whether the self-isolator is moving through an image change check. In addition, the self-isolator monitoring apparatus 40 may include an infrared human body detection sensor 28 that detects whether the self-isolator moves or not through a fluctuation check of infrared rays emitted from the body of the self-isolator. In addition, the self-isolator monitoring device 40 may include a living body signal collecting means 20 composed of at least one selected from a microphone 6 for collecting the breathing sound or the living sound of the self-isolating person. In addition, the self-isolator monitoring device 40 provides communication with the medical authority terminal 55, or a GPS origin consisting of a digital communication module 8 that provides a Bluetooth or Wi-Fi communication connection with the mobile phone 89 of the self-isolator. (10) may be included. In addition, the self-isolator monitoring device 40 may include an energy fluctuation curve calculation unit 12 for calculating an energy change over time from a signal obtained from the living body signal collecting means 20. In addition, the self-isolated person monitoring device 40 is a self-isolation departure discrimination unit implemented in an artificial intelligence neural network that has been deep-running and learned in advance by a database formed by the energy fluctuation curves labeled as residential departure and non-departure. (16) may be included. In addition, the self-isolated person monitoring device 40 may include a control unit 60 for driving a digital communication module 8 for providing a report of suspected departure to a medical authority terminal when the self-isolated person deviates from the designated residence. . In addition, the self-isolated person monitoring device 40 may include a control right transfer means (not shown) for transferring the control right of the control unit 60 to a medical authority. In addition, the self-isolator monitoring device 40 applies the energy fluctuation curve generated by the energy fluctuation curve calculation unit 12 to the deep-running artificial neural network to determine whether the self-isolator leaves the residence, and leaves the residence. Upon determination, the control unit 60 may drive the digital communication module 8 to transmit a suspected departure signal to the medical authority terminal 55.

According to an embodiment of the present application, reference numeral 56 may be an artificial intelligence neural network 56 for detecting a door sound learned by a database including various door closing sounds collected using the microphone 6. In other words, the door sound detection artificial intelligence neural network 56 may be a learning model constructed by inputting a plurality of door closing sound data acquired using the microphone 6 as inputs. When a new sound (life sound) is acquired from the microphone 6, the gate sound detection artificial intelligence neural network 56 determines the corresponding sound, and the control unit 60 determines the gate sound from the gate sound detection artificial intelligence neural network 56. When the closing sound is detected, it is determined that the self-isolator has left the individual space, and a signal of suspected departure can be transmitted to the medical authority terminal 55 using the digital communication module 8.

Preferably, the digital communication module 8 of the present invention preferably includes a wireless router 18 that allows a Wi-Fi connection.

Since Bluetooth or Wi-Fi is a short-range wireless communication, the wireless communication connection is smooth only when the mobile phone 89 of the self-isolator is within a certain distance from the digital communication module 8, for example, within a range of 20 m from the GPS origin.

Preferably, the control unit 60 is preferred not to report a suspected departure when the self-isolated person temporarily leaves the residence for a short time, for example, if he leaves the residence for only a short time within one minute. In other words, if the control unit 60 leaves the residence for less than a preset time (eg, 1 minute), the control unit 60 may not transmit a departure suspect signal to the medical authority terminal 55. On the other hand, when it is determined that the self-isolated person is not located in the residence for more than a preset time (for example, 1 minute), the control unit 60 determines that the self-isolator has left the residence, and sends a suspected departure signal to the medical authority terminal. Can be sent to (55).

Referring to FIG. 1A according to an embodiment of the present application, the self-isolator monitoring device 40 is installed in the self-isolator's residence to provide communication with the medical authority terminal 55 or Bluetooth with the self-isolator's mobile phone 89 And a GPS origin 10 composed of a digital communication module 8 providing a Wi-Fi connection.

In addition, the self-isolator monitoring device 40 is installed (resident) in the mobile phone 89 of the self-isolator, and information on the strength of Bluetooth and Wi-Fi connections between the mobile phone 89 of the self-isolator and the GPS origin 10 or Using the distance information between the GPS origin 10 and the self-isolating person's mobile phone 89, it is determined whether the self-isolated person has escaped from the designated residence, and if the self-isolating person has been separated, the self-isolating person is automatically reported to the medical authority terminal 55. It may include a self-isolation management app 89a having a connection strength measuring unit 53 to perform. In other words, the self-isolation management app 89a may be installed on the mobile phone 89 of the self-isolator. In addition, the self-isolation management app 89a may determine whether the self-isolator has deviated from the designated residence by considering Bluetooth and Wi-Fi connection strength information between the mobile phone 89 of the self-isolator and the GPS origin 10. In addition, the self-isolation management app 89a may determine whether the self-isolator is separated from the designated residence by using distance information between the GPS origin 10 and the mobile phone 89 held by the self-isolator. On the other hand, the self-isolation management app 89a may transmit a suspicion of self-isolator departure to the medical authority terminal 55 when it is determined that the self-isolator has deviated from the designated residence.

According to an embodiment of the present application, the self-isolation management app 89a includes a dialing unit 90a for making a call to a self-isolator by auto dialing and an identity authentication unit 90b for authenticating the identity of the self-isolator. It may include.

In addition, the self-isolation management app 89a makes a virtual phone call to the self-isolator through the dialing unit 90a, and determines that the self-isolator has deviated from the residence when the self-isolator does not answer the phone or if the identity is not verified. It may include an auto-dialing and check means 90 for transmitting a self-isolator departure signal to the medical authority terminal 55. For reference, the identity authentication unit 90b and the auto dialing and check means 90 may be installed (mounted) in the self-isolation management app 89a.

The identity authentication unit 90b of the present invention makes a call to the self-isolator's mobile phone 89 by the dialing unit 90a, and when the self-isolator receives the call, the self-isolator's mobile phone 89 receives voice query information. It may include a voice reproducing unit 91a for reproducing a voice message for providing or requesting fingerprint authentication.

In addition, the identity authentication unit 90b uses a speaker voice recognition unit 91b that performs speaker recognition on the self-isolator's response to the voice query, or uses a fingerprint sensor on the mobile phone 89. It may include a fingerprint recognition unit 26 that performs authentication. On the other hand, the identity authentication unit 90b performs identity authentication of the self-isolator based on the speaker voice recognition unit 91b and the fingerprint recognition unit 26, but if the identity of the self-isolator fails, the medical authority terminal It is preferred to send a signal of suspicion of self-isolator departure to (55).

Preferably, another aspect of the autodialing and check means may include a sound comparison unit 84 and a reference telephone ring sound storage unit 86.

According to an embodiment of the present application, the control unit 60 makes a call to the mobile phone 89 of the self-isolator using the digital communication module 8 by using auto dialing, and at this time, the microphone 6 is the mobile phone 89 You can collect the ring tone of the phone that is heard from the phone.

Meanwhile, the sound sound comparison unit 84 may calculate a sound similarity between the sound sound collected from the microphone 6 and the reference telephone ring sound. When the self-isolator receives a call from the mobile phone 89 and the sound similarity is greater than or equal to a predetermined value within a predetermined time after the phone ring sound of the mobile phone 89 of the self-isolator rings, the control unit 84 (60) is characterized by determining that the self-isolator is staying in the residence with a mobile phone.

Preferably, the reference phone ring tone is a ring tone similar to a phone ring tone generated when a call is made to the self-isolator's mobile phone by auto dialing, and is preferably set through a pre-registration process.

Another aspect of the sound comparison unit 84 is characterized in that the sound similarity between the sound sound collected from the microphone 6 and the standard telephone ring sound is determined by an artificial intelligence neural network previously learned by the standard telephone ring tone. It is done.

The microphone 6 may be replaced by a near-field noise collecting microphone installed for each individual space in the residence based on the Internet by the digital communication module 8.

The reception of the mobile phone 89 within a predetermined time after the phone rings is preferably performed by fingerprint authentication on the mobile phone 89. For example, when the self-isolator owns the cell phone 89 rings, the self-isolator receives the phone call through fingerprint recognition (fingerprint authentication), and authenticates that the self-isolator does not leave the quarantine residence. I can.

The self-isolation management app (89a) of the present application accepts when the medical authority terminal 55 commands the self-isolation management app (89a) on the mobile phone 89 of the self-isolator to activate (execute) the auto dialing and check function. It is preferred to make this possible only if the self-isolator authorizes the medical authority to have the right to control the location of the cell phone for the cell phone 89 of the self-isolator.

The thermal image of the thermal imaging camera 22 of the present invention may be replaced by using an image in which the thermal image is superimposed on the image collected by the image sensor.

Preferably, in the control right transfer means, the disease management authority may request the self-isolator to control the self-isolated person monitoring device and the self-isolator's location tracking control right. In addition, if the self-isolator accepts the request for control rights through a predetermined authentication procedure through a computer owned by the self-isolator or a program installed in a mobile phone app, the disease control authority may use the self-isolator monitoring device. It is possible to measure the distance between the GPS origin and the self-isolator through the positioning of the self-isolator's mobile phone 89 by controlling the control unit 60 of the controller 60 and obtaining the control right of the digital communication module 8, as well as the self-isolator monitoring device. You have the right to control and use.

1B is an embodiment of a self-isolator monitoring device 40 using a short-range noise collection microphone 6a connected to the self-isolator's mobile phone 89 and the Internet of Things according to an embodiment of the present disclosure.

Referring to FIG. 1B, the GPS origin 10 includes a digital communication module 8 that provides communication with the medical authority terminal 55, or provides a Bluetooth, Internet of Things, or Wi-Fi communication connection in the residence of the self-isolator. I can.

In addition, the speaker 17a for each space and the fingerprint sensor unit 25 for each space are not only connected to the mobile phone 89 based on the Internet of Things through the digital communication module 8, but also for each individual space within the residence of the self-isolator, for example. It can be provided in the living room, master room, or crossing room.

In addition, the near-field noise collecting microphone 6a to the living body signal collecting means 20 are not only connected to the mobile phone 89 based on the Internet of Things through the digital communication module 8, but also occur in a separate space where the self-isolator is quarantined. The self-isolator-induced life sound may be collected and provided to the self-isolator's mobile phone 89 through the digital communication module 8.

In addition, the self-isolation management app 89a is installed (resident) on the mobile phone 89 of the self-isolator, and information on the strength of Bluetooth and Wi-Fi connections between the mobile phone 89 of the self-isolator and the GPS origin 10 or the GPS By using the distance information between the origin 10 and the mobile phone 89, it is possible to determine whether the self-isolator is separated from the designated residence. In addition, the self-isolation management app 89a may include a connection strength measurement unit 53 that automatically reports a suspected self-isolator departure to the medical authority terminal 55 when the self-isolator deviates from the designated residence.

Meanwhile, the energy fluctuation curve calculation unit 12 is mounted (installed) in the self-isolation management app 89a, and can calculate energy change over time from the living sound signal collected from the near-field noise collection microphone 6a. .

In addition, the mobile phone input energy calculation unit 13 is mounted (installed) in the self-isolation management app 89a, and the person holding the mobile phone walks the isolator, changes the inclination of the mobile phone over time, or through the microphone input of the mobile phone. The ambient sound fluctuation can be calculated in the form of an energy fluctuation curve over time.

In addition, the self-isolation departure determination unit 16 is mounted (installed) in the self-isolation management app 89a, and uses a database including the energy fluctuation curves marked as departure and non-departure in advance. It can be implemented by deep running artificial intelligence neural networks.

In addition, the dialing unit 90a is mounted on the self-isolation management app 89a to provide a virtual phone call to the self-isolator's mobile phone by auto-dialing when there is a suspicion of leaving the self-isolator.

In addition, the identity authentication unit 90b may be installed in the self-isolation management app 89a to authenticate the identity of the self-isolator when there is a suspicion of leaving the self-isolator.

In addition, the auto dialing and check means 90 makes a virtual call to the self-isolator through the dialing unit 90a, and determines that the self-isolator has deviated from the residence when the self-isolator does not answer the phone or if the identity is not verified. And, it is possible to transmit a signal of suspicion of departure of the self-isolator to the medical authority terminal 55.

On the other hand, the self-isolation departure determination unit 16 may determine whether the self-isolator leaves the residence by using the deep running-learned artificial neural network with the energy fluctuation curve over time. The dialing unit 90a periodically executes the auto dialing and check unit 90 when it is determined that there is a suspicion of leaving the residence, and the identity authentication unit 90b performs the identity authentication of the self-isolating person through this.

As an example, another aspect of the autodialing and check means is installed (resident) on the app on the mobile phone 89, and by auto-dialing on the self-isolator's own mobile phone 89 It may include a cell phone ringing tone generating means 66 for making a virtual phone call and outputting a phone call tone while varying the size of the ringing tone and the type of the ringing tone according to time.

In addition, the fingerprint sensor unit 25 is not only wirelessly connected to the mobile phone 89 based on the Internet of Things, but also can be provided for each individual space (eg, living room, master room, crossing room, kitchen, door) on the residence of the self-isolating person. have.

In addition, the near-field noise collection microphone 6a is not only wirelessly connected to the mobile phone 89 based on the Internet of Things, but also collects a phone call sound from the mobile phone call sound generating unit 66.

In addition, the sound synchronization similarity calculation unit 68 may calculate a similarity between the noise collected from the near-field noise collection microphone 6a and the phone call sound.

On the other hand, if the fingerprint authentication of the self-isolator succeeds by the space-specific fingerprint sensor unit 25 and the similarity calculated by the sound-sound synchronization similarity calculation unit 68 is equal to or greater than a predetermined value, it is determined that the self-isolator is staying in the residence. can do. FIG. 1C is an embodiment of a self-isolator monitoring device 40 when a cell phone of a self-isolator is broken, a battery (battery) is discharged, or the self-isolator does not have a cell phone according to an embodiment of the present disclosure.

Illustratively, referring to FIG. 1C, the GPS origin 10 provides a digital communication module 8 that provides communication with the medical authority terminal 55, or provides a Bluetooth, Internet of Things, or Wi-Fi communication connection in the residence of the self-isolator. Can include.

In addition, the near-field noise collection microphone 6a is not only connected to the digital communication module 8 based on the Internet of Things, but also causes a self-isolator from several individual spaces in the residence of the self-isolator, such as a living room, a master room, a sidewalk, a kitchen, and a door. It is possible to collect the noise, voice, breathing sound, and living sound signals in parallel and provided to the digital communication module (8).

In addition, the energy fluctuation curve calculation unit 12 may calculate energy change over time from the living sound signal collected from the near-field noise collection microphone 6a.

In addition, the self-isolation departure determination unit 16 may be implemented by an artificial intelligence neural network that has been deep-running and learned in advance by a database including the energy fluctuation curves labeled as departure from residence and non-escape.

In addition, when the self-isolated person deviates from the designated residence, the control unit 60 may control driving the digital communication module 8 to report a suspected departure to the medical authority terminal 55.

On the other hand, the self-isolation departure determination unit 16 uses the energy fluctuation curve created from the energy fluctuation curve calculation unit 12 for the deep running-learned artificial neural network to determine whether the self-isolator leaves the residence, and self-isolates. When the departure determination unit 16 determines that the residence has been separated, the control unit 60 may transmit a suspected departure signal to the medical authority terminal 55 by driving the digital communication module 8.

In another aspect of the self-isolator monitoring device 40 when the cell phone of the self-isolator of FIG. 1C is broken, the battery (battery) is discharged, or the self-isolator does not possess the cell phone, the digital communication module 8 is medical Communication with the authority terminal 55 may be provided, or a Bluetooth, Internet of Things, or Wi-Fi communication connection in the residence of the self-isolating person may be provided.

In addition, the speaker 17a for each space may be connected to the digital communication module 8 based on the Internet of Things, and may be provided in each individual space within the residence of the self-isolating person, for example, in a living room, a master room, or a crossing room.

In addition, the near-field noise collecting microphone 6a to the living body signal collecting means 20 are not only connected to the digital communication module 8 based on the Internet of Things, but also collect the self-isolator-induced life sound from the individual space and collect the digital It can be provided to the communication module 8.

In addition, the energy fluctuation curve calculation unit 12 may calculate an energy change over time from signals collected from the near-field noise collecting microphone 6a to the living body signal collecting means 20.

In addition, when the energy calculated by the energy fluctuation curve calculation unit 12 is less than or equal to a predetermined value, the voice query unit 46 may provide a voice query to the self-isolator through the speaker 17a for each space.

In addition, the speaker voice recognition unit 27a collects the self-isolator's response voice signal to the voice query using the near-field noise collection microphone 6a, and the presence of a living organism by the energy fluctuation curve calculation unit 12 It is possible to judge or perform speaker recognition from the collected voices.

In addition, the self-isolated person monitoring device 40 performs identity authentication by the self-isolator's speaker voice recognition, and if it is determined that there is no life in the residence because authentication fails or there is no response to a query, the medical authorities It characterized in that it comprises a control unit 60 for driving the digital communication module to transmit a signal of suspicion of departure of the self-isolator to the terminal 55.

In another aspect of the self-isolator monitoring device 40 when the cell phone of the self-isolator of FIG. 1C is broken, the battery (battery) is discharged, or the self-isolator does not possess the cell phone, the digital communication module 8 is provided by the medical authorities. Communication with the terminal 55 may be provided, or a Bluetooth, Internet of Things, or Wi-Fi communication connection in the residence of the self-isolator may be provided.

In addition, the speaker 17a for each space and the fingerprint sensor unit 25 for each space are not only connected to the digital communication module 8 based on the Internet of Things, but may be provided for each individual space within the residence of the self-isolator.

In addition, the near-field noise collecting microphone 6a to the living body signal collecting means 20 are not only connected to the digital communication module 8 based on the Internet of Things, but also collect the self-isolator-induced life sound from the individual space and collect the digital It can be provided to the communication module 8.

In addition, the energy fluctuation curve calculation unit 12 may calculate an energy change over time from signals collected from the near-field noise collecting microphone 6a to the living body signal collecting means 20.

In addition, when the energy calculated by the energy fluctuation curve calculation unit 12 is less than a predetermined value, the voice query unit 46 generates a voice message requesting fingerprint authentication from the self-isolator through the speaker 17a for each space. can do.

In addition, when the energy calculated by the energy fluctuation curve calculation unit 12 is less than a predetermined value, the fingerprint recognition unit 26 recognizes a fingerprint input from the fingerprint sensor unit 25 for each space and a pre-registered self-isolator fingerprint. Identity authentication can be performed by checking whether it matches or not.

In addition, the control unit 60 drives the digital communication module 8 to transmit a suspicion of departure of the self-isolator to the medical authority terminal 55 when authentication fails or there is no response by performing fingerprint authentication of the self-isolator. Can be controlled.

Preferably, it is preferred to add a melody sound to the initial part of the voice message of the voice inquiry unit 46 and output it.

Reference numeral 27 denotes an isolator authentication unit 27 for authenticating a self-isolator by the voice or fingerprint of the self-isolator registered and stored in advance, and is formed by the speaker voice recognition unit 27a to the fingerprint recognition unit 26.

2 to 3 is an embodiment in which the self-isolator monitoring device 40 is integrated with the main bodies 1a and 1b installed on the ceiling.

Referring to FIGS. 2 and 3, the self-isolator monitoring device 40 may include ceiling-type bodies 1a and 1b buried and installed in a ceiling wall.

The self-isolator monitoring device 40 described below with reference to FIGS. 2 and 3 may be a self-isolator monitoring device 40 integrated in a ceiling air conditioner body or a ceiling lighting fixture body.

In addition, the self-isolator monitoring device 40 may include a high-resolution radar sensor for non-contactly checking the breathing pulse signal of the self-isolator 88.

In addition, the self-isolator monitoring device 40 obtains heat radiated from the body of the self-isolator 88 to form a thermal image and observes the change to determine whether the self-isolator 88 exists in a given space. It may include a thermal imaging camera for.

In addition, the self-isolator monitoring device 40 may include a living body signal collecting means 20 composed of at least one selected from a microphone for determining the presence or absence of a breathing sound or a living sound of the self-isolator 88.

In addition, the self-isolator monitoring device 40 provides communication with a medical authority terminal, or a digital communication module that provides a Bluetooth, Internet of Things, or Wi-Fi communication connection with the mobile phone 89 of the self-isolator 88 ( It may include a GPS origin 10 consisting of 8).

In addition, the self-isolator monitoring device 40 may include an energy fluctuation curve calculation unit 12 for calculating an energy change over time from a signal obtained from the living body signal collecting means 20.

In addition, the self-isolating person monitoring device 40 includes a self-isolation departure determination unit 16 implemented in an artificial intelligence neural network that has been learned in advance by a database formed by the energy fluctuation curves labeled as departure and non-departure. ) Can be included.

In addition, the self-isolated person monitoring device 40 includes a control unit 60 that drives the digital communication module 8 to report a suspected departure to the medical authorities when the self-isolated person 88 deviates from the designated residence. I can.

In addition, the self-isolated person monitoring device 40 is provided with a control right transfer means (not shown) for transferring the control right of the control unit 60 to the medical authority, and determines whether the self-isolated person 88 leaves the residence, When determining departure from the residence, the control unit 60 drives the digital communication module 8 to transmit a suspected departure signal to the medical authority terminal.

The living body signal collecting means 20 is preferably attached to the main body covering panels 2a and 2b so that the self-isolator 88 can be observed well.

The self-isolation departure determination unit 16, the digital communication module 8, the energy fluctuation curve calculation unit 12, and the control unit 60 are housed in the plastic case 100 in the ceiling-type main body 1a, 1b to be concealed. Buried assembly is installed and fixed, and the living body signal collecting means 20 is buried in the storage spaces 30a, 30b, 30c, and 30d provided in the ceiling-type main body 1a, 1b, and the input portion thereof is a panel covering the body It is preferred to be exposed to the outer surface through a plurality of openings prepared on 2a, 2b). 17A is a speaker for each space.

2 is an embodiment having a structure in which the self-isolator monitoring device of the present invention is incorporated into a ceiling type air conditioner, a motor 50a fixed to the inner upper and lower surfaces of the ceiling type body 1a, and the motor 50a. The air introduced through the air inlet 72 is sucked in by a blower fan 50b fitted to the motor shaft, converted into cold or warm air by a heat exchanger (not shown), and discharged through the discharge port 70.

Preferably, the other side of the plastic case 100 is characterized in that it is installed in the form of a separate set top box instead of concealing the inside of the main body (1a, 1b).

3(a) and 3(b) are an embodiment in which the self-isolator monitoring device 40 is integrated with the lighting fixture body 1b installed on the ceiling, and FIG. 3(b) is It is a cross-sectional view of the cross section a-a' in (a).

Referring to FIG. 3, the LED lighting lamp 120 disposed inside the lighting device 2c is formed of an insulating material while surrounding a plurality of LEDs 131 arranged at regular intervals on a metal PCB substrate 130. It is preferable to have a base 150 and a connection pin 152 made of a conductive material that has a shape protruding from the outer surface of the base 150 and is inserted into a socket to which electricity is supplied.

4A and 4B illustrate an embodiment of installing the plastic case 100 in the form of a separate set top box instead of concealing the inside of the main bodies 1a and 1b.

4(a) shows an embodiment in which the plastic case 100 is converted into a speaker box 17, while FIG. 4(b) shows the plastic case 100 is an Internet wireless router 18 It shows an example modified in the form of.

Reference numeral 20 shown in the embodiment of FIGS. 4A and 4B is a signal collecting means 20 for living organisms, 6a is a near-field noise collection microphone, and 17a is a speaker for each space. , Reference numeral 25 denotes a fingerprint sensor unit for each space, and the remaining parts for the self-isolator monitoring apparatus of the present invention may be embedded in a set top box.

5 to 6 show a short-range noise collection microphone 6a, which is provided with a connection to the digital communication module 8 through Bluetooth, Wi-Fi, or Internet of Things, for each individual living space in the residence, and a fingerprint sensor unit 25 for each space. , This is an embodiment of a modular information collection adapter 32 equipped with a speaker 17a for each space.

5 shows an embodiment of the information collection adapter 32 connected to the digital communication module 8 based on the Internet of Things through the Internet connection terminal 33a.

Figure 5 (a) shows a front view and a side view of the information collection adapter 32,

5B shows the digital communication module 8 through the electrical connection between the Internet connection socket 33b and the Internet connection terminal 33a prepared in the wiring box 35 in the residence. And an example connected based on the Internet of Things.

By coupling and connecting the internet connection terminal 33a to the internet connection socket 33b prepared in the wiring box 35 in each space in the residential area, a plurality of independent short-distance living spaces in the residential area, such as living room, master room, crossing room, kitchen , It is possible to collect the living sound and fingerprint information generated from the door, as well as to deliver a voice message through the speaker (17a) for each space. The Internet connection socket 33b is preferably an Ethernet female connector, and the Internet connection terminal 33a is preferably an Ethernet male connector.

Reference numeral 38 provides a fastening means for the wiring box 35.

Reference numeral 36 denotes a power outlet box included on the wiring box 35.

Reference numeral 42 denotes a power supply for supplying electricity to the information collection adapter 32, and a solar panel or battery (battery) is preferred.

Reference numeral 48 denotes an Internet cable connection terminal for additionally providing a wired Internet connection to a user.

6 is an embodiment in which an information collection adapter 32 connected to the digital communication module 8 is installed through a Bluetooth or Wi-Fi connection. In order to supply power to the information collection adapter 32, it is connected to a power outlet 33d. A power outlet connection terminal 33c providing electrical connection and a circuit (not shown) for Bluetooth or Wi-Fi connection with the digital communication module 8 are provided.

6(a) shows a front view and a side view of the information collection adapter 32, and FIG. 6(b) is an electrical connection between the power outlet 33d and the power connection terminal 33c of the information collection adapter 32 Through, by activating the information collection adapter 32, an embodiment in which the information collection adapter 32 is connected to the digital communication module 8 with Bluetooth and Wi-Fi is shown.

Reference numeral 17a shown in FIGS. 5 and 6 is a speaker for each space installed for each individual space in the residence of the self-isolator, and is connected to the digital communication module 8 by communication connection, and the voice reproducing unit 91a to the voice query The voice message (query) from the unit 46 is delivered to a separate space. The self-isolator may notify the controller 60 that the self-isolator exists in the residence by listening to a voice message (query) and answering a question through the near-field noise collecting microphone 6a. The question-and-answer may include any form of vocalization that can voice the presence of the self-isolator.

Reference numeral 25 in FIGS. 5 and 6 is a space-specific fingerprint sensor unit installed in several individual spaces in the self-isolator's residence, and is connected to the digital communication module 8 by communication connection, and fingerprint authentication through a speaker 17a for each space. Upon request, the self-isolator sends his/her fingerprint to the fingerprint recognition unit 26 through the space-specific fingerprint sensor unit 25 to perform a fingerprint authentication procedure that matches the registered self-isolator with the self-isolator. It can be notified to the control unit 60.

7 is an exemplary embodiment of the energy fluctuation curve calculation unit 12.

Figure 7 (a) shows the energy fluctuation curve calculation unit 12 that calculates the time-dependent sound energy change and transition for the breathing sound or life sound of the self-isolator from the microphone 6 to the high-resolution radar sensor 52, FIG. 7B shows an energy fluctuation curve calculation unit 12 that calculates a fluctuating energy value on a thermal image image over time according to a change in motion of the self-isolator from the thermal imaging camera 22.

으로서 소리 에너지를 계산하고, 이를 시간에 따라 에너지 변동 곡선(80a)으로 형성하여 산출한다.The energy fluctuation curve calculation unit 12 shown in (a) of FIG. 7 is the sum of the squares of the absolute values of the sound (life sound, 78a) pixels obtained for each predetermined time period.

As the sound energy is calculated, it is calculated by forming the energy fluctuation curve 80a over time.

The self-isolation departure determination unit 16 transmits a residence departure signal to the control unit 60 by an energy determination algorithm that determines that the self-isolator has left the residence when the sound energy continues below the reference value for a predetermined period of time or more. .

으로 자가 격리자의 움직임 변화 에너지를 계산하고, 이를 시간에 따라 에너지 변동 곡선(80b)으로 형성하여 산출한다.The energy fluctuation curve calculation unit 12 shown in (b) of FIG. 7 calculates the fluctuation energy value on the thermal image image by time according to the movement change of the self-isolator from the thermal imaging camera 22, at intervals of Δt time. The obtained, pixel-by-pixel difference image (x(t)=I(t)-(I(t+Δt)) between the two thermal image images (79a, 79b) is obtained by the subtractor (78c), and within these difference images Sum of squares of absolute values of all pixels

As the self-isolator's motion change energy is calculated, it is calculated by forming the energy change curve 80b over time.

As the motion of the self-isolator increases, the width of change between the images increases, the resultant value of the subtractor 78c increases, and the energy value of the motion change increases.

The self-isolation departure determination unit 16 provides a residence departure signal to the control unit 60 by an energy determination algorithm that determines that the self-isolator has left the residence when the motion change energy continues below the reference value for a predetermined time period or more. can do.

Another aspect of the self-isolation departure determination unit 16 shown in FIGS. 7A and 7B is a database formed by the energy fluctuation curves marked as residential departure and non-departure. It is characterized in that it is implemented using an artificial intelligence neural network learned in advance by.

According to an exemplary embodiment of the present disclosure, the self-isolator monitoring device 40 may collect biometric information of the self-isolator from a plurality of sensors installed in an isolation space in which the self-isolator lives. For example, the biometric information of the self-isolator may include breathing pulse, heat, noise, and the like.

In addition, the self-isolator monitoring apparatus 40 may apply the biometric information of the self-isolator collected from a plurality of sensors to an artificial intelligence neural network to generate energy fluctuation data including a departure section and a non-departure section.

In addition, the self-isolator monitoring device 40 may determine whether the self-isolator is separated from within the isolation space based on the energy fluctuation data.

In addition, the self-isolated person monitoring device 40 may transmit a signal of suspicion of the self-isolator's departure to the terminal 55 of the medical authority when the self-isolated person leaves the quarantine space.

In addition, the self-isolator monitoring device 40 may determine a distance between the location of any one of a plurality of sensors installed in the isolation space in which the self-isolator lives and the location of the cell phone 89 of the self-isolator.

In addition, the self-isolator monitoring device 40 may determine the signal strength of the self-isolator's mobile phone 89 existing (located) in the isolation space.

Meanwhile, the mobile phone 89 of the self-isolator may determine whether the self-isolator's call is successful or whether the self-isolator is authenticated according to the auto dialing of the self-isolator monitoring device 40.

In addition, the self-isolator's mobile phone 89 transmits a suspicious signal of the self-isolator's departure to the medical authority terminal 55 when the separation distance or signal strength is less than the standard value, or whether the call is successful or whether the self-isolator is authenticated. I can.

In addition, the mobile phone 89 of the self-isolator activates or deactivates the data of the mobile phone 89 of the self-isolator at regular time intervals, and self-isolation by determining at least one of the separation distance, the signal strength, and whether the call was successful or acknowledged. You can check whether or not the person has left

According to another embodiment of the present application, the self-isolator monitoring device 40 and the self-isolator's mobile phone 89 may be interlocked through a network.

According to an embodiment of the present application, the self-isolator monitoring device 40 may provide a self-isolation management menu to the self-isolator's mobile phone 89. For example, the self-isolator's mobile phone 89 downloads and installs an application program provided by the self-isolator monitoring device 40, and a self-isolation management menu may be provided through the installed application.

The self-isolator monitoring device 40 includes all types of servers, terminals, or devices that transmit and receive data, contents, and various communication signals to and from the self-isolator's mobile phone 89 through a network, and store and process data. can do.

Hereinafter, based on the details described above, the operation flow of the present application will be briefly described.

Although not shown in the drawing, the self-isolator monitoring method according to steps S110 to 150 below may be performed by the self-isolator monitoring device 40 described above. Therefore, even if omitted below, the description of the self-isolator monitoring device 40 may be equally applied to the description of the self-isolator monitoring method.

In step S110, the self-isolator monitoring device 40 may register the GPS origin by Bluetooth or Wi-Fi connection between the self-isolator monitoring device 40 and the self-isolator's mobile phone 89.

In step S120, the terminal 55 of the medical authority may request the control right of the self-isolator monitoring device 40 from the cell phone 89 of the self-isolator.

In step S130, the self-isolator passes through a predetermined authentication procedure through a computer app or a mobile app using the self-isolator's mobile phone 89, and the self-isolator monitoring device 40 to the self-isolator's cell phone 39 It is possible to transfer the location tracking control right to the terminal 55 of the medical authority. In other words, through a program installed in the self-isolator's computer and the self-isolator's mobile phone 89, the self-isolator enters information indicating that the location tracking control is to be transferred to the terminal 55 of the medical authority through a predetermined authentication procedure, and the user Based on the input information of, the self-isolated person monitoring device 40 or the self-isolated person's mobile phone 39 may be transferred to the terminal 55 of the medical authority.

In step S140, the self-isolator monitoring device 40 measures Bluetooth and Wi-Fi connection strength information between the self-isolator's mobile phone 89 and the GPS origin 10, or the GPS origin 10 and the self-isolator's mobile phone 89 It is possible to determine whether a self-isolator has been separated from a designated residence by using the distance information.

In step S150, the self-isolator monitoring device 40 is the self-isolator's cell phone 89 when it is suspected that the self-isolator has deviated from the designated residence by the cellular phone input energy calculation unit 13 to the living organism signal collecting means 20. ) Can be dialed by auto-dialing to authenticate the identity of the insulator.

In the above description, steps S110 to S150 may be further divided into additional steps or may be combined into fewer steps, depending on the embodiment of the present application. In addition, some steps may be omitted as necessary, or the order between steps may be changed.

The self-isolator monitoring method performed by the self-isolator monitoring apparatus according to an exemplary embodiment of the present disclosure may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the self-isolator monitoring method performed by the above-described self-isolator monitoring device may be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and are not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present application.

6: microphone
8: digital communication module
10: GPS origin
12: energy fluctuation curve calculation unit
13: Cell phone input energy calculation unit
16: self-isolation evacuation determination unit
20: means of collecting life signals
22: thermal imaging camera
26: fingerprint recognition unit
28: infrared human body detection sensor
29: image sensor
40: self-isolator monitoring device
52: high resolution radar sensor
55: medical authority terminal
56: Gate sound detection artificial intelligence neural network
60: control unit
84: sound comparison unit
86: standard phone ring tone storage unit
89: Self-Isolator's Cell Phone
89a: Self-Isolation Management App
90: Auto dialing and check means
90a: dialing part
90b: Identity authentication department
91a: voice reproduction unit
91b: Insulator Recognition Unit

Claims (10)

High-resolution radar sensor for non-contact checking of the self-isolator's breathing pulse signal,
A thermal imaging camera for providing a thermal image obtained by sensing heat radiated from the body of the self-isolating person or tracking heat and observing the change in heat to determine the presence of a self-isolator in a given space,
Image sensor to acquire the presence or absence of movement of self-isolator through image variation check,
An infrared human body detection sensor that detects the presence or absence of movement of the self-isolator through the check of infrared fluctuations emitted from the body of the self-isolator, and
A microphone to determine whether the self-isolator's breathing or living sound exists
Life signal collection means comprising at least any one of;
A GPS origin consisting of a digital communication module installed in the self-isolator's residence to provide communication with a medical authority terminal or to provide a Bluetooth and Wi-Fi connection with the self-isolator's mobile phone;
An energy fluctuation curve calculation unit for calculating an energy change over time from a signal obtained from the living body signal collecting means;
Based on a database formed by a plurality of energy fluctuation curves marked as residence departure and non-departure, it is implemented by a pre-learned artificial intelligence neural network or an energy judgment algorithm to determine whether the self-isolator has escaped or not. part;
A connection strength measuring unit installed in the mobile phone of the self-isolator and determining whether the self-isolator is separated from a designated residence using information on the strength of a Bluetooth and Wi-Fi connection between the mobile phone and the GPS origin or distance information between the GPS origin and the mobile phone And a self-isolation management app (App) for transmitting a self-isolation suspicious signal to a terminal of the medical authority when the self-isolator deviates from the designated residence;
If the self-isolator is installed in the self-isolation management app and makes a call using the auto-dialing provided in the self-isolator's mobile phone, if the self-isolator does not answer the phone or if the identity is not verified, the self-isolator determines that the person has departed from the residence, and the medical authorities An autodialing and check means for transmitting a signal of suspicion of departure of the self-isolator to the terminal of the terminal;
A control unit for driving the digital communication module to transmit a suspected departure signal to a medical authority terminal when a departure is suspected by the self-isolation departure determination unit or to activate the auto dialing and check means; And
Control right transfer means for transferring control right of the control unit to a medical authority,
Containing, self-isolator monitoring device. A digital communication module installed in the self-isolator's residence to provide communication with a medical authority terminal or to provide a Bluetooth and Wi-Fi connection with the self-isolator's cell phone;
A microphone installed in the self-isolator's residence to collect the presence or absence of the self-isolator's breathing sound or life sound;
An auto dialing and checking unit comprising a sound sound comparison unit for calculating a sound similarity between the sound sound collected from the microphone and a reference telephone ring tone, and a reference telephone ring sound storage unit; And
A control unit for driving the digital communication module to transmit a departure suspicious signal to the medical authority terminal or to activate the auto dialing and check means by auto dialing,
Including,
The microphone collects the sound of the phone ring coming from the cell phone of the self-isolator,
The control unit,
By controlling the operation of the digital communication module, when the self-isolator makes a phone call using auto dialing to the self-isolator's mobile phone, and the self-isolator receives the mobile phone within a predetermined time after the phone rings, and the sound similarity is higher than a predetermined value, the self-isolator A self-isolating person monitoring device, characterized in that it is determined that the insulator is staying in a residence while holding a mobile phone. A GPS origin consisting of a digital communication module that provides communication with a medical authority terminal or is provided in the self-isolator's residence and provides a Bluetooth, Internet of Things, or Wi-Fi communication connection with the self-isolator's cell phone;
It is connected to the mobile phone of the self-isolator based on the Internet of Things through the digital communication module, collects the self-isolator-induced life signal from a separate space, collects the phone call sound from the mobile phone call sound generating means, and uses the digital communication module A living body signal collection means including a near-field noise collection microphone provided to the;
A connection strength that is installed on the self-isolator's mobile phone and determines whether the self-isolator is separated from a designated residence using information on the strength of Bluetooth and Wi-Fi connections between the mobile phone of the self-isolator and the GPS origin, or distance information between the GPS origin and the mobile phone. A self-isolation management app having a measurement unit, and transmitting a signal of a self-isolator's departure suspicion to the terminal of the medical authority when the determination result of the connection strength measurement unit is determined as the separation of the self-isolator;
An energy fluctuation curve calculation unit installed in the self-isolation management app and calculating energy change over time based on the self-isolator-induced life signal;
Mobile phone input energy that is installed in the self-isolation management app and calculates the walking movement of the self-isolator with the mobile phone, the tilt of the mobile phone over time, or the ambient sound fluctuation through the microphone input of the mobile phone in the form of an energy fluctuation curve over time. Calculation unit;
A self-isolation departure determination unit installed in the self-isolation management app and determining the self-isolator's departure and non-departure from the residence using the energy fluctuation curve;
If it is installed in the self-isolation management app and suspected of self-isolator departure, a virtual phone call is made using auto-dialing with the self-isolator's mobile phone to authenticate the identity of the self-isolator. Auto dialing and checking means for transmitting a suspicious signal; And
A control unit for driving the digital communication module to transmit a suspected departure signal to a medical authority terminal when a departure is suspected by the self-isolation departure determination unit or to activate the auto dialing and check means,
Self-isolator monitoring device, characterized in that it comprises a. The method according to any one of claims 1 to 3
The auto dialing and check means,
Including a dialing unit and an identity authentication unit for authenticating the identity of the self-isolator,
The identity authentication unit,
A voice reproducing unit for reproducing a voice message for making a call to the self-isolator's mobile phone by the dialing unit and requesting a voice query to the self-isolating person or requesting fingerprint authentication when the self-isolator receives a call; And
A fingerprint recognition unit for performing fingerprint authentication through a fingerprint sensor on a mobile phone or using a speaker voice recognition unit for performing speaker recognition on the voice of the self-isolator to the voice query;
Including,
The control unit to the auto dialing and check means,
Self-isolator monitoring device, characterized in that when a failure by performing the identity (Identity) authentication of the self-isolator, transmitting a suspicion of departure of the self-isolator signal to a medical authority terminal. A digital communication module installed in the self-isolator's residence to provide communication with a medical authority terminal or to provide Bluetooth, Internet of Things, and Wi-Fi connection with the self-isolator's cell phone;
A near-field noise collection microphone connected to a mobile phone based on the Internet of Things through the digital communication module and collecting self-isolator-induced living sounds from individual spaces;
A fingerprint sensor unit for each space connected to the mobile phone based on the Internet of Things through the digital communication module and provided for each individual space in the residence of the self-isolator;
Mobile phone ringing means that is installed in the app on the self-isolator's mobile phone, makes a virtual phone call using auto-dialing with the self-isolator's mobile phone, and outputs a phone call sound while changing the mobile phone ringing volume and type according to time,
An auto-dialing and check means comprising a sound-sound synchronization similarity calculation unit that calculates a similarity between the telephone call sound emitted from the cellular phone ring tone generating means and the sound sound collected by the near-field noise collecting microphone; And
A control unit that determines that the self-isolator is staying in a residence when the fingerprint authentication of the self-isolator succeeds by the space-specific fingerprint sensor unit and the similarity calculated by the sound synchronization similarity calculation unit is equal to or greater than a predetermined value,
Self-isolator monitoring device comprising a. A digital communication module that provides communication with a medical authority terminal, or provides a Bluetooth, Internet of Things, or Wi-Fi communication connection in a residence of a self-isolator;
A near-field noise collection microphone or a living body signal collecting means connected to the digital communication module based on the Internet of Things, as well as collecting self-isolator-induced life signals from individual spaces in the self-isolator's residence and providing them to the digital communication module;
A speaker for each space connected to the digital communication module based on the Internet of Things, as well as prepared for each individual space in the residence of the self-isolator;
An energy fluctuation curve calculation unit for calculating an energy change over time from the self-isolator-induced life signal;
A self-isolation departure determination unit that determines whether or not to deviate from the energy fluctuation curves;
A voice query unit that makes a voice query to a self-isolator through the speaker for each space when the energy calculated by the energy fluctuation curve calculation unit is less than or equal to a predetermined value;
An isolator authentication unit that authenticates the identity of a self-isolator through the voice query; And
When it is determined that authentication fails by performing identity authentication by the isolator authentication unit or there is no life in the residence because there is no response to a query, the medical authority terminal is reminded to transmit a signal of suspicion of departure of the self-isolator to the terminal of the medical authority. A control unit driving the digital communication module,
Self-isolator monitoring device, characterized in that it comprises a. The method of claim 6,
The insulator authentication unit
The voice message of the voice interrogation unit requesting voice authentication to the self-isolator is transmitted by the speaker for each space, and the response voice signal of the self-isolator is collected by the near-field noise collection microphone, and the living body exists by the energy fluctuation curve calculation unit. A speaker voice recognition unit that performs identity authentication by determining the presence or absence of a match between the collected voice and the pre-registered voice of the isolated person; And
The voice message of the voice query unit requesting fingerprint authentication to the self-isolator is transmitted by the speaker for each space, and the identification by checking whether the fingerprint input from the fingerprint sensor unit for each space matches the fingerprint of the pre-registered self-isolator. A fingerprint recognition unit that performs authentication,
Self-isolator monitoring device, characterized in that it comprises a. The method according to any one of claims 1 and 3,
The connection strength measuring unit,
Further comprising a mobile data stop means for temporarily suspending the use of mobile data of the mobile phone by the self-isolating person,
The mobile data stop means,
During the period of checking whether the self-isolator from the residence is separated from the residence, the use of mobile data is paused, and then the Wi-Fi connection strength information between the self-isolator's mobile phone and the GPS origin is checked, and the Wi-Fi connection signal strength is weakened below the reference value or the connection is made. If the attempt is unsuccessful, the self-isolator monitoring device, characterized in that it determines that the self-isolator has left the residence and transmits a suspicious signal of the self-isolator's departure to a terminal of a medical authority. The method according to any one of claims 1 and 3,
The connection strength measuring unit,
Further comprising a mobile data connection means for forcibly activating the mobile data use of the mobile phone of the self-isolating person,
The mobile data connection means,
During the period of checking whether the self-isolator from the residence is separated from the residence, the self-isolator is forced to temporarily activate the mobile data use by using an app on the self-isolator's mobile phone, and then the distance between the GPS origin and the location of the mobile phone is determined, and the self-isolator leaves the residence. A self-isolator monitoring device, characterized in that it determines whether or not, and transmits a suspicious signal of the self-isolator's departure to a terminal of a medical authority in case of departure. In the self-isolator monitoring method performed by the self-isolator monitoring device according to any one of claims 1, 2, 3, 5 to 6,
Registering a GPS origin by Bluetooth or Wi-Fi connection between the self-isolator monitoring device and the self-isolator's mobile phone;
Requesting, by a terminal of the medical authority, a control right of the self-isolated person monitoring device through the self-isolator's mobile phone;
Transferring a location tracking control right of the self-isolating person monitoring device or the self-isolating person's mobile phone to a terminal of the medical authority;
Measuring Bluetooth and Wi-Fi connection strength information between the mobile phone of the self-isolator and the GPS origin, or determining whether the self-isolator is separated from a designated residence using distance information between the GPS origin and the mobile phone of the self-isolator ; And
If the self-isolator is suspected to have deviated from the designated residence by the cell phone input energy calculation unit or the living organism signal collection means, the self-isolator's mobile phone is dialed by auto-dialing to verify the identity of the self-isolating person. Check step;
Self-isolator monitoring method comprising a.

Images