KR102148638B1 - Apparatus for fever detection according to the change of external environment - Google Patents

Abstract

The present invention relates to a fever detection device in accordance with a change in external environment which comprises: a temperature data extracting module installed in a designated indoor or outdoor place and obtaining temperature data of specific surroundings through a thermal image sensor unit to extract measured temperature data of a person area; a temperature data analysis module for calculating a skin temperature value of people currently within a normal temperature range by analyzing a measured temperature data pattern of people within a preset reference normal temperature range from the measured temperature data of a person area extracted from the temperature data extracting module for a preset extracting time; an alarm temperature setting module for setting an alarm temperature value by adding a difference value between preset body temperatures of a fever-suspected person and a normal person to the skin temperature value of people currently within a normal temperature range calculated by the temperature data analysis module; and an alarm generating module for generating an alarm to enable a user to visually or audibly distinguish the fever-suspected person when the measured temperature value of a person area extracted by the temperature data extracting module is higher than the alarm temperature value set by the alarm temperature setting module. Accordingly, a fever-suspected person can be effectively, accurately and quickly distinguished regardless of change in external environment.

Description

Heat detection device according to changes in external environment {APPARATUS FOR FEVER DETECTION ACCORDING TO THE CHANGE OF EXTERNAL ENVIRONMENT}

The present invention relates to a heat detection device for distinguishing a suspected heat generation according to a change in an external environment.

In general, if a patient or infected person with an infectious disease freely passes in a public place or large building where a lot of people gather, the disease can be transmitted to other people, and in particular, the disease can be widely spread. Therefore, these infected individuals should be quarantined with the public at an early stage to prevent the possibility of transmission to multiple people.

In recent years, a new outbreak of respiratory infectious diseases occurs, and dangerous situations that can infect people in a wide range are frequently encountered. For example, new infectious diseases such as SARS (severe acute respiratory syndrome), swine flu, Ebola, MERS, and Corona 19 are frequently occurring.

However, since these infectious diseases show symptoms similar to common diseases such as a cold, it is difficult for the infected person to know the infection itself until the infectious disease is confirmed. Therefore, it is necessary to quickly check whether these infected people pass in public places where many people gather, and take additional tests or quarantine measures.

Most of these infectious diseases are accompanied by fever, so people with severe fever can be primarily judged as suspicious of the disease, and infection can be determined through a close examination. That is, by measuring the body temperature, it is possible to determine the primary suspected fever.

Body temperature refers to the temperature inside the body. Body temperature varies greatly depending on the part of the body, but the normal body temperature of humans is said to be 36.9℃ as the armpit temperature, and children tend to be slightly higher than adults and the elderly tend to be lower. The high temperature condition of the body causes more serious conditions than the cold upper body.

Body temperature is about 37℃ normal body temperature in adults, but at about 41℃ it causes convulsions and pain, and 43.3℃ is the maximum limit of life support. In addition, life cannot be maintained even under body temperature of 27℃.

The most accurate way to measure body temperature is to measure the temperature of the rectum, measured at about 6cm or more in the anus. However, since the measurement method is too complex, the attributable temperature is generally measured. However, in public places such as airports, since a large number of unspecified people pass through it, it takes a lot of manpower to check the body temperature by measuring the temperature attributable to all passers-by, causing inconvenience to passers-by. have.

Currently, in order to prevent the spread of fever infectious diseases such as COVID-19, thermal imaging cameras and systems are used to identify and detect suspected fever patients.

In the early days, thermal imaging cameras and systems detected a patient suspected of having fever only with low-resolution thermal images, so it was difficult to identify the detected person.The thermal imaging camera for thermal imaging was the nature of the thermal imaging camera, not the temperature of the examiner's skin. The suspected fever is selected by measuring.

In order to select such a suspected fever, the measured temperature obtained from the thermal image sensor is compared with a preset alarm temperature value, and an alarm signal is unconditionally generated when the measured temperature is higher than the set temperature.

At this time, the measured skin temperature of a person entering from the outside will be different depending on the installation environment of the heat detection camera. That is, the skin of people entering through an environment where the appropriate temperature is stably controlled, such as a quarantine booth located in the airport arrival hall, and the skin of people entering from various external temperatures and environments (eg, strong sunlight, rain, fog, etc.) such as the entrance of a building. If the temperature is measured with a camera with the same setting conditions, of course, it is bound to show different measured values.

As an easy example, the skin temperature of a person who has been walking for a long time in a cold outside environment or a person who has just gotten off a vehicle equipped with a heater shows a big difference.

For the above reasons, it is a big problem in actual operation to classify a suspected person based on a specific temperature inside the entrance of a building.

This is because a person's skin temperature is different depending on the environmental conditions such as temperature or weather, and the installation location of the fever detection camera, so the alarm temperature value for distinguishing the fever patient must be set differently each time. At this time, since the external environment cannot be accurately predicted, it is impossible to select an appropriate temperature value for setting the alarm.

Domestic registered patent No. 10-1420200 (announced on July 21, 2014)

The present invention was devised to solve the above-described problem, and an object of the present invention is to generate an alarm by selecting a suspected heat generation according to changes in external temperature and/or environment (eg, strong sunlight, rain, fog, etc.) The aim is to provide a heat detection device according to changes in the external environment by allowing the alarm temperature set value to be automatically changed and set, so that the suspected heat generation can be effectively and quickly identified regardless of changes in the external environment.

Another object of the present invention is to acquire temperature data of a thermal image for a specific surrounding through a thermal image sensor unit and at the same time acquire image data of a real image for a specific surrounding through the real image sensor unit, and based on the acquired image data and temperature data The objective is to provide a heat detection device according to changes in external environment, which accurately recognizes a person's face as well as quickly checks the heat state of the recognized face.

In order to achieve the above object, an aspect of the present invention is a temperature data extraction module that is installed in a designated place indoors or outdoors, and obtains temperature data of a specific surrounding through a thermal image sensor unit to extract measured temperature data of a person region. ; Temperature data for calculating skin temperature values of people in the current normal temperature range by analyzing the measurement temperature data pattern of people in the preset standard normal temperature range among the measured temperature data of the human region extracted from the temperature data extraction module during a preset extraction time. Analysis module; An alarm temperature setting module configured to set an alarm temperature value by adding a predetermined difference in body temperature between a suspected fever and a normal person from skin temperature values of people in the current normal temperature range calculated from the temperature data analysis module; And an alarm generating module that generates an alarm so that a user can visually or audibly identify a person suspected of fever when the measured temperature value of the person region extracted from the temperature data extraction module is higher than the alarm temperature value set by the alarm temperature setting module. It is to provide a heat-sensing device according to a change in the external environment including.

Here, the alarm temperature setting module, when the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module is lower than the skin temperature value of people in the preset standard normal temperature range that is not affected by the external environment, the It is preferable to set the alarm temperature value by adding the body temperature difference between the suspected fever and the normal person from the skin temperature values of people in the current normal temperature range calculated from the temperature data analysis module.

Preferably, the alarm temperature setting module, when the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module is higher than the skin temperature value of people in the preset reference normal temperature range that is not affected by the external environment, The alarm temperature value may be set by subtracting a predetermined difference in body temperature between a suspected fever and a normal person from the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module.

Preferably, an image acquisition module installed in a designated place indoors or outdoors, and acquiring image data of a specific surrounding through a real image sensor unit; A face that extracts and transmits temperature data for a corresponding face detection location along with image compression data, face detection location and size data based on the image data obtained from the image acquisition module and the measured temperature data extracted from the temperature data extraction module /Heat detection module; And the image compression data, the face detection location and size data transmitted from the face/heat detection module, as well as temperature data for the corresponding face detection location, and restore the compressed video data to the original image based on this, and the face detection location And, a face image is acquired from the reconstructed image according to the size information, and facial image features are extracted using landmark information extracted from the acquired face image, and face classification for the facial image features extracted through the face information storage unit And a face/heat control module that extracts face ID information, synthesizes the extracted face ID information and temperature information on the reconstructed image, and controls the output on the display screen.

Preferably, the face/heat detection module includes: an image compression unit for compressing the image data obtained from the image acquisition module and outputting image compressed data; The image data obtained from the image acquisition module and the measured temperature data extracted from the temperature data extraction module are each provided, and through deep learning-based image and data processing, the temperature for the corresponding face detection location along with face detection location and size data A face/heat detection unit for extracting data; And a data processing unit that transmits the image compression data output from the image compression unit as well as the face detection location and size data extracted from the face/heat detection unit, and temperature data for the corresponding face detection location to the face/heat control module. It may include.

Preferably, the face/heat control module includes: a data receiver receiving temperature data for a corresponding face detection location along with image compression data, face detection location and size data transmitted from the face/heat detection module; A real image restoration unit for restoring the compressed image data received from the data receiving unit into an original image; A face detection processing unit that acquires a face image from an image restored from the real image restoration unit according to the face detection position and size information received from the data receiving unit; A face information storage unit for storing and managing face classification and face ID information for each face image feature into a database (DB); By receiving the face image obtained from the face detection processing unit, extracting landmark information from the face image obtained through deep learning-based image and data processing, and extracting facial image features using the extracted landmark information. A face recognition processing unit for searching and extracting face classification and face ID information for a corresponding facial image feature extracted through the face information storage unit; An image synthesizing unit for synthesizing the image restored from the real image restoration unit with face ID information extracted from the face recognition processing unit and temperature information for a corresponding face detection position; An image output unit for outputting the image data synthesized by the image synthesizing unit on a display screen; And a face/heat control unit for controlling an operation of the image output unit so that the image data synthesized by the image synthesizing unit is displayed on a display screen to be visually viewed by a user.

Preferably, the image compression data received from the data receiving unit, the face detection location and size information along with the temperature information for the corresponding face detection location, the facial image feature information extracted from the face recognition processing unit, and the face classification for the corresponding facial image feature And a data storage unit for storing and managing at least one of face ID information or image information synthesized from the image synthesizing unit into a database (DB).

Preferably, at least one of image compression data received from the data receiving unit, facial image feature information extracted from the face recognition processing unit, face classification and face ID information for the corresponding facial image feature, or image information synthesized from the image synthesizing unit A data transmission unit for transmitting one piece of information to an external terminal or server through a communication network may be further included.

Preferably, the data transmission unit, when face classification and face ID information for the facial image feature extracted from a separate face information storage unit through the face recognition processing unit do not exist, the face information from the face recognition processing unit Face image feature information for face classification that does not exist in the storage unit may be provided and transmitted to the external terminal or server through the communication network.

Preferably, the external terminal or server receives facial image feature information for face classification that does not exist in the face information storage unit from the face recognition processing unit through the data transmission unit, and creates a separate face classification DB based on this. Through this, face ID information for a face classification that does not exist in the face information storage unit may be extracted, and face ID information and temperature information extracted from the reconstructed image may be synthesized and displayed on a display screen.

Preferably, the external terminal or server provides a service to search for temperature information corresponding to the corresponding face ID information and to search or play the restored image using face ID information input through a separate user input module. Can provide.

Preferably, the face/heat control unit may control the search for temperature information corresponding to the corresponding face ID information, search for a restored image, or play back using the face ID information input through a separate user input unit. .

Preferably, the face/heat control unit may control to search or play a restored image corresponding to a corresponding temperature by using temperature information input through a separate user input unit.

According to the heat detection device according to the change of the external environment of the present invention as described above, the alarm is generated by selecting the suspected heat generation according to changes in the external temperature and/or environment (eg, strong sunlight, rain, fog, etc.) By automatically changing and setting the alarm temperature setting value for the purpose, there is an advantage in that it is possible to effectively and quickly identify the suspected heat generation regardless of changes in the external environment.

In addition, according to the present invention, the thermal image sensor unit acquires the temperature data of the thermal image for a specific surrounding, and at the same time acquires the real image image data for the specific surrounding through the real image sensor unit, and the acquired image data and temperature data Based on this, there is an advantage of accurately recognizing a person's face and being able to quickly check the heating state of the recognized face.

1 is an overall block diagram illustrating an apparatus for detecting heat according to a change in an external environment according to an embodiment of the present invention.
2 is a detailed block diagram for explaining a face/heat detection module applied to an embodiment of the present invention.
3 is a detailed block diagram illustrating a face/heat control module applied to an embodiment of the present invention.

The above-described objects, features, and advantages will be described later in detail with reference to the accompanying drawings, and accordingly, one of ordinary skill in the art to which the present invention pertains will be able to easily implement the technical idea of the present invention. In describing the present invention, if it is determined that a detailed description of known technologies related to the present invention may unnecessarily obscure the subject matter of the present invention, a detailed description will be omitted.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

The terms used in the present invention have been selected from general terms that are currently widely used while considering functions in the present invention, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention exemplified below may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to more completely describe the present invention to those of ordinary skill in the art.

Combinations of each block of the attached block diagram and each step of the flowchart may be executed by computer program instructions (execution engine), and these computer program instructions are executed on the processor of a general purpose computer, special purpose computer or other programmable data processing equipment. As it may be mounted, its instructions executed by the processor of a computer or other programmable data processing equipment generate means for performing the functions described in each block of the block diagram or each step of the flowchart. These computer program instructions may also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular manner, so that the computer-usable or computer-readable memory It is also possible to produce an article of manufacture containing instruction means for performing the functions described in each block of the block diagram or each step of the flow chart.

In addition, since computer program instructions can be mounted on a computer or other programmable data processing equipment, a series of operation steps are performed on a computer or other programmable data processing equipment to create a process that is executed by a computer, It is also possible for the instructions to perform possible data processing equipment to provide steps for executing the functions described in each block of the block diagram and each step of the flowchart.

In addition, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing specified logical functions, and in some alternative embodiments mentioned in the blocks or steps. It should be noted that it is also possible for functions to occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially simultaneously, and the blocks or steps may be performed in the reverse order of a corresponding function as necessary.

1 is an overall block diagram illustrating a heat detection device according to a change in an external environment according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a face/heat detection module applied to an embodiment of the present invention. It is a detailed block diagram, and FIG. 3 is a detailed block diagram for explaining a face/heat control module applied to an embodiment of the present invention.

1 to 3, the heat detection device according to the change of the external environment according to an embodiment of the present invention is largely a temperature data extraction module 100, a temperature data analysis module 200, an alarm temperature setting module ( 300), an alarm generating module 400, and a power supply module 500. In addition, the heat detection device according to the change of the external environment according to an embodiment of the present invention further includes an image acquisition module 600, a face/heat detection module 700, and a face/heat control module 800. May be. Meanwhile, since the components shown in FIGS. 1 to 3 are not essential, the heat sensing device according to a change in the external environment according to an embodiment of the present invention may have more components or fewer components. have.

Hereinafter, components of a heat sensing device according to a change in an external environment according to an embodiment of the present invention will be described in detail.

The temperature data extraction module 100 is installed in a designated place indoors and/or outdoors, and obtains temperature data of a specific surrounding through at least one thermal image sensor unit 110 to extract measured temperature data of a human area. Functions.

At this time, the thermal image sensor unit 110 visually shows the thermal energy radiated from the surface of the subject, not the real object of the subject, and detects the thermal energy in the form of an infrared wavelength, which is a kind of electromagnetic wave, according to the intensity of radiant heat on the subject surface. Express them in different colors.

Meanwhile, as the thermal image sensor unit 110, an infrared (Infra-Red) camera may be used, but the present invention is not necessarily limited thereto, and in addition, a thermal image capable of appropriately generating a thermal image according to a specific ambient temperature. Various sensors may be used.

The temperature data analysis module 200 includes a preset reference normal temperature range (e.g., based on skin temperature) among measurement temperature data of a human region extracted for a preset extraction time (or for a certain time) from the temperature data extraction module 100. 34.1~34.5 degrees, about 36.3~36.7 degrees based on body temperature) It performs the function of calculating the skin temperature value of people in the current normal temperature range by analyzing the pattern of measured temperature data of people.

At this time, the data pattern analysis may be performed based on a conventional data mining technology, but is not limited thereto, and for example, various forms such as open source Hadoop, distributed parallel processing technology, and cloud computing. The techniques of can be applied.

The data mining refers to a process of discovering a new data model derived from data, extracting information that can be executed in the future, and using it for decision making. That is, the data mining is a process of generating new information by finding meaningful patterns, rules, or relationships from a large amount of data. Such data mining is performed using a mining pattern, and various data may be generated according to the mining pattern.

The alarm temperature setting module 300 is a body temperature difference value (e.g., about 1.3 to 1.7 degrees) between a pre-set fever suspect and a normal person from the skin temperature values of people in the current normal temperature range calculated from the temperature data analysis module 200. It performs the function of setting the alarm temperature value by adding about 1.5 degrees).

In addition, the alarm temperature setting module 300 is the skin temperature value of people in the preset standard normal temperature range in which the skin temperature values of people in the current normal temperature range calculated from the temperature data analysis module 200 are not affected by the external environment (for example, , About 34.1 to 34.5 degrees) (preferably, about 34.3 degrees) (preferably, the skin temperature value of people in the current normal temperature range is a preset constant value than the skin temperature value of people in the normal temperature range 0.5~1.5) or higher), the alarm temperature value is set by adding the body temperature difference between the suspected fever and the normal person from the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module 200 It is desirable to do it.

In addition, the alarm temperature setting module 300 is that the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module 200 is higher than the skin temperature value of people in the preset standard normal temperature range that is not affected by the external environment. In case (preferably, when the skin temperature value of people in the current normal temperature range is higher than the skin temperature value of people in the standard normal temperature range), the temperature data analysis module 200 The alarm temperature value can be set by subtracting the body temperature difference between a pre-set suspected fever and a normal person from the skin temperature value of people in the current normal temperature range calculated from.

When the measured temperature value of the person area extracted from the temperature data extraction module 100 is higher than the alarm temperature value set from the alarm temperature setting module 300, the user visually and/or audibly suspects heat generation. Performs the function of generating an alarm so that rulers can be identified.

The power supply module 500 includes each of the aforementioned modules, that is, a temperature data extraction module 100, a temperature data analysis module 200, an alarm temperature setting module 300, an alarm generation module 400, and an image acquisition module 600. ), the face/heat detection module 700, and/or the face/heat control module 800, etc., perform a function of supplying power necessary for the operation.For continuous power supply, commercial alternating current (AC) power ( For example, AC 220V or 380V, etc.) is preferably implemented to convert into direct current (DC) and/or alternating current (AC) power, but the present invention is not limited thereto, and may be implemented including a conventional portable battery.

In addition, the power supply module 500 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an Electro Static Damage (ESD) protector, a power detector, a rectifier, and a power circuit breaker.

Here, the ESD protector is configured to protect electric components from static electricity or sudden power shock. The power detector is configured to transmit a cutoff signal to the power circuit breaker when a voltage outside the allowable voltage range is introduced, and transmit a boost or step down signal to the rectifier according to a voltage change within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to a signal from the power detector so that a constant voltage is supplied by minimizing a fluctuation of the input voltage. The power circuit breaker is configured to cut off power supplied from the battery according to the blocking signal transmitted from the power detector.

Additionally, the image acquisition module 600 is installed in a designated place indoors and/or outdoors (preferably the same place as the temperature data extraction module 100), and through the real image sensor unit 610, a specific surrounding image It performs the function of acquiring data.

Such an image acquisition module 600 is preferably made to include an infrared (IR) camera or a solid-state image pickup device (Charge Coupled Device, CCD) camera, etc. that can photograph even in a dark place, but is not limited thereto. As a kind, the most commonly used USB (Universal Serial Bus) camera, a general video camera that can shoot a continuous video, a camera or device that can shoot an image of a specific place (e.g., IP camera, CCTV Etc.) can be anything.

At this time, the solid-state imaging device (CCD) camera is composed of an optical unit, a solid-state imaging device (CCD), and a driving unit that drives the same, and acquires bitmap data input to the solid-state imaging device (CCD) through the optical unit. The bitmap data may include both image data of a still image and video data.

In addition, the USB camera is basically composed of a camera, an interface unit, a USB host, etc., and a plurality of endpoints are configured between the camera and the interface unit, one of which is a snapshot dedicated endpoint. And the other as a video-only endpoint.

The camera processes the input image as digital data and outputs it to the interface unit, and the interface unit converts the digital data input through the endpoint according to USB standard specifications and transmits it to the USB host, and the USB host It displays data on its own monitor or transmits it to the other's USB host for video communication.

Meanwhile, although not shown in the drawing, the image acquisition module 600 typically includes a real image sensor, that is, an image sensor, an image signal processor (ISP), and a back-end chip. Includes.

The image sensor outputs an image signal formed by light incident from the lens as raw Bayer RGB format data. The image signal processor (ISP) converts the Bayer RGB format data into RGB format data, converts it into YUV format data required for screen output of a display device, and outputs the converted data.

The back-end chip is in charge of controlling a camera module including processing the YUV format data output from the image signal processor (ISP) and outputting a photographed image through the screen of the display device. A mobile switching modem (MSM) or a digital signal processor (DSP) may be used. Meanwhile, the image signal processor (ISP) and/or the back end chip may be included in the face/heat detection module 700 to be described later.

That is, when photographing using the image acquisition module 600, the image sensor unprocessed Bayer RGB format data is communicated in an IIC (Inter Integrated Circuit) method according to the image pickup signal formed by the light incident from the lens. The image signal processor (ISP) that outputs and receives it converts it into actual RGB format data, and converts the RGB format data to the YUV format required for display screen output, that is, required for the back-end chip for image processing. Converts to data and outputs it using IIC (Inter Integrated Circuit) communication. Then, the back-end chip processes the received YUV format data and outputs a photographed image through the screen of the display device.

Further, the face/heat detection module 700 includes image compression data, face detection position and size data based on the image data obtained from the image acquisition module 600 and the measured temperature data extracted from the temperature data extraction module 100. Together, it extracts and transmits temperature data for the corresponding face detection location.

As shown in FIG. 2, the face/heat detection module 700 includes an image compression unit 710, a face/heat detection unit 720, a data processing unit 730, and a power supply unit 740. It is done by doing. Meanwhile, since the components shown in FIG. 2 are not essential, the face/heat detection module 700 applied to an embodiment of the present invention may have more components or fewer components.

Hereinafter, elements of the face/heat detection module 700 applied to an embodiment of the present invention will be described in detail.

The image compression unit 710 performs a function of compressing the image data obtained from the image acquisition module 600 and outputting the image compressed data.

The face/heat detection unit 720 receives image data obtained from the image acquisition module 600 and measured temperature data extracted from the temperature data extraction module 100, respectively, and is based on deep learning, a type of machine learning. It performs a function of extracting temperature data for a corresponding face detection location along with face detection location and size data through image and data processing of.

The data processing unit 730 includes the image compression data output from the image compression unit 710, as well as the face detection position and size data extracted from the face/heat detection unit 720, and temperature data for the corresponding face detection position. It performs a function of transmitting the heat to the control module 800.

The power supply unit 740 performs a function of supplying necessary power to each of the aforementioned units, that is, the image compression unit 710, the face/heat detection unit 720, and/or the data processing unit 730. It is desirable to implement a commercial alternating current (AC) power source (e.g., AC 220V) to a direct current (DC) and/or alternating current (AC) power source for power supply, but is not limited thereto, and a conventional portable battery It can also be implemented by including.

In addition, the power supply unit 740 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an Electro Static Damage (ESD) protector, a power detector, a rectifier, and a power circuit breaker.

Here, the ESD protector is configured to protect electric components from static electricity or sudden power shock. The power detector is configured to transmit a cutoff signal to the power circuit breaker when a voltage outside the allowable voltage range is introduced, and transmit a boost or step down signal to the rectifier according to a voltage change within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to a signal from the power detector so that a constant voltage is supplied by minimizing a fluctuation of the input voltage. The power circuit breaker is configured to cut off power supplied from the battery according to the blocking signal transmitted from the power detector.

In addition, the face/heat control module 800 receives image compression data, face detection location, and size data transmitted from the face/heat detection module 700, as well as temperature data for a corresponding face detection location, and compresses the image based on this. It restores the data to the original image and performs a function of acquiring a face image from the restored image according to the face detection location and size information.

In addition, the face/heat control module 800 extracts a facial image feature using landmark information extracted from the acquired face image, and a face for the facial image feature extracted through the face information storage unit 820. Classification and face ID information is extracted, and the extracted face ID information and temperature information are synthesized in the reconstructed image to be displayed on a display screen.

As shown in FIG. 3, the face/heat control module 800 is largely a data receiving unit 805, a real image restoration unit 810, a face detection processing unit 815, a face information storage unit 820, and face recognition. A processing unit 825, an image synthesizing unit 830, an image output unit 835, a face/heating control unit 840, and/or a power supply unit 845 are included. In addition, the face/heat control module 800 may further include a data storage unit 850, a data transmission unit 855, and/or a user input unit 860. Meanwhile, since the components shown in FIG. 3 are not essential, the face/heat control module 800 applied to an embodiment of the present invention may have more components or fewer components.

Hereinafter, components of the face/heat control module 800 applied to an embodiment of the present invention will be described in detail.

The data receiving unit 805 performs a function of receiving image compression data, face detection position and size data transmitted from the face/heat detection module 700, and temperature data for a corresponding face detection position.

The real image restoration unit 810 performs a function of restoring the compressed image data received from the data receiving unit 805 into an original real image.

The face detection processing unit 815 performs a function of acquiring a face image from a real image reconstructed from the real image restoration unit 810 according to the face detection position and size information received from the data receiving unit 805.

The face information storage unit 820 performs a function of classifying faces according to facial image features and storing and managing face ID information in a database (DB).

The face recognition processing unit 825 receives the face image obtained from the face detection processing unit 815 and makes a landmark in the face image acquired through image and data processing based on deep learning, a kind of machine learning. A function of extracting information, extracting facial image features using the extracted landmark information, and searching and extracting face classification and face ID information for the facial image features extracted through the face information storage unit 820 Perform.

The image synthesizing unit 830 performs a function of synthesizing the face ID information extracted from the face recognition processing unit 825 on the real image restored from the real image restoration unit 810 and temperature information on a corresponding face detection position.

The image output unit 835 performs a function of outputting the image data synthesized by the image synthesis unit 830 on a display screen.

Such an image output unit 835 is, for example, a liquid crystal display (LCD), a light emitting diode display (LED), a thin film transistor liquid crystal display (TFT LCD), and an organic light emitting diode. Organic Light Emitting Diode (OLED), Flexible Display, Plasma Display Panel (PDP), Surface Alternate Lighting (ALiS), Digital Light Source Treatment (DLP), Silicon Liquid Crystal (LCoS), Surface Conductive electron-emitting device display (SED), field emission display (FED), laser TV (quantum dot laser, liquid crystal laser), optoelectric liquid display (FLD), interferometric modulator display (iMoD), thick film dielectric electricity (TDEL) , Quantum dot display (QD-LED), telescopic pixel display (TPD), organic light emitting transistor (OLET), laser fluorescent display (LPD), 3D display (3D display), but is limited to this It can include anything as long as it can display an image signal or the like.

The face/heat control unit 840 performs overall control of the face/heat control module 800 applied to the embodiment of the present invention. Each of the aforementioned units, that is, the data receiving unit 805 and the real image restoration unit 810 ), face detection processing unit 815, face information storage unit 820, face recognition processing unit 825, image synthesis unit 830, image output unit 835, power supply unit 845, data storage unit 850 , Performs a function of controlling the operation of the data transmission unit 855 and/or the user input unit 860.

In addition, the face/heat control unit 840 performs a function of controlling the operation of the image output unit 835 so that the image data synthesized from the image synthesis unit 830 is displayed on the display screen so that the user can visually see it. .

In addition, the face/heat control unit 840 uses the face ID information input through the user input unit 860 to search for temperature information corresponding to the corresponding face ID information, and to search and/or play the restored image. Can perform the function

In addition, the face/heat control unit 840 may perform a function of controlling so that a restored image corresponding to a corresponding temperature can be searched and/or reproduced using temperature information input through the user input unit 860.

In addition, the power supply unit 845 includes the above-described units, that is, a data receiving unit 805, a real image restoration unit 810, a face detection processing unit 815, a face information storage unit 820, a face recognition processing unit 825, A function of supplying necessary power to the image synthesis unit 830, the image output unit 835, the face/heat control unit 840, the data storage unit 850, the data transmission unit 855, and/or the user input unit 860 To perform the bar, commercial alternating current (AC) power (eg, AC 220V) is preferably implemented to convert into direct current (DC) and/or alternating current (AC) power for continuous power supply, but is not limited thereto, It can also be implemented by including a conventional portable battery (Battery).

In addition, the power supply unit 845 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an Electro Static Damage (ESD) protector, a power detector, a rectifier, and a power circuit breaker.

Here, the ESD protector is configured to protect electric components from static electricity or sudden power shock. The power detector is configured to transmit a cutoff signal to the power circuit breaker when a voltage outside the allowable voltage range is introduced, and transmit a boost or step down signal to the rectifier according to a voltage change within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to a signal from the power detector so that a constant voltage is supplied by minimizing a fluctuation of the input voltage. The power circuit breaker is configured to cut off power supplied from the battery according to the blocking signal transmitted from the power detector.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). , Processors, controllers, micro-controllers, microprocessors, and electric units for performing functions may be used. In some cases, such embodiments may be implemented by the face/heat control 840.

According to a software implementation, embodiments such as procedures or functions may be implemented together with separate software modules that perform at least one function or operation. The software code can be implemented by a software application written in an appropriate programming language. In addition, the software code may be stored in the data storage unit 850 to be described later, and executed by the face/heat control unit 840.

In addition, the data storage unit 850 includes image compression data received from the data receiving unit 805, face detection location and size information, temperature information for the face detection location, and facial image features extracted from the face recognition processing unit 825 It performs a function of storing and managing at least one of information, face classification and face ID information for a corresponding facial image feature, and/or image information synthesized from the image synthesizing unit 830 into a database (DB).

The data storage unit 850 is, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD Memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , A magnetic memory, a magnetic disk, an optical disk, and at least one type of storage medium.

The data transmission unit 855 includes image compression data received from the data receiving unit 805, facial image feature information extracted from the face recognition processing unit 825, face classification and face ID information for the corresponding facial image feature, and/or image synthesis. At least one of the video information synthesized from the unit 830 is transmitted to an external terminal 20 (eg, a user terminal, an administrator terminal, a client terminal, etc.) and/or a server (not shown) through the communication network 10. ) To transmit.

In addition, the data transmission unit 855 is the face recognition processing unit 825 if there is no face classification and face ID information for the facial image feature extracted from the face information storage unit 820 through the face recognition processing unit 825. ) To perform a function of receiving facial image feature information for face classification that does not exist in the face information storage unit 820 and transmitting it to an external terminal 20 and/or a server through the communication network 10 I can.

At this time, the communication network 10 is a communication network that is a high-speed backbone network of a large communication network capable of large-capacity, long-distance voice and data services, and Wi-Fi, WiGig, for providing Internet or high-speed multimedia services. It may be a next-generation wireless communication network including Wibro (Wireless Broadband Internet, Wibro) and Wimax (World Interoperability for Microwave Access, Wimax).

The Internet is a TCP/IP protocol and various services existing at its upper layer, namely HTTP (Hyper Text Transfer Protocol), Telnet, FTP (File Transfer Protocol), DNS (Domain Name System), SMTP (Simple Mail Transfer Protocol), It refers to a global open computer network structure that provides Simple Network Management Protocol (SNMP), Network File Service (NFS), and Network Information Service (NIS), and the face/heat control module 800 is an external terminal 20 And/or it provides an environment that allows access to the server (Server). Meanwhile, the Internet may be a wired or wireless Internet, or may be a core network integrated with a wired public network, a wireless mobile communication network, or a portable Internet.

If the communication network 10 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a wideband code division multiple access (WCDMA) communication network may be used. In this case, although not shown in the drawing, the mobile communication network may include, for example, a Radio Network Controller (RNC). Meanwhile, although the WCDMA network was exemplified as an example, it may be a next-generation communication network such as a cellular 3G network, an LTE network, a 4G network, and a 5G network, and other IP-based IP networks. The communication network 10 serves to mutually transmit signals and data from the face/heat control module 800 and the external terminal 20 and/or the server.

In addition, the external terminal 20 and/or the server receives facial image feature information for face classification that does not exist in the face information storage unit 820 from the face recognition processing unit 825 through the data transmission unit 855. Based on this, face ID information for face classification that does not exist in the face information storage unit 820 is extracted through a separate face classification DB (not shown), and face ID information and temperature extracted from the restored image The function of synthesizing information and outputting it to a display screen can be performed.

In addition, the external terminal 20 and/or the server uses the face ID information input through a separate user input unit (not shown) (which may be configured in the same manner as the user input unit 860). A function of providing a service to search for temperature information corresponding to the ID information, search for and/or reproduce the restored image may be performed.

On the other hand, the external terminal 20 includes various mobile terminals that communicate through the wireless Internet or the portable Internet, and in addition, a Palm PC, a smart phone, a mobile play-station, and a communication function DMB (Digital Multimedia Broadcasting) phone, tablet PC, iPad (iPad), such as face/heat control module 800 and/or all wired/wireless home appliances/communication devices having a user interface for accessing the server. Can mean as.

In particular, when the external terminal 20 is implemented as a conventional smartphone, the smartphone is freely used by downloading various application programs desired by the user, unlike a general mobile phone (a feature phone). As a phone based on an open operating system that can be deleted and deleted, not only functions such as voice/video calls and Internet data communication, which are commonly used, but also all mobile phones with mobile office functions, or without voice call functions, are connected to the Internet. It is desirable to understand it as a communication device including all possible Internet phones or tablet PCs.

Such a smart phone may be implemented as a smart phone equipped with various open operating systems, and the open operating systems include, for example, Symbian of NOKIA, Blackberry of RIMS, iPhone of Apple, It can be made with Microsoft's Windows Mobile, Google's Android, and Samsung Electronics' Sea.

As described above, since the smart phone uses an open operating system, unlike a mobile phone having a closed operating system, a user can arbitrarily install and manage various application programs.

The user input unit 860 performs a function of outputting a user input signal according to a user's manipulation. The user input unit 860 is preferably made of a keyboard, and may include a mouse, and in some cases, may be made of a remote control.

Meanwhile, although not shown in the drawings, the external server is connected to the external terminal 20 and/or the face/heat control module 800 through the communication network 10, and the face/heat control module 800 ), along with the image compression data, face detection location and size data, and temperature data for the corresponding face detection location, restore the compressed image data to the original image based on this, and restore according to the face detection location and size information It is possible to perform a function of acquiring a face image from the generated image.

In addition, an external server extracts facial image features using landmark information extracted from the acquired facial image, and faces for facial image features extracted through a separate face classification DB (not shown). A function of extracting classification and face ID information, synthesizing the extracted face ID information and temperature information on the reconstructed image, and outputting it to the display screen may be performed.

In addition, the external server responds to the corresponding face ID information using face ID information input through a separate user input module (not shown) (for example, it may be configured in the same manner as the user input unit 860). A function of providing a service may be performed to search for temperature information to be used and/or to search for and/or reproduce a restored image.

In addition, the external server includes image compression data, face detection location and size data transmitted from the face/heat control module 800, as well as temperature data for the face detection location, the extracted facial image feature information, and At least one of face classification and face ID information for facial image features, and/or image information obtained by synthesizing face ID information and temperature information extracted from the reconstructed image is stored in a separate face information DB (not shown) And a function of providing a service to be managed.

The apparatus for detecting fever according to an embodiment of the present invention described above automatically generates and automatically changes the temperature value for each patient with suspected fever by analyzing the temperature pattern data of the normal person measured from the temperature data extraction module 100. Tracking) function can be performed.

In addition, the apparatus for detecting fever according to an embodiment of the present invention may support an automatic alarm setting mode and/or a manual alarm setting mode based on a temperature value classified for a corresponding patient with suspected fever.

That is, the automatic alarm setting mode is a mode that automatically sets the alarm temperature to classify patients with suspected fever based on the analyzed temperature pattern data, and the manual alarm setting mode allows the user to identify patients with suspected fever based on the analyzed temperature pattern data. This is the mode to set.

In addition, the apparatus for detecting heat according to an embodiment of the present invention may support two modes of expressing temperature: a skin mode and a body temperature mode.

That is, the skin temperature mode is a mode that uses the actual measured skin temperature, and displays the actual skin temperature according to the external environment, and the body temperature mode uses a standard obtained by correcting the measured temperature of a normal person to a body temperature of 36.5 degrees. This mode is displayed based on a normal person's body temperature of 36.5 degrees, regardless of the external environment.

Although the above-described preferred embodiment of the heat sensing device according to the change of the external environment according to the present invention has been described, the present invention is not limited thereto, and within the scope of the claims and the detailed description of the invention and the accompanying drawings. It is possible to change and implement it, and this also belongs to the present invention.

100: temperature data extraction module,
200: temperature data analysis module,
300: alarm temperature setting module,
400: alarm generating module,
500: power supply module,
600: image acquisition module,
700: face/heat detection module,
800: face/heat control module

Claims (13)

A temperature data extraction module installed in a designated place indoors or outdoors, and extracting measured temperature data of a person region by obtaining temperature data of a specific surrounding through a thermal image sensor unit;
Temperature data for calculating skin temperature values of people in the current normal temperature range by analyzing the measurement temperature data pattern of people in the preset standard normal temperature range among the measured temperature data of the human region extracted from the temperature data extraction module during a preset extraction time. Analysis module;
An alarm temperature setting module configured to set an alarm temperature value by adding a predetermined difference in body temperature between a suspected fever and a normal person from skin temperature values of people in the current normal temperature range calculated from the temperature data analysis module;
An alarm generating module for generating an alarm so that a user can visually or audibly identify a person suspected of heating when the measured temperature value of the person region extracted from the temperature data extraction module is higher than the alarm temperature value set by the alarm temperature setting module;
An image acquisition module installed in a designated place indoors or outdoors, and obtaining image data of a specific surrounding through a real image sensor unit;
A face that extracts and transmits temperature data for a corresponding face detection location along with image compression data, face detection location and size data based on the image data obtained from the image acquisition module and the measured temperature data extracted from the temperature data extraction module /Heat detection module; And
Compressed image data, face detection position and size data transmitted from the face/heat detection module, as well as temperature data for a corresponding face detection location are received, and based on this, the compressed image data is restored to the original image, and the face detection location and A face image is acquired from the reconstructed image according to size information, and facial image features are extracted using landmark information extracted from the acquired face image, and face classification and facial image features extracted through the face information storage unit A face/heat control module for extracting face ID information, synthesizing the extracted face ID information and temperature information on the restored image, and controlling it to be output on a display screen,
The face/heat control module includes a data receiving unit receiving temperature data for a corresponding face sensing position along with image compression data, face sensing position and size data transmitted from the face/heat sensing module, and a data receiving unit received from the data receiving unit. A real image restoration unit for restoring compressed image data to an original image, and a face detection processing unit for acquiring a face image from an image restored from the real image restoration unit according to the face detection position and size information received from the data receiving unit; A face information storage unit that stores and manages face classification and face ID information by face image feature into a database (DB), and a face image obtained from the face detection processing unit is provided and acquired through deep learning-based image and data processing. Landmark information is extracted from the generated face image, facial image features are extracted using the extracted landmark information, and face classification and face ID information for the facial image feature extracted through the face information storage unit are searched and An image synthesizing unit for synthesizing the extracted face recognition processing unit, the face ID information extracted from the face recognition processing unit and the temperature information for the corresponding face detection position on the image restored from the real image restoration unit, and the image synthesizing unit An image output unit that outputs the generated image data on a display screen, and a face/heat control unit that controls the operation of the image output unit so that the image data synthesized from the image synthesis unit is displayed on the display screen so that the image data synthesized from the image synthesis unit can be visually viewed by a user , At least one of image compression data received from the data receiving unit, facial image feature information extracted from the face recognition processing unit, face classification and face ID information for the corresponding facial image feature, or image information synthesized from the image synthesizing unit. Including a data transmission unit for transmitting information to an external terminal or server through a communication network,
When the face classification and face ID information for the facial image feature extracted from a separate face information storage unit through the face recognition processing unit do not exist, the data transmission unit may receive the face information storage unit from the face recognition processing unit. A fever detection apparatus according to a change in an external environment, characterized in that receiving facial image feature information for a non-existent face classification and transmitting it to the external terminal or server through the communication network.
The method of claim 1,
The alarm temperature setting module, when the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module is lower than the skin temperature value of people in the preset standard normal temperature range that is not affected by the external environment, the temperature data An apparatus for detecting fever according to changes in external environment, characterized in that the alarm temperature value is set by adding a predetermined difference in body temperature between the suspected fever and the normal person from the skin temperature values of people in the current normal temperature range calculated from the analysis module.
The method of claim 2,
The alarm temperature setting module, when the skin temperature value of people in the current normal temperature range calculated from the temperature data analysis module is higher than the skin temperature value of people in the preset standard normal temperature range that is not affected by the external environment, the temperature data A fever detection device according to a change in external environment, characterized in that the alarm temperature value is set by subtracting a predetermined difference in body temperature between the suspected fever and the normal person from the skin temperature value of people in the current normal temperature range calculated from the analysis module.
delete The method of claim 1,
The face/heat detection module,
An image compression unit outputting image compressed data by compressing the image data obtained from the image acquisition module;
The image data obtained from the image acquisition module and the measured temperature data extracted from the temperature data extraction module are each provided, and through deep learning-based image and data processing, the temperature for the corresponding face detection location along with face detection location and size data A face/heat detection unit for extracting data; And
A data processing unit that transmits the image compression data output from the image compression unit as well as the face detection location and size data extracted from the face/heat detection unit, and temperature data for a corresponding face detection location to the face/heat control module Heat detection device according to the change of the external environment, comprising a.
delete The method of claim 1,
The face/heat control module includes: image compression data received from the data receiving unit, temperature information for a corresponding face detection location along with face detection location and size information, facial image feature information extracted from the face recognition processing unit, and a corresponding face image Changes in external environment, characterized in that it further comprises a data storage unit for storing and managing by forming a database (DB) of at least one of face classification and face ID information for a feature, or image information synthesized from the image synthesizing unit Fever detection device according to.
delete delete The method of claim 1,
The external terminal or server receives facial image feature information for face classification that does not exist in the face information storage unit from the face recognition processing unit through the data transmission unit, and based on this, the face image feature information is provided through a separate face classification DB. Heat according to changes in external environment, characterized in that face ID information for face classification that does not exist in the information storage unit is extracted, and the extracted face ID information and temperature information are synthesized in the restored image and output to the display screen. Detection device.
The method of claim 10,
The external terminal or server provides a service to search for temperature information corresponding to the corresponding face ID information using face ID information input through a separate user input module, and to search or play the restored image. Heat detection device according to the change of the external environment, characterized in that.
The method of claim 1,
The face/heat control unit controls the temperature information corresponding to the face ID information to be searched, and the restored image to be searched or reproduced using the face ID information input through a separate user input unit. Heat detection device according to changes in environment.
The method of claim 1,
The face/heat control unit controls the retrieval or reproduction of a restored image corresponding to a corresponding temperature using temperature information input through a separate user input unit. .

Images