WO2023074995A1 - System for detecting and expressing abnormal temperature at industrial site by using thermal imaging camera and generating alarm to inform of same, and operation method thereof - Google Patents

Abstract

Provided are, according to one embodiment of the present invention, a system for detecting and expressing an abnormal temperature at an industrial site by using a thermal imaging camera and generating an alarm to inform of same, and an operation method thereof, the system comprising: a camera module that creates a thermal image by photographing an industrial site; and a server that analyzes the thermal image received from the camera module and determines whether an abnormal temperature exists in the facility, wherein if an abnormal temperature appears in the thermal image, it notifies a manager of an abnormal facility event, such that an accident can be prevented in advance or an accident can be quickly dealt with.

Description

A system that detects and expresses an abnormal temperature at an industrial site with a thermal imaging camera and generates an alarm and an operation method thereof

The present invention relates to a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera and generates an alarm to notify the user, and an operating method thereof.

Economic loss and human loss are occurring due to accidents at industrial sites. Recently, with the development of information and communication technology, there are attempts to automatically detect accidents in industrial sites. Conventional industrial site safety management technology analyzes data collected from sensors installed in facilities to detect accidents, and there is a problem in that available data is limited and the range of use is narrow.

On the other hand, conventional surveillance camera systems (CCTV) used in industrial sites have been used for simple purposes such as checking access through video recording and storage. Various accidents such as fire, explosion, leakage of toxic gas, high temperature, and smoke may occur in industrial sites. In order to be able to detect abnormalities in industrial sites and deal with them in advance before accidents occur, technology for detecting abnormalities in industrial sites is required.

[Prior art literature]

[Patent Literature]

(Patent Document 1) KR 10-2015-0050752 A

An object according to an embodiment of the present invention is a thermal imaging camera that analyzes a thermal image received from a camera photographing an industrial site and determines that an abnormal event has occurred when a temperature outside the normal range is measured. It provides a system and its operation method for detecting and expressing and alerting by generating an alarm.

According to an embodiment of the present invention, a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm using a thermal imaging camera includes a camera module for generating a thermal image by photographing an industrial site, and a thermal image received from the camera module. It may include a server that analyzes the thermal image and determines whether an abnormal temperature exists in the facility.

In addition, the server analyzes the storage unit for storing the optical image and the thermal image received from the camera module, determines whether a temperature outside the normal temperature is detected, and if a temperature outside the normal temperature is detected, a facility abnormality is detected. A facility abnormality determination unit outputting the occurrence of an event, and a notification unit notifying a manager of the occurrence of the abnormal event when the equipment abnormality determination unit outputs the occurrence of the equipment abnormality event.

In addition, the equipment abnormality determination unit extracts gray scale values for each pixel from the frame of the thermal image to create a gray scale matrix, and uses the minimum and maximum temperatures of the thermal imaging camera matched to the minimum and maximum values of the gray scale values. Then, the gray scale value is converted into temperature, and the temperature of the pixel is compared with the normal temperature. If there is a difference greater than the standard deviation, a facility failure event can be output.

In addition, the normal temperature may be determined as an average of temperatures collected during the steady-state adaptation period for each pixel.

In addition, the facility abnormality determination unit may not output an equipment abnormality event when the temperature of the pixel determined to be out of the normal temperature corresponds to the body temperature range.

In addition, the facility abnormality determination unit may apply the normal temperature differently according to the operating state of the facility.

In addition, the facility abnormality determination unit may divide the frame into one or more zones, and set a standard deviation, a high temperature limit value, a low temperature limit value, a normal temperature, a judgment reference time, and a steady state adaptation period differently for each of the zones.

In addition, the notification unit extracts an image in which the color of a pixel determined to be out of the normal temperature in the frame of the thermal image is displayed as a first color and an optical image image taken in the same direction as the frame of the thermal image from the optical image can be provided to the manager.

According to an embodiment of the present invention, a method of operating a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm with a thermal imaging camera, the camera module photographs the industrial site, generates a thermal image, and transmits the thermal image to a server. An image generation step, a facility abnormality determination step in which the equipment abnormality determination unit of the server determines that a facility abnormality event has occurred when the temperature recognized in the thermal image is out of the normal temperature, and the equipment abnormality determination unit outputs the occurrence of the equipment abnormality event In this case, the notification unit of the server may include a notification step of notifying an administrator of the occurrence of an abnormal event.

In addition, the equipment abnormality determination step includes a temperature calculation step of converting the gray scale value of each pixel of the thermal image frame into the current temperature, and calculating and calculating the deviation between the normal temperature and the current temperature, which is calculated as an average of accumulated temperatures in a normal state. A deviation determination step of determining that an abnormal temperature exists when the measured deviation is greater than the standard deviation may be included.

In addition, the facility abnormality determination step may further include a body temperature determination step of determining that an abnormal temperature has not occurred when the current temperature is within the body temperature range after the temperature calculation step.

In addition, the facility abnormality determination step may further include a limit determination step of determining that an abnormal temperature exists when the current temperature is not included between the low temperature limit value and the high temperature limit value after the temperature calculation step.

In addition, in the facility abnormality determination step, after the temperature calculation step, if the current time is before the steady state adaptation period, the current temperature is accumulated and stored as a normal temperature in the storage unit, and the normal temperature is calculated by averaging the accumulated normal temperatures. A normal temperature generating step may be further included.

In addition, the operating method of the system for detecting and expressing an abnormal temperature in an industrial field and generating an alarm using a thermal imaging camera according to an embodiment of the present invention is performed before the image generation step, and the region of the frame and the standard deviation , a high temperature limit value, a low temperature limit value, a normal temperature, a judgment standard time, and a variable setting step of setting one or more of the steady state adaptation period.

In addition, after the deviation determination step, an event determination step of counting frames or times in which the abnormal temperature exists using a timer and determining that an equipment abnormality event has occurred when the cumulative value of the timer reaches the determination reference time is further performed. can include

In addition, the notification step transmits a facility abnormality event through e-mail, includes information on the area where the abnormal temperature occurs in the body of the e-mail, and includes an image displaying pixels where the abnormal temperature occurs in the frame image of the thermal image. can

Features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

Prior to this, the terms or words used in this specification and claims should not be interpreted in a conventional and dictionary sense, and the inventor may appropriately define the concept of the term in order to explain his or her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is.

According to one embodiment of the present invention, when a temperature outside the normal range is measured at an industrial site, it is determined that an abnormal event has occurred, and the occurrence of the abnormal event is automatically notified to a manager so as to quickly prevent or respond to accidents. can support

1 is a diagram illustrating an industrial site and a system for detecting and expressing an abnormal temperature in an industrial site and generating an alarm using a thermal imaging camera according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a system for detecting and expressing an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and generating an alarm to notify the user.

3A is a flowchart illustrating an operation method of a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates and informs an alarm.

FIG. 3B is a flowchart specifically illustrating a facility abnormality determination step of an operation method of a system for detecting and expressing an abnormal temperature in an industrial site and generating an alarm to notify an abnormal temperature using a thermal imaging camera according to an embodiment of the present invention.

FIG. 4 is a diagram illustrating a process of recognizing a temperature by a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm.

5 is a diagram illustrating a process of recognizing a normal temperature by a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm.

6 is a diagram illustrating a process of comparing a normal temperature and a current temperature in a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm using a thermal imaging camera according to an embodiment of the present invention.

7 is a view showing an alarm generated by a system for detecting and expressing an abnormal temperature in an industrial site and generating an alarm using a thermal imaging camera according to an embodiment of the present invention and displaying an area where an abnormal temperature occurs.

8 is a diagram illustrating a thermal image frame and an optical frame in which an abnormal temperature is generated, provided to a manager by a notification unit.

9 is a diagram showing the structure of mail used by the notification unit.

Objects, specific advantages and novel features of an embodiment of the present invention will become more apparent from the following detailed description and preferred embodiments taken in conjunction with the accompanying drawings. In adding reference numerals to components of each drawing in this specification, it should be noted that the same components have the same numbers as much as possible, even if they are displayed on different drawings. In addition, terms such as "one side", "other side", "first", and "second" are used to distinguish one component from another, and the components are not limited by the above terms. no. Hereinafter, in describing an embodiment of the present invention, a detailed description of related known technologies that may unnecessarily obscure the subject matter of an embodiment of the present invention will be omitted.

In addition, it should be noted that the terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention, and singular expressions include plural expressions unless otherwise specified in context.

Hereinafter, with reference to the accompanying drawings, an embodiment of the present invention will be described in detail.

1 is a diagram showing a system 10 and an industrial site 1 that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm.

The industrial site (1) may include various indoor facilities such as factories, research institutes, laboratories, chemical plants, oil refineries, automation facilities, and smart factories, as well as outdoor facilities such as ports, ports, logistics hubs, and loading docks. In the industrial site (1), various facilities (2) such as motors, heaters, air conditioners, pipes, distillers, etc. may be installed. In the industrial site (1), there may be various people (3) such as workers, managers, or visitors who work using the facility (2). An accident that occurs at an industrial site (1) may injure a person (3) or damage a facility (2). A system 10 that detects and expresses an abnormal temperature at an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates an alarm to notify the user of an accident that may occur at the industrial site 1 in advance, or when an accident occurs In order to quickly cope with the situation, an abnormal event occurring in the facility 2 may be detected and the occurrence of the abnormal event may be notified to a manager. The manager may include a safety manager, a worker, and the like of the industrial site (1), and may include public officials such as a fire station, an ambulance, and a district office.

The abnormal event may include a facility abnormal event. Abnormal events include cases in which the person (3) falls due to accidents such as leakage of toxic gas or electric shock, or the person (3) falls down due to a disease such as heart attack or stroke, and the person (3) lies on the floor. You may. The facility abnormality event may include the detection of a temperature outside of the normal temperature within the industrial site 1 . For example, when an abnormal temperature occurs, such as a rise in temperature due to overheating of a motor or a pump, a rise in temperature due to a fire, or a drop in temperature due to leakage of cooling water, a facility abnormality event has occurred. The ideal temperature is a temperature out of the normal temperature, and may include a temperature higher than the normal temperature or a temperature lower than the normal temperature.

2 is a block diagram showing a system 10 that detects and expresses an abnormal temperature at an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates and informs an alarm. See Figures 1 and 2 together.

A system 10 for detecting and expressing an abnormal temperature in an industrial site and generating an alarm with a thermal imaging camera according to an embodiment of the present invention, a camera module 100 for generating a thermal image by photographing an industrial site 1 ), and a server 200 that analyzes the thermal image received from the camera module 100 to determine whether an abnormal temperature exists in the facility 2.

The camera module 100 may be disposed in the industrial site 1 to photograph a space where facilities 2 or people 3 exist. A plurality of camera modules 100 may be disposed in the industrial site 1 . The camera module 100 may change a photographing direction according to a control signal received from the server 200 . The camera module 100 may include one or more thermal imaging cameras 120 . The camera module 100 may include an optical camera 110 and a thermal imaging camera 120 together in one module.

The optical camera 110 may include a general digital camera of the RGB method. The optical camera 110 may generate an optical image recognizable by the eyes of a person 3 by photographing the industrial site 1 in the visible ray region. The infrared camera (IR camera) 120 may include a digital camera that captures an infrared region. The thermal imaging camera 120 may capture the industrial site 1 in the infrared region and generate a grayscale thermal image.

Server 200 may be installed in the industrial site (1). The server 200 may be connected to the camera module 100 through a wired or wireless network, receive an image generated by the camera module 100, and control the camera module 100. The server 200 is a computer device having an information processing function. The camera module 100 and the server 200 may be connected through a closed circuit or through an encrypted network using an IP address.

The server 200 analyzes the storage unit 210 for storing the optical image and thermal image received from the camera module 100, the thermal image, determines whether a temperature outside the normal temperature is detected, and detects a temperature outside the normal temperature. If the equipment failure event occurs, the equipment failure determination unit 240 outputs the occurrence of the equipment failure event, and when the equipment failure determination unit 240 outputs the occurrence of the equipment failure event, the notification unit 250 notifies the manager of the occurrence of the abnormal event. can include The server 200 may further include a communication unit 220 connected to a wired or wireless network to transmit and receive data, and an interface unit 230 to receive a manager's command or provide data or information to the manager.

The storage unit 210 detects and expresses an abnormal temperature in an industrial field using an optical image, a thermal image, or a thermal image camera according to an embodiment of the present invention, and generates an alarm to inform the operating method of the system 10 implemented in software. stored program code and other necessary data. The storage unit 210 may include a hard disk, a memory, a cloud storage device, a database, and the like.

The communication unit 220 may be connected to a wired or wireless network to transmit and receive data between the camera module 100 , the manager terminal 300 , and the server 200 . The communication unit 220 may use known communication methods such as the World Wide Web (www), Ethernet, IPv4, IPv6, LAN, and WAN. The communication unit 220 may use a known short-range communication method such as wi-fi, bluetooth, zigbee, or the like.

The interface unit 230 may include input devices such as a keyboard, mouse, touch panel, and switch capable of receiving commands from a manager, and output devices such as a display, speaker, and printer capable of providing information to the manager. can include

The facility abnormality determining unit 240 and the notifying unit 250 may be written in program codes and implemented in a manner that runs on the processor or graphics processing unit (GPU) of the server 200, or may be implemented within the server 200. It may be implemented as an independent computer device included.

The equipment abnormality determining unit 240 determines whether an abnormal temperature is captured in the thermal image of the industrial site 1 based on the normal temperature. The presence of an abnormal temperature higher or lower than the normal temperature in the thermal image means that there is a problem in the facility (2). For example, if the temperature of the facility 2 rises or falls below the normal temperature, it indicates that there is a possibility of an accident. If a fire or leak occurs due to an accident in the facility 2, a temperature change may occur in an area other than the facility 2, which may indicate the occurrence of an accident. The facility abnormality determination unit 240 may output information about a pixel having an abnormal temperature along with a facility abnormality event.

When the facility abnormality determining unit 240 outputs the occurrence of a facility abnormality event, the notification unit 250 notifies the manager of the occurrence of the abnormal event and informs the contents of the abnormal event. The contents of the abnormal event include the location of the camera module 100 that captured the abnormal event, the occurrence time of the abnormal event, the frame of the optical image or thermal image in which the abnormal event occurred, guidelines for responding to the abnormal event, and other necessary information. can include The notification unit 250 may automatically transmit a phone call, text message, e-mail, etc. to the administrator terminal 300, display the occurrence of an abnormal event on a display, or notify the occurrence of an abnormal event through a speaker.

When a facility abnormality event occurs, the notification unit 250 may provide a manager with an image displaying a pixel having an abnormal temperature in a frame of a thermal image in which an abnormal temperature is detected based on information on a pixel having an abnormal temperature. . For example, the notification unit 250 may automatically generate an e-mail including an image in which an abnormal temperature is detected as a highlight or an arrow, and send the e-mail to the administrator's e-mail address.

3A is a flowchart illustrating an operation method of a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates and informs an alarm. See FIGS. 2 and 3A together.

According to an embodiment of the present invention, an operating method of a system 10 that detects and expresses an abnormal temperature in an industrial site and generates and informs an alarm with a thermal imaging camera, the optical camera 110 of the camera module 100 (1) is photographed to generate an optical image and transmitted to the server 200, and the thermal image camera 120 of the camera module 100 photographs the industrial site 1 to generate a thermal image and the server 200 image generation step (S21), equipment abnormality determination step (S22) of determining that a facility abnormality event has occurred when the temperature recognized from the thermal image by the equipment abnormality determination unit 240 of the server 200 is out of the normal temperature; and a notification step ( S23 ) in which the notification unit 250 of the server 200 notifies the manager of the occurrence of the abnormal event when the facility abnormality determination unit 240 outputs the occurrence of the facility abnormality event.

The image generation step (S21) and facility abnormality determination step (S22) may be included in the monitoring step (S20). The monitoring step (S20) is repeatedly performed in real time while the operating method of the system 10, which detects and expresses the abnormal temperature of the industrial site and generates and informs an alarm with the thermal imaging camera according to an embodiment of the present invention, is performed. The equipment abnormality determination step (S22) may be performed by the equipment abnormality determination unit 240. The notification unit 250 performs a notification step (S23) when an abnormal event is output from the equipment abnormality determination unit 240.

The operation method of the system that detects and expresses the abnormal temperature of the industrial site with a thermal imaging camera and generates an alarm to inform the operation method is performed before the image generation step, and the area of the frame, standard deviation, high temperature limit value, low temperature limit value, normal A variable setting step (S10) of setting one or more of the temperature, the judgment reference time, and the steady state adaptation period may be further included.

The variable setting step (S10) may be performed by the facility abnormality determination unit 240 before the monitoring step (S20) is performed. The variable setting step (S10) may be performed according to a manager's input or a predetermined algorithm. The variable setting step (S10) may be performed at any moment according to the manager's command.

FIG. 3B is a flowchart specifically illustrating a facility abnormality determination step (S22) of a method of operating a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm to notify an abnormal temperature using a thermal imaging camera according to an embodiment of the present invention.

As shown in FIG. 3 , the facility abnormality determination step ( S22 ) may include a temperature calculation step ( S110 ) of converting a gray scale value for each pixel of a thermal image frame into a current temperature. Then, in the equipment abnormality determination step (S22), after the temperature calculation step (S110), if the current time is before the steady state adaptation period, the current temperature is accumulated and stored in the storage unit 210 as the normal temperature, and the accumulated normal temperature A normal temperature generation step (S120) of calculating a normal temperature by averaging, a body temperature determination step (S130) of determining that no abnormal temperature has occurred if the current temperature is within the body temperature range, and the current temperature is a low temperature limit value and a high temperature limit A limit judgment step (S140) of determining that an abnormal temperature exists if it is not included between the values. Deviation determination step (S150) of determining that an abnormal temperature exists if it is large, counting frames or times in which an abnormal temperature exists using a timer, and when the accumulated value of the counter of the timer reaches the determination reference time, a facility abnormality event occurs It may include at least one or more of the event judgment steps that are determined to be.

After the temperature calculation step (S110), a normal temperature generation step (S120) is performed to recognize the temperature of the facility 2 in a normal state, and a body temperature determination step (S130), a limit determination step (S140), and a deviation determination step It is possible to determine whether an abnormal temperature exists by performing (S150) in order. If it is determined that the abnormal temperature exists (S160), the event determination step (S170) is performed, and if it is determined that the abnormal temperature is maintained longer than the determination reference time, it is determined that a facility abnormality event exists (S180), and the equipment abnormality determination unit 240 may output the presence of an abnormal event.

The temperature calculation step (S110) will be described with reference to FIGS. 2, 3B and 4.

FIG. 4 is a diagram illustrating a process of recognizing the temperature of the system 10, which detects and expresses an abnormal temperature in an industrial site with a thermal imaging camera according to an embodiment of the present invention, and generates and informs an alarm.

The thermal imaging camera 120 of the camera module 100 captures the industrial site 1 in the infrared region and generates a thermal image. The generated thermal image is stored in the storage unit 210 of the server 200 . Thermal images are created in grayscale. A frame shown in FIG. 4 is a frame arbitrarily extracted from a thermal image for explanation of an embodiment of the present invention. A frame has a gray scale value for each pixel.

The equipment abnormality determination unit 240 performs the equipment abnormality determination step (S22). In the facility abnormality determining step (S22), the facility abnormality determining unit 240 extracts gray scale values for each pixel from the frame of the thermal image to create a gray scale matrix, and matches the minimum and maximum values of the gray scale values of the thermal imaging camera. A gray scale value is converted into a temperature using the minimum temperature and maximum temperature of (120), and the temperature of the pixel is compared with the normal temperature, and if there is a difference of more than a standard deviation, a facility failure event can be output.

First, the equipment abnormality determination unit 240 performs a temperature calculation step (S110). In the temperature calculation step (S110), a gray scale matrix is generated by extracting the gray scale value of each pixel of the frame. The number of rows and columns of the grayscale matrix may be determined according to the number of horizontal and vertical pixels of the frame. The grayscale matrix may correspond 1:1 to the frame. When the size of the frame is (m,n), the grayscale matrix may be formed in the form of a matrix of (m by n). The grayscale matrix may be stored in the storage unit 210 . The gray scale matrix can represent values from 0 to 255, and can represent white when 0 and black when 255.

Next, we convert the grayscale values of pixels to temperatures to create a temperature matrix. In the thermal imaging camera 120, a maximum measurable temperature (Tmax) and a minimum temperature (Tmin) that can be measured are determined. The thermal imaging camera 120 generates a gray scale thermal image by calculating a gray scale value according to a set ratio of the highest temperature to the lowest temperature. Accordingly, the gray scale value can be converted into an actual temperature according to the ratio of the maximum temperature and the minimum temperature. Converting a gray scale value into a temperature uses Equation 1 below.

T _i,j (t): current temperature of (i,j) pixel in frame at time t, T _max : maximum temperature set in the thermal imaging camera, T _min : minimum temperature set in the thermal imaging camera, G _i,j ( t): Grayscale value of pixel (i,j) in the frame at time t. 255: number of lowest and highest grayscale values

When the temperature calculation step (S110) is performed, the temperature of each pixel in the thermal image frame at the current time (t) can be calculated.

FIG. 5 is a diagram illustrating a process of recognizing a normal temperature by a system 10 that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm. 3B and 5 are also referred to.

According to an embodiment of the present invention, the facility abnormality determination step (S22) of the operating method of the system for detecting and expressing the abnormal temperature of the industrial site and generating an alarm to notify the abnormal temperature of the industrial site with a thermal imaging camera according to an embodiment of the present invention is after the temperature calculation step (S110), the current When the time is prior to the steady state adaptation period, a normal temperature generating step (S120) of accumulating and storing the current temperature as the normal temperature in the storage unit and calculating the normal temperature by averaging the accumulated normal temperatures may be further included.

When the facility abnormality determining unit 240 compares the current temperature and the normal temperature of the pixel, the normal temperature is a value that has been measured and stored in advance. The normal state refers to a state in which there are no accidents or malfunctions in the industrial site (1). The normal temperature generating step (S120) is a process of generating a normal temperature by collecting and averaging temperatures in a steady state. The normal temperature may be determined as an average of temperatures collected during the steady-state adaptation period for each pixel. The normal temperature may be set as a range. The steady-state adaptation period is a period for accumulating steady-state temperature data. The steady-state adaptation period may be determined by time or the number of frames.

First, a step of comparing the current time (t) of the thermal image frame and the steady-state adaptation period (t _set ) (S121) is performed. If the current time (t) exceeds the steady-state adaptation period (t _set ) (Y1), since the period of obtaining the normal temperature has already passed, the body temperature determination step (S130), the limit determination step (S140), and the deviation determination step (S150) one of them can be done. If the current time (t) of the thermal image frame does not exceed the steady state adaptation period (t _set ) (N1), it corresponds to the period for accumulating the temperature in the steady state. A steady-state temperature accumulation step (S122) of storing the temperature of each pixel generated in the temperature calculation step (S110) in the storage unit 210 as a steady-state temperature is performed. After the steady-state temperature accumulation step (S122), the steady-state temperature is calculated by averaging the accumulated steady-state temperatures. The steady state temperature can be obtained by averaging the temperature of each pixel during the steady state adaptation period in the thermal image generated by photographing the industrial site 1 in the steady state. During the steady-state adaptation period, the process of calculating the steady-state temperature by accumulating and averaging the steady-state temperatures may be repeated. After the steady state adaptation period has passed, the deviation determination step (S150) may be performed using the finally calculated normal temperature.

In detail, the facility abnormality determining unit 240 may obtain a plurality of frames according to time t from the thermal image and average the temperature of each pixel of the frame to generate an average temperature matrix. For example, the normal temperature of pixel 1 (P2) can be obtained by obtaining and averaging the temperatures of six pixels 1 (P1) in six frames from Frame 1 to Frame 6, and In this way, the normal temperatures of the pixels 2 (P2) and 3 (P3) can be obtained.

The normal temperature for each pixel can be calculated using Equation 2 below.

Ta _i,j (t): average temperature of (i,j) pixel in frame during steady-state adaptation period, T _i,j (x): temperature of (i,j) pixel in frame at time x, t _set : Steady-state adaptation period

Normal temperatures can be stored in the form of an average temperature matrix. The facility abnormality determination unit 240 may obtain a normal temperature for each pixel and generate a normal temperature matrix. The normal temperature matrix may vary depending on the industrial site, the work environment, and the stage of the work process.

Again refer to FIG. 3B. In the facility abnormality determination step (S22), when it is determined that the current time has passed the steady state adaptation period (Y1), the body temperature determination step (S130) may be performed. A worker exists in the industrial site 1, and when the worker is captured in a thermal image, the temperature of a pixel changes due to the worker's presence. It is not desirable to determine the temperature change of the pixel corresponding to the operator as the abnormal temperature of the facility 2 . Accordingly, the facility abnormality determination unit 240 does not determine that an abnormal temperature has occurred when the temperature of the corresponding pixel corresponds to the body temperature range of the person 3 .

In the body temperature determination step (S130), it is determined whether the temperature of the pixel is out of the body temperature range by comparing the temperature of the pixel with the range of the body temperature. If the temperature of the pixel does not deviate from the body temperature range (N2), it is not determined that an abnormal temperature has occurred. When the temperature of the pixel is out of the body temperature range (Y2), a limit determination step (S140) or a deviation determination step (S150) may be performed. If the current temperature is out of the body temperature range, another judgment step is performed to determine whether an abnormality has occurred in the facility 2.

In the equipment abnormality determination step (S22), when it is determined that the current time has passed the steady state adaptation period (Y1) and the current temperature is determined to be a temperature outside the range of the body temperature (Y2), the limit determination step (S140) can be performed. .

In the limit determination step (S140), the facility abnormality determination unit 240 determines that an abnormal temperature exists (S160) when the current temperature of any pixel is not included between the low temperature limit value and the high temperature limit value (N3). can The high temperature threshold is a reference value for detecting a temperature higher than a predetermined temperature. When the current temperature of an arbitrary pixel exceeds the high temperature threshold (N3), it may be determined that an abnormal temperature has occurred. The low temperature threshold is a reference value for detecting a temperature below a predetermined temperature. When the current temperature of an arbitrary pixel is less than the low temperature threshold (N3), it may be determined that an abnormal temperature has occurred. If the current temperature of any pixel is equal to or higher than the low temperature threshold and equal to or lower than the high temperature threshold (Y3), since the temperature is not excessively low or high, a deviation determination step (S150) is performed to determine whether an abnormal temperature exists.

FIG. 6 is a diagram illustrating a process of comparing a normal temperature and a current temperature in a system 10 that detects and expresses an abnormal temperature in an industrial field and issues an alarm using a thermal imaging camera according to an embodiment of the present invention.

In the deviation determination step (S150), the deviation calculation step of calculating the deviation between the normal temperature and the current temperature, and comparing the calculated deviation with the standard deviation, and when the calculated deviation is greater than the standard deviation (Y4), it is determined that an abnormal temperature exists. and a comparison step of determining that no abnormal temperature exists when the calculated deviation is smaller than the standard deviation (N4). The standard deviation is a reference value of a temperature deviation for detecting an abnormal temperature.

The normal temperature is a value determined by the equipment abnormality determining unit 240 and stored in the storage unit 210 . As described with reference to FIG. 5 , it is possible to generate a normal temperature matrix (also referred to as an average temperature matrix in this specification) by averaging the temperature of each pixel in a plurality of frames.

The facility abnormality determination unit 240 compares the current temperature and normal temperature values of the corresponding frame for each pixel of the frame of the thermal image generated in real time. At this time, the temperature difference between the normal temperature and the current temperature is calculated. When the temperature deviation obtained by comparing the temperature of a certain pixel with the normal temperature is greater than the reference deviation, it can be determined that an abnormal temperature has occurred. In other words, a temperature matrix is generated for each frame of a thermal image generated in real time, and the temperature matrix is compared with a normal temperature matrix (average temperature matrix), and a pixel having a temperature deviation greater than or equal to a standard deviation is determined to have an abnormal temperature.

The temperature deviation for each pixel can be calculated using Equation 3 below.

ΔT _i,j (t): Temperature deviation of (i,j) pixels in a frame at time t, Ta _i,j (t): Average temperature of (i,j) pixels in a frame during the steady-state adaptation period, T _i,j (t): current temperature of pixel (i,j) in frame at time t

Meanwhile, the facility abnormality determining unit 240 may apply different normal temperatures depending on the operating state of the facility 2 in the facility abnormality determining step (S22).

The operating state of the facility 2 may vary depending on the stage of the process. For example, in a process requiring a high temperature, the normal temperature is a high temperature, and when the same equipment 2 is not operating, the room temperature of the industrial site 1 may be the normal temperature. Accordingly, the facility abnormality determination unit 240 may recognize a plurality of normal temperatures for each operating state of the facility 2 based on information about the operating state of the facility 2 and store them in the storage unit 210 . And, when the facility 2 enters a predetermined operating state, the equipment abnormality determination unit 240 may determine whether the facility 2 has an abnormal temperature according to the normal temperature of the entered operating state.

Again refer to FIG. 3B. When it is determined that an abnormal temperature exists through the body temperature determination step (S130), limit determination step (S140), and deviation determination step (S150) (S160), it is determined that an abnormal temperature exists in the frame of the current time (t) will be. Abnormal temperatures may appear temporarily in thermal images due to various causes. It is preferable to determine that an abnormality has occurred in the facility 2 when the occurrence of an abnormal temperature is maintained for a meaningful period of time. Therefore, an event determination step (S170) for determining how long the abnormal temperature lasts is performed. The equipment abnormality determination unit 240 determines whether abnormal temperature has occurred for each set frame or for each set time. It can be output (S180).

The judgment reference time is the time for which the temperature should be maintained in order to be judged as an abnormal temperature. When the temperature of an arbitrary pixel is out of the normal temperature and continues for a longer time than the judgment reference time, it can be determined that an abnormal temperature has occurred. When it is determined that an abnormal temperature has occurred in a certain pixel (S160), the facility abnormality determining unit 240 checks whether the timer is activated (S171), and activates the timer when the timer is in an inactive state (N5) (S172). ). When the timer is in an activated state (Y5), the timer counter is increased by 1 (S173). When the timer is activated (S172), a value of 1 is given to the timer counter. When the frame determined to have an abnormal temperature continuously exists, the counter continues to increase (173). After incrementing the counter, it is determined whether the counter value has reached the reference time (S174). When the counter value reaches the judgment standard time (Y6), since the abnormal temperature has been maintained for a predetermined time, the equipment abnormality determination unit 240 outputs a facility abnormality event. If the counter value does not reach the judgment standard time (N6), since the abnormal temperature has not been maintained for a set time, it is determined whether there is an abnormal temperature in the next frame.

If the current temperature does not deviate from the body temperature range in the body temperature determination step (S130) (N2) or if the temperature deviation between the current temperature and the normal temperature is smaller than the standard deviation in the deviation determination step (S150) (N4), no abnormal temperature exists. It is not. Therefore, the timer is initialized (S175).

The facility abnormality determining unit 240 may repeatedly output a facility abnormal event if the abnormal temperature is continuously maintained for longer than a predetermined determination reference time even after outputting the equipment abnormal event once. If a facility failure event is repeatedly output, the notification unit 250 may repeatedly transmit a notification.

The equipment abnormality determination unit 240 divides the frame into one or more zones, and may differently set a standard deviation, a high temperature limit value, a low temperature limit value, a normal temperature, a judgment reference time, and a steady state adaptation period for each zone.

The facility abnormality determination unit 240 may divide zones in the frame. For example, 4 zones can be set by dividing the frame into 4 equal parts. Alternatively, nine zones can be set by equally dividing the frame into nine equal parts. Alternatively, a plurality of zones may be set by dividing an area where the first facility is photographed and an area where the second facility is photographed in the frame. A number may be assigned to each zone in a plurality of zones.

The facility abnormality determination unit 240 may set the standard deviation, high temperature threshold value, low temperature threshold value, normal temperature, determination reference time, and steady state adaptation period differently for each zone. For example, the high temperature threshold and the low temperature threshold of the first zone may be set higher than those of the second zone. Alternatively, the standard deviation of the third zone may be set larger than that of the fourth zone.

Zone setting, standard deviation, high temperature threshold, low temperature threshold, normal temperature setting, determination reference time, and steady state adaptation period may be set differently for each camera module.

Various facilities 2 may be installed in the industrial site 1, and the normal temperature may be different for each facility 2. Therefore, appropriate monitoring can be performed according to the industrial site (1) by setting the zone and setting the standard deviation, high temperature threshold value, low temperature threshold value, normal temperature, judgment standard time, and steady state adaptation period differently for each zone.

7 is a diagram illustrating an alarm generated by displaying an area where an abnormal temperature occurs in a system 10 that detects and expresses an abnormal temperature at an industrial site and generates and informs an alarm using a thermal imaging camera according to an embodiment of the present invention. .

When an abnormal temperature occurs in the thermal image, the equipment abnormality determining unit 240 outputs an equipment abnormality event, and the alarm unit notifies the manager of the occurrence of abnormal temperature based on the equipment abnormality event. When a facility abnormality event is output, the notification unit 250 outputs the coordinates of the pixel where the abnormal temperature occurred, the number of the zone including the pixel where the abnormal temperature occurred, the frame where the abnormal temperature occurred, the time of the frame, and the camera that captured the abnormal temperature. Information related to a facility abnormality event, such as the location of the module 100 and the optical image taken by the optical camera 110 of the camera module 100 that captured the abnormal temperature, at the same time frame, etc., can be collected, processed, and provided to the manager. .

The notification unit 250 displays the position of the pixel where the abnormal temperature occurred in a first color in a frame, and mails the coordinates of the pixel where the abnormal temperature occurred and the coordinates of the industrial site 1 corresponding to the pixel where the abnormal temperature occurred. can be automatically generated and provided to the administrator. The storage unit 210 stores information capable of matching the position of the industrial site 1 and the coordinates of the frame of the image captured by the camera module 100 according to the direction in which the camera module 100 captures. The notification unit 250 calculates the actual coordinates of the industrial site 1 corresponding to the frame based on the position of the camera module 100 where the abnormal temperature occurred, the direction of the camera module 100, and the pixel coordinates where the abnormal temperature occurred. can do.

The first color indicating the position of the pixel where the abnormal temperature has occurred may use chromatic color instead of gray scale. For example, when a high temperature abnormality occurs, red color may be used, and when a low temperature abnormal temperature occurs, blue color may be used. Alternatively, an arrow may be displayed at a corresponding position in the gray scale frame, or an area where an abnormal temperature occurs may be displayed by hatching. An achromatic or chromatic box may be displayed centered on the part where the abnormal temperature occurs.

Based on the information provided by the notification unit 250, the manager can easily recognize the location where the abnormality occurred in the industrial site 1, and can immediately take necessary measures.

8 is a diagram illustrating a thermal image frame and an optical frame in which an abnormal temperature is generated, which are provided to a manager by the notification unit 250. Referring to FIG.

The notification unit 250 extracts an image in which the color of a pixel determined to be out of the normal temperature in the frame of the thermal image is displayed as a first color and an optical image image taken in the same direction as the frame of the thermal image from the optical image, and manages them together. can be provided to

A frame of a thermal image is a gray scale image, and is an image whose gray scale value varies according to temperature. Therefore, since the image is generated by the temperature regardless of the shape of the object, it may be difficult for a manager to immediately recognize the corresponding location of the industrial site 1 by looking at only the gray-scale image. The notification unit 250 displays pixels in the thermal image frame where the abnormal temperature occurs in a first color, arrows, circles, etc., and displays pixels in the optical image frame where the abnormal temperature occurs in the same direction at the same time. It may be displayed in a first color, an arrow, a circle, or the like, and provided to a manager. The administrator can easily recognize the point where the abnormal temperature occurs by checking the optical image frame and the thermal image frame together. The first color may be a chromatic color.

9 is a diagram showing the structure of mail used by the notification unit 250. Referring to FIG.

In the notification step (S23), a facility abnormality event is transmitted via e-mail, information on the area where the abnormal temperature occurs is included in the body of the e-mail, and an image displaying pixels where the abnormal temperature occurs is included in the frame image of the thermal image. can

A message structure provided using e-mail may be composed of a mail header (Mail Header, 910) and a mail body (Mail Body, 920).

The mail header 910 includes a sender mail address (911), a receiver mail address (912), a camera IP address (913), an event flag (914), a port ( Port, 915) and timestamp (Timestamp, 916).

The sender mail address 911 and the receiver mail address 912 indicate the mail addresses of the sender and receiver of the alarm alarm mail, respectively, and the camera IP address 913 is the camera 100 that detects the abnormal temperature change corresponding to the alarm. The event flag 914 may be used to indicate the cause of the abnormal temperature change, such as the occurrence of a facility abnormality event, exceeding a temperature deviation, high temperature or low temperature. A port 915 represents a port number of an e-mail transmission channel, and a timestamp 916 represents a time when a corresponding alert occurred.

The mail body 920 includes a mail title (Title, 921), sector information (Sector Information, 922), and image (Image, 923). The mail title 921 indicates the title of the abnormal temperature change alert mail, the zone information 922 indicates the zone where the abnormal temperature change is detected in the frame of the camera, and the image 923 shows the abnormal temperature change detected in the thermal image frame. It may include an image displaying a designated area, pixel, coordinates, etc., and an optical image taken in the same direction.

Although the present invention has been described in detail through specific examples, this is for explaining the present invention in detail, the present invention is not limited thereto, and within the technical spirit of the present invention, by those skilled in the art It will be clear that the modification or improvement is possible.

All simple modifications or changes of the present invention fall within the scope of the present invention, and the specific protection scope of the present invention will be clarified by the appended claims.

Claims (15)

1. A camera module for generating a thermal image by photographing an industrial site; and

   A system for detecting and expressing an abnormal temperature at an industrial site with a thermal imaging camera and generating an alarm, including a server that analyzes the thermal image received from the camera module and determines whether an abnormal temperature exists in the facility.
2. The method of claim 1,

   The server

   a storage unit for storing optical images and thermal images received from the camera module;

   a facility abnormality determining unit that analyzes the thermal image to determine whether a temperature outside of the normal temperature is detected, and outputs an occurrence of a facility abnormality event when a temperature outside of the normal temperature is detected; and

   A system for detecting and expressing an abnormal temperature at an industrial site with a thermal imaging camera and generating an alarm, including a notification unit for notifying a manager of the occurrence of an abnormal event when the facility abnormality determination unit outputs the occurrence of an abnormal facility event.
3. The method of claim 2,

   The equipment abnormality determination unit

   A gray scale matrix is created by extracting a gray scale value for each pixel from the frame of the thermal image, and the gray scale value is converted into a temperature using the minimum and maximum temperatures of the thermal imager matched to the minimum and maximum values of the gray scale values. A system that detects and expresses an abnormal temperature at an industrial site with a thermal imaging camera and generates an alarm to notify the abnormal temperature of the industrial site with a thermal imaging camera that converts the temperature of the pixel and compares the temperature of the pixel with the normal temperature and outputs a facility abnormal event if there is a difference of more than a standard deviation.
4. The method of claim 3,

   The normal temperature is

   It is determined as the average of the temperatures collected during the steady-state adaptation period for each pixel,

   The facility abnormality determination unit

   When the temperature of the pixel determined to be out of the normal temperature corresponds to the range of the body temperature, a system that does not output a facility abnormal event, detects and expresses the abnormal temperature of the industrial site with a thermal imaging camera, and generates an alarm.
5. The method of claim 3,

   The equipment abnormality determination unit

   A system that applies the normal temperature differently depending on the operating state of the facility, detects and expresses the abnormal temperature of the industrial site with a thermal imaging camera, and generates an alarm to notify.
6. The method of claim 3,

   The equipment abnormality determination unit

   The frame is divided into one or more zones, and the abnormal temperature of the industrial site is detected with a thermal imaging camera that sets a standard deviation, a high temperature limit value, a low temperature limit value, a normal temperature, a judgment reference time, and a steady state adaptation period differently for each zone. A system that detects, presents and raises an alarm to notify.
7. The method of claim 3,

   the notification section

   In the frame of the thermal image, an image in which the color of the pixel determined to be out of the normal temperature is displayed as the first color and an optical image image taken in the same direction as the frame of the thermal image are extracted from the optical image and provided together to the manager , A system that detects and expresses abnormal temperatures in industrial sites with a thermal imaging camera and issues an alarm.
8. An image generation step in which a camera module photographs an industrial site, generates a thermal image, and transmits the thermal image to a server;

   a facility abnormality determination step of determining that a facility abnormality event has occurred when the temperature recognized from the thermal image is out of a normal temperature by a facility abnormality determining unit of the server; and

   When the facility abnormality determination unit outputs the occurrence of an abnormal facility event, the notification unit of the server detects and expresses the abnormal temperature of the industrial site with a thermal imaging camera, including a notification step of notifying a manager of the occurrence of the abnormal event and alarming How to operate the system that generates and informs.
9. The method of claim 8,

   The equipment abnormality judgment step

   a temperature calculation step of converting a gray scale value for each pixel of a frame of a thermal image into a current temperature; and

   Industrial field with a thermal imaging camera, including a deviation determination step of calculating the deviation between the normal temperature and the current temperature, which is calculated as the average of the accumulated temperatures in the normal state, and determining that an abnormal temperature exists if the calculated deviation is greater than the standard deviation. A method of operating a system that detects and expresses an abnormal temperature of the temperature and informs by generating an alarm.
10. The method of claim 9,

    The equipment abnormality judgment step

    After the temperature calculation step, further comprising a body temperature determination step of determining that no abnormal temperature has occurred when the current temperature is within the body temperature range, the thermal imaging camera detects and expresses the abnormal temperature at the industrial site and generates an alarm. How the notification system works.
11. The method of claim 9,

    The equipment abnormality judgment step

    After the temperature calculation step, further comprising a limit determination step of determining that an abnormal temperature exists when the current temperature is not included between the low temperature limit value and the high temperature limit value, detecting the abnormal temperature at the industrial site with a thermal imaging camera. and a method of operating the system for displaying and alerting by generating an alarm.
12. The method of claim 9,

    The equipment abnormality judgment step

    After the temperature calculation step, a normal temperature generation step of accumulating and storing the current temperature as a normal temperature in a storage unit when the current time is before the steady state adaptation period, and calculating the normal temperature by averaging the accumulated normal temperatures is further included. A method of operating a system that detects and expresses an abnormal temperature at an industrial site with a thermal imaging camera and generates an alarm.
13. The method of claim 8,

    It is performed before the image generating step, and further comprising a variable setting step of setting one or more of the area of the frame, the standard deviation, the high temperature limit value, the low temperature limit value, the normal temperature, the judgment reference time, and the steady state adaptation period. A method of operating a system that detects and expresses an abnormal temperature at an industrial site with a video camera and generates an alarm.
14. The method of claim 9,

    After the deviation determination step, an event determination step of counting frames or times in which the abnormal temperature exists using a timer and determining that an equipment abnormality event has occurred when the accumulated value of the timer reaches the determination reference time , Operating method of a system that detects and expresses an abnormal temperature at an industrial site with a thermal imaging camera and generates an alarm.
15. The method of claim 8,

    The notification step is

    Facility failure events are delivered via e-mail, information on the area where the abnormal temperature occurred is included in the body of the e-mail, and the frame image of the thermal image includes an image displaying pixels where the abnormal temperature occurred. A method of operating a system that detects and expresses an abnormal temperature in the field and issues an alarm.

Images