WO2019182355A1 - Smartphone, vehicle and camera having thermal image sensor, and display and sensing method using same - Google Patents

Abstract

The present invention relates to a smartphone having a thermal image sensor, and a display method using same. The smartphone disclosed in the present invention comprises, on the front side, a display unit, a speaker and a microphone, and on the rear side, a rear visible-light image sensor for capturing an image of a first region and having a first resolution, and a rear thermal image sensor for capturing only an image of a second region that is part of the first region and having a second resolution lower than the first resolution. When using a smartphone having a thermal image camera according to the present invention, the temperature of an object to be measured can be checked by positioning the object at the center of the display.

Description

Smartphones, vehicles, cameras with thermal imaging sensors and display and detection methods using them

The present invention relates to a smart phone, a vehicle, a camera having a thermal image sensor, and a display and a sensing method using the same. More specifically, a visible light image sensor having a high resolution and a relatively low resolution of a visible light region is captured. The present invention relates to a smart phone having a thermal image sensor, a display method using the same, and a method of detecting a thermal image of an object in a vehicle and a camera having a thermal image sensor and analyzing characteristics, states, and distances of the object.

Among the functions provided in the smart phone, the most used function may be referred to as taking a picture. Photographing is provided by an image sensor for photographing the visible light region provided in the smartphone.

Apple's iPhone 7 Plus has 7 million pixels in front and 12 million pixels in the rear with a visible light image sensor.The Galaxy S8 Plus sold by Samsung Electronics has 8 million pixels for the front camera and 12 million pixels for the rear camera. Small image sensor is adopted.

On the other hand, smartphone and camera users often need a thermal imager in addition to visible light shooting. For example, a kindergarten nursery teacher needs to easily find out whether a kindergarten student is infected with an epidemic FLU. In the present situation, it was inconvenient because the situation is proceeding to measure the temperature by visiting the hospital to find the aboriginal.

In general, a camera equipped with a thermal image sensor and a display is called a thermal imager. Such thermal imaging cameras are used in various fields of industry. For example, a thermal imaging camera is installed at an immigration desk and used to detect a person whose body temperature is higher than normal by monitoring the heat generated from the entrant entering the country. However, rather than entering one by one, many passengers who are on the same plane usually come out at the same time, so many people enter many at once. Due to these problems, even if one of the many immigrations detects an abnormally high body temperature, it is often a problem that a person with a high body temperature is missed when a group is mixed with several people.

Meanwhile, automakers are expected to lead the future in the future. In order to drive such autonomous cars, a sensor for detecting a surrounding object is required. Typical sensors used in autonomous vehicles include riders (laser sensors), ultrasonic sensors, radars (electromagnetic wave sensors), and visible light image sensors. However, on a rainy day or a foggy day, especially in bad weather conditions (especially at night), the visible light image sensor is almost inoperable and cannot be used. The other laser sensors, electromagnetic wave sensors and ultrasonic sensors are also less sensitive. do. Recently, high-speed collision prevention systems have been applied to expensive vehicles. The high-speed collision avoidance system is a system in which a driver recognizes the warning or automatically brakes the vehicle when the driver continues to operate even if there is an object in front of the vehicle at high speed. Even in a vehicle equipped with such a high speed collision prevention system, driving at high speed at night and colliding with a vehicle standing on a road wall or a shoulder are often reported to lead to a big accident. This phenomenon occurs because the rider, radar, visible light image sensor and ultrasonic sensor installed in the vehicle does not operate in the environment.

Prior Art Documents Korean Patent Publication No. 10-2013-0142810 (published Dec. 30, 2013)

The present invention is to solve the above problems, a smart phone having a thermal image sensor and a display using the same is equipped with a visible light image sensor and a thermal image sensor having a different resolution to the display device and efficiently displayed on the display device It is an object to provide a method.

Yet another object of the present invention is to provide a monitoring method that can accurately monitor a moving object even when the moving object exists alone or in a cluster when monitoring the temperature of the moving object using a thermal imaging camera. I would like to.

Still another object of the present invention is to install a plurality of thermal image sensors on the front of the vehicle or one or a certain distance apart from each other, by measuring the distance of the approaching object using the thermal image sensor in front of the bad weather at night An object of the present invention is to provide a sensor device and a method for recognizing a vehicle in front of the vehicle.

The object of the present invention is provided with a speaker and a microphone, a display unit on the front, a rear visible light image sensor having a first resolution and a first area and a second resolution lower than the first resolution having a first resolution The partial region included in the first region may be achieved by a smartphone, which includes a rear thermal image sensor which captures only the second region. Preferably, the rear visible light image sensor has a first angle of view, and the rear thermal image sensor is preferably designed to have a second angle of view smaller than the first angle of view, and the second area is set to be a central portion of the first area. good.

Another object of the present invention is a method for monitoring the thermal temperature of a plurality of moving objects, the first step of measuring the temperature or the amount of movement of the plurality of moving objects, and a first moving object having an abnormal body temperature or a small amount of movement A second step of identifying, calculating a boundary area of the first moving object, filling the inside of the calculated boundary area of the moving object with an abnormal temperature color (redder than normal temperature), and giving an identification mark; 1 Continuous monitoring of moving objects, and when the first moving object is mixed with the cluster, the third step of calculating the boundary region of the colony and filling the interior of the colony with the abnormal temperature color, and the cluster having the abnormal temperature Monitoring continuously and if the first moving object leaves the colony, the fourth step of converting the colony into a normal temperature color and the first moving away from the colony Can be achieved by a method for monitoring a heat temperature of moving objects, characterized in that it comprises a fifth step of processing the boundary of the body region inside the abnormal color temperature. In this case, it is preferable that the identification mark given to the first moving object is a combination of colors, numbers, and symbols.

Still another object of the present invention includes a first thermal image sensor installed at the front left side and a second thermal image sensor installed at the front right side, and the first thermal image sensor and the second thermal image sensor have the same front area with the same performance. In the method for measuring the distance to the object located in front of the vehicle in the vehicle to be photographed, the boundary region (first boundary region), the maximum temperature of the moving object detected in the monitoring region using the first thermal image sensor A first step of identifying a point (first highest temperature point) and a lowest temperature point (first lowest temperature point); and a boundary area (second boundary) of the moving object detected in the monitoring area by using a second thermal image sensor Area), the second step of identifying the highest temperature point (second highest temperature point) and the lowest temperature point (second lowest temperature point), the distance between the first thermal image sensor and the second thermal image sensor and the first thermal image The first highest temperature in the sensor and the second thermal image sensor And a third step of grasping the distance D1 between the object and the vehicle by triangulation of the position difference between the point and the second highest temperature point, wherein the first and second steps are performed simultaneously or in any order. This can be achieved by a method for measuring the distance to an object located in front of the vehicle.

Preferably, the step is performed after the third step, the distance between the first thermal image sensor and the second thermal image sensor, and the first lowest temperature point and the second lowest temperature in the first thermal image sensor and the second thermal image sensor. And a fourth step of determining the distance (D2) between the object and the vehicle by triangulation based on the position difference between the points or the position difference between the first boundary area and the second boundary area. If the distance D1 and the distance D2 of the object and the vehicle calculated in the fourth step are within the error range, D1 is calculated as the distance between the object and the vehicle, and if the first highest temperature point and the first 2 In the case where it is difficult to accurately measure the distance due to the fact that the highest temperature points are located in several places or the maximum temperature values are different from each other, D2 is calculated as the distance between the object and the vehicle. With objects It is good practice to apply the method of measuring distance.

Smartphones with a visible light camera have a thickness of less than 2 cm. With current technology, a thermal imaging camera with the same resolution as a visible light camera cannot be installed in a smartphone with a thickness of less than 2 cm. In the present invention, a low resolution thermal imaging camera that can be provided in a smartphone is used to solve such a realistic problem. However, in this case, since a resolution difference between the two occurs, a technique of displaying an image photographed by a thermal imaging camera in only a part of the center of the display unit is applied. Therefore, when using a smartphone equipped with a thermal imaging camera according to the present invention, if the object to be measured at the temperature is positioned at the center of the display, the temperature of the object can be determined.

In the case of security high-resolution thermal imaging cameras and visible light cameras, high-speed information transmission power is required because human rights protection is not guaranteed and high resolution. In order to ensure the human body's portrait right and to reduce the cost of high-speed transmission, the problem can be solved by appropriately attenuating and symbolizing the thermal image information detected and received.

By using a thermal imaging camera according to the present invention, a virus-infected animal or a person in a poultry farm, a barn, etc. are gathered in a crowded state, and a person infected with a virus can be identified in a remote non-contact state and efficiently tracked in a place where many virus-infected animals move. It became possible. Multiple thermal imaging cameras and visible light cameras can be used to analyze and judge more accurately.

The frequency of far-infrared rays generated according to the temperature of the subject has a characteristic that varies with the sensing distance. When the subjects by distance are taken by the thermal imaging camera, the pixel (pixel) shape displayed on the thermal imaging camera is registered in advance by the distance between the subject and the thermal imaging camera, and when analyzed using this, the distance between the subject and the thermal imaging camera is known. Can recognize the subject. In addition, by using the information registered in advance, it is possible to grasp the temperature attenuation information according to the distance, thereby obtaining the effect of correcting and displaying the correct temperature of the subject.

When one or more thermal imaging cameras are installed in a vehicle or machine moving indoors or outdoors, and the size and type of the subject for each distance is stored in the vehicle registration information, the image taken by the mounted thermal camera is compared with the vehicle registration information. Also, when moving in bad weather conditions, the size and type of the subject can be recognized, and the distance to the subject can be accurately determined. Therefore, it is possible to prevent an accident in advance by providing an alarm if necessary. The use of multiple cameras enables more accurate analysis.

1 is a configuration of a thermal imaging camera according to an embodiment of the present invention.

2 is an explanatory diagram for explaining an example of thermal image data for each distance and object;

3 is an example of a smart phone according to the present invention equipped with a thermal image sensor.

4 is an exemplary view of synthesizing a visible light image and a thermal image photographed using a smartphone according to the present invention.

5 is an exemplary view of synthesizing a visible light image and a thermal image photographed using a smartphone according to the present invention.

6 is an image illustrating a processing method according to the present invention for monitoring a moving object having an abnormal body temperature according to the present invention.

7 is an exemplary view showing an arrangement relationship of a thermal image sensor when photographing a thermal image using two adjacent thermal image sensors.

8 is an example of measuring the moving speed of a moving object using a single thermal imaging camera.

9 is an image for explaining the principle of measuring the distance of a moving object using two thermal imaging cameras (or sensors).

10 is a human face image taken with a high-resolution thermal imaging camera and a state in which it is attenuated.

11 is an embodiment for explaining a method of arranging a plurality of thermal imaging cameras.

Fig. 12 is an explanatory diagram for explaining an area detected by four thermal imaging cameras placed around one sensing object.

FIG. 13 is a view for explaining another embodiment of photographing a moving object image and calculating a distance from the moving object using one thermal imager and one visible ray camera.

14A to 14E are graphs illustrating a method of compensating a cell array constituting a thermal image sensor according to the present invention.

15 is an explanatory diagram for explaining a method for calculating a distance between a thermal imaging camera and a person using a head size of a person detected by the thermal imaging camera;

16 is a diagram illustrating a situation of detecting a case where a person suddenly falls down using a thermal imaging camera.

Figure 17 is a setting example screen provided by the thermal imaging camera app of an embodiment according to the present invention.

18 is an example of a screen displaying only a measurement temperature range set by a user using a thermal imaging camera according to the present invention.

19 is an example of a screen displaying the entire temperature range detected by the thermal imaging camera according to the present invention.

[Description of the code]

100: rear thermal sensor

110: rear visible light image sensor

104: thermal image sensor

105: digital signal processing unit

106: control unit

107: image conversion unit

108: thermal imaging camera

109: display unit

505: first thermal image sensor

506: second thermal image sensor

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. As used herein, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described on the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

In addition, in the present specification, "on or above" means to be located above or below the target portion, and does not necessarily mean to be located above the gravity direction. In addition, when a portion such as an area, a plate, etc. is said "on or on top of" another part, it is not only in contact with or spaced apart from another part, but also in the middle of another part. It also includes cases where there is.

In addition, in the present specification, when one component is referred to as "connected" or "connected" with another component, the one component may be directly connected or directly connected to the other component, but in particular It is to be understood that, unless there is an opposite substrate, it may be connected or connected via another component in the middle.

Also, in this specification, terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment, advantages and features of the present invention.

1 is a block diagram of a thermal imaging camera according to an embodiment of the present invention. As shown in FIG. 1A, the thermal imaging camera 108 having a display includes a thermal image sensor 104, a digital signal processing unit 105, an image changing unit 107, a control unit 106, and a display unit. 109, and the thermal imaging camera 110 without a display as shown in (d) of FIG. 1 includes a thermal image sensor 104, a digital signal processor 106, an image converter 107, and a controller. It consists of 106. The thermal image sensor 104 changes the resistance when an energy wave having thermal energy reaches the sensor in a state in which a constant current is applied to the sensor, and ultimately outputs it as a voltage value, and converts it into a digital signal using an A / D converter. Module to output. The digital signal processing unit 105 is a module for digital signal processing the digital voltage value output from the thermal image sensor unit 104, the image conversion unit 107 converts the result processed by the digital signal processing unit 105 into an image The module outputs to the display unit 109. The control unit 106 is a module for applying a control signal to each component module, and is provided with a small size memory. The memory stores distance, which is the thermal image data of an object, according to distance, and thermal image data for each object in a table or database form. Of course, instead of using the memory provided in the control unit 106 may be provided with a separate memory. (B) of FIG. 1 shows a microbotometer array constituting the thermal image sensor unit, and FIG. 1 (c) shows a thermal image image of a duck measured in an image converter and then displayed on a display unit. This is an example showing the state.

When the intruder occurs during surveillance using a thermal imaging camera, the temperature pattern detected by the thermal imaging sensor is used to distinguish between a person and an object. Appears and the animal takes advantage of the trait that appears horizontally long.

The animal walks on four legs, and the human walking upright with two legs can be distinguished by the cell pattern of the thermal image sensor.The difference between the appearance of an infant walking and an animal walking is that an infant walks with his knees and an animal walks with its soles. Attributes can be used to distinguish whether a person has invaded or an animal is moving. To clarify this distinction, it is necessary to store and use thermal image data by distance and object more precisely. have.

In addition, since the thermal image sensor (or camera) is manufactured by a semiconductor device or MEMS (Micro-Electro Mechanical Systems) method, detection characteristics change over time. That is, the sensitivity of detection decreases with use time. Therefore, in the present invention, the rate of change of the detection characteristic according to time is stored in the memory unit, and a separate use time is cumulatively measured by the control unit, thereby compensating for the accurate temperature by compensating for the decrease in detection sensitivity according to the use time.

Another method of correcting the characteristics and measurement errors of a thermal image sensor that changes over time will be described. In the case of a thermal imaging camera having a shutter, the shutter is closed and the temperature is measured. In this case, since the thermal imaging camera measures the temperature between the sensor and the lens, all the thermal imaging sensor arrays (microbolometer array) should exhibit the same temperature sensing characteristics for each infrared wavelength. However, due to the change of the thermal image sensor array, some thermal image sensor arrays (pixels) output different temperature sensing characteristics. Therefore, the control unit outputs the output values of the remaining thermal image sensor arrays to the same temperature value from the thermal imager based on the maximum temperature value of the cells having the same temperature among the thermal image sensor arrays or the average temperature value detected by all the thermal image sensor arrays. A correction is made at 106 and the correction value is added to the memory.

In the case of a thermal imaging camera without a shutter, a method of compensating an object having a uniform temperature characteristic after photographing the thermal imaging camera is applied. In this case, all the cells of the IR sensor array should show the same temperature characteristics by infrared wavelength, but some of the degraded cells will show different temperature characteristics. Therefore, based on the temperature value of the largest number of cells having the same temperature among the thermal image sensor arrays or the average temperature value detected by all thermal image sensor arrays, the output values of the remaining thermal image sensor arrays are the same temperature in the thermal imager. When the control unit 106 corrects the output value to be added to the memory, the cell of the sensor array can be compensated. Examples of objects with uniform temperature characteristics include boiling water (100 ° C.), melting ice (0 ° C.) and human body temperature (36.5 ° C.).

2 is an explanatory diagram for explaining an example of thermal image data for each distance and object. 2 illustrates an example of a human shape detected according to a distance in a thermal image sensor array including 7 × 5 cells. FIG. 2 (a) shows a typical human thermal image detected when a distance between a film sensor and a person is located at a distance of 1m, and FIG. 2 (b) shows a distance of 3m between a film sensor and a person. FIG. 2 (c) shows a typical human thermal image detected when the distance between the film sensor and the person is located at a distance of 7 m. 2 (d) shows a typical human thermal image detected when the distance between the film sensor and the person is located at a distance of 10 m. As shown in FIG. 2, a thermal imaging camera according to the present invention includes a memory unit (included separately or in a control unit), and by storing thermal image data of various objects by distance as thermal image data by distance and objects in the corresponding memory. By determining the position of the pixel detected by the thermal sensor array, the approximate type and distance of the object can be determined. In addition, since the distance between the object and the thermal imaging camera is grasped, there is an advantage that the display can be displayed at a unique temperature of the object by correcting and expressing a temperature characteristic that is attenuated according to the distance.

A method of displaying a temperature using a conventional thermal imaging camera will be briefly described. Conventional thermal imaging cameras store color information to be displayed according to temperature in the form of a look up table. Conventionally, in order to detect the temperature measured in the thermal sensor array, and to express the color according to the detected temperature, the color is determined with reference to the lookup table and displayed in a predetermined color. Therefore, when the same person is photographed at a long distance using a conventional thermal imaging camera, it is displayed in a low temperature color, and when photographed at a close distance, it is displayed in a high temperature color. For reference, thermal energy is attenuated by distance. On the other hand, using the thermal imaging camera proposed in the present invention, the temperature of the object can be displayed after the temperature correction according to the distance as described above. There is this.

3 is an example of a smart phone according to the present invention equipped with a thermal image sensor. The smartphone has a display unit, a speaker, a microphone, a front visible light image sensor photographing the front surface, a rear visible light image sensor 110 photographing the rear surface, a rear thermal image sensor 100, and a plurality of operation buttons. It includes a PCB substrate provided with a variety of electronic components, including batteries, antennas, communication chips. Smartphone according to the present invention is provided with a thermal image sensor on the back, similar to the conventional smartphone except for the difference in the configuration is added to the digital signal processor, an image changer and the control unit shown in Figure 1 for processing the thermal image Has a configuration.

However, as described in the technology behind the invention, the visible light image sensor installed in the rear of the smartphone employs 12 million pixels for the iPhone 7 Plus and Galaxy S8 Plus. When the rear thermal image sensor having the same resolution as the visible light image sensor is installed, the thickness of the smart phone becomes thick and the price increases, so it is difficult to put it to practical use. Currently commercially available smartphones have a thickness of less than 2 cm, so the thermal image sensor that can be employed while maintaining this thickness adopts a resolution significantly lower than that of the visible light image sensor (eg, 10 × 10 = 100 pixels). Nothing else but to do. When designing a smartphone to design a visible light image sensor having 12 million pixels and a thermal image sensor having 100 pixels so as to capture an area of the same width, a ratio of 120,00,000 / 100 corresponds to one of the thermal image sensors. One pixel corresponds to 120,000 pixels of the visible light image sensor. In general, one pixel of the thermal image sensor is designed to correspond to 345 × 345 (= 119,025) pixels of the visible light image sensor.

In the present invention, a thermal image sensor having a resolution considerably lower than the resolution of the visible light image sensor installed on the rear surface is provided, but the area of the thermal image sensor is narrower than that of the visible light image sensor. Preferably, the thermal image sensor is designed to capture only a portion of the entire area of the visible light image sensor. For example, if the rear visible light image sensor adopts a resolution of 12 million pixels and an angle of view of 70 degrees, and the rear thermal image sensor adopts a resolution of 100 pixels and an angle of view of 30 degrees, only a portion of the visible image sensor is picked up. The sensor can be designed to shoot.

A display unit, a speaker, and a microphone are provided on the front surface, and a rear visible light image sensor having a first resolution and an image having a first resolution, and a second resolution lower than the first resolution and partially included in the first region. The area is achievable by a smartphone, characterized in that it comprises a rear thermal image sensor which captures only the second area. Preferably, the rear visible light image sensor has a first angle of view, and the rear thermal image sensor is preferably designed to have a second angle of view smaller than the first angle of view, and the second area is set to be a central portion of the first area. good.

According to the smart phone according to the present invention it is possible to synthesize a variety of images using a visible light image sensor and a thermal image sensor. Figure 4 (a) shows the image captured by the rear visible light image sensor using the smart phone according to the invention, Figure 4 (b) is taken with the rear thermal image sensor using the smartphone according to the present invention One thermal image is shown, and FIG. 4C is an image obtained by synthesizing the images of FIGS. 4A and 4B. In order to synthesize such an image, a module for synthesizing an image photographed by a thermal imaging camera and a visible light image sensor should be additionally provided to a function of a conventional smartphone. The composition module maps the area captured by the thermal image sensor to a part of the image area captured by the visible light image sensor while the center of the image captured by the thermal image sensor matches the position of the image captured by the visible light image sensor. To perform the task.

Figure 5 (a) shows a thermal image captured by the rear image sensor using a smart phone according to the present invention, Figure 5 (b) is a rear visible light in the same area as Figure 5 (a). The image captured by the image sensor is shown. As shown in FIG. 5, the visible light image sensor is configured to have a visible light image captured by using a visible light image sensor having a higher resolution and a larger area than the thermal image sensor to match an image area captured by the thermal image sensor. This is an example showing that only part of can be shown.

Next, when monitoring the moving object temperature using a thermal imaging camera, the monitoring method can accurately monitor the moving object even if the moving object exists alone and is mixed with a plurality of surrounding objects. Let's do it. 6 is an image illustrating a processing method according to the present invention for monitoring a moving object having an abnormal body temperature according to the present invention.

First, as shown in (a) of FIG. 6, a moving object exhibiting an abnormal temperature or a moving object with less movement is detected while measuring temperatures of a plurality of moving objects (STEP 1). In this case, less movement means setting the threshold movement amount per unit time for each object type and moving less. For example, in the case of chicken, the critical movement amount per 10 minutes is set to 1 m, and the object is less than the critical movement amount per 10 minutes (1 m) while auditing the movement of the moving object (chicken). As shown in FIG. 6 (b), the detected moving object having a high body temperature or the moving object having a low temperature is processed closer to red color to distinguish the moving object having another normal body temperature or the moving object showing normal movement. If necessary, an identification mark such as a unique number or symbol is assigned to the mobile object (STEP 2). As shown in (c) of FIG. 6, moving objects having abnormal body temperature or moving objects having normal body temperature, or moving objects showing normal movement (hereinafter, referred to as 'collective bodies') are shown. When mixed with, as shown in FIG. 6 (d), both the colonies including the moving objects having abnormal body temperature or the colonies including the moving objects with less movement are closer to red color (STEP 3). After that, when a moving object with abnormal temperature or a moving object with little movement leaves the cluster, the cluster changes to the normal temperature color and processes only the abnormal moving object or the moving object with less movement closer to the red color (STEP). 4). When the monitoring method shown in FIG. 6 is applied, even if a moving object having an abnormal temperature or a moving object having a small movement is mixed in a cluster, the entire cluster may be monitored and concentrated to manage the moving object or movement having an abnormal temperature. This reduces the chance of missing fewer moving objects. As shown in FIG. 6, when a phenomenon such as mixing of a moving object with a cluster occurs frequently, when an identifier (for example, a predetermined symbol, a number, or a specific color) is assigned to a moving object having an abnormal temperature, the object is managed. More accurate management is possible.

Referring to FIG. 6 through image processing, the temperature of a moving object is measured (STEP 1). When a moving object having an abnormal body temperature is found, a boundary area of the moving object is calculated, and the calculated boundary of the moving object is calculated. Fill the area with an abnormal body temperature color (redder than normal body temperature) and give an identification marker (STEP 2). The moving object with abnormal temperature is continuously monitored, and when the moving object with abnormal temperature is mixed in the cluster, the boundary region of the cluster is calculated and the inside of the boundary region of the cluster is filled with the abnormal temperature color (STEP 3). Continuous monitoring of an abnormal body temperature when a moving object having an abnormal temperature is out of the cluster converts the colony to the normal temperature color, and processing the area inside the boundary of the abnormal mobile object to the abnormal temperature color (STEP 4).

In the description of FIG. 6, a method of processing a moving object having an abnormal temperature has been described. However, in some cases, such as chickens or ducks with abnormal symptoms may show an abnormal behavior pattern first. When the present invention is extended, the technique shown in FIG. 6 may be applied as it is after identifying a moving object moving with an abnormal movement pattern while having a normal movement pattern for each moving object in a memory.

Moving objects with abnormal movements are performed in the following steps. Monitor the movement of the moving object (STEP 1), if it finds a moving object exhibiting abnormal movement, calculates the boundary area of the moving object, and the moving object having normal movement inside the calculated boundary area of the moving object. Fill in different colors (abnormal movement colors) and give them an identification marker (STEP 2). Continuously monitors moving objects with abnormal movements, and when moving objects with abnormal movements are mixed in the cluster, the boundary region of the cluster is calculated and the interior of the cluster is filled with the abnormal movement color (STEP 3). Continuous monitoring of a cluster with abnormal movement, when a moving object with abnormal movement is separated from the cluster, the cluster is converted to a normal movement color, and the area inside the boundary of the abnormal movement moving object is treated as an abnormal movement color. STEP 4).

Multiple thermal imaging cameras should be used to monitor large areas such as barns, poultry farms and borders. FIG. 7 is an exemplary view illustrating an arrangement relationship of a thermal image sensor when a thermal image is photographed using two adjacent thermal image sensors. One method is a method in which two adjacent thermal imager images are arranged so that they do not overlap each other, as shown in FIG. 7A, and another method is shown in FIG. 7B. The two adjacent thermal imaging sensors partially overlap the area of the image. Of course, when using two thermal imaging sensors (or cameras) as shown in Figure 7 it is preferable to use the same specification of the sensor (or camera), even if using the same specifications (or camera) of the neighboring image is not distorted Image correction will be necessary to avoid this.

In addition, the position and information of the junction portion or the overlapping portion of each of the thermal image sensor arrays in two adjacent thermal imaging cameras are stored in advance in the management system. When the object being tracked moves to the adjacent thermal imaging camera area, it analyzes the temperature, movement, and movement information of the object along with the adjacent thermal sensor array position information and handovers the moving object to the thermal imaging camera. Hand over to keep track of persistent objects and to store their temperature / motion information in the management system.

In the case of a moving object, the moving speed can be measured using a thermal imaging camera. 8 illustrates an example of measuring a moving speed of a moving object using a single thermal imaging camera. 8A illustrates an example of measuring two ducks moving in a thermal imaging camera at t0 seconds, and FIG. 8B illustrates an example of measuring two ducks moving in a thermal imaging camera at t1 seconds. As shown in (a) of FIG. 8, two ducks were detected in four cell areas of the thermal imaging camera array at t0 seconds, but two ducks were detected at nine cell areas after Δt seconds (t1-t0). It can be seen that the center of the moving object has a slight movement. It is possible to measure the moving direction and speed (how fast approaching) of the two ducks from the change of the two sensing regions and the center point shown in FIG. 8.

On the other hand, by using a plurality of fixed thermal imaging cameras (or sensors), the distance to the detected moving object can be measured more accurately than the visible light image sensor. 9 is an image for explaining the principle of measuring the distance of a moving object using two thermal imaging cameras (or sensors). Two thermal imaging cameras (505: first thermal camera and 506: second thermal camera) installed to be spaced apart by a certain distance (dL) are installed and the center of the moving object is determined from the thermal image data detected by each thermal camera. Detects the object center point L3, the highest temperature point L1 detected as the highest temperature, and the lowest temperature point L2 detected as the lowest temperature. If the object center point, the highest temperature point and the lowest temperature point are individually selected or used in duplicate, the distance between the moving object and the thermal imaging camera can be detected using triangulation.

When using a distance measuring device (lidar, radar, ultrasonic sensor, etc.) provided in the vehicle, or when the first thermal image sensor 505 and the second thermal image sensor 506 are installed on the front left and right sides of the vehicle, respectively, bad weather and day and night The distance to the moving object located in front of the vehicle can be accurately measured. The term "vehicle" includes a transport device that carries people on roads and rails such as automobiles, motorcycles, tricycles, and trains, and cameras are understood to include mobile / portable / fixed and surveillance / security / photography. You must lose.

In particular, moving objects moving on the road may include humans, cats, dogs, elks and wild boars, and the types of vehicles are limited to buses, cars, SUVs, and bicycles. It is easy to construct distance and object-specific thermal image data for these limited moving objects. In addition, thermal images according to vehicle types, such as buses and cars, have distinct characteristics that are distinctly distinguished, and thus, by using the thermal image data for each distance and object, the image can be easily identified. By comparing and analyzing the thermal image data, which are pre-built and stored in the vehicle, with the thermal image data captured in real time by one or a plurality of thermal cameras equipped with the vehicle, the type, state, The distance to the thermal camera, the direction of movement, the speed of movement, etc. can be known, and relevant information can be transmitted to the vehicle system or the driver.

At the same time when the visible light camera and the thermal imaging camera are respectively installed on the front left and right sides of the vehicle, the visible light camera and the thermal imaging camera respectively move the moving object as shown in (a) and (b) of FIG. 4. In order to make the image of FIG. 4 (a) to the same image size as that of FIG. 4 (b), the image taken by the visible light camera has the same image size as the image taken by the thermal imaging camera in the same ratio The operation is made as shown in FIG. 5 (b). The distance difference between the thermal image sensor array pixel position where the object is located in FIG. 4B (or FIG. 5A) and the point of the visible light camera sensor pixel where the object is located in FIG. 5B and the thermal imaging camera The distance between the vehicle and the object can be calculated by using a triangular function in the in-vehicle control unit and the memory using the simplified distance between the visible light camera and the visible light camera.

A method of measuring the distance to a moving object located on the front of the vehicle while the first thermal image sensor 505 and the second thermal image sensor 506 are respectively installed on the front left and right sides of the vehicle will be described with reference to FIG. 9. It will be briefly described.

Acquire a thermal image of the moving object detected by the first thermal image sensor 505 installed on the front left side of the vehicle, and the center point L3 and the maximum temperature point of the moving object in the obtained thermal image of the moving object. Detects the pixel position of L1 and the lowest temperature point L2, and similarly acquires a thermal image of the corresponding moving object detected by the second thermal image sensor 506 installed on the front right side of the vehicle. In the thermal image of the moving object, the pixel position of the center point L3, the highest temperature point L1, and the lowest temperature point L2 of the moving object is detected (STEP 10). If the moving object is located far from the vehicle, the center point (L3), the highest temperature point (L1), and the lowest temperature point (L2) are each one pixel because the pixel area occupied by the moving object in the thermal image is small. Can be specified. However, as the distance between the moving object and the vehicle increases, the pixel area displayed in the thermal image of the moving object becomes wider, and thus the highest temperature point L1 and the lowest temperature point L2 may appear in a plurality of pixels. For example, if only a human face is photographed in close proximity with a thermal imaging camera, the human face generally has a range that does not deviate significantly from 36.5 ° C., which causes a problem of detecting a plurality of pixels having the highest temperature or the lowest temperature. Will not be available for distance calculation.

Therefore, to solve this problem, the center point L3 of the thermal image of the moving object is calculated and used to calculate the distance between the moving object and the vehicle. Since the method of calculating the center point L3 of the moving object is already widely known in image processing, any one of them may be used. A relatively easy method is to obtain a boundary of the moving object, calculate a minimum rectangular area including the boundary area, and calculate the center point of the rectangular area as the center point L3.

The distance dL between the two thermal image sensors 505 and 506 is a known value, the angle between the first thermal image sensor 505 and the highest temperature point L1 and the second thermal image sensor 506 and The angle between the highest temperature points L1 can be determined through the position of the highest temperature point L1 in the first thermal image sensor 505 and the position of the highest temperature point L1 in the second thermal image sensor 506. Therefore, the distance between the moving object and the first thermal image sensor 505 and the second thermal image sensor 506 and the distance D between the moving object and the vehicle can be detected. In the same manner, the moving object, the first thermal image sensor 505, and the second thermal image sensor 506 using the lowest temperature point L2 in the first thermal image sensor 505 and the second thermal image sensor 506. The distance D and the distance D between the moving object and the vehicle can be detected. In the same manner, the moving object, the first thermal image sensor 505 and the second thermal image sensor are formed using the center point L3 of the moving object in the first thermal image sensor 505 and the second thermal image sensor 506. The distance 506 and the distance D between the moving object and the vehicle can be detected. Therefore, the distance D may be calculated and verified using at least one selected from the center point L3, the highest temperature point L1, and the lowest temperature point L2 of the moving object.

Data reliability can be further increased by recognizing the measurement distance only if each measured value is kept within a certain error range and remeasurement if it is outside the constant error range. In addition, since the highest temperature point (L1) and the lowest temperature point (L2) can be located at several points, each with the same temperature, it is sometimes difficult to obtain an accurate distance (D). In this case, the distance D between the moving object and the vehicle is obtained using the specific points in the boundary area or the center point L3 of the moving object, which are made by using a previously inputted calculation method with the positions of the boundary area points of the moving object described above. .

On the other hand, when taking a human body by using a high-resolution thermal imaging camera (640 × 480, 320 × 249m 160 × 120), the body may appear, which may cause a violation of human rights such as portrait rights. In addition, when a high resolution visible ray camera and a thermal imaging camera are simultaneously applied, a problem arises in that the amount of data to be transmitted and processed is increased. In this case, there may be a method of reducing the amount of data to be processed and the amount of data to be transmitted and reducing the subject image (blur processing, mosaic processing, etc.) or substituting the corresponding area with a symbol for protecting the portrait right. FIG. 10 illustrates an image of a human face photographed with a high resolution thermal imaging camera and an image b in attenuated state. When the object area to be detected or photographed needs to be replaced with a symbol image, the symbol image size or color is adjusted according to the size of the object area.

If the monitoring area to be monitored is large or there are a plurality of heat sources, and it is difficult to detect both the detection area and the heat source to be detected by one thermal imaging camera, a plurality of thermal imaging cameras should be installed. 11 is an example for explaining a method of arranging a plurality of thermal imaging cameras. The areas indicated by X and Y represent the entire area range detected by the plurality of thermal imaging cameras, and the areas indicated by x 'and y' indicate the area ranges detected by one thermal imaging camera. When multiple thermal cameras are installed in a line or matrix type in a given surveillance area, the optimal installation height and installation location are automatically calculated by using the surveillance area, movie camera characteristics (resolution / lens), size of sensing object, etc. To guide. In addition, a sensing object or a sensing device that reacts to the thermal image sensor at regular intervals is installed so that there is no blank area that cannot be detected by each thermal imager in the area detected by the thermal imagers. The thermal imaging camera detects a sensing object or a sensing device, and each thermal imaging camera orients the camera itself and completes the installation by creating overlapping monitoring areas or adjacent to each other at the boundary of adjacent thermal imaging cameras. When the adjacent thermal imaging cameras overlap with each other or store the thermal imager array information of the thermal imaging camera located so that they are adjacent to each other, the thermal imaging camera is moved to compensate for the gap in the detection area.

FIG. 12 is a diagram for explaining an area detected by four thermal imaging cameras placed around one sensing object. It can be seen that four thermal imaging cameras are arranged in a range of photographing one sensing object with an overlapping area. As shown in (a) of FIG. 12, when a plurality of thermal imaging cameras are installed, when a overlapping monitoring area is formed at an interface, when a tilting device is added to the thermal imaging camera, it is easily and automatically set to an initial setting state unlike a visible light camera. It can be returned to its original installation position. This uses the characteristic that the thermal imaging camera does not have many pixels. For example, in FIG. 12A, it is assumed that the thermal imaging camera A and the thermal imaging camera B are thermal imaging cameras having a resolution of 60 (vertical) x 80 (horizontal) pixels, respectively. Suppose that the camera B is installed so that one sensing object can be superimposed upon initial setting. If the sequence number of each thermal sensor array (pixel) is given in the same manner as in FIG. 12 (b), the sensing object is set at (58, 78) and (59, 78) pixels in the thermal imaging camera A at the initial installation stage. When the sensing object is detected at (57, 3) and (58, 3) pixels, the thermal imager B stores the position of the pixel as 'initial sensing pixel data' in the memory provided in each thermal imaging camera. do. Thereafter, as shown in FIG. 11, the photographing may be continued for a long time using a plurality of thermal imaging cameras, and thus the initial setting may be changed due to the influence of temperature or vibration. When it is found that the setting is changed, the initial detection pixel data and the tilting device stored in the control unit memory of each thermal imaging camera can be easily returned to the initial setting state. The method of switching to the initial setting state using the 'initial sensing pixel data' described above is a technique not used in the visible light camera. The reason is that the visible light camera is usually visually identifiable and has a high resolution, making it difficult to store the initial pixel position.

FIG. 13 is a view for explaining another embodiment of photographing a moving object image and calculating a separation distance from the moving object using one thermal imager and one visible light camera. FIG. 13A is an explanatory view showing a state in which the moving object A is simultaneously photographed using the thermal imaging camera 505 and the visible light camera 508, and FIG. 13B is a thermal imaging camera 505. FIG. FIG. 13C illustrates a moving object A captured by the visible light camera 508, and FIG. 13D illustrates a thermal imaging camera 505. FIG. The distance between the visible light camera 508 (dL) and the distance between the center of the moving object A from each of the vertical center lines of the thermal imaging camera 505 and the visible light camera 508 is determined by using the sum of the distances between the moving object and the moving object. It is explanatory drawing which shows the relationship of the distance D between cameras. As shown in (a) of FIG. 13, when the moving object A is photographed using the thermal imager 505 while the moving object A is placed, the moving object is located on the right side of the vertical center line as shown in FIG. The center point of A will be displayed. At this time, the distance between the vertical center line of the thermal imaging camera 505 and the center point of the moving object A is calculated as d1. When the moving object A is photographed using the visible light camera 508 in the same manner, as shown in FIG. 13C, the center point of the moving object A will be displayed on the left side of the vertical center line. At this time, the distance between the vertical center line of the visible light camera 508 and the center point of the moving object A is calculated as d2. If the sum of d1 and d2 obtained in this way is obtained, the distance D between the moving object and the camera can be obtained. Of course, in order to apply this calculation method, the value of 'd1 + d2', which is measured in various states of the distance between the moving object and the camera, must be stored in the form of a lookup table, etc. do.

The processing flow according to FIG. 13 will be briefly described. The moving object A is imaged using a thermal imager, and a center point of the moving object is obtained (step 21). The distance d1 between the center point obtained in step 21 and the vertical center line of the thermal imaging camera is calculated (step 23). The moving object A is imaged using a visible light camera, and the center point of the moving object is obtained (step 25). The distance d2 between the center point obtained in step 25 and the vertical center line of the visible light camera is calculated (step 27). Of course, the process of matching the area of the image captured by the visible light with the area of the image captured by the thermal imaging camera before step 27 must be performed first. Next, the distance D between the moving object A and the camera is calculated using the 'distance focal length sum' stored in the lookup table (step 29).

14A to 14E are graphs illustrating a method of compensating a cell array constituting a thermal image sensor according to the present invention. Although the method of compensating for the thermal image sensor has been described in the description of FIG. 1, the compensation method at the time of factory launch and the compensation method over time will be described in detail with reference to FIG. 14. It is assumed that the thermal image sensor is composed of a cell array composed of 4,800 cells in total at 60 × 80, as shown in FIG. In FIGS. 14A to 14E, eight cells (1 × 1, 1 × 2, 1 × 3, 1 × 80, 60 × 1, 60 × 2, 60 × 3, and 60 × 80) selected from all cells are illustrated for convenience of description. I will explain only.

When measuring the characteristics of the 4,800 manufactured cells, each cell shows a different characteristic as shown in Figure 14 (a). Even if a plurality of cells are manufactured in the same process using the same wafer, each cell has different properties and thus shows different characteristics. When the temperature (t) characteristics of each infrared frequency (λ) for each cell is measured, as shown in FIG. 14A, this can be confirmed. This is measured prior to release at the factory and the cell characteristics are compensated to have the same characteristics as shown in FIG. 14B. As described above, the initial compensation is generally stored in a memory provided in the controller, and, if necessary, may be stored using a memory provided separately from the controller.

Since the sensitivity changes with use after being released to the consumer, it is necessary to compensate for the relative temperature of each cell as described above. 14c is a graph showing a state (relative temperature) of the temperature detection characteristics of each cell by the infrared wavelength according to the use time after launch, Figure 14d is a state in which the temperature sensing characteristics of the infrared wavelength by cell changes according to the use time after the launch (dotted line) ) And temperature detection characteristics (indicated by solid lines) at the time of release. When such a phenomenon occurs, as described above, when the shutter is provided, the shutter is used, and when the shutter is not provided, the temperature characteristic of each infrared wavelength is measured and corrected by using an object having a reference temperature, which is illustrated in FIG. 14E. As described above, the relative temperature compensation according to the deterioration is performed (indicated by the dashed-dotted line) to compensate the characteristics so as to show characteristics similar to those at the time of release. In this case, all cells need only have the same temperature characteristic for each infrared wavelength, so it is not necessary to compensate for the sensitivity characteristic at the time of release, but for all cells to have the same temperature characteristic for each infrared wavelength.

If you know in advance the number of cells (resolution), lens angle, and object size of the thermal imaging sensor that make up the thermal imaging camera, the temperature between the object and the thermal imaging camera depends on how or when the temperature of the object is detected by the thermal imaging sensor. The distance can be determined. In particular, if the object is a human, the human head is round and normally exposed, so the temperature is high compared to other areas, and the head length is usually determined (male average 23.5 cm, female average 22.6 cm), and the variation in hair length is small. . That is, even if the head length deviation is ± 1cm, it belongs to the top / bottom 10% of the head length, and if the deviation is ± 2cm, it is the top 1%. The distance between a person and a thermal camera can be calculated by knowing the number or shape of thermal imaging sensors of a thermal camera that detects the heat of a human head. Therefore, the temperature value of the person detected by the thermal imaging camera can be corrected using this distance.

For example, in the case of a thermal imaging camera (a) having an 80 × 60 resolution and a 30 degree angle lens as shown in FIG. 15, when a real face (b) of a person is detected in a 3 × 3 cell (c) the camera and a person The distance of is calculated as about 4m (d) when calculated by trigonometric function. In the case of a thermal imaging camera using an 80 × 60 resolution and a 90 degree lens, when a human face is detected by a 3 × 3 sensor, the distance between the camera and the person is calculated to be 1m when calculated using a trigonometric function.

In the case of a thermal imaging camera using an 80 × 60 resolution and a 30 degree lens, the distance between the camera and the person is 8m when the human face is detected by the 2 × 2 sensor. In the case of a thermal imaging camera using an 80 × 60 resolution and a 90 degree lens, the distance between the camera and the person is 2m when the face is detected by a 2 × 2 sensor.

By adding a humidity sensor and a temperature sensor to measure the humidity and temperature of the surroundings in the thermal imaging camera, it is possible to more accurately correct the distance between the human and the thermal imaging camera and the human body temperature to detect a person having an abnormal body temperature. Ambient humidity and ambient temperature have a great influence on the measurement of thermal energy, so if you know it, you can accurately calibrate the measured value measured by the thermal imager. Using the same principle, it can be used in birds and automobiles, such as ducks and chickens, which are the same or similar in shape or size. The data on the resolution, lens angle, and shape or number of sensors detected by the thermal image sensor of the thermal imager described in FIG. 15 may be stored in the above-described distance and object-specific thermal image data.

15 and the number of thermal imaging sensors occupied by the head size of the person captured by the thermal imaging sensor, the resolution of the thermal imaging sensor and the distance between the corresponding object and the thermal imaging camera according to the lens angle according to the distance and the object thermal imaging in FIG. If the data is stored in advance, the distance between the object and the thermal imaging camera can be calculated. Furthermore, if a person suddenly falls to the floor, falls or falls due to a disease such as heart disease or high blood pressure, it is possible to discriminate. 16 is a diagram illustrating a situation of detecting a case where a person suddenly falls by using a thermal imaging camera. When the head (a) of the person detected by the thermal image sensor of the thermal imager is moved vertically down (b), the speed of the head falling to the floor can be calculated by the moving length (Δy) and time of the cell moved by the sensor. have. If the speed at which the head falls to the floor is faster than 1m / sec and suddenly the speed stops at 0m / sec momentarily, it can be determined that the person fell down, fell down or fell due to an abnormality of the body. It can be notified using an alarm device composed of a buzzer or a light emitting element added to the. For example, in the case of a thermal imaging camera using an 80 × 60 resolution lens and a 30 degree angle lens, when a human face is detected by a 2 × 2 sensor (a), the distance between the camera and the person is calculated by a trigonometric function, It can be said. If the position of the thermal sensor that detects the human head in one second moves to the bottom 16 cells (b), the speed at which the head falls to the floor is 1.6m / sec, which may suspect that the person falls and give an alarm. have. If this speed does not decrease slowly and suddenly becomes 0m / sec, it can judge that it falls over the body and give an alarm.

Thermal sensors can be classified into cooling thermal sensors and non-cooling thermal sensors depending on whether or not a cooler is attached. Cooled thermal imager uses an image sensor and generates a lot of heat, so it has a cooler and has high precision. Uncooled type has the disadvantage of low precision compared to the cooled type, but does not have a cooler occupies a small volume and has the advantage that can be produced at a relatively low cost. In the present invention, it is preferable to limit the example of applying the uncooled thermal image sensor, and the uncooled thermal image sensor uses a temperature sensor whose resistance changes according to a heat called a microbolometer instead of the image sensor.

A commercially available manufacturer using a cooled thermal imager is FLIR Systems. The portable thermal cameras sold by FLIR Systems have the advantage of high precision, but they are not easy to use for ordinary users. For example, in order to measure the temperature of an object using a portable thermal camera sold by FLIR Systems, data including the distance between the object and the thermal camera, the ambient temperature and the emissivity of the object must be entered before the measurement. . Conventional thermal imaging cameras express temperature values measured on the basis of these input values in a previously registered mapping color. For example, assuming that the temperature range measured by the thermal imaging camera is 17 ° C. to 50 ° C., the expression color data for each temperature stored in advance is mapped and expressed using a lookup table.

The thermal imaging camera according to the present invention applies an uncooled thermal image sensor and has been implemented so that anyone can easily measure the temperature. The interface to control the thermal camera is implemented so that it can be set through the thermal camera app (Application) stored in the smartphone used by the user using Bluetooth or Wi-Fi. 17 is a setting example screen provided by the thermal imaging camera app of an embodiment according to the present invention. In the thermal imaging camera according to the present invention, a fire alarm 210 and a security alarm 220 may be set, and a temperature range to be monitored may be set 230. In the fire alarm and security alarm, there is a difference between the conventional thermal imaging camera and the user can set any temperature value according to the thermal imaging camera installation position. A case where a fire alarm is set in a thermal imaging camera having a thermal sensor number of 10 × 7 and an angle of view of 30 degrees will be described. When using the thermal imaging camera according to the present invention to detect the occurrence of a fire in the living room and the room, the temperature of the ignition point will be measured differently according to the installation position of the thermal imaging camera. This is because the heat detected by the thermal imager is measured differently according to the ambient temperature, the ambient humidity and the distance between the ignition point and the thermal imaging camera. For example, if the living room is placed close to the entrance and then the thermal imaging camera is installed at the entrance in the room where the room is located, the detected temperature will be different if the fire occurs in the living room or the kitchen. . In the present invention, the fire alarm may be set using a lighter, etc. at various positions, and using a temperature value directly measured using a thermal imaging camera according to the present invention. For example, when the lighter is turned on in the living room relatively close to the thermal imaging camera installation position, the measured temperature is detected as 60 ° C or higher. When the lighter is turned on in the room, the fire alarm temperature according to FIG. It is set to 50 degreeC. As such, when the fire alarm is set to 50 ° C. or higher, any cell in the thermal imaging camera operation detects a temperature higher than 50 ° C. so that a fire can be sent to a preset smartphone. Unlike the thermal imaging camera according to the present invention, the thermal imaging camera according to the present invention is limited regardless of the installation location and environment because the conventional thermal imaging camera should use only a temperature value set by the manufacturer. The advantage is that accurate detection is possible.

Next, the security alarm setting will be described. Since a thermal imaging camera providing a conventional security alarm is set in a manner of sending a warning when a temperature set by a manufacturer is detected, there is a restriction that the installation location and a detectable range should follow the manufacturer's regulations. Due to this limitation, in order to perform a security function, a conventional thermal imaging camera has to be installed at a close distance from a location where a person is expected to enter or exit. In contrast, the thermal imaging camera according to the present invention has an advantage in that the user can arbitrarily set a temperature range in which the security alarm can be set, so that the installation position and the temperature range that can be detected can be freely designed.

A case where a security alarm is set in a thermal imaging camera having a number of thermal sensors 10 × 7 and an angle of view of 30 degrees will be described. When using the thermal imaging camera according to the present invention to detect the case where an intruder occurs in the living room and the room, the temperature of the intrusion point will be measured differently according to the installation position of the thermal imaging camera. This is because the heat detected by the thermal imager is measured differently according to the ambient temperature, the ambient humidity and the distance between the ignition point and the thermal imaging camera. For example, if a living room is arranged close to the entrance and then a thermal imaging camera is installed in the room where the room is located, the detected temperature is different when the intrusion occurs in the front door and in the kitchen. In the present invention, assuming a virtual intruder at various locations, the temperature of the virtual intruder can be directly measured using a thermal imager to set a fire alarm in the detected temperature range. For example, if an intruder occurs in a living room relatively close to the installation location of the thermal imaging camera, the measured temperature is detected as 30 ℃ ~ 36 ℃. If an intruder occurs at a relatively long distance, the measured temperature is detected as 25 ℃ ~ 29 ℃. The security alarm temperature range according to FIG. 17 is set to 25 ° C to 36 ° C. When the security alarm is set in the range of 25 ° C to 36 ° C, if a security alarm setting temperature range of 25 ° C to 36 ° C is detected in all of the continuous 2x2 cells during the operation of the thermal imaging camera, it is determined that an intruder has occurred and the preset smart phone Implemented to send alarms. In case of fire alarm, alarm is generated for safety even when only one cell among 10 × 7 cells exceeds the set temperature.In case of intruder, in 2 × 2 cells among 10 × 7 cells in order to secure detection reliability An alarm is generated when the set temperature range is displayed. Unlike the thermal imaging camera according to the present invention, the thermal imaging camera according to the present invention is limited regardless of the installation location and environment because the conventional thermal imaging camera should use only a temperature value set by the manufacturer. The advantage is that accurate security alarms are possible.

As described above, the conventional thermal imaging camera displays colors by mapping colors according to all detected temperature ranges from the lowest temperature detected to the highest temperature detected in the photographing area. Since this method provides only unnecessary information when the user does not want to observe the temperature range, the user cannot grasp the precise temperature distribution of the desired range. For this problem, the thermal imaging camera according to the present invention is implemented so that a user can set a temperature range to be measured. In this case, the set temperature range may be set to a temperature range detected at an arrangement position of the thermal imaging camera, not the actual temperature of the object measured by the thermometer. In FIG. 17, the measurement temperature region 230 may be set. For example, when setting to observe only the temperature range of 16.0 ℃ ~ 75.0 ℃ based on the temperature measured by the thermal imaging camera using the measurement temperature area setting menu 230, as shown in Figure 18 Instead of displaying the entire temperature range of the area, it was configured to display only the set temperature range (16.0 ℃ ~ 75.0 ℃) through the measurement temperature range setting menu 230. 18 is an example of a screen displaying only a measurement temperature range set by a user using a thermal imaging camera according to the present invention.

The thermal imaging camera according to the present invention may express the entire temperature range detected in a corresponding region, such as a conventional thermal imaging camera, through color mapping except for displaying only a temperature range set by a user. 19 is an example of a screen displaying the entire temperature range detected by the thermal imaging camera according to the present invention. At this time, in order to improve visibility, as shown in FIG. 19, a temperature range (8.9 ° C to 13.2 ° C) within the range below the center temperature value 13.2 ° C in the entire range of temperatures to be displayed (8.9 ° C to 17.5 ° C) In the black and white, the temperature range (13.2 ℃ ~ 17.5 ℃) belonging to the upper range was displayed by mapping to color.

While preferred embodiments of the present invention have been described above using specific terms, such terms are only for clarity of the present invention, and embodiments and described terms of the present invention are departed from the spirit and scope of the following claims. It is obvious that various changes and modifications can be made without a change. Such modified embodiments should not be understood individually from the spirit and scope of the present invention, but should fall within the claims of the present invention.

Claims (9)

1. A speaker and a microphone are provided, and a display unit and a speaker and a microphone are provided on the front side, and a rear visible light image sensor having a first resolution on the rear side and an image of the first region, and a second resolution lower than the first resolution. The smartphone, characterized in that the partial region included in the region has a rear thermal image sensor for capturing only the second region.
2. The method of claim 1,

   The rear visible light image sensor has a first angle of view, and the rear thermal image sensor has a second angle of view smaller than the first angle of view.
3. The method according to claim 1 or 2,

   The second area is a smart phone, characterized in that the central portion of the first area.
4. In the method for monitoring the thermal temperature of a plurality of moving objects,

   A first step of measuring temperature or movement of the plurality of moving objects;

   Identify the first moving object showing abnormal temperature or abnormal movement, calculate the boundary area of the first moving object, fill the inside of the calculated boundary area with the abnormal temperature color or abnormal movement color, and identify the identification. A second step of granting

   Continuously monitoring the first moving object, and when the first moving object is mixed with the cluster, calculating a boundary area of the colony and filling the inside of the boundary area with an abnormal temperature color or an abnormal movement color; ,

   A fourth step of continuously monitoring the colony having abnormal temperature or abnormal movement and converting the colony into a normal temperature color or a normal motion color when the first moving object is separated from the cluster; and

   And a fifth step of processing a region inside the boundary of the first moving object deviated from the cluster as an abnormal temperature color or an abnormal movement color.
5. The method of claim 4, wherein

   And the identification mark provided to the first moving object is a color, a number, or a symbol.
6. And a first thermal image sensor installed at the front left side and a second thermal image sensor installed at the front right side, wherein the first thermal image sensor and the second thermal image sensor are installed to photograph the same front region and are located in front of the vehicle. In the method for measuring the distance to the object located,

   A first step of identifying a center point L3 of the moving object detected in the surveillance area by using the first thermal image sensor;

   A second step of identifying a center point L3 of the moving object detected in the surveillance area by using the second thermal image sensor;

   The object and the vehicle by triangulation using the separation distance between the center point L3 and the first thermal image sensor and the second thermal image sensor, which are identified by the first thermal image sensor and the second thermal image sensor. And a third step of determining a distance between the first and second steps, wherein the first and second steps are performed simultaneously or irrespective of the order. Method for measuring the distance to the object located in front of the vehicle, characterized in that having the same specifications.
7. The method of claim 6,

   In the first step, in addition to the center point L3, a maximum temperature point (first highest temperature point) representing the highest temperature characteristic of the moving object and a minimum temperature point (first lowest temperature point) representing the lowest temperature characteristic are further identified. and,

   In the second step, in addition to the center point L3, a maximum temperature point (second highest temperature point) indicating the highest temperature characteristic of the moving object and a minimum temperature point (second lowest temperature point) indicating the lowest temperature characteristic are further identified. and,

   The triangulation method performed in the third step uses any one selected from the first highest temperature point, the second highest temperature point, the first lowest temperature point, and the second lowest temperature point instead of the center point. How to measure the distance to an object located at.
8. The method of claim 7, wherein

   The third step is performed after the third step, by selecting or overlapping the center point, the highest temperature point, and the lowest temperature point of the first thermal image sensor, the second thermal image sensor, and the moving object. A fourth step of re-measuring and determining the distance of the vehicle,

   The distance between the object and the vehicle calculated only when the distance D1 of the object and the vehicle calculated in the third step and the distance D2 of the object and the vehicle calculated in the fourth step are within an error range. Method for measuring the distance to the object located in front of the vehicle, characterized in that calculating.
9. And a first thermal image sensor installed at the front left side and a second thermal image sensor installed at the front right side, wherein the first thermal image sensor and the second thermal image sensor are installed to photograph the same front region, and the first column. A first distance and a second distance at which a center point of an object detected by the first thermal image sensor is spaced from a vertical center line when an object spaced by a plurality of known distances is photographed using the image sensor and the second thermal image sensor Measuring the distance from the object located in front of the vehicle in a vehicle having data on the 'focal distance sum for distance' composed of the sum of the second distances of the center points of the objects detected by the thermal imager from the vertical center line In the way,

   Grasping the center point L3 of the moving object detected in the surveillance area using the first thermal image sensor, and calculating a distance d1 between the center point L3 from a vertical center line of the first thermal image sensor; Step one,

   Grasping the center point L3 of the moving object detected in the surveillance area using the second thermal image sensor and calculating a distance d2 between the center point L3 from a vertical center line of the second thermal image sensor; Step two,

   Obtaining a sum of the d1 and d2, and determining a distance between the object and the vehicle by using the sum of the d1 and d2 and the 'focal spacing by distance', wherein the first step and the The second step may be performed simultaneously or irrespective of the order, and the first thermal image sensor and the second thermal image sensor may have the same specification. How to measure.

Images