KR20140093516A - Operating method of thermal image detectiing device - Google Patents

Operating method of thermal image detectiing device Download PDF

Info

Publication number
KR20140093516A
KR20140093516A KR1020130006019A KR20130006019A KR20140093516A KR 20140093516 A KR20140093516 A KR 20140093516A KR 1020130006019 A KR1020130006019 A KR 1020130006019A KR 20130006019 A KR20130006019 A KR 20130006019A KR 20140093516 A KR20140093516 A KR 20140093516A
Authority
KR
South Korea
Prior art keywords
image
thermal image
column
thermal
sensing apparatus
Prior art date
Application number
KR1020130006019A
Other languages
Korean (ko)
Inventor
임재호
홍효봉
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR1020130006019A priority Critical patent/KR20140093516A/en
Publication of KR20140093516A publication Critical patent/KR20140093516A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Radiation Pyrometers (AREA)
  • Image Processing (AREA)

Abstract

According to an embodiment of the present invention, a method for operating a thermal image detecting device comprises the steps of: acquiring a first thermal image including an object; processing the first thermal image acquired; detecting a first pixel number of the object based on the first thermal image processed; acquiring a second thermal image which includes the object and has a predetermined time difference between the first and the second thermal images; processing the second thermal image acquired; detecting a second pixel number of the object based on the second thermal image processed; and detecting the motion of the object based on the detected first and second pixel numbers.

Description

[0001] OPERATING METHOD OF THERMAL IMAGE DETECTILING DEVICE [0002]

The present invention relates to an image sensing system, and more particularly, to a method of sensing an object using a thermal image.

Image sensing systems are widely used for security surveillance, industrial use, video surveillance of vehicles, and traffic management. Such an image sensing system uses a camera device to recognize a person or an object. However, when a general camera device is used, the image sensing system has difficulty in detecting a person or an object due to factors such as weather, time, illumination, and location. In order to overcome such disadvantages, a thermal imaging apparatus that receives a fine infrared ray (IR) generated by a person or an object and senses heat is widely used.

An object of the present invention is to provide a method of detecting a motion of a specific object using a thermal image.

A method of operating a thermal image sensing apparatus according to an exemplary embodiment of the present invention includes: acquiring a first thermal image including an object; Image processing the acquired first column image; Detecting a first number of pixels of the object based on the first processed image; Obtaining a second column image including the object and having a predetermined time difference with the first column image; Image processing the acquired second column image; Detecting a second number of pixels of the object based on the image-processed second column image; And detecting movement of the target object based on the detected first and second number of pixels, wherein the step of image processing the acquired first column image comprises: Marking a region of the object with a specific color; Extracting the marked areas from the first column image to generate a first gray scale image; Generating a first binarized image by binarizing the generated first gray-scale image; And generating the first processed image by removing the noise of the first binarized image, wherein the step of image processing the obtained second column image comprises the steps of: Marking regions of a target object with a specific color; Extracting the marked areas from the second column image to generate a second gray scale image; Generating a second image by binarizing the second gray-scale image; And removing the noise of the second binarized image to generate the image-processed second column image.

According to the present invention, there is provided an operation method of a thermal image sensing apparatus capable of sensing the movement of a target object without being affected by external illumination, climate, or the like.

1 is a diagram illustrating a sensing system according to an embodiment of the present invention.
FIG. 2 is a flowchart showing the operation of the thermal image sensing apparatus shown in FIG. 1. FIG.
FIG. 3 is a flowchart showing steps S120 and S150 of FIG. 2 in detail.
FIGS. 4 to 7 are views for explaining the operation shown in FIG. 3 in detail.
FIG. 8 is a diagram for explaining the operation of the thermal image sensing apparatus shown in FIG. 1 in detail.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the technical idea of the present invention. .

1 is a diagram illustrating a sensing system according to an embodiment of the present invention. The sensing system 100 includes a thermal image sensing device 110 and a target object 120. The thermal image sensing apparatus 110 may acquire a thermal image based on temperature information of the object 120. FIG. For example, the thermal image sensing device 110 may detect minute infrared rays emitted from the object 120 and the background. The fine infrared rays emitted from the object 120 have different characteristics (for example, wavelength) depending on the temperature of the object 120. [ The thermal image sensing apparatus 110 can output images having different colors according to temperature based on the detected infrared rays. Illustratively, the temperature of the object 120 may be included within a certain range. In this case, the thermal image sensing apparatus 110 can previously determine a color corresponding to a temperature within a specific range to a specific color. That is, the object object 120 in the thermal image will be displayed based on a predetermined specific color.

The thermal image sensing apparatus 110 may perform an image processing operation based on the acquired thermal image. For example, the thermal image sensing device 110 may extract a region indicated by a specific color in a thermal image. The thermal image sensing apparatus 110 may generate a grayscale image in which the extracted region is emphasized. The thermal image sensing apparatus 110 may generate a binarized image by binarizing the generated gray scale image to a predetermined threshold value. The thermal image sensing apparatus 110 may remove image noise of the binarized image. The image processing operation of the thermal image sensing apparatus 110 will be described in more detail with reference to FIGS.

The thermal image sensing apparatus 110 can detect the movement of the object 120 included in the image-processed thermal image. For example, the thermal image sensing device 110 may detect the first number of pixels of the object 120 included in the imaged thermal image. The thermal image sensing apparatus 110 may redetect the second number of pixels of the object 120 based on the above-described operations after a predetermined time. At this time, when the object 120 moves, the first and second pixel numbers will have different values. The thermal image sensing apparatus 110 can detect the movement of the object 120 based on the thermal image sensing apparatus 110. With reference to the following figures, the operation of thermal image sensing device 110 will be described in more detail.

FIG. 2 is a flowchart showing the operation of the thermal image sensing apparatus shown in FIG. 1. FIG. Illustratively, the first and second column images have a time interval of a predetermined time. In addition, it is assumed that the thermal image sensing apparatus 110 senses the movement of the object 120 based on the first and second thermal images. However, the scope of the present invention is not limited thereto, and the thermal image sensing apparatus 110 may acquire thermal images in real time and image-process the thermal images to sense the movement of the object 120.

Referring to FIG. 2, in step S110, the thermal image sensing apparatus 110 may acquire a first column image including the object 120. FIG. For example, the thermal image sensing device 110 may detect a fine infrared ray emitted from the object 120 to acquire a thermal image. A thermal image refers to an image that is displayed to have a different color depending on the temperature.

In step S120, the thermal image sensing apparatus 110 may image the acquired first column image. For example, the thermal image sensing apparatus 110 may perform image processing of the acquired first column image by performing rail scale conversion, binarization, and noise removal. Illustratively, the first column image subjected to the image processing will be expressed as a monochrome image. The step S120 will be described in detail with reference to Figs.

In step S130, the thermal image sensing apparatus 110 may measure the first number of pixels of the object 120 included in the first-column image subjected to the image processing. For example, the first column image subjected to image processing is a binarized image. Binarization refers to an image in which the pixels included in the image have either a white color or a black color. Illustratively, if the object 120 included in the first processed image is represented as white, the thermal image sensing device 110 may measure the number of white pixels in the first processed image, have.

In step S140, the thermal image sensing apparatus 110 may acquire a second column image including the object. And the second column image indicates a column image obtained after a predetermined time after the first column image is acquired.

In step S150, the thermal image sensing apparatus 110 may image the acquired first column image. In step S160, the thermal image sensing apparatus 110 may measure the second number of pixels of the object 120 included in the image-processed second column image. Illustratively, in steps S150 and S160, thermal image sensing device 110 may perform the same operations as steps S120 and S130.

In step S170, the thermal image sensing apparatus 110 may detect the movement of the target object based on the first and second number of detected pixels. For example, when the object 120 moves, since the object 120 in the image changes position or size with time, the number of the first and second pixels will be different from each other. Illustratively, when the second number of pixels is greater than the first number of pixels, the size of the object 120 displayed in the second column image may be greater than the size of the object 120 displayed in the first column image. In other words, the object 120 will be approaching the thermal image sensing device 110.

According to the embodiment of the present invention described above, the thermal image sensing apparatus 110 can process the thermal image including the object 110 to sense the movement of the object. Accordingly, a thermal image sensing apparatus having improved performance without being affected by weather, illumination, and the like is provided.

FIG. 3 is a flowchart illustrating the image processing operations of steps S120 and S150 shown in FIG. 2 in detail. FIGS. 4 to 7 are views for explaining the operation method of the thermal image sensing apparatus shown in FIG. 3 in more detail. Hereinafter, the operation of step S120 will be described in detail. However, the operation of step S150 will also be the same as that described with reference to Fig. 3 to 7 together for brevity.

3 and 4, in step S121, the thermal image sensing apparatus 110 may mark an area of the object 120 included in the acquired thermal image IMG1 as a specific color. For example, the thermal image IMG1 is displayed to have a different color depending on the temperature of the object. The object of interest 120 will have a temperature that is within a certain range. The thermal image sensing apparatus 110 may display objects corresponding to temperatures included in a specific range in a specific color (e.g., green). Illustratively, the specific color may be determined based on the temperature range of the object, the temperature range of the background, the temperature range of other objects included in the thermal image, and the like.

Next, referring to FIGS. 3 and 5, in step S122, the thermal image sensing apparatus 110 may detect a specific color marked on the thermal image IMG1 to generate a gray-scale image IMG2. For example, the object 120 included in the thermal image IMG1 will have a temperature included in a certain range. In addition, the thermal image sensing apparatus 110 may display objects corresponding to temperatures included in a specific range in a specific color. The thermal image sensing apparatus 110 can detect an area indicated by a specific color. The thermal image sensing apparatus 110 may generate a gray scale image IMG2 in which the detected area is emphasized. The grayscale image indicates an image in which only the brightness information of the image is displayed. Accordingly, it is possible to generate the gray-scale image IMG2 by correcting the column image IMG1 so that the specific color is represented by black or white.

Next, referring to FIGS. 3 and 6, in step S123, the thermal image sensing apparatus 110 may binarize the gray-scale image IMG2. For example, the thermal image sensing apparatus 110 may generate a binarized image IMG3 by binarizing the grayscale image IMG2 to a specific threshold value. A binarized image refers to an image in which each pixel is represented by either a white color or a black color based on a threshold value. Illustratively, the object included in the binarized image IMG2 may be displayed in white.

3 and 7, in step S124, the thermal image sensing apparatus 110 may remove noise of the binarized image IMG3.

8 is a view for explaining an image processing process according to an embodiment of the present invention. Illustratively, the drawings shown in Fig. 8 indicate a first direction is a time flow and a second direction is an image processing procedure.

Referring to FIG. 8, the thermal image processing apparatus 110 may acquire an image IMG1 including a target object 120. FIG. The thermal image processing apparatus 110 can generate a gray scale image IMG2, a binarized image IMG3, and a noise-eliminated binarized image IMG3 based on the methods described with reference to FIGS. The thermal image processing apparatus 110 can detect the number of pixels of the object 120 in the binarized image IMG3 from which the noise is removed and detect the motion of the object 120 based on the number of pixels. For example, referring to the binarized image IMG3 from which the noise has been removed, the number of pixels of the object 120 decreases with time. In other words, the object 120 is moving away from the thermal image sensing apparatus 110 with the passage of time.

According to the embodiment of the present invention described above, the thermal image sensing apparatus 110 can process a thermal image including the object 120 and detect the movement of the object 120 based on the thermal image. Accordingly, a thermal image sensing apparatus having improved performance and reliability is provided.

Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the above-described embodiments, but should be determined by the claims equivalent to the claims of the present invention as well as the following claims.

100: Detection System
110: thermal image sensing device
120: Object of observation
IMG1: Thermal image
IMG2: Grayscale video
IMG3: Binarization image
IMG4: Noise canceled binary image

Claims (1)

A method of operating a thermal image sensing device,
Obtaining a first column image including a target object;
Image processing the acquired first column image;
Detecting a first number of pixels of the object based on the first processed image;
Obtaining a second column image including the object and having a predetermined time difference with the first column image;
Image processing the acquired second column image;
Detecting a second number of pixels of the object based on the image-processed second column image;
Detecting movement of the object based on the detected first and second number of pixels,
The step of image processing the acquired first column image
Marking an area of the object included in the acquired first column image with a specific color;
Extracting the marked areas from the first column image to generate a first gray scale image;
Generating a first binarized image by binarizing the generated first gray-scale image; And
And removing the noise of the first binarized image to generate the image-processed first column image,
The step of image processing the acquired second column image
Marking the regions of the object included in the obtained second column image with a specific color;
Extracting the marked areas from the second column image to generate a second gray scale image;
Generating a second image by binarizing the second gray-scale image; And
And removing the noise of the second binarized image to generate the image-processed second column image.
KR1020130006019A 2013-01-18 2013-01-18 Operating method of thermal image detectiing device KR20140093516A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130006019A KR20140093516A (en) 2013-01-18 2013-01-18 Operating method of thermal image detectiing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130006019A KR20140093516A (en) 2013-01-18 2013-01-18 Operating method of thermal image detectiing device

Publications (1)

Publication Number Publication Date
KR20140093516A true KR20140093516A (en) 2014-07-28

Family

ID=51739689

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130006019A KR20140093516A (en) 2013-01-18 2013-01-18 Operating method of thermal image detectiing device

Country Status (1)

Country Link
KR (1) KR20140093516A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019182355A1 (en) * 2018-03-20 2019-09-26 주식회사 엠테이크 Smartphone, vehicle and camera having thermal image sensor, and display and sensing method using same

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019182355A1 (en) * 2018-03-20 2019-09-26 주식회사 엠테이크 Smartphone, vehicle and camera having thermal image sensor, and display and sensing method using same

Similar Documents

Publication Publication Date Title
JP7262021B2 (en) Depth Acquisition Device, Depth Acquisition Method and Program
Fernández-Caballero et al. Real-time human segmentation in infrared videos
CN107005655B (en) Image processing method
KR101546933B1 (en) Apparatus for sensing fire
KR101546700B1 (en) System and method for recognizing road pothole area using image
JP2009187135A (en) Vehicle periphery monitoring device, vehicle, program for monitoring vehicle periphery, and vehicle periphery monitoring method
KR101279712B1 (en) Apparatus and method for providing real-time lane detection, recording medium thereof
JP6068833B2 (en) Car color detector
JPWO2013047088A1 (en) Biological recognition device
KR101516487B1 (en) Image processing device using difference camera
JP4887540B2 (en) Vehicle periphery monitoring device, vehicle, vehicle periphery monitoring program, and vehicle periphery monitoring method
JP6452361B2 (en) Information processing apparatus, information processing method, and program
JP6221283B2 (en) Image processing apparatus, image processing method, and image processing program
KR20110023279A (en) Method for tracking object in multi-camera system and apparatus thereof
JP2010136207A (en) System for detecting and displaying pedestrian
JP4765113B2 (en) Vehicle periphery monitoring device, vehicle, vehicle periphery monitoring program, and vehicle periphery monitoring method
KR20140093516A (en) Operating method of thermal image detectiing device
KR102150661B1 (en) Method and Apparatus for Preprocessing Image for Detecting Objects
JP4611919B2 (en) Pedestrian recognition device
JP5754931B2 (en) Image analysis apparatus, image analysis method, and program
JPWO2011155152A1 (en) Vehicle periphery monitoring device
JP2008040724A (en) Image processing device and image processing method
JP2007249743A (en) Identification method for moving object, identification device for moving object and program making identification processing for moving object to be performed
JP6565513B2 (en) Color correction device, color correction method, and computer program for color correction
JP6348020B2 (en) Image processing apparatus, image processing method, and inspection method using the same

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination