KR101728435B1 - Thermal camera equipped with thermal sensing function in IP camera network environment and CCTV system using the same - Google Patents

Abstract

The present invention relates to a thermal camera and a CCTV system using the thermal camera equipped with a thermal sensing function in an IP camera network environment. The thermal camera converts thermal images taken by the thermal camera into real-time streaming protocol (RTSP) packets in the IP camera network environment and transmits them to a storage device of the IP camera network environment with RTSP standard. The CCTV system monitors the image captured by the IP camera and the thermal image captured by the thermal camera together by using the thermal camera in the monitoring system and monitors temperature value according to situation through temperature analysis software installed in the thermal camera. Therefore, according to the present invention, the thermal camera can be easily configured at any time in the already established IP camera network environment, and cost, time and effort can be remarkably reduced because separate establishment of the thermal camera network environment is unnecessary.

Description

[0001] The present invention relates to a thermal camera equipped with a thermal sensing function in an IP camera network environment and a CCTV system using the thermal camera,

[0001] The present invention relates to a thermal camera equipped with a thermal sensing function in an IP camera network environment and a CCTV system using the thermal camera. More particularly, the present invention relates to a thermal camera, which converts a thermal image captured by a thermal camera in an IP camera network environment into an RTSP packet, Time streaming protocol of the IP camera network environment, and a thermal image captured by the IP camera and the thermal camera in the monitoring system using the thermal camera, The present invention relates to a CCTV system using a thermal camera equipped with a thermal sensing function in an IP camera network environment in which a thermal camera is equipped with a temperature analysis software and monitors a temperature value according to a situation.

The conventional IP camera network environment transmits images photographed by a plurality of IP cameras to a monitoring system through a storage device, as shown in FIG. 1 (a).

In addition, as shown in FIG. 1 (b), a conventional thermal image camera network environment transmits images photographed by a plurality of thermal cameras to a monitoring system through a storage device.

As described above, since the IP camera network environment and the thermal camera network environment are constructed in a binary manner, there is a problem that a thermal camera can not be configured in the IP camera network environment as shown in FIG.

Conventionally, IP cameras and thermal cameras are used in industries where fire, security, and surveillance are applied by utilizing advantages of IP cameras and advantages of thermal cameras.

As a typical technique, a surveillance system employing a thermal camera, which is Korean Patent Laid-Open Publication No. 10-2011-0114096, and a night surveillance method using the same, includes an optical camera for acquiring an optical image of a surveillance target area, An imaging unit including a thermal camera for acquiring a thermal image, an image processing unit for forming a single output image by formatting a nighttime optical thermal image acquired and stored in the daytime in the nighttime acquired in real time, and a display unit .

A first step of acquiring and storing an optical image of a region to be monitored by an optical camera during a day, a step of acquiring a thermal image of the region to be monitored by a thermal camera at night, Determining a reference image, formatting the thermal image and the reference image, and constructing and displaying one output image.

However, in the network environment in which the optical camera captures and transmits an optical image in the daytime, and a network environment in which the thermal camera captures and transmits the thermal image, There is a problem in that it requires a lot of cost, time and effort to construct two network environments.

Patent Document 1. Korean Patent Laid-Open Publication No. 10-2011-0114096 "Surveillance system employing a thermal image camera and nighttime monitoring method using the same"

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in view of the above problems, and it is an object of the present invention to provide a thermal camera in an IP camera network environment.

Another object of the present invention is to provide a thermal camera in an IP camera network environment so that the image captured by the IP camera and the thermal image captured by the thermal camera can be checked simultaneously or separately.

Another object of the present invention is to provide temperature analysis software in a thermal camera to generate an event such as an alarm or an alarm through a temperature value to prevent an accident.

According to an aspect of the present invention, there is provided a thermal camera equipped with a thermal sensing function in an IP camera network environment, including a photographing unit for photographing a real-time thermal image, a real- Streaming Protocol) standard, and a transmission unit for transmitting the RTSP packet according to the RTSP standard, and a thermal image conversion unit for converting the RTSP packet into an RTSP packet for transmission in accordance with the Streaming Protocol standard.

According to another exemplary embodiment of the present invention, a CCTV system using a thermal camera equipped with a thermal sensing function in an IP camera network environment includes at least one IP camera (not shown) for capturing an image in real time and transmitting the image in RTSP (Real-Time Streaming Protocol) A thermal image converter for converting the real-time thermal image into an RTSP packet to transmit the RTSP standard; and a thermal image converted by the RTSP packet to an RTSP standard And a storage unit for receiving and storing the image image and the thermal image converted by the RTSP packet, and a storage unit for storing the image image and the thermal image converted by the RTSP packet together or separately The monitoring system consists of a

As described above, the present invention has an effect of easily configuring a thermal camera at any time in an already established IP camera network environment, and there is no need to separately construct a thermal camera network environment, thereby reducing cost, time, and effort .

1 is a block diagram of a conventional IP camera network environment and a thermal camera network environment configuration diagram
FIG. 2 shows an example in which a thermal camera is not configured in a conventional IP camera network environment
3 is a schematic view of a thermal camera equipped with a thermal sensing function in an IP camera network environment according to an embodiment of the present invention
4 is a block diagram of a CCTV system using a thermal camera equipped with a thermal sensing function in an IP camera network environment according to another embodiment of the present invention
FIG. 5 is a diagram illustrating an image captured by an IP camera configured in an IP camera network environment and a thermal image captured by a thermal camera in accordance with another embodiment of the present invention

Best Mode for Carrying Out the Invention Hereinafter, a configuration and an operation of a preferred embodiment of the present invention will be described with reference to the accompanying drawings.

FIG. 3 is a schematic view of a thermal camera equipped with a thermal sensing function in an IP camera network environment according to an embodiment of the present invention. The thermal camera 10 equipped with a thermal sensing function in the IP camera network environment includes a photographing unit 11 A thermal image converting unit 12, and a transmitting unit 13.

It is also preferable that the thermal imaging camera 10 further includes a temperature analyzing unit 14 in the photographing unit 11, the thermal image converting unit 12, and the transferring unit 13.

The photographing unit 11 photographs a real-time thermal image.

The thermal image converting unit 12 converts the column image into a RTSP packet in order to transmit it in the IP camera network environment according to the RTSP (Real-Time Streaming Protocol) standard.

That is, since the thermal image captured by the thermal imaging camera and the image captured by the IP camera are different from each other in protocol, the thermal image converting unit 12 converts the generated image into a binary image in the IP camera network environment. RTSP packet to be transmitted in the RTSP standard.

- RTSP packet production example -

void CStreamer :: SendRtpPacket (char * Jpeg, int JpegLen, int nwidth, int nHeight)

#define KRtpHeaderSize 12 // size of the RTP header

#define KJpegHeaderSize 8 // size of the special JPEG payload header

char RtpBuf [60000];

sockaddr_in RecvAddr;

int RecvLen = sizeof (RecvAddr);

int RtpPacketSize = JpegLen + KRtHeaderSize + KJpegHeaderSize;

// get client address for UDP transport

getpeername (M_Client, (struct sockaddr *) & RecvAddr, &RecvLen);

RecvAddr.sin_family = AF_INET;

RecvAddr.sin_port = htons (m_RtpClientPort);

memset (RtpBuf, 0x00, sizeof (RtpBuf));

// Prepare the first 4 bytes of the packet. This is the Rtp header in case of TCP based transport

RtpBuf [0] = '$'; // magic number

RtpBuf [1] = 0; // number of multiplexed subchannels on RTPS connection - here the RTP channel

RtpBuf [2] = (RtpPacketSize & 0x0000FF00) >> 8;

RtpBuf [3] = (RtpPacketSize &0x000000FF);

// Prepare the 12 byte RTP header

RtpBuf [4] = 0x80; // RTP version

RtpBuf [5] = 0x9a; // JPEG payload (26) and marker bit

RtpBuf [7] = m_SequenceNumber &0x0FF; // each packet is counted with a sequence counter

RtpBuf [6] = m_SequenceNumber >> 8;

RtpBuf [8] = (m_Timestamp & 0xFF000000) >> 24; // each image gets a timestamp

RtpBuf [9] = (m_Timestamp & 0x00FF0000) >> 16;

RtpBuf [10] = (m_Timestamp & 0x0000FF00) >> 8;

RtpBuf [11] = (m_Timestamp &0x000000FF);

RtpBuf [12] = 0x13; // 4 byte sychronization source identifier (SSRC)

RtpBuf [13] = 0xf9; // we just an arbitrary number here to keep it simple

RtpBuf [14] = 0x7e

RtpBuf [15] = 0x67

// Prepare the 8 byte payload JPEG header

RtpBuf [16] = 0x00; // type specific

RtpBuf [17] = 0x00; // 3 byte fragmentation offset for fragmented images

RtpBuf [18] = 0x00;

RtpBuf [19] = 0x00;

RtpBuf [20] = 0x01; // type

RtpBuf [21] = 0x5e; // quality scale factor

RtpBuf [22] = nwidth / 8; // width / 8 -> 48 pixels

RtpBuf [23] = nHeight / 8;

// append the JPEG scan data to the RTP buffer

memcpy (& RtpBuf [24], Jpeg, JpegLen);

 // memcpy (& RtpBuf [24], Jpeg, JpegLen);

  m_SequenceNumber ++; // prepare the packet counter for the next packet

m-Timestamp + = 3600; // fixed timestmp increment for a frame rate of 25 fps

2, when the thermal image is converted by the RTSP packet, the RTSP standard is used in the IP camera network environment. In this case, .

The transmitting unit 13 transmits the image data converted by the RTSP packet in the RTSP standard in the IP camera network environment.

That is, the thermal camera 10 of the present invention is configured to transmit the thermal image in the RTSP standard so as to be transmitted as the image image transmitted in the IP camera network environment.

- RTSP transmission example -

DWORD CDlgLive :: LoopSuRTSP ()

{

SOCKET Client = m_CSoc;

char RecvBuf [10000]; // receiver buffer

int res;

CStreamer Streamer (Client); // our streamer for UDP / TCP based RTP transport

CRtspSession RtspSession (Client, &Streamer); // our threads RTSP session and state

int StreamID = 0; // the ID of the 2 JPEG samples streams which we support

HANDLE waitEvents [2]; // the waitable kernel objects of our session

HANDLE HTimer = :: CreatewaitableTimerA (NULL, fales, NULL);

WSAEVENT RtspReadEvent = WSACreateEvent (); // create READ wait event for our RTSP client socket

WSAEventSelect (Client, RtspReadEvent, FD_READ); // select socket read event

WaitEvents [0] = RtspReadEvent;

WaitEvent [1] = HTimer;

// set frame rate timer

double T = 40.0; // frame rate

int iT = T;

const __int64 DueTime = -static_cast <const _int64> (iT) * 10 * 1000;

:: SetWaitableTimer (HTimer, reinterpret_cast <const LARGE_INTEGER *>(& DueTime), iT, NULL, NULL, false);

bool StreamingStarted = false;

bool Stop = false;

while (! Stop)

{

  switch (WaitForMultipleObjects (2, WaitEvents, false, INFINITE))

  {

  case WAIT_OBJECT_0 + 0:

  {// read client socket

WSAResetEvent (WaitEvents [0]);

     memset (RecvBuf, 0x00, sizeof (RecvBuf));

res = recv (Client, RecvBuf, sizeof (RecvBuf), 0);

    // we filter away everything which is not an RTSP command: 0-ption, D-escribe, S-etup, P-lay, T-eardown

    (RecvBuf [0] == 'O') (RecvBuf [0] == 'D') (RecvBuf [0] == 'S') (RecvBuf [0] == 'P') (recvBuf [0] == 'T'))

    {

        RTSP_CMD_TYPES C = RtspSession, Handle_RtspRequest (RecvBuf, res);

        iF (C == RTSP_PLAY)

        {

            StreamingStarted = true;

        }

        else if (C == RTSP_TEARDOWN)

        {

             Stop = true;

             StreamingStarted = false;

        }

    };

    break;

;

As described above, the transmitting unit 13 transmits the thermal image converted by the RTSP packet in the IP camera network environment by transmitting the thermal image converted by the RTSP packet according to the RTSP standard.

Meanwhile, the temperature analyzer 14 generates a temperature value for the real-time photographed thermal image, and the generated temperature value is transmitted through the transmitter 13.

That is, the temperature analyzer 14 measures the real-time temperature value through the software when the software is installed, thereby generating an event for preventing an accident such as fire, crime, etc. in advance.

At this time, the temperature value is transmitted through the other one when any one of channel 1 and channel 2 of the transmitter 13 transmits a column image.

FIG. 4 is a block diagram of a CCTV system using a thermal camera equipped with a thermal sensing function in an IP camera network environment according to another embodiment of the present invention. In the IP camera network environment, a CCTV The system comprises at least one IP camera 100, at least one thermal camera 200, a storage device 300 and a monitoring system 400.

The at least one IP camera 100 photographs an image in real time in an IP camera network environment and transmits the real image in a Real-Time Streaming Protocol (RTSP) standard.

That is, the at least one IP camera 100 captures an image image in real time while the IP camera network is constructed, and the captured image image is transmitted to the storage device 300.

The at least one thermal camera 200 includes a photographing unit for photographing a real-time thermal image, a thermal image converting unit for converting the real-time photographed thermal image into an RTSP packet in order to transmit the RTSP standard in the IP camera network environment, And transmits the converted thermal image to the RTSP standard in the IP camera network environment.

The at least one thermal camera 200 further includes a temperature analyzer for generating a temperature value for the real-time thermal image, and the temperature value generated by the temperature analyzer is transmitted through the transmitter.

The at least one thermal camera 200 has been described in detail with reference to FIG. 3, and a detailed description thereof will be omitted.

For example, after at least one IP camera 100 is installed and at least one thermal camera 200 has a plurality of IP cameras installed in the IP camera network environment for monitoring the risk, A thermal image converting unit, a transmitting unit or a photographing unit, a thermal image converting unit, a transmitting unit, and a temperature analyzing unit in the IP camera network environment in order to solve the problem of re- At least one constructed thermal camera 200 is constructed so that the image image and the thermal image are transmitted together.

The storage device 300 receives and stores the image image and the thermal image converted by the RTSP packet.

For example, the storage device 300 stores the image data together with the image data as the thermal image is converted by the RTSP packet and transmitted in the RTSP format. The storage device 300 is preferably a network video recorder (NVR).

The monitoring system 400 monitors the image image and the thermal image converted by the RTSP packet together.

In addition, the monitoring system 400 receives the temperature value generated by the temperature analysis unit.

That is, the monitoring system 400 monitors the image image photographed by at least one IP camera 100 and the thermal image photographed by the at least one thermal image camera 200, or monitors only the thermal image or only the image image And it is preferable that a server, a terminal, a monitor, and the like are combined or combined.

For example, the monitoring system 400 can not identify that there is a person by light as an image image shown in (a) of FIG. 5, but (b) To be identifiable through thermal imaging.

At this time, a crime prevention event is generated through the temperature value analyzed by the temperature analysis unit of the thermal image of (b) shown in FIG. 5 to prevent a dangerous element in advance.

The at least one thermal camera 200 further includes a temperature analyzer for generating a temperature value for the real-time captured thermal image. When the temperature value is transmitted to the monitoring system 400, And generates data.

Accordingly, the present invention can be applied to various fields including fire, crime prevention and the like by configuring a thermal camera in a simple design in an IP camera network environment.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It is not used to limit the scope.

Therefore, it is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

10: Thermal image camera 11:
12: column image converting unit 13:
14: Temperature analysis section
100: at least one IP camera
200: at least one thermal camera
300: storage device 400: monitoring system

Claims (4)

delete delete At least one IP camera for capturing an image in real time and transmitting the real-time streaming protocol (RTSP) standard in an IP camera network environment;
A thermal image converter for converting the real-time thermal image into an RTSP packet to transmit the RTSP standard in the IP camera network environment, a thermal image converter for converting the thermal image converted by the RTSP packet into an IP camera network At least one thermal camera consisting of a transmission unit for transmitting the RTSP standard in the environment;
A storage unit for receiving and storing the image image and the thermal image converted by the RTSP packet; And
And a monitoring system for monitoring the image image and the thermal image converted by the RTSP packet together or individually. The CCTV system using the thermal camera equipped with the thermal sensing function in the IP camera network environment.
The method of claim 3,
Wherein the thermal camera further comprises a temperature analyzer for generating a temperature value for the real-time photographed thermal image, and generates event data such as fire and crime as the temperature value is transmitted to the monitoring system. CCTV system using thermal camera equipped with thermal sensing function in environment.

Images