KR101551374B1 - Fusion security system based on PIR sensor and IP network camera and method for controlling the same - Google Patents

Abstract

The present invention relates to a fusion security system based on a PIR sensor and an IP network camera, and a method for controlling the same. The fusion security system of the present invention comprises: a PIR sensor unit for detecting the difference in infrared light between the surrounding environment and an object which generates infrared light to detect a movement of the object; an IP network camera unit for acquiring image data to analyze the acquired image data, detect the moving object, and monitor whether the moving object has invaded or not; a communications unit for transmitting and receiving the data including the result of detection through the PIR sensor unit and the IP network camera unit; an alert unit for notifying the result of detection through the PIR sensor unit and the IP network camera unit to an operator or a user of the security system; and a control unit for controlling the operation of the PIR sensor unit, the IP network camera unit, the communications unit, and the alert unit.

Description

The present invention relates to a PIR sensor and an IP network camera based fusion security system and method.

The present invention relates to a PIR sensor and an IP network camera based convergence security system and method. More particularly, the present invention relates to a PIR sensor and an IP network camera based on the intrusion detection capability And a PIR sensor and IP network camera-based convergence security system and method that minimize malfunctions.

In addition to general CCTV, various security sensors are used in the security system. While CCTV-based video surveillance requires monitoring personnel, other security sensors have the advantage of building an automatic trespass detection system. Of the security sensors used to build the unauthorized trespass detection system, among them, pyroelectric infrared ray (PIR) based heat ray detectors are widely used because they are widely used.

However, such a PIR sensor is a sensor that uses a pyroelectric effect in which an electromotive force is generated due to a polarization change in a material when the infrared ray is absorbed, and detects a far-infrared ray difference between an object (human, animal, etc.) And it is possible to detect a motion of a person or an animal by using it. However, supersonic infrared-based motion sensors operate on the principle of detecting the difference from the ambient temperature. Therefore, when the object having the ambient temperature and temperature difference moves and approaches the sensor, the sensitivity is the best. However, There is a problem that sensitivity is drastically lowered when the temperature is sufficiently warmed. Therefore, in the case of summer, the ambient temperature becomes similar to that of the human body, so that malfunctions are more increased than in winter, and sensitivity is lowered even when using a shield which moves slowly or blocks heat. For example, when using an umbrella or a raincoat, the right and the umbrella block the heat from the human body, which causes a problem in the operation of the PIR sensor. In addition, there is a light of a band which can be detected by the PIR sensor in the sunlight, and there is a problem that the light is malfunctioning when sunlight comes in contact with the light.

The security system using the hot wire sensor according to the related art can not inform the trespass event through the network or provide the situation occurrence image or photo information, There is a problem.

Another alternative security system to compensate for this is an image analysis security system that detects motion by an image sensor and discriminates intrusion. However, this image-based motion detection detects a change in image brightness of a corresponding area and discriminates whether or not the object is intruded. In addition, even if an object of interest such as a person is not found, There is a problem that the malfunction rate is high due to an external change.

Korean Patent Publication No. 10-2003-0039193

SUMMARY OF THE INVENTION The present invention has been made to overcome the above-described problems of the related art, and it is an object of the present invention to provide a method and system for providing intrusion detection capability by integrating intrusion detection information acquired through a PIR sensor and image content analysis information acquired through an IP network camera And to provide a PIR sensor and IP network camera-based convergence security system that minimizes malfunctions.

Another object of the present invention is to provide a system and method for generating a security event when a trespass detection is detected in a corresponding surveillance area, and a security situation is generated in a personal terminal such as a smart phone, a PC, or a smart pad by FTP or MMS A PIR sensor and an IP network camera-based convergence security system in which an alarm message and an alarm can be transmitted to an arbitrary client on the Internet in real time.

According to an exemplary embodiment of the present invention, there is provided a PIR sensor device for detecting a movement of an object by detecting an infrared ray difference between an ambient environment and an object generating infrared rays; An IP network camera device for acquiring image data, analyzing the acquired image data to detect a moving object, and monitoring whether or not the moving object is intruded; A communication device for transmitting and receiving data including a result detected through the PIR sensor device and the IP network camera device; An alarm device for informing a security system operator or a user of a result sensed through the PIR sensor device and the IP network camera device; And a control device for controlling operations of the PIR sensor device, the IP network camera device, the communication device, and the alarm device, and an IP network camera-based convergence security system.

The PIR sensor device includes a PIR sensor unit for converting an incident infrared ray into a voltage to perform photo detection; A bracket unit configured to fix the PIR sensor unit to a ceiling or a wall surface and to adjust a horizontal angle and a vertical angle of the PIR sensor unit; A variable resistor unit for converting an infrared ray incident on the PIR sensor unit into a voltage and adjusting the magnitude of the voltage when the infrared ray is output; And a PIR sensor control unit for controlling the operation of the PIR sensor unit and the variable resistance unit.

And a Fresnel lens unit installed at a front end of the PIR sensor unit for focusing infrared rays on the PIR sensor unit.

The Fresnel lens unit uses a plurality of Fresnel lenses or a multiple Fresnel lens having a plurality of Fresnel lenses in one lens.

Wherein the IP network camera device comprises: a camera unit for acquiring an image of a detection object; An image analyzing unit for analyzing image data acquired by the camera unit to detect a moving object and monitoring whether or not the moving object is intruded; A networking unit for performing network communication of the IP network camera device; And a data compression unit for compressing the image data acquired by the camera unit.

Wherein the image analysis unit comprises: a background comparison unit for comparing an input image frame with a modeling background; Extracting foreground masks and extracting foreground masks to correct extracted foreground masks; A blob splitting section for splitting the foreground object; A moving object detection unit for detecting and removing projection shading and finally detecting a moving object region; And an object classifier for classifying the detected moving objects.

Wherein the control device comprises: a PIR sensor-based intrusion discrimination unit for determining whether or not it is an intrusion based on the detection result of the movement of the object transmitted from the PIR sensor device; An image analysis-based intrusion determination unit for classifying and determining whether a moving object detected based on image analysis contents transmitted from the IP network camera device corresponds to an intrusion; And an information fusion and intrusion discrimination unit for fusing the information of the PIR sensor-based intrusion discrimination unit and the image analysis-based intrusion discrimination unit and for determining intrusion based on the fused information.

According to another aspect of the present invention, there is provided a method comprising: operating a PIR sensor and an IP network camera-based convergence security system; Determining whether an IP network camera device has detected an intrusion of a moving object; Determining whether the PIR sensor device detects movement of the moving object when the IP network camera device detects intrusion of the moving object; Determining whether the difference between the detection time of the IP network camera device and the detection time of the PIR sensor device is within a predetermined time when the PIR sensor device detects movement of the moving object; And a step of notifying intrusion detection when it is determined that the intruder is actually intruded within a predetermined period of time as a result of the determination, and a control method of the IP network camera-based convergence security system.

In the step of determining whether the PIR sensor device senses the movement of the moving object, when the PIR sensor device can not detect the movement of the moving object, the information is fused through the existing object detection and the further implemented face detection step; And notifying a message requesting confirmation of the current situation.

Determining whether the PIR sensor device detects the movement of the moving object when the IP network camera device fails to detect the intrusion of the moving object in the step of determining whether the IP network camera device detects the intrusion of the moving object; If it is determined that the PIR sensor device does not detect the movement of the moving object, the IP network camera device returns to the step of determining whether the IP network camera device detected the intrusion of the moving object. If the PIR sensor device detects the movement of the moving object And a step of informing a message requesting confirmation of the current situation using the information detected by the existing PIR sensor.

According to the present invention, intrusion detection information acquired through a PIR sensor and image content analysis information acquired through an IP network camera are merged to monitor intrusion detection, thereby improving intrusion detection performance and minimizing malfunction .

In addition, when a trespass zone is detected in the monitoring area, a warning message is generated. By transmitting the corresponding situation image photograph and moving image to the personal terminal, the user can check the status information of the monitoring zone and monitor the image in real time.

1 is a schematic block diagram of a PIR sensor and IP network camera-based convergence security system according to an embodiment of the present invention.
2 is a schematic configuration diagram of a PIR sensor device.
3 is a diagram showing the sensing principle of the PIR sensor unit.
4 is a schematic configuration diagram of an IP network camera device.
5 is a schematic configuration diagram of an image analysis unit of an IP network camera apparatus.
6 is a schematic configuration diagram of the control device.
7 is a diagram showing an event alarm in an information fusion state.
8 is a flowchart illustrating an example of a security operation process using a PIR sensor and an IP network camera-based convergence security system according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram of a PIR sensor and IP network camera-based convergence security system according to an embodiment of the present invention.

1, a PIR sensor and IP network camera based convergence security system according to an embodiment of the present invention includes a PIR sensor device 100, an IP network camera device 200, a communication device 300, a data storage device 400 An alarm device 500, and a control device 700. [0033]

The PIR sensor device 100 senses the infrared ray difference between the surrounding environment and the object generating the infrared ray, detects the motion of the object, and transmits the detection result to the control device 700. [

The IP network camera apparatus 200 obtains image data, analyzes the acquired image data to detect a moving object, classifies and monitors whether or not the moving object is intruded, and transmits the monitoring result to the control apparatus 700.

The communication device 300 transmits various data including a monitoring result or sensing result of the PIR sensor device to a management server device (not shown) or a user terminal (not shown) according to a control signal of the control device 900, And receives data transmitted from the server device or the user terminal.

The data storage device 400 stores various data including the result data sensed through the IP network camera device 200 or the human body detection result data acquired through the PIR sensor device.

The alarm device 500 performs a function of informing the security system operator or the user of the detection result through the PIR sensor device 100 and the IP network camera device 200. A function of notifying the result of detection in various ways such as light through a lighting device or sound through a speaker, and other warning means other than a lighting device and a speaker can be used.

The control device 700 controls the operations of the PIR sensor device 100, the IP network camera device 200, the communication device 300, the data storage device 400, and the alarm device 500.

The PIR sensor device 100 may cause misdetection or undetected due to a problem that the sensitivity of the PIR sensor device 100 is suddenly lowered when the object is brought close to an ambient temperature sufficiently or the object is not detected when the object is shielded. The false detection is a case in which it is judged that a person has entered even though the person did not intrude, and the non-detection is a case in which an intrusion can not be detected even though the intrusion has occurred.

In order to compensate for this, in the present invention, a PIR sensor device and an IP network camera device are fused and used. Motion detection is performed using a PIR sensor device, and based on the motion detection result based on the image analysis contents of the IP network camera device, It is possible to complement the malfunction of the PIR sensor device or the malfunction of the IP network camera device, thereby improving the intrusion detection performance and minimizing the malfunction.

Fig. 2 is a schematic configuration diagram of the PIR sensor device, and Fig. 3 is a diagram showing the sensing principle of the PIR sensor unit.

2, the PIR sensor device 100 includes a bracket unit 110, a PIR sensor unit 120, a Fresnel lens unit 130, a variable resistance unit 140, and a PIR sensor control unit 150 do.

The bracket unit 110 is configured to fix the PIR sensor unit 120 to the ceiling or the wall and to adjust the horizontal angle and the vertical angle of the PIR sensor unit 120.

The PIR sensor unit 120 is a sensor using a pyroelectric effect that converts incident infrared rays into a voltage to enable photo detection. The PIR sensor unit is made of crystalline metal, and when heat is applied to the exposed area of the infrared, charge is generated on the surface. Sensors that use these sensitive characteristics are used to detect motion. Since the PIR sensor unit operates on the principle of detecting the difference from the ambient temperature, it is most sensitive when an object having an ambient temperature and temperature difference moves to approach the sensor (see FIG. 3).

The PIR sensor unit has various types according to the usage purpose, and it is divided into a three-dimensional shape, a planar shape, and a SPOT type according to the shape of the sensing area, and is classified into a short distance, a medium distance, and a long distance according to sensing distance. , And ceiling type. The stereoscopic type is used to detect a wide area where the horizontal sensing angle is more than 45 degrees. The surface type is used to detect a narrow area where the horizontal sensing angle is less than 20 degrees. The spot type is used to detect the 360 degrees It is used in the middle of a corridor in the shape of a cross, or in the middle of a room to detect 360 degrees.

The Fresnel lens unit 130 is installed at a front end of the PIR sensor unit 120 and functions to focus infrared rays (hot rays) on the PIR sensor unit.

One or a plurality of Fresnel lens units may be used, and in some cases, a multiple Fresnel lens having a plurality of Fresnel lenses in one lens is used.

The variable resistor unit 140 converts infrared rays incident on the PIR sensor unit 120 into a voltage and controls the magnitude of the voltage when the PIR sensor unit 120 outputs the voltage. ).

The PIR sensor control unit 150 performs a function of controlling the operation of the PIR sensor unit 120 and the variable resistance unit 140.

4 is a schematic configuration diagram of an IP network camera device.

4, the IP network camera device 200 includes a camera unit 210, an image analysis unit 220, a networking unit 230, a data compression unit 240, and a camera control unit 250.

The camera unit 210 performs a function of acquiring an image of the object to be detected. A CMOS image surveillance camera may be used to acquire images of the object to be detected, or a CCTV camera may be used. And a decoder unit for converting the acquired image data into digital data when the image is acquired using the CCTV camera.

The image analysis unit 220 analyzes the image data acquired by the camera unit 210 to detect a moving object, classifies and monitors whether or not the moving object is intruded, and transmits the monitoring result to the control device 700.

The networking unit 230 performs network communication of the IP network camera device 200.

The data compression unit 240 compresses the image data acquired by the camera unit 210.

5 is a schematic configuration diagram of an image analysis unit of an IP network camera apparatus. 5, the image analysis unit 220 includes a background comparison unit 221, a foreground mask extraction and correction unit 222, a blob splitting unit 223, a moving object detection unit 224, and an invasion classification unit 225 ).

The background comparing unit 221 performs a function of comparing the input image frame and the modeling background.

The foreground mask extraction and correction unit 222 performs a function of extracting the foreground mask and correcting the extracted foreground mask.

The blob dividing unit 223 divides the foreground object, and the moving object detecting unit detects and removes the projection shadow and finally detects the moving object region.

The object classifying unit 225 performs a function of classifying the detected moving objects.

FIG. 6 is a schematic configuration diagram of the control device, and FIG. 7 is a diagram showing an event alarm in the information fusion state.

6, the control device 700 includes a PIR sensor-based intrusion discrimination unit 710, an image analysis-based intrusion discrimination unit 730, an information fusion and intrusion discrimination unit 750.

The PIR sensor-based intrusion determination unit 710 performs a function of determining whether or not the intrusion based on the detection result of the movement of the object transmitted from the PIR sensor device 100 corresponds to an intrusion.

The image analysis-based intrusion determination unit 730 performs a function of classifying and determining whether or not the detected moving object corresponds to an intrusion based on the image analysis contents transmitted from the image analysis unit of the IP network camera device.

The information fusion and intrusion discrimination unit 750 performs a function of fusing information of the PIR sensor-based intrusion discrimination unit 710 and the image analysis-based intrusion discrimination unit 730 and judging whether or not the intruder is intruded based on the fused information .

8 is a flowchart illustrating an example of a security operation process using a PIR sensor and an IP network camera-based convergence security system according to the present invention.

Referring to FIG. 8, a process of operating a security system is performed (S110).

The IP network camera apparatus determines whether the IP network camera apparatus has detected the intrusion of the moving object (S120).

If the IP network camera device detects the intrusion of the moving object, it determines whether the PIR sensor device detects the movement of the moving object (S130).

In operation S140, when the PIR sensor device detects movement of the moving object, it is determined whether the difference between the detection time of the IP network camera device and the detection time of the PIR sensor device is within a predetermined time (S140).

As a result of the determination, when it is within a predetermined time, it is regarded that the intruder is actually intruded and the intrusion detection is notified (S150).

If the PIR sensor device fails to detect movement of the moving object in step S130, the process of merging information is performed through the existing object detection and the face recognition detection that is implemented (S160).

Then, a process of notifying a message requesting confirmation of the current situation is performed (S170).

In step S120, if the IP network camera device does not detect the intrusion of the moving object, it performs a process of determining whether the PIR sensor device detects the movement of the moving object (S180).

If the PIR sensor device does not detect movement of the moving object, the process returns to step 120. If the PIR sensor device detects movement of the moving object, the PIR sensor device detects the movement of the moving object, (Step S 190).

In the present embodiment, it is determined that the intrusion detection of the IP network camera device is first detected and then the intrusion detection of the PIR sensor device is determined. However, the intrusion detection determination order may be changed.

The above description is only an exemplary embodiment of the PIR sensor and IP network camera-based convergence security system and method according to the present invention, and the present invention is not limited to the above-described embodiments, It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

100: PIR sensor device
200: IP network camera device
300: communication device
400: Data storage device
500: Alarm device
700: Control device

Claims (10)

In a PIR sensor and IP network camera-based convergence security system,
A PIR sensor device for detecting a movement of an object by detecting an infrared ray difference between an ambient environment and an object generating infrared rays;
An IP network camera device for acquiring image data, analyzing the acquired image data to detect a moving object, and monitoring whether or not the moving object is intruded;
A communication device for transmitting and receiving data including a result detected through the PIR sensor device and the IP network camera device;
An alarm device for informing a security system operator or a user of a result sensed through the PIR sensor device and the IP network camera device; And
And a control device for controlling operations of the PIR sensor device, the IP network camera device, the communication device, and the alarm device,
The PIR sensor device includes:
A PIR sensor unit for converting an incident infrared ray into a voltage to perform photo detection; A bracket unit configured to fix the PIR sensor unit to a ceiling or a wall surface and to adjust a horizontal angle and a vertical angle of the PIR sensor unit; A variable resistor unit for converting an infrared ray incident on the PIR sensor unit into a voltage and adjusting the magnitude of the voltage when the infrared ray is output; And a PIR sensor control unit for controlling operations of the PIR sensor unit and the variable resistance unit.
delete The method according to claim 1,
And a Fresnel lens unit installed at a front end of the PIR sensor unit and focusing infrared rays on the PIR sensor unit.
The method of claim 3,
Wherein the Fresnel lens unit uses a plurality of Fresnel lens units or a multiple Fresnel lens having a plurality of Fresnel lenses in a single lens.
The method according to claim 1,
The IP network camera apparatus includes:
A camera unit for acquiring an image of a detection object;
An image analyzing unit for analyzing image data acquired by the camera unit to detect a moving object and monitoring whether or not the moving object is intruded;
A networking unit for performing network communication of the IP network camera device; And
And a data compression unit for compressing the image data acquired by the camera unit.
6. The method of claim 5,
Wherein the image analysis unit comprises:
A background comparing unit for comparing an input image frame with a modeling background;
Extracting foreground masks and extracting foreground masks to correct extracted foreground masks;
A blob splitting section for splitting the foreground object;
A moving object detection unit for detecting and removing projection shading and finally detecting a moving object region; And
And an object classifying unit for classifying the detected moving objects. The PIR sensor and the IP network camera based convergence security system according to claim 1,
The method according to claim 1,
The control device includes:
A PIR sensor-based intrusion discrimination unit for determining whether or not the movement of the object transmitted from the PIR sensor device corresponds to an intrusion based on the detection result;
An image analysis-based intrusion determination unit for classifying and determining whether a moving object detected based on image analysis contents transmitted from the IP network camera device corresponds to an intrusion; And
And an information fusion and intrusion discrimination unit for fusing the information of the PIR sensor-based intrusion discrimination unit and the image analysis-based intrusion discrimination unit and for determining intrusion based on the fused information. Camera based convergence security system.
A control method of a PIR sensor and an IP network camera-based convergence security system according to any one of claims 1, 3, 4, 5, 6, and 7,
Operating a PIR sensor and an IP network camera-based convergence security system;
Determining whether an IP network camera device has detected an intrusion of a moving object;
Determining whether the PIR sensor device detects movement of the moving object when the IP network camera device detects intrusion of the moving object;
Determining whether the difference between the detection time of the IP network camera device and the detection time of the PIR sensor device is within a predetermined time when the PIR sensor device detects movement of the moving object; And
And notifying the intrusion detection that the intruder is actually intruded if the determined result is within a predetermined time.
9. The method of claim 8,
In the step of determining whether the PIR sensor device senses the movement of the moving object, when the PIR sensor device can not detect the movement of the moving object, the information is fused through the existing object detection and the further implemented face detection step; And
Further comprising the step of notifying a message requesting confirmation of the current status of the PIR sensor and the IP network camera.
9. The method of claim 8,
Determining whether the PIR sensor device detects the movement of the moving object when the IP network camera device fails to detect the intrusion of the moving object in the step of determining whether the IP network camera device detects the intrusion of the moving object;
If it is determined that the PIR sensor device does not detect the movement of the moving object, the IP network camera device returns to the step of determining whether the IP network camera device detected the intrusion of the moving object. If the PIR sensor device detects the movement of the moving object Further comprising the step of notifying a message requesting confirmation of the current situation using the information detected by the existing PIR sensor. ≪ RTI ID = 0.0 > 8. < / RTI >

Images