KR101290782B1 - System and method for Multiple PTZ Camera Control Based on Intelligent Multi-Object Tracking Algorithm - Google Patents

Abstract

The present invention relates to a system and method for controlling multiple PTZ cameras based on an intelligent multiple object tracking algorithm. According to an aspect of the present invention, a method for controlling a multiple PTZ camera is fixed or mobile. Calculating and transmitting the corresponding location information using the sensor network module, and calculating and controlling a control value for each PTZ camera module for capturing one or more security objects in the central processing module that receives the location information. Remotely controlling each PTZ camera module on the network by transmitting through the module, and tracking and shooting the security target object with the PTZ camera module according to the location information, one or more security targets of the plurality of PTZ camera modules Select each PTZ camera module closest to the object To track and capture the security target object, or the PTZ surveillance camera module tracks the security object with the highest priority among the plurality of security target objects according to the priority of the preset security target object for each PTZ surveillance camera module. It is characterized by.

Description

System and method for Multiple PTZ Camera Control Based on Intelligent Multi-Object Tracking Algorithm}

The present invention relates to a system and method for controlling multiple PTZ surveillance cameras based on an intelligent multi-object tracking algorithm. More particularly, the present invention relates to a fixed or moving object of interest in real time. It is possible to grasp the specific situation of the object of interest by shooting from various angles without missing the object of interest within the shooting range.Effective automatic tracking by controlling multiple PTZ surveillance cameras by Pan / Tilt / Zoom motion even when the object of interest moves in real time. The present invention relates to a PTZ camera control system and method capable of photographing.

The main application technologies of the multi PTZ camera control system are the wireless sensor network based position calculation technology to obtain the position coordinates of the object of interest, the PTZ surveillance camera technology capable of controlling the movement of the front / rear left / right zoom in / out, PTZ There are video storage technology that can save the captured video with surveillance camera, and monitoring technology that can output captured video. There is an object tracking technique.

For example, as terrorism and violent crimes have increased, security awareness has been strengthened, and the installation of video security systems has been increasing in public institutions. The representative technology of the video security system is Closed Circuit Television (CCTV) technology. CCTV was installed in the main surveillance area, and the management center had to monitor at all times in the control center and fixed surveillance cameras were used.

An image security system based on the video technology has been improved. Video security technology based on general video technology is a method of detecting and tracking an object of interest by analyzing the captured video information. However, video technology based on video technology requires expensive hardware equipment because a large amount of video information has to be calculated. In addition, if the object of interest is out of or out of the field of view (FOV), tracking problems are impossible.

Therefore, in order to solve such a problem, by applying a wireless sensor network (WSN) based position calculation technology, even if the object of interest is out of or out of the shooting range it can effectively track the image of the object of interest.

However, a typical PTZ surveillance camera has an effective shooting distance of 20 m or less. Therefore, if it is out of the effective shooting distance, it is difficult to accurately analyze the captured video. Also, when a plurality of objects of interest are to be photographed using a plurality of PTZ surveillance cameras, there is a problem in that the PTZ surveillance cameras must be efficiently controlled according to the distance between the objects of interest and the PTZ surveillance cameras.

In particular, when shooting a plurality of objects moving in real time using a plurality of PTZ surveillance cameras, according to the distance between each object of interest and the PTZ surveillance camera, a plurality of PTZ surveillance cameras are linked to select an object of interest. Without tracking, there is a problem that it is difficult to obtain valid image information according to the movement of the object of interest. In addition, when photographing an object of interest with a specific fixed security camera, intelligent disturbances such as intentionally turning the face or covering the camera frequently occur so that useful information is not captured by the camera. Therefore, if there is a method of intensively tracking and tracking a moving object of interest by linking a plurality of cameras in various directions, useful image information captured from various angles may be acquired.

Accordingly, the present invention is to solve the above-described problems, an object of the present invention, it is possible to shoot a single or a plurality of objects of interest within the effective shooting distance, the image of the object of interest from various angles by shooting from various angles It is to provide multiple PTZ camera control system and intelligent surveillance method that can get comprehensive information and make situation judgment.

First, to summarize the features of the present invention, PTZ camera control method according to an aspect of the present invention, the fixed or mobile using the respective wireless sensor network module attached or installed on one or more security target object to calculate and transmit the corresponding location information Making; And calculating and controlling a control value (eg, a value for controlling a Pan, Tilt, or Zoom state) for each PTZ camera module for capturing at least one security object in the central processing module that receives the location information. Remotely controlling each PTZ camera module on the network by transmitting through the module, and tracking and shooting the security target object with the PTZ camera module according to the location information, one or more security targets of the plurality of PTZ camera modules Select the PTZ camera module closest to the object to track and capture the security object, or secure the highest priority among multiple security objects according to the priority of interest of the preset security object by PTZ camera module. Characterized in that the target PTZ surveillance camera module for tracking the target object. The tracking imaging may be performed according to a control signal or periodically.

In the controlling step, when one PTZ surveillance camera module for one security target object is installed, a control value of one PTZ surveillance camera module for tracking and capturing one security target object may be calculated. (Scenario 1).

In the controlling step, when a plurality of PTZ surveillance camera module for one security target object is installed, a PTZ surveillance camera located closest to the PTZ surveillance camera module for tracking and capturing one security target object The control value of the module can be calculated (scenario 2).

In the controlling step, when one PTZ surveillance camera module for a plurality of security target objects is installed, after calculating control values of one PTZ surveillance camera module for sequentially photographing a plurality of security target objects, The control value of the PTZ surveillance camera module for tracking and photographing the object having the highest importance may be calculated according to the priority of interest of the plurality of security target objects set in advance (scenario 3).

In the controlling step, when a plurality of PTZ surveillance camera modules for a plurality of security target objects are installed, a control value of each PTZ surveillance camera module located closest to each of the plurality of security target objects is calculated, and the PTZ surveillance camera is calculated. Control value of each PTZ surveillance camera module for each PTZ surveillance camera module to track and capture the most important object corresponding to the module according to the priority of interest among the plurality of security target objects preset by module Can be calculated (Scenario 4).

And, according to another aspect of the invention, a PTZ camera control system, at least one PTZ camera module; Fixed or mobile Each wireless sensor network module attached to or installed on at least one security object and calculating and transmitting corresponding location information; And a central processing module for remotely controlling the PTZ camera module on a network by receiving the position information, calculating a control value for the PTZ camera module for capturing at least one security object, and transmitting the control value through the control module. Including, and tracking and shooting the security target object with the PTZ camera module according to the location information, by selecting each PTZ camera module closest to the at least one security target object of the plurality of PTZ camera module to track the security target object Alternatively, the PTZ surveillance camera module may track and capture the security target object having the highest priority among the plurality of security target objects according to the priority of interest of the security target objects preset for each PTZ surveillance camera module.

According to the multiple PTZ camera control system and method according to the present invention, by combining the PTZ surveillance camera and wireless sensor network technology to obtain image information of various angles within the effective shooting distance, theft, loss, It can be protected from damage such as damage and can be managed efficiently. It is applied to video security system such as CCTV that is currently being installed and operated in domestic and foreign government offices and offices, so that it is possible to efficiently manage the assets or equipment to be secured.

1 is a block diagram of a multiple PTZ camera control system based on an intelligent multi-object tracking algorithm according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining a detailed function configuration unit for each module of the multiple PTZ camera control system of the present invention.
3 is a flowchart illustrating the operation of the intelligent multi-object tracking algorithm of the multiple PTZ camera control system of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

1 is a block diagram of a multiple PTZ camera control system based on an intelligent multi-object tracking algorithm according to an embodiment of the present invention. FIG. 2 is a diagram for explaining a detailed function configuration unit for each module of the multiple PTZ camera control system of the present invention.

1 and 2, the multiple PTZ camera control system according to an embodiment of the present invention, the PTZ camera module 10, the PTZ camera control module 20, the database module that can be linked through a network, such as the Internet ( 30), monitoring module 40, wireless sensor network module 50, and central processing module 60.

The PTZ camera module 10 may be installed at one or more locations where security target objects such as major assets or equipment that need to be managed may be photographed, and the wireless sensor network module 50 may be secured such as major assets or equipment that need to be managed. Attached to or installed in the object to calculate the location to transmit the location information (eg, three-dimensional position coordinates) to the central processing module 60.

The wireless sensor network module 50 uses a wireless communication unit 52 for receiving a radio frequency (RF) signal received from a fixed node (s) installed at a predetermined position, using a strength or a speed of the received RF signal, and the like. And a position calculation unit 56 for calculating a position based on a surveying method, etc., and in addition, a sensor unit for detecting whether there is a moving object or the like around the corresponding position using an infrared sensor or an ultrasonic sensor, etc. 54). In this way, the movable wireless sensor network module 50 transmits the position information (eg, three-dimensional position coordinates) calculated by the corresponding position or motion information detected by the sensor unit 54 to the central processing module 60. do.

Accordingly, in the central processing module 60, the wireless sensor network data processing unit 62 receives location information (eg, three-dimensional position coordinates) and the like of the security target object (s), and the multi-object tracking algorithm processing unit 64. Calculates a control value of the PTZ camera module 10 (e.g., a value for controlling a Pan, Tilt, or Zoom (In / Out) state) so that useful image information can be obtained using the same, and accordingly PTZ camera data The processor 66 transmits the control value (eg, Pan / Tilt / Zoom information) to the PTZ camera control module 20 according to a predetermined communication method. The PTZ camera control module 20 controls the operation of the PTZ camera module 10 remotely through a network such as the Internet so as to capture an image in a corresponding direction. As described above, the image information captured by the PTZ camera module 10 may be stored in a database module 30 at a remote location through a network such as the Internet, and a display unit such as an LCD of the monitoring module 40 installed at a remote location via a network such as the Internet. This allows managers or stakeholders to monitor the real-time status of their key assets or equipment.

Hereinafter, the intelligent multi-object tracking algorithm operation of the multi-object tracking algorithm processing unit 64 of the multi-PTZ camera control system of the present invention will be described in more detail with reference to the flowchart of FIG. 3.

There are four scenarios (100, 200, 300, and 400) that can occur in the multi-object tracking algorithm.

Scenario 1

The first situation 100 is a case where there is one security target object of interest and one PTZ surveillance camera module 10 for capturing and monitoring the object. In this case, the wireless sensor network module 50 transmits the corresponding object. Control value (eg Pan / Tilt / Zoom information) of the PTZ camera module 10 for tracking the object based on the location information (eg, 3D position coordinates) of the security target object to continue shooting in the corresponding direction. ) Can be calculated. This may be performed according to the control signal or periodically (eg, hourly, daily, etc.) when the motion is determined according to the motion information transmitted by the wireless sensor network module 50. Tracking of an object may be performed in such a manner that the center of the object is located at the center of the screen using predetermined contour information of the corresponding security target object (eg, fixed or movable equipment) based on the location information. have.

<Scenario 2>

The second situation 200 is a case where there is one security target object of interest, and a plurality of PTZ surveillance camera modules 10 are installed at various locations for capturing and monitoring them from various angles. In this case, the wireless sensor network module Based on the position information (eg, 3D position coordinates) of the corresponding security target object transmitted by the 50, the PTZ surveillance camera module 10 located closest to the clear image information can be obtained in consideration of the effective shooting distance. A control value (eg, Pan / Tilt / Zoom information) of the PTZ camera module 10 may be calculated to track the object and continue shooting in the corresponding direction. This is performed according to the control signal or periodically (eg, when the plurality of PTZ camera modules 10 determine the movement according to the movement information transmitted by the wireless sensor network module 50 while recording at each location thereof. Hourly, daily, etc.).

Scenario 3

The third situation 300 is a case where a plurality of security target objects of interest exist in several places, and one PTZ surveillance camera module 10 for photographing and monitoring the same is installed. In this case, the wireless sensor network module 50 is installed. Based on the location information (eg, three-dimensional position coordinates) of the corresponding security target objects transmitted by), first track and photograph each object sequentially, and then periodically or periodically according to a predetermined control signal (eg, when determining movement). According to the priorities of the security targets set in advance (eg, hourly, daily, etc.), the PTZ camera module 10 selectively tracks the objects having the highest priority (priority) and continues along the direction. A control value (eg, Pan / Tilt / Zoom information) of the PTZ camera module 10 for capturing the image may be calculated.

Scenario 4

The fourth situation 400 is a case in which a plurality of security target objects of interest exist in a plurality of places, and a plurality of PTZ surveillance camera modules 10 are also installed in a plurality of places in order to capture and monitor them from various angles. Based on the location information (eg, three-dimensional position coordinates) of the corresponding security target objects transmitted by the sensor network module 50, the PTZ surveillance camera located closest to each object to obtain clear image information in consideration of the effective shooting distance. The module 10 calculates a control value (e.g., Pan / Tilt / Zoom information) of the PTZ camera module 10 for tracking the object to continue shooting in the corresponding direction, and a predetermined control signal (e.g., motion). , Etc.) or periodically (e.g. hourly, daily, etc.), according to the priority of interest among preset security target objects by PTZ surveillance camera module. D) The module 10 calculates control values (eg, Pan / Tilt / Zoom information) of the PTZ camera modules for selectively tracking the most important object corresponding to the module to continue shooting in the corresponding direction. can do. Accordingly, multiple objects can be selectively tracked and photographed.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

10: PTZ Camera Module
20: PTZ camera control module
30: DB module
40: monitoring module
50: wireless sensor network module
52: wireless communication unit
54: sensor
56: position calculation unit
60: central processing module
62: wireless sensor network data processing unit
64: multi-object tracking algorithm processing unit
66: PTZ camera data processing unit

Claims (8)

Transmitting location information and information on the presence or absence of moving objects around each other by using each wireless sensor network module attached or installed to one or more security target objects including fixed or mobile equipment; And
Control value for each PTZ camera module for tracking and capturing the security target object based on the position information when the central processing module determines the movement existence periodically or according to the information on the presence or absence of the moving object in the vicinity Calculating and transmitting through the control module to remotely control each PTZ camera module on the network;
Wherein the controlling comprises:
Calculating a control value of the PTZ camera module when one PTZ camera module for tracking and capturing one security target object is installed;
Calculating a control value of a PTZ camera module closest to the one security target object among the plurality of PTZ camera modules when a plurality of PTZ camera modules for tracking and capturing one security target object are installed;
When one PTZ camera module for tracking and photographing a plurality of security target objects is installed, the control value of the PTZ camera module for sequentially photographing the plurality of security target objects is calculated, and then the preset Calculating a control value of a corresponding PTZ camera module for tracking and photographing a corresponding object having the highest priority according to the priority of interest of the plurality of security target objects; And
When a plurality of PTZ camera modules for tracking and capturing a plurality of security target objects are installed, a control value of each PTZ camera module located closest to each of the plurality of security target objects is calculated, and preset for each PTZ camera module. Calculating, by each PTZ camera module, a control value of each PTZ camera module for tracking and photographing the object having the highest priority corresponding to the module according to the priority of interest among the plurality of security target objects.
PTZ camera control method comprising a. delete delete delete delete delete The method of claim 1,
The control value is a PTZ camera control method, characterized in that the value for controlling the Pan, Tilt, or Zoom status of the PTZ camera module. One or more PTZ camera modules;
A wireless sensor network module attached to or installed on at least one security target object including fixed or movable equipment and transmitting information about the location information and the presence or absence of a moving object in the vicinity; And
When determining the presence of the movement periodically or according to the information about the presence or absence of the moving object, the control value for each PTZ camera module for capturing the security object based on the position information is calculated and the control module is calculated. A central processing module for remotely controlling each PTZ camera module on the network by transmitting through
The central processing module,
When one PTZ camera module is installed to track and capture one security target object, the control value of the PTZ camera module is calculated.
When a plurality of PTZ camera modules for tracking and capturing one security target object are installed, a control value of the PTZ camera module closest to the one security target object among the plurality of PTZ camera modules is calculated,
When one PTZ camera module for tracking and photographing a plurality of security target objects is installed, the control value of the PTZ camera module for sequentially photographing the plurality of security target objects is calculated, and then the preset The control value of the PTZ camera module for tracking and photographing the object having the highest priority according to the priority of interest of the plurality of security target objects is calculated.
When a plurality of PTZ camera modules for tracking and capturing a plurality of security target objects are installed, a control value of each PTZ camera module located closest to each of the plurality of security target objects is calculated, and preset for each PTZ camera module. The PTZ camera module calculates a control value of each PTZ camera module for tracking and photographing the object having the highest priority corresponding to the module according to the priority of interest among the corresponding plurality of security target objects. PTZ camera control system.

Images