JP2022129652A - Surveillance system and method of controlling surveillance system - Google Patents

Abstract

To provide a technique for reducing costs such as a software repair cost, etc. occurring when a centering position is deviated, and preventing occurrence of bugs caused by software repair.SOLUTION: A monitoring system includes a monitoring camera, a monitoring system server, and a monitoring terminal device. The monitoring system server moves the monitoring camera to a position registered at an initial setting time when a deviation detection operation is performed, compares an image captured by the monitoring camera with an image captured by the monitoring camera at the initial setting time, and determines that calibration is necessary when a deviation between the image captured by the monitoring camera and the image captured by the monitoring camera at the initial setting time exceeds a threshold value. At the initial setting time, the monitoring system server moves the monitoring camera to a position indicated by a monitoring terminal device, registers the position indicated by the monitoring terminal device, and registers the image captured by the monitoring camera.SELECTED DRAWING: Figure 1

Description

The present invention relates to a monitoring system and a control method for the monitoring system.

Screen centering technology in a surveillance system is to display an image captured by a surveillance camera on the monitoring screen of a surveillance terminal device such as a personal computer, and allow the user to specify an arbitrary position on the monitoring screen by clicking, for example, with a mouse. In this technology, the surveillance system server sends a control command to the pan/tilt mechanism of the surveillance camera to control the direction of the surveillance camera so that the position specified by clicking , is automatically centered on the monitoring screen.

In screen centering technology, the amount of control of the pan/tilt mechanism is calculated by using a calculation formula dedicated to screen centering that applies control parameters unique to surveillance cameras. In screen centering technology, the position specified by clicking may deviate from the center of the monitoring screen after screen centering due to deterioration of the pan/tilt mechanism of the surveillance camera. For example, due to deterioration of the motor of the pan/tilt mechanism, the amount of control given to the pan/tilt mechanism may deviate from the actual amount of movement of the pan/tilt mechanism.

In Patent Document 1, a reference image obtained by photographing a predetermined location with a camera and an edge of a target image obtained by photographing the same location as the reference image with a camera after the reference image is photographed are extracted, and the edges of the reference image are extracted using the edge-extracted image. It is described that the amount of image deviation is calculated and the angle of view deviation of the target image is corrected.

JP 2016-134636 A

With conventional screen centering technology, an engineer with specialized knowledge needs to rewrite the control parameters each time the centering position shifts, which has the problem of incurring costs such as software repair costs. There is also the problem of the possibility of bugs occurring due to software modifications.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a technique for reducing costs such as software modification costs that occur when the centering position is shifted, and for preventing the occurrence of bugs caused by software modification.

In order to solve the above problems, one representative monitoring system of the present invention includes a monitoring camera, a monitoring system server, and a monitoring terminal device. Then, the surveillance system server moves the surveillance camera to the position registered at the time of the initial setting, and compares the image taken by the surveillance camera with the image taken by the surveillance camera at the time of the initial setting. It is determined that calibration is necessary when the deviation between the captured image and the image captured by the surveillance camera at the time of initial setting exceeds a threshold.

According to the present invention, it is possible to reduce costs such as software modification costs that occur when the centering position shifts, and to prevent bugs from occurring due to software modification.

Problems, configurations, and effects other than those described above will be clarified by the description in the following detailed description of the invention.

It is a figure which shows the structure of the monitoring system which concerns on embodiment. 8 is a flowchart showing processing during initial setting of the monitoring system server according to the embodiment; 9 is a flow chart showing processing during deviation detection operation of the monitoring system server according to the embodiment. FIG. 4 is a diagram schematically showing an image captured by a surveillance camera during initial setting; FIG. 10 is a diagram schematically showing an image captured by a surveillance camera during a deviation detection operation; FIG. 11 is a diagram schematically showing an image captured by a surveillance camera during a deviation detection operation in a modified example;

Hereinafter, embodiments of the present invention will be described with reference to the drawings. It should be noted that the present invention is not limited by this embodiment. Moreover, in the description of the drawings, the same parts are denoted by the same reference numerals.

A configuration of a monitoring system according to an embodiment will be described with reference to FIG. FIG. 1 is a diagram showing the configuration of a monitoring system according to an embodiment.

The monitoring system comprises a monitoring camera 101 , a network 102 , a monitoring system server 103 and a monitoring terminal device 104 .

The monitoring camera 101 can transmit captured images to the monitoring terminal device 104 . The monitoring camera 101 can also transmit captured images to the monitoring system server 103 .

The network 102 can transmit information among the surveillance camera 101 , surveillance system server 103 and surveillance terminal device 104 .

The monitoring system server 103 can compare the image captured by the monitoring camera 101 during the deviation detection operation with the image captured by the monitoring camera 101 during initial setting to determine whether calibration is necessary.

The monitoring terminal device 104 can display images received from the monitoring camera 101 .

The monitoring system server 103 includes a control command reception unit 105, a camera control unit 106, an image reception unit 107, a preset position registration unit 108, a threshold registration unit 109, an image registration unit 110, a cycle registration unit 111, An image comparison unit 112 , a deviation detection unit 113 , and a calibration necessity determination unit 114 are provided.

The control command receiving unit 105 can receive control commands transmitted by the monitoring terminal device 104 .

A camera control unit 106 can control the surveillance camera 101 .

The image receiving unit 107 can receive images transmitted by the monitoring camera 101 .

The preset position registration unit 108 can register a preset position for detecting deviation of screen centering. Preset positions may include pan, tilt, focus and zoom information.

The threshold registration unit 109 can register a threshold for detecting screen centering deviation.

The image registration unit 110 can register an image captured by the monitoring camera 101 at a preset position during initial setting.

The cycle registration unit 111 can register the time and cycle for detecting deviation of screen centering.

The image comparison unit 112 can compare the image captured by the monitoring camera 101 at the preset position during the deviation detection operation with the image captured by the monitoring camera 101 at the preset position during the initial setting.

The deviation detection unit 113 can detect a deviation between an image captured by the monitoring camera 101 at the preset position during the deviation detection operation and an image captured by the monitoring camera 101 at the preset position during the initial setting.

The calibration necessity determining unit 114 can determine whether calibration of control parameters for screen centering is necessary.

The monitoring terminal device 104 includes an image display section 115 and a control command transmission section 116 .

The image display unit 115 can display an image received from the surveillance camera 101 .

The control command transmission unit 116 can transmit control commands to the monitoring system server 103 .

With reference to FIG. 2 , processing during initial setting of the monitoring system server 103 according to the embodiment will be described. FIG. 2 is a flowchart showing processing during initial setting of the monitoring system server 103 according to the embodiment.

At step 201 , the control command receiving unit 105 receives a control command instructing movement of the monitoring camera 101 from the monitoring terminal device 104 .

At step 202 , the camera control unit 106 moves the monitoring camera 101 based on the control command received from the monitoring terminal device 104 .

In step 203, the preset position registration unit 108 registers the position of the monitoring camera 101 as a preset position for detecting deviation of screen centering. The determination of the preset position may be instructed from the monitoring terminal device 104 by the user.

In step 204, the threshold registration unit 109 registers a threshold for detecting deviation of screen centering. The threshold may be input from the monitoring terminal device 104 by the user.

At step 205, the image registration unit 110 registers the image captured by the monitoring camera 101 at the preset position.

In step 206, the cycle registration unit 111 registers the time and cycle for detecting deviation of screen centering. The user may input the time and period from the monitoring terminal device 104 .

Referring to FIG. 3, the processing during the deviation detection operation of the monitoring system server 103 according to the embodiment will be described. FIG. 3 is a flow chart showing processing during deviation detection operation of the monitoring system server 103 according to the embodiment. The monitoring system server 103 starts the process when the time and the period for detecting the deviation of the screen centering are reached.

At step 301, the camera control unit 106 moves the monitoring camera 101 to the preset position.

In step 302, the image comparison unit 112 compares the image captured by the monitoring camera 101 at the preset position with the image captured by the monitoring camera 101 at the preset position during the initial setting.

In step 303, the deviation detection unit 113 detects a deviation between the image captured by the monitoring camera 101 at the preset position and the image captured by the monitoring camera 101 at the preset position during the initial setting.

In step 304, the calibration necessity determining unit 114 determines whether calibration of the control parameters for screen centering is necessary. The calibration necessity determination unit 114 determines that calibration is necessary when the difference between the image captured by the monitoring camera 101 at the preset position and the image captured by the monitoring camera 101 at the time of initial setting exceeds a threshold. Then, the process proceeds to step 305, and if the difference between the image captured by the monitoring camera 101 at the preset position and the image captured by the monitoring camera 101 at the time of initial setting does not exceed the threshold, it is determined that calibration is unnecessary. End the process.

At step 305 , the monitoring system server 103 performs calibration based on the amount of deviation detected by the deviation detection section 113 .

Image registration at the time of initial setting will be described with reference to FIG. FIG. 4 is a diagram schematically showing an image captured by surveillance camera 101 at the time of initial setting. FIG. 4 shows a “predetermined region” represented by a hatched circle at the center (horizontal W/2, vertical H/2) of an image of width W and height H captured by the monitoring camera 101; It indicates that a "region obtained by expanding a predetermined region by a threshold value" represented by a dotted circle is set.

The "predetermined area" is an area used for comparison between the image captured by the monitoring camera 101 during the deviation detection operation and the image captured by the monitoring camera 101 during the initial setting, so it has a size that allows the deviation to be detected. There is a need. In addition, the "area obtained by extending a predetermined area by a threshold value" must be an area in which an object that does not change over time is photographed. Objects that do not change with the passage of time are suitable for fixed buildings and facilities that are present in the monitoring target.

The user operates the monitoring terminal device 104 to move the monitoring camera 101, and instructs determination of a preset position in accordance with a subject that does not change over time at the center of the image captured by the monitoring camera 101. - 特許庁The monitoring terminal device 104 may display an image captured by the monitoring camera 101 by superimposing a circle indicating "an area obtained by extending a predetermined area by a threshold value". The image registration unit 110 registers "the area obtained by extending the predetermined area by the threshold value" as the image captured by the monitoring camera 101 at the preset position.

Image comparison during the shift detection operation will be described with reference to FIG. FIG. 5 is a diagram schematically showing an image captured by the surveillance camera 101 during the deviation detection operation. In FIG. 5, a "predetermined area" represented by a hatched circle is set at the center (horizontal W/2, vertical H/2) of an image of width W and height H captured by the surveillance camera 101. indicates that The “predetermined region” at the time of initial setting and the “region obtained by extending the predetermined region by a threshold value” are located in the upper right direction of the center of the image, and the center of the image captured by the monitoring camera 101 during the deviation detection operation and the initial setting It sometimes indicates that the center of the image captured by the monitoring camera 101 is out of alignment.

The image comparison unit 112 compares the “predetermined region” during the shift detection operation with the “region obtained by extending the predetermined region by the threshold value” during the initial setting. As shown in FIG. 5, when the “predetermined region” during the deviation detection operation is not included in the “region obtained by extending the predetermined region by the threshold value” during the initial setting, the deviation detection unit 113 detects that the surveillance camera is It is detected that the difference between the photographed image and the image photographed by the surveillance camera at the time of initial setting exceeds a threshold. On the other hand, if the “predetermined region” during the deviation detection operation is included in the “region obtained by extending the predetermined region by the threshold value” during the initialization, the deviation detection unit 113 detects the image captured by the surveillance camera during the deviation detection operation. , it is not detected that the deviation from the image captured by the surveillance camera at the time of initial setting exceeds the threshold.

(Modification)
In the above-described image registration/image comparison, at the time of initial setting, "a predetermined area expanded by a threshold value" is registered as an image captured by the monitoring camera 101 at a preset position. The “predetermined region” was compared with the “region obtained by expanding the predetermined region by the threshold value” at the time of initial setting. In the image registration/image comparison in this modified example, the "predetermined area" is registered as an image captured by the monitoring camera 101 at the preset position at the time of initial setting, and the "predetermined area" at the time of the deviation detection operation is registered. The "area expanded by the threshold value" is compared with the "predetermined area" at the time of initialization.

The image registration at the time of initial setting is the same as the image registration at the time of initial setting described above, except that the image registration unit 110 registers the "predetermined area" as an image captured by the monitoring camera 101 at the preset position. be.

Referring to FIG. 6, image comparison during the shift detection operation in this modified example will be described. FIG. 6 is a diagram schematically showing an image captured by the monitoring camera 101 during the deviation detection operation in this modified example. FIG. 6 shows a “predetermined area” represented by a hatched circle at the center (horizontal W/2, vertical H/2) of an image of width W and height H captured by the monitoring camera 101, It indicates that a "region obtained by expanding a predetermined region by a threshold value" represented by a dotted circle is set. The "predetermined area" at the time of initial setting is located in the upper right direction of the center of the image, and the center of the image captured by the monitoring camera 101 during the deviation detection operation is deviated from the center of the image captured by the monitoring camera 101 at the time of initial setting. indicates that

The image comparison unit 112 compares the “predetermined region expanded by the threshold value” during the shift detection operation with the “predetermined region” during the initial setting. As shown in FIG. 6, when the "predetermined region expanded by the threshold value" during the shift detection operation does not include the "predetermined region" at the time of initial setting, the shift detection unit 113 detects that the surveillance camera is It is detected that the difference between the photographed image and the image photographed by the surveillance camera at the time of initial setting exceeds a threshold. On the other hand, if the “predetermined region expanded by the threshold value” during the shift detection operation includes the “predetermined region” at the time of initial setting, the shift detection unit 113 detects the image captured by the surveillance camera during the shift detection operation. , it does not detect that the deviation from the image captured by the surveillance camera at the time of initial setting exceeds the threshold.

In this embodiment, a preset position for detecting screen centering deviation is registered, and an image captured by the surveillance camera at the preset position during the deviation detection operation is compared with an image captured by the surveillance camera at the preset position during the initial setting. However, when it is detected that the deviation of the center of the image captured by the surveillance camera exceeds the threshold value, calibration is performed. In addition, screen centering deviation detection and calibration are automatically and periodically performed by the monitoring system. Therefore, even if the screen centering position is displaced, calibration can be performed without incurring costs such as remodeling costs.

Further, in this embodiment, at the time of initial setting, "a predetermined area expanded by a threshold value" is registered as an image captured by a monitoring camera at a preset position, and during the deviation detection operation, the "predetermined area" during the deviation detection operation is registered. Either compare the "predetermined area" with the "area obtained by extending the predetermined area by the threshold value" at the initial setting, or register the "predetermined area" as an image captured by the surveillance camera at the preset position during the initial setting, and detect the deviation. During operation, the "predetermined region expanded by the threshold value" during the deviation detection operation is compared with the "predetermined region" during the initial setting. Therefore, it is possible to reduce the amount of processing required to compare the image captured by the monitoring camera at the preset position during the deviation detection operation and the image captured by the monitoring camera at the preset position during the initial setting.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present invention. For example, the "predetermined area" may be rectangular instead of circular. If the "predetermined area" is rectangular, the "threshold" in the horizontal direction and the "threshold" in the vertical direction may be different values.

DESCRIPTION OF SYMBOLS 101... Surveillance camera, 102... Network, 103... Surveillance system server, 104... Monitoring terminal device, 105... Control command receiving part, 106... Camera control part, 107... Image receiving part, 108... Preset position registration part, 109... Threshold Registration unit 110 Image registration unit 111 Period registration unit 112 Image comparison unit 113 Deviation detection unit 114 Calibration necessity determination unit 115 Image display unit 116 Control command transmission unit.

Claims (8)

surveillance cameras and
a monitoring system server;
a monitoring terminal device;
A surveillance system comprising:
The monitoring system server, during the deviation detection operation,
Move the surveillance camera to the position registered at the time of initial setting,
Comparing the image captured by the surveillance camera with the image captured by the surveillance camera at the time of initial setting,
determining that calibration is necessary when the deviation between the image captured by the surveillance camera and the image captured by the surveillance camera at the time of initial setting exceeds a threshold;
Monitoring system. A monitoring system according to claim 1, wherein
When the surveillance system server is initialized,
moving the surveillance camera to a position indicated by the surveillance terminal device;
registering the position indicated by the monitoring terminal device;
registering the image captured by the surveillance camera;
Monitoring system. A monitoring system according to claim 2, wherein
When the surveillance system server is initialized,
registering an area obtained by expanding a predetermined area in the center of the image captured by the surveillance camera by a threshold;
The monitoring system server, during the deviation detection operation,
comparing a predetermined area in the center of the image captured by the surveillance camera with the image registered at the time of initial setting;
If the predetermined area in the center of the image taken by the surveillance camera is not included in the image registered at the time of initial setting, there is a difference between the image taken by the surveillance camera and the image taken by the surveillance camera at the time of initial setting. detect that a threshold has been exceeded,
Monitoring system. A monitoring system according to claim 2, wherein
When the surveillance system server is initialized,
registering a predetermined area in the center of the image captured by the surveillance camera;
The monitoring system server, during the deviation detection operation,
Comparing an area obtained by expanding a predetermined area in the center of the image captured by the surveillance camera by a threshold value with an image registered at the time of initial setting,
If the area obtained by extending the predetermined area in the center of the image captured by the surveillance camera by a threshold value does not include the image registered at the time of initial setting, the image captured by the surveillance camera and the image taken by the surveillance camera at the time of initial setting detect that the deviation from the captured image exceeds a threshold,
Monitoring system. surveillance cameras and
a monitoring system server;
a monitoring terminal device;
A control method for a monitoring system comprising
During deviation detection operation,
a step in which the surveillance system server moves the surveillance camera to a position registered at the time of initial setting;
a step in which the surveillance system server compares an image captured by the surveillance camera with an image captured by the surveillance camera during initialization;
a step in which the monitoring system server determines that calibration is necessary when a deviation between the image captured by the monitoring camera and the image captured by the monitoring camera during initial setting exceeds a threshold;
method of controlling a surveillance system that performs A control method for a monitoring system according to claim 5,
During initial setup,
a step in which the surveillance system server moves the surveillance camera to a position indicated by the surveillance terminal device;
a step in which the monitoring system server registers the position indicated by the monitoring terminal device;
a step in which the surveillance system server registers images captured by the surveillance cameras;
method of controlling a surveillance system that performs A control method for a monitoring system according to claim 6,
During initial setup,
a step in which the surveillance system server registers an area obtained by extending a predetermined area in the center of the image captured by the surveillance camera by a threshold value;
and run
During deviation detection operation,
a step in which the surveillance system server compares a predetermined area in the center of the image captured by the surveillance camera with an image registered at the time of initial setting;
If a predetermined area in the center of the image taken by the surveillance camera is not included in the image registered at the time of initial setting, the surveillance system server combines the image taken by the surveillance camera with the image taken by the surveillance camera at the time of initial setting. a step of detecting that the deviation from the image obtained exceeds a threshold;
method of controlling a surveillance system that performs A control method for a monitoring system according to claim 6,
During initial setup,
a step in which the surveillance system server registers a predetermined area in the center of the image captured by the surveillance camera;
and run
During deviation detection operation,
a step in which the surveillance system server compares an image registered at the time of initial setting with an area obtained by extending a predetermined area in the center of the image captured by the surveillance camera by a threshold value;
If the surveillance system server does not include the image registered at the time of initial setting, the image taken by the surveillance camera and the initial setting a step of detecting that the deviation from the image taken by the surveillance camera exceeds a threshold when
method of controlling a surveillance system that performs

Images