JP2017139559A - Monitoring system and display method for monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect a fallen object on a road and display a situation of a traffic amount caused by the fallen object.SOLUTION: A monitoring system comprises: a plurality of monitoring camera devices for monitoring a road situation; a display device for displaying pictures imaged by the plurality of monitoring camera devices; and a monitoring control device that on the basis of information on a picture of a monitoring camera device, controls at least one of rotation, inclination, and zoom magnification of the monitoring camera device and outputs the picture to the display device. The monitoring control device, when a picture differing from that at the normal time is detected, detects location information on the picture differing from that at the normal time; outputs the picture and the location information to the display device; on the basis of the picture and the location information, controls at least one of rotation, inclination, and zoom magnification of a monitoring camera device on the upstream side or the downstream side of a monitoring camera device at which the picture differing from that at the normal time is detected to output a picture on the upstream or the downstream to the display device; and displays the picture of the monitoring camera device on the upstream side or the downstream side, on the display device.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a monitoring system and a display method of the monitoring system.

  Conventionally, when a fallen object occurs on a high standard road such as an expressway or a general road such as a national road, a surveillance camera such as a traffic control center by a report from a general passerby who discovered the fallen object or a discovery / contact by a road manager patrol car At the site where the centralized video monitoring of the video was performed, the surveillance camera video near the corresponding location was selected and displayed, and the situation at the site was confirmed.

  As a prior art document, for example, in Patent Document 1, a monitoring area is shared by two or more intruding object monitoring devices so that the limitation of the monitoring area is removed so that the monitoring area can be removed. An invention is disclosed in which the tracking of an intruding object that has entered a blind spot is taken over by another intruding object monitoring apparatus to eliminate the blind spot of one intruding object monitoring apparatus.

  In addition, as another prior art document, for example, Patent Document 2 discloses an invention that corrects the tilt in the front-rear direction and the twist in the horizontal direction in the imaging apparatus body when it is difficult to keep the vehicle level. Has been.

  Furthermore, as another prior art document, for example, Patent Document 3 discloses an invention that images a face and a characteristic part of an intruding object regardless of the environmental condition of the monitoring plane.

JP 2001-245284 A JP 2007-243686 A JP 2010-124033

When a fallen object of a certain size or larger occurs on a high-standard road such as an expressway or a national road, a passing vehicle tends to run away, but tends to decelerate at the same time. For this reason, it is desirable for road managers to grasp the situation at the site as soon as possible, but mainly a fallen object detection system and a fallen object detection system by image processing using a revolving camera device in the light part (other than inside the tunnel mine) The introduction of video surveillance equipment that performs interlocking operations has not progressed, and it takes time to check the situation near the site where the fallen objects occur.
An object of the present invention is to detect a fallen object on a road and to display a traffic volume state due to the fallen object. Furthermore, it is to improve the visibility of falling objects.

  The monitoring system of the present invention is a monitoring system including a monitoring camera device capable of changing the shooting direction, and displays a plurality of monitoring camera devices that monitor road conditions and images captured by the plurality of monitoring camera devices. And a monitoring control device that controls at least one of turning, tilting, and zooming magnification of the monitoring camera device based on image information of the monitoring camera device and outputs an image to the display device. When an image different from the normal time is detected, the control device detects the position information of the image different from the normal time, outputs the image and the position information to the display device, and differs from the normal time based on the image and the position information. Control at least one of the turning, tilting, and zoom magnification of the upstream or downstream surveillance camera device from which the image was detected, and output the upstream or downstream image to the display device. Displays an image of a downstream side of the monitor camera device to the display device.

  Further, the display method of the monitoring system of the present invention is a monitoring system including a monitoring camera device capable of changing a shooting direction, and is imaged by a plurality of monitoring camera devices that monitor road conditions and a plurality of monitoring camera devices. A display device that displays the image, and a monitoring control device that controls at least one of the turning, tilting, and zoom magnification of the monitoring camera device based on the image information of the monitoring camera device, and that outputs the image to the display device And detecting position information of an image different from the normal time when an image different from the normal time is detected, transmitting the image and the position information to a display device, and displaying the transmitted image The monitoring camera device upstream or downstream of the monitoring camera device in which the image different from the normal time is detected based on the position information of the image different from the normal time is turned, tilted, and zoom magnification is reduced. Transmits an upstream or downstream of the image on the display device by controlling one Kutomo to display the image on the upstream side or downstream side of the monitoring camera apparatus.

  Furthermore, the display method of the monitoring system of the present invention is the above-described display method of the monitoring system, and when the subject is in the display object of the road information display board, the installation status of the monitoring camera device or the monitoring camera device and the subject When the subject is displayed obliquely due to the positional relationship, it is preferable to detect the subject on the video and correct the trapezoidal distortion of the subject on the video for display.

  According to the present invention, it is possible to detect a fallen object on the road and display a traffic situation due to the influence of the fallen object. Furthermore, the visibility of falling objects can be improved.

It is a figure which shows the outline | summary of the monitoring system which concerns on one Example of this invention. It is a block diagram of the surveillance camera apparatus which concerns on one Example of this invention. It is a display screen figure of the surveillance picture displayed on the display concerning one example of the present invention. It is a flowchart for demonstrating operation | movement of the surveillance camera apparatus which concerns on one Example of this invention. It is a flowchart for demonstrating operation | movement of the monitoring control apparatus which concerns on one Example of this invention. It is a flowchart for demonstrating the operation | movement of the trapezoid distortion correction of the monitoring control apparatus which concerns on one Example of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing an overview of a monitoring system according to an embodiment of the present invention.
In FIG. 1, a monitoring system 100 includes monitoring camera devices 101-1 to 101-3 (referred to as 101 when representing a monitoring camera device), a network 102, and a monitoring center 110.

Although the monitoring camera devices 101-1 to 101-N (N is a natural number) will be described as three in this embodiment, a large number may be installed along the road.
Note that the monitoring camera devices 101-1 to 101-3 always shoot road conditions with a predetermined shooting direction and zoom magnification (preset value).
The network 102 may be an Internet line or a dedicated line, and is not particularly limited.
The monitoring center 110 includes a monitoring control device 111 and a display device 112.
The monitoring control device 111 and the display device 112 may be a PC (Personal Computer).

The monitoring camera device 101 captures the traffic situation and transmits the captured image data to the monitoring center 110 via the network 102.
The monitoring control device 111 of the monitoring center 110 receives the image data transmitted from the monitoring camera device 101 and outputs it to the display device 112. In addition, the monitoring control device 111 controls PTZ (Pan Tilt Zoom) of the monitoring camera device 101 with a PTZ control signal.

Next, an overview of the monitoring camera apparatus 101 according to an embodiment of the present invention will be described with reference to FIG.
FIG. 2 is a block diagram of a surveillance camera device according to an embodiment of the present invention.
The surveillance camera device 101 includes a lens unit 201, an imaging unit 202, a video encoding unit 203, an image recognition unit 204, an IF (Interface) unit 205, a camera control unit 206, and a pan head unit 207.

The imaging unit 202 outputs a video signal obtained by photoelectrically converting the incident light imaged by the lens unit 201 to the video encoding unit 203 and the image recognition unit 204.
The video encoding unit 203 outputs video data obtained by performing image processing such as compression on the input video signal to the IF unit 205.

The image recognition unit 204 performs image processing from the input video signal to extract the fallen object 141 and the like, and outputs information including the image signal and the position of the fallen object 141 to the IF unit 205.
The IF unit 205 outputs video data and falling object information to the monitoring center 110 via the network 102. Further, the IF unit 205 receives a PTZ control signal and the like from the monitoring center 110 via the network 102.

The camera control unit 206 controls the lens unit 201 and the pan head unit 207 with the PTZ control signal transmitted from the monitoring center 110. Further, the camera control unit 206 controls the imaging unit 202, the video encoding unit 203, the image recognition unit 204, and the IF unit 205.
The pan head unit 207 has a mechanism (Pan, Tilt) for changing the turning and tilting to direct the monitoring camera device 101 in a predetermined photographing direction.

Next, the display screen 300 of the display device 112 will be described.
FIG. 3 is a display screen view of the monitoring image displayed on the display device according to the embodiment of the present invention.
In FIG. 3, the display screen 300 of the display device 112 displays display areas 301-1 to 301-N (N is a natural number) for displaying a monitoring image of the monitoring camera device 101 at the normal time and an image different from the normal time. A display area 302 is provided.
Note that a plurality of display areas for displaying images different from the normal time may be provided.

Next, the falling object detection operation of the camera control unit 206 of the monitoring camera apparatus 101 will be described with reference to FIGS.
FIG. 4 is a flowchart for explaining the operation of the surveillance camera apparatus according to the embodiment of the present invention.
In FIG. 4, the image recognition unit 204 acquires image data from the imaging unit 202 in the process of S401, and proceeds to the process of S402.
In the process of S402, the image recognition unit 204 removes the moving object in the measurement area, and proceeds to the process of S403. The inside of the measurement area may be the entire screen or a predetermined part of the screen.

  In the process of S403, the image recognition unit 204 determines whether there is a falling object in the measurement area. If there is a falling object (YES), the process proceeds to S404, and if there is no falling object (NO), S401. Return to the process.

In the process of S404, the image recognition unit 204 detects the position of the falling object, notifies the monitoring control device 111 of the monitoring center 110 together with the image data of the falling object, and returns to the process of S401.
The position detection of the falling object can be obtained by a well-known technique from the installation position of the monitoring camera apparatus 101 that images the falling object, the shooting direction of the monitoring camera apparatus 101, and the zoom magnification of the lens unit 101.

Next, the operation of the monitoring control device 111 of the monitoring center 110 will be described with reference to FIG. 1, FIG. 3, and FIG.
FIG. 5 is a flowchart for explaining the operation of the monitoring control apparatus according to the embodiment of the present invention.

In FIG. 5, the monitoring control apparatus 111 acquires image data and falling object information transmitted from the monitoring camera apparatus 101 via the network 102 in the process of S501, and proceeds to the process of S502.
In the process of S502, the monitoring control device 111 outputs image data in which the name of the monitoring camera device is added to the display device 112. Note that the name of the monitoring camera device to be added is, for example, a camera number, an installation location, or an intersection name.
The display device 112 displays the image data and the like added with the monitoring camera device name output from the monitoring control device 111 in a predetermined area, for example, the display area 301-1 in FIG. 3.

  In the process of S503, the monitoring control device 111 determines whether or not there is falling object information. If there is falling object information (YES), the process proceeds to S504, and if there is no falling object information (NO), the process proceeds to S501. Return to processing.

In the processing of S504, the monitoring control device 111 outputs the image data of the falling object with the monitoring camera device name added to the display device 112. Note that the name of the monitoring camera device to be added is, for example, a camera number, an installation location, or an intersection name.
The display device 112 displays the image data of the fallen object to which the monitoring camera device name and the like output from the monitoring control device 111 are added in a predetermined area, for example, the display area 302 in FIG.

In the process of S505, the monitoring controller 111 acquires the fallen object position data from the fallen object information, and proceeds to the process of S506.
In the process of S506, the monitoring control device 111 outputs instructions for directing the shooting direction to the falling object to the monitoring camera apparatuses upstream and downstream of the monitoring camera apparatus that captured the falling object, and proceeds to the process of S507. For example, when the monitoring camera device 101-2 in FIG. 1 captures the falling object 141, the monitoring control device 111 detects the upstream of the falling object 141 and the downstream of the falling object 141. An instruction to direct the shooting direction to the direction in which the fallen object 141 is present is output to the monitoring camera apparatus 101-1 that is shooting.

In FIG. 1, the monitoring camera device 101-1 shooting the downstream side of the falling object 141 directs the shooting direction to the direction in which the falling object 141 exists according to the instruction output from the monitoring control device 111.
In addition, the monitoring camera device 101-3 shooting the upstream of the falling object 141 directs the shooting direction to the direction in which the falling object 141 exists according to the instruction output from the monitoring control device 111.

The monitoring control apparatus 111 acquires the image data output from the upstream and downstream monitoring camera apparatuses in the process of S507 via the network 102, and proceeds to the process of S508.
In the processing of S508, the monitoring control device 111 outputs the upstream and downstream image data with the monitoring camera device name added to the display device 112, and returns to the processing of S501. Note that the name of the monitoring camera device to be added is, for example, a camera number, an installation location, or an intersection name.

The display device 112 displays upstream and downstream image data and the like to which the monitoring camera device name and the like output from the monitoring control device 111 are added in a predetermined area (display area). For example, in FIG. 3, the display device 112 displays the image data of the monitoring camera device that captured the falling object in the display area 301-2, and the image data of the monitoring camera device that captured the upstream of the falling object is displayed in the display area 301-. 1 and the image data of the surveillance camera device that captured the downstream of the falling object is displayed in the display area 301-3.
By watching the display screen 300 displayed on the display device 112, the monitor can easily check the image of the fallen object and traffic conditions such as upstream and downstream traffic jams due to the influence of the fallen object.

Next, the trapezoidal distortion correction operation of the monitoring control apparatus will be described with reference to FIG. 6. FIG. 6 is a flowchart for explaining the trapezoidal distortion correction operation of the monitoring control apparatus according to an embodiment of the present invention. FIG. 6 explains the detailed processing of S504.

  In FIG. 6, the monitoring control device 111 determines whether or not the acquired fallen object image data is distorted. If the fallen object image data is distorted (YES), the process proceeds to S602, and the fallen object image data. If it is not distorted (NO), the process proceeds to S603.

In the process of S602, the monitoring controller 111 corrects the trapezoidal distortion of the falling object image data, and proceeds to the process of S603.
Note that the monitoring control device 111 detects, for example, a falling object image in a rectangular display object such as a road information display board in an image captured by the monitoring camera apparatus 101 at the same time as the falling object 141, and a rectangular information such as a road information display board. The trapezoidal distortion of the image of the falling object 141 (subject) is corrected on the video based on the image. Alternatively, when the lens unit 201 causes trapezoidal distortion, the monitoring control device 111 stores a correction coefficient corresponding to the zoom magnification of the lens unit 201 in advance, and when the falling object is detected, the image data of the falling object is stored. May be corrected with a correction coefficient stored in advance.
By performing trapezoidal distortion correction on the image data of the falling object, the squareness can be improved and the visibility of the falling object can be improved.

In the process of S603, the monitoring control device 111 outputs the image data of the falling object with the monitoring camera device name added to the display device 112. Note that the name of the monitoring camera device to be added is, for example, a camera number, an installation location, or an intersection name.
The display device 112 displays the image data of the fallen object to which the monitoring camera device name and the like output from the monitoring control device 111 are added in a predetermined area, for example, the display area 302 in FIG.

The monitoring system according to the embodiment of the present invention can detect a fallen object on a road and display a traffic situation due to the fallen object. Furthermore, the visibility of falling objects can be improved.
In addition, although the above-mentioned embodiment demonstrated the fallen object on the road, it can apply also to the state different from the normal time on a road. The state different from the normal time on the road is, for example, a case where a traffic accident or depression occurs.
Furthermore, the display device 112 may display only one image data, and the monitoring control device 111 may select and output one image data.

  Although one embodiment of the present invention has been described in detail above, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention.

  Applications that monitor traffic conditions such as traffic jams and accidents caused by falling objects by directing the shooting direction toward the falling objects with respect to the monitoring camera apparatuses located upstream and downstream of the monitoring camera apparatus that captured the falling objects Applicable to.

  100: monitoring system, 101-1 to 101-3: monitoring camera device, 102: network, 110: monitoring center, 111: monitoring control device, 112: display device, 121, 122, 123, 131: vehicle, 141: falling Object 201: lens unit 202: imaging unit 203: video encoding unit 204: image recognition unit 205: IF unit 206: camera control unit 207: pan head unit 300: display screen 301-1 ˜301-N, 302: display area.

Claims (3)

In a surveillance system equipped with a surveillance camera device capable of changing the shooting direction,
A plurality of monitoring camera devices for monitoring road conditions;
A display device for displaying images captured by the plurality of monitoring camera devices;
A monitoring control device that controls at least one of turning, tilting, and zoom magnification of the monitoring camera device based on image information of the monitoring camera device, and that outputs an image to the display device,
The monitoring control device detects position information of an image different from the normal time when an image different from the normal time is detected, outputs the image and the position information to the display device, and outputs the image and the position information. The upstream or downstream image is detected on the display device by controlling at least one of the turning, tilt, and zoom magnification of the upstream or downstream surveillance camera device on which an image different from the normal time is detected based on A monitoring system that outputs and displays an image of the upstream or downstream monitoring camera device on the display device. In a surveillance system equipped with a surveillance camera device capable of changing the shooting direction,
A plurality of monitoring camera devices for monitoring road conditions;
A display device for displaying images captured by the plurality of monitoring camera devices;
A monitoring control device that controls at least one of turning, tilting, and zoom magnification of the monitoring camera device based on image information of the monitoring camera device, and that outputs an image to the display device,
Detecting a position information of an image different from the normal time when an image different from the normal time is detected, and transmitting the image and the position information to the display device;
In addition to displaying the transmitted image, the monitoring camera device upstream or downstream of the monitoring camera device in which an image different from the normal time is detected based on the position information of the image different from the normal time is directed to the target direction. A monitoring system display method for controlling at least one of turning, tilting, and zoom magnification to transmit the upstream or downstream image to the display device and displaying an image of the upstream or downstream monitoring camera device. The display method of the monitoring system according to claim 2,
When the subject is in the display object of the road information display board, the subject on the video is detected when the subject is displayed obliquely depending on the installation status of the surveillance camera device or the positional relationship between the surveillance camera device and the subject. A display method of a monitoring system for correcting and displaying trapezoidal distortion of the subject above.

Images