WO2016152317A1

WO2016152317A1 - Video processing system, video processing method and video processing program

Info

Publication number: WO2016152317A1
Application number: PCT/JP2016/054347
Authority: WO
Inventors: 健一朗猪田; 理石井; 正人北田
Original assignee: 日本電気株式会社
Priority date: 2015-03-20
Filing date: 2016-02-15
Publication date: 2016-09-29

Abstract

The objective of the invention is to prevent a surveillance target being lost track of as a result of the surveillance target being shielded by a shielding object. This video processing system includes: a video acquiring means which acquires videos from at least two cameras; a detecting means which detects that a surveillance target is being shielded by a shielding object in a video acquired from a first camera included in the at least two cameras; a selecting means which selects a second camera, from among the at least two cameras, capable of capturing images of the region shielded by the shielding object; and a video control means which acquires the video captured by the second camera.

Description

Video processing system, video processing method, and video processing program

The present invention relates to a video processing system, a video processing system control method, and a video processing system control program.

In the above technical field, Patent Document 1 discloses a technique for capturing an image by zooming the anomaly detection area to an anomaly detection area when an abnormality is detected, and widening the angle of view of another surveillance camera. Yes.

JP 2009-157446 A

However, in the technique described in the above document, the monitoring target may be lost due to shielding by a shielding object in monitoring by a monitor of a specific camera.

An object of the present invention is to provide a technique for solving the above-described problems.

In order to achieve the above object, a video processing system according to the present invention includes:
Video acquisition means for acquiring video from at least two cameras;
Detecting means for detecting shielding of a monitoring target by a shielding object in an image acquired from a first camera included in the at least two cameras;
A selection means for selecting, from the at least two cameras, a second camera capable of imaging a shielding area by the shielding object;
Video control means for acquiring video captured by the second camera;
including.

In order to achieve the above object, a video processing method according to the present invention includes:
A video acquisition step of acquiring video from at least two cameras;
A detection step of detecting shielding of a monitoring target by a shielding object in an image acquired from a first camera included in the at least two cameras;
A selection step of selecting, from the at least two cameras, a second camera capable of imaging a shielding area by the shielding object;
A video control step of acquiring video captured by the second camera;
including.

In order to achieve the above object, a video processing program according to the present invention provides:
A video acquisition step of acquiring video from at least two cameras;
A detection step of detecting shielding of a monitoring target by a shielding object in an image acquired from a first camera included in the at least two cameras;
A selection step of selecting, from the at least two cameras, a second camera capable of imaging a shielding area by the shielding object;
A video control step of acquiring video captured by the second camera;
Is executed on the computer.

According to the present invention, it is possible to reduce losing sight of the monitoring target due to shielding by the shielding object.

1 is a block diagram showing a configuration of a video processing system according to a first embodiment of the present invention. It is a figure which shows the outline of operation | movement of the video processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the outline of operation | movement of the video processing system which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the structure of the video processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the camera performance table with which the video processing system which concerns on 2nd Embodiment of this invention is provided. It is a figure which shows the structure of the shielding object table with which the video processing system which concerns on 2nd Embodiment of this invention is provided. It is a block diagram which shows the hardware constitutions of the video processing system which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of the video processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the outline of operation | movement of the video processing system which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the structure of the video processing system which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the process sequence of the video processing system which concerns on 3rd Embodiment of this invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the components described in the following embodiments are merely examples, and are not intended to limit the technical scope of the present invention only to them.

[First Embodiment]
A video processing system 100 as a first embodiment of the present invention will be described with reference to FIG. The video processing system 100 is a system that switches to a camera capable of capturing an image of a shielding area when shielding is detected.

As shown in FIG. 1, the video processing system 100 includes a video acquisition unit 101, a detection unit 102, a selection unit 103, and a video control unit 104.

The video acquisition unit 101 acquires video from at least two cameras 120. The detection unit 102 detects the shielding of the monitoring target by the shielding object in the video acquired from the first cameras included in the at least two cameras 120. The selection unit 103 selects, from at least two cameras, a second camera that can capture an image of the shielding area by the shielding object. The video control unit 104 acquires a video captured by the second camera.

According to this embodiment, the monitoring target is not lost due to shielding by the shielding object.

[Second Embodiment]
Next, a video processing system according to a second embodiment of the present invention will be described with reference to FIGS. 2A to 6. 2A and 2B are diagrams for explaining an outline of the operation of the video processing system 200 according to the present embodiment.

As shown in FIG. 2A (a), the track 230 is approaching in front of the person 240 when the camera 210 and the camera 220 are imaging the person 240 to be monitored. Then, as shown in FIG. 2B (b), when the truck 230 stops or crosses between the person 240 and the camera 210, the person 240 is hidden behind the truck 230, and the camera 210 The person 240 cannot be photographed. That is, in this case, the person 240 is shielded by the track 230. The track 230 serves as a shield that hides the figure of the person 240 from the camera 210.

In this case, since the camera 210 cannot capture the person 240 with the camera 210, the image processing system 200 acquires the image captured by the camera 220 that can capture the area behind the track 230, that is, the shielding area shielded by the shielding object.

FIG. 2B is a diagram illustrating an image captured by the camera 210 and the camera 220. FIG. 2B (a) shows an image captured by the camera 210, and the track 230 is approaching from the left side of the screen. Thereafter, as shown in FIG. 2B (b), when the truck 230 stops in front of the person 240, the truck 230 becomes a shield that hides the figure of the person 240 from the camera 210. In this case, the video processing system 200 switches to the camera 220 that can image the person 240 as shown in FIG. 2B (c). By switching the video in this way, the person 240 to be monitored is not lost.

Although the example in which the shielding object approaches the monitoring target has been described here, the example in which the monitoring target is shielded by the shielding object is not limited to this. For example, the monitoring target is a building, a power pole, a tree, or the like. It may be an example of being hidden behind a ground object (fixed on the ground) and shielded.

FIG. 3 is a block diagram showing the configuration of the video processing system 200. The video processing system 200 includes a video acquisition unit 301, a detection unit 302, a selection unit 303, a video control unit 304, and a display control unit 305.

The video acquisition unit 301 acquires video captured by the camera group 320. For example, an image captured by the camera 321 is acquired.

The detecting unit 302 detects that the monitoring target is shielded by the shielding object in the video imaged by the camera 321. In other words, the camera 321 detects that the monitoring target can no longer be imaged. However, detection and determination of shielding may be performed by two-dimensionally analyzing an image acquired by the camera 321 or three-dimensionally. Note that the disappearance of the monitoring target inside the video acquired by the camera 321 may be detected instead of detecting the shielding of the monitoring target. In addition, the detection unit 302 may identify the shielding object in the video acquired by the camera 321 and detect that the monitoring target is shielded by the identified shielding object.

The selection unit 303 selects a camera 322 that can capture an image of the monitoring target. The video control unit 304 acquires video captured by the camera 322. The display control unit 305 displays images captured by the

cameras

321 and 322. The display control unit 305 further switches a camera that captures an image of the monitoring target. For example, when a screen to be monitored is detected while displaying an image acquired by the camera 321, the display is switched to the image of the camera 322. Although an example of switching from the camera 321 to the camera 322 has been described here, the method of switching the camera is not limited to this, and various switching methods are possible.

FIG. 4A is a diagram illustrating an example of the configuration of the camera performance table 401 provided in the video processing system 200. The camera table 401 stores an angle of view, a magnification, an imageable area, and the like in association with the camera. The items stored in the camera table 401 are not limited to these items, and any items may be used as long as they relate to camera performance. The video processing system 200 uses the camera performance table 401 to identify an area that can be captured by each camera, and performs, for example, camera switching.

FIG. 4B is a diagram illustrating an example of a configuration of the shielding object table 402 included in the video processing system 200. The shielding object table 402 stores specific contents of the shielding object in association with the property of the shielding object such as whether the shielding object is a moving object or a fixed object. The video processing system 200 uses the shielding object table 402 to identify what the moving object is, for example, if it is a moving object.

FIG. 5 is a diagram illustrating a hardware configuration of the video processing system 200. The video processing system 200 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a storage 504, and a communication control unit 505.

The CPU 501 is a processor for arithmetic processing, and implements each functional component of the video processing system 200 by executing a program. Note that the number of CPUs 501 is not limited to one, and a plurality of CPUs 501 may be included, and a GPU (GraphicsGraphProcessing Unit) for image processing may be included. The ROM 502 is a read only memory and stores programs such as firmware.

The communication control unit 505 communicates with other devices via a network. Further, the communication control unit 505 may include a CPU independent of the CPU 501 and write or read transmission / reception data to / from the RAM 503.

The RAM 503 is a random access memory that the CPU 501 uses as a work area for temporary storage. The RAM 503 has an area for storing data necessary for realizing the present embodiment. As such data, the video processing system 200 temporarily stores monitoring target information 531 that is information related to the monitoring target, shielding object information 532 that is information related to the shielding object, and camera video 533. The RAM 503 has an application execution area 534 for executing various application modules.

The storage 504 is a storage device that stores programs and databases necessary for realizing the present embodiment. The storage 504 stores a camera performance table 401, a shielding object table 402, a monitoring program 541, and a control program 545.

The monitoring program 541 stores a detection module 542, a selection module 543, and a video control module 544. These modules 542 to 544 are read by the CPU 501 into the application execution area 534 and executed. The control program 545 is a program for controlling the entire video processing system 200. Also, it is desirable to provide a DMAC (Direct Memory Access Controller) that transfers data between the RAM 503 and the storage 504 (not shown).

Note that the RAM 503 and the storage 504 shown in FIG. 5 do not show programs and data related to general-purpose functions and other realizable functions that the video processing system 200 has. Further, the hardware configuration of the video processing system 200 described here is merely an example, and the present invention is not limited to this hardware configuration, and various hardware configurations can be used.

FIG. 6 is a flowchart for explaining the processing procedure of the video processing system 200. In step S601, the video processing system 200 acquires video from at least two cameras. In step S <b> 603, the video processing system 200 determines whether or not the shielding by the monitoring target shielding object in the video acquired by one of the at least two cameras is detected. When the shielding of the monitoring target is detected, in step S605, the video processing system 200 selects another camera that can capture an area shielded by the shielding object. In step S607, the video processing system 200 acquires a video captured by another camera. In step S611, the video processing system 200 switches from the video of the one camera to the video of another camera.

According to the present embodiment, when the shielding by the shielding object occurs, switching to another camera image is performed, so that it is possible to greatly reduce the loss of the monitoring target due to the shielding by the shielding object.

[Third Embodiment]
Next, a video processing system according to a third embodiment of the present invention will be described with reference to FIGS. FIG. 7 is a diagram for explaining the outline of the operation of the video processing system 700 according to the present embodiment. The video processing system according to the present embodiment is different from the second embodiment in that it has a camera control unit. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

As shown in FIG. 7A, during the imaging of the monitoring object 740 in front of the building 750 with the camera 710, for example, a shield 730 such as an automobile approaches from the left side of the drawing, and the camera 710 and the monitoring object 740 Suppose that it stopped in between. If it does so, it will become impossible to image the monitoring object 740 with the camera 710 which imaged the monitoring object 740 until now. An area 760 indicates an area that can be imaged by the camera 710.

In this case, as shown in FIG. 7B, the video processing system 700 images another object 740 by controlling another camera 720 that can image the area 760 blocked by the shielding object. That is, as shown in FIG. 7A, the video processing system 700 changes the orientation of the camera 720 that originally captured another area as shown in FIG. Control is performed so that the monitoring target 740 is imaged.

Thus, even if the shielding object occurs and the camera 710 cannot capture the monitoring object 740, the monitoring object 740 is not lost by changing the imaging direction of another camera 720. Here, the case where there are two cameras has been described, but the number of cameras is not limited to two, and the same control can be performed even when there are three or more cameras.

Also, here, an example in which the shielding area is imaged by directing the camera to the shielding area caused by the shielding object has been described. However, for example, when there is no camera capable of imaging the shielding area, the camera is imaged at the edge of the shielding object 730 or at an edge different from the edge where the monitoring target 740 enters behind the shielding object 730. May be directed.

FIG. 8 is a block diagram showing the configuration of the video processing system 700. The video processing system 700 includes a camera control unit 801. The camera control unit 801 controls the imaging areas of the two

cameras

710 and 720. When the monitoring target 740 is blocked by the shielding object 730 in the video acquired by the camera 710 and the monitoring target 740 cannot be captured by the camera 710, the camera control unit 801 can capture the area where the monitoring target 740 is shielded. The camera 720 controls to capture the shielding area.

FIG. 9 is a flowchart showing a processing procedure of the video processing system 700. Steps similar to those in FIG. 6 are given the same step numbers and description thereof is omitted. In step S <b> 901, the video processing system 700 detects whether or not the monitoring target 740 is shielded by the shielding object 730 while displaying the video acquired by the camera 710. In step S903, the video processing system 700 points another camera 720 capable of capturing an image of the shielded area toward the shield area.

According to the present embodiment, since the camera capable of imaging the monitoring target is directed to the monitoring target, it is possible to greatly reduce losing sight of the monitoring target due to shielding by the shielding object.

[Other Embodiments]
While the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, a system or an apparatus in which different features included in each embodiment are combined in any way is also included in the scope of the present invention.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

This application claims priority based on Japanese Patent Application No. 2015-58277 filed on Mar. 20, 2015, the entire disclosure of which is incorporated herein.

Claims

Video acquisition means for acquiring video from at least two cameras;
Detecting means for detecting shielding of a monitoring target by a shielding object in an image acquired from a first camera included in the at least two cameras;
A selection means for selecting, from the at least two cameras, a second camera capable of imaging a shielding area by the shielding object;
Video control means for acquiring video captured by the second camera;
Including video processing system.
Further comprising display control means for displaying video acquired from the first and second cameras,
The display control means includes
The video processing system according to claim 1, wherein the display is switched to the video of the second camera when the shielding is detected while the video acquired from the first camera is displayed.
3. The video processing system according to claim 1, further comprising camera control means for directing the second camera toward the shielding area when the shielding is detected while displaying an image acquired from the first camera.
4. The video processing system according to claim 1, wherein the detection unit identifies a shielding object in an image acquired from the first camera, and detects shielding of the monitoring target by the shielding object. 5. .
The video processing system according to any one of claims 1 to 3, wherein the detection unit detects the shielding by detecting disappearance of the monitoring target inside the video.
The video processing system according to any one of claims 1 to 5, wherein the detection means detects the shielding by two-dimensionally analyzing the video.
The video processing system according to any one of claims 1 to 6, wherein the detection unit detects the shielding by analyzing the video three-dimensionally.
A video acquisition step of acquiring video from at least two cameras;
A detection step of detecting shielding of a monitoring target by a shielding object in an image acquired from a first camera included in the at least two cameras;
A selection step of selecting, from the at least two cameras, a second camera capable of imaging a shielding area by the shielding object;
A video control step of acquiring video captured by the second camera;
Video processing method.
A video acquisition step of acquiring video from at least two cameras;
A detection step of detecting shielding of a monitoring target by a shielding object in an image acquired from a first camera included in the at least two cameras;
A selection step of selecting, from the at least two cameras, a second camera capable of imaging a shielding area by the shielding object;
A video control step of acquiring video captured by the second camera;
A video processing program that causes a computer to execute.