JP2004104274A - Monitor system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize an efficient detection of unusual situations of an object under monitoring a large amount of images at once. <P>SOLUTION: The system has a multi-screen monitor view composed of a first monitor view for displaying a plurality of images at once and a second monitor view for displaying images existing on the first monitor view. The second view displays an image selected according to standards such as rules or parameters to be selected in the first monitor view, etc. or by the operation of a monitor operator. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a monitoring system for simultaneously monitoring a plurality of videos.
[0002]
[Prior art]
Recently, a large amount of data contents can be distributed at high speed and in large amounts at low cost by the broadband Internet and the like. One of the contents distribution services to which this technology is applied is a video monitoring service.
[0003]
While such video surveillance services on the Internet have the advantage that the service users can enjoy the video surveillance services with cameras that are inexpensive and ubiquitous, the service providers have a huge The challenge is how to monitor the number of objects.
[0004]
Patent Document 1, which is one of related technologies, mentions an image display system that divides a screen of one monitor and simultaneously displays images from two video cameras.
[0005]
Also, Patent Document 2 discloses a video monitoring control system using a video bus and a terminal control device for displaying an image of an arbitrary monitoring camera at a center among a plurality of monitoring cameras in a monitoring area and enabling easy monitoring of multiple points. Is mentioned.
[0006]
Further, Patent Document 3 mentions that a plurality of output videos are simultaneously switched in a video monitoring device having a plurality of input video signal switching functions and a titler function.
[0007]
[Patent Document 1]
JP-A-6-197344 [Patent Document 2]
Japanese Patent Application Laid-Open No. 9-74554 [Patent Document 3]
JP-A-10-98708
[Problems to be solved by the invention]
In the above prior art, a display method of a plurality of images and a switching method thereof are mentioned. However, in a video surveillance service in which a huge amount of surveillance images is assumed, monitoring is continued, and an abnormal state is detected from the surveillance. It does not provide a solution to service requests that do.
[0009]
[Means for Solving the Problems]
The present invention simultaneously realizes two mutually exclusive elements of the video surveillance service, in which the operator of the video surveillance service performs simultaneous monitoring of a huge amount of images and detects an abnormal state in the image as soon as possible. Provide a means to
[0010]
The present invention is a system having a multi-view surveillance view composed of a first surveillance view that displays a plurality of images simultaneously and a second surveillance view that displays images present in the first surveillance view, In the first monitoring view, the selected video is displayed in the second monitoring view via a criterion to be selected by a rule, a parameter, or an algorithm or by an operation of a monitoring operator.
[0011]
Also, in the first monitoring view, the video is displayed on the first monitoring view so that the video displayed in the second monitoring view indicates which video in the first monitoring view. Highlighted in the surveillance view.
[0012]
Also, the video displayed in the second monitoring view is displayed in higher definition and higher image quality than the video displayed in the first monitoring view, or an alarm indicating urgency. Information, the position (latitude / longitude) of the image, the address, a map of the vicinity thereof, and the estimated threat rank are displayed.
[0013]
Further, in the video displayed in the second monitoring view, the point that is the basis of the abnormality is highlighted and displayed on the video.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a first embodiment of a communication system according to the present invention will be described taking an example of application to a monitoring system.
[0015]
This monitoring system is suitable for night monitoring in buildings for crime prevention, daytime department store monitoring for complete confirmation, equipment monitoring in factories, parks, shopping streets, nurseries, etc. Is, of course, possible.
[0016]
FIG. 1 shows a configuration of a monitoring system according to the present embodiment. As shown in the figure, in the monitoring system, the camera 40 is connected to the WAN 11 via the camera node 30. In this figure, the WAN 11 is described as one network, but may actually be configured from a plurality of networks.
[0017]
A gateway device 31 with the WAN and a monitoring console device 20 on which a monitoring operator performs monitoring work are connected to the LAN 10. The monitoring console device 20 is configured by a personal computer, a workstation, or the like, and is equipped with the multi-display 14, a mouse 24 as an input device, and a keyboard 22. The monitoring operator 12 uses the monitoring console device 20 to operate the monitoring system and perform a monitoring operation. Note that a plurality of monitoring console devices 20 may be provided. In such a configuration, an image from the camera 40 is displayed on the multi-display 14 via the WAN 11, the gateway device 31, and the network 10 based on an instruction from the monitoring console device 20.
[0018]
FIG. 2 shows a hardware configuration of the monitoring console device 20. As shown in the figure, the monitoring console device 20 includes a network connection controller 112, a CPU 102, a memory 104, an input / output controller 106 for controlling a keyboard 22 and a mouse 24, a monitor controller 108, and a map database 26 and a customer database 28. The external device controller 109 to be controlled has a hardware configuration connected by a communication line 110 such as a bus.
[0019]
FIG. 3 shows a hardware configuration of the camera node 30. As shown in the figure, the camera node 30 includes a camera controller 136 for controlling the video camera 40, a CPU 132, a memory 134, a network connection controller 130, and an external device controller 138 for controlling the GPS receiver 136. It has a hardware configuration connected by a line 305. Further, an actuator for performing a camera angle and a zoom operation is mounted on the video camera 40, and is controlled by the camera controller 136.
[0020]
FIG. 4 shows a software configuration of the console processing device 20. This software configuration is realized on the console processor 20 by the CPU 102 executing a program stored in the memory 104, and performs each function described later on the console processor 20. As illustrated, the software configuration of the console processing device 20 includes a network control driver 174, a communication management module 172, an input / output device control driver 150, an external device control driver 151, a video control module 152, a video abnormality detection module 156, and a camera. It has a control module 160, a transmission queue 166, and a reception queue 170.
[0021]
The network control driver 174 controls the network connection controller 112. The communication management module 172 implements, via the network control driver 174, one-to-one communication for transferring a message to a designated device and broadcast communication for transferring a message to all devices connected to a network. The input / output control driver 150 controls the monitor 14, the keyboard 22, and the mouse 24.
[0022]
The communication management module 172 performs a process of transmitting the transmission data stored in the transmission queue 166 and passing the reception data stored in the reception queue 170 to an appropriate module.
[0023]
The input / output device control driver 150 executes processing of transferring video data to the multi-display 14 for display, recognizing a touch on the multi-display 14 by the monitoring operator 12, and notifying the video control module 152 of the information. I do. The external device control driver 151 controls reading and writing of necessary information from the map database 26 and the customer database 28.
[0024]
The video abnormality detection module 156 detects the abnormality of the monitoring target from the video data transferred from the camera node 30, specifies the target that has detected the abnormality, calculates the threat level, and displays the threat level on the video. Write a marker that highlights the object.
[0025]
This abnormality detection processing is realized by executing an algorithm, pattern matching with existing video data, and the like, for an object, a size, a moving speed, a moving acceleration, a motion pattern, and other states included in the video information. The details of these video and image processing are described in Tsuchiya and Fukada, Television Society Reference Book Series 5, Image Processing, Chapter 7, Corona Publishing, 1900.1.25, ISBN 4-339-01070-7, etc. There is.
[0026]
The camera control module 160 creates a video transfer monitoring / end request, a fine video transfer request, a detailed information transfer request, a camera control request, and other messages to the camera node 30. These messages are stored in the transmission queue 166 and transmitted by the communication management module 172.
[0027]
The video control module 152 interprets control contents from the monitoring operator 12 via the input / output device control driver 150, the external device control driver 151, and the camera control module 160, performs appropriate processing, and executes video data and A process for transferring other information to an appropriate device is performed.
[0028]
FIG. 5 shows a software configuration of the camera node 30. This software configuration is realized on the camera node 30 by the CPU 132 executing a program stored in the memory 134, and performs each function described later on the camera node 30. As illustrated, the software configuration of the camera node 30 includes a network control driver 200, an external device management module 202, a camera control driver 218, a camera control module 216, a transmission queue 206, and a reception queue 204.
[0029]
The network control driver 200 controls the network connection controller 130. The external device management module 202 acquires position information from the GPS receiver 136 via the external device controller 138.
[0030]
The camera control driver 218 controls camera angle, zoom, and the like of the video camera 40. The camera control module 216 transmits the video data obtained by processing the data from the video camera 40 to the network control driver 200 via the transmission queue 206.
[0031]
The camera control module 216 receives a video transfer monitoring / end request, a fine video transfer request, a detailed information transfer request, a camera control request, and other messages sent from the camera control module 160, and responds to the contents thereof. Control. The video abnormality detection module 210 detects abnormality of a monitoring target from the video data transferred from the camera node 30, specifies the target that has detected the abnormality, calculates the threat level, and displays the object on the video. Write a marker that emphasizes
[0032]
FIG. 6 shows the operation of the monitoring system according to the present embodiment. Normally, in the present surveillance system, the video data (512-A to I) from the camera nodes (30-A to 30-I) that transmit the video data are transmitted to the WAN 11, the gateway devices (31-A to 31-E), The data arrives at the monitoring console 20 that receives the video data via the network 10.
[0033]
At this time, in addition to general video data, the video data (512-A to I-I) includes alarm information indicating urgency, video data for high-definition high quality, the position (latitude / longitude) of the video source, the address, Further, a map of the vicinity, an estimated threat rank, and the like may be transmitted. The transfer source of these data is the camera node (30-A to 30-I).
[0034]
Further, the monitoring console device 20 allows the camera node (30-A to 30-I) or the gateway device (31-A to 31-E) to permit video transfer, specify the accuracy of video transfer, and specify the camera angle. A request message (514-A-B) can be issued to transfer the position (latitude / longitude) of the image source, the address, and the estimated threat rank.
[0035]
FIG. 7 is a diagram illustrating a state where the multi-display 14 displays an image. The multi-display 14 includes a plurality of monitoring screens (called views) 14-A, 14-B, and 14-C. Each view has a touch panel, and it is possible to select an image and operate an icon or controller displayed on the display by touching the display. The view 14-A at the left end of the multi-display is a view displaying the video transmitted from the camera nodes (30-A to 30-I) designated by the monitoring console device 20.
[0036]
Among the images, the images 14-A-1 and 14-A-2 are selected by the image abnormality detection module 156 of the monitoring console device 20, or the camera nodes (30-A to 30-I). Shows the image selected by accompanying the alarm information, and blinks or a specific image so that the two images 14-A-1 and 14-A-2 can be easily detected by the monitoring operator 12. Masked with color. Here, it is assumed that the image 14-A-1 is masked in yellow and the image 14-A-2 is masked in red.
[0037]
The images 14-B-1 and 14-B-2 displayed on the view 14-B at the center of the multi-display are enlarged images of the images 14-A-1 and 14-A-2, respectively. The monitoring operator 12 uses the same color mask so that the correspondence between the image blinked or masked in the view 14-A and the image displayed in the view 14-B can be immediately detected. Have been. Further, at 14-B-3, the display position of the video is indicated by a numerical value. [1,3] indicates that there is an image corresponding to the first row and the third column. In addition, it is also possible to display the image of the view 14-A on the view 14-B by directly touching the image on the view 14-A.
[0038]
14-B-4 is a marker that emphasizes the object on which this video is selected. By the marker 14-B-4, the monitoring operator 12 can understand that the detection of the humanoid object at the lower left of the image is the basis of the selection.
[0039]
In these images, all of the plurality of images selected in the view 14-A or up to a predetermined upper limit number are displayed, and the size of each image depends on the number of displayed images. It changes dynamically.
[0040]
These images continue to be displayed while the abnormality detection state continues, but automatically disappear after the abnormality detection state has disappeared after being displayed on the view 14-B for a certain period of time. Then, the video left on the view 14-B is automatically relocated to an appropriate position.
[0041]
Furthermore, the monitoring operator 12 touches an image displayed in the view 14-B at the center of the multi-display, so that the image can be selected.
[0042]
When the user wants to forcibly delete the image displayed on the view 14-B, the user can touch the button 14-B-5 at the upper right of the image to realize the next abnormality. Not displayed again until detected.
[0043]
In the view 14-C at the right end of the multi-display, the image 14-B-1 selected by the monitoring operator 12 in the view 14-B at the center of the multi-display is displayed as the image 14-C-1.
[0044]
14-C-2 is the position information acquired from the GPS receiver 136 of the camera node 30 that is the transmission source of this video, or the position coordinate information, the address, and the position information referred to from the databases 26 and 28 of the monitoring console 20. The threat level determined by the camera node (30-A to 30-I) or the video abnormality detection module 156 or 210 of the monitoring console 20 is shown.
[0045]
14-C-3 is a map indicating the position of the camera node displayed by referring to the map database 28 of the monitoring console 20 based on the position coordinate information or the address.
[0046]
14-C-4 and 14-C-5 are controllers for changing the angle of the camera. The surveillance operator 12 can directly control the direction and the elevation angle of the camera by touching these controllers. As the controller, an appropriate controller corresponding to the actuator of the camera is dynamically displayed. For example, if the camera has a zoom function, a zoom icon is displayed to enable zoom control.
[0047]
14-C-6 is a marker that emphasizes the object on which this video is selected, like the marker 14-B-4.
[0048]
By touching the end button 14-C-7, the video and all objects on the view 14-C at the right end of the multi display can be deleted.
[0049]
FIG. 8 is a flowchart showing the operation sequence of the present embodiment in the operation of the multi-display 14 in FIG.
[0050]
The monitoring console device 20 transmits a transfer start request 608 to the camera node 30-B, so that the camera starts transferring the video. The video data is transmitted to the view 14-A via the monitoring console device 20 and displayed on the view 14-A. Will be displayed. This video information is continuously transmitted until a transfer end instruction is received.
[0051]
When the monitoring console 20 detects an abnormality in the video transferred from the camera node 30-B (610), the monitoring console 20 sends a fine video transfer request (612) to the camera node 30-B. At the same time, a blinking / color masking process is performed on the image corresponding to the view 14-A (614).
[0052]
The camera node 30-B changes the video mode to “fine” (616), and starts transferring the fine video data. When the fine video data passes through the monitoring console device 20, a marker 14-B-4 indicating that the video is detected as abnormal is added to the video (619), and then displayed in the view 14-B. Is done.
[0053]
In these images, all of the plurality of images selected in the view 14-A or up to a predetermined upper limit number are displayed, and the size of each image depends on the number of displayed images. Change dynamically.
[0054]
When the monitoring operator 12 touches the video displayed on the view 14-B, the view 14-B detects the touch and transmits the detected video to the monitoring console 20 including the information on the video. The monitoring console device 20 having received the information detects that the video is selected in the view 14-B (618), and requests the camera node 30-B to transfer the detailed information (620). .
[0055]
Upon receiving this request, the camera node 30-B collects detailed information such as the position (latitude / longitude), address, and expected threat rank of the camera node (622), and adds the detailed information to the detailed information. The video is transferred to the monitoring console 20, and the monitoring console 20 adds the map information and the like (623), and displays the detailed video and detailed information on the view 14-C.
[0056]
Further, when the view 14-C detects the operation of the controller for the camera controller (624), the monitoring operator 12 creates a camera control request message and transmits it to the camera node 30-B (625). In response to the request, the camera node 30-B performs camera attitude control, zoom control, and the like (626).
In the above flow, the role of the camera node may be replaced by the gateway device 31.
[0057]
FIG. 9 is a flowchart showing a continuation of the operation sequence of FIG.
[0058]
When the monitoring console device 20 detects (630) the touch (628) of the end button 14-C-7 of the view 14-C (630), the monitoring console device 20 transfers the detailed information to the camera node 30-B. An instruction is given to end the process (632). When the monitoring console device 20 detects (636) the touch (634) of the "x" button 14-B-5 at the upper right of the view 14-B (636), the monitoring console device 20 sends a fine definition to the camera node 30-B. An instruction is given to end the video transfer (638).
[0059]
The image displayed on the upper right of the view 14-B continues to be displayed while the abnormality detection state continues, but after the abnormality detection state disappears, when the monitoring console device 20 detects the elapse of a certain period of time. , The monitoring console 20 instructs the camera node 30-B to end the transfer of the definition video. When the monitoring console device 20 issues a video transfer end instruction to the camera node 30-B (640), the camera node 30 ends the video transfer (642).
[0060]
FIG. 10 is a flowchart describing a changed part of the operation sequence of FIG. 8 in another embodiment. In FIG. 9, the video anomaly detection is performed by the monitoring console device 20 (610), but this is performed by the camera node 30-B (610-A), and the video mode is autonomously changed (610). 616-A), a marker is added to the video indicating the reason why this video was detected as abnormal (619-A), and then the detailed video data is transferred to the monitoring console device 20.
[0061]
In the above embodiment, the touch on the screen is exemplified as a method of selecting an image, a button, and the like. However, as other selection methods, a method of pointing and clicking with a mouse operation, operating a cursor with a keyboard, or the like is used. Is also good.
[0062]
【The invention's effect】
ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to implement | achieve the abnormality detection of a monitoring target efficiently, simultaneously monitoring a large amount of images.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a monitoring system according to an embodiment.
FIG. 2 is a diagram showing a hardware configuration of the monitoring console device 20.
FIG. 3 is a diagram showing a hardware configuration of a camera node 30.
FIG. 4 is a diagram showing a software configuration of the console processing device 20.
FIG. 5 is a diagram showing a software configuration of the camera node 30.
FIG. 6 is a diagram showing an operation of the monitoring system.
FIG. 7 is a diagram showing a state where a multi-display 14 displays an image.
8 is a diagram showing an operation sequence in operating the multi-display 14. FIG.
FIG. 9 is a diagram showing an operation sequence in the operation of the multi-display 14.
FIG. 10 is a diagram showing another embodiment of the operation sequence in the operation of the multi-display 14.
[Explanation of symbols]
Camera 40, camera node 30, WAN 11, gateway device 31, monitoring console device 20, LAN 10, multi-display 14, mouse 24, keyboard 22, network connection controller 112, CPU 102 , Memory 104, input / output controller 106, monitor controller 108, map database 26, customer database 28, external device controller 109, bus 110, camera controller 136, CPU 132, memory 134, network Connection controller 130, GPS receiver 136, external device controller 138, bus 305, network control driver 174, communication management module 172, input / output device control driver 150, external device control driver 15 , Video control module ... 152, video abnormality detection module ... 156, camera control module ... 160, transmission queue ... 166, reception queue ... 170, network control driver ... 200, external device management module ... 202, camera control driver ... 218, camera Control module 216, transmission queue 206, reception queue 204, video data 512, video 14-A-1, 14-A-2, 14-B-1, 14-B-2, 14-C -1, threat level 14-C-2, map 14-C-3, controller 14-C-4, 14-C-5, abnormality detection 610, 610A, fine image transfer request 612, blinking・ Color mask processing: 614; image mode change: 616, 616-A; marker addition: 619, 619-A; image selection detection: 618; Information transfer request ... 620, detailed information collection performed ... 622, the camera posture control, zoom control performed ... 626

Claims (6)

In a monitoring system that monitors multiple images,
A surveillance system comprising: a first surveillance view that simultaneously displays a plurality of images; and a second surveillance view that displays images existing in the first surveillance view. The monitoring system according to claim 1,
A surveillance system, wherein in the first surveillance view, a video present in the second surveillance view is selected based on a predetermined criterion. The monitoring system according to claim 1,
A surveillance system characterized in that a video present in the second monitoring view is selected by an operator operation in the first monitoring view. The monitoring system according to claim 1,
A monitoring system, wherein a display position in the first monitoring view of a video present in the second monitoring view is notified to an operator. The monitoring system according to claim 1,
A surveillance system characterized in that features of a video present in the second surveillance view are emphasized and displayed to an operator. In the monitoring system according to claim 2 or 3,
A surveillance system wherein the selected video present in the second monitoring view contains more information than the video present in the first monitoring view, or includes other information of the video.

Images