JPH11355761A - Monitor system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To promptly and surely transfer and display video information corresponding to an abnormal part through a network. SOLUTION: In this monitor system 1, when abnormality is detected in a sensor 64, alarm information 14 for notifying it is transmitted from a sensor controller 52 and received by respective camera controllers 31-34. Then, at the time of judging that the abnormality is detected in the sensor 64 corresponding to a connected monitor camera 43 based on the received alarm information 14, the camera controller 33 starts transmission of the video information 15 of the monitor camera 43. The transmitted video information 15 is received by a monitor console processor 21 and displayed at a display device 22. Also, the respective camera controllers 31-34 are provided with a function for adjusting the video quality of the video information to be transmitted based on the received alarm information 14.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a monitoring system in which a plurality of sensors and a plurality of monitoring cameras are connected to a network and arranged for monitoring using abnormality detection information and video information obtained from the sensors.

[0002]

2. Description of the Related Art A conventional surveillance system using a sensor and a surveillance camera is disclosed in, for example, Japanese Patent Application Laid-Open No. 9-7559.
The rented room remote monitoring system described in Japanese Patent Publication No. 2 is cited. In this system, a sensor and a surveillance camera are installed in a room to be monitored, and sensor information and video information obtained by the surveillance camera are transmitted to a central monitoring station via a dedicated optical line. When the sensor detects an abnormality, first, the notification information is transmitted to the monitoring station via the optical dedicated line, and the video information is separately transmitted according to the instruction from the monitoring station.

On the other hand, there is a system in which video information of a plurality of monitoring cameras is transferred to a monitoring console processing device via a network and displayed on a display device. In this system, video information of all surveillance cameras is transferred over a network.

[0004]

In the above-mentioned conventional system for transferring video information of a plurality of surveillance cameras to a monitoring console processing device via a network, when the number of surveillance cameras increases due to the limitation of the amount of traffic on the network, Due to traffic congestion, delay or discard of video information (packets) transferred to the monitoring console processing device occurs. Further, since the amount of video information transferred from each monitoring camera must be limited to a small amount, it is not possible to provide a clear video of the abnormality detection location to the monitor.

Further, when the sensor abnormality detection information is transferred to the monitoring console processing device via a network, the abnormality detection information is likely to be delayed or discarded similarly to the video information. As a result, the person who monitors the console processing device cannot quickly and reliably know the abnormality detection information of the sensor.

On the other hand, when the video information is transferred in accordance with the instruction of the monitoring station as in the monitoring method of the rented room remote monitoring system, the abnormality detection information of the sensor is first sent to the monitoring station, and the abnormality is detected. The transfer of the video information is started when, for example, the observer of the monitoring station issues an instruction to transfer the video information to the monitoring camera at the location where the abnormality has occurred in accordance with the detection information. As described above, it is necessary to go through a plurality of time-consuming steps until the display of the video information, so that it is difficult for the observer to promptly check the video of the location where the abnormality has occurred.

Accordingly, the present invention provides a surveillance system that can quickly and reliably transfer and display video information corresponding to a location where an abnormality has occurred through a network even when many surveillance cameras are used. The purpose is to:

[0008]

In order to solve the above-mentioned problems, the present invention comprises a plurality of sensors, a plurality of sensor control devices respectively connected to one or more of the sensors, and
A plurality of surveillance cameras, a plurality of camera controllers respectively connected to the surveillance cameras, a monitor console connected to the display device, and the sensor controller, the camera controller, and the monitor console. A monitoring system having a network connected to the camera, wherein, when the connected sensor detects an abnormality, the sensor control device has means for sending alarm information for notifying the detection to the network, and the camera A control unit configured to receive the alarm information; and a unit configured to determine, based on the received alarm information, whether an abnormality has been detected by a sensor corresponding to the monitoring camera connected to the control unit. Means for transmitting video information of a monitoring camera connected to the own device to the network when an abnormality is detected by a sensor that performs the operation. The monitoring console processing apparatus includes means for receiving image information sent from the camera control unit,
And a control means for displaying the received video information on the display device.

[0009]

DESCRIPTION OF THE PREFERRED EMBODIMENTS A monitoring system according to an embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a diagram showing an overall configuration of a monitoring system 1 according to an embodiment of the present invention. As shown,
The monitoring system 1 includes video cameras 41 to 44 for monitoring,
Camera control devices 31 to 34, sensor group 6 for abnormality detection
1 to 69, sensor control devices 51 to 53, a monitoring console processing device 21, and a network 10.

The monitoring console processor 21 is a computer having a communication function and an image display function, and includes a monitor (large display) 22, a keyboard 23, a mouse 24,
And, it is connected to the network 10.

The sensors 61 to 69 detect abnormalities such as abnormal opening and closing of doors and abnormal ignition, and are connected to the network 10 via sensor control devices 51 to 53 having a communication function. An identifier is assigned to each of the sensors 61 to 69 in advance.

The video cameras 41 to 44 generate video data representing the video at the monitoring position, and are connected to the network 10 via camera control devices 31 to 34 having a communication function. An identifier is assigned to each of the video cameras 41 to 44 in advance.

Here, the sensors 61 to 69 and the video cameras 41 to 44 are associated with each other in advance.
For example, the sensor 64 detects abnormal opening and closing of a door,
There is a correspondence such that the video camera 43 takes an image around the door.

As the network 10, a local area network such as an Ethernet network is used. Note that another type of network (for example, a wide area network) may be used as long as it can perform broadcast or multicast that can broadcast a packet to a plurality of devices on the network.

In each of the camera control devices 31 to 34, management information including an identifier of a sensor corresponding to the connected video camera is set in advance. Further, each of the camera control devices 31 to 34 has a function of band control processing for adjusting the resolution (the number of display pixels) and the frame rate of the video data to be transferred.

Next, a specific example of the characteristic operation of the monitoring system 1 will be described with reference to FIG. Here, it is assumed that the identifier of the sensor 64 is set only in the camera control device 33.

In FIG. 2, when an abnormality is detected by the sensor 64, the sensor controller 52 sets a packet (hereinafter, an alarm packet) 1 in which an identifier of the sensor 64 is set.
4 to the network 10 by broadcast.
This alarm packet 14 is transmitted to each of the camera control devices 31 to 31.
34 respectively.

In the camera control device 33, since the same information as the sensor identifier in the received alarm packet 14 is set as the management information, the packet in which the video data from the camera 43 and the content of the abnormality are set (hereinafter referred to as sensor cooperation). The video packet 15 is transmitted to the monitoring console processing device 21. On the other hand, other camera control devices 31, 32,
At 34, since the received sensor identifier is not set, the video data is not transferred.

The transmitted sensor cooperation video packet 15
Is received by the monitoring console processing device 21 and is automatically displayed on the monitor 22 as a sensor cooperation image.

Each of the camera control devices 31 to 34 receives a packet in which video data is set (hereinafter referred to as a normal video packet) in response to a request from the monitoring console processing device 21 even when no abnormality is detected by the sensor groups 61 to 69. ) To the monitoring console processing device 21. The video camera that normally transmits the video packet is specified by the observer.

When the camera control devices 31, 32, and 34 receive the above-described alarm packet 14 while transmitting a normal video packet in response to a request from the monitoring console processing device 21, the video data to be transferred is processed by a band control process. Reduce the amount of data. On the other hand, the camera control device 33 transmits the alarm packet 14 when the normal video packet is being transferred.
, A band control process for improving the video quality is performed, and the data amount of the video data to be transferred is increased.

It is also possible to associate a plurality of video cameras with one sensor and monitor the abnormal part from a plurality of video cameras.

As described above, in the monitoring system 1, when an abnormality is detected, the camera control devices 31 to 34 and the sensor control devices 51 to 53 cooperate to transfer video data.
Since the video data is automatically displayed on the monitor 22, the monitor can promptly check the video of the abnormality detection location. In addition, the processing load on the monitoring console processing device 21 is reduced, and no malfunction such as an incorrect selection of the video camera occurs.

In the monitoring system 1, usually, only the video packet of the video camera designated by the monitoring console processor 21 is transferred, and when an abnormality is detected, the video data which does not correspond to the abnormal part is subjected to the data amount control by the band control processing. Is reduced, the communication volume of the network 10 has a margin, and the video data of the location where the abnormality occurs is transferred to the monitoring console processing device 21 at high speed and reliably.

Next, the configuration of the monitoring system 1 will be described in more detail.

FIG. 3 shows a camera controller 3i (31 to 3).
4) shows the hardware configuration. Each camera control device 3i
Are a camera controller 301 for controlling the connected video camera 4i, a CPU 302, a memory 303
, A network connection controller 304 and a bus 305 connecting these components.

FIG. 4 shows a sensor controller 5i (51 to 5).
The hardware configuration of 3) is shown. Each sensor control device 5
i is the setting of the connected sensor group 6i or the sensor 6i
A sensor controller 501 for reading an abnormality detection signal from the CPU, a CPU 502, a memory 503, a network connection controller 504, and a bus 505 for connecting these components.

FIG. 5 shows a hardware configuration of the monitoring console processing device 21. As shown, the monitoring console processing device 21
Network connection controller 201 and CPU 20
2, a memory 203, an input / output controller 204 for controlling a keyboard 23, a mouse 24 and the like, and a monitor controller 20 for controlling the monitor 22.
5 and a bus 206 connecting these components. The data stored in the memory 203 may be stored in a hard disk device and transferred from the hard disk device when the monitoring console processing device 21 is started.

Next, the functional configuration of each device will be described.

FIG. 6 shows the memory 20 of the monitoring console processor 21.
FIG. 3 is a diagram showing a software and a block configuration of a table stored in a storage device 3; The table and the software are accessed and executed by the CPU 202.

The memory 203 stores a network control driver 211, a communication management module 212, and an input / output device control driver 213 as software for realizing an input / output function with the outside. Here, the network control driver 211 controls the network connection controller 201 to perform communication on the network 10. The communication management module 212 manages the communication, and performs one-to-one communication for transferring a packet to and from a designated device and broadcast communication for transferring a packet to all devices on a network. Can be. The input / output device control driver 213 includes:
The monitor 22, the keyboard 23, the mouse 24 and the like are controlled.

The memory 203 stores a monitoring window control module 214 and a video / alarm display module 215 as software for realizing main functions. Here, the monitoring window control module 214 performs an operation of receiving data from the input / output device control driver 213 and transmitting the data to the communication management module 212 via the transmission queue 216. The video / alarm display module 215 performs an operation of receiving data from the communication management module 212 via the reception queue 217 and transmitting the data to the input / output device control driver 213.

Further, in the memory 203, a monitoring window status management table 218 in which the status of the monitoring window is set, a monitoring window status transition table 219 in which processing branch information is set, and an operation status of the entire system are set. And an evacuation video buffer 221 for holding video data whose display has been stopped by the abnormality detection.

FIG. 7 shows the memory 30 of the camera control device 3i.
FIG. 3 is a block diagram showing a configuration of software and a table stored in the software 3; The table and the software are accessed and executed by the CPU 302.

The memory 303 has a network control driver 311 as software for realizing an input / output function.
And a communication management module 312 and a camera control driver 313 for controlling the video camera 4i.

The memory 303 stores camera control module 314 as software for realizing the main functions.
And a video transmission module 315 are stored. Here, the camera control module 314 sets the reception queue 31
6 to receive data from the communication management module 312 via the communication control module 6 and send control data to the camera control driver 313. The video transmission module 315 receives video data from the camera control driver 313 and sends the video data to the transmission queue 317.
An operation of transmitting data to the communication management module 312 via the.

The memory 303 has a camera state management table 318 in which video camera states such as resolution and frame rate values are set as management tables.
A cooperative sensor management table 31 in which management information including a sensor ID is set, which enables an operation cooperative with the sensor.
9 are stored.

FIG. 8 shows the memory 5 of the sensor control device 5i.
FIG. 3 is a diagram showing a software and a block configuration of a table stored in a memory device 03. The table and the software are accessed and executed by the CPU 502.

The memory 503 includes a network control driver 511 as software for realizing an input / output function.
And a communication management module 512 and a sensor control driver 513 for controlling the sensor 6i. In addition, as software that realizes the main functions,
A sensor control module 514 and an alarm transmission module 515 are stored. Here, the sensor control module 514 performs an operation of receiving the received data from the communication management module 512 via the reception queue 516 and transmitting the control data to the sensor control driver 513. The alarm transmission module 515 receives the detection data from the sensor control driver 513, and
7 to the communication management module 512.
Further, the memory 503 stores a message management table 518 in which various information to be set in an alarm packet to be transmitted when the sensor detects an abnormality is set.

Next, the operation of the monitoring system 1 will be described with reference to a flowchart.

The operation of the surveillance system 1 includes an operation at the start of system operation, an operation at the time of normal operation for displaying an image of a video camera designated by the observer, an operation at the time of detecting an abnormality by a sensor, and handling of a detected abnormality. The operation can be divided into an operation when the operation is completed and the operation returns to the normal operation, and an operation when the system operation ends.

(1) Operation at the Start of System Operation The monitoring system 1 starts the monitoring console processing device 21
Operation is started. When the monitoring console processing device 21 is activated, first, the monitoring window control module 214 is activated, and the processing of the flow shown in FIG. 9 is executed.

In FIG. 9, the monitoring window control module 214 first initializes the contents of the tables 218 to 220 and the evacuation buffer 221 in the monitoring console processor 21 (processing 701), and then changes the basic window to the monitor 22.
(Process 702), and waits for menu input (process 703). Here, the basic window is a screen that displays a menu of “start” and “end” at the top as shown in FIG. This menu is displayed when the observer uses mouse 2
4 can be specified. When the menu is specified, the monitoring window control module 214 checks the contents (process 704). If the specified is "start", the operation status in the operation status management table 220 is checked (process 707). If the operation status is in operation, an error is displayed (process 708), and menu input is performed. It goes into a waiting state. If the operation state is the initial state, an operation start packet is created and input to the transmission queue 216 in order to simultaneously start up the camera groups 41 to 44 and the sensor groups 61 to 69 distributed on the network. Broadcast the communication management module 21
2 (process 709).

Here, each device 21 in the monitoring system 1
Packets transmitted and received between 3i and 5i are composed of header sections 71 to 74 and a data section 75 as shown in FIG. The header section includes a setting area 71 for a transaction code (hereinafter, TCD) indicating the type of packet, a setting area 72 for an address SA of a transmission source apparatus, a setting area 73 for an address DA of a transmission destination apparatus, and a data area 75. And a setting area 74 for the data length L.

As the address of each device, an address previously allocated in the monitoring system 1 is used. The broadcast is performed by setting a predetermined value (for example, “0”) as the destination address DA. Each of the communication management modules of the monitoring console processing device 21, the camera control device 3i, and the sensor control device 5i receives a packet in response to a reception request of a higher-level module (215, 314, 514). Then, only the received packet having the TCD specified in the reception request is passed to the upper module.

The above-mentioned operation start packet generated by the console processing unit 21 is set via the network control driver 211 after setting the TCD indicating the operation start packet and the transmission destination address designating the broadcast. And broadcast on the network 10. Then, it is received by all camera control devices 3i and sensor control devices 5i.

The packet received by the camera control device 3i is passed to the camera control module 314 via the communication management module 312. The packet received by the sensor control device 5i is passed to the sensor control module 514 via the network control driver 511.

FIG. 19 is a processing flow of the camera control module 314 in the camera control device 3i. When activated, the camera control module 31 issues a packet reception request to the communication management module 312 and enters a packet reception waiting state (process 801). When the operation start packet is received in this state, the packet is received and the TCD is checked (process 802). When the TCD determines that the packet is an operation start packet, the video camera is powered on (process 803), and again enters a packet reception waiting state.

FIG. 21 is a processing flowchart of the sensor control module 514 in the sensor control device 5i. When activated, the sensor control module 514 issues a packet reception request to the communication management module 512 and enters a packet reception waiting state (process 901). When the operation start packet is received in this state, the packet is acquired, and T
Check the CD (process 902). If it is determined that the packet is an operation start packet, all connected sensors are set to a set state in which abnormality can be detected (step 90).
3), it is again in a packet reception waiting state.

By the above operation, all the sensors 61 to 61
69 and the video cameras 41 to 44 are put into operation.

(2) Operation in Normal Operation After broadcasting the operation start packet, the monitoring window control module 214, as shown in FIG.
Multiple monitoring windows 2 inside the basic window 231
41 to 246 are displayed (process 710 in FIG. 9). Subsequently, after initializing the monitoring window status management table 218 (process 711), the system enters a menu input waiting status in the monitoring windows 241 to 246 and the basic window 231 (process 712).

Each of the monitoring windows 241-246 is shown in FIG.
As shown in FIG. 3, a “camera designation” 2401 for designating a camera to be monitored is provided as a menu at the top,
“Image recovery” 2402 for instructing to restore the display image from the image at the abnormality detection point to the original image is displayed. Further, a display area 2403 of an alarm message indicating the content of the detected abnormality is provided at a lower portion, and a display area 2404 of video data from the monitoring camera is provided at the center.

Monitoring window status management table 218
Are the monitoring windows 241 to 24, as shown in FIG.
Entry 2181 to 2186 corresponding to each of 6
Having. Each entry includes a status field 2187 in which the status of the corresponding monitoring window is set, and a display video information field 2188 in which the video display status of the monitoring window is set.

Here, the status set in the status field 2187 includes a Null status in which no video is displayed, a manual status in which video of a video camera designated by a monitor is displayed, and a sensor abnormality detection. There is a sensor cooperation state in which an image of an abnormal part is displayed according to the condition.

The display video information field 2188 is shown in FIG.
As shown in FIG. 6, for the currently displayed video, a camera ID setting field 2189 of the video data generation source
, A resolution setting field 2190, a frame rate setting field 2191, and a sensor ID setting field 2192 for displaying a sensor cooperation image.

Further, a display video information field 2188
Are fields 2193-2 for managing evacuation images
196. Here, the evacuation image is an image of which the display is interrupted by the display of the sensor cooperation image among the images displayed in the manual state. In the fields 2193 to 2196, a flag indicating presence / absence of an evacuation video, a camera ID, a resolution, and a frame rate value are set, respectively.

In the above menu 712 (FIG. 9) waiting for menu input, when the monitor specifies a menu, the monitoring window control module 214 checks whether the specified menu is a menu in the basic window. (Step 713). When the menu of the basic window is instructed, the process returns to the process 704, and the process according to the content of the instruction is performed. On the other hand, when the menu in the monitoring window is designated, the monitoring window status management table 2
With reference to No. 18, the display state of the monitoring window is acquired (process 714). Then, using the designated menu and the acquired display state, the monitoring window state transition table 219 is searched for a branch destination process (process 71).
5).

The monitoring window state transition table is shown in FIG.
As shown in FIG. 7, the processing at the branch destination is determined by the state of the monitoring window and the designated menu. The processing at the branch destination includes switching processing for switching the display video from the current state to the video of another camera, recovery processing for returning the display video from the sensor cooperation video to the target video before abnormality detection, and incorrect instruction And error handling to deal with.

In the switching process, upon receiving designation of data relating to the switching source and switching destination video cameras,
The camera that generates the video data to be displayed is switched. However, if the camera to be switched to is not specified, the current video display is stopped.

Here, nothing is displayed (Nu
It is assumed that the observer has instructed “camera designation” in the monitoring window in the (11 state). In this case, in the processing 715 of FIG.
9 to select a switching process, and display a camera selection window (process 716).

As shown in FIG. 14, this camera selection window has a camera ID input area 2405, a resolution input area 2406, and a frame rate input area 2407. The monitor uses the mouse 24 and the keyboard 23 to input values into these areas, and presses the OK button 2408 to complete the input.

When the input of the camera selection window is completed, the monitoring window control module 214 sets the manual status in the status field 2187 in the corresponding entry in the monitoring window status management table 218, and sets the fields 2189, 2190, 219
The respective values of the camera ID, resolution, and frame rate input in the camera selection window are set to 1 (process 717). Then, it creates a camera switching packet and requests the communication management module 212 to broadcast (process 718). Thereby, the camera switching packet in which the TCD indicating the camera switching packet is set is transmitted and received by each of the camera control devices 31 to 34.

The data part 75 of the camera switching packet is
As shown in FIG. 23, a setting area 81 of a camera ID of a current display image generation source, a camera ID setting area 82 of a camera to be a new display image generation source, a resolution setting area 83, a frame And a rate setting area 84.

Since the camera switching packet generated in the above-described processing 718 is for designating a camera from a state of no display, “0” meaning no designation is set in the area 81 of the camera ID of the switching source. And the area 82 of the switching destination camera ID, resolution, and frame rate.
In 84, the value input by the monitor in the process 716 is set.

When the error processing is selected from the monitoring window state transition table 219 in the above-mentioned processing 715, a packet indicating an error of the menu instruction is displayed on the monitor 22 (processing 719), and the menu input wait state is resumed. State.

The camera switching packet broadcast to the network 10 is received by all the camera control devices 31 to 34, passed to the camera control module 314 via the communication management module 312, and processed in FIG. 801 and 802 are received. TC
Since it is known from D that the packet is a camera switching packet, it is checked whether the same ID as the ID of the video camera connected to the own camera control device 3i is set in the area 81 or 82 in the data section 75 ( Process 804).
If the area is not set in any of the areas, the received packet is discarded because it is not related to the own camera control device 3i (process 805), and the apparatus returns to the packet reception waiting state.

If the same ID as that of the connected video camera is set, it is checked whether it is the switching destination or the switching source (step 806). If the video camera is set as the switching source, a command is sent to the video camera to stop the transmission of the video data of the video camera, and the operation is stopped (process 807).
8 is updated (process 808).

As shown in FIG. 24, the camera status management table includes an operation area setting area 3181 of a connected video camera, an address setting area 3182 of a monitor processing device to which video data is to be transferred, Resolution setting area 3183 and frame rate setting area 31
84, a setting area 3185 of the sensor ID when the image is transferred in cooperation with the sensor, and a setting area 318 of the alarm message and its data size.
6, 3187 and the setting area 31 of the resolution and frame rate when the video is transferred before the sensor cooperation
88, 3189.

Here, the state set in operation state area 3181 is a state in which no video is transferred.
An FF state, a manual state in which the image is being transmitted by the observer's instruction, a sensor cooperation state in which the image is being transmitted in conjunction with the sensor abnormality detection, In the cooperative state, there is a band suppression state in which the resolution and the frame rate are reduced to restrict traffic.

After the video camera has been stopped in step 807, the OFF state is set in the state field 3181 of the camera state management table 318 (step 80).
8).

In the above processing 806, the camera ID of the switching destination is the ID of the video camera of the own control device 3i.
If it is the same as above, first, the resolution and frame rate in the camera switching packet are fetched (process 809), and these information are set in the video camera via the camera control driver 313 (process 810). Then, the manual state is set in the state field 3181 of the camera state control management table 318, and the fields 3182, 3183, 31 are set.
At 84, the source address (address of the monitoring console processing device 21), the resolution, and the frame rate in the camera switching packet are set (process 811), and the packet reception waiting state is set again.

The video camera set in the above process 810 starts outputting video data of the captured video to the camera control device 3i at the specified resolution and frame rate. Then, the video transmission module 215 in the camera control device 3i starts transferring the packet in which the input video data is set to the monitoring console processing device 21 via the network 10.

FIG. 20 is a processing flow of the video transmission module 215 in the camera control device 3i. When activated, the video transmission module 215 waits for an interrupt from the camera control driver 313 (process 851).
When the video camera starts outputting video data, the video data and an interrupt signal are passed from the camera control driver 313. Then, the received video data is captured in units of frames (process 852), and the current status is checked with reference to the operation status field 3181 in the camera status management table 318 (process 854). If the state is the manual state, a normal video packet in which frame data is set is created, and a packet transfer is requested to the communication management module 312 (process 856). As a result, transfer of the TCD indicating a normal video packet and the normal video packet in which the address of the monitoring console processing device 21 is set as the destination address are started.

Here, the data portion 75 of the normal video packet
As shown in FIG. 25, the setting area 85 of the ID of the source camera, the setting area 86 of the frame rate, and the setting area 87 of the data size of the video frame data body
And a setting area 88 for video frame data.
The normal video packet is transmitted from the camera control device 3i to the monitoring console processing device 2 so as to satisfy the above-mentioned frame rate.
Transferred to 1.

FIG. 10 shows the video / video in the monitoring console processor 21.
9 is a processing flow of the alarm display module 215. When activated, the video / alarm display module 215
The process enters a packet reception waiting state (process 751). When the normal video packet is received in this state, an interruption of the communication management module 212 is received and the TCD of the received packet is received.
Is checked (processing 752). When it is determined that the normal video packet has been received, processing for displaying the video in the monitoring window is started. First, the ID of the source camera is extracted from the camera ID field 85 of the received normal video packet (process 753). Next, in the monitoring window state management table 218, the same ID as the extracted camera ID is set in a field 2189. A search is made for an entry that exists (process 754). If there is a matching entry, the corresponding window number and the frame data in the received packet are passed to the input / output control device driver 213, and a video output to the monitor 22 is requested (process 75).
5). As a result, one frame of the normal video is displayed in the monitoring window. Then, normal video packets are sequentially received so as to satisfy the frame rate, and the above-described processes 751 to 755 are repeated, whereby video data is displayed in a monitoring window in real time.

As described above, the image of the video camera designated by the observer on the monitor processing unit 21 is displayed on the monitor window of the monitor 22.

(3) Operation when sensor abnormality is detected FIG. 22 shows the alarm transmission module 515 when abnormality is detected.
It is a processing flow of. When the sensor detects an abnormality,
The alarm transmission module 515 in the sensor control device 5i connected to the sensor is activated. The activated alarm transmission module 515 first searches the message management table 518 for an entry corresponding to the sensor that has detected the abnormality, and acquires the entry (process 951). The message management table 518 has, for each connected sensor, an entry including a sensor ID, an alarm message (for example, character information such as “occurrence of door abnormal opening / closing”), and a data size of the alarm message. Subsequently, the alarm transmission module 515 creates an alarm packet using the obtained entry (processing 9
52), request the communication management module 512 for the broadcast. Thereby, the alarm packet is broadcast on the network 10.

The data part 75 of the alarm packet is shown in FIG.
As shown in FIG. 6, the sensor I of the sensor that detected the abnormality
D has a setting area 91, an alarm message setting area 93, and an alarm message data size setting area 92.

The alarm packet broadcast on the network 10 is transmitted to all the camera control devices 31 to 31.
34, and passed to the camera control module 314.

In FIG. 19, the camera control module 3
When the alarm packet is received (step 80)
1), the TCD determines that the packet is an alarm packet (process 802), and accesses data in the cooperative sensor management table 319 (process 812).

The cooperative sensor management table 319 is shown in FIG.
As shown in FIG. 7, an area 3191 in which an ID of a sensor that needs to perform video transfer in cooperation is set, and a resolution and a frame rate of video data to be transferred are set in accordance with abnormality detection of the sensor. Area 31
92 and 3193. here,
The resolutions and frame rates of the areas 3192 and 3193 are set in advance to values that are higher in resolution and frame rate than usual in order to enable more detailed video display.

Then, the camera control module 314
By checking whether or not the same sensor ID in the received alarm packet is set in the cooperative sensor management table 319, it is determined whether or not to start transmitting the transfer sensor cooperative video packet (step 813). .
If the same sensor ID is set, it is determined that transmission is to be started, and then it is checked whether or not a normal video packet is currently being transmitted (process 814). If transmission is in progress, band control processing for improving the quality of the video data to be transferred is performed.

In this band control processing, first, the resolution and frame rate of the currently transferred video set in the areas 3183 and 3184 of the camera status management table 318 are set in the areas 3188 and 3189 (evacuated).
(Step 815). Subsequently, the resolution and frame rate of the cooperative sensor management table 319 are set for the video camera (processing 816). Then, the same resolution and frame rate are set in the fields 3183 and 3184 of the camera state management table 318, and the sensor ID, the alarm message, and the size in the received alarm packet are set in the fields 3184, 3187, and 3184.
186 respectively, and the operation state field 3181
After the sensor cooperation state is set (step 817), the apparatus enters the packet waiting state. If it is determined that the image is not being transferred in the above process 814, the processes 816 and 817 are executed without executing the process 815.

As a result, the video camera outputs video data having a high resolution and a high frame rate and a large data amount.

On the other hand, the camera control device that does not cooperate with the sensor that has detected the abnormality determines in step 813 that transmission of the sensor cooperative video packet is not necessary. Subsequently, the camera control module 314 checks the operation state set in the field 3181 of the camera state management table 318 to check whether or not a normal video packet is being transmitted (step 818). When the operation state is the OFF state, transmission is not being performed, and the packet reception wait state is left as it is. When the operation state is the manual state, since the normal video packet is being transmitted, the resolution and the resolution of the video data to be transferred are set so that the transfer and display of the sensor cooperation video packet by other camera control devices are performed without delay. A band control process for reducing the frame rate is performed.

In this band control process, first, the resolution and frame rate of the video currently being transferred are stored in the save field 31 in the camera status management table 318.
88 and 3189 (step 819), and a smaller resolution and frame rate are set for the video camera (step 820). At this time, the resolution and the frame rate are, for example, １ ／ of those in the normal operation. Subsequently, the same resolution and frame rate are set in fields 3182 and 3183 of the camera state management table 318, and the received sensor ID is set in the field 318.
4 and the band suppression state is set in the operation state field 3181 (processing 821). Then, a packet waiting state is set.

As a result, the video camera outputs video data with a reduced resolution and a reduced frame rate and a small data amount. In the above-described band control process, transmission of the normal video packet itself may be stopped.

When the operation state of the camera control device shifts from the OFF state to the sensor cooperation state due to the reception of the alarm packet, the output of the video data of the video camera is started. As a result, the video transmission module 315
0 processing 851 to 854 are executed. Then, since the operation state is the sensor cooperation state, a sensor cooperation video packet in which the fetched frame data is set is created (process 857), and the transmission to the monitoring console processing device 21 is requested to the communication management module 312. Thus, the transfer of the sensor cooperation video packet in which the TCD indicating the sensor cooperation video packet is set to the monitoring console processing device 21 is started.

Data part 75 of sensor cooperation video packet
Is a normal video packet (FIG. 25) as shown in FIG.
Has an area 101 in which an ID of a cooperating sensor is set, an area 103 in which an alarm message is set, and an area 103 in which a data size of the alarm message is set. These areas 1
Data set in fields 3183 to 3187 of the camera state management table 318 are set in 01 to 106.

When the operation state shifts from the manual state to the sensor cooperative state, the packet to be transmitted changes from a normal video packet to a sensor cooperative video packet, and video data of higher video quality is transferred.

As described above, the video data of the video camera corresponding to the sensor that detected the abnormality is transferred to the management console processing device 21 by the sensor cooperation video packet.

In FIG. 10, when the sensor cooperation image packet is received, the video / alarm display module 215 in the monitoring console processing device 21 executes the TC 75
D determines that the packet is a sensor cooperation packet. Subsequently, the status field 2187 of the monitoring window status management table 219 is sequentially checked from the top, and a null monitoring window (empty window) that is not currently displayed is searched for. If a null monitoring window is found, fields 2192, 2189, and 219 in the display video information field 3188 of the same entry are found.
At 0 and 2191, the cooperative sensor ID, camera ID, resolution, and frame rate in the received sensor cooperative video packet are set (process 760). Thereafter, the monitoring window of this entry will be used for alarms. Subsequently, the alarm message and the frame data in the sensor cooperation video packet are passed to the input / output device control driver 213, and the alarm message display area 24 in the alarm monitoring window (FIG. 13) is provided.
03 and the video display area 2404 (processes 761 and 762). This display allows the watcher to
It is possible to obtain the content of the abnormality that has occurred and the image of the abnormal location.

If there is no empty window in the above processing 759, the video / alarm display module 215
Of the normal image saving process (process 763). Specifically, first, the status field 2187 of the monitoring window status management table 218 is sequentially checked from the top to search for an entry in the manual status. Then, in the display video information field 3188 of the found entry,
Camera ID, resolution of fields 2189-2191,
Also, the frame rate is set in the save field 219.
4 to 2194, and a field 2194 is set to indicate that an evacuation image exists. And field 2189
The setting using the received sensor cooperation video packet is performed for to to 2192 in the same manner as in the above process 760.
Subsequently, by executing the processes 761 and 762, a display corresponding to the received sensor cooperation video packet is displayed on the monitoring window.

Thus, the monitoring person can monitor the monitoring window 2
Even when a normal image is displayed on all of 41 to 246, if an abnormality occurs, the occurrence of the abnormality and the image of the abnormality detection location can be quickly known.

On the other hand, when the normal video packet which has been saved by the normal video saving process 763 is received, the video / alarm display module 215 executes the processes 756 to 757 of FIG. An operation of writing to the save video buffer 221 is performed. Note that a storage capacity for a plurality of frames may be provided in the evacuation video buffer 221 so as to support detection of an abnormality at a plurality of locations.

The image / alarm display module 215
When a normal video packet is received, first, field 2 of each entry of the monitoring window status management table 220
194 is checked to find an entry in the received normal video packet in which the same ID as the source camera ID is set (process 756). If there is an entry with the same ID, the received frame data is written into the save video buffer 221 (processing 757), and the apparatus enters a reception wait state. If there is no entry with the same ID set, the received packet is discarded (processing 758), and the apparatus enters a reception waiting state. Note that in the above-described processing 757, the camera I
The ID of the source camera is added to the head of the stored frame data and written so that the storage position of the target frame data can be found using D.

(4) Operation at the time of recovery to normal operation The observer instructs the start of the recovery operation by designating “recovery” in the menu of the monitoring window displaying the sensor cooperation image. When “recovery” is specified in the monitoring window, the monitoring window control module 214 in the monitoring console processing device 21 performs the processes 712, 713, and 71 in FIG.
After Step 4, the process 715 is executed. At this time, since the state of the monitoring window is the sensor cooperation state and the instruction is “recovery”, the monitoring window state transition table 219 (FIG. 17)
More recovery processing is selected and executed.

In the recovery process, first, the entry of the designated monitoring window is searched in the monitoring window status management table 218, and the presence or absence of a saved image is checked from the field 2193 (process 720). If there is an evacuation video, fields 2189-2 in the same entry
192 setting is deleted and there is a save field 2
The camera ID, resolution, and frame rate of 194 to 2196 are newly set. And the status field 2187
Is set to the normal state, and no saved image is set in the field 2193 (process 721). Subsequently, using the newly set camera ID, the evacuation video buffer 221 searches for the latest corresponding normal video frame data, passes the frame data to the input / output device control driver 213, and displays it on the monitor 22. Request (process 722). As a result, the latest video at the position monitored before the display of the sensor cooperation video is displayed almost simultaneously with the “recovery” instruction, though it is a still video. That is, the observer can quickly return to normal operation.

If there is no evacuation video in the above processing 720, the display video information field 218 of the entry
8, camera ID, resolution, frame rate, and
Delete the cooperative sensor ID. Then, Null is set in the status field 2187 of the monitoring window status management table.
The state is set (process 724), and the monitoring window displaying the sensor cooperation video is initialized (process 72).
5).

After the processes 722 and 725, the monitoring window control module 214 performs a process of transmitting an alarm recovery packet (process 723). In this process, first, an alarm recovery packet is created using the settings deleted in the above process 722. Here, the data part of the alarm recovery packet includes, as shown in FIG. 29, a setting area 111 of the camera ID that has performed the cooperative operation and a cooperative sensor ID.
And a setting area 112. Then, the monitoring window control module 214
Is requested to broadcast (process 723), and the system enters a menu input waiting state. As a result, the alarm recovery packet is transmitted by broadcast.

When the camera control module 314 in the camera control device receives the alarm recovery packet, the camera control module 314 in FIG.
The processing advances to processing 822 through the processing 801 and 802 of the field 802, and the field 3 in the camera state management table 318 (FIG. 24)
At 181 the current operating state is checked.

When the operation state is the OFF state, the apparatus directly enters the packet reception waiting state. When the operation state is the band suppression state, the resolution and the frame rate saved in the fields 3188 and 3189 are changed to the fields 31188 and 3189.
The values are reset to 83 and 3184 (process 823), the same value is reset to the video camera (process 824), and a packet reception wait state is set. As a result, video information is output from the video camera at the resolution and frame rate before band suppression. Then, in the video transmission module 315 of the camera control device, an operation of transferring the normal video packet in which the video data is set to the monitoring console processing device 21 is performed.

In the above processing 822, if the operation state is the sensor cooperation state, the camera control module 3
14 is a field 3 of the camera status management table 318
It is checked whether or not information relating to the evacuation video is set in 188 and 3189 (process 825). When there is no valid setting (that is, when the initial value “0” is set)
Is a case where the normal video packet has not been transmitted before the sensor cooperation, so that a command instructing stop of video output is issued to the camera (process 826), and the OFF state is displayed in the field 3181 of the camera status management table 318. Is set, and a packet reception waiting state is set.

If there is a valid setting in the above processing 825, the values of the resolution and the frame rate saved in the fields 3188 and 3189 are replaced with the fields 3183 and 3189.
After resetting to 3184, fields 3188, 31
A value of 89 is set and cleared (step 828). Then, the reset resolution and frame rate are reset for the camera (process 829), and the apparatus enters a packet reception waiting state. As a result, video data is output from the video camera at the resolution and frame rate before sensor cooperation,
The normal video packet in which the video data is set is transferred to the monitoring console processing device 21.

On the other hand, upon receiving the alarm recovery packet, the sensor control module 514 in the sensor control device proceeds to the process 904 via the processes 901 and 902 in FIG. Then, the cooperative sensor ID set in the received packet is acquired, and the sensor with the same ID is connected to the own sensor control device (or a sensor group).
Check to see if it is. If there is a sensor having the same ID, the sensor is reset (step 905) so that abnormality detection is newly started. Also, the same ID
If there is no such sensor, the packet reception waiting state is left as it is.

(5) Operation at the time of terminating the system Finally, the operation when terminating and stopping the monitoring system 1 will be described. When stopping the operation of the system, the monitor designates “end” in the menu of the basic window (FIG. 11) on the monitor 22.

When "end" is designated, the processing of the monitoring window control module 214 in the monitoring console processing apparatus shifts from the processing 713 or 712 in FIG. 9 to the processing 705 via the processing 704. As a result, the monitoring window control module 214 generates a system end packet in which the TCD indicating the system end is set, and broadcasts it to the entire system (process 705). Then, the display of the monitoring window and the basic window ends, and the process ends (process 706).

In the camera control device that has received the system end packet, the camera control module 314 determines that the packet is a system end packet, and performs processing 803 shown in FIG.
To turn off the power of the video camera and terminate all the video transfer processing.

In the sensor control device that has received the system end packet, the sensor control module 514 determines that the packet is a system end packet, and executes a process 906 as shown in FIG.
It is set to F, and all the abnormality detection processing ends.

In the above description of the operation, it is assumed that one video camera performs photographing corresponding to a sensor that has detected an abnormality, and a sensor cooperation video packet is transmitted from one camera control device when an abnormality is detected. Stated.
Of course, shooting corresponding to one sensor can be performed by a plurality of video cameras. In this case, when an abnormality is detected, cooperative images transferred by a plurality of camera control devices are displayed in separate monitoring windows.

As described above, according to the monitoring system 1, when the sensor detects an abnormality, the sensor controller and the camera controller cooperate with each other to transmit the video data of the location where the abnormality occurs without the intervention of the monitoring console processor. Will be transferred to the monitoring console processor. For this reason, the observer can check the abnormal part based on the video in a short time.

Further, the camera control device which is transmitting the video before the abnormality is detected has a margin in the network band due to the band control processing for reducing the resolution and the frame rate of the image when the abnormality occurs. Since the processing load is reduced, the video of the abnormal part can be transferred more reliably, and the monitoring console processing device can more reliably receive and display.

[0114]

According to the present invention, even when many surveillance cameras are used, a surveillance system that can quickly and reliably transfer and display video information corresponding to a location where an abnormality has occurred through a network is provided. Can be provided.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a system to which the present invention is applied.

FIG. 2 is a diagram for explaining an outline of the present invention.

FIG. 3 is a hardware configuration diagram of the camera control device.

FIG. 4 is a hardware configuration diagram of a sensor control device.

FIG. 5 is a hardware configuration diagram of a monitoring console processing device.

FIG. 6 is a software configuration diagram of the monitoring console processing device.

FIG. 7 is a software configuration diagram of the camera control device.

FIG. 8 is a software configuration diagram of the sensor control device.

FIG. 9 is a processing flow of a monitoring window control module.

FIG. 10 is a processing flow of a video / alarm display module.

FIG. 11 is a configuration diagram of a basic window.

FIG. 12 is a configuration diagram of a basic window when a monitoring window is displayed.

FIG. 13 is a configuration diagram of a monitoring window.

FIG. 14 is a configuration diagram of a camera selection window.

FIG. 15 is a configuration diagram of a monitoring window state management table.

FIG. 16 is a configuration diagram of display video information in a monitoring window state management table.

FIG. 17 is a configuration diagram of a monitoring window state transition table.

FIG. 18 is a general format of a communication packet.

FIG. 19 is a processing flow of the camera control module.

FIG. 20 is a processing flow of a video transmission module.

FIG. 21 is a processing flow of a sensor control module.

FIG. 22 is a processing flow of the alarm transmission module.

FIG. 23 shows a format of a camera switching packet.

FIG. 24 is a configuration diagram of a camera state management table.

FIG. 25 shows a format of a normal video packet.

FIG. 26 shows a format of an alarm packet.

FIG. 27 is a format of a cooperative sensor management table.

FIG. 28 shows a format of an alarm cooperation video packet.

FIG. 29 is a format of an alarm recovery packet.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 10 ... Network, 21 ... Monitor processing unit, 22 ... Monitor, 23 ... Keyboard, 24 ... Mouse, 3i ... Camera control device, 4i ... Camera, 5i ... Sensor control device, 6
i: sensor, 201: network control controller, 202: CPU, 203: memory, 204: input / output controller, 205: monitor controller, 2
06 bus, 211 network control driver, 21
2 communication management module 213 input / output device control driver 214 monitoring window control module 215
... Video / alarm display module, 216 ... Transmission queue, 217 ... Reception queue, 218 ... Monitoring window status management table, 219 ... Monitoring window status transition table, 220 ... Operation status management table, 221 ... Evacuated video buffer, 231 ... Basic window , 241 monitoring window, 242 monitoring window, 243 monitoring window, 244 monitoring window, 245 monitoring window, 246 monitoring window, 301 camera controller, 302 CPU, 303 memory, 304 network control controller 305 ... Bus, 311
... Network control driver, 312 ... Communication management module, 313 ... Camera control driver, 314 ... Camera control module, 315 ... Video transmission module, 316 ...
Reception queue, 317: Transmission queue, 318: Camera status management table, 319: Cooperation sensor management table, 5
01: sensor controller, 502: CPU, 50
3 Memory, 504 Network controller, 505 Bus, 511 Network control driver, 512 Communication management module, 313 Sensor control driver, 514 Sensor control module, 515
... alarm transmission module, 516 ... reception queue, 51
7: transmission queue, 518: message management table.

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Riichiro Sasaki 5-2-1, Omika-cho, Hitachi City, Ibaraki Prefecture Inside the Omika Plant, Hitachi, Ltd. (72) Inventor Hiroshi Wataya 5-chome, Omika-cho, Hitachi City, Ibaraki Prefecture No. 1 Inside the Omika Plant of Hitachi, Ltd.

Claims (8)

[Claims] 1. A plurality of sensors, a plurality of sensor controllers respectively connected to one or more of the sensors, a plurality of monitoring cameras, a plurality of camera controllers respectively connected to the monitoring cameras, and a display. In a monitoring system having a monitoring console processing device connected to a device, and the sensor control device, the camera control device, and a network to which the monitoring console processing device is connected, the sensor control device has an abnormality in a connected sensor. When the alarm is detected, the alarm information for notifying the detection is
The camera control device has means for sending to the network, and the camera control device is configured to receive the alarm information, and based on the received alarm information, an abnormality is detected by a sensor corresponding to the monitoring camera connected to the own device. Means for judging whether or not an error has been detected by a corresponding sensor, and means for transmitting video information of a monitoring camera connected to the own device to the network when an abnormality is detected by the corresponding sensor. A monitoring system, comprising: a unit for receiving video information transmitted from the camera control device; and a control unit for displaying the received video information on the display device. 2. The monitoring system according to claim 1, wherein each of the sensors and each of the monitoring cameras are associated in advance, and at least one of the sensors is associated with a plurality of monitoring cameras. The control means of the monitoring console processing device, when an abnormality is detected by a sensor associated with a plurality of monitoring cameras, video information transmitted from a plurality of camera control devices corresponding to the sensor, on the same screen A monitoring system characterized by displaying. 3. The surveillance system according to claim 1, wherein the camera control device transmits video information of a surveillance camera connected to the self-device in response to request information from the monitoring console processing device. And control means for controlling transmission of video information from the own device when an abnormality is detected by a sensor not corresponding to the own device in a state where the transmission is performed by the means. A monitoring system characterized by the following. 4. The surveillance system according to claim 3, wherein the control means of the camera control device reduces the amount of video information transmitted from its own device or stops the transmission of video information. Monitoring system. 5. The surveillance system according to claim 1, wherein the camera control device transmits video information of a surveillance camera connected to the self-device in response to request information from the monitoring console processing device. Means, and control means for performing control to further enhance the video quality of video information sent from the own device when an abnormality is detected by a sensor corresponding to the own device,
A monitoring system, further comprising: 6. The surveillance system according to claim 3, 4 or 5, wherein the control means of the camera control device further transmits video information by itself in response to a recovery request from the monitoring console processing device. A monitoring system wherein a state is set to a state before the alarm information is received. 7. The surveillance system according to claim 3, wherein the control means of the camera control device sets at least one of a video resolution and a frame rate to a surveillance camera connected to the own device. By updating the amount of video information output from the monitoring camera. 8. The monitoring system according to claim 1, wherein the monitoring console processing device transmits request information to the camera control device so as to transmit video information of a designated monitoring camera, and If the video information corresponding to the sensor that has detected the abnormality is received while displaying the video information transmitted according to, the display of the video information of the designated monitoring camera is interrupted, and A means for controlling to start displaying video information corresponding to the sensor that has detected the monitoring.