JP2007142597A - Video monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To distribute video in real time as required without causing a delay. <P>SOLUTION: In a state that a monitor storage device 101 always distributes a video stream for storage to a video photographing camera apparatus 102, the monitor storage device 101 instructs the camera apparatus 102 to directly distribute video data associated with the video stream to a display apparatus 103 making a distribution request when the video stream whose distribution is requested by each display apparatus 103 is within a video distribution capability of the camera apparatus 102 and a present distribution state does not reach a limit of the number of video distribution amounts of the camera apparatus 102. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video monitoring system that monitors video streams distributed from a plurality of display devices.

  In recent years, with the widespread use of video surveillance systems, moving images captured by camera devices are stored in storage devices, the stored images are analyzed to detect their movement, and the camera devices are driven to move. Surveillance and photographing devices that track the body and shoot have come out.

  In such a configuration of the video monitoring system, the camera device delivers a plurality of video streams such as a video stream delivered for recording to the storage device and a video stream delivered for display on the display device. Has also come out.

  Furthermore, the display device can display real-time video data directly distributed from the camera device and video data recorded in the storage device, and can also control the PTZ drive of the camera device. .

  The storage device has a function of converting a video stream distributed from the camera device into video data suitable for recording, and a function of converting the recorded video data into video data suitable for a display device and performing video stream distribution. Have. Furthermore, in the storage device, it is possible to perform only data conversion without recording the video stream distributed from the camera device, and distribute it to the display device.

  In the video monitoring system in such a situation, the storage device controls each camera device, receives and records the video stream for storage, and distributes the video stream to the requested display device. Was converted into video data suitable for the capabilities of the display device and the connected network environment.

  In such a video surveillance system, since it is difficult to convert low-quality video data to high-quality video data, the video stream delivered from the camera device to the storage device has the highest quality within the capabilities of the camera device. Are distributed and converted into video data of a quality suitable for the storage capacity and required recording time of the storage device, or converted to a data rate suitable for the display device and the connected network environment. Or, in such a video surveillance system, low-quality video data is distributed during normal times, and high-quality video data is distributed when an abnormality or event occurs. The video data quality was changed and distributed.

  Under these circumstances, there are already devices that convert and deliver video data of quality that matches the capabilities of each display device to display devices that have the ability to display moving image data of different quality (for example, Patent Documents). 1).

  In addition, when performing PTZ drive control of a camera device by a plurality of display devices, there is already one that acquires the control right exclusively and performs drive control by any one display device (for example, Patent Document 2).

  In addition, a plurality of video data such as normal video data and compressed video data is created from the captured moving image, and the compressed video data is directly sent to the network, and the normal video data is once stored in the storage device. There is already a system that distributes according to the request of each device (see, for example, Patent Document 3).

JP 2000-341668 A JP 2004-120317 A Japanese Patent Laid-Open No. 10-174086

However, the above conventional techniques have the following problems.
When converting video data in accordance with the requirements of each display device in the storage device, processing load is applied to the storage device, and also in the distribution of the video data, a delay occurs with respect to the time actually taken by the camera device. As a result, real-time video cannot be displayed. In addition, if the camera device is to request video distribution from all the display devices, the camera device needs to have high processing capability, and the camera device becomes expensive.

  In addition, when direct distribution from a camera device is controlled freely from a display device, even for a display device that requires real-time video, such as a display device that actually controls and displays the camera device. In some cases, the video data with a delay from the storage device has to be distributed because the other display device receives the directly distributed video. In addition, there are some display devices that do not need to deliver real-time video depending on the situation, such as displaying stored video in the display device, and these cannot be determined.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a video monitoring system capable of distributing real-time video as necessary without causing a delay.

  The present invention has been made for the purpose of solving the above-mentioned problems, has a camera operation function and can deliver a plurality of types of video streams, and each has a network connection environment or a video display capability. A plurality of display devices different from each other and storage of video data related to a video stream distributed from the camera device, and conversion of the stored video data into video data suitable for the capabilities of each display device and distribution Each of the display devices to the storage device in a state in which the storage device always distributes the storage video stream to the camera device. A distribution request unit for requesting distribution of a video stream from the camera device, wherein the storage device distributes the camera device; Analysis means for analyzing the power and the distribution state, and the video stream requested to be distributed by the distribution request means is within the video distribution capability of the camera device, and the current distribution status is the video distribution of the camera device And an instruction means for instructing the display device, which has made a distribution request to the camera device, to directly distribute the video data related to the video stream when the number limit has not been reached. Provide a monitoring system.

  According to the present invention, real-time video can be distributed as necessary without causing a delay.

Hereinafter, an example of an embodiment according to the present invention will be described with reference to the accompanying drawings.
In the present embodiment, the monitoring storage device connected to the LAN, the video camera device capable of performing PTZ connected to the LAN, and the display connected to the LAN or WAN to display the distributed video A video surveillance system including the apparatus will be described.

(System configuration)
FIG. 1 is a schematic configuration diagram of a video surveillance system according to an embodiment of the present invention.
In FIG. 1, reference numeral 101 denotes a function for receiving video data from the video camera apparatuses 102-1 to 102-3 via the LAN 104-5 and managing the storage of the video data, and converting the video data into a desired format. This is a monitoring storage device having a function and a function of distributing and displaying video data on the display devices 103-1 to 103-2.

  In FIG. 1, reference numerals 102-1 to 102-3 denote video camera apparatuses that convert video data obtained by shooting into a plurality of data formats and stream-distribute them to the plurality of devices. In the following description, when the video camera device is described as a representative, it is referred to as “video camera device 102”. In FIG. 1, reference numerals 103-1 to 103-2 are connected to the LAN 104-4 or the WAN 105, and the video data stored in the monitoring storage device 101 and the video sent from the video camera devices 102-1 to 102-3 are displayed. A display device such as a PC for displaying data. In the following description, when a description is given on behalf of a display device, it is referred to as “display device 103”.

  In FIG. 1, 104-1 to 104-5 are LANs for performing communication with each device. In the following description, when a description is given on behalf of a LAN, it is referred to as “LAN 104”. In FIG. 1, a LAN is used. However, in the present embodiment, any broadband broadband network line is applicable. In FIG. 1, reference numeral 105 denotes a WAN for communicating with each device. In FIG. 1, a WAN is used, but in the present embodiment, any narrow band network line with a narrow band is applicable.

  In FIG. 1, reference numeral 106 denotes a HUB including a router that connects the LAN 104 and the WAN 105 to route data. In FIG. 1, reference numeral 107 denotes a display that is locally connected to the monitoring storage device 101.

FIG. 2 is a block configuration diagram of the monitoring and accumulating apparatus 101.
In FIG. 2, reference numeral 201 denotes a central control unit (CPU) that comprehensively controls the monitoring storage device 101. In FIG. 2, 202 is a ROM. In FIG. 2, 203 is a RAM.

A video decoding unit 204 decodes video data such as JPEG or MPEG sent from the video camera apparatus 102. In FIG. 2, reference numeral 205 denotes a video encoding unit that encodes data decoded by the video decoding unit 204 in order to perform video conversion, video analysis, and the like.

  In FIG. 2, a video conversion unit 206 converts the size, resolution, and the like in order to store the data decoded by the video decoding unit 204 and transmit the data to the display device 103. In FIG. 2, reference numeral 207 denotes a frame video conversion unit that converts the frame rate by thinning out the frames in order to store the data decoded by the video decoding unit 204 or transmit the data to the display device 103.

  In FIG. 2, reference numeral 208 denotes a camera device management unit that manages the network address and distribution capability of the video camera device 102. In FIG. 2, reference numeral 209 denotes a display device management unit that manages the network address, display capability, request, and display device priority of the display device 103.

  In FIG. 2, reference numeral 210 denotes a camera device controller that controls the destination and type of the video stream distributed from the video camera device 102. In FIG. 2, reference numeral 211 denotes a display request processing unit that analyzes a display request from the display device 103 and gives an instruction to the video camera device 102, or distributes the stored video data. In FIG. 2, reference numeral 212 denotes a distribution state management unit that manages the distribution state of video data in each video camera device 102 and display device 103.

  In FIG. 2, reference numeral 213 denotes a video storage unit such as a hard disk for storing video data such as JPEG and MPEG sent from the video camera apparatus 102. In FIG. 2, reference numeral 214 denotes a video display I / F unit that transmits video data to the display 107 locally connected to the monitoring storage device 101 and displays a video based on the video data. In FIG. 2, reference numeral 215 denotes a delay measurement unit that measures a delay that occurs when the received video data is converted and distributed.

  In FIG. 2, 216 is connected to the LAN 104-5, receives video data from the video camera device 102, sends a command for controlling the video camera device 102, and further sends video data to the display device 103. It is a communication control part which distributes. In FIG. 2, reference numeral 217 denotes an internal bus that connects the components 201 to 216 of the monitoring storage device 101.

FIG. 3 is a block diagram of the video camera apparatus 102.
In FIG. 3, reference numeral 301 denotes a central control unit (CPU) that controls the video camera apparatus 102 in an integrated manner. In FIG. 3, reference numeral 302 denotes a ROM. In FIG. 3, reference numeral 303 denotes a RAM.

  In FIG. 3, reference numeral 304 denotes a camera photographing unit that includes a lens, a CCD, and the like and captures video data by photographing. In FIG. 3, reference numeral 305 denotes a camera driving unit that causes the camera photographing unit 304 to perform a PTZ operation in order to change the photographing range in accordance with an instruction from the display device 103 that has acquired the control right.

  In FIG. 3, reference numeral 306 denotes a monitoring storage device recognition unit that recognizes the monitoring storage device 101 and exchanges commands. In FIG. 3, reference numeral 307 denotes a video encoding unit that encodes the captured video data into JPEG, MPEG, or the like for transmission. In FIG. 3, reference numeral 308 denotes a video transmission unit that transmits the video data encoded by the video encoding unit 307 to the monitoring storage device 101, the display device 103, and the like.

  In FIG. 3, reference numeral 309 denotes a display device recognition unit that recognizes the display device 103 and exchanges commands. In FIG. 3, reference numeral 310 denotes a camera control right management unit that exclusively controls the camera drive control right from each display device 103 and gives the control right.

  In FIG. 3, reference numeral 311 denotes a communication control unit that is connected to the LANs 104-1 to 104-3 and performs communication with the monitoring storage device 101, the display device 103, and the like. In FIG. 3, reference numeral 312 denotes an internal bus that connects the components 301 to 311 of the video camera apparatus 102.

FIG. 4 is a block configuration diagram of the display device 103.
In FIG. 4, reference numeral 401 denotes a central control unit (CPU) that comprehensively controls the display device 103. In FIG. 4, reference numeral 402 denotes a ROM. In FIG. 4, reference numeral 403 denotes a RAM.

  In FIG. 4, reference numeral 404 denotes a video decoding unit that decodes video data such as JPEG or MPEG sent from the monitoring storage device 101 or the video camera device 102 for display. In FIG. 4, reference numeral 405 denotes a camera device management unit that manages a network address of the video camera device 102.

  In FIG. 4, reference numeral 406 denotes a monitoring storage device recognition unit that recognizes the monitoring storage device 101 and exchanges commands. In FIG. 4, reference numeral 407 denotes an operation unit that performs the operation of the monitoring storage device 101 and the camera drive control of the video shooting camera device 102.

  In FIG. 4, reference numeral 408 denotes a display unit such as a display for displaying distributed video data. In FIG. 4, reference numeral 410 denotes a communication control unit that is connected to the LAN 104 or the WAN 105 and communicates with the monitoring storage device 101 and the video camera device 102. In FIG. 4, reference numeral 411 denotes an internal bus that connects the components 401 to 410 of the display device 103.

  FIG. 5 is a diagram illustrating an operation of converting video data in the monitoring storage device 101. Here, a video storage operation, a local display display operation, and a distribution operation to the display device 103 will be described. Note that in the monitoring and accumulating apparatus 101, a video data conversion unit that converts video data in response to storage, display, and distribution requests from the video decoding unit 204, video encoding unit 205, video resolution conversion unit 206, and video frame conversion unit 207. Is configured.

  In FIG. 5, in the video storage operation, video data (hereinafter referred to as MJPEG) of motion JPEG format having a resolution of 1280 * 1024 pixels (hereinafter referred to as SXGA) is transmitted at 30 frames per second (hereinafter referred to as 30 fps). When distributed, the video data storage unit 213 stores the video data amount reduced.

  For example, here, the video decoding unit 204 performs decoding, the video resolution conversion unit 206 converts the video size to a resolution of 640 * 480 pixels (hereinafter referred to as VGA), and the video encoding unit 205 further performs MJPEG. Are recorded in the video storage unit 213. Alternatively, the distribution video data is recorded in the video storage unit 213 at 5 fps after the frames are thinned out by the video frame conversion unit 207.

  Also, in the local display display operation, when the SXGA size MJPEG is delivered from the video camera device 102 at 30 fps, the video decoding unit 204 performs decoding, and the video resolution conversion unit 206 sets the video size. It is converted and displayed in accordance with the display 107.

  In the distribution operation to the display device 103, when the video data of the SXGA size MPEG4 format (hereinafter referred to as MPEG4) or MJPEG is distributed at 30 fps from the video camera device 102, the display capability or connection of the display device 103 is obtained. The video data volume is reduced from the network environment that is being used.

  For example, here, the video decoding unit 204 performs decoding, the video resolution conversion unit 206 converts the video size to VGA, the video frame conversion unit 207 thins out the frame to 15 fps, and the video encoding unit The data is encoded into MPEG4 at 205 and distributed to the display device 103.

  In this way, the video data conversion unit of the monitoring storage device 101 can convert the video data in accordance with storage, display, and distribution requests.

  FIG. 6 is a diagram showing an operation in a steady state in which the video data transmitted from the video camera apparatus 102 is recorded in the monitoring storage device 101. Here, it is assumed that the video camera device 102 can encode the captured video data into MJPEG and MPEG4, and can deliver two video streams by freely combining them in an arbitrary size. Furthermore, in the LAN 104-4, up to 25 SXGA size MJPEGs can be distributed at 30 fps, and in the WAN 105, up to 1 VGA size MPEG4 can be distributed at 30 fps.

  In FIG. 6, in a steady state, SXGA size MJPEG is distributed from each of the video camera devices 102-1 to 102-3 at 30 fps, converted by the monitoring storage device 101, and recorded in the video storage unit 213. Is displayed on the display 107.

FIG. 7 is a diagram illustrating an operation when there is a display request from the first display device 103-1.
In FIG. 7, the SXGA size MJPEG is distributed from the first video camera device 102-1 to the monitoring storage device 101 at 30 fps, and the VGA size MJPEG is 20 fps at the first display device 103-1. Has been delivered to.

FIG. 8 is a diagram illustrating an operation when there is a display request from the first and second display devices 103-1 and 103-2.
In FIG. 8, the SXGA size MJPEG is distributed from the video camera device 102-1 to the monitoring storage device 101 at 30 fps, and the VGA size MJPEG is 20 fps from the monitoring storage device 101. In 103-1, VGA size MPEG4 is distributed to the second display device 103-2 at 15 fps.

FIG. 9 is a diagram illustrating an operation when the first display device 103-1 acquires the control right of the PTZ operation of the first video camera device 102-1.
In FIG. 9, the SXGA size MJPEG is distributed from the first video camera device 102-1 to the monitoring storage device 101 at 30 fps, and the VGA size MJPEG is 20 fps at the first display device 103-1. Furthermore, VGA size MPEG4 is distributed from the monitoring storage device 101 to the second display device 103-2 at 15 fps.

FIG. 10 is a diagram illustrating an operation when the first display device 103-1 displays video data stored in the monitoring storage device 101.
In FIG. 10, the SXGA size MJPEG is distributed from the first video camera device 102-1 to the monitoring storage device 101 at 30 fps, and the VGA size MPEG4 is 15 fps at the second display device 103-2. Furthermore, VGA size MJPEG is distributed from the monitoring storage device 101 to the first display device 103-1 at 20 fps.

  FIG. 11 is a diagram showing a video distribution management table for the video camera device 102. This table is managed by the distribution status management unit 212 of the monitoring storage apparatus 101 and used for distribution control of each video camera apparatus 102.

(Detailed operation explanation)
Hereinafter, the specific operation of the video surveillance system according to the embodiment of the present invention will be described in several cases.

FIG. 12 is a flowchart showing the video distribution operation of the video camera apparatus 102.
First, when shooting is started (step S1201 / Y), a video is shot in the camera shooting unit 304 (step S1202). Subsequently, when there is a video distribution instruction from the monitoring storage device 101 (step S1203 / Y), the designated distribution destination is set in the communication control unit 311 (step S1204), and the encoding mode is set in the video encoding unit 307. Then (step S1205), video encoding is started (step S1206).

  Subsequently, the video transmission unit 308 transmits the video (step S1207). In this state, distribution of storage video data from the video camera apparatus 102 to the monitoring storage apparatus 101 as shown in FIG. 6 is started.

  Subsequently, when there is an instruction to change the distribution video from the monitoring storage device 101 (step S1208 / Y), it is subsequently determined whether or not the video encoding unit 307 or the video transmission unit 308 is within the distribution capability ( Step S1212). If the result of this determination is within the distribution capability (step S1212 / Y), the distribution video is changed and transmission is continued (step S1213). On the other hand, if the distribution capability is exceeded (step S1212 / N), the distribution video change refusal is transmitted to the monitoring storage device 101 (step S1214).

  If there is an instruction to add a delivery destination from the monitoring storage device 101 (step S1209 / Y), it is subsequently determined whether the video encoding unit 307 or the video transmission unit 308 is within the delivery capability ( Step S1215). If the result of this determination is within the distribution capability (step S1215 / Y), the distribution destination is added and transmission is continued (step S1216). On the other hand, if the distribution capability is exceeded (step S1215 / N), the distribution video change rejection is transmitted to the monitoring storage device 101 (step S1214).

  If there is a delivery destination reduction instruction from the monitoring storage device 101 (step S1210 / Y), the video delivery to the designated delivery destination is terminated (step S1217). On the other hand, when there is no distribution destination reduction instruction from the monitoring and storage apparatus 101 (step S1210 / N), it is subsequently determined whether or not there is an instruction to end video distribution from the monitoring and storage apparatus 101 (step S1211). . If the result of this determination is that there is no instruction to end video distribution from the monitoring and storage apparatus 101 (step S1211 / N), the process returns to step S1207, while there is an instruction to end video distribution from the monitoring and storage apparatus 101. In this case (step S1211 / Y), the video transmission unit 308 ends video distribution.

FIG. 13 is a flowchart showing the control right acquisition operation of the video camera apparatus.
First, when the PTZ drive control right is requested from the first display device 103-1 to the video camera device 102 (step S1301 / Y), the camera control right management unit 310 has no control right. It is determined whether or not (step S1302). If the result of this determination is that control is not available, the processing in the flowchart is terminated. On the other hand, if the result of determination in step S1302 is that the control right is vacant, the camera drive control right acquisition approval is transmitted (step S1303). Subsequently, the monitor storage device 101 is notified of information on the display device that has been given the drive control right of the camera (step S1304).

  Subsequently, it is determined whether or not there is a camera driving instruction from the first display device 103-1 (step S1305). If the result of this determination is that there is an instruction to drive the camera from the first display device 103-1, the camera drive unit 305 performs the PTZ operation in accordance with the instruction (step S1306).

  On the other hand, if it is determined in step S1305 that there is no camera drive instruction from the first display device 103-1, then another terminal (for example, the second display device 103-2 in the present embodiment) is continued. From this, it is determined whether there is a request for the PTZ drive control right to the video camera apparatus 102 (step S1307). As a result of this determination, if there is a request for the PTZ drive control right from another terminal, the camera control right management unit 310 transmits a rejection of the request for the camera drive control right (step S1308).

  On the other hand, if it is determined in step S1307 that there is no request for the PTZ drive control right from another terminal, the PTZ drive control right is subsequently transferred from the first display device 103-1 to the video camera device 102. It is determined whether there is a release instruction (step S1309). As a result of this determination, if there is an instruction to release the PTZ drive control right from the first display device 103-1 to the video camera apparatus 102, the approval of the release of the camera drive control right is subsequently issued. Transmit (step S1310). Subsequently, the monitor storage device 101 is notified of information for releasing the camera drive control right (step S1311).

  On the other hand, if it is determined in step S1309 that the first display device 103-1 has not instructed the video camera apparatus 102 to release the PTZ drive control right, the process returns to step S1305.

  Through the processing from step S1301 to step S1311 described above, the control right in the video camera apparatus 102 is acquired.

FIG. 14 is a flowchart showing the operation of the display device.
First, when a video display request is input from the operation unit 407 (step S1401 / Y), a video is requested to the monitoring storage device 101, and it is determined what the video requested to be displayed is (step S1401 / Y). S1402).

  If the result of determination in step S1402 is that the image requested to be displayed is an accumulated image recorded in the monitor accumulation device 101, the corresponding image is designated (step S1403). Subsequently, the format, size, and frame rate of the video to be distributed are designated (step S1404). Subsequently, after receiving the video (step S1405), it is determined whether there is a video delay notification from the monitoring storage device 101 (step S1406).

  If there is a video delay notification from the monitoring storage device 101 as a result of the determination in step S1406, the delay time is displayed (step S1407). On the other hand, as a result of the determination in step S1406, if there is no video delay notification from the monitoring storage device 101, the process proceeds to step S1408.

  Subsequently, the video decoding unit 404 decodes the video (step S1408). Subsequently, an image is displayed on the display unit 408 (step S1409). Subsequently, it is determined whether or not a video distribution end request has been input from the operation unit 407 (step S1410). If a video distribution end request has been input from the operation unit 407, the monitoring storage apparatus 101 is subsequently continued. Then, an instruction to stop video distribution is issued (step S1431). On the other hand, if a video distribution end request is not input from the operation unit 407, the process returns to step S1405.

  If the result of determination in step S1402 is that the image requested to be displayed is a captured image captured by the image capturing camera device 102, the requested image capturing camera device 102 is designated (step S1411). Subsequently, the format, size, and frame rate of the video to be distributed are designated (step S1412).

  Subsequently, it is determined whether or not there is a request for a camera control right (step S1413). If the result of this determination is that there is a request for camera control, video data sent directly from the video camera device 102 or video data obtained by converting the video for storage in the monitoring storage device 101 is received (step S1414).

  Subsequently, it is determined whether there is a video delay notification from the monitoring storage device 101 (step S1415). If there is a video delay notification from the monitoring storage device 101 as a result of this determination, the delay time is subsequently displayed (step S1416). Subsequently, the video decoding unit 404 decodes the video (step S1417). Subsequently, an image is displayed on the display unit 408 (step S1418).

  Subsequently, it is determined whether or not there is a distribution video switching instruction (step S1419). This distribution video switching is performed by switching the captured video from the video camera device 102 to the stored video from the monitoring storage device 101 and switching the stored video from the monitor storage device 101 to the captured video from the video camera device 102. There is a form. If the result of this determination is that there is a distribution video switching instruction, the received video is then switched and displayed (step S1420). On the other hand, if the result of determination in step S1419 is that there is no distribution video switching instruction, processing proceeds to step S1421.

  Subsequently, it is determined whether or not a video distribution end request has been input from the operation unit 407 (step S1421). If a video distribution end request has been input from the operation unit 407, the monitoring storage apparatus 101 is subsequently continued. Then, an instruction to stop video distribution is issued (step S1431). On the other hand, if the video distribution end request is not input from the operation unit 407, the process returns to step S1413.

  If the result of determination in step S1413 is that there is no request for camera control rights, it is then determined whether or not a request for acquisition of camera control rights has been made from the operation unit 407. If the result of this determination is that there has been no request for acquisition of control rights for the camera from the operation unit 407, processing proceeds to step S1414. On the other hand, when a camera control right acquisition request is made from the operation unit 407, the camera control right is acquired for the video camera apparatus 102.

  Subsequently, it is determined whether or not there is a distribution video switching instruction (step S1423). This distribution video switching is performed by switching the captured video from the video camera device 102 to the stored video from the monitoring storage device 101 and switching the stored video from the monitor storage device 101 to the captured video from the video camera device 102. There is a form. If the result of this determination is that there is a distribution video switching instruction, the received video is then switched and displayed (step S1424). On the other hand, if the result of determination in step S1423 is that there is no distribution video switching instruction, processing proceeds to step S1425.

  Subsequently, when a camera drive instruction is input from the operation unit 407, drive control of the video camera device 102 is performed (step S1425). Subsequently, video data is received (step S1426), the video decoding unit 404 decodes the video (step S1427), and the display unit 408 displays the video (step S1428).

  Subsequently, it is determined whether or not a camera control right release request is input from the operation unit 407 (step S1429). As a result of the determination, if a camera control right release request is input from the operation unit 407, the camera drive control right is released, and the process returns to step S1413.

  On the other hand, as a result of the determination in step S1429, if a camera control right release request is not input from the operation unit 407, it is subsequently determined whether a video distribution end request is input from the operation unit 407 ( Step S1430). If a video distribution end request is input from the operation unit 407 as a result of this determination, then an instruction to stop video distribution is issued to the monitoring storage device 101 (step S1431). On the other hand, if the video distribution end request is not input from the operation unit 407, the process returns to step S1423.

  Through the processing from step S1401 to step S1431, the operation of the display device in the present embodiment is performed.

FIG. 15 is a flowchart showing the video distribution operation of the monitoring storage device.
First, when video data is received from the video camera apparatus 102 (step S1501 / Y), the video decoding unit 204 decodes the video data (step S1502).

  Subsequently, it is determined whether or not the video is to be recorded (step S1503). If it is determined that the video is to be recorded, the video resolution conversion unit 206 and the video frame conversion unit 207 subsequently convert the video into an optimal video. Then, the video encoding unit 205 encodes the video data (step S1504), and starts video recording (step S1505). On the other hand, if it is determined not to record the video, the process proceeds to step S1506.

  Subsequently, it is determined whether a display request is received from the first display device 103-1 (step S1506). As a result of this determination, if a display request is received from the first display device 103-1, then it is determined what the video requested to be displayed is (step S1507).

  If the result of determination in step S1507 is that the image requested to be displayed is a captured image captured by the image capturing camera device 102, distribution based on the image distribution management table (FIG. 11) of the distribution status management unit 212 is performed. The situation is analyzed (step S1508). Subsequently, it is determined whether or not the camera is within the distribution capability of the camera (step S1509). If it is within the distribution capability of the camera, then the video distribution is performed from the display device 103 to the video camera device 102. (Step S1510), and the video distribution management table is updated (Step S1511). This is the state shown in FIG. Thereafter, the process returns to step S1506.

  On the other hand, as a result of the determination in step S1509, for example, when a display request is transmitted from the second display device 103-2 and exceeds the distribution capability of the camera (not within the distribution capability of the camera), the monitoring storage device The video data distributed for storage in 101 is converted as shown in FIG. 6 using the video decoder 204, video resolution converter 206, video frame converter 207, and video encoder 205 (step S1518). Subsequently, the delay caused by the conversion is measured in the delay measuring unit 215, the delay time is sent to the second display device 103-2 (step S1519), and the video is distributed to the second display device 103-2 (step S1519). In step S1520, the video distribution management table is updated (step S1521). This is the state shown in FIG. Thereafter, the process returns to step S1506.

  If the result of determination in step S1507 is that the video requested to be displayed is a stored video recorded in the monitoring storage device 101, the video is distributed based on the video distribution management table (FIG. 11) of the distribution status management unit 212. Is analyzed (step S1512). Subsequently, it is determined whether or not the first display device 103-1 is currently receiving the video directly from the video camera device 102 (step S1513). If the result of this determination is that the first display device 103-1 is currently receiving the video directly from the video camera device 102, as shown in FIG. A delivery stop instruction is issued (step S1514). On the other hand, if the result of determination in step S1513 is that the first display device 103-1 is not currently receiving video directly from the video camera device 102, processing proceeds to step S1515.

  Subsequently, it is determined whether there is a display device 103 that distributes the stored video (step S1515). As shown in FIG. 8, if there is a display device 103 that distributes the stored video, the video is displayed. A direct distribution instruction is issued to the photographing camera apparatus 102 (step S1516), and a video switching instruction is issued to the second display apparatus 103-2 that distributes the stored video to perform direct video distribution (step S1517). . On the other hand, if the result of determination in step S1515 is that there is no display device 103 that distributes stored video, processing proceeds to step S1518.

  Subsequently, the monitoring storage device 101 converts the recorded video data as shown in FIG. 6 using the video decoder 204, the video resolution converter 206, the video frame converter 207, and the video encoder 205 (step). S1518). Subsequently, the delay continuation unit 215 measures the delay caused by the conversion, sends the delay time to the second display device 103-2 (step S1519), and distributes the video to the first display device 103-1. In step S1520, the video distribution management table is updated (step S1521). This is the state shown in FIG. Thereafter, the process returns to step S1506.

  If the display request is not received from the first display device 103-1 as a result of the determination in step S1506, it is subsequently determined whether the monitoring storage device 101 has received a display end request from the display device 103. Judgment is made (step S1522). As a result of this determination, if the monitoring storage device 101 does not receive a display end request from the display device 103, the process returns to step S1506. On the other hand, as a result of the determination in step S1522, if the monitoring storage device 101 receives a display end request from the display device 103, subsequently, it is determined what kind of video is requested to be displayed (step S1523). ).

  If the result of determination in step S1523 is that the video requested for display termination is a video shot taken by the video camera device 102, the video distribution management table (FIG. 11) of the distribution status management unit 212 continues. Based on this, the distribution status is analyzed (step S1524), and it is determined whether there is another display device that has requested display (step S1525). As a result of this determination, if there is another display device that requests display as shown in FIG. 9 and the display request falls within the distribution capability of the video camera device 102 due to the distribution stop, then the video camera An instruction is issued to the apparatus 102 (step S1526), and the video distribution management table is updated while switching to direct distribution (step S1527). This is the state shown in FIG. Thereafter, the processing in the flowchart ends.

  If there is no other display requesting display as shown in FIG. 7 as a result of the determination in step S1525, then the video distribution is stopped (step S1528), and the video distribution management table is set. Update (step S1529). This is the state shown in FIG. Thereafter, the processing in the flowchart ends.

  As a result of the determination in step S1523, if the video requested to be displayed as shown in FIG. 10 is a stored video recorded in the monitoring storage device 101, the video distribution is subsequently stopped (step S1523). S1528), the video distribution management table is updated (step S1529).

  Through the above processing, video can be distributed to all display devices, and direct video distribution from the camera device is controlled and delayed according to the video distribution capability of the camera device and the request status of the display device. Can be distributed.

  Furthermore, when a display device that has received direct distribution from a camera device is in a state in which the distribution capability resource of the camera device is vacant, such as playing back stored video, the distribution capability resource is directly distributed to other display devices. The video can be distributed, and the video without delay can be distributed.

FIG. 16 is a flowchart showing a video distribution switching operation when a control right is acquired in the video monitoring system according to the embodiment of the present invention.
First, when the monitoring storage device 101 is notified from the video camera device 102 that the camera drive control right in the first display device 103-1 has been acquired (step S1601 / Y), the distribution status management unit 212. The distribution status is analyzed based on the video distribution management table (FIG. 11) (step S1602).

  Subsequently, it is determined whether or not the display device that has acquired the control right is a display device currently receiving video distribution directly from the video camera device 102 (step S1603), and directly from the video camera device 102. If the display device is receiving video distribution, direct video data distribution is continued as it is, and only the video distribution management table is updated (step S1608). This is the state shown in FIG. Thereafter, the processing in the flowchart ends.

  On the other hand, if the result of determination in step S1603 is that the display device is not receiving video distribution directly from the video camera device 102, then another display device that is directly distributing from the video camera device is used. It is determined whether or not there is (step S1604). If there is another display device that is directly distributed from the video camera device as a result of this determination, then the display device is instructed to switch video (step S1605), and the monitoring storage device 101 records. The video is converted and distributed (step S1606). On the other hand, if the result of determination in step S1604 is that there is no other display device that delivers directly from the video camera device, processing proceeds to step S1607.

  Subsequently, the video camera apparatus 102 is instructed to directly distribute the video data to the display device that has acquired the control right (step S1607), and the video distribution management table is updated (step S1608). This is the state shown in FIG. Thereafter, the processing in the flowchart ends.

  If the result of determination in step S1601 is that the monitoring and accumulation apparatus 101 has not been notified from the video shooting camera apparatus 102 that it has acquired control rights for camera driving in the first display apparatus 103-1, Subsequently, the monitoring and accumulation apparatus 101 determines whether or not a notification for releasing the right to control camera driving in the first display apparatus 103-1 has been received from the video camera apparatus 102 (step S1609). If it is determined that the notification has not been received, the process returns to step S1601. If it is determined that the notification has been received, then, based on the video distribution management table (FIG. 11) of the distribution status management unit 212. Then, the distribution status is analyzed (step S1610).

  Subsequently, it is determined whether there is another display device that has requested display (step S1611). As a result of the determination, if there is no other display device that has requested display, the direct distribution of the video data is continued as it is, and only the video distribution management table is updated (step S1615). This is the state shown in FIG. Thereafter, the processing in the flowchart ends.

  On the other hand, if the result of determination in step S1611 is that there is another display device that has requested display, video data distribution is directly stopped by the video camera device 102 (step S1612), and the first display device 103 is stopped. -1 is instructed to switch the video (step S1613), and after the recorded video of the monitoring storage device 101 is converted and distributed (step S1614), the video distribution management table is updated (step S1615). This is the state shown in FIG. Thereafter, the processing in the flowchart ends.

  With the above processing, even when a certain display device receives video distribution directly from the camera device and the distribution capability resource of the camera device is not available, the display device that has acquired the PTZ control matter of the camera device. Can distribute video resources directly by distributing the distribution capability resources of the camera device, and can also display video by video distribution from the storage device to other display devices.

  In the present embodiment, when the drive control right of the video camera device 102 is acquired, the video camera device 102 notifies the monitoring storage device 101 to that effect, but the control right has been acquired. The display device 103 may perform notification.

  Further, in this embodiment, video distribution is performed directly to the display device 103 that has acquired the PTZ control right of the video camera device 102. However, the storage device gives priority to the display device 103, and the display device 103 Resources for direct video distribution of the video camera apparatus 102 may be preferentially assigned to the apparatus.

  Further, in this embodiment, when a display request exceeding the distribution capability of the camera device is received, the video that has undergone video conversion by the monitoring storage device 101 is distributed to any display device 103. However, for the display device that directly distributed the video from the camera device 102 within the distribution capability, the direct video distribution is continued as it is, and the video distribution is performed from the monitoring storage device for the display request exceeding the distribution capability. Alternatively, the video distribution may be performed directly from the display apparatus 103 in descending order of priority to the distribution capability limit of the camera apparatus 102, and the video distribution from the monitoring and accumulation apparatus may be performed by the amount exceeding that.

1 is a schematic configuration diagram of a video surveillance system according to an embodiment of the present invention. It is a block block diagram of a monitoring storage device. It is a block block diagram of a video camera device. It is a block block diagram of a display apparatus. It is the figure which showed the operation | movement of conversion of the video data in a monitoring storage device. It is the figure which showed the operation | movement of the steady state which has recorded the video data transmitted from the video camera device in the monitoring storage device. It is a figure which shows operation | movement when there is a display request from a 1st display apparatus. It is a figure which shows operation | movement when there exists a display request from the 1st and 2nd display apparatus. It is the figure which showed the operation | movement when the 1st display apparatus acquires the control right of PTZ operation | movement of a 1st video camera device. It is the figure which showed the operation | movement in case the 1st display apparatus displays the video data accumulate | stored in the monitoring storage apparatus. It is the figure which showed the video delivery management table with respect to a video camera device. It is a flowchart which shows the video delivery operation | movement of a video camera device. It is a flowchart which shows the control right acquisition operation | movement of a video camera device. It is a flowchart which shows operation | movement of a display apparatus. It is a flowchart which shows the video delivery operation | movement of a monitoring storage device. 5 is a flowchart showing a video distribution switching operation when a control right is acquired in the video monitoring system according to the embodiment of the present invention.

Explanation of symbols

101 monitoring storage devices 102-1 to 102-3 video camera devices 103-1 and 103-2 display devices 104-1 to 104-5 LAN (or broadband network)
105 WAN (or narrowband network)
106 HUB
107 display

Claims (6)

A camera device having a camera operation function and capable of delivering a plurality of types of video streams;
A plurality of display devices each having a different network connection environment or video display capability;
A video monitoring system comprising: a storage device that stores video data related to a video stream distributed from the camera device, and converts the stored video data into video data that matches the capabilities of each display device and distributes the video data Because
In a state where the storage device always distributes a video stream for storage to the camera device, each display device requests distribution of the video stream from the camera device to the storage device Equipped with request means,
The storage device
Analyzing means for analyzing the distribution capability and distribution state of the camera device;
When the video stream requested to be distributed by the distribution request means is within the video distribution capability of the camera device and the current distribution status has not reached the limit of the number of video distribution of the camera device, the camera device An instruction means for instructing the display device that has requested distribution to directly distribute the video data related to the video stream.   When the distribution request by the distribution request means exceeds the video distribution capability of the camera device, or when the current number of video distribution exceeds the limit of the number of video distribution of the camera device, the storage The apparatus reads out the video data relating to the corresponding video stream distributed to the storage device for storage or the video data to the display device that has made the distribution request, and matches the display device's capability. The video monitoring system according to claim 1, further comprising distribution means for distributing the converted video data. The storage device
Priority giving means for giving priority to any display device;
Since the display device other than the display device to which the priority is given receives the video data directly from the camera device, the video data cannot be directly delivered to the display device to which the priority is given. In a situation, video distribution interruption means for controlling the camera device to interrupt direct video distribution from the camera device to the other display device;
Video distribution execution means for distributing video directly from the camera device to the display device to which the priority has been given,
The video monitoring system according to claim 2, wherein the distribution unit distributes the video data to the other display device. Each display device further includes an operation control means for performing operation control on the PTZ of an arbitrary camera device,
The camera device further includes PTZ control giving means for giving control of the PTZ to any one display device,
The storage device further comprises recognition means for recognizing that the control right of the PTZ is given to a certain display device, and the distribution means stores the video data stored in the display device. The video monitoring system according to claim 2, wherein, when distributed, the camera device is controlled to distribute a video stream directly from the camera device. Each display device further includes an operation control means for performing operation control on the PTZ of an arbitrary camera device,
The camera device further includes PTZ control giving means for giving control of the PTZ to any one display device,
The storage device
Recognizing means for recognizing that the control right of the PTZ is given to a display device;
When the display device other than the certain display device is in a situation where the video data cannot be directly delivered to the certain display device because the video data is directly received from the camera device, the camera device is Video distribution interruption means for controlling and interrupting direct video distribution from the camera device to the other display device;
Video distribution execution means for distributing video directly from the camera device to the display device;
The video monitoring system according to claim 2, wherein the distribution unit distributes the video data to the other display device.   When the distribution request by the distribution request means falls within the distribution number limit of the camera device, the storage device controls the camera device and is currently requesting video distribution. The video monitoring system according to claim 2, wherein the video data is directly distributed from the camera device to the video device and the distribution of the video data from the storage device to the other display device is stopped.

Images