JP2018207279A - Image monitoring system and image monitoring device - Google Patents

Abstract

To provide an image monitoring system capable of speedily tracking an illegal intruder into a monitored site such as a building and grasping a region suffering abnormality in equipment or the like.SOLUTION: An administrative server 6 having received a request for image data from a monitoring terminal 14 installed at a monitoring site extracts camera images from composing cameras 4a to 4c installed at a monitored site 1 and calculates a time difference between a time of acquiring the images at the site and a time of completing image composition. When the time difference exceeds a predetermined time, image composition is performed with a reduced frame rate.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video monitoring system and a video monitoring apparatus.

Since monitoring work such as station buildings and buildings is labor intensive, usually surveillance cameras and camera images are recorded without resident security guards at the monitored site being monitored to reduce labor costs. The device is installed. In addition, unauthorized intruders and equipment failures are monitored using a terminal device such as a personal computer from a monitoring site provided on a monitoring side such as a monitoring base of a station building or an office of a building owner.
When a monitor confirms an abnormal situation such as an unauthorized entry into a monitored site or a failure of equipment provided at the monitored site, the monitor contacts the security company or patrol officer and heads to the monitored site. Is taking action.

On the other hand, in order to monitor a monitored site in a wide area, a plurality of cameras are generally installed, and a plurality of monitored sites are divided and displayed on one screen of a display device. However, when video from multiple cameras is divided and displayed, the wide-area video often cannot be confirmed, and of course, the position of each camera must be known. There is.
Therefore, in order to grasp the status of the monitored site in detail from a remote location, a video surveillance system is proposed in which a supervisor can check not only a single surveillance camera image but also a plurality of surveillance camera images at once. (For example, refer to Patent Document 1).
In addition, a technique for performing optimization in order to correct a shift of a displayed composite image has been proposed (see, for example, Patent Document 2).

Japanese Patent No. 5314741 Japanese Patent Laying-Open No. 2015-106860

  In general, in a video surveillance system equipped with a remote monitoring function for unauthorized intrusion and equipment failure at the monitored site, image composition processing is used to check the local abnormal situation from images at the time of unauthorized intrusion and equipment failure. Thus, a plurality of camera images may be displayed on one screen. However, at this time, the screen of the plurality of camera images may be shifted due to network delay, server processing capability, and the like, which is not preferable for a monitor who must continue to view images for a long time.

For example, if the image A of a road with a lot of movement taken with a plurality of cameras and the image B of a site with a little movement are combined, the amount of information of the image A with a high movement increases, and the image A to be combined There is a delay. For this reason, even if the images are taken at the same time, a time difference occurs between the images A and B, and the object disappears at the joint between the A image and the B image on the screen after the image synthesis.
For this reason, it is necessary to perform image processing for preventing the occurrence of screen shift on the composite screen. However, if this image processing is performed, there is a problem that the real-time property is impaired.

  The present invention has been made to solve the above-described problems in the prior art, and its purpose is to quickly obtain detailed information on abnormal situations relating to unauthorized entry into a monitored site and failure of equipment at the monitored site. It is an object of the present invention to provide an image monitoring system and an image monitoring apparatus that can be grasped.

In order to solve the above technical problem, the present invention is a video monitoring system in which a monitored site, a monitoring site including a monitoring terminal, and a management server are connected by a network line.
The monitored site includes a plurality of cameras, a recording device that records images of these cameras, and a communication device that transmits an image recorded by the recording device or an image from the camera to a network line.

In addition, the management server receives an image transmitted from the monitored site, transmits a processed image in the management server to a network line, and an image composition unit that combines image data from the monitored site Is provided. Furthermore, a delay detector that detects a time difference between the time added to the image data sent from the monitored site and the time that the image is combined by the image combiner, and the time difference detected by the delay detector is a predetermined time or more A delay processing unit for determining whether or not the communication unit, a communication unit, an image synthesis unit, a delay detection unit, and a control unit that performs control related to the processing of the delay processing unit.
When the delay processing unit of the management server determines that the time difference between the time added to the image data sent from the monitored site and the time when the image is combined by the image combining unit is equal to or greater than a predetermined time In addition, control for changing the frame rate for transmitting image data is performed.

  The monitoring site includes at least a monitoring terminal capable of communicating with the management server, and the monitoring terminal divides and displays a plurality of image data sent from the monitored site on one screen on the display unit. Thus, it is possible to switch and display an enlarged display in which the synthesized image synthesized by the image synthesizing unit is displayed on one screen.

According to the video monitoring system of the present invention, it is possible to quickly track an intruder and to easily grasp a damaged area such as an abnormality in equipment.
Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

It is the schematic which showed the whole structure of the video surveillance system which concerns on the example of the 1st Embodiment of this invention. It is a figure which shows the hardware constitutions of the terminal used in the management server used in the video monitoring system which concerns on the example of the 1st Embodiment of this invention, and a monitoring site and a monitoring site. It is a figure which shows the table of the data structure of the image data transmitted from the camera for image composition shown in FIG. It is a figure which shows the table of the data structure of the image data after processing the image data transmitted from the camera for image composition shown in FIG. 1 within a management server. It is an image figure of the camera installation position on the to-be-monitored site side of the video surveillance system shown in the example of the 1st Embodiment of this invention. FIG. 6A is a diagram showing a monitoring screen of a terminal device on the monitoring site side of the video monitoring system shown in the example of the first embodiment of the present invention, FIG. 6A is an example of split display, and FIGS. 6B and 6C are composite display. It is a figure which shows an example. It is a flowchart which shows the procedure of the operation | movement process in each part of the video surveillance system concerning the example of the 1st Embodiment of this invention. It is the flowchart which showed the procedure of the operation | movement process in each part of the video surveillance system concerning the example of the 2nd Embodiment of this invention.

[Overall Configuration and Function of First Embodiment]
A video surveillance system according to a first embodiment of the present invention (hereinafter referred to as “this example”) will be described below with reference to the drawings.
FIG. 1 is a schematic diagram showing the overall configuration of a video surveillance system for building equipment according to this example. FIG. 2 is a diagram illustrating a hardware configuration of the management server and the monitoring terminal that configure the video monitoring system of the present example.

As shown in FIG. 1, the video monitoring system of this example is configured by connecting a plurality of monitored sites 1 ₁ to 1 _n , a management server 6 and a plurality of monitoring sites 13 _{1 to} 13 _m to a wide area network 2. ing. Here, the monitored sites 1 ₁ to 1 _n refer to buildings such as normal station buildings and buildings, and the monitored sites 1 ₁ to 1 _n are collectively referred to as monitored sites 1. Alternatively, the building 1 may be simply referred to in accordance with the embodiment shown in FIG. The plurality of monitoring sites 13 _{1 to} 13 _m are collectively referred to as the monitoring site 13.

The monitored sites 1 ₁ to 1 _n include a communication device 3 that connects to the network line 2, image synthesis cameras 4 a to 4 d, and a recording device 5 that records image data of the image synthesis cameras 4 a to 4 d. . The image composition cameras 4a to 4d may be collectively referred to simply as the camera 4 or the monitoring camera 4.

The image synthesis cameras 4a to 4d are usually installed at a height such as the roof of the building 1 as shown in FIG.
The communication device 3 transmits images captured by the image composition cameras 4a to 4d to the management server 6 via the network line 2 which is a wide area network. The recording device 5 in the building 1 is a database that records image data of images taken by the image composition cameras 4a to 4d. The recording device 5 is usually formed by a nonvolatile memory.

  The management server 6 includes a communication unit 7, a control unit 8, an image composition unit 9, a delay detection unit 10, a delay processing unit 11, and a database 12. The communication unit 7 is connected to a network line 2 forming a wide area network, and takes in image data from the monitored site 1 to the management server 6 via the network line 2. The control unit 8 is a CPU (Computer Processing Unit) that controls the processing of the communication unit 7, the image composition unit 9, the delay detection unit 10, and the delay processing unit 11, and controls writing and reading to the database 12. .

The image composition unit 9 synthesizes a plurality of image data in the image data acquired by the image composition cameras 4a to 4d. However, in FIG. 6 to be described later, image data of the three cameras 4a, 4b, and 4c and their combined image data are shown, and image data taken by the camera 4d is not shown.
The delay detection unit 10 acquires a shooting time attached to the image data sent from the image synthesis cameras 4 a to 4 d, and the image synthesis unit 9 performs image synthesis using this time (local image acquisition time). The difference from the time when the camera images from the cameras 4a to 4d are synthesized (composition completion time) is detected.

  The delay processing unit 11 determines whether or not the time difference detected by the delay detection unit 10 is equal to or longer than a predetermined time (for example, 5 seconds). When the time difference detected by the delay detection unit 10 is equal to or longer than a predetermined time (for example, 5 seconds), the delay processing unit 11 changes the frame rate of the image data or issues a command including the change of the frame rate. Transmit to monitored site 1.

  Note that there are overlapping portions when pictures from a plurality of cameras 4 are connected. In this case, paying attention to two points in the overlapping portion, for example, when the coordinates and the color are the same value, the control unit 8 causes the image synthesis unit 9 to generate a synthesized image. At this time, with respect to the image of the overlapped portion, it may be determined in advance which image of the camera 4 is to be displayed preferentially. As will be described later, a standard image and color data such as a photograph of the building of the monitored site 1 taken from the sky are registered in advance in the database 12 and are used when the image data is synthesized.

  In addition, the control unit 8 changes the frame rate according to the time difference when two points having the same value overlap in the image data from the plurality of cameras 5. For example, in the case of 1 fps (flame per second), one frame of video is displayed every second. However, when it is necessary to display every two seconds due to network factors, the frame to be synthesized is It will be changed to 0.5 fps.

The database 12 of the management server 6 includes a local information storage area 12a, an IP address storage area 12b, an image storage area 12c, a local image acquisition time area 12d, and a composition completion time area 12e.
In the local information storage area 12a, for example, information on the site to be monitored 1 such as a building name and an area name is stored. The IP address storage area 12b stores IP (Internet Protocol) addresses for distinguishing the monitored sites 1 ₁ to 1 _n . In the image storage area 12c, image data captured by the image composition cameras 4a to 4d installed in the monitored sites 1 ₁ to 1 _n are stored.

  The local image acquisition time area 12d stores the time at which the image is added to the image data of the image composition cameras 4a to 4d sent from the monitored site 1. In the composition completion time area 12e, the time at which the composition processing of the image data of the image composition cameras 4a to 4d is completed in the image composition unit 9 is stored.

The monitoring sites 13 _{1 to} 13 _m include monitoring terminals 14 _{1 to} 14 _m that can monitor the image data collected and combined by the management server 6. However, only the monitoring terminal 14 ₁ is shown in FIG. 1. Note that the monitoring terminals 14 _{1 to} 14 _m are simply referred to as the monitoring terminal 14 when collectively described. As shown in FIG. 2, the monitoring terminal 14 includes a communication terminal such as a normal personal computer or tablet that can be connected to the network line 2. Here, the number m of the monitoring terminals 14 and the number n of the monitored sites 1 are not necessarily matched, but m = n may be used.

[Hardware configuration of management server and monitoring terminal]
FIG. 2 is a diagram showing a hardware configuration of the management server 6 and the monitoring terminal 14 used in the video monitoring system of this example. FIG. 2A shows the hardware configuration of the management server 6, and FIG. 2B shows the hardware configuration of the monitoring terminal 14.

  As shown in FIG. 2A, the management server 6 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, and a nonvolatile storage 24 connected to the bus 20. Prepare. In addition, a network interface 25 for performing communication with the outside is provided.

  The CPU 21 reads out the program code of the software that realizes the function of each unit of the management server 7 related to the video monitoring system of this example from the ROM 21 and executes it. In the RAM 22, variables and the like generated during the arithmetic processing performed in the management server 6 are temporarily written. Various functions in the management server 6 are realized by the CPU 21 executing the program code recorded in the ROM 22.

  The nonvolatile storage 24 is composed of a nonvolatile memory such as an SSD (Solid State Drive) and corresponds to the database 12 of FIG. The ROM 22 and the non-volatile storage 24 store and store semi-permanent programs and data necessary for the CPU 21 to operate. Here, the storage areas of the local information storage area 12 a, the IP address storage area 12 b, the image storage area 12 c, the local image acquisition time area 12 d, and the composition completion time area 12 e described in FIG. 1 are formed in the nonvolatile storage 24. Has been.

  As the network interface 25, for example, a NIC (Network Interface Card) or the like is used, and communication with the monitoring terminal 14 of the monitored site 1 and the monitoring site 13 is performed through the network interface 25.

FIG. 2B shows a hardware configuration of the monitoring terminal 14 provided in the monitoring site 13. The CPU 31, ROM 32, and RAM 33 shown in FIG. 2B are the same as the CPU 21, ROM 22, and RAM 23 shown in FIG.
The non-volatile storage 34 of the monitoring terminal 14 shown in FIG. 2B has the same configuration as a non-volatile memory such as an SSD provided in a smartphone or the like, and programs and data necessary for the operation of the CPU 31 are semi-permanent. Is stored and stored.

The communication unit 35 of the monitoring terminal 14 is for connecting to the network line 2.
The monitoring terminal 14 is provided with an input unit 36 and a display unit 37. The input unit 36 is an input icon or the like used for performing operations such as screen composition and display screen division, which will be described later. The display unit 37 is used to display image data described later with reference to FIG.

  In the video monitoring system of this example, the image synthesizing process from all the plurality of cameras 4 is performed in the management server 6. On the other hand, the storage areas of the local information storage area 12a, the IP address storage area 12b, the image storage area 12c, the local image acquisition time area 12d, and the composition completion time area 12e are provided in the nonvolatile storage 34 of the monitoring terminal 14. The monitoring terminal 14 may perform image processing similar to that of the management server 6. In this case, the monitoring terminal 14 functions as a video monitoring device.

[Data structure of image data and data structure stored in database]
FIG. 3 is a diagram showing a table of a data structure of image data sent from the image composition cameras 4a to 4d or the recording device 5. FIG. 4 is a diagram showing a table of the data structure of image data stored in the database 12 of the management server 6.

  In FIG. 3, an image data field 12c, an IP address field 12b, and a local time field 12d are shown in relation to the image data sent from the three image composition cameras 4a to 4c or the recording device 5. Image data photographed by the image synthesis cameras 4a to 4c is stored in the image storage area 12c shown in FIG. 1, and the IP addresses of the respective cameras 4a to 4c are stored in the IP address storage area 12b of the database 12 in FIG. Stored. The local time when images are acquired by the cameras 4a to 4c is stored in the local image acquisition time area 12d in FIG.

  In FIG. 3, the image data field, the IP address field, and the local time field have the same symbols as the area names of the image storage area 12c, the IP address storage area 12b, and the local image acquisition time area 12d of the database 12 in which the respective data are stored. It is written using. Although not shown in FIG. 3, the image data sent from the image synthesis cameras 4a to 4c or the recording device 5 stores local information such as the building name and address in addition to these pieces of information. Information stored in the area 12a is also included.

  In FIG. 3, it is assumed that only three camera images of image composition cameras 4a to 4c related to image composition to be described later are transmitted from the monitored site 1 to the management server 6, and the camera 4a image, the camera 4b image, and the camera 4c. Only the image is shown. Of course, when the image synthesizing camera 4d and a larger number of cameras are used, these camera images may be included.

As shown in the local time field 12d of FIG. 3, it can be seen that the camera 4a, the camera 4b, and the camera 4c take images of two frames per second and transmit the camera images to the management server 6. For example, when viewing the image of the camera 4a, two frames of local time 12d ₁ “10: 10: 20: 500” and 12d ₂ “10: 10: 21: 000” are shown. This indicates that two frames of images are taken and transmitted in one second from 10:10:20 local time to 21 seconds. Similarly, the camera 4b image and the camera 4c image are taken at the same time as the camera 4a image, and two frames are transmitted in one second (see local times 12d _{4 to} 12d ₆ ). Of course, the times of all the cameras 4a to 4c must match.

FIG. 4 is a diagram showing a table example of the data structure after the image data from the image composition camera 4a is processed in the management server 6.
In addition to the image data field 12c and the local time field 12b, FIG. 4 shows a composition completion time field 12e that describes the time when the image composition processing in the management server 6 is completed. The synthesis completion time field 12e corresponds to the synthesis completion time area 12e of the database 12 shown in FIG. 1, and the same symbols as those in the synthesis completion time area 12e of FIG. 1 are used in FIG. In FIG. 4, only the camera 4a image is shown, but it goes without saying that the same processing is performed for the camera 4b image and the camera 4c image.

As shown in FIG. 4, the camera 4a image taken at the local time “10: 10: 20: 500” has a compositing completion time 12e ₁ of “10: 10: 21: 500”. That is, image composition is completed after one second. Similarly, the image composition of the camera 4a images taken at the local time “10: 10: 21: 000” and the local time “10: 10: 21: 500” is also completed after one second (composition completion time 12e ₂ 12e ₃ ).

However, the camera 4a image shot at the local time “11: 21: 20: 000” has its composition completion time 12e ₄ “11: 21: 25: 000”, and the image composition is performed from the image acquisition time. 5 seconds have passed by the time when is completed.
The compositing completion time 12e ₅ corresponding to the camera 4a image photographed at the local time “11: 21: 20: 500” is blank. This blank means that the camera 4a image taken at the local time “11: 21: 20: 500” was not used as a composite image, that is, thinned out.

Finally, the camera 4a image taken at local time “11: 21: 21: 000” has a compositing completion time 12e ₆ of local time “11: 21: 25: 200”. It is 4.2 seconds until the time and the synthesis completion time. This means that the time from the image acquisition to the image synthesis is within 5 seconds because the camera 4a image photographed and transmitted before is thinned out.

[Relationship of camera for image composition in building]
FIG. 5 is a diagram showing the installation positions of the image composition cameras 4a to 4d installed in the building which is the monitored site 1 in the video monitoring system of this example. In the example of the table shown in FIG. 3, only three image synthesis cameras 4 a to 4 c are shown, but FIG. 5 shows an example in which four cameras 4 a to 4 d are arranged on the roof of the building 1. As shown in FIG. 5, it is possible to monitor illegal intruders in the building 1 over a wide area by arranging four cameras 4 on the rooftop of the building 1 so that the four directions of east, west, south, and north can be monitored. Is possible.

[Multiple camera images and their composition]
6A, 6B, and 6C are image diagrams of a monitoring screen of the monitoring terminal 14 installed in the monitoring site 13 in the video monitoring system of this example.
6A is an example in which a plurality of camera images are divided and displayed on the display unit 37 of the monitoring terminal 14, and FIGS. 6B and 6C are examples in which one screen combined with the plurality of camera images is displayed. Here, an example is shown in which image composition is performed using camera images taken by three monitoring cameras 4a to 4c. FIG. 6B shows a successful example in which one car is displayed on the road on the right side of the figure and the image composition is successful.

  On the other hand, FIG. 6C shows an example where two vehicles that should be displayed originally are displayed and image composition is not successful, that is, a failure example. This is considered to occur when, for example, a moving image including a car shown in the area 16C has more delay than the images in the areas 16A and 16b, and the frame rate has not been accurately changed. Although FIG. 6C shows an example in which two vehicles that should originally be one are displayed, there may be cases where one vehicle that should be displayed is not displayed.

In the video monitoring system of this example, the monitored sites 1 ₁ to 1 _n temporarily store images captured by the image composition cameras 4 a to 4 c in the recording device 5. Then, the image data stored in the recording device 5 is transmitted to the management server 6 via the network line 2. The management server 6 receives the image data from the monitored sites 1 ₁ to 1 _n by the communication unit 7 and stores it in the database 12 under the control of the control unit 8.

The image composition unit 9 performs composition processing of a plurality of image data under the control of the control unit 8 according to the image data from the monitored sites 1 ₁ to 1 _n , as shown in FIGS. 6B and 6C. In addition to the images from the cameras 4a, 4b, and 4c, image data such as a top view of the building 1 that is the monitored site is used as the composite image. The image data required for the synthesis of the image such as the top view of the building that is the monitored site 1 is registered in advance in the image storage area 12c.
Further, the control unit 8 activates the delay detection unit 10 and acquires the time added to the received image data. Then, the difference between the time acquired by the delay detection unit 10 and the time when the image is combined by the image combining unit 9 is compared.

When it is determined in the comparison result of the delay detection unit 10 that there is a delay of 5 seconds or more between the time when the image is acquired and the time when the image composition is completed, the delay processing unit 11 Performs processing to change the frame rate.
Thereafter, the management server 6 transmits the image data of the cameras 4a to 4c and the image data subjected to the synthesis process to the monitoring terminal 14 of the monitoring site 13 via the network line 2. The monitoring terminal 14 performs display shown in FIGS. 6A to 6C described later based on these image data.

  As shown in FIG. 6A, the display screen of the display unit 37 of the monitoring terminal 14 is divided into areas 16 </ b> A to 16 </ b> D for each of a plurality of cameras in order to display a plurality of cameras before synthesis on one screen. Here, images of three cameras 4a, 4b, and 4c are shown in areas 16A, 16D, and 16C. The area 16D is blank because there is no camera image to be displayed. However, for example, an image acquired by the fourth camera 4d can be displayed.

  In FIG. 6A, an image composition button 16E is provided, and by touching the image composition button 16E, three images from the composition cameras 4a to 4c are composed, as shown in FIGS. 6B and 6C. The display is switched to the full screen 16F display.

[Operation procedure of the video surveillance system of this example]
FIG. 7 shows a procedure of operation processing between the recording device 5 provided in the monitored site 1 (building 1), the management server 6 and the monitoring terminal 14 in the monitoring site 13 constituting the video monitoring system of this example. It is a flowchart which shows.

As shown in FIG. 7, a composite image data display request is transmitted from the monitoring terminal 14 to the management server 6 (step SA1). The management server 6 receives a display request from the monitoring terminal 14 via the communication unit 7 (step SB1).
Then, the control unit 8 of the management server 6 sends an image data transmission request to the image composition cameras 4a to 4c or the recording device 5 installed in the building 1 (step SB2).

The communication device 3 at the monitored site 1 receives the transmission request from the management server 7 (step SC1), and causes the image composition cameras 4a to 4c to acquire local image data or is acquired in advance and recorded by the recording device 5. Is acquired as local image data (step SC2).
Then, local image data is transmitted from the communication device 3 in the monitored site 1 (building 1) to the management server 6 via the network line 2 (step SC3).

  The management server 6 receives the image data transmitted from the monitored site 1 through the communication unit 7 (step SB3). The control unit 8 in the management server 6 activates the delay detection unit 10 and stores the local image acquisition time assigned to the received image data in the local image acquisition time area 12 d in the database 12. Subsequently, the control unit 8 compares the received local image acquisition time with the composition completion time stored in the composition completion time area 12e and determines whether there is a delay of 5 seconds or more (step SB4). .

  If there is a delay of 5 seconds or more in step SB4 (NO in step SB4), the control unit 8 activates the delay processing unit 11 to convert the frame rate of the image data from 2 fps to 1 fps. Perform (step SB5). That is, the image data of one preceding frame out of two consecutive frames of image data is thinned out. Here, it is assumed that the images acquired by the image composition cameras 4a to 4c acquire 2 frames per second (that is, the frame rate is 2 fps) as shown in FIG.

Next, the control unit 8 activates the image composition unit 9, and performs image composition processing when there is a delay of 5 seconds or more in step SB4 at the frame rate changed in step SB5 (step SB6). . Thereafter, the control unit 8 transmits the synthesized image data to the monitoring terminal 14 of the monitoring site 13 via the communication unit 7 and the network line 2 (step SB7).
Further, the control unit 8 stores the time when the image composition processing is completed in the composition completion time area 13e (step SB8). The monitoring terminal 14 at the monitoring site 13 receives the image composition data sent from the management server 6 (step SA2), and displays the synthesized image on the screen 16F of the display unit 37 of the monitoring terminal 14 (step SA3). .

  When it is determined in step SB4 that there is no delay of 5 seconds or more (YES in step SB4), the control unit 8 does not activate the delay processing unit 11, that is, one frame of step SB5. The image composition processing in step SB6 is performed without thinning out the image data.

  In the video monitoring system of this example, only the process of converting the frame rate change accompanying the delay process from 2 fps to 1 fps is described, but the frame rate conversion process such as converting the frame rate from 1 fps to 0.5 fps, etc. is performed. You may do it.

  According to the video monitoring system of the present example described above, it is possible to optimally combine a plurality of camera images by the action of the delay detection unit 10 and the delay processing unit 11 of the management server 6. In other words, even if there is a time difference between the image composition completion time and the local shooting time when combining multiple camera images, the real-time property of optimal combining of multiple camera images is ensured by changing the frame rate. can do. In addition, since it is possible to quickly track unauthorized intruders and acquire detailed information at the monitoring site, it is possible to quickly grasp how far abnormal conditions such as equipment have spread.

  In the video monitoring system of this example, the management server 6 is provided to perform image composition, delay detection, and delay processing. However, these are not used in the monitoring terminal 14 of the monitoring site 13 without using the management server 6. It is also possible to perform the process.

[Explanation of Second Embodiment of the Present Invention]
FIG. 8 is a flowchart for explaining a communication operation among the monitoring site 13, the management server 6, and the monitored site 1 (building) in the second embodiment of the present invention.
In the second embodiment, a request for changing the frame rate is included in the image data transmission request from the management server 6 to the monitored site 1 from the monitoring terminal 14 of the monitoring site 13 via the network line 2. In such a case, the frame rate is changed at the monitored site 1.

  In the second embodiment, a composite image data display request is transmitted from the monitoring terminal 14 of the monitoring site 13 to the management server 6 via the network line 2 (step SA1). The control unit 8 of the management server 6 receives the composite image data display request from the monitoring terminal 14 (step SD1), and creates image data request data for the monitored site 1 (step SD2). The creation of the request data in step SD2 is performed by the same processing as in step SB4 of FIG. 7, but at this time, a request for changing the frame rate is included in the request from the management server 6.

  That is, in step SD2, the acquisition time of the local image stored in the local image acquisition time area 12d of the database 12 of the management server 6 and the time when the synthesis of the image stored in the synthesis completion time area 12e is completed. Compare. Then, in step SD2, after determining whether there is a delay of 5 seconds or more, request data to be transmitted to the monitored site 1 is created. If there is a delay of 5 seconds or more between the local image acquisition time and the image composition completion time, the management server 6 includes a request to change the frame rate in the request data and transmits the request data to the monitored site 1 (step). SD3).

The monitored site 1 receives the request data from the management server 6 (step SF1), and acquires target local image data from the image synthesis cameras 4a to 4c or the recording device 5 (step SF2).
Then, according to the request data created in step SD2, it is determined whether or not a request for changing the frame rate is included in the request data (step SF3). If it is determined in step SF3 that a request for changing the frame rate is included in the request data (NO in step SF3), a frame rate of 2 fps for transmitting 2 frames per second in the monitored site 1 The frame rate is changed to a frame rate of 1 fps at which 1 frame is transmitted per second (step SF4).

On the other hand, when it is determined in step SF3 that the request data does not include a frame rate change request (YES in step SF3), the monitored site 1 does not change the frame rate, and the communication device 3 transmits the image data to the management server 6 via the network line 2 (step SF5).
The management server 6 receives the image data from the monitored site 1 (step SD4), and the control unit 8 activates the image composition unit 9 to perform image composition processing (step SD5). Then, the management server 6 transmits the image composition data to the monitoring terminal 14 at the monitoring site 13 (step SD6).

The control unit 8 stores the time when the image composition processing is completed in the composition completion time area 12e (step SD7). The monitoring terminal 14 of the monitoring site 13 receives the image composition data (step SA2), and displays the images of the image composition cameras 4a to 4c on the screen 16A of the monitoring terminal 14 as in the first embodiment of FIG. In addition to the division display on C, the image composition data is displayed on the screen 16F of the monitoring terminal 14 (step SA3).
In addition, according to the second embodiment described above, the frame rate can be changed (thinning out images) on the monitored site 1 side, so the number of images transmitted from the monitored site 1 side to the management server 6 is reduced. be able to.

[Modification]
As a modification, when the delay detection unit 10 of the management server 6 determines that a time delay has occurred between the local time when the image is acquired and the combination completion time of the plurality of camera images, the management server 6 6 resources (CPU, memory) may be temporarily increased, and when it is determined that the delay has been eliminated, it may be possible to allocate the original resource.

  Each of the above-described configurations, functions, processing units, processing means, and the like can be realized in hardware by designing a part or all of them, for example, with an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function can be stored in a recording device such as a memory, a hard disk, an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.

Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.
It should be noted that the present invention is not limited to the embodiments disclosed in the specification or the drawings, and of course includes other applications and modifications as long as they do not depart from the contents described in the claims. It is.

1 ₁ to 1 _n: Site to be monitored (building), 2 ... network line, 3 ... communication device, 4a to 4d ... camera for image composition, 5 ... recording device, 6 ... Management server, 7 communication unit, 8 control unit, 9 image compositing unit, 10 delay detection unit, 11 delay processing unit, 12 database, 12a .. Local information storage area, 12b ... IP address storage area, 12c ... Image storage area, 12d ... Local image acquisition time area, 12e ... Composition completion time area, 13 _{1 to} 13 _m Monitoring site, 14 ... monitoring terminal, 16A to 16D ... divided display area, 16E, 16G ... screen switching button, 16F ... composite screen display area

Claims (5)

In a video monitoring system in which a monitored site, a monitoring site including a monitoring terminal, and a management server are connected by a network line,
The monitored site is
A plurality of cameras, a recording device that records the images of the plurality of cameras, and a communication device that adds a time of shooting to an image recorded by the recording device or an image from the camera and transmits the image to a network line. Prepared,
The management server
A communication unit that receives an image transmitted from the monitored site and transmits an image processed by the management server to a network line;
An image synthesis unit that synthesizes image data from the plurality of cameras of the monitored site;
A delay detection unit that detects a time difference between the time added to the image data sent from the monitored site and the time of image synthesis by the image synthesis unit;
A delay processing unit that determines whether or not the time difference detected by the delay detection unit exceeds a predetermined time; and a control unit that performs control related to processing of the image synthesis unit, the delay detection unit, and the delay processing unit And comprising
The monitoring terminal of the monitoring site is
A display unit for switching and displaying divided display for displaying a plurality of image data sent from the monitored site on one screen, and an enlarged display for displaying the composite image synthesized by the image composition unit on one screen; With
In the delay processing unit of the management server, it is determined that the time difference between the time added to the image data sent from the monitored site and the time when the image is synthesized by the image synthesizing unit is a predetermined time or more. Change the frame rate to send image data,
Video surveillance system. The change of the frame rate of the image data is performed in the delay processing unit of the management server when the delay processing unit of the management server is a predetermined time or longer.
The video surveillance system according to claim 1. When the change of the frame rate of the image data is determined by the delay processing unit of the management server to be a predetermined time or more, the management server sends a command including the change of the frame rate to the monitored site, At the monitored site, based on the frame rate change command,
The video surveillance system according to claim 1. The management server includes a database composed of nonvolatile storage,
The database is
A local information storage area for storing the name of the area related to the monitored site that is local;
An IP address storage area for storing an IP address for distinguishing the monitored site;
An image storage area for storing image data captured by the plurality of cameras installed at the monitored site;
A local image acquisition time area for storing the time when the image data was acquired by the plurality of cameras installed in the monitored site;
The video monitoring system according to any one of claims 1 to 3, further comprising a composition completion time area for storing a time at which the processing in the image composition unit is completed. In a video monitoring device that displays video data from monitored sites captured by multiple cameras on a single screen,
A communication unit that receives a plurality of image data from the monitored site and a time when the image data was captured;
An image combining unit that combines image data from the plurality of cameras;
A delay detection unit that detects a time difference between the time when the image data sent from the monitored site was captured and the time when the image was synthesized by the image synthesis unit;
A delay processing unit that changes a frame rate of the image data when a time difference detected by the delay detection unit is a predetermined time or more;
A control unit that performs control related to processing of the image synthesis unit, the delay detection unit, and the delay processing unit;
A display unit that switches and displays a divided display of each of a plurality of screens of image data sent from the monitored site, or an enlarged display of a combined image combined by the image combining unit,
Video surveillance device.

Images