JP2007048249A - Safety monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a picture analysis system capable of extracting dangerous events or the like for reducing a load of a watcher, wherein danger or the like is mainly determined by a watcher watching pictures, in regard to a safety monitoring system using picture information to carry out monitoring. <P>SOLUTION: An intelligent picture monitoring system is composed by using an intelligent picture analysis system capable of carrying out analysis in units of element of a monitoring object in a picture. An analysis function of the analysis system is used to monitor activities of the monitoring object. By having the intelligent picture monitoring system carry out judgement of monitoring for danger prevention carried out by the watcher, and transmission work to related departments when there is a dangerous situation, the load of the watcher can be reduced. At the same time, a movement record of a person, an automobile, or the like becoming the monitoring object such as an intruder, namely, an activity locus is displayed as a locus in the picture, and a measure to crime prevention is also taken by knowing the intrusion point. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

Technical field to which the invention belongs

  The present invention relates to a video safety monitoring system.

  As shown in FIG. 1, a conventional video safety monitoring system uses a video transmission device 102 to connect a video obtained by one or a plurality of surveillance cameras 101 at a monitoring point to a monitoring room 108. In the monitoring room, the system integration server 103 distributes the transmitted video to the recording device 104, the display device 105, the printer 106, and the like, and the video information transmitted from the monitoring camera 101 is transmitted to the display device and the like. Monitoring items are monitored through monitoring items such as dangerous or abnormal conditions occurring at the monitoring point, such as intrusion of suspicious persons in the trajectory, presence of persons, objects, etc. in the level crossing where the level crossing is blocked However, a supervisor discovered the situation and transmitted a danger or warning to a related person or a related department, and at the same time, the video was constantly recorded [Patent Document 1]. In the safety monitoring system, it is necessary for a monitoring person to keep an eye on the video and keep monitoring.

  Further, in the monitoring room 108 where the video information of a plurality of monitoring points is collected, the monitor 107 arranges a plurality of display devices so that the images from the cameras at the plurality of monitoring points can be monitored at a time, or simply. Divide the screen of one display device [Patent Document 2] to monitor all the monitoring point images at all times or to monitor a plurality of monitoring point images on a single or multiple display devices Monitoring is carried out by a method of sequentially switching and displaying every short period of time, and the monitor 107 continues to monitor by watching the video of those display devices, and the monitoring items, that is, the suspicious person intrusion in the orbit and crossing are blocked. An event corresponding to a monitoring item such as an abnormality such as the presence of a person, an object, or a danger in a level crossing is detected and transmitted to a predetermined place and people. In addition, the recording device continuously records video.

  Attempts have also been made to replace the function of the monitoring person 107, that is, the function of judging an abnormality or danger by looking at the image of the display device 105 and notifying it with a monitoring system using an image analysis system or the like. (A) A method for detecting and determining a change between frames of a video by a motion detector detection system, (b) a system for detecting an abnormality from the area and moving speed of a video change area, and (c) a vector of a pixel set of a video A method of detecting and determining by calculating, that is, an optical flow detection system is well known.

Although (a) is the most generalized detection system at present, any change in an object in a video is detected in the same way, that is, the video object cannot be identified or identified. (B) can be distinguished from other moving objects in the image such as vegetation because it identifies and detects a person, car, etc. from the continuity and aspect ratio of the change area of the image. However, it is impossible to know a plurality of overlapping persons or specific actions of the persons, for example, where to enter the monitoring range in the vehicle trajectory from where the person or the like moves. Regarding (c), a recently developed method has been used in a monitoring system that measures landslides and river flow, but the surveillance camera itself shakes or moves around in the image, for example, drops on the camera lens or insects. When there is a crawl, malfunction is expected.
Patent Publication 2003-046989 Patent publication 2004-522379 Patent Publication 2004-94518 Wayne Wolf, Barrack Ozer, Teehan Liu “System with Smart Cameras” Electrical and Electronic Society of Japan, Computer Group 35 (9) 2002 Wayne Wolf, Burak Ozer, Tiehan Lv, “Smart Cameras as embedded system,” IEEE 35, IEEE 35 ) September 2002

Problems to be solved by the invention

  For example, in a vehicle track safety monitoring system that is installed to ensure traffic safety and minimize accidents, the monitoring staff grasps events that may cause accidents (herein referred to as monitoring contents) and related departments. It is intended to be used to prevent accidents from occurring. For this purpose, it is necessary to make a judgment for safety, that is, prevention of danger, and to speed up a process for transmitting the information. Since it is transmitted after waiting for the judgment of the observer, that is, human beings, it takes time for the judgment and the notification action of the alarm, and it takes time to notify the danger information that was known in advance, so it is said that the accident is avoided. It is also possible that it does not function well for the purpose. One of the reasons is that it takes time because it is considered dangerous after the observer sees the occurrence of the event with the video of the monitoring point of the display device and reports it as dangerous. In order to immediately detect the occurrence of danger, it is essential to keep an eye on the video for monitoring, that is, to keep an eye on the video, that is, the observer should be able to keep an eye on the video. It is. Further, when monitoring a plurality of display devices, monitoring omission due to the large load and delay in monitoring judgment are inevitable. In other words, immediate response to risk judgment is almost impossible. The second involves the means of reporting. The time difference between the work of recognizing the prediction of the occurrence of a dangerous event and the reporting may be a decisive factor for the accident, so it is necessary to make sure that the relevant departments are contacted promptly and that they really need raw information. It is well known that the real measures for avoiding accidents will not be approached unless it is communicated to the driver of the vehicle and the operation manager. Third, it is also necessary to convey a warning directly to a person or object who takes a dangerous action. In order to minimize the damage caused by accidents and disasters, it is much more difficult to expect only the observers to avoid the accident. However, it is essential to reduce the load against the overload state of the observers. At the same time, by reducing this overload, it is possible to reduce the number of observers, that is, labor costs, and to collect and analyze the occurrence of danger etc. early, that is, including prior information, and quickly analyze the analysis results to related departments and people. It is necessary to have a monitoring system that can be communicated, and each department can quickly take measures and take actions against accidents and disasters with this early information. For example, the first early detection of danger and the second quick transmission of danger information are most important for safe operation of the vehicle. In order to bring out the effect further, it is possible to transmit video information quickly to the driver of a train that operates in the vicinity, and to transmit it to people in the operation control room. On the other hand, the development of various monitoring systems [0004] has been attempted, but it is still unsatisfactory to rely on the judgment because of its drawbacks. Therefore, the load on the first observer has not been reduced.

Means to solve the problem

In order to solve the above problem, it is possible to use an intelligent video analysis system (function of the smart camera system shown in [Non-Patent Document 1]). The function of the intelligent video analysis system is to be able to independently monitor the movement of the part to be monitored as shown in FIG. In the past, a person was captured as a lump of shapes in the form of a moving object on the screen and templated and tracked. [Patent Document 3] Viewing movement by distinguishing between elements such as the person's head, torso, legs and hands. I couldn't. That is, according to the analysis system, it is the same as the person, here the object, but it can be confirmed by dividing it into element parts, so that the most easily distinguishable part of the person can be selected from the image. By using the head as the tracking target, the surveillance camera can monitor and track multiple people. The judgment action of the observer, that is, the judgment of the occurrence of a dangerous event performed in light of the monitoring contents stored by the observer, for example, there is an object such as a person or a car in the railway crossing for a certain time or more despite the crossing of the railway crossing In addition, a function that determines whether or not an event that falls under the monitoring content, such as a dangerous action such as being present for a certain period of time after entering or entering a track from a railroad crossing passage, and a function that issues an alarm based on the determination The intelligent video monitoring system can solve the problem by performing it on behalf of the supervisor.
In other words, the video from the surveillance camera is analyzed by the intelligent video analysis system, and it is judged that it falls under danger, etc., and information about the occurrence of danger and abnormality is sent to the surveillance staff and related departments as well as the video at the time of danger occurrence. An image from an arbitrary time before the point when it was determined to be dangerous, or a video in which a trajectory of an intruder or dangerous object captured in the image is superimposed and displayed as a line, can be monitored by a supervisor or in advance. This can be solved by a safety monitoring system equipped with an intelligent video monitoring system having a function of transmitting danger information, such as “danger indication” and “alarm indication” transmitted to a department, and notifying danger by voice.

The invention's effect

  The present invention brings about the following effects. A monitoring system that includes a video analysis system, that is, a function that determines the danger, that is, the content of the monitoring, and a function that transmits information about the danger are provided to the monitoring system that includes the video analysis system. By providing this function, it is possible to reduce the time taken by the person who is a supervisor and the act of notifying the related department by the judgment by the monitoring system, thereby avoiding danger accordingly. This has the effect of increasing the time taken to take action. In order to prevent danger, it is important to shorten the time required for reporting. At the same time, the load that the surveillance staff must keep watching the surveillance video at all times is greatly reduced. That is, the fatigue of the observer can be reduced, and at the same time, more points can be monitored with fewer observers. In addition, it is indicated how the monitored object behaves and shifts to a dangerous act by displaying an image that draws a line that displays the trajectory of the object that is a feature of the present invention. Knowing whether or not it has entered the orbit, how far it has entered, and the intrusion time and its trajectory makes it possible to follow up and monitor and take measures against further crime prevention. Furthermore, by using a digital communication means such as the Internet or an intranet that is always connected to notify the relevant department of the danger, the video, alarm, and tracking image, which are dangerous information, can be instantaneously displayed at the same time by the supervisor, the relevant department, especially the operation. It is possible to build a system that can be sent to people who take direct risk-avoidance actions such as hands and operation managers.

  Furthermore, the conventional monitoring system requires a large capacity because the video information from the monitoring camera is always recorded. However, it is also possible to record from the video a certain time before the time when danger is detected using the judgment function by the video analysis system, and in that case, the economic effect that only a very small recording capacity is required can be expected. . Furthermore, since the recorded video is limited, it can be expected that there will be almost no conflict with privacy infringement by the surveillance camera.

  Further, in order to bring out the effect of the present invention, a judgment function of danger or the like, that is, a judgment function of monitoring at a monitoring point on the camera side is provided by attaching a computer system including an intelligent video analysis system to the monitoring camera side at the monitoring point. If it is determined that there is a danger, the display will indicate the danger together with an image and a diagram representing the trajectory of the subject or person's action that is judged to be dangerous. A composite of a video that is superimposed on the video or displayed beside the video is transmitted to the monitoring room or a predetermined department, and means for transmitting the information from the monitoring camera side to the monitoring room is conventionally provided. If the number of surveillance cameras increases, the capacity of the communication line increases and the equipment costs increase. Communication If a system transmitted only La side line is small, requires economic effects. Further, as another communication means, a computer system including an intelligent video analysis system attached to the surveillance camera side has an Internet communication function, and continues to send the video complex to the side that monitors the video complex by always connecting the Internet line. You can also. In particular, the transmission of information via the Internet can also inform the computer display at the driver's or operation manager's computer display of danger such as video information, and the danger information is immediately notified to the direct department taking the risk avoidance action. Has an effect that can be. Of course, from the side receiving the information such as the monitoring room, the video of the desired monitoring camera can be displayed at any time for monitoring.

FIG. 1 shows a conventional safety monitoring system using video. A video for monitoring is transmitted from the camera 101 which is a monitoring camera to the monitoring room 108 by the video transmission device 102, and the monitoring video received by the system integration server 103 in the monitoring room is displayed on the display device 105 and the recording device 104. Delivered to the printer 106. The monitoring image 107 displayed on the display edge 105 is monitored by the monitoring person 107, and when a danger is found, an alarm is sounded or the like, but it is not described by the alarm device 109 but is transmitted to the related person or related department. [FIG. 2] is obtained by connecting a computer system 210 in which an intelligent video analysis system is incorporated into the conventional video safety monitoring system of FIG. 1 in the middle of the line between the video transmission device 202 and the system integration server 203. FIG. 2 is a system diagram of an intelligent video surveillance system that is an additional type of the function. The computer system 210 can individually monitor the element parts of the video object in the video from the monitoring camera 201 such as the head part and the body part. FIG. 8 specifically illustrates this function. Taking a person as an example, the head 801, the torso 802, and the hand portion 802 are separated and their movements are analyzed. The right figure (b) shows the head 811, the torso portion 813, and the hand portion 812 on the screen of the next video. It is the schematic diagram which analyzed the position. The lower diagrams (c) and (d) are schematic diagrams of a conventional recognition method based on object image recognition. The whole body of a person captured in the video or the whole of a car or the like is monitored, and its movement, that is, how to recognize the moved person on the next screen of the video is shown. Further, [FIG. 2] shows that video information or the like can be directly transmitted to the train driver or the like 207, and communication is possible not only by wire and wireless but also by the Internet. FIG. 3 is a diagram showing an example in the case where a monitoring area that forms the basis of the present invention is designated. FIG. 3 shows a crossing site from a crossing bar following the road 302. Here, a portion 303 surrounded by a thick dotted line is a monitoring area in a crossing. Of course, the vehicle track 304 crosses the monitoring area. This shows that the monitoring area can be set. [FIG. 4] uses the function of the intelligent video analysis system to change the monitoring contents depending on whether the setting is outside or within the set area. One or more moving objects, in this case, the intruder 401 is monitored, the action trajectory after entering the intrusion prohibited area from the monitoring area 303 is displayed as a line and superimposed on the video, and the person who is the monitoring target It is shown that the trajectory from any time before can be displayed. For example, even if the foot is stepped off and stepped into the vehicle trajectory, if it is within the range of an arbitrarily set time (for example, 5 seconds), no danger information is output, and the time longer than the set time remains intruding into the track In the case of this state, it is determined that the person is an intruder 401 and danger information is output.

  Regarding the image of the surveillance camera, in FIG. 5, it is determined that it is a serious danger that the object held by the intruder 503 is left in the trajectory 502, and the intruder 503 leaves the place. When returning, it is judged as an illegal act, that is, an illegal dumper or a line jammer, and the trajectory 501 of the intruder is continuously recorded and represented by a line. Overlay the monitoring video as information, or display the most prominent method on a part of the display device, for example, alarm warning and display flushing etc. are also performed, and alarms etc. are given to the monitoring side, that is, monitoring personnel and people related to monitoring Continue to send information to avoid accidents and so on.

[FIG. 6] is a diagram for explaining monitoring of a plurality of objects that have entered a monitoring area where entry is prohibited by a safety monitoring system in which an intelligent video monitoring system is transplanted. [FIG. 6] is an object to be monitored in a railroad crossing that has already been closed, and in the example shown in the figure, two people 601 and 602 or a person on a car, a motorcycle, or a bicycle can also be a monitoring object. If it is determined that it exists outside the specified time range, an alarm is sent to the relevant department, and it is not shown in FIG. It is also possible to issue danger information at The information that the level crossing is closed may refer to an electrical signal that sounds a normal level crossing alarm. Alternatively, as shown in FIG. 6, it is possible to use the image analysis technique to determine that the breaker has been lowered based on the position of the crossing bar 603, that is, the blocking bar, and start the monitoring function of the system. good.

[FIG. 7] attaches a computer system in which an intelligent video analysis system is transplanted to each monitoring camera 701 at a monitoring point, and stores in the computer system actions and operations that are determined to be a preset danger as monitoring contents. The monitoring object of the image from the remote monitoring camera, for example, a person or an object represented by a car, a bicycle, etc. Video from any time before the time of the determination is sent to the monitoring room 711 and other necessary departments or people via the always-connected Internet line 702, the video, the danger information, the traced trace line, etc. To do. The video including the alarm information is transmitted to the system integration server 705 and displayed on the video display device 707, and a danger display signal such as a large red color is displayed so as to be noticeable to the monitor 710, or the danger is notified by flashing. At the same time, the video recording is recorded by the video recording device 708, and the alarm information is also sent from the automatic alarm output device 706 to a predetermined destination. The printer 709 prints related images as necessary. Information exchange via the Internet can be sent to anywhere with a personal computer such as a train cab in the vicinity of a department having an Internet receiver, without going through the system integration server. By transmitting the danger information directly from the system on the surveillance camera side, the transmission time is greatly shortened. By installing the intelligent video analysis system on the surveillance camera side, it is possible to send a safety to a related person who performs monitoring more quickly and more widely, and a safety surveillance system with higher safety can be realized. Needless to say, the surveillance camera can call and view the video of the surveillance camera at any time.

Conventional safety monitoring system with video Surveillance system that adds intelligent video analysis system functions to the current system Illustration of the monitoring area in a level crossing A person enters the orbital premises from the level crossing area. An example when an intruder enters the orbit and returns with the things owned by the intruder left in the orbit Line indicating the detection of the state where a person or vehicle stays in the level crossing while the level crossing is blocked, and the locus Surveillance system that adds intelligent video analysis system functions to the current system Analysis diagram of intelligent video analysis system

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Surveillance camera 102 Image transmission device 103 System integration server 104 Recording device 105 Display device 106 Printer 107 Monitor 108 Monitoring room 109 Alarm device 201 Monitoring camera 202 Image transmission device 203 System integration server 204 Recording device 205 Display device 207 Vehicle operation 210, etc. 210 Computer system with built-in intelligent video analysis system 302 Railroad crossing 302 Road 303 Crossing monitoring area 304 Vehicle trajectory 401 Intruder 402 Railroad crossing bar 403 Intruder intrusion trajectory display line 404 Within railroad crossing area 405 Vehicle trajectory (track)
501 Intruder trajectory display line 502 Abandoned object 503 Intruder 504 Vehicle trajectory (track) 505 Railroad crossing area 601 Person who enters through the railroad crossing 602 Vehicle trajectory (track)
603 Railroad crossing bar 604 Person crossing the closed railroad crossing 605 Intruder trajectory display line 701 Computer system 702 with built-in surveillance camera and intelligent video analysis system Internet communication line 703 Send to Internet service provider 704 Receiving computer 705 System integrated server 706 Automatic alarm output device 707 Video display device 708 Video recording device 709 Printer 710 Monitor 711 Monitoring room 801 Human head in video 802 Hand portion 803 Body portion 811 Head after movement 812 After movement 813 Recognize the presence of a person in the video 822 Recognize the moved person

Claims (5)

  A device for recording a video from a monitoring camera on a recording device via a system integration server by a transmission device, displaying the video on a display device, copying the video with a printer or the like and launching it on a paper surface, etc. It is known by inserting a computer system that incorporates an intelligent video analysis system in the middle of the video communication line into a safety monitoring system that has an alarm transmission means that determines that the video is dangerous and transmits an alarm to the relevant department. A video monitoring system having a function of a dynamic video monitoring system, storing the monitoring content in the computer system, analyzing the video of the monitoring point and matching the dangerous action, that is, the monitoring content, An object is selected as a monitoring target, its coordinates are calculated to obtain position information, and the tracking of the movement of the monitoring target is continued. Is a video surveillance system with a function of displaying the image as a line and displaying it over the video, wherein a part of the visual field of the video is designated and set as a surveillance area, and enters the surveillance area or conversely from the surveillance area The same applies to the case of entering an outside area. However, if there is a person or an object, such as a bicycle or a car, the video monitoring system determines that there is an intruder (thing) and is dangerous to monitor. The video or video before and after the time at which the occurrence of the danger is detected is displayed with the display of danger and the trajectory of the intruder superimposed or displayed prominently on a part of the display unit. Safety monitoring system with a function to communicate to related departments. The intelligent video analysis system incorporated in the intelligent video surveillance system according to claim 1 is used to detect a person or an object entering the surveillance area, and set the area or the setting reverse to make it out of the area. However, a safety monitoring system that has the function of determining that it is an intruder or an intruding object and issuing a warning of danger to the monitoring personnel and monitoring personnel if it continues to invade there for an arbitrarily set time.   Using the intelligent video analysis system incorporated in the intelligent video surveillance system according to [Claim 1] and [Claim 2], the video surveillance system determines that the intruder is intruder, and the intruder continues to intrude. For example, a safety monitoring system that detects an illegal act of illegally neglecting or discarding possessed items when it is left or abandoned in a vehicle track or the like, that is, a safety monitoring system that detects illegal dumping or disturbing acts.   [Claim 3] When an intruder who has illegally left or dumped his / her belongings illegally moves, he / she keeps tracking on the image and continuously displays the trajectory on the image to indicate the escape direction. A safety monitoring system that has the ability to track people who have been left behind or illegally dumped.   [Claim 1] [Claim 2] [Claim 3] and [Claim 4] A monitoring system having the function according to claim 1, wherein the intelligent video surveillance system is provided at a surveillance camera at a surveillance point, that is, a front end. A computer system is attached, and the functions of the Internet are ported. Using the always-connected Internet, not only is it sent to everyone who has the Internet equipment of surveillance personnel, but also includes train drivers, operation managers, etc. A safety monitoring system that can transmit video information etc. that convey dangers etc. to people who are widely involved in safety at the same time through the Internet.