JP2006287883A - Video monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To mostly eliminate a problem of privacy infringement with a monitoring camera, and at the same time, to largely reduce a time required for recording video images from the monitoring camera. <P>SOLUTION: An intelligent video monitoring system utilizes a smart camera system capable of analyzing an image by constituents of an object to be monitored in a video image, i.e. an intelligent video analyzing system. Otherwise, the intelligent video monitoring system is configured by adding the smart camera system, i.e. the intelligent video analyzing system to a conventional video monitoring system. The intelligent video monitoring system can automatically judge monitoring items such as a danger or an abnormality by using the inside of the system, thereby reducing a load of monitoring work on monitoring persons, and further dealing with privacy infringement by using limited video records. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video surveillance system.

  As shown in FIG. 1, the conventional video monitoring system transmits a video of a monitoring camera 1 that captures a monitoring target to a monitoring room 8 by a transmission device 2 by wire or wirelessly, and the video is transmitted to the system integration server in the monitoring room. 3 is connected and distributed to the video recording device 4, the display device 5, the printer 6 and the like, and the monitor 7 monitors the video information transmitted from the monitoring point through the display device. Monitoring instruction items such as landslides, suspicious person intrusions, etc. are discovered, and dangers or warnings are reported to related persons or related organizations.

  In the monitoring room where video information of a plurality of monitoring points is collected, the screens of a plurality of display devices or a single display device are divided so that the monitor can monitor the images of the plurality of monitoring points at once (Patent Document) 2) and the like, and a display device is provided that displays all the monitoring point images at all times, or switches and displays a plurality of monitoring point images at a certain time on a single or a plurality of display devices. The monitor continues monitoring with the video on the display device, finds out the abnormalities and dangers that are the monitoring items, and when found, reports them to a predetermined place and person. In addition, the video recording apparatus continues to record the video that is always transmitted.

  Attempts have also been made to replace the function of the observer, that is, the function of judging and reporting abnormalities and dangers by looking at the video from the surveillance camera using the video analysis system. (A) a motion detector detection system, that is, a method for detecting and judging a change between frames of a video, (b) a system for detecting an abnormality from the area and moving speed of a video change region, and (c) a pixel set vector of the video A method of detecting and determining by calculating the value, that is, an optical flow detection system is described.

(A) is the most generalized detection system at present, but it detects the change in the image of any object in the same way, that is, does not identify the image object. (B) can be distinguished from other moving objects in the image, for example, vegetation fluctuation, because the person and the car are identified and detected from the continuity of the change area of the image and the aspect ratio. However, it is impossible to determine a plurality of overlapping persons or a specific action of the persons, for example, a state where a person is raising his hand or lying down. Regarding (c), a recently developed method is used in a system that can measure landslides and river flow, but the surveillance camera shakes or moves around in the image, such as when a drop crawls on a camera lens or a bug catches. Etc., malfunction is expected. In addition, when the flow of the river being observed has changed, the system must be reconfigured.
Patent Publication No. 10-294933 Patent publication 2004-522379 Teehan Liu, Barrack Ozer, Wayne Wolf “Smart Camera System Design”, Vol. Wayne Wolff, Barrack Ozar, Teahan Liu “System with Smart Cameras” Electrical and Electronic Society Computer Section 35 (9) 2002 Wayne Wolf, Burak Ozer, Tiehan Lv, “Smart Cameras as embedded system,” IE 35 9) September 2002

  In order to display the images of multiple monitoring points one by one on the display device and keep the monitor constantly monitoring and to detect the occurrence of abnormal situations and dangerous situations, it is necessary to continue to pay attention for a long time. It requires the patient's perseverance and has a high risk of being overlooked. Furthermore, when a plurality of display devices are monitored by one person, it is inevitable that monitoring is overlooked due to physical and mental loads. If this oversight is eliminated, the burden on the observer is reduced, and the occurrence of abnormal situations or dangerous situations in the video can be found accurately and quickly, the damage will be minimized. Can do. In addition, the recording apparatus records almost all the images from the plurality of surveillance cameras that have been sent in the past. However, the privacy of the image object is infringed, and a large-capacity storage medium such as a video tape is used. Etc. are required, and the storage medium and the like are expensive and time-consuming to replace. Also, for video transmission from multiple surveillance cameras, a transmission path suitable for transmission of a signal having a wide band is required by a device including a modulation unit that modulates by spread spectrum using a pseudo-noise code, such as a coding pattern, in order to avoid interference However, the cost of these transmission path facilities and the cost of related devices are also expensive. In addition, an automatic determination method for monitoring using a video analysis system has been tried in place of the monitoring person, but the determination still has drawbacks and is not satisfactory. Therefore, the load on the monitoring staff has not been reduced.

  The present invention is free from the long-time monitoring work performed by the surveillance personnel, that is, humans, eliminates the problem of privacy infringement by the surveillance camera, and can greatly reduce the time for recording the video from the surveillance camera or the like at the same time. .

Means to solve the problem

In order to solve the above problems, the technology of a smart camera system, that is, a video analysis system
This can be achieved by adding a computer system transplanted to the video surveillance system and constructing an intelligent video surveillance system. That is, the movement and state of the part of the monitoring object in the monitoring video, for example, the movement of the hand, foot, face, torso or raising the hand or lying on the floor for a person. , The state where the car body and the load are separated from the same state when the load is placed separately, the state when the person has forgotten to leave it, the flow of the rough river etc. and the movement of each part such as splash A function for analyzing the situation and the like, presuming a problem state in advance, that is, an abnormal situation, a dangerous state, etc., comparing with the pattern of each part stored in the system, and making a conclusion such as danger, When it is judged that the result is abnormal or dangerous, a function that displays "danger" display and "warning" display together with the monitoring video with the monitoring video or separately, and information on the danger etc. With automatic sending function It can be achieved by building intelligent video surveillance system.

The invention's effect

  The present invention brings about the following effects. By transplanting (installing) and using the smart camera system, that is, the intelligent video analysis system performed on behalf of the surveillance person, to the computer system included in the video surveillance system, it is possible to analyze the video at the monitoring point in an abnormal situation or a dangerous state. When it is determined that there is a danger or the like, the display device displays the video and reports the danger or the like alone or automatically within the display, and further notifies a predetermined report destination. Therefore, it is not necessary for the monitor to constantly monitor the display device, and oversight of monitoring items can be solved.

For storage media that require a large capacity, the required recording capacity is extremely high by displaying and recording from the video a certain time before the point of time when danger is determined by the smart camera system, that is, the intelligent video analysis system. The economic effect can be expected to be very small. Video system with similar effects
However, it is necessary to select an appropriate video after reporting an abnormality, since the information indicating that there is an abnormality has an abnormality detection means installed separately and uses the information from there. Furthermore, according to the present system, the recorded video is limited in terms of time and place, so that the privacy infringement by the surveillance camera is hardly infringed.

  By installing the smart camera system, that is, the computer system transplanted with the intelligent video analysis system, from the monitoring room side to the monitoring camera side, when an event such as danger occurs at the monitoring point, an abnormal situation or dangerous It is only necessary to determine the status, etc., and transmit the video from the monitoring camera to the monitoring room side, and the capacity of equipment and transmission lines for transmission is reduced despite the installation of multiple monitoring cameras, and the equipment cost is Hold down low. Of course, it goes without saying that the surveillance camera can always monitor the video of the surveillance camera.

  It goes without saying that by attaching the function of the computer system and the like to the surveillance camera side, the contents of the above (0011) can be transmitted, and it is possible to transmit the video at a relatively low cost with constant connection such as an Internet line. Since this Internet line can use a telephone line or a wireless communication circuit, it is not necessary to construct a transmission / reception facility for the video surveillance system, and the installation cost can be reduced.

  The role of the monitoring camera can be replaced with a mobile phone with a camera function. Since it has the function of a surveillance camera and is small and inexpensive, the communication means can use a telephone line as well as the effect (0012), so that it is inexpensive. However, since the call cost is high in the case of continuous call, it is usually connected to the computer system installed on the monitoring camera side, that is, the monitoring point side as described in (0012) without setting the call state, and with the camera function. Continue to send video from the mobile phone, judge the video in the computer system, and send the video etc. to the monitoring room when it is judged as dangerous, etc. For that purpose, the telephone line is automatically set up and used Communication costs can be reduced.

  The monitoring point needs to be installed in a place where communication equipment cannot be installed, for example, a deep place in a mountainous area, in order to select a point where danger or the like may occur. The installation location is also an important source of information for this video surveillance system. By installing a GPS device on the surveillance camera, the location where the surveillance camera is installed can be determined. By sending this geographical position information to the monitoring room together with the video via a transmission line, the problem of installing the monitoring camera in the difficult place can be solved. Needless to say, the advantage of the GPS device attached installation that displays the installation position of the surveillance camera can also be applied to the video surveillance system of the ordinary surveillance camera.

  In FIG. 2, a computer system 210 in which a smart camera system, that is, an intelligent video analysis system is transplanted to an already installed video surveillance system, is connected between the video transmission apparatus 2 and the system integration server 3, and the surveillance target in the surveillance video is displayed. Provided is an additional video surveillance system capable of monitoring the movement and state of each part of an object. FIG. 3 shows an embodiment of the present invention. Surveillance videos from surveillance cameras 1 and the like installed at a plurality of points are sent via a transmission device 2 to a computer system 310 transplanted with a smart camera system in the surveillance room 8, that is, an intelligent video analysis system, where the video is analyzed. The video information is input to the system integration server 303 and transmitted to the display device 5, the printer 6, and the video recording device 304 to display, print, and store the video and the like. When the computer system 201 analyzes the video and determines that it is dangerous or the like, the video is displayed on the display device 5 together with an alarm, and the alarm output device 311 is automatically transmitted to a necessary department by operating the monitor 307. The

  FIG. 4 is a diagram for explaining a combination of devices for making a judgment of danger or the like at a monitoring point regarding the configuration of the video monitoring system according to the present invention. An intelligent video analysis system obtained by attaching a computer system 410 to which a smart camera system, that is, an intelligent video analysis system is transplanted, to the monitoring camera 1 at the monitoring point 409 and obtained from a preset motion and state pattern and the monitoring video A function of transmitting a video from an arbitrary time before the time point determined to be a danger or the like when the monitoring condition is satisfied, to the monitoring room 8 by the transmission device 2 that is a transmission circuit. In the monitoring room 8 that has received the monitoring video, it is displayed on the display device 5 by the system integration server 403, and simultaneously recorded by the video recording device 404, and an alarm is issued from the automatic alarm output device 411 to a predetermined level. Functions such as printing an arbitrary part of an image with the printer 6 when necessary to send to a destination (in FIG. 4, the mobile phone of the monitoring staff and related persons) Shows a front-end processing type video monitoring system comprising.

  FIG. 5 shows an example in which a GPS camera 2100 is replaced with a camera-equipped mobile phone instead of a monitoring camera at a monitoring point, and a power supply device 2400 such as a solar cell is attached. A computer system 501 transplanted with a smart camera system, that is, an intelligent video analysis system, is attached to the mobile phone at the monitoring point to constitute a front-end processing type video monitoring system, and each monitoring point information such as video is transmitted using a telephone line. It is done. As an extension of (0016), the GPS device 2100 transmits the location information of the monitoring camera 1 and the like together with the monitoring point video information to the monitoring room 8 side, thereby attaching geographical information of the place where the danger or the like has occurred. A warning can be issued. When monitoring natural disasters, especially debris flow disasters and landslides, it is often the case that there is no communication facility or a place where it is difficult to install. The video surveillance system which attaches | subjects the positional information and transmits is shown. Even if a GPS device is attached to each of the surveillance cameras in FIG. 4, in addition to the video information, position information can be sent simultaneously, and the same effect can be obtained.

  As described above, in the video surveillance system, not only the use of a normal commercial power source for the power source for operating the system but also the effect of being able to select the surveillance point, that is, the installation location of the surveillance camera more freely and widely by the attachment of a private power generator such as a solar cell. This shows that the power supply device need not be a commercial power supply.

  6 and 7 are for understanding the smart camera system and the motion detector system. FIG. 6 recognizes the face 6100, the hand 6200, and the torso 6300 and analyzes the movement of each part to monitor the movement and the state of movement. The analysis method of the position of each part in the next frame is shown. FIG. 7 shows a conventional method for analyzing motion based on video information. By analyzing a moving object in a video as a unit, it is analyzed that the object image 7400 has moved to the position of the object image 7500 in the next scene. Judgment, confirmation of the existence of moving objects, and use for information to issue notifications such as alarms.

  Explanatory drawing showing the current video surveillance system   An explanatory diagram in which a computer system in which a smart camera system, that is, an intelligent video analysis system is transplanted, is added to an existing video surveillance system   Illustration of a video surveillance system including a computer system transplanted with a smart camera system, that is, an intelligent video analysis system   Illustration of a video surveillance system in which a computer system in which a smart camera system, that is, an intelligent video analysis system is transplanted, is installed at the front end, that is, a monitoring point   Illustration of video surveillance system using GPS device and camera-equipped mobile phone   Illustration of the principle of smart camera system, that is, intelligent video analysis system   Illustration of the principle of the motion detector detection system

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Surveillance camera 2 Transmission apparatus 3 System integration server 4 Video recording apparatus 5 Display apparatus (single, plural)
6 Printer 7 Monitoring Person 8 Monitoring Room 210 Computer System Ported with Smart Camera System 303 System Integrated Server 304 Video Recording Device 310 Computer System Ported with Smart Camera System 309 Monitoring Point 311 Alarm Device 403 System Integrated Server 404 Video Recording Device 409 Monitoring Point 410 Computer system transplanted with smart camera system 411 Automatic alarm output device 412 Alarm receiving device such as mobile phone 413 Monitor or related person 503 System integration server 504 Video recording device 510 Computer system transplanted with smart camera system 511 Automatic alarm output device 512 Alarm receiving device such as mobile phone 513 Monitor or related person 2001 Camera-equipped mobile phone 2100 GPS device 2200 Telephone line 2300 Receiver 2400 Power supply 6100 Smart camera system, that is, face portion 6101 of intelligent video analysis system analysis result Face movement position 6200 of smart camera system, that is, analysis result of intelligent video analysis system Smart camera system, that is, intelligent video analysis System analysis result hand 6201 Movement position 6300 of the hand of the analysis result by the smart camera system, that is, the intelligent video analysis system 6300 Smart camera system, that is, the body part 6301 of the analysis result of the intelligent video analysis system By the smart camera system, that is, the intelligent video analysis system Analysis position of barrel movement position 7400 Explanation of motion detector analysis method FIG. 7500 Explanation of motion detector analysis target movement

Claims (9)

  A recording apparatus for recording video from a surveillance camera, a display apparatus for displaying the video, a printer apparatus for printing the video on a paper surface, etc., and a computer system having communication means for connecting them and controlling the operation of each apparatus. In a video monitoring system comprising a system integration server, a video monitoring system having a judgment function is configured by transplanting a smart camera system, that is, an intelligent video analysis system, into the computer system. The movement and state pattern of each part of the object is stored in advance as a monitoring reference, and the video sent from the monitoring camera installed at the monitoring point is analyzed using the intelligent video analysis system, Compared with the movement and state pattern that is the monitoring standard, the set movement and state pattern In order to notify the danger, etc., the computer system activates the computer system, causes the display device to display the danger together with the video, starts recording the video from a predetermined time, and This is a system that uses sound to inform the monitoring staff, and at the same time, automatically notifies the related parties and related organizations together with the recorded video. Video surveillance characterized by a smart camera system, that is, an intelligent video analysis system capable of making a judgment of danger and the like, notifying an alarm, etc., and minimizing privacy infringement due to the limited video recording system.   A recording apparatus for recording video from a surveillance camera, a display apparatus for displaying the video, a printer apparatus for printing the video on a paper surface, etc., and a computer system having communication means for connecting them and controlling the operation of each apparatus. In a video monitoring system comprising a system integration server, a video monitoring system having a judgment function is configured by transplanting a smart camera system, that is, an intelligent video analysis system, into the computer system. The movement and state pattern of each part of the object is stored in advance as a monitoring reference, and the video sent from the monitoring camera installed at the monitoring point is analyzed using the intelligent video analysis system. , The movement and state of each part of the object, such as a hand that leads to an accident or incident if a person, Compare the movement of the face, torso, etc. and the state of falling down or putting your hand in your pocket, etc., and an alarm device to notify you of danger etc. when it matches the movement and state pattern set as the monitoring standard The computer system is activated, the display device is displayed as dangerous with the image, the recording of the image is started for a certain period of time, and an alarm sound is used to inform the monitoring personnel, It is a system that automatically reports to related organizations, analyzing the movement and state of the object to be monitored as a person, determining the danger etc. in comparison with the preset monitoring criteria, and notifying the alarm, etc. A video for human surveillance, characterized by a smart camera system that can eliminate privacy violations due to limited video recording, that is, an intelligent video analysis system Visual system.   A recording apparatus for recording video from a surveillance camera, a display apparatus for displaying the video, a printer apparatus for printing the video on a paper surface, etc., and a computer system having communication means for connecting them and controlling the operation of each apparatus. In a video monitoring system comprising a system integration server, a video monitoring system having a judgment function is configured by transplanting a smart camera system, that is, an intelligent video analysis system, into the computer system. The movement and state pattern of each part of the object is stored in advance as a monitoring reference, and the video sent from the monitoring camera installed at the monitoring point is analyzed using the intelligent video analysis system. , Movement and state patterns that are the monitoring standard, that is, movement and state of each part of the object, for example Compared to the movement of each part such as the flow of rivers and splashes caused by water increase in natural disasters and the state or the flow of landslides and the movement and state of falling rocks, The computer system activates an alarm device for notifying a danger or the like in the case of coincidence, causing the display device to display the danger together with the video, recording the video, and further using a warning sound to the monitor This is a system that automatically informs related parties and organizations at the same time, and makes the monitored object an event of a natural disaster, analyzes its movement and condition, and compares it with a preset monitoring standard to determine danger, etc. A video surveillance system for performing natural disaster monitoring, characterized in that it is equipped with a smart camera system, that is, an intelligent video analysis system that can perform notifications such as alarms.   A recording apparatus for recording video from a surveillance camera, a display apparatus for displaying the video, a printer apparatus for printing the video on a paper surface, etc., and a computer system having communication means for connecting them and controlling the operation of each apparatus. In a video monitoring system comprising a system integration server, a smart camera system, that is, an intelligent video analysis system is transplanted to the computer system to form a video monitoring system having a judgment function, and the storage function portion of the computer system is monitored The movement and state pattern of each part of the object is stored in advance as a monitoring reference, and the video sent from the monitoring camera installed at the monitoring point is analyzed using the intelligent video analysis system. Compared to the movement and state pattern that is the monitoring standard, that is, the movement and state of each part of the object. The computer system activates an alarm device for notifying the danger etc. when the set movement and state patterns match, and the display device displays the danger together with the image, or monitoring using the alarm sound A system that automatically informs personnel and related parties and related organizations at the same time, and installs the computer system on the monitoring camera side at the monitoring point to send video information only from the monitoring camera Thus, even if there are a plurality of surveillance cameras, the communication line can be reduced. Thus, the video surveillance system characterized in that the computer system is installed on the surveillance camera side at the surveillance point.   (Claim 4) A video monitoring system using the Internet, wherein the computer system is located at a monitoring point, and the Internet is used for a transmission / reception line and video can be constantly transmitted to a monitoring room.   A recording device for recording video from a surveillance camera, a display device for displaying the video, a printer device for printing the video on a paper surface, etc., and a computer system having communication means for connecting them and controlling the functions of the devices. In a video monitoring system comprising a system integration server, a video monitoring system having a judgment function is configured by transplanting a smart camera system, that is, an intelligent video analysis system, into the computer system. The movement and state pattern of each part of the object is stored in advance as a monitoring reference, and an image sent from a monitoring camera installed at a monitoring point is analyzed using the intelligent image analysis system. Compared to the movement and state pattern that is the monitoring standard, that is, the movement and state of each part of the object, When a movement or state pattern is matched, a signal such as an alarm is displayed on the display device together with the image, and at the same time, a notification is automatically made to related parties or related organizations. When an object such as a person and a bag belonging to him / her, or a car and its load or belongings are individually monitored and it is judged that the bag has been left behind and left behind, and accessories etc. are separated from the car and left unattended That is, when an item is abandoned, an alarm or the like is automatically transmitted to the monitoring room together with the video, and is notified to related organizations. Video monitoring system for illegal dumping monitoring and forgetting thing monitoring, such as having a means to issue a warning directly on the spot with a loudspeaker at the monitoring point. Instead of the surveillance camera of (Claim 1) to (Claim 6), a mobile phone with a camera function is used, and the video of the monitoring point from the mobile phone with the camera is analyzed using the intelligent video analysis system. A video surveillance system equipped with a camera-equipped mobile phone that can be used for disaster monitoring and can be activated from a monitoring room via a telephone line and can be monitored.   (Claim 7) By providing the camera-equipped mobile phone with a GPS function, and by attaching a GPS device to the surveillance camera of the video surveillance system of (Claim 1) to (Claim 6) When installing a monitoring point in an undeveloped area such as a mountainous area, that is, where communication-related equipment is not sufficient, the GPS information reveals the geographical location of the monitoring camera, and the installation time and cost are determined from the freedom and simplicity of selecting the installation location Can be reduced. A camera-equipped mobile phone with a GPS function or a video surveillance system with a GPS device attached to a surveillance camera. A recording apparatus for recording video from a surveillance camera, a display apparatus for displaying the video, a printer apparatus for printing the video on a paper surface, etc., and a computer system having communication means for connecting them and controlling the operation of each apparatus. In a video monitoring system comprising a system integration server, a video monitoring system having a judgment function is configured by transplanting a smart camera system, that is, an intelligent video analysis system, into the computer system. The movement and state pattern of each part of the object is stored in advance as a monitoring reference, and the video sent from the monitoring camera installed at the monitoring point is analyzed using the intelligent video analysis system. , Movement and state patterns that are the monitoring standard, that is, movement and state of each part of the object, for example Compared to the state of movement, hand, foot, face, torso, etc. leading to the accident or incident, falling down, or putting your hand in your pocket, etc. Means to notify, that is, the computer system activates an alarm device, displays the danger on the display device together with the video, or informs the monitoring staff using an alarm sound, and at the same time automatically notifies the related parties and related organizations A system that monitors the daily movements and conditions of people who need care or protection and is in a dangerous state, for example, when it does not go beyond the set time after closing the entrance door of a toilet or bathroom Also, dangerous situations such as falling, spitting eaten food, falling from the bed, etc. Analyzing the monitored video and comparing it with the stored contents, dangerous situations or dangerous acts, etc. The alarm can be automatically transmitted to the nurse station etc. immediately before the judgment time, and the privacy violation of the normal life due to the video can be reduced as much as possible. A video surveillance system for nursing care.