CN101123721A - An intelligent video monitoring system and its monitoring method - Google Patents

Abstract

The present invention relates to an intelligent video surveillance system and monitoring method. Camera set, alarm and PC terminal software system are connected to a control module; control module comprises a central processing module, data storage module, the video analysis module, alarm module, video capture module, a communications module and network connectors; data storage module, video analysis and communication modules are central processing module associated with the two-way, the alarm module and the central processing module associated unidirectional; video capture module through the video analysis module associated with the central processing module; Fi communication module and through the central processing module linked. Monitoring method comprising the steps of: A system initialization; B reads the alarm rules; video analysis C; D video processing..... Advantage of the present invention are: to make real-time intelligent automatic monitoring, surveillance personnel need not be provided; to store alarm monitoring period and a video stream; intelligent analysis capability with automatic, on-demand video storage can greatly save memory space.

Description

An intelligent video surveillance system and monitoring method Technical Field The present invention relates to an intelligent video surveillance system and a monitoring method, and a digital image belonging to the field of communications technology, is capable of automatic discovery, identification, and tracking moving objects, and capable of binding set cordon or warning area intelligent video surveillance system to identify the target behavior. With the development of multimedia technology, and the need for safe city construction, video surveillance systems are becoming increasingly necessary. Video surveillance systems are used in banks, department stores, industrial areas and even streets. A typical prior art video surveillance system is based on the following concepts: the camera is mounted in the area to be monitored, the sequence of images captured through the video line or a dedicated network to the control center, constantly watching the display monitor by specialized personnel screen viewing, such as unusual circumstances, the activation of the alarm to alert criminals or security personnel assigned to go see, or will transfer over all video streams to disk, and then to search for an accident the previous video provide reliable evidence for the public security department. The above is a typical traditional video surveillance systems, it has two fatal drawbacks: First, the monitoring personnel will have to see the display screen in visual fatigue for about twenty minutes, it is prone to leakage alarm event; Second, all video data to disk, will occupy a large disk capacity, or will use a lot of bandwidth. At the same time, such a video surveillance system does not have the intelligence, the need for specialized monitoring personnel to participate. Chinese Patent No. ZL03116154.5 target an unusual discovery and auto-tracking camera system that can automatically track the target field of view is abnormal, while the alarm to the monitoring center, the target track can be performed automatically, and automatically adjusts the magnification of the lens to obtain a clear and complete picture of the target. The system includes auto-discovery mobile object (someone enters the object) or a case where a video image characteristic abnormal changes in the case of fire, smoke and the like. However, in reality, the range is not captured by the camera are moving targets are exceptions, more target only reaches a certain area, or through a certain position was only considered to be anomalies. Based on the above, we propose a video surveillance system to overcome traditional weaknesses, while more superior than the average intelligent monitoring system of intelligent video surveillance systems and monitoring methods.

SUMMARY An object of the present invention is to overcome the disadvantages of the prior art described above, there is provided an intelligent video surveillance system: first, the system allows users to easily set the alarm rules, after the video content analysis, in conjunction with an alarm rule will It can make the target area to monitor the behavior of real-time intelligent automatic monitoring without additional set up surveillance personnel; second, in exceptional cases in addition to the alarm, the system also stores the monitoring period of the video stream for future inquiries; third Since the rules set the alarm, automatic intelligent analysis capabilities, before being offended begin storing video, different from the traditional video surveillance systems need to store all the data, which can greatly save storage space. Another object of the present invention is to provide a method of monitoring for smart video monitoring system according to the present invention - The method reasonable program. In order to achieve intelligent video surveillance system proposed by the present invention, the present method is effective to provide the core technical approach of the system. As a result of the practical moving object detection and tracking algorithm to ensure that the method can effectively detect the moving object monitoring video scene (including people, objects, vehicles, etc.), and track the moving object detected, for video analysis. For common problems in the current video surveillance, such as surveillance scene changes in factors affecting scene memory object tracking goals shadows, be addressed in this process, making the process more practical and effective. Technical Solution intelligent video surveillance system of the present invention is: an intelligent video surveillance system according to which the group L comprises a camera, alarm 2, control module 3, PC terminal software 4; wherein the group L cameras, alarm and 2 PC terminal software control module 3 and 4, respectively; said control module 3 includes a central processing module 3.1, 3.2 data storage module, the video analysis module 3.3, 3.4 alarm module, a video acquisition module 3.5, 3.6 and network communication module connector 3. 7; 3.2 the data storage module, the video analysis module, and communication module 3.3 3.6 average 3.1 bidirectional central processing module associated with the alarm module and the central processing module 3.4 3.1 unidirectional phase linking; video acquisition module 3.5 and 3.3 by the video analysis module central processing module 3.1 associated; network connector through the communication module 3.7 3.6 3.1 central processing module associated with the video, and for providing an alarm rule transmission of data. The PC 4 includes a display terminal software module 4.1, 4.2 alarm rules module and alarm log module 4.3, a TCP / IP network to the associated connector 3.7; the network connector 3. 7 is selected from RJ-45. 3.3 The video analysis module is capable of high-speed video content analysis for external program memory solidified therein, for detecting a moving object of interest within the monitoring range and be tracking and identification of the processing result is transmitted to the central controller . The video analysis module 3.3 is selected in U.S. TI's TMS320C6000 digital signal processor. Said alarm rule module 4.2 is there a particular alarm rule module alarm rules, the rules alarm

According to one user is alarm rules that several different types of actual needs, or combinations thereof .1) a scene change, including object is moved, covered abnormal;. 2) a single warning level, including setting a traverse direction, That object specified direction specified through the defense; 3) double cordon, includes a traverse direction, i.e., the object specified through two defense specified direction; 4) warning area, i.e. set any polygonal alert area. . Said alarm rule module 4.2 there is an alarm on alert type in the region immediate and / or remain in the alert area specified alarm time starts alarm rule module. Said alarm rule module 4.2 there is a scene change alarm alarm rule type is provided if an object is removed or left alarm alarm rules module starts in the designated areas. The data storage module 3.2 when the alarm is set by rules module 4.2 offended alarm rule after the start of the video memory data storage module. Monitoring method aspect of intelligent video surveillance system of the present invention, comprising the steps of: A, system initialization: After successful initialization into the NEXT BLOCK step, otherwise, re-initialize; B, reads the alarm rule: alarm rules successfully read, proceed to the next step, otherwise continue reading alarm rules; C, video analysis: analyzing the video image, an exception occurs, the process proceeds to the next step, otherwise continue video analysis; D, video processing: video analysis program sent information processing abnormality occurs, comprising: triggering an alarm module, abnormal data is stored, and a write alarm log; triggering the alarm module is triggered alarm module activates the alarm after 3.4 2; complete video processing after analyzing the video again. The video parser comprises -a, monitoring the video acquisition: the installation of surveillance cameras in place, to get the most favorable processed video stream; B, video preprocessing: for preprocessing acquired video stream, including removing noise, adjust frame rate and frame size; c, background modeling: the establishment of reasonable real background in order to get accurate foreground object; d, foreground segmentation: the use of technology has been reduced background foreground objects, while be eliminated for false prospects; e, shadow elimination : HSV color space using the method and direction of the shadow remove various shadow; F, target tracking: target tracking overcomes occlusion problems, a multi-scene for target tracking, recording its trajectory and direction of motion;

g, trajectory analysis: alarm rules from the trajectory and the target setting, target trajectory analysis of whether an abnormal event, if the alarm is triggered; H, target identification: identify the foreground object classification, the classification of the type comprising people and / or vehicles, and / or objects. Technical effects of the invention significantly, mainly: 1, video analysis module (3.3) can accurately detect and track moving targets simultaneously can also identify people, vehicles, objects, and other types of objects; 2, the system only in the alarm rule offended the case began to store video data, which can greatly save storage space, while providing a basis that can be queried after an exception occurs also for. 3, the present system has the ability to identify the behavior, it is possible to monitor whether there has been removed and the object leaving the object in the specified range, it is possible to detect the vehicle speed. 4, the system can be provided by different types of alarm rule 4 PC terminal software, which fully reliable alarm rule: K may be a scene change, including object is moved, covered abnormalities; 2, single cordon (crossing direction may be provided), i.e., objects specified direction through a specified line of defense; 3, cordon bis (crossing direction may be provided), i.e., the object specified through two defense specified direction; 4, the warning area, which can set an arbitrary polygonal alert area, type of alarm can also be divided into the warning area and the warning area to stay in the designated start time alarm condition, wherein these rules may be one or a plurality of different combinations. 5, the system for the enormous amount of data and selection of video stream processing US TI's TMS320C6000 digital signal processor and appropriate to reduce the frame rate and size of the frame in a video pre-processing stage, to ensure the system in real time from the hardware and software. 6, for the scene monitoring the situation changes, added a background update technology in the implementation process, to ensure the correctness of the post-processing. 7, the system can inhibit the shadow of the object, surface reflection detection adverse impact on the outlook, while the leaves have to adapt to sway within the monitoring range, sparkling water and other occasions, with the general intelligent video surveillance system has a wider use range and greater adaptability. The present invention will be further described below in conjunction with the accompanying drawings and embodiments. BRIEF DESCRIPTION OF DRAWINGS: FIG. 1 is a block diagram of an intelligent video surveillance system connector of the present invention. FIG 2 is a smart video monitoring system monitoring method according to the present invention a flowchart. Figure 3 is a smart video monitoring system monitoring method according to the present invention, the video analysis program flowchart. EXAMPLES Embodiment 1: FIG intelligent video surveillance system security for the bank 1 shown in FIG. It consists of a camera set 1, Alarm 2, control module 3, PC terminal software 4 which may also be a remote alarm (alarm to the police when abnormal behavior is detected); wherein the camera set 1, Alarm 2 (a a speaker or light alarm, etc.) and PC terminal software control module 3 and 4, respectively; said control module 3 3.1 a central processing module, data storage module 3.2, 3.3 video analysis module, alarm module 3. 4, the video acquisition module 3.5, 3.6 and network communication module connector 3.7; 3.2 said data storage module, the video analysis module, and communication module 3.3 and 3.6 are bidirectional central processing module 3.1 linked, the alarm module and the central processing module 3.4 3.1 unidirectional associated; video acquisition module 3.5 3.3 3.1 and the central processing module through the associated video analysis module; network connection through the communication module 3.7 3.6 3.1 central processing module associated with the alarm rule, and for providing video data transmission. The software of the PC terminal 4 by the display module 4.1, 4.2 alarm rules module and alarm log module consisting of 4.3, a TCP / IP network to the associated connector 3.7; the network connector 3 7 is selected from RJ-45. The video analysis module 3.3 is capable of high-speed video content analysis for external program memory solidified therein, for detecting a moving object of interest within the monitoring range and be tracking and recognition result to the central processing controller. The video analysis module 3.3 is selected in U.S. TI's TMS320C6000 digital signal processor. Said alarm rule module 4.2 is there a particular alarm rule module alarm rules, the rule is that the user alarm according to one of alarm rules that several different types of actual needs or a combination thereof: 1). scene change, including object is moved, covered abnormalities; 2) a single warning level, including setting a traverse direction, i.e., the object specified through the defense specified direction; 3) double cordon, includes a traverse direction, i.e., the object specified specified direction through two defense; 4) warning area, i.e. set any polygonal alert area. Said alarm rule module 4.2 there is an alarm on alert type in the region immediate and / or remain in the alert area specified alarm time starts alarm rule module. This embodiment is the start instant alarm may be set at the same time stay within the specified time alert area starts an alarm. Said alarm rule module may further preferably 4.2 there is a scene change alarm type alarm rule whether an object is arranged to remove or leave a warning alarm rules module starts in the designated areas. The data storage module is 3.2 4.2 when the alarm rule module set alarm rules are violated before the start of the video data stored in the storage module. Bank needed, particularly belonging to the present embodiment is provided below: draw a virtual cordon in front of the bank vault, and through the cordon alarm arrangement, which is set when the predetermined rules are not allowed entry into the effective ; someone enters, the system will automatically detect the occurrence of an abnormality, an alarm is triggered at the same time also means the start time of the stored video data is abnormal; considering the relatively simple context vault door, fixed or variable lighting conditions are relatively slow, and the situation of moving objects appear relatively small, video content analysis of the difficulty of small, very small chance of false positives and false negatives, so the system is especially useful in this scenario; with traditional video surveillance with active and intelligent compared, without surveillance personnel staring lot of useless data screens and storage. This example can be applied to national borders, ports, docks and other occasions. Run intelligent video surveillance system of the present invention: an analog video signal from the camera 1 group are obtained access to the video acquisition module 3.5 into a digital signal, the video analysis module 3.3 preclude the use of computer vision processing techniques to achieve detection of the moving object, tracking and alarm rules to recognize and bind the corresponding processing result obtained, the central processing module 3.1 and alarm signals if the video data if an instruction to start storing the alarm module and data storage module 3.4 3.2 the results of the processing; communication module 3. 6 is a control module 3 and the PC 4 terminal software and implement alarm rules set by the network real-time transmission of video connector 3. 7 (RJ-45). 2, FIG. 3, the monitoring method is applied to the smart video monitoring system according to the invention: comprises the following steps (see FIG. 2): A, system initialization: After successful initialization the next step, otherwise, re-initialize ; B, reads the alarm rule: alarm rules successfully read, the process proceeds to the next step, otherwise continue reading alarm rules; C, video analysis: analyzing the video image, an exception occurs, the process proceeds to the next step, otherwise, proceed with video analysis; D, video processing: the video analysis program sent from the information processing abnormality occurs, comprising: triggering an alarm module, abnormal data is stored for future reference, and a write alarm log; triggering said alarm module is 3.4 to trigger an alarm after activating an alarm module 2;. for video analysis again after the completion of video processing. The video analysis program according to the following steps (see FIG. 3): a, surveillance video acquisition: surveillance cameras installed in place, to get the most favorable processed video stream; B, video preprocessing: for captured video stream preprocessing including a noise removing adjust the frame rate and frame size; C, background modeling: to establish a reasonable real background, so as to obtain foreground objects; D, foreground segmentation: Save bACKGROUND obtained using foreground object, while for false foreground be eliminated; E, shadow elimination: direction using the shadow method and remove various HSV color space shadow; F, target tracking: target tracking overcomes occlusion problems, a multi-scene for target tracking, recording its trajectory and the direction of motion; analysis g, trajectory: trajectory according to the set rules and police targets, target trajectory analysis of whether unusual activity, if the alarm is triggered; h, object recognition: identification of the foreground object classification, classification of species including human and / or vehicles, and / or objects, namely: people, or vehicles, or objects, but also Be a combination thereof, such as cars and people, people and objects, the vehicle and the object; other objects can also be sensed object. Example 2: intelligent video surveillance system to monitor the system and method of the present example is a security for the museum, and the

Example l above except that: it is provided according to the characteristics of the museum. General museum distributed into three regions - the surveillance area (usually within a specified time stay alert area began to alarm), the protection zone (within or entering the immediate area warning / alert area and stay within the specified time will start alarm) and restricted (in That began to alarm when entering the warning area). Restricted area means storing, safekeeping protection goals of the Treasury, safe, and other repair room does not allow public access to the area. We can set goals in need of protection (such as works of art hanging on for the tour to watch the wall) polygon area which was covered: if someone enters the protected works of art in this exhibition area of ​​more than stay alert specified time began to alarm, and set this artwork was removed, an alarm is triggered immediate alert rules, in order to achieve the goal of real-time monitoring, to meet this exposed but also to prevent its special applications stolen. This example can be applied to the case of sensitive areas in airports terrorists deliberately discarded items, the suspect in the case of the night hanging around outside the bank has tried to misconduct.

Example 3:

Video monitoring system and a monitoring method of the present example for traffic monitoring, the above-described Example 1, except that the 2: it is implemented in the traffic flow and the traffic violation monitoring driving. Traffic monitoring is implemented: it is judged by the traffic information unit of time the number of vehicles passing through the virtual security line. Roughly processing flow: First, the motion detecting foreground (a moving vehicle), each vehicle keeps track of its resulting physical center, the center crossing a line counter is incremented, the number of statistical units in the last time that can be the size of the traffic flow. For the present driving violations in both cases the system may recognize the vehicle speed and the vehicle running red lights. Monitoring the vehicle speed to achieve: the same vehicle detected tracking process, combined with the camera calibration information, calculate the actual distance of movement of the object between two frames, to determine whether the speed of the vehicle speed obtained. Red light monitoring environment: using two cordon provided two virtual boundary lines crossing at two intersections, respectively, to take effect within a time interval of the red, for all vehicles within the scope of monitoring the track, if the vehicle at a red light while passing through the two cordon it is considered a red light, because only through the cordon may be the first case of a vehicle turn right, and such a situation is not in violation of traffic rules. This example can also be used in government office buildings, Olympic venues, consulates.

The scope of the present invention is not limited to the above embodiments.

Claims (10)

1, an intelligent video surveillance system, characterized in that it comprises a camera set (L), the alarm (2), the control module (3), PC software, a terminal (4); wherein the camera set (1), an alarm (2) and PC terminal software (4) connected with the control module (3); said control module (3) comprises a central processing module (3.1), a data storage module (3.2), the video analysis module (3.3), the alarm module (3.4), the video capture module (3.5), communications module (3.6) and the network connector (3.7); said data storage module (3.2), the video analysis module (3.3) and the communications module (3.6) with both central the processing module (3.1) associated bidirectional, the alarm module (3.4) with central processing module (3.1) associated unidirectional; video capture module (3.5) by the video analysis module (3.3) with central processing module (3. l) associated ; network connector (3.7) by the associated communication module (3.6) with central processing module (3.1).

2. The smart video monitoring system according to claim l, wherein said PC terminal software (4) comprises a display module (4.1), the alarm rules module (4.2) and alarm log module (4.3), linked via TCP / IP and the network connector (3.7); the network connector (3.7) is selected from RJ-45.

3. The smart video monitoring system according to claim 1, wherein the video analysis module (3.3) is capable of high-speed video content analysis for external program memory solidified therein, for detecting the monitor range and the moving object to be of interest to identify and track the processing result is transmitted to the central controller.

4. The intelligent video surveillance system as claimed in claim 1 or 3, wherein the video analysis module (3.3) is selected in the United States TI TMS320C6000 digital signal processor.

5. The intelligent video surveillance system as claimed in claim 2, wherein said alarm rule module (4.2) there is a specific alarm rule alarm rule module, an alarm rule is the user according to their actual needs of alarm rules several different types or a combination thereof: 1) a scene change, including object is moved, covered abnormalities; 2) a single warning level, including setting a traverse direction, i.e., the object specified in the specified direction through the defense; 3) double cordon, includes a traverse direction, i.e., the object specified in the specified direction through the two defense; 4) warning area, i.e. set any polygonal alert area.

6, intelligent video surveillance system as claimed in claim 2, wherein said alarm rule module (4.2) there is an immediate alarm type region or / and a specified time of stay on alert in the alert area begins alarm rule alarm module.

7, intelligent video surveillance system as claimed in claim 2, wherein said alarm rule module (4.2) there is a scene change alarm types alarm rule whether an object is arranged to be removed or remain in the designated area alarm rule module starts the alarm that is.

8, the book intelligent video surveillance system according to claim l, wherein said data storage module (3.2) when the alarm rule module (4.2) set alarm rules are violated before the start of the video data stored memory modules.

9. A method for monitoring method of claim intelligent video surveillance system of claim 1, characterized in that it comprises the steps of: A, system initialization: After successful initialization the next step, otherwise, re-initialize; B, alarm rule read: alarm rules read successfully, the process proceeds to the next step ho, otherwise, continue reading the alarm rule; C, video analysis: analyzing the video image, an exception occurs, the process proceeds to the next step, otherwise continue video analysis; D, video processing: the video analysis program sent from the information processing abnormality occurs, comprising: triggering an alarm module, abnormal data is stored, and a write alarm log; module triggers the alarm is triggered the alarm module (3.4 ) after activating an alarm (2); video analysis again after the completion of video processing.

10. The monitoring method according to claim 9 intelligent video surveillance system, characterized in that said video analysis program comprising: a, surveillance video acquisition: surveillance cameras installed in place, to get the most favorable processed video stream; B, video preprocessing: perform preprocessing for obtaining a video stream, including removing noise, frame size and frame rate adjustment; C, background modeling: to establish a reasonable real background, so as to obtain foreground objects; D, prospect segmentation: Save bACKGROUND obtained using foreground object, being simultaneously eliminate the false foreground; E, to eliminate shadows: HSV color space using the method and direction of shadows remove various shadow; F, target tracking: to overcome the problem of occlusion in target tracking, for scenes in multi-target tracking, recording its trajectory and direction of motion; Anal g, trajectory: setting the target trajectory and the alarm rules, analyzes whether the target trajectory unusual activity, if the alarm is triggered ; H, target identification: identify the foreground objects, the classifier of the type comprising And / or vehicles, and / or objects.