CN101877780A - Real-time intelligent video monitoring system - Google Patents

Real-time intelligent video monitoring system Download PDF

Info

Publication number
CN101877780A
CN101877780A CN2009100830139A CN200910083013A CN101877780A CN 101877780 A CN101877780 A CN 101877780A CN 2009100830139 A CN2009100830139 A CN 2009100830139A CN 200910083013 A CN200910083013 A CN 200910083013A CN 101877780 A CN101877780 A CN 101877780A
Authority
CN
China
Prior art keywords
intelligent
module
real
video monitoring
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2009100830139A
Other languages
Chinese (zh)
Inventor
黄英
王磊
邱嵩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vimicro Corp
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN2009100830139A priority Critical patent/CN101877780A/en
Publication of CN101877780A publication Critical patent/CN101877780A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Closed-Circuit Television Systems (AREA)

Abstract

The invention relates to the field of video monitoring, in particular to a real-time intelligent video monitoring system. The system completes complex core algorithm of a monitoring front end by an intelligent processing module (140) which is implemented by a special integrated circuit with strong operation function; and an embedded intelligent analysis module (150) is used for analyzing and processing the data from the intelligent processing module (140), and the related functions of the embedded intelligent analysis module (150) can be realized by user configuration. Therefore, the invention has strong processing capability of the core algorithm, high configurability of intelligent monitoring, low cost and important application valve.

Description

Real-time intelligent video monitoring system
Technical field
The present invention relates to field of video monitoring, relate in particular to video camera Network Based (IPCamera, Internet Protocol Camera) intelligent video monitoring system.
Background technology
Along with the enhancing of social economy and development of electronic technology and people's awareness of safety, the video monitoring technology is rapidly developed, and the intellectuality of video monitoring system is the inevitable demand of monitoring technique development.
The traditional video surveillance system adopts embedded system usually.Embedded system is application-centered, and based on computer technology, but the software and hardware cutting is applicable to the dedicated computer system that function, reliability, cost, volume, power consumption is had strict demand.Embedded system is used to realize the functions such as control, supervision or management to other equipment.Therefore embedded system be technology-intensive a, intensive capital, high degree of dispersion, the knowledge integrated system of constantly bringing forth new ideas.
Integrated circuit is a kind of microelectronic device or parts.Integrated circuit has that volume is little, in light weight, cost is low, is convenient to characteristics such as large-scale production.ASIC (Application Specific IntegratedCircuit, application-specific integrated circuit (ASIC)) is the integrated circuit for specific user or particular electronic system making.Application-specific integrated circuit (ASIC) is meant answers the specific user to require with the needs of particular electronic system and the integrated circuit that designs, makes.The characteristics of ASIC are the demands towards the specific user.
There is following problem in embedded system with respect to application-specific integrated circuit (ASIC):
1. algorithm process is limited in one's ability, can not be applied to too in the complication system;
2. core code is protected, can not further effectively be developed;
3. the embedded chip cost is higher.
In sum, traditional built-in smart video supervisory control system can't be handled very complicated monitoring environment, and price is relatively costly when large-scale production; Intelligent video monitoring system development process complexity and construction cycle based on integrated circuit are longer.
Summary of the invention
The invention provides a kind of real-time intelligent video monitoring system that can overcome the above problems.
In first aspect, the invention provides a kind of real-time intelligent video monitoring frontend, comprise intelligent processing module and intelligent analysis module.Intelligent processing module is realized by application-specific integrated circuit (ASIC), is used to finish the complicated core algorithm of this front monitoring front-end.Intelligent analysis module is realized that by embedded chip this intelligent analysis module is analyzed and handled doing from the data of intelligent processing module according to user's configuration.
In second aspect, the invention provides a kind of real-time intelligent video monitoring system, comprise real-time intelligent video monitoring frontend and terminal server.This terminal server receives the information that sends over from one or more these headend equipments.
In one embodiment of the invention, intelligent processing module is used for detecting in real time and the interior moving target of the affiliated guarded region of tracing and monitoring system, and analyzes the movement tendency of this moving target.
In another real-time example of the present invention, intelligent analysis module provides parameter/configuration interface for the user, so that dispose one or more in the warning function, statistical function of this headend equipment.
In another real-time example of the present invention, terminal server comprises the intelligent retrieval module, is used for the information from headend equipment is done statistics and analysis, and according to statistic analysis result this information is done classification storage, and provide the intelligent retrieval function for the user.
Front monitoring front-end of the present invention is finished core algorithm by the powerful application-specific integrated circuit (ASIC) of calculation function, so disposal ability is strong and with low cost; By embedded chip the data from integrated circuit are further analyzed and handle, so computing is simple and configurable ability is strong; Monitor terminal is by to doing statistics, analyze classification again from front-end information, and then realizes the intelligent retrieval function.Front monitoring front-end of the present invention, terminal and system have important use and are worth.
Description of drawings
Below with reference to accompanying drawings specific embodiments of the present invention is described in detail, in the accompanying drawings:
Fig. 1 is the IP Camera system block diagram based on intelligent video monitoring of the present invention;
Fig. 2 is the intelligent video monitoring system block diagram based on a plurality of IP Camera of the present invention.
Embodiment
Fig. 1 is the IP Camera system block diagram based on intelligent video monitoring of the present invention.This IP Camera system comprises optical lens 110, imageing sensor 120, image processing module 130, intelligent processing module 140, intelligent analysis module 150, alarm module 160, osd information laminating module 170, video compressing module 180 and IP data transmission module 190.
Optical lens 110 is used for obtaining the light signal of monitoring scene.Imageing sensor 120 is used for converting the light signal of monitoring scene to the signal of telecommunication, and exports original digital picture.Distinct image stream is handled and then obtained to 130 pairs of original digital pictures of image processing module, such as automatic exposure, focusing automatically, Automatic white balance etc.
Intelligent processing module 140 is used to finish the algorithm of complexity and core, is realized by the application-specific integrated circuit (ASIC) of fast operation.This integrated circuit can be FPGA or IC hardware.Each two field picture that intelligent processing module 140 receives from image processing module 130, and then analyze and handle this each two field picture that receives.And then realization is to real-time detection, tracking and the movement tendency analytic function of moving target in the monitoring scene.
Particularly, intelligent processing module 140 carries out foreground detection according to existing foreground detection method to current frame image according to the former frame image background from image processing module 130, obtains the foreground detection result.Then the pixel among the foreground detection result is carried out clustering processing, obtain each prospect position and shape data in the current frame image, as the profile of target, housing etc.And then, obtain position and shape such as the profile or the housing etc. of each object correspondence in current frame image in the former frame image according to existing motion estimation mode.Judge that again current frame image and the unmatched prospect of former frame image are emerging object, and the object that moves in the current frame image in the certain hour is set to background, with described context update former frame image background.The position of each prospect and shape in the current frame image, and the point-to-point speed of all objects in the former frame image, each object corresponding position and shape etc. in current frame image all can be used as tracking data output in the former frame image.
In one embodiment of the invention, intelligent processing module 140 provides the area configurations function for the user, the user can be by the area configurations interface configuration tracing area of intelligent processing module 140, intelligent processing module is only handled the moving target in the tracing area, the outer moving target of tracing area does not then deal with, after the user finished tracing area configuration, what intelligent processing module 140 returned to system was monitoring objective in the tracing area.Illustrate, a large amount of leaves is often arranged in the monitoring scene of parking lot, the leaf that rocks in fact also is moving object, and the user only is concerned about common-denominator target such as automobile and pedestrian in the scene.The tracing area that can set current scene this moment only comprises key areas such as road surface in the scene, parking stall, and then reject outside the leaf region.Therefore the user can be provided with suitable tracing area by adjusting the configuration of intelligent processing module 140, gets rid of the influence that leaf causes motion target tracking, and then returns useful monitor message to system.
Intelligent analysis module 150 is used to realize simple and crucial intelligent monitoring project, is realized by embedded chip.This embedded chip can be ARM or DSP etc.Embedded intelligence analysis module 150 is analyzed and is handled doing from the data of intelligent processing module 140 according to user configuration, and then judges whether moving target triggers default alarm rule in the guarded region, or moving target quantity etc. in the statistics guarded region.Intelligent analysis module 150 is for the user provides parameter/configuration interface, and then configuration warning function, statistical function etc.
Intelligent analysis module 150 disposes relevant parameter according to the actual needs of monitoring scene, and then judges whether have moving target to trigger the early warning rule in the guarded region, or the interior moving target quantity of statistics guarded region etc.Illustrate, suppose that monitoring scene is the sensitizing range, represent dangerous target invasion when moving target enters this sensitizing range, then this risk object triggers the early warning rule.Suppose that again monitoring scene is a single flow route, then this vehicle triggers the early warning rule when vehicle drives in the wrong direction.Suppose that again monitoring scene is the scene that needs statistics moving vehicle quantity, moving vehicle quantity in this monitoring scene of intelligent analysis module 150 real-time statistics then, and this quantity is sent to terminal server by IP data transmission module 180.The user can and then dispose sensitizing range scope, one-way traffic highway section, statistics moving target affiliated area etc. by configuration intelligent analysis module 150 relevant parameters.Enumerate no longer one by one at this for other monitoring scenes.
Intelligent analysis module 150 also can utilize this opening development platform user to develop the corresponding function module according to its demand for the user provides open development platform simultaneously except that providing the parameter/configuration interface to the user.
Alarm module 160 is used to receive the warning message from intelligent analysis module 150, alarm module 160 instant alarmings when the moving target in the guarded region triggers alarm rule, and specifically the form of reporting to the police can be that voice also can be light.Type of alarm has following two kinds:
Mode 1 is directly reported to the police in this locality by alarm module 160;
Mode 2 sends to terminal server with warning message by IP data transmission module 180, reports to the police by terminal server.
OSD (On Screen Display shows at screen) technology is stack literal or a graphical information on image, and then the technology of more additional informations is provided for the user.Osd information laminating module 170 is used to receive from the video flowing of image processing module 130 with from the analysis processing result of intelligent analysis module 150, and this analysis processing result is added on this video flowing.
Video compressing module 180 is used to receive the video flowing of overlay analysis result, and to this video stream compression and then formation compressing video frequency flow.
IP data transmission module 190 is used to receive the information from intelligent analysis module 150, this information comprises warning message and statistical information etc., and receive compressing video frequency flow, and information and the compressing video frequency flow that receives is sent to terminal server from video compressing module 180.
Fig. 2 is the intelligent video monitoring system block diagram based on a plurality of IP Camera of the present invention.This intelligent video monitoring system comprises a plurality of IP Camera and terminal server 210.The a plurality of IP Camera that are placed in a plurality of monitoring scenes link to each other with one or more terminal servers 210.Terminal server 210 can be one or more, and this specification is that example is illustrated intelligent video monitoring system of the present invention with a terminal server.
Terminal server 210 comprises terminal alarm module 211, intelligent retrieval module 212 and configuration module 213.
Terminal alarm module 211 is used to receive the warning message from IP Camera, and after receiving warning message instant alarming.
Intelligent retrieval module 212 has statistics, analyzes data, storage data and intelligent retrieval function.
Particularly, intelligent retrieval module 212 at first receives from the compressing video frequency flow of IP Camera and warning message, statistics etc., and the information that receives is done further statistics and analysis; And then according to this statistic analysis result this information that receives is done classification and handle, and according to the respective classes classified and stored.
The user needs content to do retrieval by intelligent retrieval module 212 to it, intelligent retrieval module 212 is done the matching degree analysis with the search condition of user's input with the information of having classified that is stored in this intelligent retrieval module, if on the coupling, then the user obtains the information that it needs by intelligent retrieval module 212.
Configuration module 213 comprises the monitoring objective quiet region of Remote configuration intelligent processing module 140 for the user provides Remote configuration IP Camera the function of parameters; And the warning trigger condition of Remote configuration intelligent analysis module 150; The statistical function relevant parameter of Remote configuration intelligent analysis module 150 etc.
Obviously, under the prerequisite that does not depart from true spirit of the present invention and scope, the present invention described here can have many variations.Therefore, the change that all it will be apparent to those skilled in the art that all should be included within the scope that these claims contain.The present invention's scope required for protection is only limited by described claims.

Claims (13)

1. a real-time intelligent video monitoring frontend comprises intelligent processing module (140) and intelligent analysis module (150);
Described intelligent processing module (140) is realized by application-specific integrated circuit (ASIC), is used to finish the complicated core algorithm of described intelligent monitoring front end;
Described intelligent analysis module (150) is realized that by embedded chip this intelligent analysis module (150) is analyzed and handled doing from the data of intelligent processing module (140) according to user's configuration.
2. a kind of real-time intelligent video monitoring frontend as claimed in claim 1, it is characterized in that, described intelligent processing module (140) is used for detecting in real time and following the tracks of the interior moving target of the affiliated guarded region of this supervisory control system, and analyzes the movement tendency of this moving target.
3. a kind of real-time intelligent video monitoring frontend as claimed in claim 1 is characterized in that, described intelligent analysis module (150) is for the user provides parameter/configuration interface, so that dispose one or more in the warning function, statistical function of this headend equipment.
4. a kind of real-time intelligent video monitoring frontend as claimed in claim 1 comprises osd information laminating module (170);
Described osd information laminating module (170) is used for the analysis processing result from described intelligent analysis module (150) is added to from the video flowing of described headend equipment.
5. a kind of real-time intelligent video monitoring frontend as claimed in claim 4 comprises video compressing module (180), and this video compressing module (180) is used for the video flowing of compression from the result of overlay analysis of osd information laminating module (170).
6. a kind of real-time intelligent video monitoring frontend as claimed in claim 5, comprise IP data transmission module (190), this IP data transmission module (190) is used for the information from intelligent analysis module (150), and sends from the compressing video frequency flow of video compressing module (180).
7. a kind of real-time intelligent video monitoring frontend as claimed in claim 1 is characterized in that described headend equipment is IP Camera.
8. a real-time intelligent video monitoring system comprises claim 1 described real-time intelligent video monitoring frontend and terminal server (210), and this terminal server (210) receives the information that sends over from one or more described headend equipments.
9. a kind of real-time intelligent video monitoring system as claimed in claim 8, it is characterized in that described terminal server (210) comprises intelligent retrieval module (212), this intelligent retrieval module (212) is used for the information from described headend equipment is done statistics and analysis, and this information is done classification storage, and provide the intelligent retrieval function for the user according to statistic analysis result.
10. a kind of real-time intelligent video monitoring system as claimed in claim 9, it is characterized in that, described intelligent retrieval is the search condition imported of user and the data in the intelligent retrieval module (212) when being complementary, and intelligent retrieval module (212) provides corresponding retrieving information for the user.
11. a kind of real-time intelligent video monitoring system as claimed in claim 8, described terminal server (210) comprises configuration module (213), and this configuration module (213) provides the function of the described headend equipment parameter of Remote configuration for the user.
12. a kind of real-time intelligent video monitoring system as claimed in claim 11 is characterized in that, described Remote configuration headend equipment parameter comprises the monitoring objective quiet region of Remote configuration intelligent processing module (140); And the warning trigger condition of Remote configuration intelligent analysis module (150); One or more in the statistical function relevant parameter of Remote configuration intelligent analysis module (150).
13. a kind of real-time intelligent video monitoring system as claimed in claim 8, described terminal server (210) comprises terminal alarm module (211), this terminal alarm module (211) is used to receive the warning message from described headend equipment, and after receiving warning message instant alarming.
CN2009100830139A 2009-04-28 2009-04-28 Real-time intelligent video monitoring system Pending CN101877780A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009100830139A CN101877780A (en) 2009-04-28 2009-04-28 Real-time intelligent video monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009100830139A CN101877780A (en) 2009-04-28 2009-04-28 Real-time intelligent video monitoring system

Publications (1)

Publication Number Publication Date
CN101877780A true CN101877780A (en) 2010-11-03

Family

ID=43020230

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009100830139A Pending CN101877780A (en) 2009-04-28 2009-04-28 Real-time intelligent video monitoring system

Country Status (1)

Country Link
CN (1) CN101877780A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102104721A (en) * 2011-01-17 2011-06-22 王兴国 Double-mode intelligent vision sensing system architecture
CN102984508A (en) * 2012-12-21 2013-03-20 浙江宇视科技有限公司 Camera
CN103158620A (en) * 2013-03-25 2013-06-19 中国电子科技集团公司第三十八研究所 Vehicle pedestrian detection tracking early warning system
CN103369308A (en) * 2013-07-10 2013-10-23 浙江宇视科技有限公司 OSD superposition management and superposition execution method and device
CN104202559A (en) * 2014-08-11 2014-12-10 广州中大数字家庭工程技术研究中心有限公司 Intelligent monitoring system and intelligent monitoring method based on rotation invariant feature
CN105357495A (en) * 2015-12-08 2016-02-24 浙江宇视科技有限公司 Front-rear end cooperating intelligent analysis method and device
CN106454079A (en) * 2016-09-28 2017-02-22 北京旷视科技有限公司 Image processing method and apparatus, and camera
CN107124577A (en) * 2017-05-22 2017-09-01 东华大学 A kind of real-time alarm system for guarding against theft based on moving object detection
CN107358160A (en) * 2017-06-08 2017-11-17 小草数语(北京)科技有限公司 Terminal monitoring method for processing video frequency, monitor terminal and server
CN107992627A (en) * 2017-12-25 2018-05-04 浙江宇视科技有限公司 Demand video real-time searching method and apparatus
CN108769629A (en) * 2018-08-10 2018-11-06 苏州达能激光科技有限公司 A kind of high-definition intelligent network video monitor and control system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101093603A (en) * 2007-07-03 2007-12-26 北京智安邦科技有限公司 Module set of intellective video monitoring device, system and monitoring method
CN101227598A (en) * 2008-02-26 2008-07-23 大连恒为电子有限公司 High-resolution video monitoring system
CN101355692A (en) * 2008-07-30 2009-01-28 浙江大学 Intelligent monitoring apparatus for real time tracking motion target area
CN101404760A (en) * 2008-10-28 2009-04-08 大连理工大学 Self-perception portable image wireless monitoring equipment and use method thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101093603A (en) * 2007-07-03 2007-12-26 北京智安邦科技有限公司 Module set of intellective video monitoring device, system and monitoring method
CN101227598A (en) * 2008-02-26 2008-07-23 大连恒为电子有限公司 High-resolution video monitoring system
CN101355692A (en) * 2008-07-30 2009-01-28 浙江大学 Intelligent monitoring apparatus for real time tracking motion target area
CN101404760A (en) * 2008-10-28 2009-04-08 大连理工大学 Self-perception portable image wireless monitoring equipment and use method thereof

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102104721A (en) * 2011-01-17 2011-06-22 王兴国 Double-mode intelligent vision sensing system architecture
CN102984508A (en) * 2012-12-21 2013-03-20 浙江宇视科技有限公司 Camera
CN103158620A (en) * 2013-03-25 2013-06-19 中国电子科技集团公司第三十八研究所 Vehicle pedestrian detection tracking early warning system
CN103158620B (en) * 2013-03-25 2015-09-16 中国电子科技集团公司第三十八研究所 A kind of traffic detecting and tracking forewarn system
CN103369308B (en) * 2013-07-10 2017-04-19 浙江宇视科技有限公司 OSD superposition management and superposition execution method and device
CN103369308A (en) * 2013-07-10 2013-10-23 浙江宇视科技有限公司 OSD superposition management and superposition execution method and device
CN104202559A (en) * 2014-08-11 2014-12-10 广州中大数字家庭工程技术研究中心有限公司 Intelligent monitoring system and intelligent monitoring method based on rotation invariant feature
CN105357495A (en) * 2015-12-08 2016-02-24 浙江宇视科技有限公司 Front-rear end cooperating intelligent analysis method and device
CN106454079A (en) * 2016-09-28 2017-02-22 北京旷视科技有限公司 Image processing method and apparatus, and camera
CN106454079B (en) * 2016-09-28 2020-03-27 北京旷视科技有限公司 Image processing method and device and camera
CN107124577A (en) * 2017-05-22 2017-09-01 东华大学 A kind of real-time alarm system for guarding against theft based on moving object detection
CN107358160A (en) * 2017-06-08 2017-11-17 小草数语(北京)科技有限公司 Terminal monitoring method for processing video frequency, monitor terminal and server
CN107992627A (en) * 2017-12-25 2018-05-04 浙江宇视科技有限公司 Demand video real-time searching method and apparatus
CN108769629A (en) * 2018-08-10 2018-11-06 苏州达能激光科技有限公司 A kind of high-definition intelligent network video monitor and control system

Similar Documents

Publication Publication Date Title
CN101877780A (en) Real-time intelligent video monitoring system
CN110390262B (en) Video analysis method, device, server and storage medium
US10599929B2 (en) Event monitoring with object detection systems
CN101854516B (en) Video monitoring system, video monitoring server and video monitoring method
US20190122082A1 (en) Intelligent content displays
US9442176B2 (en) Bus lane infraction detection method and system
JP2020149704A (en) System and method for activity monitoring using video data
KR102122859B1 (en) Method for tracking multi target in traffic image-monitoring-system
CN107705574A (en) A kind of precisely full-automatic capturing system of quick road violation parking
CN102081844A (en) Traffic video behavior analyzing and alarming server
KR101964683B1 (en) Apparatus for Processing Image Smartly and Driving Method Thereof
CN111047824B (en) Indoor child nursing linkage control early warning method and system
Magrini et al. Computer vision on embedded sensors for traffic flow monitoring
CN117319609A (en) Internet of things big data intelligent video monitoring system and method
JP2019215889A (en) Computer-implemented method, imaging system, and image processing system
CN116311166A (en) Traffic obstacle recognition method and device and electronic equipment
CN113963316A (en) Target event determination method and device, storage medium and electronic device
Zadobrischi et al. Pedestrian detection based on TensorFlow YOLOv3 embedded in a portable system adaptable to vehicles
WO2017176711A1 (en) Vehicle recognition system using vehicle characteristics
WO2020008459A1 (en) System and method for use in object detection from video stream
CN117037040A (en) Pedestrian recognition and tracking method based on multi-camera monitoring network
Anagnostopoulos et al. Intelligent traffic management through MPEG-7 vehicle flow surveillance
CN115471872A (en) Behavior detection method and device for distributing advertisement, electronic equipment and storage medium
Vujović et al. Traffic video surveillance in different weather conditions
CN113902987A (en) Object detection method for group intelligence, storage medium and processor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20101103