CN101098463A - Intelligent network camera having function of protecting fixed target - Google Patents

Intelligent network camera having function of protecting fixed target Download PDF

Info

Publication number
CN101098463A
CN101098463A CNA2007100699514A CN200710069951A CN101098463A CN 101098463 A CN101098463 A CN 101098463A CN A2007100699514 A CNA2007100699514 A CN A2007100699514A CN 200710069951 A CN200710069951 A CN 200710069951A CN 101098463 A CN101098463 A CN 101098463A
Authority
CN
China
Prior art keywords
steps
target
video
image
intelligent network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2007100699514A
Other languages
Chinese (zh)
Other versions
CN100539687C (en
Inventor
陈耀武
周昌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CNB2007100699514A priority Critical patent/CN100539687C/en
Publication of CN101098463A publication Critical patent/CN101098463A/en
Application granted granted Critical
Publication of CN100539687C publication Critical patent/CN100539687C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses an intelligent network camera with fixed target protection function, which uses a single-chip DSP processor as core, provided with a video I/O interface, a voice I/O interface, a video AD/DA converter, a voice DA/AD converter, a memory, and a network communication module. The DSP processor is provided with vision analysis software. User sets a protected target, uses a video input device to collect a target image, the vision analysis soft analyzes the background information to the target image. And when the target image is all shielded, and the image changes and the target moves when the shield is returned, user uses a video output device and a network communication module to output alarm information. The invention also has fixed target protection function as well as video compression and network transmission of general network camera, which can process movement and theft alarm on fixed target set by user (as parked vehicle, picture on wall, and stored goods).

Description

The intelligent network camera that possesses protection fixed target function
Technical field
The present invention relates to a kind of Network Video Surveillance equipment, be meant a kind of intelligent network camera (Smart IP Camera) that possesses the fixed target defencive function specifically.
Background technology
Along with video monitoring system is more and more as to have appeared in many public places such as airport, subway, square and supermarket, its application scale is also just presenting volatile development.Under such development trend, the video monitoring content changes automatic explanation into by visual interpretation and realizes that promptly intelligent video monitoring is a video monitoring system development inexorable trend.Web camera is widely-used, cheap at present Network Video Surveillance equipment, realizes that the web camera of intelligent vision analysis is an intelligent network camera, is to realize the intelligent video monitoring system important component part.
Existing web camera generally only possesses digitlization and networked video monitoring ability, promptly can realize video digitizer compression and Network Transmission.But supervisory control system more and more needs to possess intelligent ability at present, promptly can finish the monitoring function that some need artificial visual to explain in real time automatically, such as the fixed target defencive function.At present the majority of network video camera has adopted the solution of MCU+DSP, and the Compress softwares of audio frequency, video needs to finish by the special ASIC chip, and complex structure, cost height, autgmentability are poor, are difficult to realize on this basis the intelligent vision analytic function.
Summary of the invention
The invention provides a kind of intelligent network camera that utilizes single-chip to realize possessing the fixed target defencive function, simple in structure, maintainability is good, cost is low, extensibility is strong.This intelligent network camera also possesses the fixed target defencive function except that video compression that possesses the general networking video camera and network transmission function, the fixed target that can set the user (such as the picture on the vehicle that stops, the wall, the goods parked etc.) moves, steals warning function.
A kind of intelligent network camera that possesses the fixed target defencive function; with the monolithic dsp processor is core; external video input/output interface; the audio frequency input/output interface; video modulus (AD)/digital-to-analogue (DA) transducer; the audio frequency D and D/A converter; memory and network communication module; described dsp processor has visual analysis software; the user sets the protection target; gather target image by video input apparatus; the background information of visual analysis software analysis monitoring objective image; when target image all is blocked; image changes when blocking recovery; during situations such as target is moved, by audio frequency and video output equipment and network communication module output alarm information.
The analyzing and processing process of described visual analysis software may further comprise the steps:
Steps A 1, learning records is protected the image of target, is used for the background image of record protection target area, gets rid of the image of interim shelter target, realizes by the mean value of record multiple image data;
Steps A 2 is gathered an once new two field picture, and the target approach protection is calculated;
Steps A 3, moving image detects, and by more up-to-date 5 two field pictures, determines the part of image motion, and the gray scale maximum and the minimum value of relatively more contiguous 5 frames of individual element if two value differences surpass the threshold value that sets, then are judged as the moving image pixel;
Steps A 4, moving image is demarcated, and the result with steps A 3 outputs merges, and investigates non-motion pixel of fritter and the interior little fast motion pixel of non-motion pixel region in the motion pixel region, obtains being linked to be the motion block of pixels of sheet;
Steps A 5, alarm decision, the result who demarcates according to steps A 4, if the motion block of pixels accounts for more than 80% of protection target area area, then think exist target deliberately blocked or be moved may, output alarm information, steps A 7;
Steps A 6, if protection target area motion elemental area then detects non-moving region less than 80%, by the image preserved with steps A 1 relatively, and if the area that changes is greater than set threshold value, output alarm information, steps A 7; If the area that changes is less than set threshold value; Return steps A 2; Above-mentioned steps is carried out in circulation.
Described dsp processor adopts real time operating system RTOS.
The external video input apparatus of described video input interface, video input apparatus adopts video camera.
The external picture output device of described video output interface, picture output device adopts television set, monitor.
Described audio input interface external audio frequency input equipment, audio input device adopts microphone.
Described audio output interface external audio frequency output equipment, audio output apparatus adopts loud speaker.
The MII interface of described dsp processor by ethernet control chip link to each other with network exchanging chip afterwards access to LAN or common network.
The special dsp processor of developing at multimedia application that the present invention adopts possesses DSP and MCU complex function, and powerful coding/decoding capability and general microprocessor control ability can be provided; Dsp processor inside has two processor cores in addition, and a processor core is realized the video/audio encoding and decoding function; Another processor core uses real time operating system RTOS in the heart, realizes the Network Transmission and the fixed target defencive function of web camera; This dsp processor is incorporated into functions such as code decode algorithm, visual analysis algorithm and network communication application on the one chip, is particularly suitable for this coding/decoding capability of intelligent network camera and video analysis Capability Requirement than higher application.
Compare with existing web camera, the present invention adopts video digitizer compression of monolithic dsp processor and intelligent vision analysis, and structure is greatly simplified, and cost greatly reduces, and extensibility strengthens.System's boombox can directly insert TV output and be user-friendly to.
Description of drawings
Fig. 1 is a syndeton schematic diagram of the present invention;
Wherein: the 1-intelligent network camera, 2-television set (output monitoring image), 3-user, 4-monitoring scene (comprising the fixed target that needs protection), the input of 5-video, the 6-Ethernet, 7-controls host computer
Fig. 2 is the internal structure block diagram of intelligent network camera of the present invention;
Fig. 3 is the course of work flow chart of visual analysis software of the present invention.
Embodiment
As shown in Figure 1; a kind of intelligent network camera system that possesses the fixed target defencive function; comprise intelligent network camera 1; with the monolithic dsp processor is core; have video input/output interface, audio frequency input/output interface, video modulus (AD)/digital-to-analogue (DA) transducer, audio frequency D and D/A converter, memory and network communication module; the external video input apparatus of video input interface, video input apparatus adopts video camera.The external picture output device of video output interface, picture output device adopts television set, monitor.Audio input interface external audio frequency input equipment, audio input device adopts microphone.Audio output interface external audio frequency output equipment, audio output apparatus adopts loud speaker.Network communication module access to LAN LAN/ Ethernet WAN4 and remote communication.
As shown in Figure 2, dsp processor is by EBIU bus external data memory storage SDRAM, program storage FLASH and ethernet controller; By PPI1 data/address bus, iic bus and two external video AD transducers of PF mouth line; By PPI2 data/address bus, iic bus and the two external video DA of PF mouth line transducers; Link to each other with a PF mouth line external audio frequency ad/da converter by SPORTO; Dsp processor also is circumscribed with system reset module and energy supply control module in addition.
Wherein, the video input data bus of video AD transducer links to each other with the PPI1 bus of dsp processor, and the control line of video AD transducer links to each other with the PF mouth line of dsp processor.
The SPORTO accent audio data bus of audio frequency ad/da converter links to each other with dsp processor.
The video output data line of video DA transducer links to each other with the PPI2 bus of dsp processor, and the control line of video DA transducer links to each other with the PF mouth line of dsp processor.
The data address bus of ethernet controller links to each other with the EBIU bus of dsp processor, and ethernet controller links to each other with network exchanging chip by the MII interface.
The data/address bus of program storage FLASH and data storage SDRAM, address bus, control line link to each other with the EBIU bus of dsp processor.
The MII interface of dsp processor by ethernet control chip link to each other with network exchanging chip afterwards access to LAN or common network;
Intelligent network camera of the present invention adopts monolithic DSP BF561 processor as core processor, and its inside has two processor cores, and a processor core is realized the video/audio encoding and decoding function; Another processor core uses real time operating system RTOS in the heart, has visual analysis software, realizes the Network Transmission and the fixed target defencive function of web camera; This dsp processor is incorporated into code decode algorithm, visual analysis algorithm and network communication function on the one chip, is particularly suitable for this coding/decoding capability of intelligent network camera and video analysis Capability Requirement than higher application.
During application; with intelligent network camera 1 Ethernet 6; video input interface connects video input apparatus 5; video output interface connects television set/monitor 2; energized can be carried out intelligentized Network Video Surveillance by controlling after host computer 7 protects target configuration good according to monitoring scene 4.Digital compression video after intelligent network machine video camera will be encoded carries out Network Transmission, and simultaneously this locality can directly be exported monitor video by television set 2.Block, move or block when changing when recovering, when most of area takes place the fixedly protection target of setting by local video output 2, loud speaker and network output alarm information.
Wherein the analytical work flow process of visual analysis software as shown in Figure 3; finish after the IMAQ initialization preparation; learning records protection target image; steps A 1; the background image that is used for the record protection target area; the image of getting rid of interim shelter target can be realized by the mean value of record multiple image data.
When system enters operating state, gather an once new two field picture, steps A 2.
Carry out protection of goal and calculate, at first, carry out moving image and detect; steps A 3 by more up-to-date 5 two field pictures, is determined the part of image motion; the gray scale maximum and the minimum value of relatively more contiguous 5 frames of individual element if two value differences surpass the threshold value that sets, then are judged as the moving image pixel.
Carry out moving image and demarcate, steps A 4, the result with steps A 3 outputs merges, and investigation is fallen non-motion pixel of fritter and the interior little fast motion pixel of non-motion pixel region in the motion pixel region, obtains being linked to be the motion block of pixels of sheet after such operation.
Alarm decision, steps A 5, the result who demarcates according to A4, if the motion block of pixels is occupied more than 80% of protection target area area, then think exist target deliberately blocked or be moved may, output alarm information, steps A 7.
If protection target area motion elemental area then detects non-moving region less than 80%, steps A 6, by the image comparison of preserving with steps A 1, if the area that changes greater than set threshold value, output alarm information, steps A 7.If the area that changes less than set threshold value, returns steps A 2, repeat above-mentioned steps.

Claims (8)

1. intelligent network camera that possesses the fixed target defencive function; with the monolithic dsp processor is core; have the video input/output interface; the audio frequency input/output interface; the video D and D/A converter; the audio frequency D and D/A converter; memory and network communication module; it is characterized in that: described dsp processor has visual analysis software; the user sets the protection target; gather target image by video input apparatus; the background information of visual analysis software analysis monitoring objective image; when target image all is blocked; image changes when blocking recovery; during situations such as target is moved, by audio frequency and video output equipment and network communication module output alarm information.
2. intelligent network camera as claimed in claim 1 is characterized in that: the analyzing and processing process of described visual analysis software may further comprise the steps:
Steps A 1, learning records is protected the image of target, is used for the background image of record protection target area, gets rid of the image of interim shelter target, realizes by the mean value of record multiple image data;
Steps A 2 is gathered an once new two field picture, and the target approach protection is calculated;
Steps A 3, moving image detects, and by more up-to-date 5 two field pictures, determines the part of image motion, and the gray scale maximum and the minimum value of relatively more contiguous 5 frames of individual element if two value differences surpass the threshold value that sets, then are judged as the moving image pixel;
Steps A 4, moving image is demarcated, and the result with steps A 3 outputs merges, and investigates non-motion pixel of fritter and the interior little fast motion pixel of non-motion pixel region in the motion pixel region, obtains being linked to be the motion block of pixels of sheet;
Steps A 5, alarm decision, the result who demarcates according to steps A 4, if the motion block of pixels accounts for more than 80% of protection target area area, then think exist target deliberately blocked or be moved may, output alarm information, steps A 7;
Steps A 6, if protection target area motion elemental area then detects non-moving region less than 80%, by the image preserved with steps A 1 relatively, and if the area that changes is greater than set threshold value, output alarm information, steps A 7; If the area that changes is less than set threshold value; Return steps A 2; Above-mentioned steps is carried out in circulation.
3. intelligent network camera as claimed in claim 1 is characterized in that: described dsp processor adopts real time operating system RTOS.
4. intelligent network camera as claimed in claim 1 is characterized in that: the external video input apparatus of described video input interface, video input apparatus adopts video camera.
5. intelligent network camera as claimed in claim 1 is characterized in that: the external picture output device of described video output interface, picture output device adopts television set, monitor.
6. intelligent network camera as claimed in claim 1 is characterized in that: described audio input interface external audio frequency input equipment, audio input device adopts microphone.
7. intelligent network camera as claimed in claim 1 is characterized in that: described audio output interface external audio frequency output equipment, audio output apparatus adopts loud speaker.
8. intelligent network camera as claimed in claim 1 is characterized in that: the MII interface of described dsp processor by ethernet control chip link to each other with network exchanging chip afterwards access to LAN or common network.
CNB2007100699514A 2007-07-12 2007-07-12 The intelligent network camera that possesses protection fixed target function Expired - Fee Related CN100539687C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2007100699514A CN100539687C (en) 2007-07-12 2007-07-12 The intelligent network camera that possesses protection fixed target function

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2007100699514A CN100539687C (en) 2007-07-12 2007-07-12 The intelligent network camera that possesses protection fixed target function

Publications (2)

Publication Number Publication Date
CN101098463A true CN101098463A (en) 2008-01-02
CN100539687C CN100539687C (en) 2009-09-09

Family

ID=39011929

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2007100699514A Expired - Fee Related CN100539687C (en) 2007-07-12 2007-07-12 The intelligent network camera that possesses protection fixed target function

Country Status (1)

Country Link
CN (1) CN100539687C (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101399970B (en) * 2008-07-30 2010-10-13 浙江大学 Network camera system having intelligent alarm function
CN102104721A (en) * 2011-01-17 2011-06-22 王兴国 Double-mode intelligent vision sensing system architecture
CN102811334A (en) * 2012-07-10 2012-12-05 杭州海康威视数字技术股份有限公司 System and method for transmitting high-definition video signal in dome camera
CN103873818A (en) * 2012-12-13 2014-06-18 北京计算机技术及应用研究所 General subsystem of intelligent monitor camera and intelligent processing method thereof
CN109488383A (en) * 2018-12-27 2019-03-19 江苏三恒科技股份有限公司 Intelligent video analysis system and its application method
CN110084979A (en) * 2019-04-23 2019-08-02 暗物智能科技(广州)有限公司 Man-machine interaction method, device and controller and interactive device
CN112543312A (en) * 2020-12-02 2021-03-23 中国联合网络通信集团有限公司 Transport vehicle monitoring method and device, vehicle and storage medium

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101399970B (en) * 2008-07-30 2010-10-13 浙江大学 Network camera system having intelligent alarm function
CN102104721A (en) * 2011-01-17 2011-06-22 王兴国 Double-mode intelligent vision sensing system architecture
CN102811334A (en) * 2012-07-10 2012-12-05 杭州海康威视数字技术股份有限公司 System and method for transmitting high-definition video signal in dome camera
CN103873818A (en) * 2012-12-13 2014-06-18 北京计算机技术及应用研究所 General subsystem of intelligent monitor camera and intelligent processing method thereof
CN109488383A (en) * 2018-12-27 2019-03-19 江苏三恒科技股份有限公司 Intelligent video analysis system and its application method
CN110084979A (en) * 2019-04-23 2019-08-02 暗物智能科技(广州)有限公司 Man-machine interaction method, device and controller and interactive device
CN110084979B (en) * 2019-04-23 2022-05-10 暗物智能科技(广州)有限公司 Human-computer interaction method and device, controller and interaction equipment
CN112543312A (en) * 2020-12-02 2021-03-23 中国联合网络通信集团有限公司 Transport vehicle monitoring method and device, vehicle and storage medium

Also Published As

Publication number Publication date
CN100539687C (en) 2009-09-09

Similar Documents

Publication Publication Date Title
CN100539687C (en) The intelligent network camera that possesses protection fixed target function
US10127452B2 (en) Relevant image detection in a camera, recorder, or video streaming device
CN100337253C (en) Video tripwire
CN1767638B (en) Visible image monitoring method for protecting privacy right and its system
JP3872014B2 (en) Method and apparatus for selecting an optimal video frame to be transmitted to a remote station for CCTV-based residential security monitoring
EP0967584A2 (en) Automatic video monitoring system
US20080024610A1 (en) Monitoring Apparatus, Monitoring System, Monitoring Method and Program
JP2010009134A (en) Image processing system, image processing method, and program
CN100493184C (en) TV monitor system and implement method
WO2011082185A1 (en) Confined motion detection for pan-tilt cameras employing motion detection and autonomous motion tracking
CN106327738B (en) A kind of intelligent hierarchical monitoring system
US20110221895A1 (en) Detection of Movement of a Stationary Video Camera
CN103268680A (en) Intelligent monitoring and anti-theft system for family
CN100464348C (en) Video frequency monitoring, identification intelligont device and technical method
AU2011203219B2 (en) Mode removal for improved multi-modal background subtraction
US20230067154A1 (en) Monitoring apparatus and system
AU2010238543A1 (en) Method for video object detection
CN110933478A (en) Security protection system
CN107578024A (en) A kind of face identification system
CN101281649A (en) Method for detecting surroundings variation movably
US20080024611A1 (en) Monitoring Apparatus, Monitoring Method, and Program
CN202488602U (en) All-dimensional vision detection analysis prewarning system based on fisheye correction technology
KR100439042B1 (en) Digital video recording system having a data file backup function in the distance
JP2008185480A (en) Human body detector
KR20100077662A (en) Inteligent video surveillance system and method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090909

Termination date: 20200712

CF01 Termination of patent right due to non-payment of annual fee