CN101783881A - Intelligent web camera with video structural description function - Google Patents

Intelligent web camera with video structural description function Download PDF

Info

Publication number
CN101783881A
CN101783881A CN 201010119021 CN201010119021A CN101783881A CN 101783881 A CN101783881 A CN 101783881A CN 201010119021 CN201010119021 CN 201010119021 CN 201010119021 A CN201010119021 A CN 201010119021A CN 101783881 A CN101783881 A CN 101783881A
Authority
CN
China
Prior art keywords
video
image
description
analysis
structural description
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010119021
Other languages
Chinese (zh)
Inventor
吴炬
胡传平
梅林�
高鹏
吴轶轩
张鸿洲
蔡烜
梁辰
沙淼淼
朱丽英
赵悦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Third Research Institute of the Ministry of Public Security
Original Assignee
Third Research Institute of the Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Third Research Institute of the Ministry of Public Security filed Critical Third Research Institute of the Ministry of Public Security
Priority to CN 201010119021 priority Critical patent/CN101783881A/en
Publication of CN101783881A publication Critical patent/CN101783881A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention aims to disclose an intelligent web camera with a video structural description function, which is characterized by comprising a video structural description device for carrying out structural description processing on video information, wherein the video structural description device comprises an image collecting unit, an analysis and discrimination unit and a description unit. The web camera of the invention can complete a network monitoring function, directly analyze and understand the shot monitoring video, and generate structural description information about the attribute and content of the video images; the description information has a small data volume and can be stored and transmitted through network conveniently; and by retrieving and querying the description information, the searched video images can be found quickly, thereby greatly improving the utilization efficiency of the video information, reducing the cost of manual retrieval and searching, and realizing the purpose of the invention.

Description

A kind of intelligent network camera with video structural description function
Technical field
The present invention relates to a kind of intelligent network camera, particularly a kind of intelligent network camera with video structural description function.
Background technology
Along with embedded technology and development of internet technology, supervisory control system is developed to networking, intelligent direction gradually by traditional Close Circuit Television (CCTV) supervisory control system.
Web camera designs at the monitoring demand under the network environment, it has overcome the shortcoming that traditional C CTV supervisory control system can't be obtained video information by network, and the user can watch, record and managing video information by any computer in the network.
Web camera is the watch-dog of total digitalization, its measured ICP/IP protocol, can pass through local area network (LAN)/wireless network/internet transmission, its image resolution ratio generally can reach 200~5,000,000 pixels, and the readability of image is considerably beyond the simulation monitoring video camera.
Chinese patent application number discloses a kind of based on embedded intelligent network camera with recognition function for the patent of invention of 200710046001.X, collection IMAQ, compression, preservation, certain content identification, transmission, control technology in case of necessity are one, hardware designs is combined with software design, reach purposes such as applying flexible, function can preset, network management, network settings.
Chinese patent application number is that 200810120164.2 patent of invention discloses a kind of internet protocol camera system that possesses intelligent alarm function, can realize motion detection and warning, and system configuration is simple, the real-time autgmentability is strong, has the multimeshed network access function.
At present, though the part intelligent network camera is arranged can be analyzed and warning automatically video content, but,, can't realize inquiry and retrieval to video content if can not produce structural description data about video attribute and content because vedio data is a unstructured data.
Summary of the invention
The object of the present invention is to provide a kind of intelligent network camera, overcome above-mentioned shortcoming of the prior art with video structural description function, applied range, stable and reliable for performance.
Technical problem solved by the invention can realize by the following technical solutions:
A kind of intelligent network camera with video structural description function is characterized in that, it comprises that one is used for video information is carried out the video structural description device that structural description is handled, and described video structural description device comprises:
One image acquisition units in order to gathering video image in real time, and is given the analysis and distinguishing unit image data transmission;
One analysis and distinguishing unit, in order to video image carried out preliminary treatment, cut apart, feature extraction and discriminant classification, and the result of the characteristics of image of the video image of image acquisition units collection and analysis and distinguishing passed to description unit; And
One description unit in order to the characteristics of image of the video image gathered and the result of analysis and distinguishing are described coding, produces the data of description about video image attribute and content.
In one embodiment of the invention, described characteristics of image is a visual feature of image, comprises color, texture, shape, motion, location and the contour feature of image.
In one embodiment of the invention, described analysis and distinguishing unit can carry out reasoning and judgement to its attribute and content according to the characteristics of image of video image.
In one embodiment of the invention, described data of description adopts extend markup language (XML), binary extend markup language (Binary XML) to write.
Intelligent network camera with video structural description function of the present invention, not only can finish the network monitoring function, and can directly carry out analysis and understanding to the monitoring video that photographs, generation is about the attribute of video image and the structural description information of content, this descriptor data volume is little, can store easily and Network Transmission, by retrieval and inquiry to this descriptor, can find the video image that to search fast, improved the utilization ratio of video information greatly, reduce the cost of manually having access to and searching, realized purpose of the present invention.
Characteristics of the present invention can be consulted the detailed description of the graphic and following better execution mode of this case and be obtained to be well understood to.
Description of drawings
Fig. 1 is the structural representation of video structural description device of the present invention;
Fig. 2 is the system construction drawing of embodiments of the invention 1;
Fig. 3 is the fundamental diagram of embodiments of the invention 1;
Fig. 4 is the application schematic diagram of embodiments of the invention 1;
Fig. 5 is the system construction drawing of embodiments of the invention 2.
Embodiment
For technological means, creation characteristic that the present invention is realized, reach purpose and effect is easy to understand, below in conjunction with concrete diagram, further set forth the present invention.
Embodiment 1
As shown in Figure 1, intelligent network camera with video structural description function of the present invention, it comprises that one is used for video information is carried out the video structural description device 100 that structural description is handled, and video structural description device 100 is made of image acquisition units 110, analysis and distinguishing unit 120 and description unit 130.
[image acquisition units 110]
Image acquisition units 110 in order to gathering video image in real time, and is given analysis and distinguishing unit 120 image data transmission; In the present embodiment, image acquisition units 110 is TVP5145 by 1 ccd sensor of lining by line scan and 1 model A/D converter constitutes.(referring to Fig. 2)
[analysis and distinguishing unit 120]
Analysis and distinguishing unit 120, in order to the video images that image acquisition units 110 is gathered in real time carry out preliminary treatment, cut apart, feature extraction and discriminant classification, and the characteristics of image of the video image that image acquisition units 110 is gathered and the result of analysis and distinguishing pass to description unit 130; In the present embodiment, analysis and distinguishing unit 120 is that TMS320DM642 digital signal processor, model are that the flash chip of AT29LV020, the SDRAM memory that model is K4S561632E, the CF card of 64M capacity constitute by model.(referring to Fig. 2)
[description unit 130]
Description unit 130 in order to the characteristics of image of the video image gathered and the result of analysis and distinguishing are described coding, produces the data of description about video image attribute and content; In the present embodiment, hardware resources are shared in description unit 130 and analysis and distinguishing unit 120, and promptly description unit 130 and analysis and distinguishing unit 120 are that TMS320DM642 digital signal processor, model are that the flash chip of AT29LV020, the SDRAM memory that model is K4S561632E, the CF card common combination of 64M capacity constitute by model.
In the present embodiment, described characteristics of image is a visual feature of image, comprises color, texture, shape, motion, location and the contour feature of image; Analysis and distinguishing unit 120 can carry out reasoning and judgement to its attribute and content according to the characteristics of image of video image; The data of description about content that description unit 130 produces adopts extend markup language (XML), binary extend markup language (Binary XML) to write.
In the present embodiment, but in analysis and distinguishing unit 120 and description unit 130 models is the power module that also is connected with ethernet transceiver editorial logic device, JTAG artificial head on the TMS320DM642 digital signal processor and is used to the digital signal processor power supply, be connected with the RJ45 interface on the ethernet transceiver, but be connected with the VGA interface on the editorial logic device.
As shown in Figure 3, the course of work of the intelligent network camera with video structural description function of the present invention is as follows:
At first, image acquisition units 110 is obtained real-time video image, comprises a slice woods, car and highway in this image scene.
Then, 120 pairs of these images in analysis and distinguishing unit are cut apart, and the image region segmentation of the woods and automobile is come out, and these two image-regions are carried out the extraction of contour feature, obtain the profile lines feature of image; According to image outline lines feature, it is carried out discriminant classification, judge that these two image-regions are respectively " woods " and " car ", obtain semantic interpretation to image.
At last, 130 pairs of characteristics of image of description unit and semantic interpretation are encoded, and produce one section data of description about video image attribute and content, this The data extend markup language (XML) write.
As shown in Figure 4, a typical case of the present invention uses example.The present invention has the intelligent network camera 200 of video structural description function and gathers video image and produce description, and by network video data and data of description are transferred in storage and the application server 300 and store, storage and application server 300 provide various application services by network for the user according to demand; Subscriber computer 400 can obtain application service by access to netwoks storage and application server 300.Such as: subscriber computer 400 inquiries " car " and " woods ", storage and application server 300 will be inquired about in data of description according to keyword, and corresponding video image is presented to the user as Query Result.
Adopt the intelligent network camera with video structural description function of the present invention not only can finish IMAQ, encoding function, and can carry out intelligent analysis and description, thereby realize the video content retrieval and the warning of deploying to ensure effective monitoring and control of illegal activities monitor video.
Embodiment 2
As shown in Figure 1, intelligent network camera with video structural description function of the present invention, it comprises that one is used for video information is carried out the video structural description device 100 that structural description is handled, and video structural description device 100 is made of image acquisition units 110, analysis and distinguishing unit 120 and description unit 130.
Present embodiment is only distinguished with embodiment 1 on hardware configuration to some extent:
In the present embodiment, image acquisition units 110 is read module by ccd sensor and view data and is constituted; Analysis and distinguishing unit 120 and description unit 130 are shared hardware resource, are made of dsp chip and SDRAM memory, control image acquisition units 110, analysis and distinguishing unit 120 and description unit 130 realization work by FPGA; FPGA is connected with RS232 interface, external trigger interface, digital I interface and FLASH memory, is connected with network interface on analysis and distinguishing unit 120 and the description unit 130; The benefit of doing has like this alleviated the computation burden of dsp chip, improves the efficient of system, and other parts are identical with embodiment 1.
More than show and described basic principle of the present invention and principal character and advantage of the present invention.The technical staff of the industry should understand; the present invention is not restricted to the described embodiments; that describes in the foregoing description and the specification just illustrates principle of the present invention; without departing from the spirit and scope of the present invention; the present invention also has various changes and modifications; these changes and improvements all fall in the claimed scope of the invention, and the claimed scope of the present invention is defined by appending claims and equivalent thereof.

Claims (4)

1. the intelligent network camera with video structural description function is characterized in that, it comprises that one is used for video information is carried out the video structural description device that structural description is handled, and described video structural description device comprises:
One image acquisition units in order to gathering video image in real time, and is given the analysis and distinguishing unit image data transmission;
One analysis and distinguishing unit, in order to video image carried out preliminary treatment, cut apart, feature extraction and discriminant classification, and the result of the characteristics of image of the video image of image acquisition units collection and analysis and distinguishing passed to description unit; And
One description unit in order to the characteristics of image of the video image gathered and the result of analysis and distinguishing are described coding, produces the data of description about video image attribute and content.
2. intelligent network camera as claimed in claim 1 is characterized in that described characteristics of image is a visual feature of image, comprises color, texture, shape, motion, location and the contour feature of image.
3. intelligent network camera as claimed in claim 1 is characterized in that, described analysis and distinguishing unit can carry out reasoning and judgement to its attribute and content according to the characteristics of image of video image.
4. intelligent network camera as claimed in claim 1 is characterized in that, described data of description adopts extend markup language (XML), binary extend markup language (Binary XML) to write.
CN 201010119021 2010-03-05 2010-03-05 Intelligent web camera with video structural description function Pending CN101783881A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010119021 CN101783881A (en) 2010-03-05 2010-03-05 Intelligent web camera with video structural description function

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010119021 CN101783881A (en) 2010-03-05 2010-03-05 Intelligent web camera with video structural description function

Publications (1)

Publication Number Publication Date
CN101783881A true CN101783881A (en) 2010-07-21

Family

ID=42523678

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010119021 Pending CN101783881A (en) 2010-03-05 2010-03-05 Intelligent web camera with video structural description function

Country Status (1)

Country Link
CN (1) CN101783881A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102568003A (en) * 2011-12-21 2012-07-11 北京航空航天大学深圳研究院 Multi-camera target tracking method based on video structural description
CN102902965A (en) * 2012-10-09 2013-01-30 公安部第三研究所 Method for processing structured description of video image data and capable of implementing multi-target tracking
CN102903126A (en) * 2012-08-08 2013-01-30 公安部第三研究所 System and method for carrying out texture feature extraction and structured description on video images
CN102999640A (en) * 2013-01-09 2013-03-27 公安部第三研究所 Video and image retrieval system and method based on semantic reasoning and structural description
CN104378539A (en) * 2014-11-28 2015-02-25 华中科技大学 Scene-adaptive video structuring semantic extraction camera and method thereof
CN104899261A (en) * 2015-05-20 2015-09-09 杜晓通 Device and method for constructing structured video image information
CN105187793A (en) * 2015-09-09 2015-12-23 深圳市研赛科技有限公司 Intelligent network camera
CN105898204A (en) * 2014-12-25 2016-08-24 支录奎 Intelligent video recorder enabling video structuralization
CN107018340A (en) * 2017-04-05 2017-08-04 合肥酷庆信息科技有限公司 A kind of high definition CCD network cameras rear end processing system for video
CN107122393A (en) * 2017-03-09 2017-09-01 北京小度互娱科技有限公司 Electron album generation method and device
CN108174152A (en) * 2017-12-28 2018-06-15 深圳英飞拓科技股份有限公司 A kind of target monitoring method and target monitor system
CN108875517A (en) * 2017-12-15 2018-11-23 北京旷视科技有限公司 Method for processing video frequency, device and system and storage medium
CN109040839A (en) * 2018-08-21 2018-12-18 北京深瞐科技有限公司 Wisdom video structural method and device
CN110121060A (en) * 2019-05-27 2019-08-13 中国电子科技网络信息安全有限公司 A kind of intelligence enhancing device and method for IP Camera
US10755044B2 (en) 2016-05-04 2020-08-25 International Business Machines Corporation Estimating document reading and comprehension time for use in time management systems
CN112565717A (en) * 2021-02-18 2021-03-26 深圳市安软科技股份有限公司 Video structuring method, related device, system and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101112099A (en) * 2005-02-01 2008-01-23 松下电器产业株式会社 Monitor recording device
CN101420595A (en) * 2007-10-23 2009-04-29 华为技术有限公司 Method and equipment for describing and capturing video object
CN101587483A (en) * 2009-07-10 2009-11-25 张丛喆 Information storage/retrival method of video files based on MPEG-7 in monitoring system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101112099A (en) * 2005-02-01 2008-01-23 松下电器产业株式会社 Monitor recording device
CN101420595A (en) * 2007-10-23 2009-04-29 华为技术有限公司 Method and equipment for describing and capturing video object
CN101587483A (en) * 2009-07-10 2009-11-25 张丛喆 Information storage/retrival method of video files based on MPEG-7 in monitoring system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
《中国图象图形学报》 20060430 代科学等 视频挖掘技术综述 451-457页 第11卷, 第4期 2 *
《深圳信息职业技术学院学报》 20090630 柳伟等 智能视频监控中的语义理解模型 1-4页 第7卷, 第2期 2 *

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102568003B (en) * 2011-12-21 2015-04-08 北京航空航天大学深圳研究院 Multi-camera target tracking method based on video structural description
CN102568003A (en) * 2011-12-21 2012-07-11 北京航空航天大学深圳研究院 Multi-camera target tracking method based on video structural description
CN102903126A (en) * 2012-08-08 2013-01-30 公安部第三研究所 System and method for carrying out texture feature extraction and structured description on video images
CN102903126B (en) * 2012-08-08 2015-11-04 公安部第三研究所 The system and method for a kind of video image texture feature extraction and structural description
CN102902965A (en) * 2012-10-09 2013-01-30 公安部第三研究所 Method for processing structured description of video image data and capable of implementing multi-target tracking
CN102902965B (en) * 2012-10-09 2016-07-06 公安部第三研究所 Realize the method that the vedio data structural description of multiple target tracking processes
CN102999640A (en) * 2013-01-09 2013-03-27 公安部第三研究所 Video and image retrieval system and method based on semantic reasoning and structural description
CN102999640B (en) * 2013-01-09 2016-03-09 公安部第三研究所 Based on the video of semantic reasoning and structural description and image indexing system and method
CN104378539A (en) * 2014-11-28 2015-02-25 华中科技大学 Scene-adaptive video structuring semantic extraction camera and method thereof
CN104378539B (en) * 2014-11-28 2017-08-08 华中科技大学 The video structural extraction of semantics video camera and its method of scene adaptive
CN105898204A (en) * 2014-12-25 2016-08-24 支录奎 Intelligent video recorder enabling video structuralization
WO2016184314A1 (en) * 2015-05-20 2016-11-24 山东大学 Device and method for establishing structured video image information
CN104899261A (en) * 2015-05-20 2015-09-09 杜晓通 Device and method for constructing structured video image information
CN104899261B (en) * 2015-05-20 2018-04-03 杜晓通 A kind of apparatus and method for building structuring video image information
CN105187793B (en) * 2015-09-09 2019-01-11 深圳市研赛科技有限公司 A kind of intelligent network camera
CN105187793A (en) * 2015-09-09 2015-12-23 深圳市研赛科技有限公司 Intelligent network camera
US10755044B2 (en) 2016-05-04 2020-08-25 International Business Machines Corporation Estimating document reading and comprehension time for use in time management systems
CN107122393A (en) * 2017-03-09 2017-09-01 北京小度互娱科技有限公司 Electron album generation method and device
CN107122393B (en) * 2017-03-09 2019-12-10 北京小度互娱科技有限公司 electronic album generating method and device
CN107018340A (en) * 2017-04-05 2017-08-04 合肥酷庆信息科技有限公司 A kind of high definition CCD network cameras rear end processing system for video
CN108875517A (en) * 2017-12-15 2018-11-23 北京旷视科技有限公司 Method for processing video frequency, device and system and storage medium
CN108174152A (en) * 2017-12-28 2018-06-15 深圳英飞拓科技股份有限公司 A kind of target monitoring method and target monitor system
CN109040839A (en) * 2018-08-21 2018-12-18 北京深瞐科技有限公司 Wisdom video structural method and device
CN110121060A (en) * 2019-05-27 2019-08-13 中国电子科技网络信息安全有限公司 A kind of intelligence enhancing device and method for IP Camera
CN112565717A (en) * 2021-02-18 2021-03-26 深圳市安软科技股份有限公司 Video structuring method, related device, system and storage medium
CN112565717B (en) * 2021-02-18 2021-05-25 深圳市安软科技股份有限公司 Video structuring method, related device, system and storage medium

Similar Documents

Publication Publication Date Title
CN101783881A (en) Intelligent web camera with video structural description function
Xu et al. Video structured description technology based intelligence analysis of surveillance videos for public security applications
CN107908175B (en) On-site intelligent operation and maintenance system for power system
JP6005837B2 (en) Image analysis apparatus, image analysis system, and image analysis method
US20150019586A1 (en) System and method for sharing tagged multimedia content elements
WO2016119528A1 (en) Intelligent processing method and system for video data
Koyuncu et al. Visual and auditory data fusion for energy-efficient and improved object recognition in wireless multimedia sensor networks
US10719735B2 (en) Information processing method, information processing device and video surveillance system
US10380267B2 (en) System and method for tagging multimedia content elements
Civelek et al. Automated moving object classification in wireless multimedia sensor networks
CN106534784A (en) Acquisition analysis storage statistical system for video analysis data result set
CN101790064A (en) Hard disk video equipment with video structural description function and method thereof
Nikouei et al. I-vise: Interactive video surveillance as an edge service using unsupervised feature queries
Duan et al. Towards mobile document image retrieval for digital library
CN113239792A (en) Big data analysis processing system and method
Wang et al. Design and implementation of remote facial expression recognition surveillance system based on PCA and KNN algorithms
CN104865860A (en) Sampling, storing and inquiring method and device of WTGS (Wind Turbine Generator System) state monitoring system
Li et al. Real-time Safety Helmet-wearing Detection Based on Improved YOLOv5.
CN115103157A (en) Video analysis method and device based on edge cloud cooperation, electronic equipment and medium
Cao et al. Edge-Cloud collaborated object detection via difficult-case discriminator
Li et al. A city monitoring system based on real-time communication interaction module and intelligent visual information collection system
CN104463114A (en) Method for catching images and quickly recognizing targets and embedded device
CN103824058A (en) Face recognition system and method based on locally distributed linear embedding algorithm
CN116796015A (en) Visual multi-mode data acquisition, transmission and processing method
CN205038686U (en) Intelligence attendance device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20100721