CN103136738A - Registering method of fixing vidicon surveillance video and three-dimensional model in complex scene - Google Patents
Registering method of fixing vidicon surveillance video and three-dimensional model in complex scene Download PDFInfo
- Publication number
- CN103136738A CN103136738A CN201110385497XA CN201110385497A CN103136738A CN 103136738 A CN103136738 A CN 103136738A CN 201110385497X A CN201110385497X A CN 201110385497XA CN 201110385497 A CN201110385497 A CN 201110385497A CN 103136738 A CN103136738 A CN 103136738A
- Authority
- CN
- China
- Prior art keywords
- video
- dimensional model
- module
- model
- vidicon
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses a registering method of a fixing vidicon surveillance video and a three-dimensional model in a complex scene. The registering method of the fixing vidicon surveillance video and the three-dimensional model in the complex scene includes that firstly, a video monitoring management system is constructed, the video monitoring management system comprises a media control module, a video transmitting module, a video storing module, a source request module and a communication control module; secondly, the three-dimensional model of a surveillance region is established, and the three-dimensional model in the surveillance region is constructed through three-dimensional modeling technology; thirdly, the vidicon is calibrated, relative locations and angles in the model of the vidicon are calibrated, and the registering of the vidicon video and the three-dimensional model is achieved.
Description
Technical field
The present invention relates to the method for registering of a kind of image and three-dimensional model, especially the method for registering of fixed cameras monitor video and three-dimensional model under complex scene
Background technology
Along with pay attention to day by day and the raising of society to demand for security, monitoring is used more and more wider in real world, acts on also more and more important.In the tradition monitoring, the real time monitoring screen that requires the monitor staff to continue by the video information that manual interpretation obtains, is then made corresponding decision-making.Yet allow the monitor staff stare at numerous video monitors is a very heavy task long-term, uninterestingly, and special in more place, some control points, the monitor staff almost can't accomplish complete comprehensive monitoring.This not only causes the waste of huge manpower, and is easy to because the absent-mindedness of monitor staff's thought causes failing to report, and in some occasions to the safety requirements sensitivity (as bank, military etc.), this mistake is flagrant.Therefore, replace human eye with video camera, substitute even the people with the computing machine contributor and complete supervision or control task, thereby improve the efficient of monitoring, the requirement of development intelligent visual surveillance system becomes more and more urgent.
In the multi-cam video monitoring system, the impact that camera is needed by geographical environment and actual monitored in installation process, setting height(from bottom), luffing angle are different, make the visual signature of Same Scene in the different camera kens have larger difference.
Development along with the multi-source image integration technology, with at one time or the multi-source image information about certain concrete scene obtained of different time in addition comprehensive, generating the description of new relevant this scene, and this description is can't obtain from the information of single image.Monitor video and three-dimensional model registration technology under complex scene, it is the gordian technique that merges when solving the monitor video sky, multi-channel video and guarded region three-dimensional model can be merged by this registration technology, by the fusion to multi-source image, can overcome the limitation that single image exists, improve the service efficiency of multi-source image, and be conducive to physical phenomenon and event are positioned, identify and explain.
Summary of the invention
The object of the invention is to exist for video fusion the problems such as the visual angle is various, scene is complicated, cam movement, monitor video and three-dimensional model method for registering under a kind of complex scene are provided, take video and model textural characteristics matching method to set up video to the mapping relations of three-dimensional model, realize video and the fusion problem of three-dimensional model and the video fusion problem in the cam movement situation under complex scene.
Technical scheme of the present invention is as follows:
Fixed cameras monitor video and three-dimensional model method for registering under a kind of complex scene is characterized in that comprising the following steps:
(1) build the video surveillance management system, described video monitoring system comprises media management module, video forwarding module, video storage module, resource request module, communication control module, wherein,
Described media management module is the kernel service in AVSS video monitoring system overall plan, can support multistage multiple domain, be used for the central server of managing video monitoring business and control;
Described video forwarding module carries out forwarding, the distribution of real-time audio and video stream;
Described video storage module realizes the stable storage function of multi-channel video, and the historical video frequency searching playback of client support is provided.Satisfied the demand of video mass memory, Concurrency Access in the practical application;
Described resource request module, fulfillment database agency's function for client provides data access service, reduces the security of database number of connection and assurance data access;
Described communication control module is realized parameter and configuration that the codec to different manufacturers manages, the different manufacturers codec device supported and obtained devices from different manufacturers;
(2) set up the three-dimensional stereo model of guarded region, by dimensional Modeling Technology, build the three-dimensional model in the guarded region scope;
(3) camera calibration, calibrating camera relative position and the angle in model realizes camera video and three-dimensional model registration.
Above-mentioned steps (3) further comprises the steps:
(31) according to the coverage of monitor video, the texture subgraph that has obvious architectural feature in feature selecting algorithm extraction model texture is arranged, extract and optimize the mapping relations of texture subgraph in model, with subgraph and map information write into Databasce, as the reference point of video accuracy registration, improve the arithmetic speed of fusion process;
(32) use structure invariant features matching algorithm extract the scene structure invariant features and carry out scene matching to pretreated realtime graphic and texture subgraph, set up the registration relation of realtime graphic and texture subgraph;
(33) combined with texture subgraph map information storehouse utilizes the registration relation of realtime graphic and texture subgraph, calculates the map information of realtime graphic.
The present invention is directed to the setting angle of rig camera and highly different, the characteristics such as video scene is complicated, by the dynamic registration technology of monitor video and guarded region three-dimensional scene models, solved the Precision Mapping problem of monitor video and three-dimensional model.In the camera support situation of sufficient amount, be provided at the function that supervises security postures in the zone under certain height and angle mode, realize that three-dimensional model, monitor video and other Information fusion of guarded region shows.
Description of drawings
Fig. 1 is fixed cameras monitor video actual situation registration process flow process
Embodiment
The present invention is in order to realize video and three-dimensional model fusion under complex environment, at first extract and optimize texture and the scene structure information of three-dimensional model, then calculate in real time the scene structure invariant features of video image, set up the matching relationship of scene structure invariant features and three-dimensional model, utilize at last tripleplane's technology to realize the seamless fusion of panoramic video and three-dimensional model.Specifically comprise the following steps:
Step 1: build the video surveillance management system, described video monitoring system comprises media management module, video forwarding module, video storage module, resource request module, communication control module, wherein,
Described media management module is the kernel service in AVSS video monitoring system overall plan, can support multistage multiple domain, be used for the central server of managing video monitoring business and control;
Described video forwarding module carries out forwarding, the distribution of real-time audio and video stream;
Described video storage module realizes the stable storage function of multi-channel video, and the historical video frequency searching playback of client support is provided.Satisfied the demand of video mass memory, Concurrency Access in the practical application;
Described resource request module, fulfillment database agency's function for client provides data access service, reduces the security of database number of connection and assurance data access;
Described communication control module is realized parameter and configuration that the codec to different manufacturers manages, the different manufacturers codec device supported and obtained devices from different manufacturers;
Step 2: set up the three-dimensional stereo model of guarded region, by dimensional Modeling Technology, build the three-dimensional model in the guarded region scope;
Step 3: camera calibration, calibrating camera relative position and the angle in model, realize camera video and three-dimensional model registration.
In above-mentioned steps 3, for video being mapped to the correspondence position of three-dimensional scene models, realize the fusion of real-time video and three-dimensional model, research is based on the scene match method of structure invariant features, in the situation that camera is not carried out extra proving operation, extract camera inside and outside parameter and characteristics of image, solve the registration problems of monitor video and three-dimensional model, treatment scheme as shown in Figure 1, mainly comprises in detail:
First, coverage according to monitor video, the texture subgraph that has obvious architectural feature in feature selecting algorithm extraction model texture is arranged, extract and optimize the mapping relations of texture subgraph in model, with subgraph and map information write into Databasce, as the reference point of video accuracy registration, improve the arithmetic speed of fusion process.
The second, use structure invariant features matching algorithm extract the scene structure invariant features and carry out scene matching to pretreated realtime graphic and texture subgraph, set up the registration relation of realtime graphic and texture subgraph;
The 3rd, combined with texture subgraph map information storehouse utilizes the registration relation of realtime graphic and texture subgraph, calculates the map information of realtime graphic.
System is according to the map information of realtime graphic, with the realtime graphic Precision Mapping in the scene of three-dimensional model, thereby realize that monitor video is to the Precision Mapping of three-dimensional model.System generates according to the virtual special angle that supervises, height the image that will show again from real-time three-dimensional model.
Claims (2)
1. fixed cameras monitor video and three-dimensional model method for registering under a complex scene is characterized in that comprising the following steps:
(1) build the video surveillance management system, described video monitoring system comprises media management module, video forwarding module, video storage module, resource request module, communication control module, wherein,
Described media management module is the kernel service in AVSS video monitoring system overall plan, can support multistage multiple domain, be used for the central server of managing video monitoring business and control;
Described video forwarding module carries out forwarding, the distribution of real-time audio and video stream;
Described video storage module realizes the stable storage function of multi-channel video, and the historical video frequency searching playback of client support is provided.Satisfied the demand of video mass memory, Concurrency Access in the practical application;
Described resource request module, fulfillment database agency's function for client provides data access service, reduces the security of database number of connection and assurance data access;
Described communication control module is realized parameter and configuration that the codec to different manufacturers manages, the different manufacturers codec device supported and obtained devices from different manufacturers;
(2) set up the three-dimensional stereo model of guarded region, by dimensional Modeling Technology, build the three-dimensional model in the guarded region scope;
(3) camera calibration, calibrating camera relative position and the angle in model realizes camera video and three-dimensional model registration.
2. monitor video and three-dimensional model method for registering under the complex scene shown according to claim 1, is characterized in that, step (3) further comprises the steps:
(31) according to the coverage of monitor video, the texture subgraph that has obvious architectural feature in feature selecting algorithm extraction model texture is arranged, extract and optimize the mapping relations of texture subgraph in model, with subgraph and map information write into Databasce, as the reference point of video accuracy registration, improve the arithmetic speed of fusion process;
(32) use structure invariant features matching algorithm extract the scene structure invariant features and carry out scene matching to pretreated realtime graphic and texture subgraph, set up the registration relation of realtime graphic and texture subgraph;
(33) combined with texture subgraph map information storehouse utilizes the registration relation of realtime graphic and texture subgraph, calculates the map information of realtime graphic.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110385497XA CN103136738A (en) | 2011-11-29 | 2011-11-29 | Registering method of fixing vidicon surveillance video and three-dimensional model in complex scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110385497XA CN103136738A (en) | 2011-11-29 | 2011-11-29 | Registering method of fixing vidicon surveillance video and three-dimensional model in complex scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103136738A true CN103136738A (en) | 2013-06-05 |
Family
ID=48496533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110385497XA Pending CN103136738A (en) | 2011-11-29 | 2011-11-29 | Registering method of fixing vidicon surveillance video and three-dimensional model in complex scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103136738A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400409A (en) * | 2013-08-27 | 2013-11-20 | 华中师范大学 | 3D (three-dimensional) visualization method for coverage range based on quick estimation of attitude of camera |
| CN103716586A (en) * | 2013-12-12 | 2014-04-09 | 中国科学院深圳先进技术研究院 | Monitoring video fusion system and monitoring video fusion method based on three-dimension space scene |
| CN104572653A (en) * | 2013-10-12 | 2015-04-29 | 北京航天长峰科技工业集团有限公司 | Method for quickly constructing topological relation of metro mass video camera |
| CN104683758A (en) * | 2014-12-25 | 2015-06-03 | 合肥寰景信息技术有限公司 | Three-dimensional video monitoring method capable of conveniently obtaining specific positions and surroundings |
| CN104850693A (en) * | 2015-01-19 | 2015-08-19 | 安科智慧城市技术（中国）有限公司 | Monitoring equipment layout method and device |
| CN105118061A (en) * | 2015-08-19 | 2015-12-02 | 刘朔 | Method used for registering video stream into scene in three-dimensional geographic information space |
| CN105516654A (en) * | 2015-11-25 | 2016-04-20 | 华中师范大学 | Scene-structure-analysis-based urban monitoring video fusion method |
| WO2017181699A1 (en) * | 2016-04-21 | 2017-10-26 | 杭州海康威视数字技术股份有限公司 | Method and device for three-dimensional presentation of surveillance video |
| CN107645646A (en) * | 2017-07-07 | 2018-01-30 | 罗普特（厦门）科技集团有限公司 | A kind of regional monitoring system implementation method |
| CN108154553A (en) * | 2018-01-04 | 2018-06-12 | 中测新图(北京)遥感技术有限责任公司 | The seamless integration method and device of a kind of threedimensional model and monitor video |
| CN110660124A (en) * | 2019-08-15 | 2020-01-07 | 广东康云科技有限公司 | Three-dimensional model modeling and editing system and method |
| CN111640181A (en) * | 2020-05-14 | 2020-09-08 | 佳都新太科技股份有限公司 | Interactive video projection method, device, equipment and storage medium |
| CN112261293A (en) * | 2020-10-20 | 2021-01-22 | 华雁智能科技(集团)股份有限公司 | Remote inspection method and device for transformer substation and electronic equipment |
| CN112887633A (en) * | 2021-01-14 | 2021-06-01 | 四川航天神坤科技有限公司 | Video splicing and three-dimensional monitoring display method and system based on camera |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101144716A (en) * | 2007-10-15 | 2008-03-19 | 清华大学 | Multiple angle movement target detection, positioning and aligning method |
| CN101646067A (en) * | 2009-05-26 | 2010-02-10 | 华中师范大学 | Digital full-space intelligent monitoring system and method |
| CN101951502A (en) * | 2010-10-19 | 2011-01-19 | 北京硅盾安全技术有限公司 | Three-dimensional intelligent video monitoring method |
| CN102036054A (en) * | 2010-10-19 | 2011-04-27 | 北京硅盾安全技术有限公司 | Intelligent video monitoring system based on three-dimensional virtual scene |
-
2011
- 2011-11-29 CN CN201110385497XA patent/CN103136738A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101144716A (en) * | 2007-10-15 | 2008-03-19 | 清华大学 | Multiple angle movement target detection, positioning and aligning method |
| CN101646067A (en) * | 2009-05-26 | 2010-02-10 | 华中师范大学 | Digital full-space intelligent monitoring system and method |
| CN101951502A (en) * | 2010-10-19 | 2011-01-19 | 北京硅盾安全技术有限公司 | Three-dimensional intelligent video monitoring method |
| CN102036054A (en) * | 2010-10-19 | 2011-04-27 | 北京硅盾安全技术有限公司 | Intelligent video monitoring system based on three-dimensional virtual scene |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400409A (en) * | 2013-08-27 | 2013-11-20 | 华中师范大学 | 3D (three-dimensional) visualization method for coverage range based on quick estimation of attitude of camera |
| CN103400409B (en) * | 2013-08-27 | 2016-08-10 | 华中师范大学 | A kind of coverage 3D method for visualizing based on photographic head attitude Fast estimation |
| CN104572653A (en) * | 2013-10-12 | 2015-04-29 | 北京航天长峰科技工业集团有限公司 | Method for quickly constructing topological relation of metro mass video camera |
| CN103716586A (en) * | 2013-12-12 | 2014-04-09 | 中国科学院深圳先进技术研究院 | Monitoring video fusion system and monitoring video fusion method based on three-dimension space scene |
| CN104683758A (en) * | 2014-12-25 | 2015-06-03 | 合肥寰景信息技术有限公司 | Three-dimensional video monitoring method capable of conveniently obtaining specific positions and surroundings |
| CN104850693B (en) * | 2015-01-19 | 2018-02-16 | 深圳市顺恒利科技工程有限公司 | A kind of monitoring device layout method and device |
| CN104850693A (en) * | 2015-01-19 | 2015-08-19 | 安科智慧城市技术（中国）有限公司 | Monitoring equipment layout method and device |
| CN105118061A (en) * | 2015-08-19 | 2015-12-02 | 刘朔 | Method used for registering video stream into scene in three-dimensional geographic information space |
| CN105516654B (en) * | 2015-11-25 | 2018-10-26 | 华中师范大学 | A kind of supervision of the cities video fusion method based on scene structure analysis |
| CN105516654A (en) * | 2015-11-25 | 2016-04-20 | 华中师范大学 | Scene-structure-analysis-based urban monitoring video fusion method |
| WO2017181699A1 (en) * | 2016-04-21 | 2017-10-26 | 杭州海康威视数字技术股份有限公司 | Method and device for three-dimensional presentation of surveillance video |
| CN107645646A (en) * | 2017-07-07 | 2018-01-30 | 罗普特（厦门）科技集团有限公司 | A kind of regional monitoring system implementation method |
| CN108154553A (en) * | 2018-01-04 | 2018-06-12 | 中测新图(北京)遥感技术有限责任公司 | The seamless integration method and device of a kind of threedimensional model and monitor video |
| CN110660124A (en) * | 2019-08-15 | 2020-01-07 | 广东康云科技有限公司 | Three-dimensional model modeling and editing system and method |
| CN111640181A (en) * | 2020-05-14 | 2020-09-08 | 佳都新太科技股份有限公司 | Interactive video projection method, device, equipment and storage medium |
| CN112261293A (en) * | 2020-10-20 | 2021-01-22 | 华雁智能科技(集团)股份有限公司 | Remote inspection method and device for transformer substation and electronic equipment |
| CN112887633A (en) * | 2021-01-14 | 2021-06-01 | 四川航天神坤科技有限公司 | Video splicing and three-dimensional monitoring display method and system based on camera |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103136738A (en) | Registering method of fixing vidicon surveillance video and three-dimensional model in complex scene | |
| CN108022176B (en) | Intelligent garden management system and method | |
| CN102036054B (en) | Intelligent video monitoring system based on three-dimensional virtual scene | |
| CN112115198A (en) | Urban remote sensing intelligent service platform | |
| US11334756B2 (en) | Homography through satellite image matching | |
| CN107516282A (en) | Three look into the Land Change Survey information management system of unification | |
| CN105025255B (en) | A kind of city management processing system for video and method of work | |
| CN103136739B (en) | Controlled camera supervised video and three-dimensional model method for registering under a kind of complex scene | |
| CN103414870B (en) | A kind of multi-mode warning analytical method | |
| CN108306756A (en) | One kind being based on electric power data network holography assessment system and its Fault Locating Method | |
| CN103686065A (en) | Cloud mirror cluster control method and device of monitoring equipment based on GIS (geographic information system) interoperability | |
| CN103259872A (en) | Multi-source heterogeneous geographic information service platform based on open-type grid system | |
| CN110362895B (en) | Land acquisition removal application management system based on BIM + GIS technology | |
| CN110188989A (en) | One kind being based on three-dimensional visualization outdoor scene wisdom municipal administration system | |
| CN104361586A (en) | Electric pole and tower maintenance and pre-warning system based on panoramas | |
| CN105447923A (en) | Electric power circuit routing inspection system | |
| CN106412526A (en) | Police oblique-photography real 3D platform system and interface system thereof | |
| CN110322326A (en) | A kind of economic big data sharing method of geography based on ArgGis | |
| CN104240020A (en) | Three-dimensional civil defense geographic information service system | |
| CN108492711A (en) | A kind of drawing electronic map method and device | |
| CN113347360A (en) | Construction management system and method based on 5G video and BIM | |
| KR20130082530A (en) | Augmented reality service providing apparatus, method and system for linking to social network service | |
| CN113704567A (en) | Internet of things data management method and device, Internet of things data resource pool and equipment | |
| CN113627005B (en) | Intelligent vision monitoring method | |
| CN109377197A (en) | A kind of managing numeralization city data-sharing systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130605 |