CN102932638B - 3D video monitoring method based on computer modeling - Google Patents

3D video monitoring method based on computer modeling Download PDF

Info

Publication number
CN102932638B
CN102932638B CN201210498715.5A CN201210498715A CN102932638B CN 102932638 B CN102932638 B CN 102932638B CN 201210498715 A CN201210498715 A CN 201210498715A CN 102932638 B CN102932638 B CN 102932638B
Authority
CN
China
Prior art keywords
subsystem
image
modeling
field picture
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201210498715.5A
Other languages
Chinese (zh)
Other versions
CN102932638A (en
Inventor
田学东
刘哲
李秀云
梁浚
郭中豪
杨子鹏
孙裕昌
邢文武
王兴楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Zhonghuan System Construction Co ltd
Original Assignee
Tianjin Institute Of Tv Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Institute Of Tv Technology filed Critical Tianjin Institute Of Tv Technology
Priority to CN201210498715.5A priority Critical patent/CN102932638B/en
Publication of CN102932638A publication Critical patent/CN102932638A/en
Application granted granted Critical
Publication of CN102932638B publication Critical patent/CN102932638B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)

Abstract

The invention relates to a 3D (Three Dimensional) video monitoring method based on computer modeling. A hardware used in the method comprises a front-end image acquisition system and a transmission system. The method is characterized in that a monitoring camera is used for acquiring video image information; a computer is used as a processing platform so as to finish the conversion from images to a 3D model, and the 3D modeling, and update the content of the 3D modeling according to real-time video image information acquired by the camera; and simultaneously, the virtual monitoring is executed on a model by a simulated camera in the computer. The method has the beneficial effects of being capable of carrying out the 3D modeling by the computer, modeling historical records according to normal recorded videos, realizing the simulation on monitoring regions by combining with a digital sand table, finishing the bake simulation on complex environments with a small number of acquisition front ends, and being applied to detection in the complex environments.

Description

3D video frequency monitoring method based on microcomputer modelling
Technical field
The present invention relates to technical field of video monitoring, particularly a kind of 3D video frequency monitoring method based on microcomputer modelling.
Background technology
Supervisory control system is comprised of front-end collection system, transmission system and display system, take remote watching surveillance area real time status and carry out the weak electricity system that playing back videos is major function.The at present demonstration in supervisory control system on the market all adopts 2 dimension images to show, have and cannot adapt to closely monitoring under hot conditions, cannot many weak points such as monitor in the monitoring angle that does not possess mounting condition, along with the development of China's Video Supervision Technique, need a kind of new technical scheme to make up the deficiencies in the prior art.
Summary of the invention
Object of the present invention is exactly the deficiency for said method, a kind of 3D video frequency monitoring method based on microcomputer modelling is proposed, by monitoring camera, gather video image information, by the computer conversion to 3D model by image of finishing dealing with, in computer, complete 3D modeling, and according to the situation of the real time video image information real-time update 3D model of camera acquisition, as information such as running orbit, color change, body shape changes.By the video camera simulateding in computer, model is carried out to virtual monitoring mode simultaneously.
We just can realize and spatially simulate a video camera like this, on the basis of computer process ability at a high speed, finally can obtain close to real 3D model, realize 3D monitoring.
The technical scheme that equipment in the present invention adopts is: a kind of 3D video frequency monitoring method based on microcomputer modelling, the hardware of its utilization comprises front end image capturing system, transmission system, it is characterized in that, by CCTV camera, gather video image information, take computer as processing platform, by computer conversion and the 3D modeling to 3D model by image of finishing dealing with, according to the content of the real time video image information real-time update 3D model of camera acquisition, comprise running orbit, color change, body shape changes information, by analog video camera in computer, model is carried out to virtual monitor simultaneously, described method comprises following order step:
(1) set up front end image capturing system, front end image capturing system and transmission system comprise CCTV camera, The Cloud Terrace, monitor network;
(2) in computer, set up image distance treatment system, image distance treatment system is extracted subsystem, two field picture contrast subsystem, data operation processing subsystem and data-interface subsystem by two field picture and is formed, realize to different front-end collections to image carry out distance operation;
Two field picture extraction system is carried out frame extraction by the image that the same time point of different acquisition front end gathering for same object or environment is collected, and the frame information extracting is offered to two field picture contrast subsystem;
Two field picture contrast subsystem mainly contrasts two field picture and extracts the frame of data information that subsystem provides, and to proofread the image information collecting, whether belongs to difference between the information that same object or environment and contrast different acquisition front-end collection arrive;
Two field picture contrast subsystem confirm different acquisition front-end collection to image information belong to same object or environment after, data operation processsubsystem carries out calculation process by gathering range information between front end and same object or environment by the image information of different acquisition front-end collection, obtains the 3D that needs in order to the range information between the polygon of expressing object and collection front end;
Data-interface subsystem completes data and is exported to the data of 3D modeling by image distance treatment system;
Image distance treatment system is carried out polygonal patch processing to the image collecting, and calculates the vertex distance information of each polygonal patch, and the data of computing are sent to 3D modeling, adopts " polarisation principle " computing;
The different image information that different collection front ends is collected is carried out operational analysis, obtain color, tone, gray scale and saturation infromation that range information between image information point and different collection front end and each gather the image that front-end collection arrives, send information data to 3D modeling;
(3) in computer, set up picture displacement treatment system: picture displacement treatment system is extracted subsystem, two field picture displacement comparison subsystem and running orbit analyzing and processing subsystem by two field picture and formed, realize the computing of moving target running orbit and processing;
The two field picture here extracts subsystem and image distance processing subsystem init is different that two field picture extracts subsystem, the two field picture that it mainly extracts, and two field picture refers to that same collection front end extracts on different time axle herein;
Two field picture displacement comparison subsystem extracts according to two field picture the frame information that subsystem provides, and draws the displacement on each summit of polygon that represents object by processing computing;
Running orbit analyzing and processing subsystem generates the polygonal running orbit of 3D modeling sign object, and the form in conjunction with 3D model with animation displays;
(4) in computer, set up 3D modeling, 3D modeling generates subsystem by modeling subsystem, color and analog video camera generation subsystem forms; The monitored picture of exporting to simulate generating virtual video camera by the image that in computer, model is carried out to different angles, reaches the process of model being carried out to multi-faceted demonstration;
(5) running orbit on the polygonal timeline that each position of model that the 3D model of being set up by 3D modeling and picture displacement treatment system calculate represents carries out in conjunction with the animation form that generates 3D model, to realize simulated monitoring system.
The invention has the beneficial effects as follows: the 3D video frequency monitoring method based on microcomputer modelling, with traditional monitoring mode operation, scene is monitored in real time, scene is carried out to the video recording of traditional monitoring mode, the function such as search and return, by computer 3D modeling, can carry out 3D modeling to the region of real-time monitoring, can to historical record, carry out modeling according to common video recording, being used in conjunction with digital sand table, can to realize guarded region simulated, complete the analoging reproduction to complex environment with less collection front end, the present invention should be in the detection of complex environment, as the hydrology detects, underground mine modeling, high sensitivity and the real-time status of things of reducing accurately, realize dynamic data processing, the dynamic threshold values of selecting carries out region duplication, Production Regional that can extensive use industrial enterprise, high-temperature area that particularly cannot be approaching personnel, this technology of employing preferably is monitored, the present invention also can be applicable to complete set video conference, in the world, accomplish Anywhere real aspectant discussion.
Accompanying drawing explanation
Fig. 1 is the 3D supervisory control system frame diagram based on microcomputer modelling;
Fig. 2 is human eye polarisation principle schematic.
Embodiment
Below in conjunction with drawings and Examples, the present invention is further described.
As shown in Figure 1 and Figure 2, a kind of 3D video frequency monitoring method based on microcomputer modelling, the hardware adopting comprises front end image capturing system, transmission system, by monitoring camera, gather video image information, take computer as processing platform, by computer conversion and the 3D modeling to 3D model by image of finishing dealing with, according to the content of the real time video image information real-time update 3D model of camera acquisition, comprise running orbit, color change, body shape changes information, by computer software, simulate video camera simultaneously model is carried out to virtual monitoring
Embodiment mono-:
1, set up front end image capturing system, front end image capturing system and transmission system comprise video camera, The Cloud Terrace, monitor network;
2, in computer, set up image distance treatment system: image distance treatment system is extracted subsystem, two field picture contrast subsystem, data operation processing subsystem and data-interface subsystem by two field picture and formed, realize to front-end collection to image carry out distance operation;
The processing procedure of image distance treatment system: by different acquisition front end is carried out the distance operation between monitoring object or environment and collection point for the processing of the collection image information of same object or environment, with the method for expressing of 3D model, approximate representation is carried out to by polygonal patch in its surface of object with complex appearance;
To collecting to such an extent that image carries out polygonal patch processing, calculate the vertex distance information of each polygonal patch, the data of computing are sent to 3D modeling, adopt " polarisation principle " computing;
Just as we vision with can differentiate far and near, gather front end just as people's eyes, by the range difference between different collection front ends, the different image information that different collection front ends is collected is carried out operational analysis, obtain color, tone, gray scale and saturation infromation that range information between image information point and different collection front end and each gather the image that front-end collection arrives, send information data to 3D modeling;
As shown in Figure 2, take our human eye is that example is set forth polarisation principle: establish blinkpunkt as M, its conformation at two eyes retina centers is respectively m1 and m2.When watching M point attentively, other object point A, B also can be on retina conformation, be respectively al, b1 and a2, b2, the corresponding picture point in left and right is divided horizontal arc length poor that is clipped to corresponding foveal region of retina, is called physiology parallax.
Conformation m1, the m2 of with M, ordering are as the criterion, picture point its left side for just, otherwise for bearing.The physiology parallax of 2 of A, B is so: A=m1a1-m2a2 < 0, B=m1b1-m2b2 > 0.Obviously, the physiology parallax that M is ordered is zero.As can be seen here, when object point is far away than blinkpunkt, its physiology parallax is less than zero, otherwise is greater than zero.This due to the far and near formed biological parallax of object point, through the processing of brain, just produce the far and near different stereo perception of space object.
3, in computer, set up picture displacement treatment system: picture displacement treatment system is extracted subsystem, two field picture displacement comparison subsystem and running orbit analyzing and processing subsystem by two field picture and formed, and mainly realizes the computing of moving target running orbit and processing;
Picture displacement treatment system processing procedure: the information same object or environment being collected in different time sections by the collection front end to identical processes to calculate object or the displacement of environment on time shaft;
After each object is established in its local coordinate system, just need to be placed among the scene that will draw, each object that forms scene has oneself independently local coordinate system;
The coordinate system of whole scene adopts world coordinate system, and all objects in scene all must transform in world coordinate system to define the space relativeness between object in scene from the local coordinate system of oneself;
If an object moves in scene, be necessary for time dependent transform sequence of this object definitions to this object is transformed to the diverse location in world coordinate system at each frame.
Picture displacement treatment system by object or environment the variation on coordinate system the running orbit of object or environment is carried out to analytic operation.
The data message that receives image distance treatment system carries out NURBS modeling generation and color generation processing to object or environment, due to what receive, it is the vertex information of the polygonal dough sheet of 3D method for expressing, so memory space and operand have all reduced greatly, adopting local coordinate system, world coordinate system or camera coordinates is to set up the simulation 3D scene of real world.
Simultaneously can be to realizing the sense of reality effects such as texture mapping, transparent and atomization (atmospheric effect) color processing stage.The definition of article surface vein is carried out in world coordinate system, and by preliminary treatment, each has set up the mapping relations with respective texture figure in its vertex data with veined polygon.When veined polygon is with in drafting, its corresponding texture maps is also loaded in texture storage device simultaneously, and on obtaining object, in pixel coordinates, its corresponding texture coordinate is also calculated.With this texture coordinate, from texture storage device, read the value of respective texture pixel, the result that it is processed with light and shade is mixed and is just obtained the pixel value that will show.Atomization (atmospheric effect) is in the pixel value calculating, to be multiplied by a decay factor relevant with the degree of depth.
To dropping on the pixel value of the picture element of same screen position, by the coefficient of transparency of object under it, be weighted to merge and just can produce transparent effect.Obtain gathering after the 3D model at front end scene, we can carry out image sampling processing to model by setting up virtual video camera model being arbitrarily angled again.
4, in computer, set up 3D modeling, 3D modeling comprises that modeling subsystem, color generate subsystem and analog video camera generates subsystem composition; By 3D modeling subsystem and the computing of picture displacement subsystem, generate simulated monitoring system.
3D supervisory control system based on microcomputer modelling can extensive use industrial enterprise Production Regional, as personnel cannot be approaching high-temperature area, can adopt this technology to monitor.Also can be applicable to complete set video conference, what let us can be in the world accomplishes real aspectant discussion Anywhere.
First 3D supervisory control system based on microcomputer modelling needs modeling could realize monitoring; on the basis of modeling, we will be very broad at adaptable orientation; no matter from military affairs or scientific investigation aspect, can obtain by modeling the information of the aspects such as the body situations such as our required landform, Architectural Equipment and variation thereof.We can adopt the collection front end of non-image form equally, such as the sonar of sea-bottom survey, the ray of industrial flaw detection and X-ray etc. as front end to realize our Real-time modeling set to the mapping such as sea bed, industrial products and inner modeling and organization of human body etc.
According to the above description, in conjunction with art technology, can realize the solution of the present invention.

Claims (1)

1. the 3D video frequency monitoring method based on microcomputer modelling, the hardware of its utilization comprises front end image capturing system, transmission system, it is characterized in that, by CCTV camera, gather video image information, take computer as processing platform, by computer conversion and the 3D modeling to 3D model by image of finishing dealing with, according to the content of the real time video image information real-time update 3D model of camera acquisition, comprise running orbit, color change, body shape changes information, by analog video camera in computer, model is carried out to virtual monitor simultaneously; Described method comprises following order step:
(1) set up front end image capturing system, front end image capturing system and transmission system comprise CCTV camera, The Cloud Terrace, monitor network;
(2) in computer, set up image distance treatment system, image distance treatment system is extracted subsystem, two field picture contrast subsystem, data operation processing subsystem and data-interface subsystem by two field picture and is formed, realize to different front-end collections to image carry out distance operation;
Two field picture extracts subsystem and carries out frame extraction by the image that the same time point of different acquisition front end gathering for same object or environment is collected, and the frame information extracting is offered to two field picture contrast subsystem;
Two field picture contrast subsystem mainly contrasts two field picture and extracts the frame of data information that subsystem provides, and to proofread the image information collecting, whether belongs to difference between the information that same object or environment and contrast different acquisition front-end collection arrive;
Two field picture contrast subsystem confirm different acquisition front-end collection to image information belong to same object or environment after, data operation processsubsystem carries out calculation process by gathering range information between front end and same object or environment by the image information of different acquisition front-end collection, obtains the 3D that needs in order to the range information between the polygon of expressing object and collection front end;
Data-interface subsystem completes data and is exported to the data of 3D modeling by image distance treatment system;
Image distance treatment system is carried out polygonal patch processing to the image collecting, and calculates the vertex distance information of each polygonal patch, and the data of computing are sent to 3D modeling, adopts " polarisation principle " computing;
The different image information that different collection front ends is collected is carried out operational analysis, obtain color, tone, gray scale and saturation infromation that range information between image information point and different collection front end and each gather the image that front-end collection arrives, send information data to 3D modeling;
(3) in computer, set up picture displacement treatment system: picture displacement treatment system is extracted subsystem, two field picture displacement comparison subsystem and running orbit analyzing and processing subsystem by two field picture and formed, realize the computing of moving target running orbit and processing;
The two field picture here extracts subsystem and image distance processing subsystem init is different that two field picture extracts subsystem, the two field picture that it mainly extracts, two field picture refers to that same collection front end extracts on different time axle herein, two field picture displacement comparison subsystem extracts according to two field picture the frame information that subsystem provides, and draws the displacement on each summit of polygon that represents object by processing computing; Running orbit analyzing and processing subsystem generates the polygonal running orbit of 3D modeling sign object, and the form in conjunction with 3D model with animation displays;
(4) in computer, set up 3D modeling, 3D modeling generates subsystem by modeling subsystem, color and analog video camera generation subsystem forms; The monitored picture of exporting to simulate generating virtual video camera by the image that in computer, model is carried out to different angles, reaches the process of model being carried out to multi-faceted demonstration;
(5) running orbit on the polygonal timeline that each position of model that the 3D model of being set up by 3D modeling and picture displacement treatment system calculate represents carries out in conjunction with the animation form that generates 3D model, to realize simulated monitoring system.
CN201210498715.5A 2012-11-30 2012-11-30 3D video monitoring method based on computer modeling Expired - Fee Related CN102932638B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210498715.5A CN102932638B (en) 2012-11-30 2012-11-30 3D video monitoring method based on computer modeling

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210498715.5A CN102932638B (en) 2012-11-30 2012-11-30 3D video monitoring method based on computer modeling

Publications (2)

Publication Number Publication Date
CN102932638A CN102932638A (en) 2013-02-13
CN102932638B true CN102932638B (en) 2014-12-10

Family

ID=47647323

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210498715.5A Expired - Fee Related CN102932638B (en) 2012-11-30 2012-11-30 3D video monitoring method based on computer modeling

Country Status (1)

Country Link
CN (1) CN102932638B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106162144A (en) * 2016-07-21 2016-11-23 触景无限科技(北京)有限公司 A kind of visual pattern processing equipment, system and intelligent machine for overnight sight
CN106373173A (en) * 2016-08-31 2017-02-01 北京首钢自动化信息技术有限公司 Monitoring method and monitoring system
CN107901424A (en) * 2017-12-15 2018-04-13 北京中睿华信信息技术有限公司 A kind of Image Acquisition modeling
CN108881842A (en) * 2018-07-05 2018-11-23 盎锐(上海)信息科技有限公司 Monitoring system and information processing method based on 3D video camera
CN108810517A (en) * 2018-07-05 2018-11-13 盎锐(上海)信息科技有限公司 Image processor with monitoring function and method
CN108848366B (en) * 2018-07-05 2020-12-18 盎锐(上海)信息科技有限公司 Information acquisition device and method based on 3D camera
CN110675517A (en) * 2019-09-20 2020-01-10 青岛海信商用显示股份有限公司 Express item detection method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101208723A (en) * 2005-02-23 2008-06-25 克雷格·萨默斯 Automatic scene modeling for the 3D camera and 3D video
CN101419499A (en) * 2008-11-14 2009-04-29 东南大学 Multimedia human-computer interaction method based on cam and mike
CN101951502A (en) * 2010-10-19 2011-01-19 北京硅盾安全技术有限公司 Three-dimensional intelligent video monitoring method
JP4710081B2 (en) * 2004-11-24 2011-06-29 株式会社国際電気通信基礎技術研究所 Image creating system and image creating method
CN102608920A (en) * 2012-03-15 2012-07-25 中国计量学院 Method for monitoring bridge inspection van through three-dimensional (3D) simulation on basis of Android system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4710081B2 (en) * 2004-11-24 2011-06-29 株式会社国際電気通信基礎技術研究所 Image creating system and image creating method
CN101208723A (en) * 2005-02-23 2008-06-25 克雷格·萨默斯 Automatic scene modeling for the 3D camera and 3D video
CN101419499A (en) * 2008-11-14 2009-04-29 东南大学 Multimedia human-computer interaction method based on cam and mike
CN101951502A (en) * 2010-10-19 2011-01-19 北京硅盾安全技术有限公司 Three-dimensional intelligent video monitoring method
CN102608920A (en) * 2012-03-15 2012-07-25 中国计量学院 Method for monitoring bridge inspection van through three-dimensional (3D) simulation on basis of Android system

Also Published As

Publication number Publication date
CN102932638A (en) 2013-02-13

Similar Documents

Publication Publication Date Title
CN102932638B (en) 3D video monitoring method based on computer modeling
CN105335696B (en) A kind of intelligence based on the identification of 3D abnormal gaits behavioral value is helped the elderly robot and implementation method
CN110874864B (en) Method, device, electronic equipment and system for obtaining three-dimensional model of object
CN106803267B (en) Kinect-based indoor scene three-dimensional reconstruction method
EP3550516B1 (en) Environmental parameter based selection of a data model for recognizing an object of a real environment
CN110458897B (en) Multi-camera automatic calibration method and system and monitoring method and system
Kropatsch et al. Digital image analysis: selected techniques and applications
WO2019140945A1 (en) Mixed reality method applied to flight simulator
CN103268629B (en) Unmarked some real time restoration method of 3 D human body form and attitude
EP1946567A2 (en) Device for generating three dimensional surface models of moving objects
CN103260015A (en) Three-dimensional visual monitoring system based on RGB-Depth camera
Jia et al. 3D image reconstruction and human body tracking using stereo vision and Kinect technology
CN106066701A (en) A kind of AR and VR data handling equipment and method
CN103354616A (en) Method and system for realizing three-dimensional display on two-dimensional display
CN109035307B (en) Set area target tracking method and system based on natural light binocular vision
Lan et al. Development of a virtual reality teleconference system using distributed depth sensors
CN104732586B (en) A kind of dynamic body of 3 D human body and three-dimensional motion light stream fast reconstructing method
Yu et al. Intelligent visual-IoT-enabled real-time 3D visualization for autonomous crowd management
CN105959667A (en) Three-dimensional image collection device and system
CN114863061A (en) Three-dimensional reconstruction method and system for remote monitoring medical image processing
CN112102504A (en) Three-dimensional scene and two-dimensional image mixing method based on mixed reality
CN116029919A (en) Intelligent optimization method for compressed three-dimensional light field display
CN110033521B (en) Three-dimensional visualization system based on VR and AR technologies
CN115048954A (en) Retina-imitating target detection method and device, storage medium and terminal
CN111383340B (en) Background filtering method, device and system based on 3D image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20151224

Address after: 300060 Tianjin city Hexi District North Lake Road No. 9

Patentee after: TIANJIN ZHONGHUAN SYSTEM CONSTRUCTION CO.,LTD.

Address before: 300010 No. 56, progressive Road, Tianjin, Hebei District

Patentee before: Tianjin TV Technology Institute

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20141210