CN101931790A - Method and system for three-dimensional video monitor - Google Patents

Method and system for three-dimensional video monitor Download PDF

Info

Publication number
CN101931790A
CN101931790A CN2009100874993A CN200910087499A CN101931790A CN 101931790 A CN101931790 A CN 101931790A CN 2009100874993 A CN2009100874993 A CN 2009100874993A CN 200910087499 A CN200910087499 A CN 200910087499A CN 101931790 A CN101931790 A CN 101931790A
Authority
CN
China
Prior art keywords
dimensional
camera head
virtual scene
dimensional video
video image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2009100874993A
Other languages
Chinese (zh)
Inventor
王安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Changfeng Science Technology Industry Group Corp
Original Assignee
China Changfeng Science Technology Industry Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Changfeng Science Technology Industry Group Corp filed Critical China Changfeng Science Technology Industry Group Corp
Priority to CN2009100874993A priority Critical patent/CN101931790A/en
Publication of CN101931790A publication Critical patent/CN101931790A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention relates to a method for three-dimensional video monitor, comprising the steps of: establishing a three-dimensional digitalized virtual system of a monitored location; adding a virtual image pickup device at an approximate position corresponding to a three-dimensional virtual scene according to the position of an actual image pickup collection device; selecting a matched characteristic point from two-dimensional video images acquired by the actual image pickup device; and according to a mapping point, corresponding to the matched characteristic point, in the three-dimensional virtual scene, obtaining the accurate position and the posture of the virtual image pickup device based on matching algorithm, and integrating the two-dimensional video images acquired by the image pickup device into the three-dimensional model scene. The invention further provides a system for three-dimensional video monitor. According to the invention in which the three-dimensional video monitor is realized, users can clearly know the spatial position of various image pickup devices in the entire monitored location through the integrated three-dimensional virtual scene, and upon the appearance of a suspicious object in the video, users can conveniently and rapidly determine the spatial position where the suspicious object appears, thus the suspicious object can be timely disposed of by users.

Description

A kind of three-dimensional video monitor method and system
Technical field
The present invention relates to the security system field, particularly relate to a kind of three-dimensional video monitor method and system.
Background technology
Current supervisory control system adopts the two dimensional surface monitoring more, independently shows by the video signal of monitor with each camera head collection.This monitor mode exists a lot of deficiencies, and for example intuitive is strong, globality and interactivity deficiency or the like.For such as places such as airport, production base or other main facilitieses, because the similitude of building interior diverse location is very big, monitor under the similar situation of place background at two, be difficult to analyze at once the place of monitoring; The two dimensional surface supervisory control system independently shows separately makes it lack interactivity, and video image can only directly be exported by monitor, lacks editting function, can not carry out the function expansion; Camera head quantity too much causes locating rapidly etc.Above problem shows, supervisory control system should towards intelligent, interactivity is strong, three-dimensional, the functional expansionary direction develops.
Referring to Fig. 1, the existing two-dimensional video monitoring mode is shown, the image of a plurality of camera head collections is concentrated on the display screen and shows, observes the each several part of monitored site by the two-dimensional video image that shows on the display screen.But the often many places internal structure of many monitored sites is very approximate, when suspicious object appears in video image, the user only is difficult to which part that direct judgement suspicious object specifically is positioned at the monitored site with two-dimensional video image, influences user accurately judgement and timely disposal.
Therefore, the existing two-dimensional video monitoring mode exists three-dimensional not strong, is unfavorable for that the particular location of suspicious object appears in user's Direct observation, influences drawbacks such as user's disposal in time.
Summary of the invention
Technical problem to be solved by this invention provides a kind of three-dimensional video monitor method, and this method has three-dimensional advantage such as strong, is beneficial to the particular location that suspicious object appears in user's Direct observation, makes things convenient for the user in time to dispose.
Another object of the present invention provides a kind of three-dimensional video monitor system, and this system has three-dimensional advantage such as strong, is beneficial to the particular location that suspicious object appears in user's Direct observation, makes things convenient for the user in time to dispose.
The present invention discloses a kind of three-dimensional video monitor method, it is characterized in that, comprise: the three-dimensional virtual scene of simulation monitored site is set,, adds virtual camera head at the correspondence position of three-dimensional virtual scene according to the physical location of camera head in the monitored site; From the two-dimensional video image that described camera head obtains, choose the matching characteristic point,, obtain the exact position and the attitude of described virtual camera head according to matching algorithm according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene; The two-dimensional video image that described camera head is obtained is incorporated in the described three-dimensional virtual scene.
Preferably, also comprise: select an anchor point, based on this anchor point the three-dimensional virtual scene after integrating is carried out the part and amplify monitoring and/or adjust the video angle monitoring.
Preferably, also comprise: each described virtual camera head is numbered, shows the monitoring range of each described virtual camera head correspondence in three-dimensional virtual scene by number order successively.
Preferably, also comprise: analyze described two-dimensional video image, when producing alert, the monitoring range of Softcam in the three-dimensional virtual scene of the two-dimensional video image correspondence of demonstration generation alert.
Preferably, also comprise: analyze described two-dimensional video image, lock suspicious object in the described two-dimensional video image, along with the monitoring range in the mobile switching three-dimensional virtual scene of suspicious object.
Preferably, also comprise: the time period is set, deposits storage device in after 3 D video information is cut apart on a time period.
The present invention also discloses a kind of three-dimensional video monitor system, comprise that three-dimensional virtual scene sets up module, virtual camera head to add module, virtual camera head position and attitude adjusting module, and two-dimensional video image integrate module: described three-dimensional virtual scene is set up module, is used to be provided with the three-dimensional virtual scene of simulation monitored site; Described virtual camera head adds module, is used for according to the physical location of camera head in the monitored site, adds virtual camera head at the correspondence position of three-dimensional virtual scene; Described virtual camera head position and attitude adjusting module, be used for choosing the matching characteristic point from the two-dimensional video image that described camera head obtains, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm; Described two-dimensional video image integrate module is used for the two-dimensional video image that described camera head obtains is incorporated into described three-dimensional virtual scene.
Preferably, also comprise: amplify rotary module, be used to select an anchor point, based on this anchor point the three-dimensional virtual scene after integrating is carried out the part and amplify monitoring and/or adjust the video angle monitoring.
Preferably, also comprise: the poll module, be used for each described virtual camera head is numbered, show the monitoring range in the three-dimensional virtual scene of each described virtual camera head correspondence successively by number order.
Preferably, also comprise: locking module, be used to analyze described two-dimensional video image, lock suspicious object in the described two-dimensional video image, along with the monitoring range in the mobile switching three-dimensional virtual scene of suspicious object.
Compared with prior art, the present invention has the following advantages:
The present invention realizes three-dimensional video monitor, by the three-dimensional virtual scene after integrating, the user can know and recognizes the locus of each camera head in whole monitored site, when suspicious object occurring in the video, make things convenient for the user to determine to occur the locus of suspicious object rapidly, be convenient to the user and just can in time dispose.
Description of drawings
Fig. 1 is an existing two-dimensional video monitoring mode schematic diagram;
Fig. 2 is the three-dimensional video monitor method first embodiment flow chart of the present invention;
Fig. 3 is the three-dimensional video monitor method second embodiment flow chart of the present invention;
Fig. 4 is three-dimensional video monitor method the 3rd an embodiment flow chart of the present invention;
Fig. 5 is three-dimensional video monitor method the 4th an embodiment flow chart of the present invention;
Fig. 6 is three-dimensional video monitor method the 5th an embodiment flow chart of the present invention;
Fig. 7 is three-dimensional video monitor method the 6th an embodiment flow chart of the present invention;
Fig. 8 is the three-dimensional video monitor of the present invention system first embodiment schematic diagram;
Fig. 9 is the three-dimensional video monitor of the present invention system second embodiment schematic diagram.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the present invention is further detailed explanation below in conjunction with the drawings and specific embodiments.
The present invention is provided with the three-dimensional digital virtual system of simulation monitored site earlier, can the stereo display monitored site, the physical location of camera head in the corresponding monitored site, virtual camera head is added in position approximate in three-dimensional virtual scene, position and attitude according to the Feature Points Matching algorithm is adjusted, proofreaied and correct virtual camera head make the virtual monitor scope of virtual camera head consistent with the monitoring range in the monitored site.The two-dimensional video image real-time integration that each camera head is obtained is in three-dimensional virtual scene again.Like this, the user just can be by monitoring three-dimensional virtual scene system, and stereovision is known the particular location of each camera head monitoring range in whole monitored site to whole monitored site, is convenient to the user and accurately locatees monitoring accident, in time disposes.
Referring to Fig. 2, three-dimensional video monitor method first embodiment of the present invention is shown, concrete steps are as described below.
Step S201, be provided with the simulation monitored site three-dimensional virtual scene.According to size, the shape of monitored site, draw a certain proportion of threedimensional model.And, the transparency of three-dimensional virtual scene each several part is set rationally according to actual monitored position, monitored site, the actual monitored position of monitored site can both be known in three-dimensional virtual scene present.For example, the monitored site is a building, and actual monitored position is each door in the building, and this three-dimensional virtual scene then need be known and presents each door in the building; Again for example, the monitored site is the stadium, and actual monitored position is each passage, competition area and the auditorium in the stadium, and this three-dimensional virtual scene then need be known and presents each passage, competition area and auditorium.
Step S202, according to the physical location of camera head in the monitored site, add virtual camera head at the apparent position of the correspondence of three-dimensional virtual scene.Position and the position on the three-dimensional virtual scene on the monitored site are one to one, according to the actual installation position of each camera head on the monitored site, correspondence position at three-dimensional virtual scene adds each virtual camera head, just can know the distribution situation of recognizing each camera head by three-dimensional virtual scene.
When the position of camera head in the monitored site changes, lay down as split, or change the position, or newly add camera head, all can in three-dimensional virtual scene, operate accordingly.The split camera head of laying down can be deleted the corresponding virtual camera head at three-dimensional virtual scene; Change the camera head of position, can the corresponding virtual camera head be changed to reposition at three-dimensional virtual scene; The camera head that newly adds can add virtual camera head by correspondence position in three-dimensional virtual scene.By virtual camera head is set flexibly, can allow three-dimensional virtual scene better corresponding with actual monitored site.
Step S203, from the two-dimensional video image that camera head obtains, choose the matching characteristic point,, calculate, adjust the position and the angle of virtual camera head according to matching algorithm according to the mapping point of described matching characteristic point in described three-dimensional virtual scene.What camera head was gathered in the monitored site is two-dimensional video image, in this two-dimensional video image, choose some matching characteristic points, such as the boundary point in the two-dimensional video image, central point, anchor point etc., in described three-dimensional virtual scene, find the mapping point (apparent position and attitude) of this matching characteristic point, calculate the accurate position and the angle of virtual camera head according to these mapping points, and adjust the arrangement of virtual camera head thus.The external parameter of virtual camera head comprises three location parameters and three angle parameters.
Camera calibration is exactly the inside and outside parameter of calibrating camera.
Inner parameter: 1. principal point [u 0, v 0], the crosspoint of the optical axis and the plane of delineation; 2. scale factor [d x, d y], relevant with the size of pixel x and y; 3. be out of shape factor τ 1, relevant with the horizontal vertical ratio of camera review; 4. focal distance f, photocentre is to the distance of the plane of delineation.
External parameter is to describe position and the anglec of rotation of video camera in three dimensions.Be exactly position and the anglec of rotation of Softcam in threedimensional model: 1. translation vector: [t x, t y, t z] T2. spin matrix:
r 11 r 12 r 13 0 r 21 r 22 r 23 0 r 31 r 32 r 33 0 0 0 0 1
For spin matrix, must satisfy the unit orthogonal matrix, equivalence and three-dimensional vector also are that the anglec of rotation has only three thus.
If vectorial b=[u 1, u 2..., u n] comprised the image abscissa u of n group corresponding points iBecause A and b are known, can solve unknown parameter vector μ from linear equation A μ=b.
Calculate rotating vector and translation parameters:
If U=is μ 1 2+ μ 2 2+ μ 3 2+ μ 4 2Calculate translation parameters t ySquare
t y 2 = U - [ U 2 - 4 ( μ 1 μ 4 - μ 2 μ 3 ) 2 ] 1 / 2 2 ( μ 1 μ 4 - μ 2 μ 3 ) 2 if ( μ 1 μ 4 - μ 2 μ 3 ) ≠ 0 1 μ 1 2 + μ 2 2 if ( μ 1 2 + μ 2 2 ) ≠ 0 1 μ 3 2 + μ 4 2 f ( μ 3 2 + μ 4 2 ) ≠ 0
If t y=| t y|, calculate 4 rotation parameters and translation parameters t according to the μ value of calculating then x:
r 11=μ 1t y;r 12=μ 2t y;r 21=μ 3t y;r 22=μ 4t y;t y=μ 5t y
In order to determine t yCorrect sign, select an impact point P, the picture point of its correspondence [u, v] is away from picture centre.If P=[x, y, z], calculate then: ξ x=r 11X+r 12Y+t x, ξ y=r 21X+r 22Y+t y, this just looks like as the coordinate x of a P and the coefficient of y the spin matrix parameter of calculating.If ξ xThe same with the sign of u, ξ yThe same with the sign of v, t so ySign just correct, otherwise will reversion;
Remaining rotation parameter can calculate by following formula:
r 13=(1-r 11 2-r 12 2) 1/2
r 13=(1-r 11 2-r 12 2) 1/2
r 13=(1-r 11 2-r 12 2) 1/2
r 13=(1-r 11 2-r 12 2) 1/2
r 13=(1-r 11 2-r 12 2) 1/2
Now from second linear system Equation for Calculating focal distance f and translation parameters t zAt first structural matrix A ' and vectorial b ', a i'=(r 21x i+ r 22y i+ t y, v i), b i'=(r 31x i+ r 32y i) v i, take off upper thread system equation A ' V=b ', wherein v=(f, t z) tJust can obtain f and t zEstimated value;
If f<0 changes r so 13, r 23, r 31, r 32, f and t zSign.So just guarantee to meet right-handed scale (R.H.scale) planning.
By adjusting the pose of virtual camera head, make the monitoring range of virtual camera head in 3 d video images, consistent with camera head at the monitoring range of monitored site, be convenient to the two-dimensional video image of the collection of camera head is integrated mutually with three-dimensional virtual scene, can make the effect after the integration more true to nature.
Step S204, two-dimensional video image real-time integration that camera head is obtained are in three-dimensional virtual scene.Because of the camera head and the virtual camera head of reality is one to one, the two-dimensional video image that the camera head of reality is gathered is loaded in the monitoring range of virtual camera head in real time, realizes the integration of two-dimensional video image and three-dimensional virtual scene.
Pass through above-mentioned steps, the present invention realizes three-dimensional video monitor, by the three-dimensional virtual scene after integrating, the user can know and recognizes the locus of each camera head in whole monitored site, when suspicious object occurring in the video, make things convenient for the user to determine to occur the locus of suspicious object rapidly.For example, the monitored site is a building, actual monitored position is each door in the building, but the structure of each door and peripheral facility are all comparatively close, only the two-dimensional video image with each camera head collection is difficult to determine to be which layer in the building, suspicious object appears in which door, but by the three-dimensional virtual scene after the present invention's integration, the two-dimensional video image of each camera head collection directly is carried on the three-dimensional virtual scene, so just can observe directly is that suspicious object appears in that door of that layer, and the user just can in time dispose.
The present invention also can monitor the three-dimensional virtual scene after integrating by amplifying, dwindle, adjust modes such as angle, makes things convenient for the user that local circumstance is carefully checked.
Referring to Fig. 3, three-dimensional video monitor method second embodiment of the present invention is shown, concrete steps are as described below.
Step S301, be provided with the simulation monitored site three-dimensional virtual scene.
Step S302, according to the physical location of camera head in the monitored site, add virtual camera head at the correspondence position of three-dimensional virtual scene.
Step S303, from the two-dimensional video image that camera head obtains, choose the matching characteristic point, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm, adjust the position and the attitude of virtual camera head.
Step S304, two-dimensional video image real-time integration that camera head is obtained are in three-dimensional virtual scene.
Step S305, selection one anchor point carry out the part based on this anchor point to the three-dimensional virtual scene after integrating and amplify monitoring, adjust video angle and monitor.Three-dimensional virtual scene of the present invention is a polar plot, can amplify, processing such as rotation.When the user need carry out processing and amplifying to the somewhere, select an anchor point at this place, amplify instruction by the input of instruments such as operation push-button or mouse, three-dimensional virtual scene is that amplify at the center with this anchor point, is convenient to the details that the user sees this place clearly.Be inconvenient to observe the position for corner, side, top etc., the rotatable three-dimensional virtual scene of user is realized the positive detailed rules and regulations of this position are observed.Certainly, user of the present invention can carry out elder generation as required and amplify afterwards and rotate, or rotation is amplified again earlier, or just amplify, rotary manipulation.
For bigger monitored site, the user may be difficult to accurately navigate to concrete local circumstance by the three-dimensional virtual scene of integral body, the invention provides poll, by some special scenes of prior setting, so that the user observes each local circumstance of monitored site in sequence successively.
Referring to Fig. 4, three-dimensional video monitor method the 3rd embodiment of the present invention is shown, concrete steps are as described below.
Step S401, be provided with the simulation monitored site three-dimensional virtual scene.
Step S402, according to the physical location of camera head in the monitored site, add virtual camera head at the correspondence position of three-dimensional virtual scene.
Step S403, from the two-dimensional video image that camera head obtains, choose the matching characteristic point, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm, adjust the position and the attitude of virtual camera head.
Step S404, two-dimensional video image real-time integration that camera head is obtained are in three-dimensional virtual scene.
Step S405, each virtual camera head is numbered, shows the monitoring range of each virtual camera head correspondence by number order successively.The present invention can be numbered each virtual camera head by certain rule, for example presses from left to right, and from front to back, order from top to bottom is numbered each virtual camera head, is applicable to building, monitored sites such as warehouse; For example, the order of passing through by pedestrian, vehicle etc. is numbered each virtual camera head, is applicable to monitored sites such as subway, transportation depot.Monitoring image shows the monitoring range of each virtual camera head correspondence successively by number order, is convenient to the user each part of monitored site is monitored, and realizes the orderly monitoring to large-scale monitored site.
The present invention also provides the alarm linkage function.The present invention when producing alert, shows the monitoring range of the two-dimensional video image corresponding virtual camera that produces alert by the analysis of two-dimensional video image, is convenient to user monitoring.
Referring to Fig. 5, three-dimensional video monitor method the 4th embodiment of the present invention is shown, concrete steps are as described below.
Step S501, be provided with the simulation monitored site three-dimensional virtual scene.
Step S502, according to the physical location of camera head in the monitored site, add virtual camera head at the correspondence position of three-dimensional virtual scene.
Step S503, from the two-dimensional video image that camera head obtains, choose the matching characteristic point, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm, adjust the position and the attitude of virtual camera head.
Step S504, two-dimensional video image real-time integration that camera head is obtained are in three-dimensional virtual scene.
Step S505, analysis of two-dimensional video image when producing alert, show the monitoring range of the two-dimensional video image corresponding virtual camera that produces alert, are convenient to user monitoring and timely the disposal.
The present invention realizes the position key monitoring to going wrong by alarm linkage, improves monitoring effect, and is user-friendly.
The present invention also provides the target lock-on function.Lock for the suspicious object that occurs, and, make and to be presented within the monitoring range all the time by object, be convenient to the Subscriber Locked target, key monitoring along with the running transform monitoring range of this suspicious object.
Referring to Fig. 6, three-dimensional video monitor method the 5th embodiment of the present invention is shown, concrete steps are as described below.
Step S601, be provided with the simulation monitored site three-dimensional virtual scene.
Step S602, according to the physical location of camera head in the monitored site, add virtual camera head at the correspondence position of three-dimensional virtual scene.
Step S603, from the two-dimensional video image that camera head obtains, choose the matching characteristic point, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm, adjust the position and the attitude of virtual camera head.
Step S604, two-dimensional video image real-time integration that camera head is obtained are in three-dimensional virtual scene.
Step S605, analysis of two-dimensional video image, suspicious object in the locking two-dimensional video image is along with the mobile switching monitoring scope of suspicious object.Like this, when suspicious object enters the monitored site, 3 D monitoring of the present invention system just can realize the solid monitoring to this suspicious object, the user can clearly observe the mobile route of this suspicious object by three-dimensional virtual scene, understand the possible whereabouts of this suspicious object, be convenient to the user and take measures rapidly to dispose.
The present invention also provides information storage function, with 3 D monitoring information segmenting storage, is convenient to the user and retrieves afterwards and check.
Referring to Fig. 7, three-dimensional video monitor method the 6th embodiment of the present invention is shown, concrete steps are as described below.
Step S701, be provided with the simulation monitored site three-dimensional virtual scene.
Step S702, according to the physical location of camera head in the monitored site, add virtual camera head at the correspondence position of three-dimensional virtual scene.
Step S703, from the two-dimensional video image that camera head obtains, choose the matching characteristic point, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm, adjust the position and the attitude of virtual camera head.
Step S704, two-dimensional video image real-time integration that camera head is obtained are in three-dimensional virtual scene.
Step S705, be set the time period, deposit storage device in after 3 D video is cut apart on a time period.Time period can be provided with by the hour by the sky setting, on a time period 3 D video information is divided into a plurality of files on a time period, is saved in storage devices such as hard disk.When the user need check the file of certain time period, can directly transfer this time period corresponding file, check.
Based on above-mentioned three-dimensional video monitor method, the present invention also provides a kind of three-dimensional video monitor system.See Fig. 8, three-dimensional video monitor first embodiment of system of the present invention is shown, and the three-dimensional video monitor system comprises that three-dimensional virtual scene sets up module 81, virtual camera head to add module 82, virtual camera head position and attitude adjusting module 83, and two-dimensional video image integrate module 84.
Three-dimensional virtual scene sets up module 81 that the three-dimensional virtual scene of simulating the monitored site is set, and sends the three-dimensional virtual scene that is provided with to virtual camera head interpolation module 82.
Virtual camera head adds module 82 according to the physical location of camera head in the monitored site, correspondence position at three-dimensional virtual scene adds virtual camera head, and the three-dimensional virtual scene that adds virtual camera head is sent to virtual camera head position and attitude adjusting module 83.
Virtual camera head position and attitude module 83 are chosen the matching characteristic point from the two-dimensional video image that described camera head obtains, according to the mapping point of described matching characteristic point in described three-dimensional virtual scene, adjust the angle of described virtual camera head, and the three-dimensional virtual scene that will adjust virtual camera head position and attitude sends to two-dimensional video image integrate module 84.
The two-dimensional video image that two-dimensional video image integrate module 84 obtains described camera head is incorporated in the described three-dimensional virtual scene.
See Fig. 9, three-dimensional video monitor second embodiment of system of the present invention is shown, and the three-dimensional video monitor system comprises that three-dimensional virtual scene is set up module 81, virtual camera head to add module 82, virtual camera head position and attitude adjusting module 83, two-dimensional video image integrate module 84, amplified rotary module 85, poll module 86, locking module 87, and memory module 88.
Amplify rotary module 85 and obtain 3 D video information, select an anchor point, based on this anchor point the three-dimensional virtual scene after integrating is carried out the part and amplify monitoring and/or adjust the video angle monitoring at two-dimensional video image integrate module 84.
Poll module 86 is obtained 3 D video information at two-dimensional video image integrate module 84, and each described virtual camera head is numbered, and shows the monitoring range of each described virtual camera head correspondence successively by number order.
Locking module 87 is obtained 3 D video information at two-dimensional video image integrate module 84, and the analysis of two-dimensional video image locks suspicious object in the described two-dimensional video image, along with the mobile switching monitoring scope of suspicious object.
Memory module 88 is obtained 3 D video information at two-dimensional video image integrate module 84, and the time period is set, and deposits storage device in after 3 D video information is cut apart on a time period.
Three-dimensional virtual scene set up module 81, virtual camera head add module 82, virtual camera head position and attitude module 83, and the effect of two-dimensional video image integrate module 84 and function with embodiment illustrated in fig. 8 identical, repeat no more.
More than to a kind of three-dimensional video monitor method and system provided by the present invention, be described in detail, used specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.

Claims (10)

1. a three-dimensional video monitor method is characterized in that, comprising:
The three-dimensional virtual scene of simulation monitored site is set,, adds virtual camera head at the correspondence position of three-dimensional virtual scene according to the physical location of camera head in the monitored site;
From the two-dimensional video image that described camera head obtains, choose the matching characteristic point,, obtain the exact position and the attitude of described virtual camera head according to matching algorithm according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene;
The two-dimensional video image that described camera head is obtained is incorporated in the described three-dimensional virtual scene.
2. the method for claim 1 is characterized in that, also comprises:
Select an anchor point, based on this anchor point the three-dimensional virtual scene after integrating is carried out the part and amplify monitoring and/or adjust the video angle monitoring.
3. the method for claim 1 is characterized in that, also comprises:
Each described virtual camera head is numbered, shows the monitoring range of each described virtual camera head correspondence in three-dimensional virtual scene by number order successively.
4. the method for claim 1 is characterized in that, also comprises:
Analyze described two-dimensional video image, when producing alert, the monitoring range of Softcam in the three-dimensional virtual scene of the two-dimensional video image correspondence of demonstration generation alert.
5. the method for claim 1 is characterized in that, also comprises:
Analyze described two-dimensional video image, lock suspicious object in the described two-dimensional video image, along with the monitoring range in the mobile switching three-dimensional virtual scene of suspicious object.
6. as each described method of claim 1 to 5, it is characterized in that, also comprise:
Time period is set, deposits storage device in after 3 D video information is cut apart on a time period.
7. a three-dimensional video monitor system is characterized in that, comprises that three-dimensional virtual scene sets up module, virtual camera head to add module, virtual camera head position and attitude adjusting module, and two-dimensional video image integrate module:
Described three-dimensional virtual scene is set up module, is used to be provided with the three-dimensional virtual scene of simulation monitored site;
Described virtual camera head adds module, is used for according to the physical location of camera head in the monitored site, adds virtual camera head at the correspondence position of three-dimensional virtual scene;
Described virtual camera head position and attitude adjusting module, be used for choosing the matching characteristic point from the two-dimensional video image that described camera head obtains, according to the correspondence mappings point of described matching characteristic point in described three-dimensional virtual scene, obtain the exact position and the attitude of described virtual camera head according to matching algorithm;
Described two-dimensional video image integrate module is used for the two-dimensional video image that described camera head obtains is incorporated into described three-dimensional virtual scene.
8. system as claimed in claim 7 is characterized in that, also comprises:
Amplify rotary module, be used to select an anchor point, based on this anchor point the three-dimensional virtual scene after integrating is carried out the part and amplify monitoring and/or adjust the video angle monitoring.
9. system as claimed in claim 7 is characterized in that, also comprises:
The poll module is used for each described virtual camera head is numbered, and shows the monitoring range in the three-dimensional virtual scene of each described virtual camera head correspondence successively by number order.
10. system as claimed in claim 7 is characterized in that, also comprises:
Locking module is used to analyze described two-dimensional video image, locks suspicious object in the described two-dimensional video image, along with the monitoring range in the mobile switching three-dimensional virtual scene of suspicious object.
CN2009100874993A 2009-06-23 2009-06-23 Method and system for three-dimensional video monitor Pending CN101931790A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009100874993A CN101931790A (en) 2009-06-23 2009-06-23 Method and system for three-dimensional video monitor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009100874993A CN101931790A (en) 2009-06-23 2009-06-23 Method and system for three-dimensional video monitor

Publications (1)

Publication Number Publication Date
CN101931790A true CN101931790A (en) 2010-12-29

Family

ID=43370675

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009100874993A Pending CN101931790A (en) 2009-06-23 2009-06-23 Method and system for three-dimensional video monitor

Country Status (1)

Country Link
CN (1) CN101931790A (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103136739A (en) * 2011-11-29 2013-06-05 北京航天长峰科技工业集团有限公司 Registering method of controllable vidicon surveillance video and three-dimensional model in complex scene
CN103716586A (en) * 2013-12-12 2014-04-09 中国科学院深圳先进技术研究院 Monitoring video fusion system and monitoring video fusion method based on three-dimension space scene
CN104079816A (en) * 2013-11-11 2014-10-01 国网山东省电力公司 Automatic control method for surveillance cameras based on virtual reality technology
CN104539875A (en) * 2014-09-05 2015-04-22 王学魁 Video monitoring method and system
CN104881870A (en) * 2015-05-18 2015-09-02 浙江宇视科技有限公司 Live monitoring starting method and device for to-be-observed point
CN105678839A (en) * 2015-12-30 2016-06-15 天津德勤和创科技发展有限公司 Security device distribution design method based on computer three dimensional scene simulation technology
CN106331618A (en) * 2016-08-22 2017-01-11 浙江宇视科技有限公司 Method and device for automatically confirming visible range of camera
CN106851421A (en) * 2016-12-15 2017-06-13 天津知音网络科技有限公司 A kind of display system for being applied to video AR
WO2017124663A1 (en) * 2016-01-21 2017-07-27 杭州海康威视数字技术股份有限公司 Three-dimensional surveillance system, and rapid deployment method for same
CN107396069A (en) * 2017-09-01 2017-11-24 三筑工科技有限公司 Monitor methods of exhibiting, apparatus and system
CN108022265A (en) * 2016-11-01 2018-05-11 狒特科技(北京)有限公司 Infrared camera pose determines method, equipment and system
CN108076320A (en) * 2016-11-17 2018-05-25 天津凯溢华升科技发展有限公司 A kind of city technological service safety protection method
CN108833827A (en) * 2018-05-31 2018-11-16 四川隧唐科技股份有限公司 monitoring method and device
CN109003305A (en) * 2018-07-18 2018-12-14 江苏实景信息科技有限公司 A kind of positioning and orientation method and device
CN109254406A (en) * 2018-11-07 2019-01-22 深圳市传智科技有限公司 A kind of multi-functional augmented reality glasses
CN109857904A (en) * 2018-12-28 2019-06-07 北京市劳动保护科学研究所 A kind of video frequency tracking method and device based on threedimensional model
CN110009624A (en) * 2019-04-11 2019-07-12 成都四方伟业软件股份有限公司 Method for processing video frequency, video process apparatus and electronic equipment
CN110009561A (en) * 2019-04-10 2019-07-12 南京财经大学 A kind of monitor video target is mapped to the method and system of three-dimensional geographical model of place
CN111046725A (en) * 2019-10-24 2020-04-21 宝略科技(浙江)有限公司 Spatial positioning method based on face recognition and point cloud fusion of surveillance video
WO2020132784A1 (en) * 2018-12-24 2020-07-02 Intel Corporation Methods and apparatus to detect collision of virtual camera with objects in three-dimensional volumetric model
CN111526328A (en) * 2020-03-18 2020-08-11 深圳市华橙数字科技有限公司 Video monitoring inspection method, device, terminal and storage medium
CN111737518A (en) * 2020-06-16 2020-10-02 浙江大华技术股份有限公司 Image display method and device based on three-dimensional scene model and electronic equipment
CN112866627A (en) * 2019-11-28 2021-05-28 上海华为技术有限公司 Three-dimensional video monitoring method and related equipment

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103136739A (en) * 2011-11-29 2013-06-05 北京航天长峰科技工业集团有限公司 Registering method of controllable vidicon surveillance video and three-dimensional model in complex scene
CN104079816A (en) * 2013-11-11 2014-10-01 国网山东省电力公司 Automatic control method for surveillance cameras based on virtual reality technology
CN104079816B (en) * 2013-11-11 2018-02-27 国网山东省电力公司 A kind of CCTV camera autocontrol method based on virtual reality technology
CN103716586A (en) * 2013-12-12 2014-04-09 中国科学院深圳先进技术研究院 Monitoring video fusion system and monitoring video fusion method based on three-dimension space scene
CN104539875A (en) * 2014-09-05 2015-04-22 王学魁 Video monitoring method and system
CN104881870A (en) * 2015-05-18 2015-09-02 浙江宇视科技有限公司 Live monitoring starting method and device for to-be-observed point
CN105678839A (en) * 2015-12-30 2016-06-15 天津德勤和创科技发展有限公司 Security device distribution design method based on computer three dimensional scene simulation technology
WO2017124663A1 (en) * 2016-01-21 2017-07-27 杭州海康威视数字技术股份有限公司 Three-dimensional surveillance system, and rapid deployment method for same
CN106993152A (en) * 2016-01-21 2017-07-28 杭州海康威视数字技术股份有限公司 Three-dimension monitoring system and its quick deployment method
CN106993152B (en) * 2016-01-21 2019-11-08 杭州海康威视数字技术股份有限公司 Three-dimension monitoring system and its quick deployment method
CN106331618B (en) * 2016-08-22 2019-07-16 浙江宇视科技有限公司 A kind of method and device automatically confirming that video camera visible range
CN106331618A (en) * 2016-08-22 2017-01-11 浙江宇视科技有限公司 Method and device for automatically confirming visible range of camera
CN108022265A (en) * 2016-11-01 2018-05-11 狒特科技(北京)有限公司 Infrared camera pose determines method, equipment and system
CN108022265B (en) * 2016-11-01 2023-06-13 北京墨土科技有限公司 Method, equipment and system for determining pose of infrared camera
CN108076320A (en) * 2016-11-17 2018-05-25 天津凯溢华升科技发展有限公司 A kind of city technological service safety protection method
CN106851421A (en) * 2016-12-15 2017-06-13 天津知音网络科技有限公司 A kind of display system for being applied to video AR
CN107396069A (en) * 2017-09-01 2017-11-24 三筑工科技有限公司 Monitor methods of exhibiting, apparatus and system
CN108833827A (en) * 2018-05-31 2018-11-16 四川隧唐科技股份有限公司 monitoring method and device
CN109003305A (en) * 2018-07-18 2018-12-14 江苏实景信息科技有限公司 A kind of positioning and orientation method and device
CN109003305B (en) * 2018-07-18 2021-07-20 江苏实景信息科技有限公司 Positioning and attitude determining method and device
CN109254406A (en) * 2018-11-07 2019-01-22 深圳市传智科技有限公司 A kind of multi-functional augmented reality glasses
WO2020132784A1 (en) * 2018-12-24 2020-07-02 Intel Corporation Methods and apparatus to detect collision of virtual camera with objects in three-dimensional volumetric model
US11257282B2 (en) 2018-12-24 2022-02-22 Intel Corporation Methods and apparatus to detect collision of a virtual camera with objects in three-dimensional volumetric model
CN109857904A (en) * 2018-12-28 2019-06-07 北京市劳动保护科学研究所 A kind of video frequency tracking method and device based on threedimensional model
CN109857904B (en) * 2018-12-28 2022-02-18 北京市劳动保护科学研究所 Video tracking method and device based on three-dimensional model
CN110009561A (en) * 2019-04-10 2019-07-12 南京财经大学 A kind of monitor video target is mapped to the method and system of three-dimensional geographical model of place
CN110009561B (en) * 2019-04-10 2023-04-18 南京财经大学 Method and system for mapping surveillance video target to three-dimensional geographic scene model
CN110009624A (en) * 2019-04-11 2019-07-12 成都四方伟业软件股份有限公司 Method for processing video frequency, video process apparatus and electronic equipment
CN111046725A (en) * 2019-10-24 2020-04-21 宝略科技(浙江)有限公司 Spatial positioning method based on face recognition and point cloud fusion of surveillance video
CN112866627A (en) * 2019-11-28 2021-05-28 上海华为技术有限公司 Three-dimensional video monitoring method and related equipment
CN112866627B (en) * 2019-11-28 2024-03-05 上海华为技术有限公司 Three-dimensional video monitoring method and related equipment
CN111526328B (en) * 2020-03-18 2022-01-04 深圳市华橙数字科技有限公司 Video monitoring inspection method, device, terminal and storage medium
CN111526328A (en) * 2020-03-18 2020-08-11 深圳市华橙数字科技有限公司 Video monitoring inspection method, device, terminal and storage medium
CN111737518A (en) * 2020-06-16 2020-10-02 浙江大华技术股份有限公司 Image display method and device based on three-dimensional scene model and electronic equipment

Similar Documents

Publication Publication Date Title
CN101931790A (en) Method and system for three-dimensional video monitor
CN112894832B (en) Three-dimensional modeling method, three-dimensional modeling device, electronic equipment and storage medium
Son et al. Real-time vision-based warning system for prevention of collisions between workers and heavy equipment
CN110222137B (en) Intelligent campus system based on oblique photography and augmented reality technology
US8823855B2 (en) User equipment and method for providing augmented reality (AR) service
CN107067794B (en) Indoor vehicle positioning and navigation system and method based on video image processing
CN105096382B (en) A kind of method and device that real-world object information is associated in video monitoring image
CN103226838A (en) Real-time spatial positioning method for mobile monitoring target in geographical scene
CN105828045A (en) Method and device for tracking target by using spatial information
CN108496348A (en) Slip mass dynamic monitoring and controlling method and system
CN102129290A (en) Image processing device, object selection method and program
CN110300292A (en) Projection distortion bearing calibration, device, system and storage medium
CN107993282A (en) One kind can dynamically measure live-action map production method
CN111222190B (en) Ancient building management system
CN102905122A (en) Auxiliary method for tracking suspicious people by monitoring system
CN103270752A (en) Method and system for converting privacy zone planar images to their corresponding pan/tilt coordinates
CN103279187A (en) Method for constructing multi-scene virtual panorama space and intelligent terminal
CN103942820A (en) Method and device for simulating three-dimensional map in multi-angle mode
CN112449093A (en) Three-dimensional panoramic video fusion monitoring platform
CN107124581A (en) Video camera running status and suspected target real-time display system on the electronic map
CN106412526A (en) Police oblique-photography real 3D platform system and interface system thereof
CN113869231B (en) Method and equipment for acquiring real-time image information of target object
CN113914407B (en) Excavator excavation tunnel accurate control system based on BIM and machine vision
CN112256818B (en) Display method and device of electronic sand table, electronic equipment and storage medium
CN112105892A (en) Identifying map features using motion data and bin data

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20101229