CN101720027B - Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera - Google Patents
Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera Download PDFInfo
- Publication number
- CN101720027B CN101720027B CN2009102192128A CN200910219212A CN101720027B CN 101720027 B CN101720027 B CN 101720027B CN 2009102192128 A CN2009102192128 A CN 2009102192128A CN 200910219212 A CN200910219212 A CN 200910219212A CN 101720027 B CN101720027 B CN 101720027B
- Authority
- CN
- China
- Prior art keywords
- scene
- target
- camera
- video
- video camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Studio Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method for the cooperative acquisition of multi-target videos in different resolutions by a variable-focus array camera in a monitor system with large scene and multiple targets, aiming at controlling the array camera to realize the cooperative acquisition of videos in the low-resolution scene and videos of a plurality of targets in the scene under different resolutions on the basis of the analysis and the comprehension of video images in scenes. The design proposal thereof comprises: utilizing N variable-focus low-resolution cameras to shoot the same scene, wherein one camera shoots the entire scene and the rest N-1 cameras are used for shooting the targets in the scene, computing the working parameters of the camera according to the quantity, the position and the dimension information of the targets in the scene, controlling the array camera to realize the cooperative acquisition so as to obtain the scene videos and the target videos under different resolutions, and then obtaining and displaying clear video images in the scene by an image fusion technique. The method can realize the acquisition of multi-target high-resolution videos and high-quality scene videos at low cost in case of large scene dimension, and is used for video monitor system.
Description
Technical field
The invention belongs to technical field of image processing, relate to the video frequency graphic monitoring method, can be used for obtaining multiple target video image in the large scene.
Background technology
Along with society, expanding economy, people are more and more higher to the demand of safety precaution, and video monitoring is as the effective means in the safety protection field, use more and more generally, and application requirements is also in raising constantly.Video monitoring system has developed short twenties years, to burning hot a few years ago digital supervision, arrives Network Video Surveillance in the ascendant from simulation monitoring the earliest again, and earth-shaking variation has taken place.In recent years, along with the develop rapidly of computer, network and image processing, transmission technology, in video monitoring system, obtain high-quality video and become noticeable.
Yet, in traditional video monitoring system, obtaining of video arranged several low resolution video cameras often in scene to be monitored, each video camera is independently each other, they gather the video of a fixed area in the scene separately, and by network processed video is transferred on the display of remote monitoring terminal and shows that the user can only see several independent low quality video on remote monitoring terminal.And for single low quality video, the user often runs into such problem in use: when monitored scene is bigger, when a plurality of target was particularly arranged in the scene, interested target resolution was too small, is unfavorable for watching.
For such situation,,, have to high-resolution image is adopted lower code check compression, and this processing can make visual effect have a greatly reduced quality owing to be subjected to the influence of the network bandwidth if HardwareUpgring is adopted high-resolution video camera; In addition along with the raising of resolution of video camera, the also corresponding increase of its price.
Summary of the invention
The objective of the invention is to overcome the deficiency of above-mentioned prior art, provide a kind of variable-focus array camera the collaborative method of obtaining multiple target video under the different resolution, to be implemented under the big scene yardstick, low-cost obtains multiobject high-resolution video and high-quality scene video.
For achieving the above object, the technical thought of variable-focus array camera cooperative acquisition of multi-target videos under different resolutions of the present invention is: take same scene with N varifocal low resolution video camera, wherein a video camera in array center is used to take whole scene, and all the other N-1 video cameras around array are used for the interesting target of photographed scene.By area-of-interest detection algorithm and known focal length of camera and coke ratio, information such as the number of target, position, yardstick in the acquisition scene, utilize all the other N-1 of these information Control video camera collaborative work, control operations such as their unlatching, rotation, zoom by the parameter that calculates.After the video camera of monitoring interesting target was started working, video camera was followed the tracks of the target that moves by rotation, after the scope of the maximum anglec of rotation of target disengaging rig camera, reanalysed scene, the collaborative work of control video camera.Its specific implementation step is as follows:
(1) array of forming with N varifocal low resolution video camera is taken Same Scene, and wherein in array center takes large scene, all the other targets in N-1 video camera photographed scene around the array;
(2) give receiving terminal with the large scene video image of taking by Network Transmission, by receiving terminal scene image is understood and analysis, obtain number, position and the yardstick information of target in the scene, and in conjunction with relative position, focal length and the coke ratio information of N video camera, according to the running parameter of pinhole imaging system model and Triangle Model calculating photographic subjects video camera, give video camera by network-feedback;
(3) collaborative work behind the running parameter that obtains from network of video camera array to the monitoring of the target following in the scene, and by standard video encoder, obtains N-1 high-resolution target code stream and a low resolution scene code stream, sends to receiving terminal by network;
(4) will decode at receiving terminal by N the code stream that network obtains, obtain N-1 target video and a scene video, and this N-1 target video image and a scene video image will be carried out image co-registration, and obtain high-quality scene video image and show;
(5) in monitor procedure, if the target in the scene moves, the video camera of monitoring objective is followed the tracks of target, thereby makes target's center be in the camera lens center always;
(6) if after target broke away from the scope of the rig camera anglec of rotation, repeating step (2) was controlled the video camera array collaborative work again to step (4).
The running parameter of the described video camera of step (2) comprises the anglec of rotation of operating state, photographic subjects focus of camera and the photographic subjects video camera of photographic subjects video camera.
The present invention has the following advantages compared with prior art:
1. the present invention has been owing to adopted pinhole imaging system model and Triangle Model to calculate the running parameter of photographic subjects video camera, thereby can control the video camera array collaborative work, takes a plurality of targets in large scene and the scene simultaneously;
2. the present invention can obtain the target video of scene video and different resolution owing to adopt variable-focus array camera, helps carrying out image co-registration and obtains high-resolution and high-quality scene video;
3. the present invention does not use the high definition camera owing to still use common camera, realizes that cost is low, and can work under the network condition of limited bandwidth.
Description of drawings
Fig. 1 is the system block diagram of implementation method of the present invention;
Fig. 2 realizes calculating the schematic diagram of focal length of camera for the present invention;
Fig. 3 realizes calculating the schematic diagram of the video camera anglec of rotation for the present invention;
Fig. 4 is the flow chart of implementation method of the present invention.
Embodiment
With reference to Fig. 1 and Fig. 4, variable-focus array camera method for cooperative acquisition of multi-target videos under different resolutions of the present invention comprises the steps:
Step 1: take Same Scene with the array that N varifocal low resolution video camera formed.
1a) video camera that is positioned at the center in N the varifocal low resolution video camera array is taken large scene, the target in all the other N-1 video camera photographed scenes;
1b) each varifocal low resolution video camera all has the video processing module of oneself, comprises video memory, H.264 encoder and target tracker;
1c) each varifocal low resolution video camera all is furnished with The Cloud Terrace, and certain anglec of rotation is arranged, and accurate zoom.
Step 2: give receiving terminal by Network Transmission with the large scene video image of taking, by receiving terminal image is understood and analysis, promptly adopted a kind of number, position and yardstick information that obtains target in the scene based on the method for automatically extracting interesting image regions of human visual attention system.
Step 3:, calculate N-1 photographic subjects video camera running parameter according to pinhole imaging system model and Triangle Model, and running parameter is controlled to video camera by network-feedback in conjunction with relative position, focal length and the coke ratio information of N video camera.
The running parameter of above-described video camera comprises the anglec of rotation of operating state, photographic subjects focus of camera and the photographic subjects video camera of photographic subjects video camera.
3a) the operating state of photographic subjects video camera, set according to following steps:
At first, establish the arrangement mode n * n of video camera array, then scene image is divided into n * n equirotal, and according to the space physics position that the piece of being divided is corresponding with video camera;
Secondly, in scene image, the number of statistics target area shared pixel in n * n the piece of dividing, the pairing video camera operating state of the piece that pixel is maximum is set at unlatching, and the operating state of all the other video cameras is set at closes;
3b) photographic subjects focus of camera, calculate according to following steps:
With reference to Fig. 2, the specific implementation of this step is: establishing the photographed scene focal length of camera earlier is f
a, the scene video image that receiving terminal obtains has a
1* a
2Individual pixel, there is b a target area in the image
1* b
2Individual pixel; Adopt following formula to calculate the focus of camera f of photographic subjects again
b:
3c) the anglec of rotation of photographic subjects video camera, calculate in the following manner:
The specific implementation of this step is as shown in Figure 3:
At first, if the projection centre of photographic subjects video camera is spatial point O, projection plane is π, then spatial point O is a focal distance f to the distance of projection plane π, the geometric center of a target is spatial point M in the scene, the projection of spatial point M on the π of plane is m, and projection m is end points and passes through the ray of spatial point M and the intersection point of projection plane π with spatial point O;
Then, in the space, with spatial point O is that the origin of coordinates is set up video camera rectangular coordinate system in space O-XYZ, wherein horizontal line and vertical line are respectively an X and Y-axis, and π is parallel with projection plane, and the Z axle is vertical with projection plane π, and the intersection point o with Z axle and projection plane π on projection plane π is that initial point is set up plane coordinate system o-xy, horizontal line and vertical line are respectively x axle and y axle, and the coordinate of projection m in plane coordinate system o-xy is designated as m=(x
1, y
1);
Then, establish distance between the video camera of the monitoring video camera of large scene and each monitoring objective much smaller than the distance between target and the video camera, in scene image, establishing target's center range image center has e in the horizontal direction
1Individual pixel has e in vertical direction
2Individual pixel adopts following formula to calculate the coordinate (x of projection m in plane coordinate system o-xy
1, y
1):
Wherein, f
xAnd f
yBe respectively the coke ratio of horizontal direction and vertical direction;
At last, utilize following formula to calculate anglec of rotation parameter, horizontal direction angle θ and vertical direction angle that the video camera of shooting interesting target need rotate
Step 4: video camera array is controlled each video camera collaborative work according to the running parameter that obtains, and the target following in the scene is monitored.
Step 5:N video camera photographs to such an extent that video passes through H.264 encoder, obtains N-1 high-resolution target code stream and a low resolution scene code stream, sends to receiving terminal by network.
5a) all video cameras are all caught the VGA video, with encoder compresses H.264, again it is passed to receiving terminal before;
5b) when H.264 compressing, the photographed scene video camera adopts cbr (constant bit rate), and the photographic subjects video camera is according to the number and the channel width of opening, mean allocation code check.
Step 6: will obtain N-1 high-resolution target code stream and a N-1 target video and the scene video that low resolution scene code stream decoding obtains at user side, and N video image be carried out image co-registration by a kind of image mirage method based on study show.
Step 7: when moving as if target, start the target tracker on the video camera, video camera adopts a kind of video tracing method based on particle filter that target is followed the tracks of by rotation, makes target's center be in the camera lens center always.
Step 8: if after target breaks away from the scope of the rig camera anglec of rotation, repeating step 2 is to step 6, and the multiple target video under the different resolution is obtained in the collaborative work of control video camera array.
More than, only be example of the present invention, do not constitute any limitation of the invention, obviously anyone can change under design of the present invention, but these are all in protection scope of the present invention.
Claims (3)
1. the method for a variable-focus array camera cooperative acquisition of multi-target videos under different resolutions comprises the steps:
(1) array of forming with N variable-focus video camera is taken Same Scene, and wherein in array center takes large scene, all the other targets in N-1 video camera photographed scene around the array;
(2) give receiving terminal with the large scene video image of taking by Network Transmission, scene image is understood and analysis, obtain number, position and the yardstick information of target in the scene by receiving terminal;
(3) arrangement mode of establishing video camera array is n * n, and scene image is divided into n * n equirotal, and is according to the space physics position that the piece of being divided is corresponding with the photographic subjects video camera;
(4) in scene image, the number of statistics target area shared pixel in n * n the piece of dividing, the pairing photographic subjects video camera of the piece operating states that pixel is maximum are set at unlatching;
(5) calculate the photographic subjects focus of camera and the anglec of rotation, and operating state, focal length and the anglec of rotation of photographic subjects video camera fed back to video camera array by network;
(6) collaborative work behind the running parameter that obtains from network of video camera array to the monitoring of the target following in the scene, and by standard video encoder, obtains N-1 target code stream and a scene code stream, sends to receiving terminal by network;
(7) will be decoded at receiving terminal by N the code stream that network obtains, and obtain N-1 target video and a scene video, and this N-1 target video image and a scene video image are carried out image co-registration, the scene video image after obtaining merging shows;
(8) in monitor procedure, if the target in the scene moves, the photographic subjects video camera is followed the tracks of target, thereby makes target's center be in the camera lens center always;
(9) if after target broke away from the scope of the photographic subjects video camera anglec of rotation, repeating step (2) was controlled the video camera array collaborative work again to step (7).
2. the method for variable-focus array camera cooperative acquisition of multi-target videos under different resolutions as claimed in claim 1, the described photographic subjects focus of camera of step (5) wherein, calculate as follows:
2a) establishing the photographed scene focal length of camera is f
a, the scene video image that receiving terminal obtains has a
1* a
2Individual pixel, there is b a target area in the image
1* b
2Individual pixel;
2b) with scene image number of pixels a
1* a
2With target region number of pixels b in the image
1* b
2The ratio and the focal length of camera f that pans
aMultiply each other, obtain the focus of camera f of photographic subjects
b
3. the method for variable-focus array camera cooperative acquisition of multi-target videos under different resolutions as claimed in claim 1, the anglec of rotation of the described photographic subjects video camera of step (5) wherein, calculate as follows:
3a) projection centre of establishing the video camera of photographic subjects is spatial point O, projection plane is π, focus of camera is f, the geometric center of captured target is spatial point M in the scene, the projection of spatial point M on the π of plane is m, and projection m is end points and passes through the ray of spatial point M and the intersection point of projection plane π with spatial point O;
3b) in the space, with spatial point O is that the origin of coordinates is set up video camera rectangular coordinate system in space O-XYZ, wherein horizontal line and vertical line are respectively X-axis and Y-axis, and π is parallel with projection plane, the Z axle is vertical with projection plane π, intersection point o with Z axle and projection plane π on projection plane π is that initial point is set up plane coordinate system o-xy, and horizontal line and vertical line are respectively x axle and y axle, and the coordinate of projection m in plane coordinate system o-xy is designated as m=(x
1, y
1);
3c) in scene image, establishing target's center range image center has e in the horizontal direction
1Individual pixel has e in vertical direction
2Individual pixel;
3d) according to the coke ratio f of horizontal direction in the video camera confidential reference items matrix and vertical direction
xAnd f
y, calculate the coordinate x of projection m in plane coordinate system o-xy according to following formula
1And y
1:
3e) according to the coordinate x of projection m in plane coordinate system o-xy
1And y
1With focal length of camera f, calculate horizontal direction angle θ and the vertical direction angle that the video camera of photographic subjects need rotate according to following formula
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102192128A CN101720027B (en) | 2009-11-27 | 2009-11-27 | Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102192128A CN101720027B (en) | 2009-11-27 | 2009-11-27 | Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101720027A CN101720027A (en) | 2010-06-02 |
| CN101720027B true CN101720027B (en) | 2011-06-01 |
Family
ID=42434530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009102192128A Expired - Fee Related CN101720027B (en) | 2009-11-27 | 2009-11-27 | Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101720027B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5395956B2 (en) * | 2010-07-02 | 2014-01-22 | 株式会社ソニー・コンピュータエンタテインメント | Information processing system and information processing method |
| GB2523740B (en) * | 2014-02-26 | 2020-10-14 | Sony Interactive Entertainment Inc | Image encoding and display |
| CN104780347A (en) * | 2015-04-15 | 2015-07-15 | 无锡华海天和信息科技有限公司 | Monitoring data transmission system and realizing method thereof |
| CN105072414B (en) * | 2015-08-19 | 2019-03-12 | 浙江宇视科技有限公司 | A kind of target detection and tracking and system |
| CN105163025B (en) * | 2015-08-31 | 2020-01-31 | 联想(北京)有限公司 | Image capturing method and electronic device |
| CN105578045A (en) * | 2015-12-23 | 2016-05-11 | 努比亚技术有限公司 | Terminal and shooting method of terminal |
| CN105744239B (en) * | 2016-05-11 | 2018-10-19 | 湖南源信光电科技有限公司 | More focal length lens ultrahigh resolutions linkage imaging devices |
| CN107659774B (en) * | 2017-09-30 | 2020-10-13 | 北京拙河科技有限公司 | Video imaging system and video processing method based on multi-scale camera array |
| CN107734271B (en) * | 2017-10-16 | 2019-09-06 | 深圳市未来媒体技术研究院 | 1,000,000,000 pixel video generation method of high dynamic range |
| CN107959805B (en) * | 2017-12-04 | 2019-09-13 | 深圳市未来媒体技术研究院 | Light field video imaging system and method for processing video frequency based on Hybrid camera array |
| CN109785365B (en) * | 2019-01-17 | 2021-05-04 | 西安电子科技大学 | Real-time target tracking method of address event driven unstructured signal |
| CN110072056B (en) * | 2019-05-10 | 2022-02-01 | 北京迈格威科技有限公司 | Data processing method and device based on multiple camera modules |
| CN111651618B (en) * | 2019-09-26 | 2021-01-15 | 上海麦克风文化传媒有限公司 | Intelligent database management system |
| CN113301308B (en) * | 2021-05-25 | 2022-06-17 | 浙江安防职业技术学院 | Video monitoring device for safety monitoring |
| CN113489948A (en) * | 2021-06-21 | 2021-10-08 | 浙江大华技术股份有限公司 | Camera monitoring equipment, method and device and storage medium |
| CN113660456A (en) * | 2021-07-12 | 2021-11-16 | 无锡安科迪智能技术有限公司 | Method for cooperatively acquiring multi-target videos with different resolutions by variable-focus array camera |
| CN115002373A (en) * | 2022-04-27 | 2022-09-02 | 西安应用光学研究所 | Large and small view field composite display method for airborne infrared search navigation pod |
| CN117714883A (en) * | 2022-09-07 | 2024-03-15 | 华为技术有限公司 | Video camera control method and related device |
| CN115578694A (en) * | 2022-11-18 | 2023-01-06 | 合肥英特灵达信息技术有限公司 | Video analysis computing power scheduling method, system, electronic equipment and storage medium |
| CN116360492B (en) * | 2023-04-03 | 2024-01-30 | 北京科技大学 | Object tracking method and system for flapping wing flying robot |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1574961A (en) * | 2003-06-18 | 2005-02-02 | 松下电器产业株式会社 | Video surveillance system, surveillance video composition apparatus, and video surveillance server |
| CN1658670A (en) * | 2004-02-20 | 2005-08-24 | 上海银晨智能识别科技有限公司 | Intelligent tracking monitoring system with multi-camera |
| CN1976445A (en) * | 2006-12-15 | 2007-06-06 | 上海鼎业电子科技有限公司 | Multi-camera monitoring system based on three-dimensional video frequency dynamic tracking and tracking method thereof |
| CN101106700A (en) * | 2007-08-01 | 2008-01-16 | 大连海事大学 | Intelligent target detail capturing device and method in video monitoring system |
| CN201248107Y (en) * | 2008-04-30 | 2009-05-27 | 深圳市飞瑞斯科技有限公司 | Master-slave camera intelligent video monitoring system |
-
2009
- 2009-11-27 CN CN2009102192128A patent/CN101720027B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1574961A (en) * | 2003-06-18 | 2005-02-02 | 松下电器产业株式会社 | Video surveillance system, surveillance video composition apparatus, and video surveillance server |
| CN1658670A (en) * | 2004-02-20 | 2005-08-24 | 上海银晨智能识别科技有限公司 | Intelligent tracking monitoring system with multi-camera |
| CN1976445A (en) * | 2006-12-15 | 2007-06-06 | 上海鼎业电子科技有限公司 | Multi-camera monitoring system based on three-dimensional video frequency dynamic tracking and tracking method thereof |
| CN101106700A (en) * | 2007-08-01 | 2008-01-16 | 大连海事大学 | Intelligent target detail capturing device and method in video monitoring system |
| CN201248107Y (en) * | 2008-04-30 | 2009-05-27 | 深圳市飞瑞斯科技有限公司 | Master-slave camera intelligent video monitoring system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101720027A (en) | 2010-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101720027B (en) | Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera | |
| CN107659774B (en) | Video imaging system and video processing method based on multi-scale camera array | |
| US11457157B2 (en) | High dynamic range processing based on angular rate measurements | |
| CN103905792B (en) | A kind of 3D localization methods and device based on PTZ CCTV cameras | |
| US20140347439A1 (en) | Mobile device and system for generating panoramic video | |
| CN108141568B (en) | OSD information generation camera, synthesis terminal device and sharing system | |
| WO2018103233A1 (en) | Virtual reality-based viewing method, device, and system | |
| CN104735408B (en) | A kind of police vehicle mounted surveillance method in no dead angle and monitoring system | |
| CN108848354B (en) | VR content camera system and working method thereof | |
| CN107018386A (en) | A kind of video flowing multiresolution observation system | |
| CN114268736B (en) | Tower foundation ball-type camera shooting method with high space coverage | |
| CN204168378U (en) | A kind of panoramic shooting system | |
| CN112470189B (en) | Occlusion cancellation for light field systems | |
| CN108111753A (en) | A kind of high-resolution real time panoramic monitoring device and monitoring method | |
| CN202721763U (en) | Panoramic video acquisition device | |
| CN104539893A (en) | Method, device and system for achieving virtual PTZ monitoring effect | |
| KR101625471B1 (en) | Method and apparatus for enhancing resolution of popular low cost thermal image camera | |
| CN107454326B (en) | Method for panoramic shooting by using fisheye lens, camera and panoramic shooting system | |
| CN109327652A (en) | A kind of ultrahigh resolution monitoring display device | |
| CN202818497U (en) | Electronic PTZ device capable of monitoring based on high-definition digital camera | |
| CN113660456A (en) | Method for cooperatively acquiring multi-target videos with different resolutions by variable-focus array camera | |
| US9609211B2 (en) | Method of image conversion operation for panorama dynamic IP camera | |
| CN106060481A (en) | Video collection method and device of pan-tilt-zoom camera | |
| CN206835216U (en) | Using single high-definition full views optical lens super low-power consumption camera system and device | |
| Higa et al. | Employing light field cameras in surveillance: An analysis of light field cameras in a surveillance scenario |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110601 Termination date: 20171127 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |