CN104506840A - Real-time stereoscopic video stitching device and real-time stereoscopic video feature method - Google Patents

Real-time stereoscopic video stitching device and real-time stereoscopic video feature method Download PDF

Info

Publication number
CN104506840A
CN104506840A CN201410833096.XA CN201410833096A CN104506840A CN 104506840 A CN104506840 A CN 104506840A CN 201410833096 A CN201410833096 A CN 201410833096A CN 104506840 A CN104506840 A CN 104506840A
Authority
CN
China
Prior art keywords
video
real time
real
monitoring
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410833096.XA
Other languages
Chinese (zh)
Other versions
CN104506840B (en
Inventor
蔡晓东
王丽娟
梁奔香
杨超
刘馨婷
华娜
吴迪
陈文竹
朱利伟
甘凯今
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GUILIN TOPINTELLIGENT COMMUNICATION TECHNOLOGY Co Ltd
Original Assignee
GUILIN TOPINTELLIGENT COMMUNICATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GUILIN TOPINTELLIGENT COMMUNICATION TECHNOLOGY Co Ltd filed Critical GUILIN TOPINTELLIGENT COMMUNICATION TECHNOLOGY Co Ltd
Priority to CN201410833096.XA priority Critical patent/CN104506840B/en
Publication of CN104506840A publication Critical patent/CN104506840A/en
Application granted granted Critical
Publication of CN104506840B publication Critical patent/CN104506840B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention relates to a real-time stereoscopic video stitching device. The device comprises a stereoscopic camera device used for collecting video data in a monitoring place in real time, a real-time video stitching module used for stitching the video data, a stereoscopic video processing module used for processing panoramic real-time stereoscopic video and a video monitoring display module used for invoking optimal observation point pictures for users. The invention further relates to a real-time stereoscopic video feature method. By the real-time stereoscopic video stitching device, larger picture content can be obtained, so that information amount of live image information is increased to some extent, and useful information of live scenes is increased; besides, the optimal observation point images in all available front-end video resources in grids are invoked through the real-time stereoscopic video feature method, so that the users can monitor in broad scenes while optimal detail observation effect is acquired.

Description

A kind of real time tridimensional video splicing apparatus and close up method
Technical field
The present invention relates to technical field of video processing, particularly relate to a kind of real time tridimensional video splicing apparatus and close up method.
Background technology
Video monitoring has been widely used in daily life and some special application fields of society.Simultaneously people's huge power of also seeing video monitoring with to the tremendous contribution done by human society.Current Video Supervision Technique substantially all based on simple eye picture pick-up device, acquisition be all the image of a viewpoint.The live state information data of image definition or photographed scene all have certain loss.
In recent years, along with popularizing of 3 D stereo application, the research of stereoscopic image and video starts to become focus.Three-dimensional video-frequency technology (3D video technique) is the developing direction of Future Multimedia technology, and three-dimensional video-frequency can provide relief Novel video technology.Compared with single channel video, three-dimensional video-frequency generally has two passages, and data volume will be far longer than single channel video.The third dimension that three-dimensional video-frequency can provide human vision to experience.The application relevant to image and video is also constantly being widened, such as: digital television broadcasting, and video request program, long-distance education and medical treatment, wireless multimedia communication etc.
In large-range monitoring occasion, the monitoring of stereoscopic full views scope should be obtained, obtain the details of local again, use single equipment to be difficult to accomplish.
Summary of the invention
Technical problem to be solved by this invention is to provide a kind of real time tridimensional video splicing apparatus and close up method, larger image content can be obtained, thus improve the amount of information of live image information to a certain extent and increase the useful information of live scene, and the point of observation image of the best in grid in all available head end video resources is called by real time tridimensional video close up method, thus make user while broad scene monitoring, best details observing effect can be obtained.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of real time tridimensional video splicing apparatus, comprises stereo camera apparatus, real-time video concatenation module, three-dimensional video-frequency processing module and video monitoring display module;
Described stereo camera apparatus, for gathering video data in real time in monitoring place, and is sent to described real time tridimensional video concatenation module by this video data;
Described real-time video concatenation module, for being spliced by the described video data sent, through being spliced to form panorama real time tridimensional video splicing picture, realizing real-time three-dimensional video-frequency and showing;
Described three-dimensional video-frequency processing module, for described panorama real time tridimensional video split picture veil is formatted, and give different grids according to different monitoring emergency plan model by front monitoring front-end Resourse Distribute all in monitoring place, make these grids become the elementary cell realizing the local detail observing effect obtaining the best;
Described video monitoring display module, for from grid for user calls best point of observation picture.
The invention has the beneficial effects as follows: larger image content can be obtained by real time tridimensional video splicing apparatus, thus improve the amount of information of live image information to a certain extent and increase the useful information of live scene, and the point of observation image of the best in grid in all available head end video resources is called by real time tridimensional video close up method, thus make user while broad scene monitoring, best details observing effect can be obtained.
On the basis of technique scheme, the present invention can also do following improvement.
Further, for user calls best point of observation picture from grid, be implemented as: be that user calls best point of observation picture by front monitoring front-end resources all in grid according to the system of selection of ABVPS automatic optimal point of observation.
Grid image to be amplified to according to the observation habit of user by ABVPS (Automatic Best View Point Selection) automatic optimal point of observation system of selection can see local message clearly by point of observation image call best in available head end video resources all in certain grid, by the described point of observation image calling the best in grid in all available head end video resources.
The system of selection of ABVPS automatic optimal point of observation detects pedestrian by hog+svm algorithm in monitored picture, and obtain pedestrian position, multiple target then camera carries out poll, and namely camera is to each target observations after 10 seconds, then observes next target.
Obtain focus according to ABVPS, such as, obtain focus by the mode of pedestrian detection, when there is multiple focus, adopt the mode of poll, obtain monitoring emergency plan model.
Further, described front monitoring front-end resource comprises video information, facility information, control information and video interlink warning message.
Further, described stereo camera apparatus comprises shooting part, disk fixed mount, support bar and fixing foot rest, described support bar is fixed on described fixing foot rest, described support bar through described disk fixed mount the center of circle and described disk fixed mount is fixed on described support bar, described shooting part is arranged on described disk fixed mount.
Further, described shooting part is provided with multiple, and described disk fixed mount is also provided with multiple, and the quantity of described shooting part is identical with the quantity of described disk fixed mount, and multiple described disk fixed mount coaxial line is arranged on described support bar.
Further, multiple described shooting part is positioned on same axis, and has different camera angle.
Further, the distance between two adjacent described shooting parts is less than 2.5m.
Further, described shooting part comprises gun type camera or ball-shaped camera.
Another technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of real time tridimensional video close up method, adopts described real time tridimensional video splicing apparatus, comprises the steps:
Steps A: stereo camera apparatus gathers video data in real time in monitoring place, and this video data is sent to described real time tridimensional video concatenation module;
Step B: the described video data sent splices by real-time video concatenation module, through being spliced to form panorama real time tridimensional video splicing picture;
Step C: described panorama real time tridimensional video split picture veil is formatted by three-dimensional video-frequency processing module, and give different grids according to different monitoring emergency plan model by front monitoring front-end Resourse Distribute all in monitoring place;
Step D: video monitoring display module from grid for user calls best point of observation picture.
On the basis of technique scheme, the present invention can also do following improvement.
Further, in described step D from grid for user calls best point of observation picture, be implemented as: be that user calls best point of observation picture by front monitoring front-end resources all in grid according to the system of selection of ABVPS automatic optimal point of observation.
Accompanying drawing explanation
Fig. 1 is the module frame chart of real time tridimensional video splicing apparatus of the present invention;
Fig. 2 is the structural representation of stereo camera apparatus of the present invention;
Fig. 3 is the method flow diagram of real time tridimensional video close up method of the present invention.
In accompanying drawing, the component names representated by each mark is as follows:
1, stereo camera apparatus, 2, real-time video concatenation module, 3, three-dimensional video-frequency processing module, 4, video monitoring display module, 101, shooting part, 102, disk fixed mount, 103, support bar, 104, fixing foot rest.
Embodiment
Be described principle of the present invention and feature below in conjunction with accompanying drawing, example, only for explaining the present invention, is not intended to limit scope of the present invention.
As shown in Figure 1, a kind of real time tridimensional video splicing apparatus, comprises stereo camera apparatus 1, real-time video concatenation module 2, three-dimensional video-frequency processing module 3 and video monitoring display module 4;
Described stereo camera apparatus 1, for gathering video data in real time in monitoring place, and is sent to described real time tridimensional video concatenation module 2 by this video data;
Described real-time video concatenation module 2, for being spliced by the described video data sent, through being spliced to form panorama real time tridimensional video splicing picture, realizing real-time three-dimensional video-frequency and showing;
Described three-dimensional video-frequency processing module 3, for described panorama real time tridimensional video split picture veil is formatted, and give different grids according to different monitoring emergency plan model by front monitoring front-end Resourse Distribute all in monitoring place, make these grids become the elementary cell realizing the local detail observing effect obtaining the best;
Described video monitoring display module 4, for from grid for user calls best point of observation picture.
For user calls best point of observation picture from grid, be implemented as: be that user calls best point of observation picture by front monitoring front-end resources all in grid according to the system of selection of ABVPS automatic optimal point of observation.
Grid image to be amplified to according to the observation habit of user by ABVPS (Automatic Best View Point Selection) automatic optimal point of observation system of selection can see local message clearly by point of observation image call best in available head end video resources all in certain grid, by the described point of observation image calling the best in grid in all available head end video resources.
The system of selection of ABVPS automatic optimal point of observation detects pedestrian by hog+svm algorithm in monitored picture, and obtain pedestrian position, multiple target then camera carries out poll, and namely camera is to each target observations after 10 seconds, then observes next target.
Obtain focus according to ABVPS, such as, obtain focus by the mode of pedestrian detection, when there is multiple focus, adopt the mode of poll, obtain monitoring emergency plan model.
Described front monitoring front-end resource comprises video information, facility information, control information and video interlink warning message.
As shown in Figure 2, described stereo camera apparatus 1 comprises shooting part 101, disk fixed mount 102, support bar 103 and fixing foot rest 104, described support bar 103 is fixed on described fixing foot rest 104, described support bar 103 through described disk fixed mount 102 the center of circle and described disk fixed mount 102 is fixed on described support bar 103, described shooting part 101 is arranged on described disk fixed mount 102.
Described shooting part 101 is provided with multiple, and described disk fixed mount 102 is also provided with multiple, and the quantity of described shooting part 101 is identical with the quantity of described disk fixed mount 102, and multiple described disk fixed mount 102 coaxial line is arranged on described support bar 103.
Multiple described shooting part 101 is positioned on same axis, and has different camera angle.
Distance between adjacent two described shooting parts 101 is less than 2.5m.
Described shooting part 101 comprises gun type camera or ball-shaped camera.
As shown in Figure 3, a kind of real time tridimensional video close up method, adopts real time tridimensional video splicing apparatus, comprises the steps:
Steps A: stereo camera apparatus gathers video data in real time in monitoring place, and this video data is sent to described real time tridimensional video concatenation module;
Step B: the described video data sent splices by real-time video concatenation module, through being spliced to form panorama real time tridimensional video splicing picture;
Step C: described panorama real time tridimensional video split picture veil is formatted by three-dimensional video-frequency processing module, and give different grids according to different monitoring emergency plan model by front monitoring front-end Resourse Distribute all in monitoring place;
Step D: video monitoring display module from grid for user calls best point of observation picture.
In described step D from grid for user calls best point of observation picture, be implemented as: be that user calls best point of observation picture by front monitoring front-end resources all in grid according to the system of selection of ABVPS automatic optimal point of observation.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. a real time tridimensional video splicing apparatus, is characterized in that, comprises stereo camera apparatus (1), real-time video concatenation module (2), three-dimensional video-frequency processing module (3) and video monitoring display module (4);
Described stereo camera apparatus (1), for gathering video data in real time in monitoring place, and is sent to described real time tridimensional video concatenation module (2) by this video data;
Described real-time video concatenation module (2), for being spliced by the described video data sent, through being spliced to form panorama real time tridimensional video splicing picture;
Described three-dimensional video-frequency processing module (3), for being formatted by described panorama real time tridimensional video split picture veil, and gives different grids according to different monitoring emergency plan model by front monitoring front-end Resourse Distribute all in monitoring place;
Described video monitoring display module (4), for from grid for user calls best point of observation picture.
2. real time tridimensional video splicing apparatus according to claim 1, it is characterized in that, for user calls best point of observation picture from grid, be implemented as: be that user calls best point of observation picture by front monitoring front-end resources all in grid according to the system of selection of ABVPS automatic optimal point of observation.
3. real time tridimensional video splicing apparatus according to claim 1 and 2, is characterized in that, described front monitoring front-end resource comprises video information, facility information, control information and video interlink warning message.
4. real time tridimensional video splicing apparatus according to claim 1, it is characterized in that, described stereo camera apparatus (1) comprises shooting part (101), disk fixed mount (102), support bar (103) and fixing foot rest (104), described support bar (103) is fixed on described fixing foot rest (104), described support bar (103) through described disk fixed mount (102) the center of circle and described disk fixed mount (102) is fixed on described support bar (103), described shooting part (101) is arranged on described disk fixed mount (102).
5. real time tridimensional video splicing apparatus according to claim 4, it is characterized in that, described shooting part (101) is provided with multiple, described disk fixed mount (102) is also provided with multiple, and the quantity of described shooting part (101) is identical with the quantity of described disk fixed mount (102), multiple described disk fixed mount (102) coaxial line is arranged on described support bar (103).
6. real time tridimensional video splicing apparatus according to claim 5, is characterized in that, multiple described shooting part (101) is positioned on same axis, and has different camera angle.
7. real time tridimensional video splicing apparatus according to claim 5, is characterized in that, the distance between two adjacent described shooting parts (101) is less than 2.5m.
8. the real time tridimensional video splicing apparatus according to any one of claim 4 to 7, is characterized in that, described shooting part (101) comprises gun type camera or ball-shaped camera.
9. a real time tridimensional video close up method, is characterized in that, adopts arbitrary described real time tridimensional video splicing apparatus in claim 1 to 8, comprises the steps:
Steps A: stereo camera apparatus gathers video data in real time in monitoring place, and this video data is sent to described real time tridimensional video concatenation module;
Step B: the described video data sent splices by real-time video concatenation module, through being spliced to form panorama real time tridimensional video splicing picture;
Step C: described panorama real time tridimensional video split picture veil is formatted by three-dimensional video-frequency processing module, and give different grids according to different monitoring emergency plan model by front monitoring front-end Resourse Distribute all in monitoring place;
Step D: video monitoring display module from grid for user calls best point of observation picture.
10. real time tridimensional video close up method according to claim 9, it is characterized in that, in described step D from grid for user calls best point of observation picture, be implemented as: be that user calls best point of observation picture by front monitoring front-end resources all in grid according to the system of selection of ABVPS automatic optimal point of observation.
CN201410833096.XA 2014-12-25 2014-12-25 A kind of real time tridimensional video splicing apparatus and close up method Expired - Fee Related CN104506840B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410833096.XA CN104506840B (en) 2014-12-25 2014-12-25 A kind of real time tridimensional video splicing apparatus and close up method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410833096.XA CN104506840B (en) 2014-12-25 2014-12-25 A kind of real time tridimensional video splicing apparatus and close up method

Publications (2)

Publication Number Publication Date
CN104506840A true CN104506840A (en) 2015-04-08
CN104506840B CN104506840B (en) 2017-07-28

Family

ID=52948553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410833096.XA Expired - Fee Related CN104506840B (en) 2014-12-25 2014-12-25 A kind of real time tridimensional video splicing apparatus and close up method

Country Status (1)

Country Link
CN (1) CN104506840B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106210703A (en) * 2016-09-08 2016-12-07 北京美吉克科技发展有限公司 The utilization of VR environment bust shot camera lens and display packing and system
CN106569588A (en) * 2015-09-30 2017-04-19 韩相善 Product augmented reality application system having function of using displayed content
CN106973282A (en) * 2017-03-03 2017-07-21 深圳百科信息技术有限公司 A kind of panoramic video feeling of immersion Enhancement Method and system
CN107454438A (en) * 2016-06-01 2017-12-08 深圳看到科技有限公司 Panoramic video preparation method
CN107705253A (en) * 2017-10-26 2018-02-16 中国科学院长春光学精密机械与物理研究所 A kind of method and device for generating video pump source
CN108419042A (en) * 2018-01-12 2018-08-17 孙向东 Full dimension picture monitoring collection control system and intelligent monitor system
CN110297333A (en) * 2019-07-08 2019-10-01 中国人民解放军陆军装甲兵学院 A kind of light field display system adjusting method and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1605933A (en) * 2003-10-10 2005-04-13 百呈科技股份有限公司 Coordinate correspondence method and image monitoring auxiliary device applying the same
CN101646067A (en) * 2009-05-26 2010-02-10 华中师范大学 Digital full-space intelligent monitoring system and method
CN101707671A (en) * 2009-11-30 2010-05-12 杭州普维光电技术有限公司 Panoramic camera and PTZ camera combined control method and panoramic camera and PTZ camera combined control device
CN102148965A (en) * 2011-05-09 2011-08-10 上海芯启电子科技有限公司 Video monitoring system for multi-target tracking close-up shooting
CN102521816A (en) * 2011-11-25 2012-06-27 浪潮电子信息产业股份有限公司 Real-time wide-scene monitoring synthesis method for cloud data center room
CN102938827A (en) * 2012-11-29 2013-02-20 深圳英飞拓科技股份有限公司 Stratified monitoring command system and cross-camera virtual tracking method
CN103533309A (en) * 2013-10-18 2014-01-22 中国民用航空总局第二研究所 Method and distributed linked system capable of simultaneously performing panoramic display and local lookup

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1605933A (en) * 2003-10-10 2005-04-13 百呈科技股份有限公司 Coordinate correspondence method and image monitoring auxiliary device applying the same
CN101646067A (en) * 2009-05-26 2010-02-10 华中师范大学 Digital full-space intelligent monitoring system and method
CN101707671A (en) * 2009-11-30 2010-05-12 杭州普维光电技术有限公司 Panoramic camera and PTZ camera combined control method and panoramic camera and PTZ camera combined control device
CN102148965A (en) * 2011-05-09 2011-08-10 上海芯启电子科技有限公司 Video monitoring system for multi-target tracking close-up shooting
CN102521816A (en) * 2011-11-25 2012-06-27 浪潮电子信息产业股份有限公司 Real-time wide-scene monitoring synthesis method for cloud data center room
CN102938827A (en) * 2012-11-29 2013-02-20 深圳英飞拓科技股份有限公司 Stratified monitoring command system and cross-camera virtual tracking method
CN103533309A (en) * 2013-10-18 2014-01-22 中国民用航空总局第二研究所 Method and distributed linked system capable of simultaneously performing panoramic display and local lookup

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106569588A (en) * 2015-09-30 2017-04-19 韩相善 Product augmented reality application system having function of using displayed content
CN106569588B (en) * 2015-09-30 2019-06-11 韩相善 Carry the product augmented reality application program system using function of displayed content
CN107454438A (en) * 2016-06-01 2017-12-08 深圳看到科技有限公司 Panoramic video preparation method
CN107454438B (en) * 2016-06-01 2020-03-13 深圳看到科技有限公司 Panoramic video production method
CN106210703A (en) * 2016-09-08 2016-12-07 北京美吉克科技发展有限公司 The utilization of VR environment bust shot camera lens and display packing and system
CN106973282A (en) * 2017-03-03 2017-07-21 深圳百科信息技术有限公司 A kind of panoramic video feeling of immersion Enhancement Method and system
CN107705253A (en) * 2017-10-26 2018-02-16 中国科学院长春光学精密机械与物理研究所 A kind of method and device for generating video pump source
CN107705253B (en) * 2017-10-26 2021-05-04 中国科学院长春光学精密机械与物理研究所 Method and device for generating video excitation source
CN108419042A (en) * 2018-01-12 2018-08-17 孙向东 Full dimension picture monitoring collection control system and intelligent monitor system
CN108419042B (en) * 2018-01-12 2020-06-09 孙向东 Full-dimensional picture monitoring acquisition control system and intelligent monitoring system
CN110297333A (en) * 2019-07-08 2019-10-01 中国人民解放军陆军装甲兵学院 A kind of light field display system adjusting method and system
CN110297333B (en) * 2019-07-08 2022-01-18 中国人民解放军陆军装甲兵学院 Light field display system adjusting method and system

Also Published As

Publication number Publication date
CN104506840B (en) 2017-07-28

Similar Documents

Publication Publication Date Title
CN104506840A (en) Real-time stereoscopic video stitching device and real-time stereoscopic video feature method
US20150358539A1 (en) Mobile Virtual Reality Camera, Method, And System
CN107205122A (en) The live camera system of multiresolution panoramic video and method
CN104902263A (en) System and method for showing image information
CN104219584A (en) Reality augmenting based panoramic video interaction method and system
EP2892205B1 (en) Method and device for determining a sharing terminal
CN109960969B (en) Method, device and system for generating moving route
CN103488040A (en) Stereo panoramic image synthesis method and related stereo camera
JP2019103067A (en) Information processing device, storage device, image processing device, image processing system, control method, and program
CN204681518U (en) A kind of panorama image information collecting device
CN108769755A (en) High-resolution full view frequency live streaming camera system and method
CN113038117B (en) Panoramic playing method and device based on multiple visual angles
CN108153412A (en) LAN VR live broadcasting methods and system
CN102893614A (en) Method and apparatus for auto-convergence based on auto focus point for stereoscopic frame
CN103051866B (en) network 3D video monitoring system, method and video processing platform
CN114363530B (en) Cloud video monitoring method and monitoring platform based on hundred million-level pixel equipment
CN110113628A (en) A kind of panorama live broadcast system under video-splicing server and moving condition
CN107454326B (en) Method for panoramic shooting by using fisheye lens, camera and panoramic shooting system
CN114040184A (en) Image display method, system, storage medium and computer program product
CN111277797B (en) VR (virtual reality) stereoscopic imaging system for security monitoring
CN108184078A (en) A kind of processing system for video and its method
US9325963B2 (en) Device and method for rendering and delivering 3-D content
CN106961551A (en) A kind of VR panoramic videos later stage stabilization technology
CN109981969B (en) Intelligent electronic equipment, image processing unit and image processing method
CN110602480A (en) Method, device and system for sharing scene by adopting augmented reality

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170728

Termination date: 20201225

CF01 Termination of patent right due to non-payment of annual fee