CN103595954A - Method and system for multi-video-image fusion processing based on position information - Google Patents
Method and system for multi-video-image fusion processing based on position information Download PDFInfo
- Publication number
- CN103595954A CN103595954A CN201210292372.7A CN201210292372A CN103595954A CN 103595954 A CN103595954 A CN 103595954A CN 201210292372 A CN201210292372 A CN 201210292372A CN 103595954 A CN103595954 A CN 103595954A
- Authority
- CN
- China
- Prior art keywords
- video
- video source
- fusion
- source
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method and system for multi-video-image fusion processing based on position information. The system includes a plurality of video-source devices, a service control system and a client. The service control system refers to position information of each video source and with respect to a plurality of video sources which are adjacent in position, the system judges whether an inclusion relation, that is, a global and local relation, exists in the content of video pictures of the video sources. The service control system uses a global video-source picture as a base picture and displays local pictures of other video sources on the global picture in an overlapping manner according to a relative-position relation between the global video source and the other video resources; and with respect to video pictures input by a plurality paths of video sources, in video pictures of which, the inclusion relation does not exist, the video pictures are displayed on corresponding positions of a client interface in an arrayed manner according to the relative-position relation of the video resources. The method and system for the multi-video-image fusion processing based on the position information are capable of helping a user to watch a plurality paths of videos and at the same time grasp global and local video images and real positions and mutual relations of the images in space so that user management efficiency is improved.
Description
Technical field
The present invention relates to technical field of video image processing, is specifically a kind of method and system of many video images fusion treatment of position-based information.
Background technology
Along with the fast development of national economy and urban construction, various video systems are more and more applied to the each side of people's life and work.
Wherein, video monitoring system is a kind of common Video Applications system, in urban public security management, traffic administration, has obtained a large amount of practical applications.Exemplary video supervisory control system generally consists of front end watch-dog, Business Management Platform and monitor client.
Front end watch-dog is deployed in monitoring site, realizes the function that various information is gathered, as collection and the control of the information such as video, audio frequency, video intelligent analysis and relevant parameter.
Business Management Platform is realized the management of whole system and operation flow, control, and the function such as warning processing, video recording, playing back videos, user management.
Monitor client is deployed in user's side, realizes the function of monitor video centralized displaying, video recording inquiry playback, operation system management, and typical monitor client comprises monitoring large-screen, PC etc.
Along with progressively going deep into of application, the scale of each video monitoring system is increasing, from tens to up to a hundred, even more.In order to facilitate customer administrator's quick-searching video content, the mode that general supervisory control system provides the mode of split screen that many pictures output display is provided, as modes such as nine split screens, 16 split screens, but along with the monitor client increase of output video way simultaneously, also brought new problem, monitor client is just presented at multi-channel video on large-screen at present, according to actual deployment way or relative position relation Dui Ge road video, do not manage, so, customer administrator is when watching video, cannot be by the video content Yu Gai road video showing the physical location in space, and the relative position relation of each front end watch-dog is set up corresponding relation, especially, if in the similar situation of scene of each road front end watch-dog monitoring, the video that user management personnel cannot show by monitor client more judges the physical location that it is corresponding.
Summary of the invention
In order to solve the problems of the prior art, the invention provides a kind of many video images of position-based information, video traffic control system is by gathering GPS, the positional information of the video source of the location information system inputs such as RFID, by the vision signal of a plurality of video source in video system, real space position according to video source in system, and the relative position between video source device, carry out the fusion treatment of video demonstration, facilitate customer administrator when checking video, grasp the locus of video source in whole video system and with the relative position of other video source.
One of object of the present invention is, a kind of many video images fusion processing system of position-based information is provided, described system comprises following part: as shown in Figure 1, video source device 101 by the video streaming gathering to service control system 102, service control system 102 carries out the video flowing collecting to be transferred to client 103 after fusion treatment, by client 103 display of video content.Video acquisition terminal comprises: video module 1011, is used to provide collection and the control of the information such as video, audio frequency, video intelligent analysis and relevant parameter; Position module 1012, can be GPS module, RFID module or other locating modules, is used for obtaining positional information.Service control system comprises, and video information process engine 1021, for realizing the video processing function such as reception, storage of video data of a plurality of video source of described many video images fusion processing system; Position information process engine 1022, for managing position information and the relative position of a plurality of video source of described many video images fusion processing system; Video fusion processing module 1023, for according to the relative position relation of multipath video source, completes the fusion Graphics Processing function of multipath video source; User interaction process module 1024, for receiving client 103 users' Service control request, and the control function that provides video fusion to show to client 103.As shown in Figure 2, video fusion processing module comprises: video is demarcated administration module 201, for according to the positional information of a plurality of video source, completes the staking-out work of video source display position on client control picture; User's control and management module 202, shows control command for receiving the video of client input; Video fusion administration module 203, the relative position relation based on video source, manages various video fusion display mode, and corresponding with the actual relative position relation of each video source; Image display management module 204, according to the video fusion display strategy of video fusion administration module 203, completes the fusion Presentation Function of multipath video source, and exports to client and show.
One of object of the present invention is, a kind of many video images method for amalgamation processing of position-based information is provided, and described method comprises the following steps:
Service control system is retrieved the positional information of the multipath video source of input, and according to position neighbouring relations, video source is divided into groups;
Service control system carries out images match for the video image of every group of adjacent video source of position, the video source that includes other video source shooting areas or picture for video image is defined as overall video source, and the video source that shooting area or picture are comprised in overall video source is defined as local video source;
Service control system judges in every group of video source, whether there is overall video source;
If there is overall video source in this group video source, service control system is according to each local video source and the relative position relation of overall video source in world coordinate system of record, calculate the relative position of each local video source in overall video source image pixel coordinate system, completing place is demarcated; On the position of the local video source that operation system calibrates on base map, according to the local video source image of suitable displaying ratio Overlapping display, complete the demonstration that video fusion is processed;
If there is not overall video source in this group video source, according to the relative position relation of each local video source of operation system record, and according to the display resolution of client, complete the location position of each video source in client display screen; Operation system, according to the relative position of each video source calibrating, according to suitable displaying ratio, is arranged and is presented on client display interface, completes the demonstration that video fusion is processed.
Beneficial effect of the present invention is, the video image that effectively represents related video source input on a plurality of positions, make user when watching multi-channel video, can grasp the video image of overall situation and partial situation simultaneously, and each video image physical location and correlation spatially, improved user management efficiency.
Accompanying drawing explanation
Fig. 1 is the structured flowchart of many video images fusion processing system of the present invention
Fig. 2 is the structured flowchart of many video images fusion processing system video fusion processing module of the present invention
Fig. 3 is the fusion treatment flow chart that the present invention is based on many video images of positional information
Embodiment
Below in conjunction with accompanying drawing explanation the specific embodiment of the present invention.As shown in Figure 1, the system of many video images fusion treatment of described a kind of position-based information consists of following components:
As shown in Figure 2, video fusion processing module comprises: video is demarcated administration module 201, for according to the positional information of a plurality of video source, completes the staking-out work of video source display position on client control picture; User's control and management module 202, shows control command for receiving the video of client input; Video fusion administration module 203, the relative position relation based on video source, manages various video fusion display mode, and corresponding with the actual relative position relation of each video source; Image display management module 204, according to the video fusion display strategy of video fusion administration module 203, completes the fusion Presentation Function of multipath video source, and exports to client and show.
As shown in Figure 3, the method for many video images fusion treatment of described a kind of position-based information, comprises following steps:
1) service control system reads the multi-channel video source data of input;
2) retrieve the positional information of each video source;
3) judge whether the video source that position is adjacent, if satisfied condition, enter step 4, otherwise, the multi-channel video source images of input is directly shown respectively in client;
4) according to the neighbouring relations of position, video source is divided into groups;
5) video image of video source input in group is mated one by one, if comprise the picture material of other video source or the region of its demonstration in group in certain video source image, think that this video source is overall video source.In the video image of every group of video source input of interpretation, whether comprise global image, if satisfied condition, enter step 6, otherwise, step 9 entered;
6) select global image as system, to merge the base map showing;
7), by the non-global image in this video group, according to its relative coordinate relation with respect to overall video image video source in world coordinate system, calculate its relative position in global image pixel coordinates system;
8) utilize the calibration result of video camera, non-global image is superimposed upon on global image;
9) for the video group that does not comprise global image, according between video source at the relative position relation of world coordinate system, demarcate each video source at the different display positions of client;
10), according to the display position arranging, this group video source is arranged to demonstration.
Especially, in one group of video source, there is N video source that global image is provided, N>1, service control system is according to above-described method step, forms to take respectively the multi-channel video that N road global image is base map and merge the image showing.
Special again, in one group of video source image, there is the image inclusion relation of many levels, for example, the video image of certain road video source is the global image that comprises some video source image, but be also the local video image comprising of some other video source simultaneously, service control system continues this group video source to segment, until only include one deck overall situation and local relation in video group, same video source allows to exist in the adjacent video group in a plurality of positions.
Claims (3)
1. a method for many video images fusion treatment of position-based information, is characterized in that, described method comprises the following steps:
Service control system is retrieved the positional information of the multipath video source of input, and according to position neighbouring relations, video source is divided into groups;
Service control system carries out images match for the video image of every group of adjacent video source of position, the video source that includes other video source shooting areas or picture for video image is defined as overall video source, and the video source that shooting area or picture are comprised in overall video source is defined as local video source;
Service control system judges in every group of video source, whether there is overall video source;
If there is overall video source in this group video source, service control system is according to each local video source and the relative position relation of overall video source in world coordinate system of record, calculate the relative position of each local video source in overall video source image pixel coordinate system, completing place is demarcated; On the position of the local video source that operation system calibrates on base map, according to the local video source image of suitable displaying ratio Overlapping display, complete the demonstration that video fusion is processed;
If there is not overall video source in this group video source, according to the relative position relation of each local video source of operation system record, and according to the display resolution of client, complete the location position of each video source in client display screen; Operation system, according to the relative position of each video source calibrating, according to suitable displaying ratio, is arranged and is presented on client display interface, completes the demonstration that video fusion is processed.
2. a system for many video images fusion treatment of position-based information, is characterized in that, this system comprises:
Video source device is by the video streaming gathering to service control system, and service control system carries out the video flowing collecting to be transferred to client after fusion treatment, by client display of video content;
Video acquisition terminal comprises: video module, is used to provide collection and the control of the information such as video, audio frequency, video intelligent analysis and relevant parameter; Position module, can be GPS module, RFID module or other locating modules, is used for obtaining positional information.
Service control system comprises, and video information process engine, for realizing the video processing function such as reception, storage of video data of a plurality of video source of described many video images fusion processing system; Position information process engine, for managing position information and the relative position of a plurality of video source of described many video images fusion processing system; Video fusion processing module, for according to the relative position relation of multipath video source, completes the fusion Graphics Processing function of multipath video source; User interaction process module, for receiving client user's Service control request, and the control function that provides video fusion to show to client.
3. system according to claim 2, is characterized in that, described video fusion processing module comprises:
Video is demarcated administration module, for according to the positional information of a plurality of video source, completes the staking-out work of video source display position on client control picture;
User's control and management module, shows control command for receiving the video of client input;
Video fusion administration module, the relative position relation based on video source, manages various video fusion display mode, and corresponding with the actual relative position relation of each video source;
Image display management module, according to the video fusion display strategy of video fusion administration module, completes the fusion Presentation Function of multipath video source, and exports to client and show.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210292372.7A CN103595954A (en) | 2012-08-16 | 2012-08-16 | Method and system for multi-video-image fusion processing based on position information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210292372.7A CN103595954A (en) | 2012-08-16 | 2012-08-16 | Method and system for multi-video-image fusion processing based on position information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103595954A true CN103595954A (en) | 2014-02-19 |
Family
ID=50085920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210292372.7A Pending CN103595954A (en) | 2012-08-16 | 2012-08-16 | Method and system for multi-video-image fusion processing based on position information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103595954A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104375509A (en) * | 2014-12-11 | 2015-02-25 | 山东大学 | Information fusion positioning system and method based on RFID (radio frequency identification) and vision |
| CN106055610A (en) * | 2016-05-25 | 2016-10-26 | 维沃移动通信有限公司 | Retrieval method for voice messages and mobile terminal |
| CN109151341A (en) * | 2018-09-27 | 2019-01-04 | 中国船舶重工集团公司第七0九研究所 | A kind of embedded platform multi-source HD video fusion realization system and method |
| CN109873980A (en) * | 2019-01-24 | 2019-06-11 | 深圳市景阳信息技术有限公司 | Video monitoring method, device and terminal device |
| CN111371985A (en) * | 2019-09-17 | 2020-07-03 | 杭州海康威视系统技术有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN112188269A (en) * | 2020-09-28 | 2021-01-05 | 北京达佳互联信息技术有限公司 | Video playing method and device and video generating method and device |
| CN113556515A (en) * | 2021-07-20 | 2021-10-26 | 铜仁市市政公用设施管理处 | A monitoring device for garden building engineering management |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005191934A (en) * | 2003-12-25 | 2005-07-14 | Funai Electric Co Ltd | Monitoring camera and monitoring camera system |
| CN101272456A (en) * | 2007-03-24 | 2008-09-24 | 阎跃军 | Locating navigation information and image information amalgamated portable digital shooting system |
| CN101277429A (en) * | 2007-03-27 | 2008-10-01 | 中国科学院自动化研究所 | Method and system for amalgamation process and display of multipath video information when monitoring |
| CN101312526A (en) * | 2008-06-26 | 2008-11-26 | 天津市亚安科技电子有限公司 | Full-view cooperative video monitoring apparatus and full-view image splicing method |
| CN101646067A (en) * | 2009-05-26 | 2010-02-10 | 华中师范大学 | Digital full-space intelligent monitoring system and method |
| CN101710976A (en) * | 2009-11-16 | 2010-05-19 | 中国电信股份有限公司 | Security-protection management system and monitoring method |
| CN101778236A (en) * | 2009-01-14 | 2010-07-14 | 北京风格九州文化传播有限公司 | Method for managing space-time correlation multi-channel video |
| CN102256111A (en) * | 2011-07-17 | 2011-11-23 | 西安电子科技大学 | Multi-channel panoramic video real-time monitoring system and method |
-
2012
- 2012-08-16 CN CN201210292372.7A patent/CN103595954A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005191934A (en) * | 2003-12-25 | 2005-07-14 | Funai Electric Co Ltd | Monitoring camera and monitoring camera system |
| CN101272456A (en) * | 2007-03-24 | 2008-09-24 | 阎跃军 | Locating navigation information and image information amalgamated portable digital shooting system |
| CN101277429A (en) * | 2007-03-27 | 2008-10-01 | 中国科学院自动化研究所 | Method and system for amalgamation process and display of multipath video information when monitoring |
| CN101312526A (en) * | 2008-06-26 | 2008-11-26 | 天津市亚安科技电子有限公司 | Full-view cooperative video monitoring apparatus and full-view image splicing method |
| CN101778236A (en) * | 2009-01-14 | 2010-07-14 | 北京风格九州文化传播有限公司 | Method for managing space-time correlation multi-channel video |
| CN101646067A (en) * | 2009-05-26 | 2010-02-10 | 华中师范大学 | Digital full-space intelligent monitoring system and method |
| CN101710976A (en) * | 2009-11-16 | 2010-05-19 | 中国电信股份有限公司 | Security-protection management system and monitoring method |
| CN102256111A (en) * | 2011-07-17 | 2011-11-23 | 西安电子科技大学 | Multi-channel panoramic video real-time monitoring system and method |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104375509A (en) * | 2014-12-11 | 2015-02-25 | 山东大学 | Information fusion positioning system and method based on RFID (radio frequency identification) and vision |
| CN106055610A (en) * | 2016-05-25 | 2016-10-26 | 维沃移动通信有限公司 | Retrieval method for voice messages and mobile terminal |
| CN106055610B (en) * | 2016-05-25 | 2020-02-14 | 维沃移动通信有限公司 | Voice information retrieval method and mobile terminal |
| CN109151341A (en) * | 2018-09-27 | 2019-01-04 | 中国船舶重工集团公司第七0九研究所 | A kind of embedded platform multi-source HD video fusion realization system and method |
| CN109873980A (en) * | 2019-01-24 | 2019-06-11 | 深圳市景阳信息技术有限公司 | Video monitoring method, device and terminal device |
| CN111371985A (en) * | 2019-09-17 | 2020-07-03 | 杭州海康威视系统技术有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN112188269A (en) * | 2020-09-28 | 2021-01-05 | 北京达佳互联信息技术有限公司 | Video playing method and device and video generating method and device |
| CN113556515A (en) * | 2021-07-20 | 2021-10-26 | 铜仁市市政公用设施管理处 | A monitoring device for garden building engineering management |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103595954A (en) | Method and system for multi-video-image fusion processing based on position information | |
| CN108960566B (en) | Traffic visual monitoring system | |
| CN107958490B (en) | Hands-free augmented reality for wireless communication devices | |
| JP6399324B1 (en) | Video management system for garbage truck | |
| US20170102910A1 (en) | Communication to an Audience at an Event | |
| CN108446015B (en) | Exhibition method and exhibition system based on mixed reality | |
| CN101710976B (en) | Security-protection management system and monitoring method | |
| CN103607568A (en) | Stereo street scene video projection method and system | |
| TW200602859A (en) | Method for searching image differences in recorded video data of surveillance system | |
| EP2940986B1 (en) | Image processing device and method, and program | |
| US20230162449A1 (en) | Systems and methods for data transmission and rendering of virtual objects for display | |
| US20090310866A1 (en) | Superimposition information presentation apparatus and superimposition information presentation system | |
| CN109274926A (en) | A kind of image processing method, equipment and system | |
| JP2016213810A (en) | Image display system, information processing apparatus, program, and image display method | |
| US20140049654A1 (en) | Information providing system, information providing device, image capture device, and computer program | |
| CN104412324A (en) | Display device | |
| US11373409B2 (en) | Photography system | |
| Al-Jabi et al. | Toward mobile AR-based interactive smart parking system | |
| JP2015210713A (en) | Driving recorder and cloud road-information operation system using the same | |
| CN102157183B (en) | Method for realizing video capturing on video player of portable electronic equipment | |
| CN112182286B (en) | Intelligent video management and control method based on three-dimensional live-action map | |
| AU2014200677A1 (en) | Method and system for gaze detection and advertisement information exchange | |
| CN202696755U (en) | 360-degree street scenery recording apparatus and vehicle provided with same | |
| CN110967036B (en) | Test method and device for navigation product | |
| CN108279402B (en) | WMTS-based browser-side radar video display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| ASS | Succession or assignment of patent right |
Owner name: LIU WEI Free format text: FORMER OWNER: BEIJING ZHONGDIAN HUAYUAN TECHNOLOGY CO., LTD. Effective date: 20140516 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Wang Chunming Inventor after: Li Huiru Inventor after: Liu Wei Inventor before: Wang Chunming Inventor before: Li Huiru |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: WANG CHUNMING LI HUIRU TO: WANG CHUNMING LI HUIRU LIU WEI Free format text: CORRECT: ADDRESS; FROM: 100011 CHAOYANG, BEIJING TO: 100096 CHANGPING, BEIJING |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20140516 Address after: 100096 new dragon city 25-2-1305, Beijing, Changping District Applicant after: Liu Wei Address before: 100011 Beijing City, Chaoyang District Xi'an two District 13 Li anzhen Bridge No. 7 Building 1 layer Applicant before: Beijing Zhongdian Huayuan Technology Co., Ltd. |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140219 |