CN111586351A - Visual monitoring system and method for fusion of three-dimensional videos of venue - Google Patents
Visual monitoring system and method for fusion of three-dimensional videos of venue Download PDFInfo
- Publication number
- CN111586351A CN111586351A CN202010311732.8A CN202010311732A CN111586351A CN 111586351 A CN111586351 A CN 111586351A CN 202010311732 A CN202010311732 A CN 202010311732A CN 111586351 A CN111586351 A CN 111586351A
- Authority
- CN
- China
- Prior art keywords
- video
- dimensional
- venue
- area
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Remote Sensing (AREA)
- Computer Graphics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Alarm Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses a three-dimensional video fusion visualization monitoring system for a venue, wherein a plurality of cameras and monitoring platforms are distributed in each area of the venue, the cameras shoot videos in the front range of the corresponding area, and the video images and video labels are transmitted to a video fusion module; the monitoring platform comprises: the three-dimensional model building module builds a three-dimensional scene model of the venue based on the 3D GIS technology; the video fusion module analyzes the area to which the transmitted video image belongs based on the video label, performs video fusion on the video image transmitted by the camera belonging to the same area, and visually embeds the fused video image into the area in the three-dimensional scene model. The sub-camera monitoring videos which are located at different positions and have different visual angles are fused into the three-dimensional scene model in real time, real-time global monitoring of the whole large scene in the monitoring area range is achieved, any camera video screen does not need to be switched, various emergencies are convenient to command and deal with in time, and practical efficiency of video monitoring is greatly improved.
Description
Technical Field
The invention relates to the technical field of video fusion, in particular to a visual monitoring system and a visual monitoring method for venue three-dimensional video fusion.
Background
The original sub-lens monitoring has the following disadvantages: only images can be viewed from the viewpoint of the lens for each lens; each image taken by the surveillance and the surrounding environment are split, and each camera is split from camera to camera, so that only workers familiar with the surrounding environment can know the position of the image.
Disclosure of Invention
Aiming at the problems and the defects in the prior art, the invention provides a novel visual monitoring system and a novel visual monitoring method for the fusion of three-dimensional videos of a venue.
The invention solves the technical problems through the following technical scheme:
the invention provides a visual monitoring system for three-dimensional video fusion of a venue, which is characterized in that the venue is divided into a plurality of areas, a plurality of cameras and a monitoring platform are distributed in each area, and the monitoring platform comprises a three-dimensional model building module and a video fusion module;
the three-dimensional model building module is used for building a three-dimensional scene model of the venue based on the 3D GIS technology;
the camera is used for shooting videos in the front range of the corresponding area and transmitting the video images and the video labels to the video fusion module;
the video fusion module is used for analyzing the area to which the transmitted video image belongs based on the video label, performing video fusion on the video image transmitted by the camera belonging to the same area, and visually embedding the fused video image into the area in the three-dimensional scene model.
Preferably, the monitoring platform further comprises a storage module, and the storage module is used for storing the fused video image.
Preferably, the monitoring platform further comprises an analysis module, and the analysis module is configured to analyze whether an abnormal condition exists in the fused video image, and perform an alarm when the abnormal condition exists.
The invention also provides a visual monitoring method for the fusion of the three-dimensional videos of the venue, which is characterized by being realized by utilizing the visual monitoring system for the fusion of the three-dimensional videos of the venue, and the method comprises the following steps:
s1, the three-dimensional model building module builds a three-dimensional scene model of the venue based on the 3D GIS technology;
s2, the camera shoots videos in the front range of the corresponding area, and the video images and the video labels are transmitted to the video fusion module;
and S3, the video fusion module analyzes the area to which the transmitted video image belongs based on the video label, performs video fusion on the video image transmitted by the camera belonging to the same area, and visually embeds the fused video image into the area in the three-dimensional scene model.
Preferably, the monitoring platform further comprises a storage module, and the storage module stores the fused video image.
Preferably, the monitoring platform further comprises an analysis module, wherein the analysis module analyzes whether an abnormal condition exists in the fused video image, and gives an alarm when the abnormal condition exists.
On the basis of the common knowledge in the field, the above preferred conditions can be combined randomly to obtain the preferred embodiments of the invention.
The positive progress effects of the invention are as follows:
the invention fuses the sub-lens monitoring videos which are positioned at different positions and have different visual angles into the three-dimensional scene model in real time, realizes the real-time global monitoring of the whole large scene in the monitoring area range, does not need to switch any video camera screen, is convenient for commanding and handling various emergencies in time, and greatly improves the practical efficiency of video monitoring.
Drawings
Fig. 1 is a block diagram of a stadium three-dimensional video fusion visualization monitoring system according to a preferred embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
As shown in fig. 1, the present embodiment provides a three-dimensional video fusion visualization monitoring system for a venue, where the venue is divided into a plurality of areas, each area is provided with a plurality of cameras 1 and a monitoring platform 2, and the monitoring platform 2 includes a three-dimensional model building module 21, a video fusion module 22, a storage module 23, and an analysis module 24.
The three-dimensional model building module 21 is used for building a three-dimensional scene model of the venue based on the 3D GIS technology.
The camera 1 is configured to shoot a video in a range in front of a corresponding area, and transmit a video image and a video tag to the video fusion module 22.
The video fusion module 22 is configured to analyze an area to which the transmitted video image belongs based on the video tag, perform video fusion on the video image transmitted from the camera belonging to the same area, and visually embed the fused video image in the area in the three-dimensional scene model.
The storage module 23 is configured to store the fused video image.
The analysis module 24 is configured to analyze whether an abnormal condition exists in the fused video image, and perform an alarm when the abnormal condition exists.
The embodiment also provides a visual monitoring method for the fusion of the three-dimensional videos of the venue, which is implemented by using the visual monitoring system for the fusion of the three-dimensional videos of the venue, and the method comprises the following steps:
and S1, the three-dimensional model building module builds a three-dimensional scene model of the venue based on the 3D GIS technology.
And S2, shooting videos in the front range of the corresponding area by the camera, and transmitting the video images and the video labels to the video fusion module.
And S3, the video fusion module analyzes the area to which the transmitted video image belongs based on the video label, performs video fusion on the video image transmitted by the camera belonging to the same area, and visually embeds the fused video image into the area in the three-dimensional scene model.
And S4, the storage module stores the fused video image.
And S5, the analysis module analyzes whether the fused video image has abnormal conditions or not, and gives an alarm when the abnormal conditions exist.
The panoramic fusion video supports the watching of video images from a preset virtual global viewpoint, the video image information of each camera is combined together in space and time, and the video image information shot by each camera is embedded into a real environment. And the system supports complex scenes such as indoor, outdoor, overground and underground scenes and can also display in a layered mode. A user can preset an observation point in the system to monitor a large scene of a key area, and the real-time dynamics of the key area is observed in a global view angle.
Based on the three-dimensional scene model, the video information at different positions is displayed in the three-dimensional scene model in the form of tags. The video images collected by the cameras are associated with real three-dimensional spatial positions, and the video label provides for simultaneously observing a plurality of camera conditions associated with physical positions under one viewing angle: the user does not need to memorize the erection position and the coverage area of each camera, can intuitively know the corresponding position of the video through the video label in the three-dimensional model, and can observe the target video at multiple angles; the camera shooting video can be zoomed and displayed, and the shot video display can be associated; in addition, the video label can be rotated in a certain angle in a self-adaptive visual angle, so that the user can conveniently check the video label.
And displaying the three-dimensional visible fields of the monitoring videos at different positions in the 3D GIS. In the 3D GIS, a user can macroscopically know the actual coverage condition of the monitored video in the district; a user can conveniently position the monitoring camera, and the stereoscopic view cone of the camera is checked in the 3D GIS by selecting the specific camera, so that the macro browsing of the global dynamic information of the monitored area is controlled conveniently. By establishing spatial position correlation among monitoring videos and taking a 3D GIS spatial position as an index, the shot videos at corresponding positions are called and displayed conveniently in the 3D GIS, an attention area is selected in the 3D GIS, the system lists all the shot videos capable of irradiating the area automatically, all real-time video pictures corresponding to the attention area of a user are displayed intuitively and efficiently, and daily management and rapid handling of emergency events are facilitated.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.
Claims (6)
1. A three-dimensional video fusion visualization monitoring system for a venue is characterized in that the venue is divided into a plurality of areas, a plurality of cameras and a monitoring platform are distributed in each area, and the monitoring platform comprises a three-dimensional model building module and a video fusion module;
the three-dimensional model building module is used for building a three-dimensional scene model of the venue based on the 3D GIS technology;
the camera is used for shooting videos in the front range of the corresponding area and transmitting the video images and the video labels to the video fusion module;
the video fusion module is used for analyzing the area to which the transmitted video image belongs based on the video label, performing video fusion on the video image transmitted by the camera belonging to the same area, and visually embedding the fused video image into the area in the three-dimensional scene model.
2. The venue three-dimensional video fusion visualization monitoring system of claim 1, wherein the monitoring platform further comprises a storage module for storing fused video images.
3. The venue three-dimensional video fusion visualization monitoring system of claim 1, wherein the monitoring platform further comprises an analysis module, the analysis module is configured to analyze whether an abnormal condition exists in the fused video images, and to alarm when an abnormal condition exists.
4. A method for the fusion visualization monitoring of the three-dimensional video of the venue, which is implemented by the fusion visualization monitoring system of the three-dimensional video of the venue as claimed in claim 1, the method comprising the following steps:
s1, the three-dimensional model building module builds a three-dimensional scene model of the venue based on the 3D GIS technology;
s2, the camera shoots videos in the front range of the corresponding area, and the video images and the video labels are transmitted to the video fusion module;
and S3, the video fusion module analyzes the area to which the transmitted video image belongs based on the video label, performs video fusion on the video image transmitted by the camera belonging to the same area, and visually embeds the fused video image into the area in the three-dimensional scene model.
5. The method for visual surveillance of a venue with three-dimensional video fusion as recited in claim 4, wherein the surveillance platform further comprises a storage module, and the storage module stores the fused video images.
6. The method for visual monitoring of integration of three-dimensional videos of stadiums according to claim 4, wherein the monitoring platform further comprises an analysis module, wherein the analysis module analyzes whether an abnormal situation exists in the integrated video images, and gives an alarm when the abnormal situation exists.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010311732.8A CN111586351A (en) | 2020-04-20 | 2020-04-20 | Visual monitoring system and method for fusion of three-dimensional videos of venue |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010311732.8A CN111586351A (en) | 2020-04-20 | 2020-04-20 | Visual monitoring system and method for fusion of three-dimensional videos of venue |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111586351A true CN111586351A (en) | 2020-08-25 |
Family
ID=72111519
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010311732.8A Pending CN111586351A (en) | 2020-04-20 | 2020-04-20 | Visual monitoring system and method for fusion of three-dimensional videos of venue |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111586351A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112364950A (en) * | 2020-09-30 | 2021-02-12 | 北京智汇云舟科技有限公司 | Event positioning method and system based on three-dimensional geographic information scene |
| CN113115015A (en) * | 2021-02-25 | 2021-07-13 | 北京邮电大学 | Multi-source information fusion visualization method and system |
| CN113206983A (en) * | 2021-04-28 | 2021-08-03 | 广州海事科技有限公司 | Omnibearing eye array monitoring method, system, computer equipment and storage medium |
| CN113259625A (en) * | 2021-03-24 | 2021-08-13 | 北京潞电电气设备有限公司 | Monitoring system and method thereof |
| CN113259624A (en) * | 2021-03-24 | 2021-08-13 | 北京潞电电气设备有限公司 | Monitoring equipment and method thereof |
| WO2024040863A1 (en) * | 2022-08-26 | 2024-02-29 | 中建三局集团有限公司 | General layout-based multi-site multi-view video fusion method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716586A (en) * | 2013-12-12 | 2014-04-09 | 中国科学院深圳先进技术研究院 | Monitoring video fusion system and monitoring video fusion method based on three-dimension space scene |
| CN104320616A (en) * | 2014-10-21 | 2015-01-28 | 广东惠利普路桥信息工程有限公司 | Video monitoring system based on three-dimensional scene modeling |
| CN104683758A (en) * | 2014-12-25 | 2015-06-03 | 合肥寰景信息技术有限公司 | Three-dimensional video monitoring method capable of conveniently obtaining specific positions and surroundings |
| CN107306349A (en) * | 2016-04-21 | 2017-10-31 | 杭州海康威视数字技术股份有限公司 | A kind of three-dimensional shows the method and device of monitor video |
| CN108010079A (en) * | 2017-10-19 | 2018-05-08 | 中国船舶工业系统工程研究院 | Status information remote monitoring system and method based on projection fusion and image recognition |
| CN110910338A (en) * | 2019-12-03 | 2020-03-24 | 煤炭科学技术研究院有限公司 | Three-dimensional live-action video acquisition method, device, equipment and storage medium |
-
2020
- 2020-04-20 CN CN202010311732.8A patent/CN111586351A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716586A (en) * | 2013-12-12 | 2014-04-09 | 中国科学院深圳先进技术研究院 | Monitoring video fusion system and monitoring video fusion method based on three-dimension space scene |
| CN104320616A (en) * | 2014-10-21 | 2015-01-28 | 广东惠利普路桥信息工程有限公司 | Video monitoring system based on three-dimensional scene modeling |
| CN104683758A (en) * | 2014-12-25 | 2015-06-03 | 合肥寰景信息技术有限公司 | Three-dimensional video monitoring method capable of conveniently obtaining specific positions and surroundings |
| CN107306349A (en) * | 2016-04-21 | 2017-10-31 | 杭州海康威视数字技术股份有限公司 | A kind of three-dimensional shows the method and device of monitor video |
| CN108010079A (en) * | 2017-10-19 | 2018-05-08 | 中国船舶工业系统工程研究院 | Status information remote monitoring system and method based on projection fusion and image recognition |
| CN110910338A (en) * | 2019-12-03 | 2020-03-24 | 煤炭科学技术研究院有限公司 | Three-dimensional live-action video acquisition method, device, equipment and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112364950A (en) * | 2020-09-30 | 2021-02-12 | 北京智汇云舟科技有限公司 | Event positioning method and system based on three-dimensional geographic information scene |
| CN113115015A (en) * | 2021-02-25 | 2021-07-13 | 北京邮电大学 | Multi-source information fusion visualization method and system |
| CN113259625A (en) * | 2021-03-24 | 2021-08-13 | 北京潞电电气设备有限公司 | Monitoring system and method thereof |
| CN113259624A (en) * | 2021-03-24 | 2021-08-13 | 北京潞电电气设备有限公司 | Monitoring equipment and method thereof |
| CN113206983A (en) * | 2021-04-28 | 2021-08-03 | 广州海事科技有限公司 | Omnibearing eye array monitoring method, system, computer equipment and storage medium |
| WO2024040863A1 (en) * | 2022-08-26 | 2024-02-29 | 中建三局集团有限公司 | General layout-based multi-site multi-view video fusion method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111586351A (en) | Visual monitoring system and method for fusion of three-dimensional videos of venue | |
| CN108965825B (en) | Video linkage scheduling method based on holographic position map | |
| CN106657906A (en) | Information equipment monitoring system with function of self-adaptive scenario virtual reality | |
| CN112449093A (en) | Three-dimensional panoramic video fusion monitoring platform | |
| US20050024206A1 (en) | Method and apparatus for providing a scalable multi-camera distributed video processing and visualization surveillance system | |
| CN105306899B (en) | Method and device for processing monitoring video | |
| CN107038754A (en) | A kind of wisdom garden management system and method based on three-dimensional live | |
| US20110109747A1 (en) | System and method for annotating video with geospatially referenced data | |
| CA2569524A1 (en) | Method and system for performing video flashlight | |
| CN101375599A (en) | Method and system for performing video flashlight | |
| CN111163286A (en) | Panoramic monitoring system based on mixed reality and video intelligent analysis technology | |
| CN113225212A (en) | Data center monitoring system, method and server | |
| CN107197209A (en) | The dynamic method for managing and monitoring of video based on panorama camera | |
| KR102107189B1 (en) | System and method for maintenance history and state management of facilities of subway station onto 3D screen | |
| KR101778744B1 (en) | Monitoring system through synthesis of multiple camera inputs | |
| KR101297237B1 (en) | System and method for monitoring a disaster | |
| CN110557603A (en) | Method and device for monitoring moving target and readable storage medium | |
| CN109636763B (en) | Intelligent compound eye monitoring system | |
| CN109889777A (en) | The switching methods of exhibiting and system of 3D outdoor scene vision monitoring | |
| CN115604433A (en) | Virtual-real combined three-dimensional visualization system | |
| KR100964726B1 (en) | Method for tracking moving objects using characteristics of moving objects in image camera system | |
| CN113905211B (en) | Video patrol method, device, electronic equipment and storage medium | |
| CN112669205A (en) | Three-dimensional video fusion splicing method | |
| JP2009060261A (en) | Video monitoring system | |
| KR101700651B1 (en) | Apparatus for tracking object using common route date based on position information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200825 |