CN116310233A - Three-dimensional GIS monitored control system based on virtual reality technique - Google Patents
Three-dimensional GIS monitored control system based on virtual reality technique Download PDFInfo
- Publication number
- CN116310233A CN116310233A CN202310099706.7A CN202310099706A CN116310233A CN 116310233 A CN116310233 A CN 116310233A CN 202310099706 A CN202310099706 A CN 202310099706A CN 116310233 A CN116310233 A CN 116310233A
- Authority
- CN
- China
- Prior art keywords
- video
- dimensional
- module
- monitoring
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 22
- 238000012544 monitoring process Methods 0.000 claims abstract description 116
- 238000005516 engineering process Methods 0.000 claims abstract description 47
- 230000002452 interceptive effect Effects 0.000 claims abstract description 36
- 238000009877 rendering Methods 0.000 claims abstract description 33
- 230000000007 visual effect Effects 0.000 claims abstract description 12
- 230000003993 interaction Effects 0.000 claims abstract description 6
- 238000012360 testing method Methods 0.000 claims description 25
- 239000010410 layer Substances 0.000 claims description 24
- 230000008569 process Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000013507 mapping Methods 0.000 claims description 4
- 238000012552 review Methods 0.000 claims description 4
- 239000002356 single layer Substances 0.000 claims description 4
- 238000012546 transfer Methods 0.000 claims description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 3
- 238000009435 building construction Methods 0.000 claims description 2
- 210000003128 head Anatomy 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000178 monomer Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000003313 weakening effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
Abstract
The invention provides a three-dimensional GIS monitoring system based on virtual reality technology, which belongs to the technical field of virtual reality, and comprises: the system comprises a GIS platform, a VR interaction terminal and at least one video monitoring terminal; the video monitoring terminal is used for collecting video data in a monitoring range to generate panoramic monitoring video and providing video retrieval service for the VR interactive terminal; the GIS platform is used for providing a three-dimensional map data set and map elements of the real environment in the monitoring range; and the VR interaction terminal is used for rendering a virtual three-dimensional scene based on the three-dimensional map data set so as to enable a user to execute monitoring operation in the virtual three-dimensional scene. According to the invention, the VR technology and the GIS technology are applied to the monitoring system, and the three-dimensional virtual environment with the same spatial attribute as the real world is used, so that a user can monitor the environment in a more natural and visual mode, and the experience and efficiency of staff can be effectively improved.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a three-dimensional GIS monitoring system based on the virtual reality technology.
Background
The geographic information system (Geographic Information System, GIS) is a system that creates, manages, analyzes, and draws all types of data. GIS connects data to a map, integrating location data (where things are located) with all types of descriptive information (where things are located). This may provide a basis for mapping and analysis applicable to natural science and almost all industries. GIS helps users to know patterns, relationships and geographic environments. Advantages include improved communication, increased efficiency, and better management and decision making.
However, the strategy of performing environmental monitoring only by using the GIS technology is poor in terms of monitoring experience and monitoring efficiency of the user.
Disclosure of Invention
The invention provides a three-dimensional GIS monitoring system based on a virtual reality technology, which is used for solving the defect that the strategy of environment monitoring by only utilizing the GIS technology in the prior art is poor in monitoring experience and monitoring efficiency of users, and providing a natural and visual mode for monitoring the environment, so that the experience and efficiency of staff can be effectively improved.
The invention provides a three-dimensional GIS monitoring system based on virtual reality technology, comprising: the system comprises a GIS platform, a VR interaction terminal and at least one video monitoring terminal; the video monitoring terminal is used for collecting video data in a monitoring range to generate panoramic monitoring video and providing video retrieval service for the VR interactive terminal; the GIS platform is used for providing a three-dimensional map data set and map elements of the real environment in the monitoring range; the VR interactive terminal is used for rendering a virtual three-dimensional scene based on the three-dimensional map data set so as to enable a user to execute monitoring operation in the virtual three-dimensional scene; the monitoring operation includes: roaming operations, video reviews, and map element queries.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the video monitoring terminal comprises a video acquisition module, a video management module, a video processing module and a plug flow module; the video acquisition module is used for acquiring video data in a monitoring range; the video management module is used for responding to a first management instruction of a user and managing video data; the video processing module is used for splicing and encoding the video data to obtain a panoramic monitoring video; and the plug flow module is used for converting the panoramic monitoring video into a streaming media format so as to provide video retrieval service for the VR interactive terminal through a preset protocol.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the GIS platform comprises: the map element query service module is used for inquiring the map element query service module; the map service module is used for acquiring a three-dimensional map data set; the three-dimensional map data set comprises a topographic map layer, a building construction map layer and a video monitoring terminal distribution map layer; the map element inquiry service module is used for providing map element inquiry service; and the service management module is used for responding to a second management instruction of the user and managing the service provided by the GIS platform.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the VR interactive terminal comprises a connecting module, an input module, an operation module and a head-mounted display module; the connection module is used for establishing connection among the head-mounted display module, the operation module and the input module; the input module is used for acquiring an input instruction of a user by utilizing a gesture recognition technology or input equipment and sending the input instruction to the operation module; the head-mounted display module is used for acquiring the position data and the angle data of the current head of the user and sending the position data and the angle data to the operation module so as to acquire a virtual three-dimensional scene fed back by the operation module to be displayed to the user; the operation module is used for mapping the position and the angle of the current head to a virtual three-dimensional space based on the position data and the angle data, and rendering a virtual three-dimensional scene by combining a three-dimensional map data set by using geographic coordinates in the virtual three-dimensional space as parameters.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the topographic map layer comprises the following entities: aisle, greening, water surface, road surface and tree; each entity comprises a geographic position attribute, a geometric attribute and a display style; the building layer is used for providing a building model which is identical to the geographic position, the size and the appearance of a real building; the video monitoring terminal distribution map layer is used for providing virtual three-dimensional models corresponding to the video monitoring terminals one by one.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the building layer comprises a house single layer for describing houses in a building; in any house single layer, each house corresponds to a house three-dimensional model; and responding to the selection operation of the user on the target house, and displaying the house three-dimensional model of the target house and the related information of the target house to the user by the VR interactive terminal.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the roaming operation comprises a free movement mode and a transmission mode; in the free movement mode, the VR interactive terminal controls the visual angle to move by using the input module so as to move to any position in the virtual three-dimensional scene; and in the transmission mode, the VR interactive terminal selects a preset position point in the virtual three-dimensional scene by using the input module so as to move to the preset position point.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the virtual three-dimensional model is a camera model; responding to the selection operation of the user on the camera model, the VR interactive terminal displays panoramic monitoring video of the video monitoring terminal corresponding to the camera model to the user, and the method specifically comprises the following steps: creating a smooth sphere in the virtual three-dimensional scene; converting the acquired panoramic monitoring video into video textures and attaching the video textures to the surface of the smooth sphere; wrapping the smooth sphere with a user field of view so as to display the panoramic surveillance video to a user in the virtual three-dimensional scene.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the three-dimensional map data set is divided into a plurality of blocks, and the blocks are organized in a number form; correspondingly, the step of the VR interactive terminal downloading the three-dimensional map data set from the GIS platform to render the virtual three-dimensional scene comprises the following steps:
step 1: downloading the root tiles;
step 2: performing a spatial intersection test on the bounding volumes of the view cone and the current tile; the view cone is a visual range in the scene rendering process;
step 3: rendering the current image block and continuing to perform screen space error testing on the current image block under the condition that the current image block passes the space intersection test;
step 4: under the condition that the current image block fails the screen space error test, acquiring all sub-image blocks corresponding to the current image block; under the condition that the current image block passes the screen space error test, the current image block is utilized to enhance the image quality;
step 5: and taking each sub-image block as a new current image block, and executing the steps 2 to 4 to finish the image quality enhancement process by utilizing the sub-image blocks passing the space intersection test and the screen space error test.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the image quality enhancement strategy comprises a replacement strategy and an additional strategy; the replacement strategy is to replace the rendering content of the parent block with the rendering content of the child block in the case that the rendering content of the child block is the same and has more details than the rendering content of the parent block; the additional strategy is that the sub-block is rendered on the surface of the parent block in the case that the rendering content of the sub-block is newly detailed relative to the parent block but does not include the rendering content of the parent block.
According to the three-dimensional GIS monitoring system based on the virtual reality technology, the VR technology and the GIS technology are applied to the monitoring system, and the three-dimensional virtual environment with the same spatial attribute as the real world is used, so that a user can monitor the environment in a more natural and visual mode, and the experience and efficiency of staff can be effectively improved.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic structural diagram of a three-dimensional GIS monitoring system based on virtual reality technology provided by the invention;
fig. 2 is a schematic structural diagram of a VR interactive terminal provided by the present invention;
fig. 3 is a flow chart of a method for streaming downloading and rendering a three-dimensional virtual scene provided by the invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that in the description of embodiments of the present invention, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. The orientation or positional relationship indicated by the terms "upper", "lower", etc. are based on the orientation or positional relationship shown in the drawings, are merely for convenience of description and to simplify the description, and are not indicative or implying that the system or element in question must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as limiting the invention. Unless specifically stated or limited otherwise, the terms "mounted," "connected," and "coupled" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
The terms "first," "second," and the like in this application are used for distinguishing between similar objects and not for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Further, the character "/", generally indicates that the front-rear association object is an "or" relationship.
The three-dimensional GIS monitoring system based on the virtual reality technology provided by the embodiment of the invention is described below with reference to fig. 1 to 3.
Fig. 1 is a schematic structural diagram of a three-dimensional GIS monitoring system based on virtual reality technology provided by the present invention, as shown in fig. 1, the system includes: GIS platform, VR interactive terminal and at least one video monitoring terminal.
The video monitoring terminal is used for collecting video data in a monitoring range to generate panoramic monitoring video and providing video retrieval service for the VR interactive terminal; the GIS platform is used for providing a three-dimensional map data set and map elements of the real environment in the monitoring range; the VR interactive terminal is used for rendering a virtual three-dimensional scene based on the three-dimensional map data set so as to enable a user to execute monitoring operation in the virtual three-dimensional scene; the monitoring operation includes: roaming operations, video reviews, and map element queries.
It should be noted that, the VR interactive terminal in the present invention adopts a virtual reality technology. Virtual reality technology (VR), also known as a virtual environment, a smart environment, or an artificial environment, refers to a technology that uses a computer to generate a virtual world that can directly impart visual, auditory, and tactile sensations to participants and allow them to interactively observe and operate. The basic features of VR systems are three "I": immersion (im), interaction (Interaction), and Imagination (imaging), emphasizing the dominant role of a person in a VR system, adapting the information handling system to the needs of the person and consistent with the sensory feel of the person.
Based on the content of the foregoing embodiment, as an optional embodiment, the three-dimensional GIS monitoring system based on the virtual reality technology provided by the present invention, the video monitoring terminal includes a video acquisition module, a video management module, a video processing module and a push flow module.
Preferably, the video monitoring terminal manages the working states of the cameras, and configures name, id and space coordinate information for each camera. The video monitoring terminal provides video streaming service through RTSP, RTP, RTCP protocol. The video monitoring terminal can collect VR panoramic video data and has night video collection capability.
The video acquisition module is used for acquiring video data in a monitoring range; specifically, the camera can be used for continuously collecting video data in a monitoring range for 24 hours.
The video management module is used for responding to a first management instruction of a user and managing video data; the different first management instructions correspond to different management operations. For example, a storage operation, a deletion operation, or the like is performed on video data.
The video processing module is used for splicing and encoding the video data to obtain a panoramic monitoring video; the panoramic monitoring video belongs to VR panoramic video, and the format of the panoramic monitoring video can be an equidistant columnar projection format.
And the plug flow module is used for converting the panoramic monitoring video into a streaming media format so as to provide video retrieval service for the VR interactive terminal through a preset protocol. The preset protocol includes RTSP, RTP, RTCP protocol.
Based on the content of the foregoing embodiment, as an optional embodiment, the three-dimensional GIS monitoring system based on the virtual reality technology provided by the present invention, where the GIS platform includes: the map element query system comprises a map service module, a map element query service module and a service management module.
The map service module is used for acquiring a three-dimensional map data set; the three-dimensional map data set comprises a topographic map layer, a building map layer and a video monitoring terminal distribution map layer. Optionally, the map service module provides a Web Map Service (WMS), web map tile service (WMTF).
The map element query service module is used for providing map element query service (WFS).
And the service management module is used for responding to a second management instruction of the user and managing the service provided by the GIS platform. Specifically, the service can be stopped/started and a new service can be rapidly released through the corresponding operations.
Fig. 2 is a schematic structural diagram of a VR interactive terminal provided by the present invention, and as shown in fig. 2, the VR interactive terminal includes a connection module, an input module, an operation module, and a head-mounted display module.
The connection module is used for establishing connection among the head-mounted display module, the operation module and the input module. In this embodiment, the supporting AP router is used as a connection device, the head-mounted display module is wirelessly connected to the AP, and the operation module (device) is connected to the LAN port of the router through the network cable, so as to complete the physical connection. And simultaneously running the video streaming functions of the operation equipment and the head-mounted display module, and streaming the pictures rendered by the operation equipment to the head-mounted display.
The input module is used for acquiring an input instruction of a user by utilizing a gesture recognition technology or input equipment and sending the input instruction to the operation module. A 6-degree-of-freedom handle is used as the input device in this embodiment.
The head-mounted display module is used for acquiring the position data and the angle data of the current head of the user and sending the position data and the angle data to the operation module so as to acquire a virtual three-dimensional scene fed back by the operation module to be displayed to the user. Specifically, the head-mounted display module acquires position and angle data of the current head at high frequency, sends the data to the operation equipment through the connection module, waits for rendering to be completed, then acquires left and right eye pictures which are rendered from the operation equipment through the connection module, and displays the pictures in eyes corresponding to a user, so that the user obtains three-dimensional immersion.
The operation module is used for mapping the position and the angle of the current head to a virtual three-dimensional space based on the position data and the angle data, and rendering a virtual three-dimensional scene by combining a three-dimensional map data set by using geographic coordinates in the virtual three-dimensional space as parameters.
Based on the content of the foregoing embodiment, as an optional embodiment, the three-dimensional GIS monitoring system based on the virtual reality technology provided by the present invention, the topographic map layer includes the following entities: aisle, greening, water surface, road surface and tree; each entity comprises a geographic location attribute, a geometric attribute and a display style.
The building layer is used for providing a building model which is identical to the geographic position, the size and the appearance of a real building. Optionally, with reference to a building drawing, a three-dimensional model is constructed by means of manual high-precision modeling and the like, and a real picture is adopted as an external texture of a building, so that the reality is quite high.
The video monitoring terminal distribution map layer is used for providing virtual three-dimensional models corresponding to the video monitoring terminals one by one. Each video monitoring terminal is provided with a corresponding virtual three-dimensional model, and monitoring videos of the corresponding terminals can be called through clicking the virtual three-dimensional models.
Based on the content of the above embodiment, as an optional embodiment, the three-dimensional GIS monitoring system based on the virtual reality technology provided by the present invention, where the building layer includes a building monomer layer for describing a building in a building; in any house single layer, each house corresponds to a house three-dimensional model; and responding to the selection operation of the user on the target house, and displaying the house three-dimensional model of the target house and the related information of the target house to the user by the VR interactive terminal.
It will be appreciated that by default, the three-dimensional model of the house is not displayed, and when the house is selected, the three-dimensional model of the house is highlighted and has a dynamic effect of prompting the user that the corresponding target house is in the selected state.
Based on the above-described embodiments, as an alternative embodiment, the three-dimensional map data set is divided into a plurality of tiles, and the plurality of tiles are organized in a number form therebetween; correspondingly, the step of the VR interactive terminal downloading the three-dimensional map data set from the GIS platform to render the virtual three-dimensional scene comprises the following steps:
step 1: downloading the root tiles;
step 2: performing a spatial intersection test on the bounding volumes of the view cone and the current tile; the view cone is a visual range in the scene rendering process;
step 3: rendering the current image block and continuing to perform screen space error testing on the current image block under the condition that the current image block passes the space intersection test;
step 4: under the condition that the current image block fails the screen space error test, acquiring all sub-image blocks corresponding to the current image block; under the condition that the current image block passes the screen space error test, the current image block is utilized to enhance the image quality;
step 5: and taking each sub-image block as a new current image block, and executing the steps 2 to 4 to finish the image quality enhancement process by utilizing the sub-image blocks passing the space intersection test and the screen space error test.
The above implementation is illustrated in fig. 3 below. Fig. 3 is a flow chart of a method for streaming downloading and rendering a three-dimensional virtual scene provided by the invention.
The three-dimensional map data set is split into a plurality of smaller-volume tiles. The tiles are organized in a tree that merges the concept of hierarchical detail (HLOD) to optimize the presentation of spatial data. Each tile has a bounding volume, an object defining a spatial extent that completely encloses its contents. The contents of the child tiles are entirely within the bounding volume of the parent object.
The data structure between tiles may include one or more octrees, such as sparse voxel octrees or dense voxel trees. Of course, other data structures may be included, such as quadtrees, BSP trees, 3D arrays, kD trees, point clouds, wire frames, boundary representations (B-Rep), build entity geometry trees (CSG trees), bintrees, and hexagonal structures. The purpose of the three-dimensional tile cache set is to accurately and efficiently represent the data for each geometry.
And step 101, downloading the root tiles, wherein the root tiles are downloaded from the GIS platform according to Uniform Resource Identifiers (URIs) of the layer data sets corresponding to the three-dimensional map.
Step 102, performing a spatial intersection test on the boundary volumes of the view cone and the tile. Rendering the block if the test passes; if not, the tile is not rendered. The view cone is the visual range in the scene rendering process, and is determined by the position, orientation and field angle of the camera.
And 103, performing screen space error test on the image blocks. Each tile has an attribute named geometric error that describes the gap between the simplified geometric grid and the exact geometric grid. The larger the geometric error, the more primitive the simplified geometric mesh, the worse the picture quality and the better the rendering performance. The screen space error is calculated as follows:
screen space error= (geometric error x height of screen)/(distance of camera from center point of tile x 2 x tan (camera angle of view/2))
When the screen space error is greater than a certain threshold, the picture quality of the tile is considered to have failed to meet the requirements, requiring enhancement of picture quality. For enhancing the picture quality, the sub-blocks with lower geometric errors and richer details need to be used.
Step 104, downloading the sub-tiles. And the VR interactive terminal acquires Uniform Resource Identifiers (URIs) of the sub-blocks from the current block, downloads files of all the sub-blocks corresponding to the block from the GIS platform, and finishes downloading. The boundary volumes of the view cone and each sub-tile are tested for spatial intersection, and the screen space error test, and the passed sub-tiles will be used to enhance picture quality.
Step 105, enhancing the picture quality. The image quality enhancement policy includes a replacement policy and an additional policy. The replacement policy, the rendered content of the sub-tile is the same as the rendered content of the parent tile and has more detail, and the rendered content of the sub-tile is directly used to replace the rendered content of the parent tile. In addition, the rendering content of the sub-block is only added with some details relative to the parent block, and does not comprise the rendering content of the parent block, and the sub-block is rendered on the surface of the parent block.
Based on the content of the above embodiments, as an optional embodiment, the three-dimensional GIS monitoring system based on virtual reality technology provided by the present invention, the roaming operation includes a free movement mode and a transmission mode; in the free movement mode, the VR interactive terminal controls the visual angle to move by using the input module so as to move to any position in the virtual three-dimensional scene; and in the transmission mode, the VR interactive terminal selects a preset position point in the virtual three-dimensional scene by using the input module so as to move to the preset position point.
It will be appreciated that in the free movement mode, the user can control the up-down movement of the back-and-forth movement, left-and-right movement, and can move to any position in the scene. When the user selects the transfer mode, the range of movement is limited to a range of surfaces, typically the ground. By selecting a point on the surface of the object to transfer to the location, the surrounding environment during transfer will be hidden from the uncomfortable experience.
Based on the content of the above embodiment, as an optional embodiment, the three-dimensional GIS monitoring system based on the virtual reality technology provided by the invention, wherein the virtual three-dimensional model is a camera model; responding to the selection operation of the user on the camera model, the VR interactive terminal displays panoramic monitoring video of the video monitoring terminal corresponding to the camera model to the user, and the method specifically comprises the following steps: creating a smooth sphere in the virtual three-dimensional scene; converting the acquired panoramic monitoring video into video textures and attaching the video textures to the surface of the smooth sphere; wrapping the smooth sphere with a user field of view so as to display the panoramic surveillance video to a user in the virtual three-dimensional scene.
Specifically, based on the VR interactive terminal, the user may review the monitoring screen of the real scene by selecting the camera model in the virtual three-dimensional scene. After a user selects a camera of a virtual environment, the VR interactive terminal creates a smooth sphere in the virtual three-dimensional scene, then acquires a monitoring video stream from a corresponding video monitoring terminal according to the id of a camera model, converts the video stream into video textures, and adds the video textures to the surface of the sphere, finally wraps the field of view of the user by using the sphere, and displays the panoramic monitoring video in the virtual VR environment. By default, the ball uses opaque materials, and the user can only observe the monitoring video. After the video is switched to the mixed mode, the sphere uses semitransparent materials, a user can observe the monitoring video on the surface of the sphere and the three-dimensional virtual environment at the rear of the sphere at the same time, so that the virtual environment at the rear of the video and the real environment in the monitoring video are better fused, the VR interactive terminal can read the position and the angle of the camera from the video monitoring terminal, and then the angle of the spherical screen is configured. In order to avoid the interference of the virtual environment on the video content, the surface material of the model uses a prime material, thereby weakening the content of the virtual environment.
In summary, according to the three-dimensional GIS monitoring system based on the virtual reality technology, the VR technology and the GIS technology are applied to the monitoring system, and the three-dimensional virtual environment with the same spatial attribute as the real world is used, so that a user can monitor the environment in a more natural and visual mode, and the experience and efficiency of staff can be effectively improved.
The system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A three-dimensional GIS monitored control system based on virtual reality technique, characterized by comprising: the system comprises a GIS platform, a VR interaction terminal and at least one video monitoring terminal;
the video monitoring terminal is used for collecting video data in a monitoring range to generate panoramic monitoring video and providing video retrieval service for the VR interactive terminal;
the GIS platform is used for providing a three-dimensional map data set and map elements of the real environment in the monitoring range;
the VR interactive terminal is used for rendering a virtual three-dimensional scene based on the three-dimensional map data set so as to enable a user to execute monitoring operation in the virtual three-dimensional scene; the monitoring operation includes: roaming operations, video reviews, and map element queries.
2. The three-dimensional GIS monitoring system based on the virtual reality technology according to claim 1, wherein the video monitoring terminal comprises a video acquisition module, a video management module, a video processing module and a plug flow module;
the video acquisition module is used for acquiring video data in a monitoring range;
the video management module is used for responding to a first management instruction of a user and managing video data;
the video processing module is used for splicing and encoding the video data to obtain a panoramic monitoring video;
and the plug flow module is used for converting the panoramic monitoring video into a streaming media format so as to provide video retrieval service for the VR interactive terminal through a preset protocol.
3. The virtual reality technology-based three-dimensional GIS monitoring system of claim 1, wherein the GIS platform comprises: the map element query service module is used for inquiring the map element query service module;
the map service module is used for acquiring a three-dimensional map data set; the three-dimensional map data set comprises a topographic map layer, a building construction map layer and a video monitoring terminal distribution map layer;
the map element inquiry service module is used for providing map element inquiry service;
and the service management module is used for responding to a second management instruction of the user and managing the service provided by the GIS platform.
4. The three-dimensional GIS monitoring system based on the virtual reality technology according to claim 1, wherein the VR interactive terminal comprises a connection module, an input module, an operation module and a head-mounted display module;
the connection module is used for establishing connection among the head-mounted display module, the operation module and the input module;
the input module is used for acquiring an input instruction of a user by utilizing a gesture recognition technology or input equipment and sending the input instruction to the operation module;
the head-mounted display module is used for acquiring the position data and the angle data of the current head of the user and sending the position data and the angle data to the operation module so as to acquire a virtual three-dimensional scene fed back by the operation module to be displayed to the user;
the operation module is used for mapping the position and the angle of the current head to a virtual three-dimensional space based on the position data and the angle data, and rendering a virtual three-dimensional scene by combining a three-dimensional map data set by using geographic coordinates in the virtual three-dimensional space as parameters.
5. A three-dimensional GIS monitoring system based on virtual reality technology according to claim 3, characterized in that the topographical layer comprises the following entities: aisle, greening, water surface, road surface and tree; each entity comprises a geographic position attribute, a geometric attribute and a display style;
the building layer is used for providing a building model which is identical to the geographic position, the size and the appearance of a real building;
the video monitoring terminal distribution map layer is used for providing virtual three-dimensional models corresponding to the video monitoring terminals one by one.
6. The virtual reality technology based three-dimensional GIS monitoring system of claim 3, wherein the building layer comprises a building element layer for describing a building in a building; in any house single layer, each house corresponds to a house three-dimensional model;
and responding to the selection operation of the user on the target house, and displaying the house three-dimensional model of the target house and the related information of the target house to the user by the VR interactive terminal.
7. The virtual reality technology based three-dimensional GIS monitoring system of claim 4, wherein the roaming operation comprises a free movement mode and a transfer mode;
in the free movement mode, the VR interactive terminal controls the visual angle to move by using the input module so as to move to any position in the virtual three-dimensional scene;
and in the transmission mode, the VR interactive terminal selects a preset position point in the virtual three-dimensional scene by using the input module so as to move to the preset position point.
8. The virtual reality technology-based three-dimensional GIS monitoring system of claim 5, wherein the virtual three-dimensional model is a camera model; responding to the selection operation of the user on the camera model, the VR interactive terminal displays panoramic monitoring video of the video monitoring terminal corresponding to the camera model to the user, and the method specifically comprises the following steps:
creating a smooth sphere in the virtual three-dimensional scene;
converting the acquired panoramic monitoring video into video textures and attaching the video textures to the surface of the smooth sphere;
wrapping the smooth sphere with a user field of view so as to display the panoramic surveillance video to a user in the virtual three-dimensional scene.
9. The virtual reality technology based three-dimensional GIS monitoring system of claim 1, wherein the three-dimensional map data set is divided into a plurality of tiles, the plurality of tiles organized in a number format therebetween; correspondingly, the step of the VR interactive terminal downloading the three-dimensional map data set from the GIS platform to render the virtual three-dimensional scene comprises the following steps:
step 1: downloading the root tiles;
step 2: performing a spatial intersection test on the bounding volumes of the view cone and the current tile; the view cone is a visual range in the scene rendering process;
step 3: rendering the current image block and continuing to perform screen space error testing on the current image block under the condition that the current image block passes the space intersection test;
step 4: under the condition that the current image block fails the screen space error test, acquiring all sub-image blocks corresponding to the current image block; under the condition that the current image block passes the screen space error test, the current image block is utilized to enhance the image quality;
step 5: and taking each sub-image block as a new current image block, and executing the steps 2 to 4 to finish the image quality enhancement process by utilizing the sub-image blocks passing the space intersection test and the screen space error test.
10. The virtual reality technology based three-dimensional GIS monitoring system of claim 9, wherein the image quality enhancement policies include replacement policies and additional policies;
the replacement strategy is to replace the rendering content of the parent block with the rendering content of the child block in the case that the rendering content of the child block is the same and has more details than the rendering content of the parent block;
the additional strategy is that the sub-block is rendered on the surface of the parent block in the case that the rendering content of the sub-block is newly detailed relative to the parent block but does not include the rendering content of the parent block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310099706.7A CN116310233A (en) | 2023-02-03 | 2023-02-03 | Three-dimensional GIS monitored control system based on virtual reality technique |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310099706.7A CN116310233A (en) | 2023-02-03 | 2023-02-03 | Three-dimensional GIS monitored control system based on virtual reality technique |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116310233A true CN116310233A (en) | 2023-06-23 |
Family
ID=86831512
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310099706.7A Pending CN116310233A (en) | 2023-02-03 | 2023-02-03 | Three-dimensional GIS monitored control system based on virtual reality technique |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116310233A (en) |
-
2023
- 2023-02-03 CN CN202310099706.7A patent/CN116310233A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106296783B (en) | A kind of space representation method of combination space overall situation 3D view and panoramic pictures | |
| CN109167686B (en) | Layout and display method based on multilayer complex network topology | |
| CN112837406B (en) | Three-dimensional reconstruction method, device and system | |
| CN106462999A (en) | Processing and/or transmitting 3d data | |
| CN108648269A (en) | The monomerization approach and system of three-dimensional building object model | |
| CN113313818B (en) | Three-dimensional reconstruction method, device and system | |
| CN110379010A (en) | Three-dimensional geographic information method for visualizing and system based on video fusion | |
| CN106548516A (en) | Three-dimensional range method and apparatus | |
| WO2016114930A2 (en) | Systems and methods for augmented reality art creation | |
| Mossel et al. | Streaming and exploration of dynamically changing dense 3d reconstructions in immersive virtual reality | |
| CN108765576B (en) | OsgEarth-based VIVE virtual earth roaming browsing method | |
| EP3533218B1 (en) | Simulating depth of field | |
| CN110163942A (en) | A kind of image processing method and device | |
| KR101591427B1 (en) | Method for Adaptive LOD Rendering in 3-D Terrain Visualization System | |
| CN106157354A (en) | A kind of three-dimensional scenic changing method and system | |
| US11181862B2 (en) | Real-world object holographic transport and communication room system | |
| CN114356096B (en) | XR (X-ray diffraction) technology-based new-dimension space construction method, system and platform | |
| Che et al. | Reality-virtuality fusional campus environment: An online 3D platform based on OpenSimulator | |
| Ekong et al. | Teacher-student vr telepresence with networked depth camera mesh and heterogeneous displays | |
| CN113963094A (en) | Depth map and video processing and reconstruction method, device, equipment and storage medium | |
| CN116310233A (en) | Three-dimensional GIS monitored control system based on virtual reality technique | |
| CN109448135B (en) | Three-dimensional model repairing method based on multi-source data | |
| CN111915715A (en) | Visual operation monitoring method for overhead transmission line | |
| US11145111B2 (en) | Volumetric slicer | |
| CN114549761A (en) | Real-scene three-dimensional model layered rendering optimization method and system based on distributed storage and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |