CN113891042B - Integrated panoramic display method integrating 3D, monitoring information and video signals - Google Patents
Integrated panoramic display method integrating 3D, monitoring information and video signals Download PDFInfo
- Publication number
- CN113891042B CN113891042B CN202111138552.5A CN202111138552A CN113891042B CN 113891042 B CN113891042 B CN 113891042B CN 202111138552 A CN202111138552 A CN 202111138552A CN 113891042 B CN113891042 B CN 113891042B
- Authority
- CN
- China
- Prior art keywords
- interface
- video
- monitoring
- data
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 156
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000010586 diagram Methods 0.000 claims description 35
- 238000005516 engineering process Methods 0.000 claims description 19
- 230000002457 bidirectional effect Effects 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 12
- 238000007667 floating Methods 0.000 claims description 9
- 238000007689 inspection Methods 0.000 claims description 9
- 230000010354 integration Effects 0.000 claims description 9
- 230000009466 transformation Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 230000003993 interaction Effects 0.000 abstract description 3
- 230000009471 action Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
Abstract
The invention relates to an integrated panoramic display method integrating 3D, monitoring information and video signals, which divides panoramic data display into independent 3-class sub-interfaces, namely a 2D graphic monitoring sub-interface, a video monitoring sub-interface and a 3D webpage display sub-interface, so that 3 users are integrated in one interface for display. The same piece of equipment information is shared between the two interfaces, and the data of the 2D graphic monitoring sub-interface and the video monitoring sub-interface are acquired from local service by calling the local interface; and the data in the 3D webpage display sub-interface is acquired from the web service by utilizing the webpage script. The information interaction between the 3-type sub-interfaces is mainly through a message bus designed by software, and the message bus supports the subscription and the release of data of the 2D monitoring sub-interface and the video monitoring sub-interface.
Description
Technical Field
The invention relates to the technical field of multimedia integrated machines, in particular to an integrated panoramic display method for fusing 3D, monitoring information and video signals.
Background
With the development of multimedia technology, the ways of assisting the content display of the monitoring system are more and more diversified. However, the information is displayed by adopting different technologies, and the 2D graphic monitoring information of the primary equipment and the secondary equipment is usually displayed by using a local desktop window mode; the corresponding video images are displayed in a browser webpage or local desktop window mode provided by a video manufacturer; the corresponding 3D models are displayed by adopting a Microsoft edge new generation browser mode. These different display technologies appear very loose due to the different programs used. The same equipment object is displayed by adopting the 3 display technologies, and is required to be manually switched to different programs, and then corresponding equipment is manually found, so that the relevance of the same equipment is not reflected, and the use of the equipment is inconvenient for a user.
Disclosure of Invention
The invention aims to provide an integrated panoramic display method for fusing 3D, monitoring information and video signals, so as to solve the problems in the background technology.
In order to achieve the above purpose, the technical scheme of the invention is as follows:
an integrated panoramic display method integrating 3D, monitoring information and video signals comprises the following steps:
s1, creating a tool layer and a device layer, wherein the tool layer is used for providing an editing tool for constructing various system application parameters, and the device layer is used for providing communication specifications and protocols for accessing external devices; displaying and editing the substation 3D model data by using an open-source Threejs script;
s2, creating an interface layer, wherein the interface layer is used for providing a unified sdk interface for various data services of various service layers; displaying the device video image using the sdk interface;
s3, creating a service layer, wherein the service layer is used for providing various data acquisition, storage and access; the service layer comprises a c/s service layer and a web service layer, wherein the c/s service layer is used for displaying 2D monitoring graphic data by using a graphic window, and the web service layer is used for displaying 3D monitoring graphic data by using a graphic window;
s4, creating a control layer, wherein the control layer is used for providing data and control logic for various display elements in the integrated interface; the control layer comprises a 2D graphic data controller, a video data controller and a webpage data controller; the 2D graphic data controller and the video data controller respectively utilize graphic windows in the c/s service layer to dynamically load sdk library interfaces, and establish a message bidirectional channel between the graphic windows and the video windows; the webpage data controller utilizes the embedded webview2 in the web service layer to dynamically load and display a webpage of the substation 3D model;
s5, creating an interface integration window and a message layer, wherein the interface integration window is used for providing an interface for observation and control for a user, a message bus supporting a webview2 interface is arranged in the message layer, and the message layer is used for mutually transmitting and receiving information in a unified format between various graphic objects of a local program, graphic objects in a webpage and equipment objects in a video so as to achieve a result of mutual operation;
s6, the interface integration window comprises a 2D graphic monitoring sub-interface, a video monitoring sub-interface and a 3D webpage display sub-interface, wherein the 2D monitoring sub-interface is in bidirectional connection with the 2D image data controller through a message layer, the video monitoring sub-interface is in bidirectional connection with the video data controller through the message layer, and the 3D webpage display sub-interface is in bidirectional connection with the webpage data controller through the message layer.
In the method, in step S1, the tool layer includes a device knowledge base, a 2D drawing package, a device video preset bit editing tool, a 3D scene web page layout tool, and an offline map drawing tool; the equipment knowledge base automatically infers and constructs various equipment object parameter information of the corresponding type substation according to various inference knowledge in the knowledge base; the 2D drawing package utilizes a typical substation template structure diagram and equipment parameter information created by an equipment knowledge base to semi-automatically construct a 2D monitoring graph and corresponding parameters of monitoring equipment of a substation; the device video preset bit editing tool defines correct video preset bit information for all devices; the 3D scene webpage layout tool manually builds a 3D model scene graph of the substation and defines the number of 3D equipment in the scene; the offline map drawing tool draws a substation and a railway line connected with the substation on the downloaded offline tile map.
In the method, in step S6, the 2D graphical monitoring sub-interface includes a primary wiring diagram, an equipment working condition diagram, a fire control monitoring diagram, and a power monitoring diagram; the 2D graphic data controller accesses parameter information in the equipment information parameter service through the equipment interface and sends the parameter information to the 2D graphic monitoring sub-interface for display, the 2D graphic data controller accesses real-time and historical data acquired by the equipment layer through the real-time/historical data interface and sends the data to the 2D graphic monitoring sub-interface for display, and the 2D graphic data controller receives an equipment control command sent by the 2D graphic monitoring sub-interface, sends the command to the real-time data service through the real-time interface and then sends the command to the equipment layer for controlling various intelligent equipment.
In the method, in step S6, the video monitoring sub-interface includes equipment real-time monitoring and equipment timing inspection; the video data controller accesses a real-time video stream collected by a corresponding camera in the video service through a video interface and sends the real-time video stream to the video monitoring sub-interface for display; the video data controller accesses the equipment inspection task card parameters in the equipment information parameter service through the equipment interface and sends the equipment inspection task card parameters to the video monitoring sub-interface for display; the video data controller receives a video control command sent by the video monitoring sub-interface, invokes video service through the video interface, and the video service controls the camera through the equipment layer.
In the method, in step S6, the 3D web page display sub-interface includes 3D scene monitoring, a geographical map, and a semitransparent function web page dashboard superimposed on the 3D scene or the geographical map, and the web page data controller invokes web 3D and web geographical map interfaces through a front-end script technology, accesses the 3D model scene data and offline geographical tile map information of the substation in the web service, and sends the data to the web page monitoring sub-interface for display.
According to the method, in the process of switching from the 2D monitoring interface to the video monitoring window, the method comprises the following steps:
s11, selecting and clicking a certain equipment graphic element on a primary graph in the 2D monitoring interface, and sending a command for switching to a corresponding video monitoring picture to the 2D graphic data controller;
s12, the 2D graphic data controller issues a video monitoring window switching command of the equipment to a local message bus;
s13, the video data controller monitors a video monitoring window switching command of the equipment from the message bus, invokes video stream data of the equipment in video service through the video interface, and sends the video stream data to the video monitoring window for display;
s14, the video data controller pushes the video monitoring window to the front-end display.
According to the method, the process of switching from the 2D monitoring interface to the 3D geographic map comprises the following steps:
s21, selecting and clicking a geographic map button graphic element on a primary wiring map in a 2D graphic monitoring sub-interface, and sending a geographic map switching command to a 2D graphic data controller;
s22, the 2D graphic data controller issues a geographic diagram switching command to the message bus;
s23, the webpage data controller monitors a geographic diagram switching command from a message bus by utilizing a script technology, invokes geographic diagram data in geographic diagram web services through a geographic diagram interface and sends the geographic diagram data to a webpage sub-interface for display;
and S24, the webpage data controller pushes the webpage sub-interface to the forefront display.
According to the method, in the process of switching from the 3D geographic map webpage to the 3D scene monitoring of the substation, the method comprises the following steps of:
s31, selecting and clicking a certain 3D distribution substation graphic element on a 3D geographic map webpage, and sending and displaying a 3D scene monitoring map corresponding to the distribution to a webpage data controller;
s32, the webpage data controller acquires the distribution station 3D scene layout data and the floating display function dashboard information from the web service through a 3D service interface, and sends the distribution station 3D scene layout data and the floating display function dashboard information to the webpage sub-window for display;
s33, the webpage data controller utilizes a script technology and sends real-time data and historical data information which are required to be displayed in a part of the 3D webpage to a message bus;
s34, after the 2D graphic data controller monitors the data subscription requests from the message bus, the requests are acquired from the real-time library/history data service by utilizing the real-time/history interface to obtain real-time/history data, and the real-time/history data are published to the message bus;
and S35, the webpage data controller monitors a real-time data value through a message bus and sends the real-time data value to a 3D scene monitoring webpage of the power substation and a semitransparent function webpage dashboard floating on the webpage by utilizing a script technology.
According to the method, in the process of switching from the 3D scene monitoring webpage of the power transformation and distribution substation to the video monitoring window, the method comprises the following steps of:
s41, selecting and clicking a certain 3D equipment graphic element on a 3D scene monitoring webpage, and sending a command for switching to a video monitoring picture corresponding to the equipment to a webpage data controller;
s42, the webpage data controller issues a video monitoring window switching command of the equipment to a local message bus by utilizing a script technology;
s43, the video data controller monitors a video monitoring window switching command of the equipment from the message bus, invokes video stream data of the equipment in video service through the video interface, and sends the video stream data to the video monitoring window for display;
s44, the video data controller pushes the video monitoring window to the front-end display.
Compared with the prior art, the invention has the beneficial effects that: according to the method, panoramic data display is divided into independent 3 types of sub-interfaces, namely a 2D graphic monitoring sub-interface, a video monitoring sub-interface and a 3D webpage display sub-interface, so that 3 users are integrated and displayed in one interface. The same piece of equipment information is shared between the two interfaces, and the data of the 2D graphic monitoring sub-interface and the video monitoring sub-interface are acquired from local service by calling the local interface; and the data in the 3D webpage display sub-interface is acquired from the web service by utilizing the webpage script. The information interaction (inter-switching operation) between the 3-type sub-interfaces is mainly through a message bus designed by software, and the message bus supports the 2D monitoring sub-interface and the video monitoring sub-interface to subscribe and publish data. The method designs an independent script interface, and can enable the webpage to subscribe data from the message bus or enable the webpage to release data to the message bus through the webview2 interface, so that 3 sub-interfaces can be fused in a program to mutually transmit messages and control the data display of the respective sub-interfaces.
Drawings
The disclosure of the present invention is described with reference to the accompanying drawings. It is to be understood that the drawings are designed solely for the purposes of illustration and not as a definition of the limits of the invention. In the drawings, like reference numerals are used to refer to like parts. Wherein:
FIG. 1 is a schematic diagram of the overall architecture of the present invention.
Detailed Description
In order to make the technical means, the creation characteristics, the achievement of the purpose and the effect of the present invention easy to understand, the present invention will now be described in further detail with reference to the accompanying drawings. The drawings are simplified schematic representations which merely illustrate the basic structure of the invention and therefore show only the structures to which the invention pertains.
According to the technical scheme of the invention, a person skilled in the art can propose various alternative structural modes and implementation modes without changing the true spirit of the invention. Accordingly, the following detailed description and drawings are merely illustrative of the invention and are not intended to be exhaustive or to limit the invention to the precise form disclosed.
The technical scheme of the invention is further described in detail below with reference to the accompanying drawings and examples.
Embodiment 1, as shown in fig. 1, is an integrated panoramic display method for fusing 3D, monitoring information and video signals, comprising the following steps:
s1, creating a tool layer and a device layer, wherein the tool layer is used for providing an editing tool for constructing various system application parameters, the device layer is used for providing communication specifications and protocols for accessing external devices, and the open-source Threejs script is used for displaying and editing the substation 3D model data.
The tool layer comprises a device knowledge base, a 2D drawing package, a device video preset position editing tool, a 3D scene webpage layout tool and an offline map drawing tool. The equipment knowledge base automatically infers and constructs various equipment object parameter information of the corresponding type substation according to various inference knowledge in the knowledge base. The equipment type mainly comprises electric primary equipment, a monitoring device, fire-fighting equipment, power equipment, a video camera and the like. The 2D drawing package utilizes a template structure diagram of a typical substation and equipment parameter information created by an equipment knowledge base to semi-automatically construct a 2D monitoring graph and corresponding parameters of monitoring equipment of the substation. The device video preset bit editing tool defines the correct video preset bit information for all devices. The 3D scene webpage layout tool manually builds a 3D model scene graph of the substation and defines the number of the 3D equipment in the scene. The offline map drawing tool draws a power transformation and distribution substation and a railway line connected with the power transformation and distribution substation on a downloaded offline tile map, and the drawn power transformation and distribution substation contains longitude and latitude, names, communication state quantity and other information.
S2, creating an interface layer, wherein the interface layer is used for providing a unified sdk interface for various data services of various service layers; the device video image is displayed using the sdk interface.
S3, creating a service layer, wherein the service layer is used for providing various data acquisition, storage and access; the service layer comprises a c/s service layer and a web service layer, wherein the c/s service layer is used for displaying 2D monitoring graphic data through a graphic window, and the web service layer is used for displaying 3D monitoring graphic data through a graphic window.
S4, creating a control layer, wherein the control layer is used for providing data and control logic for various display elements in the integrated interface; the control layer comprises a 2D graphic data controller, a video data controller and a webpage data controller; the 2D graphic data controller and the video data controller respectively utilize graphic windows in the c/s service layer to dynamically load sdk library interfaces, and establish a message bidirectional channel between the graphic windows and the video windows; and the webpage data controller dynamically loads and displays the webpage of the substation 3D model by utilizing the embedded webview2 in the web service layer.
S5, creating an interface integration window and a message layer, wherein the interface integration window is used for providing an interface for observation and control for a user, a message bus supporting a webview2 interface is arranged in the message layer, and the message layer is used for enabling various graphic objects of a local program, graphic objects in a webpage and equipment objects in a video to mutually send and receive information in a unified format so as to achieve a result of mutual operation.
S6, the interface integration window comprises a 2D graphic monitoring sub-interface, a video monitoring sub-interface and a 3D webpage display sub-interface, wherein the 2D monitoring sub-interface is in bidirectional connection with the 2D image data controller through a message layer, the video monitoring sub-interface is in bidirectional connection with the video data controller through the message layer, and the 3D webpage display sub-interface is in bidirectional connection with the webpage data controller through the message layer.
Through the steps, a 3D webpage in 3D, a graphic window in monitoring information and a video window in a video signal are constructed, so that after information between the 3 webpage and the video window is interacted bidirectionally, the automatic bidirectional switching of the same equipment on 3 different monitoring interfaces is realized.
The method comprises the steps that the 2D graphic monitoring sub-interface comprises a primary wiring diagram, an equipment working condition diagram, a fire control monitoring diagram and a power monitoring diagram; the 2D graphic data controller accesses parameter information in the equipment information parameter service through the equipment interface and sends the parameter information to the 2D graphic monitoring sub-interface for display, the 2D graphic data controller accesses real-time and historical data acquired by the equipment layer through the real-time/historical data interface and sends the data to the 2D graphic monitoring sub-interface for display, and the 2D graphic data controller receives an equipment control command sent by the 2D graphic monitoring sub-interface, sends the command to the real-time data service through the real-time interface and then sends the command to the equipment layer for controlling various intelligent equipment.
The method comprises the steps that the video monitoring sub-interface comprises equipment real-time monitoring and equipment timing inspection; the video data controller accesses a real-time video stream collected by a corresponding camera in the video service through a video interface and sends the real-time video stream to the video monitoring sub-interface for display; the video data controller accesses the equipment inspection task card parameters in the equipment information parameter service through the equipment interface and sends the equipment inspection task card parameters to the video monitoring sub-interface for display; the video data controller receives video control commands (including position location, photographing and video recording) sent by the video monitoring sub-interface, invokes video service through the video interface, and the video service controls the camera through the equipment layer.
According to the method, the 3D webpage display sub-interface comprises 3D scene monitoring, a geographic map and a semitransparent function webpage dashboard overlapped on the 3D scene or the geographic map, the webpage data controller calls the web 3D and web geographic map interfaces through a front-end script technology, accesses the 3D model scene data and offline geographic tile map information of the substation in the web service, and sends the data to the webpage monitoring sub-interface for display.
Embodiment 2, based on embodiment 1, according to the method described above, in the process of switching from the 2D monitoring interface to the video monitoring window, includes the following steps:
s11, selecting and clicking a certain equipment graphic element on a primary graph in the 2D monitoring interface, and sending a command for switching to a corresponding video monitoring picture to the 2D graphic data controller;
s12, the 2D graphic data controller issues a video monitoring window switching command of the equipment to a local message bus;
s13, the video data controller monitors a video monitoring window switching command of the equipment from the message bus, invokes video stream data of the equipment in video service through the video interface, and sends the video stream data to the video monitoring window for display;
s14, the video data controller pushes the video monitoring window to the front-end display.
Embodiment 3, based on embodiment 1, according to the above method, in the process of switching from the 2D monitoring interface to the 3D geographical map, includes the following steps:
s21, selecting and clicking a geographic map button graphic element on a primary wiring map in a 2D graphic monitoring sub-interface, and sending a geographic map switching command to a 2D graphic data controller;
s22, the 2D graphic data controller issues a geographic diagram switching command to the message bus;
s23, the webpage data controller monitors a geographic diagram switching command from a message bus by utilizing a script technology, invokes geographic diagram data in geographic diagram web services through a geographic diagram interface and sends the geographic diagram data to a webpage sub-interface for display;
and S24, the webpage data controller pushes the webpage sub-interface to the forefront display.
Embodiment 4, based on embodiment 1, according to the above method, in the process of switching from the 3D geographical map web page to the 3D scene monitoring of the substation, includes the following steps:
s31, selecting and clicking a certain 3D distribution substation graphic element on a 3D geographic map webpage, and sending and displaying a 3D scene monitoring map corresponding to the distribution to a webpage data controller;
s32, the webpage data controller acquires the distribution station 3D scene layout data and the floating display function dashboard information from the web service through a 3D service interface, and sends the distribution station 3D scene layout data and the floating display function dashboard information to the webpage sub-window for display;
s33, the webpage data controller utilizes a script technology and sends real-time data and historical data information which are required to be displayed in a part of the 3D webpage to a message bus;
s34, after the 2D graphic data controller monitors the data subscription requests from the message bus, the requests are acquired from the real-time library/history data service by utilizing the real-time/history interface to obtain real-time/history data, and the real-time/history data are published to the message bus;
and S35, the webpage data controller monitors a real-time data value through a message bus and sends the real-time data value to a 3D scene monitoring webpage of the power substation and a semitransparent function webpage dashboard floating on the webpage by utilizing a script technology.
Embodiment 5, based on embodiment 1, according to the above method, in the process of switching from the 3D scene monitoring web page of the substation to the video monitoring window, includes the following steps:
s41, selecting and clicking a certain 3D equipment graphic element on a 3D scene monitoring webpage, and sending a command for switching to a video monitoring picture corresponding to the equipment to a webpage data controller;
s42, the webpage data controller issues a video monitoring window switching command of the equipment to a local message bus by utilizing a script technology;
s43, the video data controller monitors a video monitoring window switching command of the equipment from the message bus, invokes video stream data of the equipment in video service through the video interface, and sends the video stream data to the video monitoring window for display;
s44, the video data controller pushes the video monitoring window to the front-end display.
In summary, the panoramic data display is divided into independent 3 types of sub-interfaces, namely a 2D graphic monitoring sub-interface, a video monitoring sub-interface and a 3D webpage display sub-interface, so that 3 users are integrated and displayed in one interface. The same piece of equipment information is shared between the two interfaces, and the data of the 2D graphic monitoring sub-interface and the video monitoring sub-interface are acquired from local service by calling the local interface; and the data in the 3D webpage display sub-interface is acquired from the web service by utilizing the webpage script. The information interaction (inter-switching operation) between the 3-type sub-interfaces is mainly through a message bus designed by software, and the message bus supports the 2D monitoring sub-interface and the video monitoring sub-interface to subscribe and publish data. The method designs an independent script interface, and can enable the webpage to subscribe data from the message bus or enable the webpage to release data to the message bus through the webview2 interface, so that 3 sub-interfaces can be fused in a program to mutually transmit messages and control the data display of the respective sub-interfaces.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (5)
1. An integrated panoramic display method integrating 3D, monitoring information and video signals is characterized by comprising the following steps:
s1, creating a tool layer and a device layer, wherein the tool layer is used for providing an editing tool for constructing various system application parameters, and the device layer is used for providing communication specifications and protocols for accessing external devices; displaying and editing the substation 3D model data by using an open-source Threejs script;
s2, creating an interface layer, wherein the interface layer is used for providing a unified sdk interface for various data services of various service layers; displaying the device video image using the sdk interface;
s3, creating a service layer, wherein the service layer is used for providing various data acquisition, storage and access; the service layer comprises a c/s service layer and a web service layer, wherein the c/s service layer is used for displaying 2D monitoring graphic data by using a graphic window, and the web service layer is used for displaying 3D monitoring graphic data by using a graphic window;
s4, creating a control layer, wherein the control layer is used for providing data and control logic for various display elements in the integrated interface; the control layer comprises a 2D graphic data controller, a video data controller and a webpage data controller; the 2D graphic data controller and the video data controller respectively utilize graphic windows in the c/s service layer to dynamically load sdk library interfaces, and establish a message bidirectional channel between the graphic windows and the video windows; the webpage data controller utilizes the embedded webview2 in the web service layer to dynamically load and display a webpage of the substation 3D model;
s5, creating an interface integration window and a message layer, wherein the interface integration window is used for providing an interface for observation and control for a user, a message bus supporting a webview2 interface is arranged in the message layer, and the message layer is used for mutually transmitting and receiving information in a unified format between various graphic objects of a local program, graphic objects in a webpage and equipment objects in a video so as to achieve a result of mutual operation;
s6, the interface integration window comprises a 2D graphic monitoring sub-interface, a video monitoring sub-interface and a 3D webpage display sub-interface, wherein the 2D monitoring sub-interface is in bidirectional connection with the 2D image data controller through a message layer, the video monitoring sub-interface is in bidirectional connection with the video data controller through the message layer, and the 3D webpage display sub-interface is in bidirectional connection with the webpage data controller through the message layer;
the method comprises the following steps of:
s11, selecting and clicking a certain equipment graphic element on a primary wiring diagram in a 2D monitoring interface, and sending a command for switching to a corresponding video monitoring picture to a 2D graphic data controller;
s12, the 2D graphic data controller issues a video monitoring window switching command of the equipment to a local message bus;
s13, the video data controller monitors a video monitoring window switching command of the equipment from the message bus, invokes video stream data of the equipment in video service through the video interface, and sends the video stream data to the video monitoring window for display;
s14, the video data controller pushes the video monitoring window to the forefront end for display;
the process of switching from the 2D monitoring interface to the 3D geographic map comprises the following steps:
s21, selecting and clicking a geographic map button graphic element on a primary wiring map in a 2D graphic monitoring sub-interface, and sending a geographic map switching command to a 2D graphic data controller;
s22, the 2D graphic data controller issues a geographic diagram switching command to the message bus;
s23, the webpage data controller monitors a geographic diagram switching command from a message bus by utilizing a script technology, invokes geographic diagram data in geographic diagram web services through a geographic diagram interface and sends the geographic diagram data to a webpage sub-interface for display;
s24, the webpage data controller pushes the webpage sub-interface to the forefront end for display;
the process of switching from the 3D geographic map webpage to the 3D scene monitoring of the power transformation and distribution substation comprises the following steps:
s31, selecting and clicking a certain 3D distribution substation graphic element on a 3D geographic map webpage, and sending and displaying a 3D scene monitoring map corresponding to the distribution to a webpage data controller;
s32, the webpage data controller acquires the distribution station 3D scene layout data and the floating display function dashboard information from the web service through a 3D service interface, and sends the distribution station 3D scene layout data and the floating display function dashboard information to the webpage sub-window for display;
s33, the webpage data controller utilizes a script technology and sends real-time data and historical data information which are required to be displayed in a part of the 3D webpage to a message bus;
s34, after the 2D graphic data controller monitors the data subscription requests from the message bus, the requests are acquired from the real-time library/history data service by utilizing the real-time/history interface to obtain real-time/history data, and the real-time/history data are published to the message bus;
s35, the webpage data controller monitors a real-time data value through a message bus and sends the real-time data value to a 3D scene monitoring webpage of a power substation and a semitransparent function webpage dashboard floating on the webpage by utilizing a script technology;
the method comprises the following steps of:
s41, selecting and clicking a certain 3D equipment graphic element on a 3D scene monitoring webpage, and sending a command for switching to a video monitoring picture corresponding to the equipment to a webpage data controller;
s42, the webpage data controller issues a video monitoring window switching command of the equipment to a local message bus by utilizing a script technology;
s43, the video data controller monitors a video monitoring window switching command of the equipment from the message bus, invokes video stream data of the equipment in video service through the video interface, and sends the video stream data to the video monitoring window for display;
s44, the video data controller pushes the video monitoring window to the front-end display.
2. The integrated panoramic display method for fusing 3D, monitoring information and video signals according to claim 1, wherein the method comprises the following steps: in step S1, the tool layer includes a device knowledge base, a 2D drawing package, a device video preset bit editing tool, a 3D scene web page layout tool, and an offline map drawing tool; the equipment knowledge base automatically infers and constructs various equipment object parameter information of the corresponding type substation according to various inference knowledge in the knowledge base; the 2D drawing package utilizes a typical substation template structure diagram and equipment parameter information created by an equipment knowledge base to semi-automatically construct a 2D monitoring graph and corresponding parameters of monitoring equipment of a substation; the device video preset bit editing tool defines correct video preset bit information for all devices; the 3D scene webpage layout tool manually builds a 3D model scene graph of the substation and defines the number of 3D equipment in the scene; the offline map drawing tool draws a substation and a railway line connected with the substation on the downloaded offline tile map.
3. The integrated panoramic display method for fusing 3D, monitoring information and video signals according to claim 1, wherein the method comprises the following steps: in step S6, the 2D graphic monitoring sub-interface comprises a primary wiring diagram, an equipment working condition diagram, a fire control monitoring diagram and a power monitoring diagram; the 2D graphic data controller accesses parameter information in the equipment information parameter service through the equipment interface and sends the parameter information to the 2D graphic monitoring sub-interface for display, the 2D graphic data controller accesses real-time and historical data acquired by the equipment layer through the real-time/historical data interface and sends the data to the 2D graphic monitoring sub-interface for display, and the 2D graphic data controller receives an equipment control command sent by the 2D graphic monitoring sub-interface, sends the command to the real-time data service through the real-time interface and then sends the command to the equipment layer for controlling various intelligent equipment.
4. The integrated panoramic display method for fusing 3D, monitoring information and video signals according to claim 1, wherein the method comprises the following steps: in step S6, the video monitoring sub-interface comprises equipment real-time monitoring and equipment timing inspection; the video data controller accesses a real-time video stream collected by a corresponding camera in the video service through a video interface and sends the real-time video stream to the video monitoring sub-interface for display; the video data controller accesses the equipment inspection task card parameters in the equipment information parameter service through the equipment interface and sends the equipment inspection task card parameters to the video monitoring sub-interface for display; the video data controller receives a video control command sent by the video monitoring sub-interface, invokes video service through the video interface, and the video service controls the camera through the equipment layer.
5. The integrated panoramic display method for fusing 3D, monitoring information and video signals according to claim 1, wherein the method comprises the following steps: in step S6, the 3D web page display sub-interface includes 3D scene monitoring, a geographic map, and a semitransparent function web page dashboard superimposed on the 3D scene or geographic map, and the web page data controller invokes web 3D and web geographic map interfaces through a front-end script technique, accesses the 3D model scene data and offline geographic tile map information of the substation in the web service, and sends the data to the web page monitoring sub-interface for display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111138552.5A CN113891042B (en) | 2021-09-27 | 2021-09-27 | Integrated panoramic display method integrating 3D, monitoring information and video signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111138552.5A CN113891042B (en) | 2021-09-27 | 2021-09-27 | Integrated panoramic display method integrating 3D, monitoring information and video signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113891042A CN113891042A (en) | 2022-01-04 |
| CN113891042B true CN113891042B (en) | 2023-11-14 |
Family
ID=79007135
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111138552.5A Active CN113891042B (en) | 2021-09-27 | 2021-09-27 | Integrated panoramic display method integrating 3D, monitoring information and video signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113891042B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007023818A1 (en) * | 2005-08-22 | 2007-03-01 | National University Corporation Okayama University | Real-time information-gathering user assisting system and server control program used therein |
| CN103273489A (en) * | 2013-05-10 | 2013-09-04 | 上海大学 | Robot control system and method based on principal and subordinate teleoperation mechanical arm |
| CN103778566A (en) * | 2014-01-17 | 2014-05-07 | 广东电网公司电力科学研究院 | Heat-engine plant monitoring and measuring method based on three-dimensional visualization demonstration |
| CN106647586A (en) * | 2017-01-20 | 2017-05-10 | 重庆邮电大学 | Virtual machine room visualization monitoring management system based on B/S architecture and realization method |
| CN108377361A (en) * | 2016-11-14 | 2018-08-07 | 杭州海康威视数字技术股份有限公司 | A kind of display control method and device of monitor video |
| CN111770146A (en) * | 2020-06-18 | 2020-10-13 | 南京恒星自动化设备有限公司 | Method and system for realizing electrified railway fault distance measurement message interaction based on goose information general program architecture |
| CN112449093A (en) * | 2020-11-05 | 2021-03-05 | 北京德火科技有限责任公司 | Three-dimensional panoramic video fusion monitoring platform |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020112237A1 (en) * | 2000-04-10 | 2002-08-15 | Kelts Brett R. | System and method for providing an interactive display interface for information objects |
| US9602880B2 (en) * | 2006-12-29 | 2017-03-21 | Kip Prod P1 Lp | Display inserts, overlays, and graphical user interfaces for multimedia systems |
-
2021
- 2021-09-27 CN CN202111138552.5A patent/CN113891042B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007023818A1 (en) * | 2005-08-22 | 2007-03-01 | National University Corporation Okayama University | Real-time information-gathering user assisting system and server control program used therein |
| CN103273489A (en) * | 2013-05-10 | 2013-09-04 | 上海大学 | Robot control system and method based on principal and subordinate teleoperation mechanical arm |
| CN103778566A (en) * | 2014-01-17 | 2014-05-07 | 广东电网公司电力科学研究院 | Heat-engine plant monitoring and measuring method based on three-dimensional visualization demonstration |
| CN108377361A (en) * | 2016-11-14 | 2018-08-07 | 杭州海康威视数字技术股份有限公司 | A kind of display control method and device of monitor video |
| CN106647586A (en) * | 2017-01-20 | 2017-05-10 | 重庆邮电大学 | Virtual machine room visualization monitoring management system based on B/S architecture and realization method |
| CN111770146A (en) * | 2020-06-18 | 2020-10-13 | 南京恒星自动化设备有限公司 | Method and system for realizing electrified railway fault distance measurement message interaction based on goose information general program architecture |
| CN112449093A (en) * | 2020-11-05 | 2021-03-05 | 北京德火科技有限责任公司 | Three-dimensional panoramic video fusion monitoring platform |
Non-Patent Citations (1)
| Title |
|---|
| 基于SOA架构的智能电站信息系统整合云平台设计与实现;王德军;;神华科技(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113891042A (en) | 2022-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103200460B (en) | The method of the multiplexing personal mobile information termination function of a kind of automatic navigator | |
| KR101794378B1 (en) | Remote control of a telephone | |
| CN113497945B (en) | Live broadcast and configuration method based on cloud mobile phone and related device and system | |
| JP2009146146A (en) | Information processor and home network system | |
| CN103636197A (en) | Transmission terminal, image display control method, image display control program, recording medium, and transmission system | |
| US10404763B2 (en) | System and method for interactive and real-time visualization of distributed media | |
| CN104866269A (en) | Screen splitting area regulation method and terminal | |
| JP2002091913A (en) | Remote maintenance system, and maintenance device and supporting device used for the same | |
| CN114286165A (en) | Display device, mobile terminal and screen projection data transmission method | |
| CN102364957A (en) | Method, device and equipment for playing internet videos | |
| CN103020313A (en) | Capturing method based on detection of webpage refreshing period | |
| CN113590059A (en) | Screen projection method and mobile terminal | |
| EP4362456A1 (en) | Monitoring system and method based on digital converter station | |
| CN101188702A (en) | A weather forecast service system and realization method based on TV | |
| US6671730B1 (en) | Data gateway unit and data gateway method | |
| CN115237077A (en) | Industrial digital twinning system based on 5G edge calculation | |
| CN114286152A (en) | Display device, communication terminal and screen projection picture dynamic display method | |
| US7817537B2 (en) | Matrix switcher and method of controlling matrix switcher | |
| CN104375991A (en) | Image map-based urban monitoring system | |
| CN113891042B (en) | Integrated panoramic display method integrating 3D, monitoring information and video signals | |
| CN112104086B (en) | Transformer substation remote live-action holographic exploration system and method | |
| CN102118605A (en) | Network video monitoring system and method | |
| JP3381772B2 (en) | Production line monitoring system | |
| JP2006350681A (en) | Operation procedure support system for plant monitoring control device | |
| CN108306414A (en) | A kind of monitoring of intelligent power distribution and control method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |