CN118069475B - Digital twin monitoring system - Google Patents
Digital twin monitoring system Download PDFInfo
- Publication number
- CN118069475B CN118069475B CN202410504165.6A CN202410504165A CN118069475B CN 118069475 B CN118069475 B CN 118069475B CN 202410504165 A CN202410504165 A CN 202410504165A CN 118069475 B CN118069475 B CN 118069475B
- Authority
- CN
- China
- Prior art keywords
- monitoring
- scene
- digital
- mirror image
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 309
- 238000004088 simulation Methods 0.000 claims abstract description 41
- 230000008859 change Effects 0.000 claims abstract description 9
- 238000012545 processing Methods 0.000 claims description 46
- 238000011068 loading method Methods 0.000 claims description 45
- 230000000007 visual effect Effects 0.000 claims description 36
- 238000000034 method Methods 0.000 claims description 30
- 238000009877 rendering Methods 0.000 claims description 28
- 230000008569 process Effects 0.000 claims description 23
- 238000003860 storage Methods 0.000 claims description 16
- 238000010276 construction Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000012216 screening Methods 0.000 claims description 8
- 238000005457 optimization Methods 0.000 claims description 6
- 241001465754 Metazoa Species 0.000 claims description 5
- 239000003550 marker Substances 0.000 claims description 4
- 238000004891 communication Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 230000009191 jumping Effects 0.000 description 8
- 230000006399 behavior Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000003313 weakening effect Effects 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 4
- 241000270295 Serpentes Species 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 235000011888 snacks Nutrition 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 241000699666 Mus <mouse, genus> Species 0.000 description 1
- 241000699670 Mus sp. Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000004387 environmental modeling Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036316 preload Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/323—Visualisation of programs or trace data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Image Analysis (AREA)
Abstract
The invention belongs to the technical field of digital twinning, and particularly relates to a digital twinning monitoring system, which comprises a digital twinning management end, a monitoring terminal and a user end; the monitoring terminal generates monitoring operation data; the digital twin management end builds a monitoring system digital image and a monitoring scene digital image, and drives the monitoring system digital image to carry out monitoring operation simulation and monitoring scene digital image change simulation according to monitoring operation data; the user side obtains the operation parameters of the user and uploads the monitoring scene data and the operation parameters to the digital twin management side; the digital twin management end also operates the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene according to the operation parameters, eliminates the digital mirror image which does not accord with the preset target in the operation result, and renders the digital mirror image which accords with the preset target. The invention can solve the problem of high cost when the existing digital twin monitoring system solves the problem of delay jamming caused by data redundancy.
Description
Technical Field
The invention belongs to the technical field of digital twinning, and particularly relates to a digital twinning monitoring system.
Background
Along with the continuous development of information technology, the monitoring system is iterated continuously, and the functions which can be realized by the monitoring system are increased from the improvement of monitoring equipment facilities to the perfection of big data and information technology, and on the basis, the digital twin technology brings great development prospect for the monitoring field.
The digital twin is to fully utilize data such as a physical model, sensor update, operation history and the like, integrate simulation processes of multiple disciplines, multiple physical quantities, multiple scales and multiple probabilities, and complete mapping in a virtual space so as to reflect the whole life process of corresponding entity equipment; in the monitoring system, the digital twin technology can simulate, receive and process monitoring data, monitoring pictures, monitoring equipment parameters and the like in real time, and can realize intellectualization, visualization and comprehensiveness by matching with corresponding early warning functions.
In the existing monitoring system based on the digital twin technology, a large number of physical models, physical parameters and other elements are set in the model, the operation interface and the simulation interface for truly restoring the actual monitoring scene, so that a user can switch the scene, simulate operation and the like in the operation interface, the situation of clamping and the like often occurs, and the system needs to run by depending on a processing system with stronger performance at the moment, thereby bringing the problem of cost increase.
Disclosure of Invention
The technical problem solved by the invention is to provide a digital twin monitoring system so as to solve the problem of high cost caused by adopting a powerful processing system when the existing digital twin monitoring system solves the problem of delay jamming caused by data redundancy.
The basic scheme provided by the invention is as follows: a digital twin monitoring system comprises a digital twin management end, a monitoring terminal and a user end; the monitoring terminal and the user terminal are both in communication connection with the digital twin management terminal; wherein:
the monitoring terminal is used for generating monitoring operation data;
The digital twin management end is used for constructing a digital mirror image of the monitoring system and a digital mirror image of the monitoring scene;
the digital twin management end is also used for driving the digital mirror image of the monitoring system to carry out monitoring operation simulation and monitoring scene digital mirror image change simulation according to the monitoring operation data;
the user side is used for acquiring the operation parameters of the user and uploading the monitoring scene data and the operation parameters to the digital twin management side;
The digital twin management end is also used for operating the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene according to the operation parameters, preloading and removing the digital mirror image which does not accord with the preset target in the operation result, and rendering the digital mirror image which accords with the preset target; the method comprises the steps that a target is preset to be a jump target of a scene under current operation, the resolution of the target and the visible range of the target; the preset target is within the jump target of the scene under the current operation, the resolution of the target and the visual range of the target, and the non-preset target is within the jump target of the scene under the current operation, the resolution of the target and the visual range of the target.
Further, the digital twin management terminal comprises a data transmission module, a distributed storage module and a data processing server, wherein the data transmission module is used for receiving data transmitted by the monitoring terminal and the user terminal and transmitting feedback information back to the user terminal; the data processing server is used for carrying out data analysis processing according to the received data to generate a monitoring system digital image and a monitoring scene digital image, driving simulation of the monitoring system digital image and simulation of the monitoring scene digital image according to monitoring operation data, and generating a control command according to the operation parameters to control switching of the monitoring system digital image and the monitoring scene digital image; the distributed storage module is used for storing the data received by the data transmission module and the data generated by processing of the data processing server.
Further, the data processing server comprises a scene model construction module, a scene screening module, an operation switching module, a scene optimization module and a rendering module;
The scene model construction module is used for generating a digital mirror image of the monitoring system and a digital mirror image of the monitoring scene according to the monitoring scene data, the monitoring operation data and the simulation parameters;
The scene screening module is used for retrieving a preset target according to the operation parameters, wherein the preset target comprises a jump target of a scene under the current operation, the resolution of the target and the visible range of the target;
The operation switching module is used for switching to the corresponding monitoring system digital mirror image and the corresponding monitoring scene digital mirror image according to the jump target;
the scene optimization module is used for optimizing the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene which are beyond the resolution and are not in the visual range according to the resolution and the visual range of the jump target;
the rendering module is used for rendering the monitor system digital mirror image and the monitor scene digital mirror image which are optimized by the scene optimizing module.
Further, the operation simulation of the digital mirror image of the monitoring system is specifically as follows:
acquiring simulation data of a monitoring terminal, wherein the simulation data comprises coordinate information of the monitoring terminal, quantity information of the monitoring terminal, connection relation of the monitoring terminal, parameter information of the monitoring terminal and visible picture range information of the monitoring terminal;
Generating a digital mirror image of the monitoring system according to the coordinate information of the monitoring terminals, the quantity information of the monitoring terminals, the connection relation of the monitoring terminals, the parameter information of the monitoring terminals and the visible picture range information of the monitoring terminals;
Acquiring operation data of a monitoring terminal, driving the digital mirror image of the monitoring system to operate according to the operation data of the monitoring terminal, and realizing motion simulation of the digital mirror image of the monitoring system;
and carrying out preloading treatment and rejection treatment on the model with the visual picture range of the monitoring terminal outside the preset distance.
Further, the pre-loading processing and the rejecting processing for the model with the visual picture range of the monitoring terminal being beyond the preset distance are specifically as follows:
scaling the visual picture of the monitoring terminal according to the size of the user terminal interface;
Extracting a scene model in a visual picture of a monitoring terminal, and reading a correlation model of the scene model in the visual picture of the monitoring terminal in a digital mirror image of a monitoring system;
calculating the association degree of the association model and the scene model, taking the scene model as a trunk, taking the association model as a branch, and generating a model tree;
constructing a pre-loading sliding window and a full-loading sliding window, traversing the whole model tree in parallel through the pre-loading sliding window and the full-loading sliding window, eliminating the models which are not in the pre-loading sliding window and the full-loading sliding window in the traversing process, carrying out pre-loading processing on the models in the pre-loading sliding window, and carrying out full-loading processing on the models in the full-loading window.
Further, boundaries of the preloaded sliding window and the fully loaded sliding window are determined according to user operations and item importance.
Further, the preloading is specifically:
acquiring scene elements in the completely loaded scene model, and caching the scene elements in the distributed storage module;
a preloading sequence is established from the lower boundary to the upper boundary of the preloading sliding window, the priority of a scene model needing preloading is determined, and rendering is carried out according to the priority;
In the rendering process, whether the same scene elements exist in the distributed storage module or not is read, if yes, the corresponding scene elements in the database are directly extracted, if not, the rendering is directly carried out, and the scene elements after the rendering are stored in the database.
Further, the preloading further includes:
Judging the loading path length of a preloaded association model serving as a branch and a scene model serving as a trunk in a model tree, and generating a priority according to the length of the path length;
rendering is performed according to the priority.
Further, the change simulation of the digital mirror image of the monitoring scene specifically comprises the following steps:
Storing scene elements by a distributed storage module;
constructing a digital mirror image of the monitoring scene according to the monitoring scene data and the simulation parameters uploaded by the user;
And acquiring image data in the monitoring operation data, identifying, calling scene elements according to the identification result, and carrying out change simulation on the digital mirror image of the monitoring scene.
Further, the scene elements include human body elements, animal body elements, and marker elements.
The principle and the advantages of the application are as follows: according to the digital twin monitoring system, a digital twin management terminal is set based on operation parameters of a user terminal, in the process of jumping according to a jumping target, one type of digital twin management terminal directly jumps to a real-time picture of a current monitoring terminal, a display area of the real-time picture is usually the user terminal, for example, the middle of a screen of a platform, and a background plate is supported by a digital mirror image of a constructed monitoring system and a digital mirror image of a monitoring scene, at the moment, in the process of jumping, not only real-time picture contents are required to be displayed, but also the background plate is required to be loaded, in the process of jumping, firstly, the background plate outside the visible range is removed according to the visible range of the monitoring terminal, then, according to the size of resolution, the related background plate exceeding the resolution is subjected to weakening or blurring treatment, finally, the displayed picture view is mainly the real-time picture, and the virtual or weakened background plate is used as an auxiliary display, so that in the process of jumping, the target required to be loaded and rendered is less, and the whole background plate contents are not required to be completely rendered, so that the processing requirements of the processing performance of a processor are reduced, and more processing resources and the processing resources are required to be removed are required to be more in the process of the weakening the background plate;
meanwhile, in the loading process, the designed optimized loading method can effectively and orderly load the model, and can predict the next operation of a user, so that the loading efficiency is higher.
Drawings
FIG. 1 is a schematic diagram of an embodiment of the present invention.
Detailed Description
The following is a further detailed description of the embodiments:
An example is substantially as shown in figure 1: the digital twin monitoring system comprises a user terminal, a digital twin management terminal and a monitoring terminal, wherein the monitoring terminal and the user terminal are both in communication connection with the digital twin management terminal, and the digital twin management terminal comprises:
The monitoring terminal is used for generating monitoring operation data, and particularly, the monitoring terminal can be applied to various scenes including factory production line monitoring, garden monitoring, substation equipment monitoring and the like, and under the scenes, the monitoring terminal needs to have multiple functions including real-time streaming display, visual early warning and the like, so that the monitoring operation data generated by the monitoring terminal comprise monitoring terminal operation state data such as starting and stopping states of the monitoring terminal, association states among the monitoring terminals, power supply data, fault data and the like, monitoring terminal monitoring data such as monitored image data, frame data of images, resolution data and the like, and simulation data of the monitoring terminal such as monitoring terminal coordinate information, monitoring terminal quantity information, monitoring terminal connection relation, monitoring terminal parameter information, monitoring terminal visual picture range information and the like.
The user end is used for acquiring the operation parameters of the user and uploading the monitoring scene data and the operation parameters to the digital twin management end; in this embodiment, the user side adopts a tablet personal computer, a PC side or a mobile side, where the user side is located at the user side and is used to obtain operation parameters of the user, for example, clicking, sliding, zooming, jumping and other operations on a visual image after the user enters the monitoring system, that is, the operation parameters, and meanwhile, uploading monitoring scene data and the operation parameters to the digital twin management side, where the monitoring scene data includes modeling data of an environment where the monitoring terminal is located, for example, when the monitoring terminal is used for monitoring gardens in a garden, the environmental modeling data of the garden is imported into the digital twin management side through the user side, and when the monitoring terminal is located on a production line of plant equipment, the modeling data of the production line of the plant equipment is imported into the digital twin management side through the user side.
The imported monitoring scene data can comprise more and less scene elements according to the complexity of an actual scene and the complexity of a user modeling process, and when the scene elements are more, the data packet received by the digital twin management end is very large, so that when a user switches or operates the monitoring scene through the user end, the loading and rendering processes easily cause the conditions of blocking, delaying and the like, the user experience is poor, an upgrade processor is adopted by a conventional means, the system optimization capability is improved, but the cost is high.
Specifically, in the digital twin management end, firstly, a digital mirror image of a monitoring system and a digital mirror image of a monitoring scene are constructed; driving the digital mirror image of the monitoring system to perform monitoring operation simulation and monitoring scene digital mirror image change simulation according to the monitoring operation data; thirdly, operating the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene according to the operation parameters, and carrying out preloading and removing processing on the digital mirror image which does not accord with a preset target in an operation result, and rendering the digital mirror image which accords with the preset target, wherein the preset target is a jump target of the scene under the current operation, the resolution of the target and the visible range of the target, and the preset target accords with the jump target of the scene under the current operation, the resolution of the target and the visible range of the target;
in order to realize the functions, the digital twin management terminal comprises a data transmission module, a distributed storage module and a data processing server, wherein the data transmission module is used for receiving data transmitted by the monitoring terminal and the user terminal, including monitoring operation data, monitoring scene data and operation parameters, and transmitting feedback information after operation back to the user terminal, such as a jumped visual picture.
The data processing server is used for carrying out data analysis processing according to the received data to generate a monitoring system digital image and a monitoring scene digital image, driving simulation of the monitoring system digital image and simulation of the monitoring scene digital image according to monitoring operation data, and generating a control command according to the operation parameters to control switching of the monitoring system digital image and the monitoring scene digital image; specifically, the data processing server comprises a scene model construction module, a scene screening module, an operation switching module, a rejection module and a rendering module; the scene model construction module is used for generating a digital mirror image of the monitoring system and a digital mirror image of the monitoring scene according to the monitoring scene data, the monitoring operation data and the simulation parameters; the construction process of the digital mirror image of the monitoring system comprises the following steps:
generating a digital mirror image of the monitoring system according to the coordinate information of the monitoring terminals, the quantity information of the monitoring terminals, the connection relation of the monitoring terminals, the parameter information of the monitoring terminals and the visual picture range information of the monitoring terminals, and specifically comprises the following steps:
And a data acquisition step: the method comprises the steps that related information of monitoring system entities is collected through devices such as a sensor, a scanner and a camera, the related information comprises monitoring terminal coordinate information, monitoring terminal quantity information, connection relation among the monitoring terminals, parameter information of the monitoring terminals and monitoring terminal visual picture range information, wherein the monitoring terminal coordinate information is coordinate points of each monitoring terminal in a two-dimensional scene and a three-dimensional scene under a monitoring area of a monitoring system, the coordinate points have X coordinate values and Y coordinate values in the two-dimensional scene, the coordinate points comprise the X coordinate values, the Y coordinate values and Z coordinate values in the three-dimensional scene, and the mounting position of each monitoring terminal can be effectively obtained by the monitoring terminal coordinate information, so that the position of each monitoring terminal in a digital mirror image of the monitoring system is obtained; the connection relation between the monitoring terminals is represented in a certain monitoring area, the monitoring terminals are controlled by one server, and in another monitoring area, the monitoring terminals are controlled by another server, so that different connection relations between the monitoring terminals in different monitoring areas are provided, and the connection relation between the monitoring terminals is determined, so that the simulated association relation in the digital mirror image of the monitoring system can be obtained; the parameter information of the monitoring terminal represents factory configuration information, outline dimension information and the like of the monitoring terminal, and the parameter information is beneficial to setting operation parameters and modeling configuration of the monitoring terminal in a digital mirror image of a monitoring system; the visual picture range information of the monitoring terminal indicates the range of pictures monitored by the monitoring terminal in the running process, for example, the monitoring terminal in a market is provided with a monitoring terminal for monitoring a snack area, the monitoring range covers the snack area, and a plurality of monitoring terminals for monitoring living goods areas are provided, so that the monitoring pictures of the monitoring terminals are combined to comprise all the ranges of the whole living goods area, therefore, the visual picture range information of the monitoring terminal can synchronize the picture range and picture information monitored by each monitoring terminal in the digital mirror image of the monitoring terminal, and the digital twin effect is achieved;
and a data processing step: the data acquired by the data acquisition step is processed and analyzed, such as data cleaning, data association, data conversion and the like, and the data after data processing can be effectively matched with the input of the digital twin management end;
Model construction: and constructing a digital model of the physical entity of the monitoring system, such as a geometric model, a 3D model of the monitoring terminal, a physical model and the like, according to the result of the processing of the data processing step.
The construction process of the digital mirror image of the monitoring scene comprises the following steps:
The method for constructing the digital mirror image of the monitoring scene according to the monitoring scene data and the simulation parameters uploaded by the user comprises the following steps:
And a data acquisition step: receiving monitoring picture data of a monitoring terminal through host equipment, and acquiring elements in a monitoring scene, such as trees, buildings, equipment facilities and the like, which need to construct a digital mirror image through equipment such as a camera, a scanner and the like;
and a data processing step: analyzing and processing the collected and received data, such as removing some repeatedly collected monitoring pictures and correlating the monitoring picture data according to the overall layout of the monitoring scene;
model construction: constructing a digital model of a monitoring scene entity for the result after data processing, for example, generating an integral frame model of the monitoring scene, modeling equipment facilities in the scene and the like;
thus, a digital mirror image of the monitoring scene is obtained.
After the scene model is built, the data processing server drives the operation simulation of the digital mirror image of the monitoring system and the change simulation of the digital mirror image of the monitoring scene according to the monitoring operation data, specifically, in the operation simulation of the digital mirror image of the monitoring system, firstly, operation data of the monitoring terminal is obtained, a behavior model of an entity is added for the digital mirror image of the monitoring system, for example, the monitoring terminal can execute lens rotation behavior, target tracking behavior and the like when in operation, the digital mirror image of the monitoring system can be executed according to the behaviors, the behavior functions of the digital mirror image of the monitoring system can be achieved, and then the digital mirror image of the monitoring system is connected with the monitoring system of an actual physical entity in real time, so that the monitoring system of the digital mirror image can update the current state in real time when the actual monitoring system executes operation behavior or monitoring tasks, and the motion simulation of the digital mirror image of the monitoring system is realized.
In the variation simulation of the digital mirror image of the monitoring scene, firstly, scene elements are stored through a distributed storage module, wherein the scene elements stored in the distributed storage module comprise human body elements, animal body elements and marker elements; and then acquiring image data in the monitoring operation data and identifying, and for the image data in the monitoring operation data, identifying whether a specific marker, a human body or an animal exists, for example, human body elements stored in a distributed storage module comprise a man, a woman, a child, an old man and the like, animal body elements comprise mice, snakes and the like, and when the image data is identified, if the image data comprises walking man, woman, an invading mouse, a snakes, a floating plastic bag paper and the like, the image data is identified, and the image data is subjected to entity replacement through a pre-stored scene model element, so that a flowing real-time picture can be formed in the integral display of the digital mirror image of the monitoring scene, the result of changing simulation is achieved, and the requirement of the scene element on the processing capacity of a processor can be reduced by replacing the entity.
In order to better realize reasonable use of the processor, namely the resources of the data processing server, a preset target is called by a scene screening module according to the operation parameters, wherein the preset target comprises a jump target of a scene under the current operation, the resolution of the target and the visible range of the target; for example, if the user wants to view the visual picture of a certain monitoring terminal or the details of the monitoring terminal with early warning, the monitoring terminal is taken as a jump target, the resolution of the monitoring terminal is taken as a target resolution, and the visual range of the monitoring terminal is taken as the visual range of the target;
Switching to the corresponding monitoring system digital mirror image and the corresponding monitoring scene digital mirror image according to the jump target by using an operation switching module;
Then the scene optimization module optimizes the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene which are beyond the resolution and not in the visual range according to the resolution and the visual range of the jump target; specific:
scaling the visual picture of the monitoring terminal according to the size of the user terminal interface;
Extracting a scene model in a visual picture of a monitoring terminal, and reading a correlation model of the scene model in the visual picture of the monitoring terminal in a digital mirror image of a monitoring system;
calculating the association degree of the association model and the scene model, taking the scene model as a trunk, taking the association model as a branch, and generating a model tree;
constructing a pre-loading sliding window and a full-loading sliding window, traversing the whole model tree in parallel through the pre-loading sliding window and the full-loading sliding window, eliminating the models which are not in the pre-loading sliding window and the full-loading sliding window in the traversing process, carrying out pre-loading processing on the models in the pre-loading sliding window, and carrying out full-loading processing on the models in the full-loading window.
In this embodiment, the method for calculating the association degree is a spatial association algorithm, specifically:
Extracting relevant position space features, size space features, overlapping space features with other models and adjacent space features with other models according to the characteristics of the scene model and the associated model, and converting the extracted space features into numerical values for representation;
Comparing the spatial features of the scene model and the associated model, specifically, respectively performing position spatial feature comparison, size spatial feature comparison, overlapping spatial feature comparison and adjacent spatial feature comparison according to the numerical value of each spatial feature, and finally obtaining the comparison result of the spatial features of the scene model and the associated model;
Reserving the comparison result within a correlation threshold;
The reserved scene model and the association model are constructed into a model tree, wherein the scene model mainly presented is a trunk, the association model is a branch, for example, in a scene aiming at a production line, equipment fire alarm events are involved, when a user jumps the equipment model, the equipment model is taken as the trunk, and a related circuit schematic model, a camera model, an upstream equipment model, a downstream equipment model and the like of the equipment model are taken as the association model.
Finally, parallel traversal operation is carried out on the model tree through the pre-loading sliding window and the full loading sliding window, the boundaries of the two types of sliding windows are determined according to the operation of a user and the importance of matters in the model tree, for example, if a device fire alarm event caused by circuit faults occurs, the importance of the fire section of the circuit in the whole circuit structure is firstly evaluated, if the circuit is a main circuit, the importance of the fire section of the circuit is highest, and if the circuit is a branch circuit, the importance of the fire section of the circuit is lower; the circuit model is mainly to be checked by a user, and is complex, in order to better find out reasons, the range of the circuit model judges whether the circuit model needs to be presented more according to the evaluated importance degree, if so, the threshold value of the association degree is larger, the boundary of the sliding window is larger, and the range of the sliding window is larger, so that the sliding window in the application adopts a dynamic adjustment mode to adapt to different loading ranges of more scene types.
For the specific loading mode of the model related to the preloaded sliding window, the method has two specific modes, namely, firstly, the scene elements in the completely loaded scene model are acquired and cached to the distributed storage module; a preloading sequence is established from the lower boundary to the upper boundary of the preloading sliding window, the priority of a scene model needing preloading is determined, and rendering is carried out according to the priority; in the rendering process, whether the same scene elements exist in the distributed storage module or not is read, if yes, the corresponding scene elements in the database are directly extracted, if not, the rendering is directly carried out, and the scene elements after the rendering are stored in the database.
The other is to judge the loading path length of the preloaded association model serving as a branch and the scene model serving as a trunk in the model tree, and generate priority according to the length of the path length; rendering is then carried out according to the priority; for example, in a model tree, a scene model of a trunk to be loaded, an associated model with the shortest path, and within a preload sliding window, the loading is performed preferentially, and the order of the preloading can be determined in such a way that the next operation of a user can be further predicted and effective subsequent loading can be performed.
And the rendering module is used for rendering the monitor system digital mirror image and the monitor scene digital mirror image which are optimized by the scene optimizing module.
In this embodiment, the scene screening module is set based on the operation parameters of the user side, in the process of performing the jump according to the jump target, one type of the scene screening module directly jumps to the real-time picture of the current monitoring terminal, and the display area of the real-time picture is usually the middle of the screen of the user side, for example, the background plate is dependent on the digital mirror image of the constructed monitoring system and the digital mirror image of the monitoring scene, at this time, in the process of jumping, not only the real-time picture content but also the background plate is required to be displayed, and in the application, the background plate outside the visual range is firstly removed according to the visual range of the monitoring terminal, then the relevant background plate exceeding the resolution is subjected to weakening or blurring processing according to the size of the resolution, and finally the finally presented picture view angle is displayed with the real-time picture as the main, and the blurring or weakening background plate as the auxiliary, so that in the process of jumping, the target required to be loaded and rendered is less, the whole background plate content is not required to be completely processed, so that the requirement on the processing performance of the processor is reduced, and more processing resources are required to be distributed to perform the weakening processing and blurring processing on the background plate.
The foregoing is merely exemplary of the present application, and specific structures and features well known in the art will not be described in detail herein, so that those skilled in the art will be aware of all the prior art to which the present application pertains, and will be able to ascertain the general knowledge of the technical field in the application or prior art, and will not be able to ascertain the general knowledge of the technical field in the prior art, without using the prior art, to practice the present application, with the aid of the present application, to ascertain the general knowledge of the same general knowledge of the technical field in general purpose. It should be noted that modifications and improvements can be made by those skilled in the art without departing from the structure of the present application, and these should also be considered as the scope of the present application, which does not affect the effect of the implementation of the present application and the utility of the patent. The protection scope of the present application is subject to the content of the claims, and the description of the specific embodiments and the like in the specification can be used for explaining the content of the claims.
Claims (8)
1. A digital twin monitoring system, characterized by: the system comprises a digital twin management terminal, a monitoring terminal and a user terminal; the monitoring terminal and the user terminal are both in communication connection with the digital twin management terminal; wherein:
the monitoring terminal is used for generating monitoring operation data;
The digital twin management end is used for constructing a digital mirror image of the monitoring system and a digital mirror image of the monitoring scene;
the digital twin management end is also used for driving the digital mirror image of the monitoring system to carry out monitoring operation simulation and monitoring scene digital mirror image change simulation according to the monitoring operation data;
the user side is used for acquiring the operation parameters of the user and uploading the monitoring scene data and the operation parameters to the digital twin management side;
The digital twin management end is also used for operating the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene according to the operation parameters, preloading and removing the digital mirror image which does not accord with the preset target in the operation result, and rendering the digital mirror image which accords with the preset target; the method comprises the steps that a target is preset to be a jump target of a scene under current operation, the resolution of the target and the visible range of the target; the method comprises the steps that a preset target is a jump target of a scene under the current operation, the resolution of the target and the visual range of the target, and a non-preset target is a jump target of a scene not under the current operation, the resolution of the target and the visual range of the target;
The pre-loading processing and the rejecting processing of the model with the visual picture range outside the preset distance of the monitoring terminal are specifically as follows:
scaling the visual picture of the monitoring terminal according to the size of the user terminal interface;
Extracting a scene model in a visual picture of a monitoring terminal, and reading a correlation model of the scene model in the visual picture of the monitoring terminal in a digital mirror image of a monitoring system;
calculating the association degree of the association model and the scene model, taking the scene model as a trunk, taking the association model as a branch, and generating a model tree;
Constructing a pre-loading sliding window and a full-loading sliding window, traversing the whole model tree in parallel through the pre-loading sliding window and the full-loading sliding window, eliminating the models which are not in the pre-loading sliding window and the full-loading sliding window in the traversing process, carrying out pre-loading treatment on the model in the pre-loading sliding window, and carrying out full-loading treatment on the model in the full-loading window;
The preloading is specifically as follows:
acquiring scene elements in the completely loaded scene model, and caching the scene elements in the distributed storage module;
a preloading sequence is established from the lower boundary to the upper boundary of the preloading sliding window, the priority of a scene model needing preloading is determined, and rendering is carried out according to the priority;
In the rendering process, whether the same scene elements exist in the distributed storage module or not is read, if yes, the corresponding scene elements in the database are directly extracted, if not, the rendering is directly carried out, and the scene elements after the rendering are stored in the database.
2. A digital twin monitoring system as defined in claim 1, wherein: the digital twin management terminal comprises a data transmission module, a distributed storage module and a data processing server, wherein the data transmission module is used for receiving data transmitted by the monitoring terminal and the user terminal and transmitting feedback information back to the user terminal; the data processing server is used for carrying out data analysis processing according to the received data to generate a monitoring system digital image and a monitoring scene digital image, driving simulation of the monitoring system digital image and simulation of the monitoring scene digital image according to monitoring operation data, and generating a control command according to the operation parameters to control switching of the monitoring system digital image and the monitoring scene digital image; the distributed storage module is used for storing the data received by the data transmission module and the data generated by processing of the data processing server.
3. A digital twin monitoring system as defined in claim 2, in which: the data processing server comprises a scene model construction module, a scene screening module, an operation switching module, a scene optimization module and a rendering module;
The scene model construction module is used for generating a digital mirror image of the monitoring system and a digital mirror image of the monitoring scene according to the monitoring scene data, the monitoring operation data and the simulation parameters;
The scene screening module is used for retrieving a preset target according to the operation parameters, wherein the preset target comprises a jump target of a scene under the current operation, the resolution of the target and the visible range of the target;
The operation switching module is used for switching to the corresponding monitoring system digital mirror image and the corresponding monitoring scene digital mirror image according to the jump target;
the scene optimization module is used for optimizing the digital mirror image of the monitoring system and the digital mirror image of the monitoring scene which are beyond the resolution and are not in the visual range according to the resolution and the visual range of the jump target;
the rendering module is used for rendering the monitor system digital mirror image and the monitor scene digital mirror image which are optimized by the scene optimizing module.
4. A digital twin monitoring system according to claim 3, wherein: the operation simulation of the digital mirror image of the monitoring system is specifically as follows:
acquiring simulation data of a monitoring terminal, wherein the simulation data comprises coordinate information of the monitoring terminal, quantity information of the monitoring terminal, connection relation of the monitoring terminal, parameter information of the monitoring terminal and visible picture range information of the monitoring terminal;
Generating a digital mirror image of the monitoring system according to the coordinate information of the monitoring terminals, the quantity information of the monitoring terminals, the connection relation of the monitoring terminals, the parameter information of the monitoring terminals and the visible picture range information of the monitoring terminals;
Acquiring operation data of a monitoring terminal, driving the digital mirror image of the monitoring system to operate according to the operation data of the monitoring terminal, and realizing motion simulation of the digital mirror image of the monitoring system;
and carrying out preloading treatment and rejection treatment on the model with the visual picture range of the monitoring terminal outside the preset distance.
5. A digital twin monitoring system as defined in claim 1, wherein: the boundaries of the preloaded sliding window and the fully loaded sliding window are determined according to user operations and item importance.
6. A digital twin monitoring system as defined in claim 1, wherein: the preloading further comprises:
Judging the loading path length of a preloaded association model serving as a branch and a scene model serving as a trunk in a model tree, and generating a priority according to the length of the path length;
rendering is performed according to the priority.
7. A digital twin monitoring system as defined in claim 6, wherein: the change simulation of the digital mirror image of the monitoring scene specifically comprises the following steps:
Storing scene elements by a distributed storage module;
constructing a digital mirror image of the monitoring scene according to the monitoring scene data and the simulation parameters uploaded by the user;
And acquiring image data in the monitoring operation data, identifying, calling scene elements according to the identification result, and carrying out change simulation on the digital mirror image of the monitoring scene.
8. A digital twin monitoring system as defined in claim 7, wherein: the scene elements include human body elements, animal body elements, and marker elements.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410504165.6A CN118069475B (en) | 2024-04-25 | 2024-04-25 | Digital twin monitoring system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410504165.6A CN118069475B (en) | 2024-04-25 | 2024-04-25 | Digital twin monitoring system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118069475A CN118069475A (en) | 2024-05-24 |
| CN118069475B true CN118069475B (en) | 2024-07-05 |
Family
ID=91106180
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410504165.6A Active CN118069475B (en) | 2024-04-25 | 2024-04-25 | Digital twin monitoring system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118069475B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115937482A (en) * | 2022-11-24 | 2023-04-07 | 西南交通大学 | Holographic scene dynamic construction method and system capable of adapting to screen size |
| CN116319862A (en) * | 2023-02-09 | 2023-06-23 | 深圳和众创科技有限公司 | System and method for intelligently matching digital libraries |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111210359B (en) * | 2019-12-30 | 2022-01-28 | 中国矿业大学(北京) | Intelligent mine scene oriented digital twin evolution mechanism and method |
| CN116681822A (en) * | 2023-05-22 | 2023-09-01 | 青岛虚拟现实研究院有限公司 | Light weight method of digital twin model |
| CN117876560A (en) * | 2023-11-06 | 2024-04-12 | 西北工业大学 | Three-dimensional model lightweight construction method of digital twin system |
| CN117853636A (en) * | 2023-12-29 | 2024-04-09 | 八维通科技有限公司 | Rapid rendering method and system based on three-dimensional object |
-
2024
- 2024-04-25 CN CN202410504165.6A patent/CN118069475B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115937482A (en) * | 2022-11-24 | 2023-04-07 | 西南交通大学 | Holographic scene dynamic construction method and system capable of adapting to screen size |
| CN116319862A (en) * | 2023-02-09 | 2023-06-23 | 深圳和众创科技有限公司 | System and method for intelligently matching digital libraries |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118069475A (en) | 2024-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8953674B2 (en) | Recording a sequence of images using two recording procedures | |
| JP4633841B2 (en) | Estimating 3D road layout from video sequences by tracking pedestrians | |
| CN110399908B (en) | Event-based camera classification method and apparatus, storage medium, and electronic apparatus | |
| CN104040601A (en) | Cloud-based video surveillance management system | |
| GB2408880A (en) | Observing monitored image data and highlighting incidents on a timeline | |
| KR102296274B1 (en) | Method for providing object recognition with deep learning using fine tuning by user | |
| US8948245B2 (en) | Displaying graphical output representing the activity of a plurality of monitoring detection devices | |
| CN114187541A (en) | Intelligent video analysis method and storage device for user-defined service scene | |
| JP4912028B2 (en) | Sequential learning type non-stationary video detection apparatus, sequential learning type non-stationary video detection method, and program implementing the method | |
| CN117292321B (en) | Motion detection method and device based on video monitoring and computer equipment | |
| CN118229085A (en) | Intelligent park energy management risk visual management system based on attention prediction mechanism | |
| CN118069475B (en) | Digital twin monitoring system | |
| US20230334774A1 (en) | Site model updating method and system | |
| Shi-Kuo et al. | Multi-sensor information fusion by query refinement | |
| Nguyen et al. | A general framework for tracking objects in a multi-camera environment | |
| CN117528030B (en) | Electric panoramic digital retina system, control method, device, equipment and medium | |
| CN118504277B (en) | Digital twin management and control method, device, equipment and medium for urban cable | |
| CN118708080A (en) | Click behavior prediction method and device, computer readable medium and electronic equipment | |
| CN118587651A (en) | Substation operation condition analysis method and device, wearable equipment and storage medium | |
| CN118585340A (en) | Edge data service construction method and language model training method | |
| Zhang et al. | Exploration on Intelligent Interaction Design and User Experience of VR Platform Based on Intelligent Perception and Deep Learning | |
| CN116049432A (en) | Construction method and device of equipment knowledge graph | |
| AU2004233463C1 (en) | Monitoring an output from a camera | |
| CN118097327A (en) | Model training method, video panorama segmentation method, device, equipment, medium and product | |
| CN116778425A (en) | Safety analysis method and device for chemical direct operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: No. 1, 2nd to 7th Floor, Hongji Jingyuan, No. 116 Zaoshan Road, Yunyan District, Guiyang City, Guizhou Province, 550000 Patentee after: GUIZHOU PLANNING & DESIGN INSTITUTE OF POSTS & TELECOMMUNICATIONS Co.,Ltd. Country or region after: China Address before: 550000 Luban Avenue, Renhuai City, Guiyang City, Guizhou Province Patentee before: GUIZHOU PLANNING & DESIGN INSTITUTE OF POSTS & TELECOMMUNICATIONS Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |