CN116740301B

CN116740301B - Three-dimensional virtual monitoring system and method and monitoring equipment

Info

Publication number: CN116740301B
Application number: CN202311006770.2A
Authority: CN
Inventors: 龙锦帆; 谭钢; 梁振桂; 毛帅文; 林若微
Original assignee: Shenzhen Megmeet Electrical Co Ltd
Current assignee: Shenzhen Megmeet Electrical Co Ltd
Priority date: 2023-08-11
Filing date: 2023-08-11
Publication date: 2024-01-30
Anticipated expiration: 2043-08-11
Also published as: CN116740301A

Abstract

The application relates to the technical field of automatic welding and discloses a three-dimensional virtual monitoring system, a three-dimensional virtual monitoring method and monitoring equipment. The method comprises the steps that an industrial model corresponding to each industrial facility in a physical workshop is built through a model building module, the workshop building module responds to user-defined operation of a virtual workshop and/or an industrial model corresponding to the physical workshop by a user, a virtual model list and workshop configuration parameters are generated, equipment data are acquired by an equipment access module, an access equipment list is generated, an association relation between the equipment model and the physical equipment is built by a data binding module based on the virtual model list and the access equipment list, and the association relation is stored in the workshop configuration parameters.

Description

Three-dimensional virtual monitoring system and method and monitoring equipment

Technical Field

The embodiment of the application relates to the technical field of automatic welding, in particular to a three-dimensional virtual monitoring system and method and monitoring equipment.

Background

Along with the development of informatization technology, the requirements of people on a monitoring system in a welding industry scene are higher and higher, and the traditional monitoring system only monitors in real time through a camera, so that the interaction degree is not high and the requirements of users cannot be met.

At present, a monitoring system is generally constructed in a mode of combining digitization with a virtual workshop in a welding industry scene, namely an online virtual monitoring system is constructed through technologies such as three-dimensional modeling and virtual reality so as to detect a physical workshop in an omnibearing manner.

In the process of implementing the present application, the inventor finds that at least the following problems exist in the prior art: the layout of the workshop equipment cannot be modified once established, if the layout of the physical workshop equipment is changed, the virtual workshop cannot respond in time, and a developer is required to modify a program or a modeling engineer to re-model, and the like.

Disclosure of Invention

The embodiment of the application provides a three-dimensional virtual monitoring system, a three-dimensional virtual monitoring method and three-dimensional virtual monitoring equipment, which can solve the problem that a production manager cannot make real-time modification to a virtual workshop according to physical workshop change in the existing monitoring system, and realize the equipment layout of a custom virtual workshop, so that real-time information of the physical workshop is more comprehensively acquired.

The embodiment of the application provides the following technical scheme:

in a first aspect, embodiments of the present application provide a three-dimensional virtual monitoring system, including a model building module, a plant building module, a device access module, and a data binding module, where,

the model construction module is connected with the workshop construction module and is used for constructing an industrial model corresponding to each industrial facility in the physical workshop, wherein the industrial model comprises an equipment model;

the workshop construction module is connected with the model construction module and the equipment access module and is used for creating a virtual workshop corresponding to the physical workshop and responding to the user-defined operation of the user on the virtual workshop and/or the industrial model to generate a virtual model list and workshop configuration parameters;

the device access module is connected with the workshop construction module and the data binding module and is used for acquiring device data, analyzing the device data and generating an access device list, wherein the access device list comprises names of physical devices accessed into the three-dimensional virtual monitoring system;

the data binding module is connected with the equipment access module and is used for establishing the association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list and storing the association relation into workshop configuration parameters.

In some embodiments, industrial facilities include shop building structures and industrial equipment;

the model construction module is specifically used for:

constructing an initial model corresponding to each industrial equipment and/or workshop building structure based on the modeling tool;

carrying out optimization operation on each initial model to obtain an industrial model corresponding to each initial model;

and compressing each industrial model based on a compression algorithm to derive an industrial model file corresponding to each industrial model, wherein the industrial model further comprises a workshop model.

In some embodiments, the plant build module is specifically configured to:

after the model building module derives an industrial model file, generating an import model list based on the industrial model file;

creating a virtual workshop, responding to the operation of loading an industrial model to the virtual workshop by a user through the imported model list, generating a virtual model list, calling a loader corresponding to the type of the industrial model file, and carrying out loading analysis on the industrial model file;

rendering and displaying the industrial model based on a three-dimensional engine in the browser.

In some embodiments, the plant build module is further to:

generating workshop configuration parameters in response to user-defined operation of the virtual workshop and/or the industrial model by a user;

And responding to the preview operation of the user on the virtual workshop, dynamically loading an industrial model corresponding to the workshop configuration parameters, and adjusting a matrix of the industrial model based on the workshop configuration parameters so as to show the equipment layout of the virtual workshop customized by the user.

In some embodiments, the device access module is specifically configured to:

acquiring equipment data;

analyzing the device data based on a user-defined object model to obtain an analysis result, storing the analysis result into a device database, and generating an access device list, wherein the object model comprises a device data analysis rule, and the access device list further comprises a corresponding relation between physical devices and device data.

In some embodiments, the three-dimensional virtual monitoring system further comprises a data presentation configuration module;

the data display configuration module is connected with the data binding module and is used for configuring a device data display mode and displaying the device data based on workshop configuration parameters, wherein the device data display mode comprises a label or an animation.

In some embodiments, the device access module is further configured to establish a correspondence between the physical device and the object model;

the data display configuration module is specifically used for:

after the association relation between the equipment model and the physical equipment is established by the data binding module, a data parameter list is generated based on the equipment model selected by the user and the corresponding relation between the physical equipment and the object model, wherein the data parameter list comprises data names of the physical equipment;

Based on the label created by the user for the selected equipment model and the data parameter list, establishing an association relation between the physical equipment and the label and the data to be displayed, and storing the association relation into workshop configuration parameters;

and responding to the preview operation of the user on the virtual workshop, and displaying the label according to the workshop configuration parameters and the setting parameters of the label.

In some embodiments, the data presentation configuration module is further to:

generating an animation list based on an animation sequence of the industrial model file, and determining an animation sequence selected by a user in the animation list;

storing the association relation between the animation sequence selected by the user and the state quantity data to workshop configuration parameters, wherein the state quantity data comprises data in an object model;

traversing the association relation between the animation sequence and the state quantity data in the workshop configuration parameters according to the background timing task;

and determining whether to animate the equipment model selected by the user according to the numerical value of the state quantity data in the association relation.

In some embodiments, the three-dimensional virtual monitoring system is accessed or run through a browser.

In a second aspect, an embodiment of the present application provides a three-dimensional virtual monitoring method, which is applied to the three-dimensional virtual monitoring system according to the first aspect, where the three-dimensional virtual monitoring method includes:

Creating a virtual workshop based on input operation of a user;

responding to the user-defined operation of the virtual workshop and/or the industrial model, and generating a virtual model list and workshop configuration parameters;

acquiring equipment data, analyzing the equipment data, and generating an access equipment list, wherein the access equipment list comprises names of physical equipment accessed into the three-dimensional virtual monitoring system;

and establishing an association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list, and storing the association relation into workshop configuration parameters.

In some embodiments, the three-dimensional virtual monitoring method further comprises:

and displaying the equipment data based on the equipment data display mode and the workshop configuration parameters configured by the user so as to monitor the physical workshops corresponding to the virtual workshops.

In a third aspect, embodiments of the present application provide a monitoring device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the three-dimensional virtual monitoring method as in the second aspect when the computer program is executed by the processor.

In a fourth aspect, embodiments of the present application provide a non-volatile computer readable storage medium storing a computer program that when executed by a processor implements the three-dimensional virtual monitoring method as in the second aspect.

The beneficial effects of this embodiment of the application are: different from the situation of the prior art, the embodiment of the application provides a three-dimensional virtual monitoring system, which comprises a model building module, a workshop building module, a device access module and a data binding module. The model construction module is connected with the workshop construction module and is used for constructing an industrial model corresponding to each industrial device in the physical workshop, wherein the industrial model comprises a device model; the workshop construction module is connected with the model construction module and the equipment access module and is used for creating a virtual workshop corresponding to the physical workshop and responding to the user-defined operation of the user on the virtual workshop and/or the industrial model to generate a virtual model list and workshop configuration parameters; the device access module is connected with the workshop construction module and the data binding module and is used for acquiring device data, analyzing the device data and generating an access device list, wherein the access device list comprises names of physical devices accessed into the three-dimensional virtual monitoring system; the data binding module is connected with the equipment access module and is used for establishing the association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list and storing the association relation into workshop configuration parameters.

On the one hand, an industrial model corresponding to each industrial device in the physical workshop is built through a model building module, the workshop building module responds to user-defined operation of a virtual workshop and/or an industrial model corresponding to the physical workshop, a virtual model list and workshop configuration parameters are generated, and the layout of the user-defined virtual workshop can be realized.

On the other hand, equipment data are acquired through the equipment access module, an access equipment list is generated, the data binding module establishes an association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list, and the association relation is stored in workshop configuration parameters.

Drawings

One or more embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements, and in which the figures of the drawings are not to scale, unless expressly stated otherwise.

Fig. 1 is a schematic structural diagram of a three-dimensional virtual monitoring system according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a detailed structure of a three-dimensional virtual monitoring system according to an embodiment of the present application;

FIG. 3 is a schematic process flow diagram of a plant building block according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram of a processing flow of a data display configuration module through tag display device data according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a data processing flow of a data display configuration module through animation display device according to an embodiment of the present application;

fig. 6 is a schematic flow chart of a three-dimensional virtual monitoring method according to an embodiment of the present application;

fig. 7 is a schematic diagram of a refinement flow of step S602 in fig. 6;

fig. 8 is a schematic diagram of a refinement flow of step S603 in fig. 6;

fig. 9 is a schematic flow chart of displaying device data through a tag according to an embodiment of the present application;

FIG. 10 is a schematic flow chart of data passing through an animation display device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a monitoring device according to an embodiment of the present application.

Reference numerals illustrate:

Detailed Description

In order to facilitate an understanding of the present application, the present application will be described in more detail below with reference to the accompanying drawings and detailed description. It will be understood that when an element is referred to as being "fixed" to another element, it can be directly on the other element or one or more intervening elements may be present therebetween. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or one or more intervening elements may be present therebetween. The terms "vertical," "horizontal," "left," "right," and the like are used herein for illustrative purposes only.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the present application in this description is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and/or" as used in this specification includes any and all combinations of one or more of the associated listed items.

The technical scheme of the application is specifically described below with reference to the accompanying drawings of the specification:

referring to fig. 1, fig. 1 is a schematic structural diagram of a three-dimensional virtual monitoring system according to an embodiment of the present application;

as shown in fig. 1, the three-dimensional virtual monitoring system 1000 includes a model building module 100, a plant building module 200, a device access module 300, and a data binding module 400.

The model building module 100 is connected to the plant building module 200 for building an industrial model corresponding to each industrial facility in the physical plant, wherein the industrial model includes an equipment model.

The shop assistant construction module 200 is connected with the model construction module 100 and the device access module 300, and is configured to create a virtual shop assistant corresponding to the physical shop assistant, and generate a virtual model list and shop assistant configuration parameters in response to user-defined operation of the virtual shop assistant and/or the industrial model.

The device access module 300 is connected with the workshop building module 200 and the data binding module 400, and is used for acquiring device data, analyzing the device data and generating an access device list, wherein the access device list comprises names of physical devices accessed into the three-dimensional virtual monitoring system.

The data binding module 400 is connected to the device access module 300, and is configured to establish an association relationship between the device model and the physical device based on the virtual model list and the access device list, and store the association relationship into the workshop configuration parameters.

Specifically, referring to fig. 2, fig. 2 is a detailed structural schematic diagram of a three-dimensional virtual monitoring system according to an embodiment of the present application;

as shown in fig. 2, the three-dimensional virtual monitoring system 1000 includes a model building module 100, a plant building module 200, a device access module 300, a data binding module 400, and a data presentation configuration module 500.

In the present embodiment, the three-dimensional virtual monitoring system 1000 is accessed or run through a browser.

The model building module 100 is connected to the plant building module 200, and is configured to build an industrial model corresponding to each industrial facility in the physical plant, where the industrial model includes an equipment model and a plant model. Specifically, a physical plant is a place or space for performing actual production operations, and generally includes elements such as equipment, machines, tools, and the like; industrial facilities include plant building structures including plant wall structures, and industrial equipment including machines and the like for actual production operations in physical workshops, such as: industrial equipment includes welding machines, cameras, welders, welding robots, and the like, which are welding-related devices.

The industrial model is a three-dimensional virtual model corresponding to an industrial facility of a physical plant, for example: the industrial model comprises a welding machine model, a camera model, a welder model, a welding robot model and other models of welding-related equipment, wherein the equipment model is an industrial model corresponding to industrial equipment, and the workshop model is an industrial model corresponding to a workshop wall structure.

In the embodiment of the present application, the model building module 100 is specifically configured to: constructing an initial model corresponding to each industrial equipment and/or workshop building structure based on the modeling tool; carrying out optimization operation on each initial model to obtain an industrial model corresponding to each initial model; and compressing each industrial model based on a compression algorithm to derive an industrial model file corresponding to each industrial model.

Specifically, the model building module 100 builds an initial model corresponding to each industrial equipment and/or workshop wall structure through a modeling tool, and then performs an optimization operation on each initial model, for example: and carrying out optimization operations such as surface reduction, baking materials and the like to obtain an equipment model corresponding to the initial model of each industrial equipment and/or obtain a workshop model corresponding to the initial model of each workshop wall structure. Further, the model building module 100 compresses each equipment model and/or plant model based on a compression algorithm, and adjusts the compression level to the highest level, so as to derive an industrial model file corresponding to each equipment model and/or plant model, wherein the type of the industrial model file is a glb type.

The modeling tool comprises, but is not limited to, blender 3D modeling software (Blender), wherein Blender is a model-sourced three-dimensional modeling software, and supports three-dimensional modeling, engraving, skeleton assembly, animation, simulation, real-time rendering, synthesis, motion tracking and the like. Compression algorithms such as: the delake compression algorithm (drago), an open source algorithm for three-dimensional geometric data compression, can compress three-dimensional model data to 1/10 or less of the original size while maintaining little visible quality loss.

The shop assistant construction module 200 is connected with the model construction module 100 and the device access module 300, and is configured to create a virtual shop assistant corresponding to the physical shop assistant, and generate a virtual model list and shop assistant configuration parameters in response to user-defined operation of the virtual shop assistant and/or the industrial model. The virtual model list comprises workshop models and/or equipment models which are selected by a user in the imported model list and need to be loaded into the virtual workshop, and the workshop configuration parameters comprise parameters of the industrial model loaded by the virtual workshop. Specifically, the workshop configuration parameters include names of industrial models loaded by the virtual workshop, parameters of each industrial model after user-defined operation, and the like.

In the embodiment of the present application, the shop build module 200 is specifically configured to: after the model building module 100 exports the industrial model files, an import model list is generated based on the industrial model files; creating a virtual workshop, responding to the operation of loading an industrial model to the virtual workshop by a user through the imported model list, generating a virtual model list, calling a loader corresponding to the type of the industrial model file, and carrying out loading analysis on the industrial model file; rendering and displaying the industrial model based on a three-dimensional engine in the browser.

In the present embodiment, the shop build module 200 is further configured to: generating workshop configuration parameters in response to user-defined operation of the virtual workshop and/or the industrial model by a user; and responding to the preview operation of the user on the virtual workshop, dynamically loading an industrial model corresponding to the workshop configuration parameters, and adjusting a matrix of the industrial model based on the workshop configuration parameters so as to show the equipment layout of the virtual workshop customized by the user.

Specifically, referring to fig. 3, fig. 3 is a schematic process flow diagram of a workshop building module according to an embodiment of the present application;

as shown in fig. 3, the process flow of the shop build module includes:

Step S301: generating an import model list;

specifically, after the model building module 100 uploads the exported glb type industrial model file to the three-dimensional virtual monitoring system 1000, the shop building module 200 records the industrial model corresponding to the uploaded industrial model file, so as to generate an import model list for the subsequent user to select an industrial model to use in the import model list, where the import model list includes names of the industrial models imported to the three-dimensional virtual monitoring system 1000, for example: the import model list includes names of plant models and/or equipment models.

In some embodiments, the shop build module 200 also supports importing an already created industrial model from outside and generating a list of imported models based on the externally imported industrial model and/or the industrial model files uploaded by the model build module 100.

Step S302: determining an industrial model loaded by a user to a virtual workshop;

when a user creates a virtual plant in the three-dimensional virtual monitoring system 1000, the plant building module 200 enters an editor page in response to the user's creation operation to enable the user to select plant models and/or equipment models in the import model list that need to be loaded into the virtual plant to determine the plant models and/or equipment models that the user loads into the virtual plant.

Step S303: generating a virtual model list;

specifically, the shop floor construction module 200 generates a list of virtual models in response to a user loading an industrial model into the virtual shop floor via the list of imported models.

Step S304: calling a loader;

specifically, the three-dimensional virtual monitoring system 1000 loads an industrial model in a web page of a browser through a 3D engine, for example: the industrial model files of various types are loaded and parsed through various loaders provided by the three.js framework running in the browser to present the industrial model. The THREE.JS framework is an open source JavaScript framework based on the WebGL technology and is used for creating and displaying 3D graphic scenes and animations.

The workshop construction module 200 calls a loader corresponding to the type of the industrial model file through the three.js frame to load and analyze the industrial model file.

It will be appreciated that the loader, through built-in decompression algorithms, may automatically decompress the industrial model for analytical rendering. Different types of industrial model files correspond to different loaders, for example: for the glb type industrial model file, the three-dimensional virtual monitoring system 1000 calls the GltfLoader to parse, for the fbx type industrial model file, the three-dimensional virtual monitoring system 1000 calls the FbxLoader to parse, and for the obj type industrial model file, the three-dimensional virtual monitoring system 1000 calls the obj loader to parse.

Step S305: rendering and displaying the industrial model;

specifically, the shop build module 200 invokes the render Api of the three.js frame to render and display the industrial model.

In the embodiment of the present application, since the industrial model is relatively complex, the size of the corresponding industrial model file is usually particularly large, and the model construction module 100 performs an optimization operation on each initial model to obtain a corresponding industrial model, compresses each industrial model based on the drago compression algorithm to derive the corresponding industrial model file, and the shop construction module 200 performs analytical rendering on each industrial model file based on the three.js frame.

Step S306: determining user-defined operation of a virtual workshop and/or an industrial model by a user;

specifically, the three-dimensional virtual monitoring system 1000 provides system interaction functions by running a model controller provided by the three.js framework, such as: when a user performs self-defined operations such as moving, scaling, rotating and the like on the industrial model on the display page through a mouse, the three-dimensional virtual monitoring system 1000 automatically acquires the position, scaling and rotation angle of the industrial model in the three-dimensional world, and stores the operation result of the user as layout parameters.

In this embodiment of the present application, when a user performs operations such as moving, zooming, rotating, etc. on an industrial model through a mouse, or the placement position, the size, etc. of the industrial model are customized by filling parameters of the industrial model, the layout of the virtual workshops is correspondingly adjusted, so as to implement the layout of the customized virtual workshops, for example: the size of the self-defined workshop, the placement position of industrial equipment, the light intensity and the like.

Step S307: saving workshop configuration parameters;

specifically, in response to a user's custom operation on the virtual plant and/or the industrial model, the plant building module 200 saves parameters of each industrial model after the user performs the custom operation as plant configuration parameters, where the plant configuration parameters include position coordinates, scaling ratio, rotation coefficient, and the like of the industrial model. It can be understood that, in the virtual shop created by the user, the name of the loaded industrial model and the parameters of the industrial model after the user performs the custom operation on the industrial models are all saved as json data to the shop configuration parameters corresponding to the virtual shop, and further, the shop configuration parameters are stored by the shop construction module 200 to the background database of the three-dimensional virtual monitoring system 1000.

Step S308: determining a user preview virtual workshop;

step S309: inquiring workshop configuration parameters;

step S310: and adjusting the matrix of the industrial model according to the workshop configuration parameters.

Specifically, when the user selects to preview the virtual shop, the shop construction module 200 responds to the preview operation of the user on the virtual shop, reads the shop configuration parameters corresponding to the virtual shop, dynamically loads the industrial model corresponding to the shop configuration parameters, and adjusts the matrix of the industrial model based on the parameter values in the shop configuration parameters to display the device layout of the user-defined virtual shop.

Compared with the prior art that a production manager cannot make real-time modification to a virtual workshop according to physical workshop variation, namely, the virtual workshop cannot respond in time when the physical workshop equipment layout is changed, a developer is required to modify a program or a modeling engineer is required to conduct modeling again, and the like, the method and the device construct an industrial model corresponding to each industrial facility in the physical workshop through the model constructing module 100, and the workshop constructing module 200 responds to the user-defined operation of the virtual workshop and/or the industrial model corresponding to the physical workshop by a user to generate a virtual model list and workshop configuration parameters, so that the layout of the user-defined virtual workshop can be realized, and secondary development is not required through the developer.

In the embodiment of the present application, the device access module 300 is specifically configured to: acquiring equipment data; analyzing the equipment data based on the user-defined object model to obtain an analysis result, storing the analysis result into an equipment database, and generating an access equipment list. The device data are device message data of the physical device, the object model comprises a device data analysis rule, the device database is used for storing the analyzed device data, and the access device list further comprises a corresponding relation between the physical device and the device data.

Specifically, before the user inputs device data to the device access module 300, the device access module 300 determines a user-defined object model in response to the user-selected protocol type and the user-configured parsing rules. The protocol type is the type of the physical device uploading device message data, and the protocol type comprises two types of hex (16 system) type and json (key value) type.

The object model specifically includes the name of the device data, the type of the device data, and the like. The names of the equipment data include welding current, voltage, gas flow, switching state, operation mode, welding mode, wire diameter, wire type, current type, job number, high frequency arc striking, etc., and the types of the equipment data include numerical value type, bit value type, character type, enumeration type, boolean type, etc. For example: the types of welding current, voltage and air flow are all digital; the switch state, the operation mode and the welding mode are all bit value type; the types of Job numbers and wps are characters; the types of the diameter of the welding wire, the type of the welding wire and the type of the current are enumerated; the type of high frequency striking is boolean.

After the user creates the object model and inputs the device message data of the physical device to the device access module 300, the device access module 300 receives the device message data, analyzes the device message data based on the user-defined object model to obtain an analysis result, stores the analysis result in the device database, generates an access device list, and establishes a corresponding relationship between the physical device and the object model.

Compared with the prior art that the device data of the newly added device cannot be accessed in real time, namely when a device type is newly added in a workshop site, the message data type of the device for uploading is not defined in a monitoring system, or is an unconventional welding data type, for example: the unconventional welding data type is bit value type, then the production manager needs to submit the requirement to the developer first, and after the developer modifies the program and increases the data access interface, the monitoring system can acquire the real-time data of the newly-added equipment in the virtual workshop.

The data binding module 400 is connected with the device access module 300 and the data display configuration module 500, and is configured to establish an association relationship between the device model and the physical device based on the virtual model list and the access device list, and store the association relationship into the workshop configuration parameters.

Specifically, after the plant building module 200 generates the virtual model list and the device access module 300 generates the access device list, the data binding module 400 responds to the operation that the user configures the association device for the designated device model in the virtual device list on the page of the browser, configures and associates the device model selected by the user in the virtual device list with the physical device in the access device list, establishes the association relationship between the device model and the physical device, that is, associates the specific device model with the device data, that is, corresponds the virtual device and the physical device, and stores the association relationship in json format into the plant configuration parameters. It can be understood that after the association relationship between the plurality of device models and the corresponding physical devices is established, the plurality of association relationships can be stored in the workshop configuration parameters in the form of an association relationship table.

In the embodiment of the application, the device access module is used for acquiring the device data to generate the access device list, the data binding module is used for establishing the association relation between the device model and the physical device based on the virtual model list and the access device list and storing the association relation into the workshop configuration parameters, and the corresponding relation between the physical device in the real scene and the device model in the three-dimensional virtual monitoring system can be established, so that the three-dimensional virtual monitoring system can comprehensively and accurately reflect the information of the physical workshop.

The data display configuration module 500 is connected with the data binding module 400, and is used for configuring a device data display mode and displaying device data based on workshop configuration parameters, wherein the device data display mode comprises a label or an animation. Specifically, when the device data display mode is a label, the three-dimensional virtual monitoring system 1000 displays the device data on a page of the browser with a label as a display template, for example: show voltage, current, etc.; when the device data display mode is animation, the three-dimensional virtual monitoring system 1000 plays the device model through animation on the page of the browser.

In the embodiment of the present application, the data presentation configuration module 500 is specifically configured to: after the data binding module 400 establishes the association relationship between the device model and the physical device, a data parameter list is generated based on the device model selected by the user and the corresponding relationship between the physical device and the object model; based on the label created by the user for the selected equipment model and the data parameter list, establishing an association relation between the physical equipment and the label and the data to be displayed, and storing the association relation into workshop configuration parameters; and responding to the preview operation of the user on the virtual workshop, and displaying the label according to the workshop configuration parameters and the setting parameters of the label.

Specifically, referring to fig. 4, fig. 4 is a schematic diagram of a processing flow of data of a tag display device by a data display configuration module according to an embodiment of the present application;

as shown in fig. 4, the processing flow of the data display configuration module through the tag display device data includes:

step S401: determining a device model;

specifically, the data presentation configuration module 500 determines a device model selected by the user in the virtual model list;

step S402: associating physical devices;

specifically, after the data binding module 400 establishes the association relationship between the device model and the physical device according to the device model selected by the user in the virtual model list, the data display configuration module 500 determines the physical device corresponding to the device model.

Step S403: generating a data parameter list;

specifically, the data display configuration module 500 queries the correspondence between the physical device and the object model established by the device access module 300, and determines the object model corresponding to the physical device, so as to generate a data parameter list, where the data parameter list includes data names of the physical device, for example: the list of data parameters includes voltage, current, etc.

Step S404: creating a label;

Specifically, when the user selects the device data display mode using the tag as the device model, in response to the operation of creating the tag for the device model and configuring the setting parameters of the tag on the page of the browser, the data display configuration module 500 stores the setting parameters of the tag, and establishes the association relationship between the physical device and the tag, where the setting parameters of the tag include the tag coordinate, the tag size, and the like.

Step S405: establishing an association relation between physical equipment and a tag and between the physical equipment and data to be displayed;

specifically, in response to a user selecting data to be displayed by the tag from the data parameter list, the data display configuration module 500 establishes an association between the tag and the data to be displayed to identify which data the tag should display. Further, the data display configuration module 500 establishes an association relationship between the physical device and the tag and an association relationship between the tag and the data to be displayed based on the association relationship between the physical device and the tag and the association relationship between the tag and the data to be displayed, and stores the association relationship into the workshop configuration parameters.

Step S406: displaying the label;

specifically, in response to a preview operation of the user on the virtual workshop, the data display configuration module 500 reads the workshop configuration parameters, and displays the label according to the association relationship between the physical device and the label and the data to be displayed, and the setting parameters of the label.

Step S407: acquiring a background timing label task;

specifically, the background timing tag task is used to control the data display configuration module 500 to traverse the tag list and update the data value of the tag configuration.

Step S408: updating the data value configured in the tag;

specifically, the data display configuration module 500 automatically queries the device data of the physical device matched with the device model at regular time according to the background timing tag task, and then traverses the tag list to cover the data value configured in the tag, so as to play a role in refreshing the data at regular time. Further, the data presentation configuration module 500 may present the tag in response to a user preview operation of the virtual shop.

In the embodiment of the present application, the data presentation configuration module 500 is further configured to: generating an animation list based on an animation sequence of the industrial model file, and determining an animation sequence selected by a user in the animation list; storing the association relation between the animation sequence selected by the user and the state quantity data to workshop configuration parameters, wherein the state quantity data comprises data in an object model; traversing the association relation between the animation sequence and the state quantity data in the workshop configuration parameters according to the background timing task; and determining whether to animate the equipment model selected by the user according to the numerical value of the state quantity data in the association relation.

Specifically, referring to fig. 5, fig. 5 is a schematic diagram of a processing flow of data passing through an animation display device by a data display configuration module according to an embodiment of the present application;

as shown in fig. 5, the data presentation configuration module includes:

step S501: generating an animation list;

specifically, if the industrial model file has an animation sequence, after the industrial model file is imported into the three-dimensional virtual monitoring system 1000, the data display configuration module 500 automatically identifies and records the animation sequence of the device model corresponding to the industrial model file, and generates an animation list based on the animation sequence, where the animation list includes at least one animation sequence.

Step S502: acquiring a state quantity data list;

specifically, the state quantity data list is generated by the three-dimensional virtual monitoring system 1000 according to the corresponding relation between the physical device and the object model established in the device access module 300, specifically, the three-dimensional virtual monitoring system 1000 screens out parameters of boolean types in the object model of the physical device corresponding to the device model selected by the user to form a state quantity data list, the state quantity data list is selected by the user in the form of a drop-down frame on a page, the state quantity data list comprises at least one state quantity data, the state quantity data comprises boolean types of data in the object model, and the state quantity data has two values: yes or no.

Step S503: recording the association relation between the animation sequence selected by the user and the state quantity data;

specifically, in response to a user selection operation on a page of an animation sequence in an animation list corresponding to a certain device model and the device model, and a selection operation on state quantity data in a state quantity data list, the data display configuration module 500 records an association relationship between the animation sequence selected by the user and the state quantity data, and stores the association relationship to the workshop configuration parameters.

Step S504: acquiring a background timing animation task;

specifically, the background timing animation task is used for controlling the data display configuration module 500 to traverse the association relationship between the animation sequence and the state quantity data in the workshop configuration parameters.

Step S505: traversing the association relation between the animation sequence and the state quantity data in the workshop configuration parameters;

specifically, the data display configuration module 500 traverses the association relationship between the animation sequence and the state quantity data in the workshop configuration parameters according to the background timing animation task, and queries the numerical value of the state quantity data in the association relationship.

Step S506: and determining whether to play the animation according to the numerical value of the state quantity data.

Specifically, when the value of the state quantity data in the association relationship is yes, the data display configuration module 500 plays an animation sequence corresponding to the device model selected by the user, so that the device model selected by the user is played in an animation form on the page of the browser; when the value of the state quantity data in the association relationship is no, the data display configuration module 500 does not play the animation sequence corresponding to the device model selected by the user.

In the embodiment of the application, the data display mode of the device is configured through the data display configuration module 500, and the device data is displayed based on workshop configuration parameters.

Compared with the hardware requirement of the virtual monitoring system in the existing scheme, namely, the existing three-dimensional application software such as UE, U3D and the like directly runs on an operating system, the virtual monitoring system usually needs to run on a high-configuration server.

In an embodiment of the application, by providing a three-dimensional virtual monitoring system, the three-dimensional virtual monitoring system comprises a model building module, a workshop building module, a device access module and a data binding module. The model construction module is connected with the workshop construction module and is used for constructing an industrial model corresponding to each industrial device in the physical workshop, wherein the industrial model comprises a device model; the workshop construction module is connected with the model construction module and the equipment access module and is used for creating a virtual workshop corresponding to the physical workshop and responding to the user-defined operation of the user on the virtual workshop and/or the industrial model to generate a virtual model list and workshop configuration parameters; the device access module is connected with the workshop construction module and the data binding module and is used for acquiring device data, analyzing the device data and generating an access device list, wherein the access device list comprises names of physical devices accessed into the three-dimensional virtual monitoring system; the data binding module is connected with the equipment access module and is used for establishing the association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list and storing the association relation into workshop configuration parameters.

Referring to fig. 6, fig. 6 is a schematic flow chart of a three-dimensional virtual monitoring method according to an embodiment of the present application;

the three-dimensional virtual monitoring method is applied to the three-dimensional virtual monitoring system in any embodiment, the three-dimensional virtual monitoring system is accessed or operated through a browser, and the three-dimensional virtual monitoring system comprises a model building module, a workshop building module, a device access module and a data binding module.

As shown in fig. 6, the three-dimensional virtual monitoring method includes:

step S601: creating a virtual workshop based on input operation of a user;

specifically, the three-dimensional virtual monitoring system provides a system interaction function by running the model controller provided by the three.js framework, and when a user needs to create a virtual workshop in the three-dimensional virtual monitoring system, a workshop construction module in the three-dimensional virtual monitoring system responds to input operation of the user on a browser page, for example: and (3) creating a virtual workshop through a mouse click operation, and entering an editor page to enable a user to select an industrial model to be loaded into the virtual workshop in the imported model list.

The imported model list comprises names of industrial models imported to the three-dimensional virtual monitoring system, the imported model list is generated by the three-dimensional virtual monitoring system based on industrial model files exported by the model building module and/or from an externally imported industrial model which is already created. The industrial model comprises an equipment model and a workshop model, wherein the equipment model is an industrial model corresponding to industrial equipment, and the workshop model is an industrial model corresponding to a workshop wall structure.

Step S602: responding to the user-defined operation of the virtual workshop and/or the industrial model, and generating a virtual model list and workshop configuration parameters;

Specifically, a workshop construction module in the three-dimensional virtual monitoring system responds to the operation that a user loads an industrial model to a virtual workshop through a model list, a virtual model list is generated, parameters of each industrial model after the user moves, zooms, rotates and other self-defining operations on the industrial model through a mouse on a display page are obtained through the THREE.JS framework, and the parameters are stored as workshop configuration parameters.

Specifically, referring to fig. 7, fig. 7 is a schematic diagram of a refinement flow of step S602 in fig. 6;

as shown in fig. 7, step S602: generating a virtual model list and plant configuration parameters in response to user-defined operations on the virtual plant and/or the industrial model, including:

step S621: generating a virtual model list in response to a user loading an industrial model into the virtual workshop through the imported model list;

specifically, the three-dimensional virtual monitoring system loads an industrial model in a webpage of a browser through a 3D engine, for example: the industrial model files of various types are loaded and parsed through various loaders provided by the three.js framework running in the browser to present the industrial model. A shop floor construction module in the three-dimensional virtual monitoring system generates a list of virtual models in response to a user loading an industrial model into the virtual shop floor by importing the list of models. The virtual model list comprises workshop models and/or equipment models which are selected by a user in the imported model list and need to be loaded into the virtual workshop.

Step S622: invoking a loader corresponding to the type of the industrial model file, and loading and analyzing the industrial model file;

specifically, a workshop building module in the three-dimensional virtual monitoring system calls a loader corresponding to the type of the industrial model file through the THREE.JS framework to load and analyze the industrial model file.

It will be appreciated that the loader, through built-in decompression algorithms, may automatically decompress the industrial model for analytical rendering. Different types of industrial model files correspond to different loaders, for example: for the glb type industrial model file, the three-dimensional virtual monitoring system calls a GltfLoader loader to analyze, for the fbx type industrial model file, the three-dimensional virtual monitoring system calls a FbxLoader loader to analyze, and for the obj type industrial model file, the three-dimensional virtual monitoring system calls an objLoader loader to analyze.

Step S623: rendering and displaying the industrial model based on a three-dimensional engine in the browser;

specifically, a workshop building module in the three-dimensional virtual monitoring system calls a rendering Api of the three.js frame to render and display the industrial model.

Step S624: in response to user-defined operation of the virtual workshops and/or the industrial model, the workshops configuration parameters are generated.

Specifically, the three-dimensional virtual monitoring system provides system interaction functions by running a model controller provided by the three.js framework, for example: when a user performs self-defined operations such as moving, scaling, rotating and the like on the industrial model on the display page through a mouse, the three-dimensional virtual monitoring system automatically acquires the position, scaling and rotation angle of the industrial model in the three-dimensional world, and stores an operation result of the user as a layout parameter.

In response to user-defined operation of the virtual workshops and/or the industrial models, the workshop construction module stores parameters of each industrial model after the user-defined operation as workshop configuration parameters. It can be understood that in the virtual workshop created by the user, the name of the loaded industrial model and the parameters of the industrial model after the user performs the self-defining operation on the industrial models are all saved as json data into workshop configuration parameters corresponding to the virtual workshop, and further, the workshop configuration parameters are saved into a background database of the three-dimensional virtual monitoring system by the workshop construction module.

Wherein the plant configuration parameters include parameters of the virtual plant-loaded industrial model. Specifically, the workshop configuration parameters include names of industrial models loaded by the virtual workshop, parameters of each industrial model after user-defined operation, and the like, and parameters of each industrial model after user-defined operation include: position coordinates, scaling ratio, rotation coefficient, etc. of the industrial model.

In an embodiment of the present application, after generating the workshop configuration parameters, the method further includes: and responding to the preview operation of the user on the virtual workshop, dynamically loading an industrial model corresponding to the workshop configuration parameters, and adjusting a matrix of the industrial model based on the workshop configuration parameters so as to show the equipment layout of the virtual workshop customized by the user.

Specifically, when a user selects to preview a certain virtual workshop, the workshop construction module responds to the preview operation of the user on the virtual workshop, reads workshop configuration parameters corresponding to the virtual workshop, dynamically loads an industrial model corresponding to the workshop configuration parameters, and adjusts a matrix of the industrial model based on parameter values in the workshop configuration parameters so as to display the equipment layout of the virtual workshop customized by the user.

Compared with the prior art that a production manager cannot make real-time modification to a virtual workshop according to physical workshop change, namely the virtual workshop cannot respond in time when the physical workshop equipment layout is changed, a developer is required to modify a program or a modeling engineer is required to conduct modeling again and the like, the virtual model list and workshop configuration parameters are generated by responding to the user-defined operation of the virtual workshop and/or the industrial model corresponding to the physical workshop, the layout of the user-defined virtual workshop can be achieved, and secondary development is not required through the developer.

Step S603: acquiring equipment data, analyzing the equipment data, and generating an access equipment list;

specifically, a device access module in the three-dimensional virtual monitoring system acquires device data, analyzes the device data based on a user-defined object model to obtain an analysis result, stores the analysis result in a device database, and generates an access device list. The device data are device message data of the physical device, the object model comprises a device data analysis rule, the device database is used for storing the analyzed device data, and the access device list comprises names of the physical devices accessed to the three-dimensional virtual monitoring system and corresponding relations between the physical devices and the device data.

Specifically, referring to fig. 8, fig. 8 is a schematic diagram of a refinement flow of step S603 in fig. 6;

as shown in fig. 8, step S603: acquiring equipment data, analyzing the equipment data, and generating an access equipment list, wherein the access equipment list comprises:

step S631: determining a user-defined object model;

specifically, before a user inputs device data to a device access module, the device access module determines a user-defined object model in response to a protocol type selected by the user and a parsing rule configured by the user. The protocol type is the type of the physical device uploading device message data, and the protocol type comprises two types of hex (16 system) type and json (key value) type.

Step S632: acquiring equipment data;

specifically, after the user creates the object model, the device access module receives device message data of the physical device input by the user.

Step S633: analyzing the equipment data based on the user-defined object model to obtain an analysis result, storing the analysis result into an equipment database, and generating an access equipment list.

Specifically, the device access module analyzes the device message data based on the user-defined object model to obtain an analysis result, stores the analysis result in the device database, generates an access device list, and establishes a corresponding relationship between the physical device and the object model.

Compared with the prior art that the device data of the newly added device cannot be accessed in real time, namely when a device type is newly added in a workshop site, the message data type of the device for uploading is not defined in a monitoring system, or is an unconventional welding data type, for example: the non-conventional welding data type is bit value type, then the production manager needs to submit the requirement to the developer, the monitoring system can acquire real-time data of the newly-added equipment in the virtual workshop after the developer modifies the program and increases the data access interface.

Step S604: and establishing an association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list, and storing the association relation into workshop configuration parameters.

Specifically, after the workshop building module generates a virtual model list and the equipment access module generates an access equipment list, the data binding module in the three-dimensional virtual monitoring system responds to the operation of configuring and associating equipment on a designated equipment model in the virtual equipment list by a user on a page of a browser, configures and associates the equipment model selected by the user in the virtual equipment list with physical equipment in the access equipment list, establishes an association relationship between the equipment model and the physical equipment, namely associates a specific equipment model with equipment data, namely corresponds the virtual equipment and the physical equipment, and stores the association relationship in a json format into workshop configuration parameters. It can be understood that after the association relationship between the plurality of device models and the corresponding physical devices is established, the plurality of association relationships can be stored in the workshop configuration parameters in the form of an association relationship table.

In the embodiment of the application, the association relation between the equipment model and the physical equipment is established based on the virtual model list and the access equipment list, and the association relation is stored in the workshop configuration parameters.

In the embodiment of the present application, the three-dimensional virtual monitoring method further includes: and displaying the equipment data based on the equipment data display mode and the workshop configuration parameters configured by the user so as to monitor the physical workshops corresponding to the virtual workshops.

Specifically, the three-dimensional virtual monitoring system further comprises a data display configuration module, and the data display configuration module displays the equipment data based on the equipment data display mode and the workshop configuration parameters configured by the user so as to monitor the physical workshop corresponding to the virtual workshop.

The device data display mode comprises a label or an animation. Specifically, when the device data display mode is a label, the three-dimensional virtual monitoring system displays the device data on a page of the browser by using a label as a display template, for example: displaying welding voltage, welding current, gas consumption, welding wire consumption and the like; when the equipment data display mode is animation, the three-dimensional virtual monitoring system plays the equipment model through animation on the page of the browser.

Referring to fig. 9, fig. 9 is a schematic flow chart of displaying equipment data through a tag according to an embodiment of the present application;

as shown in fig. 9, the process of displaying device data by a tag includes:

step S901: generating a data parameter list based on the equipment model selected by the user and the corresponding relation between the physical equipment and the object model;

specifically, after the data binding module establishes an association relationship between the device model and the physical device according to a device model selected by a user, the data display configuration module determines the physical device corresponding to the device model, queries the correspondence between the physical device established by the device access module and the object model, and determines the object model corresponding to the physical device, thereby generating a data parameter list, where the data parameter list includes data names of the physical device, for example: the list of data parameters includes voltage, current, etc.

Step S902: based on the label created by the user for the selected equipment model and the data parameter list, establishing an association relation between the physical equipment and the label and the data to be displayed, and storing the association relation into workshop configuration parameters;

specifically, when a user selects a device data display mode using a tag as the device model, responding to operations of creating the tag for the device model and configuring the setting parameters of the tag on a page of a browser by the user, storing the setting parameters of the tag by the data display configuration module, and establishing an association relationship between physical devices and the tag, wherein the setting parameters of the tag comprise tag coordinates, tag sizes and the like. And responding to the operation of selecting the data to be displayed of the tag from the data parameter list by a user, and establishing an association relationship between the tag and the data to be displayed by the data display configuration module so as to identify which data the tag should display.

Further, the data display configuration module establishes the association relationship between the physical equipment and the tag as well as the data to be displayed based on the association relationship between the physical equipment and the tag and the association relationship between the tag and the data to be displayed, and stores the association relationship into the workshop configuration parameters.

Step S903: and responding to the preview operation of the user on the virtual workshop, and displaying the label according to the workshop configuration parameters and the setting parameters of the label.

Specifically, in response to a preview operation of a user on a virtual workshop, the data display configuration module reads workshop configuration parameters and displays the labels according to association relations between physical equipment and the labels and data to be displayed and setting parameters of the labels.

In the embodiment of the application, the three-dimensional virtual monitoring system can also automatically and regularly inquire the equipment data of the physical equipment matched with the equipment model according to the background timing label task, then traverse the label list and cover the data value of the label configuration so as to play a role in regularly refreshing the data.

Referring to fig. 10, fig. 10 is a schematic flow chart of data passing through an animation display device according to an embodiment of the present application;

in this embodiment of the present application, if the industrial model file has an animation sequence, after the industrial model file is imported into the three-dimensional virtual monitoring system, the three-dimensional virtual monitoring system automatically identifies and records the animation sequence that the equipment model corresponding to the industrial model file has, and generates an animation list based on the animation sequence, where the animation list includes at least one animation sequence.

As shown in fig. 10, the process of displaying device data through animation includes:

step S1001: storing the association relation between the animation sequence selected by the user and the state quantity data into workshop configuration parameters;

specifically, in response to a user selection operation on a page of an animation sequence in an animation list corresponding to a certain equipment model and the equipment model, and a selection operation on state quantity data in a state quantity data list, a data display configuration module in the three-dimensional virtual monitoring system records an association relationship between the animation sequence selected by the user and the state quantity data, and stores the association relationship into workshop configuration parameters.

The state quantity data list is generated by the three-dimensional virtual monitoring system according to the corresponding relation between the physical equipment and the object model, which is established in the equipment access module, specifically, the three-dimensional virtual monitoring system screens out the parameters of the Boolean type in the object model of the physical equipment corresponding to the equipment model selected by the user to form a state quantity data list, the state quantity data list is provided for the user to select in a form of a drop-down frame on a page, the state quantity data comprises the data of the Boolean type in the object model, and the state quantity data only has two numerical values: yes or no.

Step S1002: traversing the association relation between the animation sequence and the state quantity data in the workshop configuration parameters according to the background timing animation task;

specifically, the data display configuration module traverses the association relation between the animation sequence and the state quantity data in the workshop configuration parameters according to the background timing animation task.

Step S1003: and determining whether to animate the equipment model selected by the user according to the numerical value of the state quantity data in the association relation.

Specifically, when the value of the state quantity data in the association relationship is yes, the data display configuration module plays an animation sequence corresponding to the equipment model selected by the user, so that the equipment model selected by the user is played in an animation form on a page of the browser, and when the value of the state quantity data in the association relationship is no, the data display configuration module does not play the animation sequence corresponding to the equipment model selected by the user.

In the embodiment of the application, by configuring the equipment data display mode and displaying the equipment data based on the workshop configuration parameters, the application can realize how the user can use and display the accessed equipment data in a self-defined manner without secondary development by a developer.

In an embodiment of the present application, by providing a three-dimensional virtual monitoring method, the three-dimensional virtual monitoring method is applied to a three-dimensional virtual monitoring system, and the three-dimensional virtual monitoring method includes: creating a virtual workshop based on input operation of a user; responding to the user-defined operation of the virtual workshop and/or the industrial model, and generating a virtual model list and workshop configuration parameters; acquiring equipment data, analyzing the equipment data, and generating an access equipment list, wherein the access equipment list comprises names of physical equipment accessed into the three-dimensional virtual monitoring system; and establishing an association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list, and storing the association relation into workshop configuration parameters.

On the one hand, by constructing an industrial model corresponding to each industrial device in the physical workshop and responding to the user-defined operation of the virtual workshop and/or the industrial model corresponding to the physical workshop, a virtual model list and workshop configuration parameters are generated, and the layout of the user-defined virtual workshop can be realized.

On the other hand, by acquiring the equipment data, generating an access equipment list, establishing the association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list, and storing the association relation into the workshop configuration parameters, the method and the device can establish the corresponding relation between the physical equipment in the real scene and the equipment model in the three-dimensional virtual monitoring system, so that the three-dimensional virtual monitoring system can comprehensively and accurately reflect the information of the physical workshop.

Referring to fig. 11, fig. 11 is a schematic structural diagram of a monitoring device according to an embodiment of the present application;

as shown in fig. 11, the monitoring device 1100 includes one or more processors 1101 and a memory 1102. In fig. 11, a processor 1101 is taken as an example.

The processor 1101 and the memory 1102 may be connected by a bus or otherwise, which is illustrated in fig. 11.

The processor 1101 is configured to provide computing and control capabilities to control the monitoring device 1100 to perform corresponding tasks, for example, to control the monitoring device 1100 to perform the three-dimensional virtual monitoring method in any of the method embodiments described above, where the three-dimensional virtual monitoring method is applied to a three-dimensional virtual monitoring system.

The three-dimensional virtual monitoring method comprises the following steps: creating a virtual workshop based on input operation of a user; responding to the user-defined operation of the virtual workshop and/or the industrial model, and generating a virtual model list and workshop configuration parameters; acquiring equipment data, analyzing the equipment data, and generating an access equipment list, wherein the access equipment list comprises names of physical equipment accessed into the three-dimensional virtual monitoring system; and establishing an association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list, and storing the association relation into workshop configuration parameters.

On the one hand, by constructing an industrial model corresponding to each industrial device in the physical workshop and responding to the user-defined operation of the virtual workshop and/or the industrial model corresponding to the physical workshop, a virtual model list and workshop configuration parameters are generated.

The processor 1101 may be a general purpose processor, including a central processing unit (CentralProcessingUnit, CPU), a network processor (NetworkProcessor, NP), a hardware chip, or any combination thereof; it may also be a digital signal processor (DigitalSignalProcessing, DSP), an application specific integrated circuit (ApplicationSpecificIntegratedCircuit, ASIC), a programmable logic device (programmable logic device, PLD), or a combination thereof. The PLD may be a complex programmable logic device (complex programmable logic device, CPLD), a field-programmable gate array (field-programmable gate array, FPGA), general-purpose array logic (generic array logic, GAL), or any combination thereof.

The memory 1102 is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the three-dimensional virtual monitoring method in the embodiments of the present application. The processor 1101 may implement the three-dimensional virtual monitoring method in any of the method embodiments described above by running non-transitory software programs, instructions, and modules stored in the memory 1102. In particular, memory 1102 may include Volatile Memory (VM), such as random access memory (random access memory, RAM); the memory 1102 may also include a non-volatile memory (NVM), such as read-only memory (ROM), flash memory (flash memory), hard disk (HDD) or Solid State Drive (SSD), or other non-transitory solid state storage device; the memory 902 may also include a combination of the above types of memory.

Memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 1102 optionally includes memory remotely located relative to processor 1101, which may be connected to processor 1101 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

One or more modules are stored in the memory 1102 that, when executed by the one or more processors 1101, perform the three-dimensional virtual monitoring method in any of the method embodiments described above, for example, performing the various steps described above and shown in fig. 6.

In this embodiment of the present application, the monitoring device 1100 may further have a wired or wireless network interface, a keyboard, an input/output interface, and other components for implementing the functions of the device, which are not described herein.

Embodiments of the present application also provide a non-transitory computer readable storage medium, such as a memory, including program code executable by a processor to perform the three-dimensional virtual monitoring method of the above embodiments. For example, the non-volatile computer readable storage medium may be a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a compact disc Read-Only Memory (CDROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.

Embodiments of the present application also provide a computer program product comprising one or more program codes stored in a non-volatile computer-readable storage medium. The program code is read from the non-transitory computer readable storage medium by a processor of the electronic device, and executed by the processor, to complete the method steps of the three-dimensional virtual monitoring method provided in the above-described embodiments.

It will be appreciated by those of ordinary skill in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by program code related hardware, where the program may be stored in a computer readable storage medium, where the storage medium may be a read only memory, a magnetic disk or optical disk, etc.

From the above description of embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus a general purpose hardware platform, or may be implemented by hardware. Those skilled in the art will appreciate that all or part of the processes implementing the methods of the above embodiments may be implemented by a computer program for instructing relevant hardware, and the program may be stored in a non-volatile computer readable storage medium, and the program may include processes of the embodiments of the methods as above when executed. The non-volatile computer readable storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; the technical features of the above embodiments or in the different embodiments may also be combined under the idea of the present application, the steps may be implemented in any order, and there are many other variations of the different aspects of the present application as described above, which are not provided in details for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. The three-dimensional virtual monitoring system is characterized by comprising a model building module, a workshop building module, a device access module and a data binding module, wherein,

the workshop construction module is connected with the model construction module and the equipment access module and is used for creating a virtual workshop corresponding to the physical workshop and generating a virtual model list and workshop configuration parameters in response to user-defined operation of the virtual workshop and/or the industrial model by a user;

the device access module is connected with the workshop building module and the data binding module and is used for acquiring device data, analyzing the device data and generating an access device list, wherein the access device list comprises names of physical devices accessed into the three-dimensional virtual monitoring system;

the data binding module is connected with the equipment access module and is used for establishing an association relation between the equipment model and the physical equipment based on the virtual model list and the access equipment list and storing the association relation into the workshop configuration parameters;

The device access module is specifically configured to:

determining a user-defined object model in response to a protocol type selected by a user and an analysis rule configured by the user, wherein the protocol type is a type of physical equipment uploading equipment message data;

acquiring equipment data, wherein the equipment data are equipment message data of physical equipment;

analyzing the equipment data based on a user-defined object model to obtain an analysis result, and storing the analysis result into an equipment database, wherein the object model comprises the type of the equipment data.

2. The three-dimensional virtual monitoring system of claim 1, wherein the industrial facility comprises a shop building structure and industrial equipment;

the model construction module is specifically used for:

performing optimization operation on each initial model to obtain an industrial model corresponding to each initial model;

3. The three-dimensional virtual monitoring system of claim 2, wherein the shop build module is specifically configured to:

rendering and displaying the industrial model based on a three-dimensional engine in a browser.

4. The three-dimensional virtual monitoring system of claim 3, wherein the shop build module is further configured to:

and responding to the preview operation of the user on the virtual workshop, dynamically loading an industrial model corresponding to the workshop configuration parameters, and adjusting a matrix of the industrial model based on the workshop configuration parameters so as to show the equipment layout of the user-defined virtual workshop.

5. The three-dimensional virtual monitoring system of claim 1, wherein the object model comprises device data parsing rules;

the device access module is further configured to generate an access device list, where the access device list further includes a correspondence between physical devices and device data.

6. The three-dimensional virtual monitoring system of claim 1, further comprising a data presentation configuration module;

the data display configuration module is connected with the data binding module and is used for configuring a device data display mode and displaying device data based on the workshop configuration parameters, wherein the device data display mode comprises a label or an animation.

7. The three-dimensional virtual monitoring system of claim 6, wherein the device access module is further configured to establish a correspondence between a physical device and an object model;

the data display configuration module is specifically configured to:

after the data binding module establishes the association relation between the equipment model and the physical equipment, generating a data parameter list based on the equipment model selected by a user and the corresponding relation between the physical equipment and the object model, wherein the data parameter list comprises data names of the physical equipment;

8. The three-dimensional virtual monitoring system of claim 6, wherein the data presentation configuration module is further configured to:

and determining whether to play the equipment model selected by the user in an animation mode according to the numerical value of the state quantity data in the association relation.

9. The three-dimensional virtual monitoring system of any of claims 1-8, wherein the three-dimensional virtual monitoring system is accessed or run through a browser.

10. A three-dimensional virtual monitoring method, characterized by being applied to the three-dimensional virtual monitoring system according to any one of claims 1 to 9, comprising:

creating a virtual workshop based on input operation of a user;

based on the virtual model list and the access equipment list, establishing an association relation between the equipment model and the physical equipment, and storing the association relation into the workshop configuration parameters;

and displaying the equipment data based on the equipment data display mode configured by the user and the workshop configuration parameters so as to monitor the physical workshops corresponding to the virtual workshops.

11. The three-dimensional virtual monitoring method of claim 10, further comprising:

12. A monitoring device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the three-dimensional virtual monitoring method according to claim 10 or 11 when the computer program is executed.