CN109375595B

CN109375595B - Visual workshop monitoring method, device and equipment

Info

Publication number: CN109375595B
Application number: CN201811251647.6A
Authority: CN
Inventors: 刘检华; 熊辉; 赵浩然; 庄存波; 刘金山; 王彬; 苗田
Original assignee: Beijing Institute of Technology BIT; Beijing Satellite Manufacturing Factory Co Ltd
Current assignee: Beijing Institute of Technology BIT; Beijing Satellite Manufacturing Factory Co Ltd
Priority date: 2018-10-25
Filing date: 2018-10-25
Publication date: 2020-11-10
Anticipated expiration: 2038-10-25
Also published as: CN109375595A

Abstract

The invention discloses a visual workshop monitoring method, a visual workshop monitoring device and visual workshop monitoring equipment, wherein the visual workshop monitoring method comprises the following steps: establishing a virtual workshop three-dimensional scene model; determining the running state of the workshop three-dimensional scene model according to the real-time data of the workshop; and monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model, and displaying state monitoring information. According to the embodiment of the invention, real-time mapping of the workshop operation site is realized through the virtual workshop three-dimensional scene model driven by real-time workshop data, the whole process of production activities can be visually monitored, the workshop operation site is vividly displayed, the two-dimensional display board is used for assisting in cooperative monitoring, the state information of each element of the workshop is clearly displayed, the visual level of workshop monitoring is improved, and the problem of service restriction caused by opaque workshop operation and more process links is effectively solved.

Description

Visual workshop monitoring method, device and equipment

Technical Field

The invention relates to the field of visual workshop monitoring, in particular to a visual workshop monitoring method, device and equipment.

Background

The workshop is a basic unit for organizing production in the manufacturing industry, and the technical progress of the digital twin workshop has important significance for promoting the virtual-real fusion of the whole manufacturing industry. With increasingly severe market competition and increasingly complex product requirements, workshop operation is subject to the pressure of shorter product delivery period, higher reliability requirement, more frequent product variety change and the like, and a workshop management layer needs to master the field operation condition of the workshop in time and discover abnormal disturbance in production in time, so that the production plan and resource allocation are reasonably adjusted, and the production efficiency and reliability are improved. And the problem of 'black box' of workshop operation caused by insufficient timely and comprehensive workshop information interaction and low visualization degree leads to insufficient monitoring strength of management personnel on the execution information of the bottom layer of the workshop, and the development of workshop intellectualization is severely restricted. The development of the technology of the internet of things provides a large amount of real-time data of a workshop bottom layer for various application systems of a workshop, how to manage and apply the real-time data of the internet of things of the workshop, and on the basis, the visual monitoring of the real-time information-driven production workshop, which is intuitive, transparent and real-time, is an engineering problem which needs to be solved urgently by enterprises, is one of core technologies for establishing mapping from a physical workshop to a virtual workshop, and is also a foundation for tamping a digital twin workshop for realizing interactive fusion and real-time mapping of the physical workshop and the virtual workshop.

With the appearance and development of the technology of the internet of things, around the problem of three-dimensional visual real-time monitoring of a production workshop driven by real-time information, experts and scholars at home and abroad develop a great deal of research and practice in aspects of workshop data acquisition and workshop events, workshop monitoring models, workshop electronic signboards, workshop three-dimensional visual monitoring, digital twin workshops and the like, and research is conducted from different angles and an implementation approach of the three-dimensional visual monitoring technology of the digital twin workshop is gradually tried to be solved. However, the following disadvantages of the related research results exist around the real-time visual monitoring problem of the digital twin workshop at present:

(1) at present, research around a digital twin workshop is still in a preliminary exploration phase, mainly focuses on unidirectional mapping from a physical workshop to a virtual workshop, and the construction and synchronous operation of the virtual workshop are gradually completed from information integration, model construction, two-dimensional monitoring, three-dimensional monitoring and the like.

(2) The workshop field information acquisition technology has mature achievements, information value-added processing can be carried out in the aspect of monitoring through a workshop event conversion mode, the workshop state is monitored mainly in data modes such as parameter sets, real-time data and a production system modeling method can be fused to obtain a workshop monitoring model, mathematical analysis is emphasized, and the visualization degree is low. Two-dimensional data and graphic display modes represented by the electronic billboard are not visual enough, the displayed information amount is far smaller than three-dimensional, and the workshop operation site cannot be displayed vividly.

(3) The research aiming at the three-dimensional visual monitoring of the workshop focuses on the realization of a system architecture and technology, a data-driven virtual workshop synchronous operation method is not comprehensively researched by a system, and the accurate mapping process from a physical workshop to a virtual workshop cannot be clarified.

Disclosure of Invention

In order to solve the technical problems, the invention provides a visual workshop monitoring method, a visual workshop monitoring device and visual workshop monitoring equipment, and solves the problems that a workshop monitoring model in the prior art is low in visualization degree and cannot clearly illustrate an accurate mapping process from a physical workshop to a virtual workshop.

According to one aspect of the invention, a visual workshop monitoring method is provided, which comprises the following steps:

establishing a virtual workshop three-dimensional scene model;

determining the running state of the workshop three-dimensional scene model according to the real-time data of the workshop;

and monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model, and displaying state monitoring information.

Optionally, the step of establishing a virtual workshop three-dimensional scene model includes:

constructing a workshop resource model; the workshop resource model comprises an equipment model, a personnel model, a workpiece model, a storage model and a workshop environment model;

and establishing a virtual workshop three-dimensional scene model according to the workshop resource model.

Optionally, the step of determining the operating state of the three-dimensional scene model of the plant according to the real-time data of the plant comprises:

establishing a workshop production system model and a data management model;

and controlling the workshop three-dimensional scene model to operate according to the operation logic contained in the production system model according to the real-time workshop data in the data management model.

Optionally, the plant data in the data management model includes: the system comprises virtual workshop static model information, workshop real-time visual monitoring information and workshop running state evaluation information.

Optionally, the step of controlling the plant three-dimensional scene model to operate according to the operation logic included in the production system model according to the real-time plant data in the data management model includes:

constructing a virtual workshop operation mode according to the production system model and the real-time workshop data, wherein the virtual workshop operation mode comprises a production logistics module, an equipment action module and a product state module;

controlling the state change of each module in the virtual workshop operation mode according to the updated real-time workshop data in the data management model;

and mapping the state change into the workshop three-dimensional scene model.

Optionally, the workshop site is monitored in real time according to the running state of the three-dimensional scene model of the workshop, and the step of displaying the state monitoring information includes:

establishing a three-dimensional dynamic mapping model and a two-dimensional display billboard model of the workshop state according to the running state of the three-dimensional scene model of the workshop;

and monitoring the production logistics operation, the equipment real-time action and the product model change of the workshop in real time through the three-dimensional dynamic mapping model and the two-dimensional display signboard model, and displaying the production logistics state information, the equipment state information and the product information of the workshop.

Optionally, the three-dimensional dynamic mapping model includes: the system comprises a workshop logistics monitoring module, an equipment action monitoring module and a product state monitoring module.

Optionally, the two-dimensional bulletin board model comprises: a data acquisition layer, an information value-added layer and a message processing layer.

According to another aspect of the present invention, there is also provided a visual monitoring device for a workshop, including:

the first modeling module is used for establishing a virtual workshop three-dimensional scene model;

the first control module is used for determining the running state of the workshop three-dimensional scene model according to real-time data of the workshop;

and the first monitoring module is used for monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model and displaying state monitoring information.

Optionally, the first modeling module comprises:

the first modeling unit is used for constructing a workshop resource model; the workshop resource model comprises an equipment model, a personnel model, a workpiece model, a storage model and a workshop environment model;

and the second modeling unit is used for establishing a virtual workshop three-dimensional scene model according to the workshop resource model.

Optionally, the first control module comprises:

the third modeling unit is used for establishing a workshop production system model and a data management model;

and the control unit is used for controlling the workshop three-dimensional scene model to operate according to the operation logic contained in the production system model according to the workshop real-time data in the data management model.

Optionally, the control unit comprises:

the first modeling subunit is used for constructing a virtual workshop operation mode according to the production system model and the real-time workshop data, wherein the virtual workshop operation mode comprises a production logistics module, an equipment action module and a product state module;

the first control subunit is used for controlling the state change of each module in the virtual workshop operation mode according to the workshop real-time data updated in the data management model;

and the mapping unit is used for mapping the state change into the workshop three-dimensional scene model.

Optionally, the first monitoring module includes:

the fourth modeling unit is used for establishing a three-dimensional dynamic mapping model and a two-dimensional display billboard model of the workshop state according to the running state of the three-dimensional scene model of the workshop;

and the information display unit is used for monitoring the production logistics operation, the equipment real-time action and the product model change of the workshop in real time through the three-dimensional dynamic mapping model and the two-dimensional display billboard model, and displaying the production logistics state information, the equipment state information and the product information of the workshop.

According to an aspect of the present invention, there is provided a visual plant monitoring apparatus, comprising a processor, a memory and a computer program stored on the memory and operable on the processor, wherein the computer program, when executed by the processor, implements the steps of the visual plant monitoring method described above.

In the scheme, the real-time mapping of the workshop operation site is realized through the virtual workshop three-dimensional scene model, the whole process of production activities can be visually monitored, and the workshop operation site is vividly displayed; through the cooperative monitoring of the two-dimensional display boards, the state information of each element of the workshop is clearly displayed, and the workshop operation site is vividly and transparently displayed. The virtual workshop three-dimensional and two-dimensional collaborative visual monitoring driven by real-time data of the workshop effectively monitors the running state of equipment, the product quality, the order state, the equipment utilization rate, the production balance rate, messages pushed by other platforms and the like, improves the visual level of workshop monitoring, and effectively solves the problem of service control caused by opaque workshop operation and more flow links.

Drawings

FIG. 1 is a flow chart of a visual monitoring method for a workshop according to an embodiment of the invention;

FIG. 2 illustrates a tree diagram of a plant resource model in accordance with an embodiment of the present invention;

FIG. 3 is a schematic flow chart of a visual monitoring method for a workshop according to an embodiment of the present invention;

FIG. 4 is a schematic representation of a plant production system model according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a data management model according to an embodiment of the present invention;

FIG. 6 is a schematic view of a virtual plant operating mode according to an embodiment of the present invention;

fig. 7 is a block diagram showing a configuration of a visual monitoring apparatus for a plant according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

As shown in fig. 1, an embodiment of the present invention provides a visual monitoring method for a workshop, including:

step 11, establishing a virtual workshop three-dimensional scene model;

the workshop three-dimensional scene model needs to accurately map the state change of each workshop resource and comprises a monitoring object of all elements and all processes of the workshop, namely, each workshop resource in the virtual workshop three-dimensional scene model is mirror image mapping of actual workshop resources (including personnel, materials, tools, equipment and the like), and the workshop environment and layout are consistent with those of a physical workshop, so that the real reproduction of the workshop field production activities in a virtual space is realized. The workshop three-dimensional scene model not only can support the three-dimensional model of each workshop resource, but also can uniformly manage the workshop resource three-dimensional model.

Step 12, determining the running state of the workshop three-dimensional scene model according to real-time workshop data;

the operation process of the workshop production system relates to the relationship between production elements of the system, and in the mapping of the workshop three-dimensional scene model to the physical workshop, the running state of the workshop three-dimensional scene model is driven to change through the collected real-time data of the physical workshop, so that the accurate mapping of the virtual workshop and the physical workshop is realized.

The method comprises the steps that in the process of driving the running state of a workshop three-dimensional scene model to change through workshop real-time data, the running of the workshop three-dimensional scene model is based on a specific running logic, collected workshop real-time data can be converted into corresponding workshop events, the workshop events serve as trigger conditions for state transition of resources in the model, the states and the events form time sequence expression of the workshop running process in the whole workshop three-dimensional scene model, the states maintain stable operation for a period of time, the events decide the change of the working state, the next working state is promoted to occur, and the fusion of workshop real-time data information in the running logic of the workshop three-dimensional scene model is achieved.

And step 13, monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model, and displaying state monitoring information.

In the embodiment, the workshop three-dimensional scene model is based on the collected real-time workshop data and operates in a specific operation logic, so that the accurate mapping from the production state change of the physical workshop to the operation state change of the virtual workshop is realized. In the production process of the workshop, real-time workshop data continuously drive the virtual workshop three-dimensional scene model to run, wherein the whole running process from the time that a workpiece enters the workshop to the time that the workpiece leaves the workshop is included, and state information in the running process can be cooperatively displayed through the three-dimensional dynamic mapping model and the two-dimensional display billboard model.

Specifically, the three-dimensional dynamic mapping model comprises a workshop logistics monitoring module, an equipment action monitoring module and a product state monitoring module, and dynamic mapping of three layers of production logistics, equipment action and product state is realized by adopting a decomposition and modularization method. The workshop logistics monitoring module is used for displaying dynamic changes of logistics corresponding to a virtual workshop driven by real-time data based on workshop operation logic; the equipment action monitoring module is established on the basis of the parent-child relationship of each equipment model in the workshop three-dimensional scene model and displays the real-time action of the equipment; and the product state monitoring module dynamically displays the model change of the workpiece in different process stages. In the running process of the virtual workshop three-dimensional scene model, the state information panels of all equipment and workpieces can be displayed and hidden in a man-machine interaction mode, and abnormal disturbance in a workshop and related data analysis messages of other platforms can remind workers in a mode of warning pop-up windows.

The workshop three-dimensional scene model also comprises a two-dimensional display board for displaying the state information of each device and workpiece in the workshop and comprehensive statistical information, the workshop operation condition information such as indexes, messages and states of each element in the workshop can be clearly displayed through the two-dimensional display board, and the workshop data can be displayed in detail through the modes such as graph characters and diagrams.

In the scheme, the workshop real-time data is driven, the workshop three-dimensional scene model and the physical workshop run synchronously, visual monitoring is performed in cooperation through the three-dimensional dynamic mapping model and the two-dimensional display signboard, the whole process of production activities can be monitored visually, the workshop operation site is displayed vividly, the visual level of workshop monitoring is improved, and the problem that the workshop operation is opaque and the operation is limited due to more flow links is effectively solved.

Specifically, step 11 includes: constructing a workshop resource model; the workshop resource model comprises an equipment model, a personnel model, a workpiece model, a storage model and a workshop environment model;

The embodiment completes virtual workshop scene management based on a tree structure, organizes a workshop resource model by adopting a hierarchical structure, establishes a parent-child nesting relationship among models, describes the geometric positions of child nodes in a parent node coordinate system, performs three-dimensional modeling on leaf nodes, and finally establishes a virtual workshop geometric scene consistent with the actual workshop layout according to a hierarchical combination model.

Preferably, the tree diagram of the plant resource model is shown in fig. 2, and the whole scene is divided into five modules: equipment model, personnel model, workpiece model, storage model and workshop environment model. For each module subdivision, for example, the equipment model can be divided into a numerical control machine model, a robot model, a manual work station model, and logistics equipment such as an Automated Guided Vehicle (AGV) model; the personnel model can comprise a manager model, an operator model and the like; the workpiece models may include different process state models from blank to finished product; the storage model can comprise a goods shelf model, a temporary storage area model and the like; the plant environment model can comprise a plant model, a light model, a layout model and the like. The module attribute comprises the incidence relation among the models and the geometric attribute information of the parent-child nesting. For the three-dimensional modeling of the leaf nodes, the equipment model and the personnel model also relate to the three-dimensional graphic transformation of the models, and a hierarchical structure is adopted during modeling. In the modeling process, a static model of the model slave is used as a root node, each dynamic sub-model sequentially establishes a parent-child node relationship according to the motion slave relationship, and a three-dimensional model is established according to the position of the child node in a parent node local coordinate system.

The dendrogram of the workshop resource model classifies the important workshop resource model in a hierarchical structure. Before carrying out three-dimensional modeling on leaf nodes, determining a three-dimensional model to be established finally through parent-child relations among models, establishing the three-dimensional model according to the modeling method, and establishing an object library of a virtual workshop three-dimensional scene model. On the basis of the three-dimensional model of the leaf nodes of the scene tree, the positions of the child nodes in the parent node coordinate system are sequentially combined, the distribution of workshop resources in a workshop is shown in the workshop according to the layout of the workshop, and finally the virtual workshop three-dimensional scene model is established.

Preferably, as shown in fig. 3, step 12 comprises:

step 121, establishing a workshop production system model and a data management model;

in this embodiment, the production system model is used to describe the operation logic of the plant production activity, i.e. the operation logic representing the virtual plant three-dimensional scene model. The workshop production system is a typical discrete event dynamic system, and the task execution process can be abstractly represented by events and states, so that the embodiment adopts an extended stochastic high-level judgment Petri network to build a production system model. The plant production system model is shown in fig. 4, and includes a base, a transition, a token, and a decision point, where the token in the base is removed from the input base to the output base according to a decision rule in the decision point, the token in the decision point can be reused, but cannot be removed from the decision point, and a plant event can be introduced into the decision rule as a trigger condition for state transition.

As in FIG. 4, c₁、i₁、m₁、c₂、m₂Is a token in the vault, r₁、r₂、r₃、r₄、r₅、r₆For the token in the decision point, according to the meanings of the library, the transition and the decision point in table 1, the transition starting flow of the production system model is as follows: when the condition p is satisfied₁The vault has tokens i from the production plan₁，f₁And w₁Token c in the pool₁And m₁According to a decision point s₁Rule of (3) triggering transition t using real-time workshop events₁₁Simultaneously combine to form (i)₁，c₁，m₁) Composite token, put into warehouse₁Processing is carried out; after the processing is finished, according to the decision point s₃Rule of (2) triggering transition t in real time₁₂After decomposing the composite token, c₁And m₁Returning to the original library according to the decision point s₅Will decompose the newly generated i₂Output to the output buffer o₁Or the second process input buffer p₂Thus, the input buffer for the second pass may be from the tokens generated by the last transition or the input production plan. In the actual production process, when a first procedure production plan is issued or materials arrive at a station and workers and machines are in idle states, according to s₁The decision point rule triggers the operation state conversion, and an idle worker puts a workpiece into idle equipment to start a first processing procedure; after a period of time, the working is completed according to s₅Decision point rule passing real timeAnd (4) converting the data driving state, triggering the next sequence state to occur, putting the processed workpiece into a finished product area or continuously entering a second procedure for processing, and simultaneously returning the first procedure worker to the original station and restoring the machine to the idle state. And the rest is done in turn to complete the whole processing operation.

The workshop state and the event form a time sequence expression of the workshop operation process, the state maintains stable operation for a period of time, and the event decides the operation state change and promotes the next operation state to occur. According to the method, the operation logic covering the whole process flow of the workshop can be converted into a complex production system model, the data acquired in real time in the workshop field can be converted into corresponding workshop events, such as an entering event AE, an leaving event DE, an existing event SE and the like, and the fusion of real-time information in the workshop operation logic is realized by introducing the events into a transition rule to participate in the decision of the change of the workshop operation state. The production system model is transformed driven by real-time information, dynamic mapping from workshop field operation to the production system model is established, synchronous operation modeling of the whole operation process in the whole life cycle of workshop operation is realized, and model reasoning and decision making capabilities are improved.

Specifically, the meanings of the library, transition, and decision point in FIG. 4 are shown in Table 1:

TABLE 1

The state change of the workshop three-dimensional scene model is driven by workshop real-time data, the workshop real-time data after standardized processing is stored in a data center, and a data queue is updated through periodically acquired real-time data streams, so that the virtual workshop is driven to run synchronously. The data management model 5 is used for demonstrating management of data in a plant, and as shown in fig. 5, the plant data in the data management model 5 includes: the system comprises virtual workshop static model information, workshop real-time visual monitoring information and workshop running state evaluation information.

The virtual workshop static model information mainly comprises workshop three-dimensional scene model information of a geometric level and production system model information of a logic level, and is used for providing data support of models and logics, and the workshop three-dimensional scene model information comprises: factory building information, equipment information, frock information, personnel information, environmental information, product information and workshop layout information etc, production system model information includes: process flow information, workshop operation logic information, and the like.

The real-time visual workshop monitoring information is the core of the data management model, comprises three-dimensional dynamic mapping information and real-time workshop state information, and is obtained according to the collected real-time workshop logistics information, real-time equipment information, real-time product information and task execution conditions, and the collected real-time workshop logistics information comprises information such as real-time workshop time, logistics task requests, real-time product positions and real-time logistics positions; the collected real-time information of the equipment comprises information such as equipment number, name, start-stop signals, current state, operation and maintenance information, action data of each child node and the like; the collected real-time product information comprises product number, name, position, quality information, real-time processing procedure, product problem analysis description and other information; the task execution condition comprises information such as the number of work-in-process, the real-time completion number ratio, the real-time consumed working hour ratio and the like.

The three-dimensional dynamic mapping information comprises workshop logistics information, equipment action information and product model information, the real-time workshop state information comprises plan execution progress information, equipment state information and product process information, and the workshop logistics information, the equipment action information, the product model information, the plan execution progress information, the equipment state information and the product process information are obtained according to the collected real-time workshop data. The real-time visual monitoring information of the workshop is based on data acquisition and interaction methods such as an RFID (Radio Frequency IDentification), a sensor, a machine tool communication module, an MES (Manufacturing Execution System) interface and the like, real-time data such as logistics, equipment, products, order tasks and the like are acquired and stored in a data table, and data required for monitoring matched from the data table according to monitoring requirements are used as a driving data source for operation process conversion and state display refreshing.

The workshop operation state evaluation information comprises production performance evaluation index information and an index algorithm library, a part of the data management model is formed from the aspects of evaluation, feedback and auxiliary decision according to the collected workshop production evaluation indexes, and the index algorithm library is used for realizing data-driven index automatic calculation.

And step 122, controlling the workshop three-dimensional scene model to operate according to the operation logic contained in the production system model according to the real-time workshop data in the data management model.

Specifically, step 122 includes:

1221, according to the production system model and the real-time workshop data, constructing a virtual workshop operation mode, wherein the virtual workshop operation mode comprises a production logistics module, an equipment action module and a product state module;

in this embodiment, the real-time workshop data is provided by the data management model, and on the basis of expression of a workshop state and an event time sequence, each production element of the workshop also changes dynamically during each operation state, and the production system model can only show the basic operation logic of the three-dimensional workshop scene model and cannot show the driving process of the real-time workshop data on each production element in the three-dimensional workshop scene model, so that a corresponding mapping rule of the real-time workshop data on the three-dimensional workshop scene model, that is, the virtual workshop operation mode 6 needs to be established on the basis of the production system model, and as shown in fig. 6, the virtual workshop operation mode 6 is used for showing the operation logic of the three-dimensional workshop scene model driven by the real-time workshop data.

Step 1222, controlling the state change of each module in the virtual workshop operation mode according to the updated real-time workshop data in the data management model;

as shown in fig. 6, the production logistics module determines the logistics direction of the workpiece between the workshop stations according to the process state in the product process flow in the full life cycle of the workpiece from entering the workshop to leaving the workshop, drives the logistics of the workpiece between different stations through the workshop event converted by the real-time perception information of the workshop, and the logistics task request matches with the corresponding transport means to complete real-time logistics transportation; the device action module aims at virtual-real mapping of a device level, takes event triggering as a start-stop signal, acquires real-time action data of physical devices, and controls dynamic mapping of a virtual device model through a data driving instruction to realize reconstruction of a three-dimensional model of the device, wherein a parent-child node linkage mode is usually adopted as a model motion mode; the product state module is established on the basis of the production logistics module and the equipment action module, determines the real-time process stage of the workpiece according to the logistics position of the workpiece in a workshop and the working procedure on a station on the premise of the known product process flow, and drives the workpiece model to change by using the material label information among the working procedures.

And 1223, mapping the state change to the workshop three-dimensional scene model.

And driving the state change logic of each workshop resource in the virtual workshop operation mode according to real-time workshop data, and mapping the state change of each workshop resource into the workshop three-dimensional scene model to realize the state change of each workshop resource model in the virtual workshop three-dimensional scene model. Through the virtual workshop operation mode, real-time data are continuously collected on a workshop site, so that the virtual workshop three-dimensional scene model is driven to operate, the physical workshop operation process is mapped in real time, and meanwhile real-time state information of all elements of the workshop can be displayed in the virtual workshop.

In the above embodiment of the present invention, step 13 includes:

and monitoring the production logistics operation, the real-time equipment action and the product state of the workshop in real time through the three-dimensional dynamic mapping model and the two-dimensional display signboard model, and displaying the production logistics data information, the equipment action information and the product information of the workshop.

In this embodiment, the state information displayed by the three-dimensional dynamic mapping model and the two-dimensional display signboard model is continuously updated by real-time data driving of the workshop. The three-dimensional dynamic mapping model comprises: the system comprises a workshop logistics monitoring module, an equipment action monitoring module and a product state monitoring module, and dynamic mapping of three layers of a production logistics, an equipment action and a product state workshop is realized by adopting a decomposition and modularization method. The standardized real-time workshop data are stored in the data center, direct information required by monitoring of workshop events and the like can be obtained by extracting the real-time workshop data of the data center and performing information value-added processing on the data, and the data are continuously updated by refreshing a real-time data stream.

Specifically, the workshop logistics monitoring module is established on the basis of a production system model, controls the logistics direction of a workpiece in the virtual workshop three-dimensional scene model according to a process flow, takes a workshop event which is established by a real-time position of the workpiece and a device start-stop signal and judges whether the workpiece enters or leaves a station as a decision point rule, introduces real-time data into the production system model, associates the real-time data with the corresponding virtual workshop three-dimensional scene model, and displays the dynamic change of logistics corresponding to the virtual workshop. The whole-process workpiece logistics monitoring is formed by logistics monitoring of workpieces among devices, logistics of workpieces entering and leaving a workshop and logistics of transportation devices, interpolation processing needs to be carried out on positions of the workpieces updated in real time, and continuous logistics monitoring is fitted through discrete real-time position data of the workpieces. And the real-time position information-driven workshop logistics mapping is realized through the rule that workpieces enter and leave equipment triggered by workshop events and the logistics monitoring of the whole process of the workpiece process.

The equipment action monitoring module is established on the basis of the parent-child relationship of the equipment model and converts the equipment action into the rotation and translation transformation of the equipment child nodes. And starting and ending the motion monitoring of the equipment by using the equipment start and stop signal, and controlling the model of the father node to drive the model of the child node to synchronously move through the motion data of each level of nodes until the child node moves to the terminal node in sequence. The complex equipment action of complex equipment such as a multi-joint industrial robot also needs the support of a position resource transformation matrix, and the position and orientation transformation matrix in the graph transformation is determined according to the self position and orientation of each level of sub-node models. The manual station has no equipment action mapping, an operator animation mode can be adopted, different working procedures of the workpiece are determined according to the material RFID label information on the station, and corresponding personnel animations are called.

The product state monitoring module can dynamically display models of different process stages of a workpiece, determines an ongoing process according to the real-time position and the process flow of the workpiece, needs the support of real-time data of a material label for the condition of single-station multi-process, realizes process-level event monitoring through the destruction and the establishment of the material label, and converts a three-dimensional model of the workpiece into a model of a corresponding process stage after the process is completed.

The three-dimensional dynamic mapping model can clearly and transparently show the field operation of the workshop, but the information of the workshop operation conditions such as indexes, messages, states and the like also needs to be shown by a two-dimensional billboard. On the basis of dynamic mapping of a virtual workshop three-dimensional scene model, a workshop state real-time display panel, namely a two-dimensional display billboard model, is established for a workshop, equipment and a product, and besides visual monitoring of a three-dimensional workshop operation process, the two-dimensional display billboard is used for monitoring workshop element state information, so that a workshop operation field is vividly and transparently displayed. The related production statistical indexes and the data analysis decision conclusion can be reflected on the two-dimensional display billboard.

The two-dimensional display billboard model comprises: the method comprises a data acquisition layer, an information value-added layer and an information processing layer, a two-dimensional display billboard model is constructed through three layers of billboards, a processing and display method for real-time state indexes of a plurality of modules in a workshop such as an inter-vehicle layer, an equipment layer and a product layer is established, automatic calculation and visual display of the state indexes driven by data can be realized, the billboards displayed in various modes can adapt to the state display requirement of three-dimensional visual monitoring of the workshop, and the configurable and extensible characteristics are achieved.

Specifically, the data acquisition layer selects a specific state information query rule according to specific workshop requirements, acquires workshop real-time data meeting the requirements through a data interface of a data center or other platforms, and manages the workshop real-time data through a data management model. The information value-added layer carries out value-added processing on the data, an index calculation algorithm is packaged and managed according to an index system in advance, real-time and statistical state data for display are calculated by calling the algorithm in an index algorithm library through the real-time data, and the display state is refreshed after statistical iteration or updating calculation is carried out. The message processing layer triggers different message processing modes for different workshop state information, and further configures different display effects, including a billboard which is often displayed on an interface, a three-dimensional panel which is displayed in a three-dimensional world space, a hidden state panel which is displayed through human-computer interaction, a warning popup window aiming at abnormal data and the like.

The scheme realizes real-time mapping of the workshop operation site through the virtual workshop three-dimensional scene model, can visually monitor the whole process of production activities, and vividly shows the workshop operation site; through the cooperative monitoring of the two-dimensional display boards, the state information of each element of the workshop is clearly displayed, and the workshop operation site is vividly and transparently displayed. The virtual workshop three-dimensional and two-dimensional collaborative visual monitoring driven by real-time data of the workshop effectively monitors the running state of equipment, the product quality, the order state, the equipment utilization rate, the production balance rate, messages pushed by other platforms and the like, improves the visual level of workshop monitoring, and effectively solves the problem of service control caused by opaque workshop operation and more flow links.

As shown in fig. 7, an embodiment of the present invention further provides a visual monitoring apparatus for a workshop, including:

the first modeling module 71 is used for establishing a virtual workshop three-dimensional scene model;

The first control module 72 is used for determining the running state of the workshop three-dimensional scene model according to the real-time workshop data;

And the first monitoring module 73 is used for monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model and displaying state monitoring information.

In the above embodiment of the present invention, the first modeling module 71 includes:

In the above embodiment of the present invention, the first control module 72 includes:

in this embodiment, the production system model is used to describe the operation logic of the plant production activity, i.e. the operation logic representing the virtual plant three-dimensional scene model. The workshop production system is a typical discrete event dynamic system, and the task execution process can be abstractly represented by events and states, so that the embodiment adopts an extended stochastic high-level judgment Petri network to build a production system model. The plant production system model is shown in fig. 4, and includes a base, a transition, a token, and a decision point, where the token in the base is removed from the input base to the output base according to a decision rule in the decision point, the token in the decision point can be reused, but cannot be removed from the decision point, and a plant event can be introduced into the decision rule as a trigger condition for state transition. The meanings of the library, transition and decision point in fig. 4 are shown in table 1.

As in FIG. 4, c₁、i₁、m₁、c₂、m₂Is a token in the vault, r₁、r₂、r₃、r₄、r₅、r₆For the token in the decision point, according to the meanings of the library, the transition and the decision point in table 1, the transition starting flow of the production system model is as follows: when the condition p is satisfied₁The vault has tokens i from the production plan₁，f₁And w₁Token c in the pool₁And m₁According to a decision point s₁Rule of (3) triggering transition t using real-time workshop events₁₁Simultaneously combine to form (i)₁，c₁，m₁) Composite token, put into warehouse₁Processing is carried out; after the processing is finished, according to the decision point s₃Rule of (2) triggering transition t in real time₁₂After decomposing the composite token, c₁And m₁Returning to the original library according to the decision point s₅Will decompose the newly generated i₂Output to the output buffer o₁Or the second process input buffer p₂Thus, the input buffer for the second pass may be from the tokens generated by the last transition or the input production plan. In the actual production process, the first pass isWhen a process production plan is issued or materials arrive at a station and workers and machines are in idle states, according to s₁The decision point rule triggers the operation state conversion, and an idle worker puts a workpiece into idle equipment to start a first processing procedure; after a period of time, the working is completed according to s₅And the decision point rule drives state conversion through real-time data to trigger the next sequence state to occur, the processed workpiece is placed in a finished product area or continuously enters a second procedure for processing, meanwhile, a worker in the first procedure returns to the original station, and the machine restores to an idle state. And the rest is done in turn to complete the whole processing operation.

Specifically, the control unit includes:

In the above embodiment of the present invention, the first monitoring module includes:

and the information display unit is used for monitoring the production logistics operation, the real-time equipment action and the product model change state of the workshop in real time through the three-dimensional dynamic mapping model and the two-dimensional display billboard model, and displaying the production logistics state information, the equipment state information and the product information of the workshop.

It should be noted that the apparatus is an apparatus corresponding to the individual recommendation method, and all implementation manners in the method embodiments are applicable to the embodiment of the apparatus, and the same technical effect can be achieved.

The embodiment of the invention also provides a visual workshop monitoring device which comprises a processor, a memory and a computer program stored on the memory and capable of running on the processor, wherein the computer program is executed by the processor to realize the steps of the visual workshop monitoring method.

According to the embodiment of the invention, the real-time mapping of the workshop operation field is realized through the virtual workshop three-dimensional scene model, the whole process of production activities can be visually monitored, and the workshop operation field can be vividly displayed; through the cooperative monitoring of the two-dimensional display boards, the state information of each element of the workshop is clearly displayed, and the workshop operation site is vividly and transparently displayed. The virtual workshop three-dimensional and two-dimensional collaborative visual monitoring driven by real-time data of the workshop effectively monitors the running state of equipment, the product quality, the order state, the equipment utilization rate, the production balance rate, messages pushed by other platforms and the like, improves the visual level of workshop monitoring, and effectively solves the problem of service control caused by opaque workshop operation and more flow links.

While the preferred embodiments of the present invention have been described, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.

Claims

1. A visual workshop monitoring method is characterized by comprising the following steps:

establishing a virtual workshop three-dimensional scene model;

monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model, and displaying state monitoring information;

the step of determining the running state of the workshop three-dimensional scene model according to the real-time data of the workshop comprises the following steps:

establishing a workshop production system model and a data management model, wherein the production system model is used for representing the operation logic of the virtual workshop three-dimensional scene model, and the workshop production system is a discrete event dynamic system;

controlling the workshop three-dimensional scene model to operate according to the operation logic contained in the production system model according to the real-time workshop data in the data management model;

the plant data in the data management model includes: virtual workshop static model information, workshop real-time visual monitoring information and workshop running state evaluation information; the virtual workshop static model information mainly comprises workshop three-dimensional scene model information of a geometric level and production system model information of a logic level and is used for providing data support of models and logics;

the step of controlling the workshop three-dimensional scene model to operate according to the operation logic contained in the production system model according to the real-time workshop data in the data management model comprises the following steps:

and mapping the state change into the workshop three-dimensional scene model.

2. The visual workshop monitoring method according to claim 1, wherein the step of establishing a virtual workshop three-dimensional scene model comprises:

3. The visual workshop monitoring method according to claim 1, wherein the workshop site is monitored in real time according to the running state of the three-dimensional workshop scene model, and the step of displaying state monitoring information comprises the following steps:

4. The visual plant monitoring method of claim 3, wherein the three-dimensional dynamic mapping model comprises: the system comprises a workshop logistics monitoring module, an equipment action monitoring module and a product state monitoring module.

5. The visual workshop monitoring method of claim 3 wherein the two-dimensional bulletin board model comprises: a data acquisition layer, an information value-added layer and a message processing layer.

6. A visual monitoring device for a workshop, comprising:

the first monitoring module is used for monitoring the workshop site in real time according to the running state of the workshop three-dimensional scene model and displaying state monitoring information;

the first control module includes:

the third modeling unit is used for establishing a workshop production system model and a data management model; the production system model is used for representing the operation logic of the virtual workshop three-dimensional scene model, and the workshop production system is a discrete event dynamic system;

the control unit is used for controlling the workshop three-dimensional scene model to operate according to the operation logic contained in the production system model according to the workshop real-time data in the data management model;

the plant data in the data management model includes: the system comprises virtual workshop static model information, workshop real-time visual monitoring information and workshop running state evaluation information, wherein the virtual workshop static model information mainly comprises workshop three-dimensional scene model information on a geometric level and production system model information on a logic level and is used for providing data support of models and logics;

the control unit includes:

7. The visual plant monitoring apparatus of claim 6, wherein the first modeling module comprises:

8. The visual plant monitoring device of claim 6, wherein the first monitoring module comprises:

and the information display unit is used for monitoring the production logistics operation, the equipment real-time action and the product model state of the workshop in real time through the three-dimensional dynamic mapping model and the two-dimensional display billboard model, and displaying the production logistics state information, the equipment state information and the product information of the workshop.

9. The visual plant monitoring apparatus of claim 8, wherein the three-dimensional dynamic mapping model comprises: the system comprises a workshop logistics monitoring module, an equipment action monitoring module and a product state monitoring module.

10. The visual plant monitoring device of claim 8, wherein the two-dimensional bulletin board model comprises: a data acquisition layer, an information value-added layer and a message processing layer.

11. Plant visual monitoring device, characterized in that it comprises a processor, a memory and a computer program stored on said memory and executable on said processor, said computer program, when being executed by said processor, implementing the steps of the plant visual monitoring method according to any one of claims 1 to 5.