CN115115289B - XR technology-based interactive monitoring management system - Google Patents
XR technology-based interactive monitoring management system Download PDFInfo
- Publication number
- CN115115289B CN115115289B CN202211039988.3A CN202211039988A CN115115289B CN 115115289 B CN115115289 B CN 115115289B CN 202211039988 A CN202211039988 A CN 202211039988A CN 115115289 B CN115115289 B CN 115115289B
- Authority
- CN
- China
- Prior art keywords
- entity equipment
- module
- information
- equipment
- entity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 85
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 32
- 238000005516 engineering process Methods 0.000 title claims abstract description 21
- 238000011156 evaluation Methods 0.000 claims abstract description 29
- 238000013441 quality evaluation Methods 0.000 claims abstract description 20
- 238000004088 simulation Methods 0.000 claims abstract description 14
- 238000000034 method Methods 0.000 claims description 24
- 230000002159 abnormal effect Effects 0.000 claims description 22
- 238000010276 construction Methods 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 14
- 238000004364 calculation method Methods 0.000 claims description 13
- 238000012546 transfer Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 8
- 230000006854 communication Effects 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 7
- 238000012797 qualification Methods 0.000 claims description 6
- 238000004519 manufacturing process Methods 0.000 claims description 4
- 230000007175 bidirectional communication Effects 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims description 3
- 238000003860 storage Methods 0.000 claims description 3
- 230000008859 change Effects 0.000 abstract description 8
- 238000013461 design Methods 0.000 abstract description 2
- 238000004876 x-ray fluorescence Methods 0.000 description 12
- 230000005540 biological transmission Effects 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000005520 cutting process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0635—Risk analysis of enterprise or organisation activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/04—Manufacturing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/182—Level alarms, e.g. alarms responsive to variables exceeding a threshold
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Tourism & Hospitality (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Game Theory and Decision Science (AREA)
- Educational Administration (AREA)
- Health & Medical Sciences (AREA)
- Manufacturing & Machinery (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Emergency Management (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The invention belongs to the technical field of XR simulation remote supervision, and particularly relates to an XR technology-based interactive monitoring management system. The invention adopts the design of a preview module, when the simulation operation module synchronizes and simulates the operation state information of the entity equipment, the monitoring value and the standard value of the entity equipment in operation can be synchronously obtained, the quality evaluation model compares the standard value with the monitoring value, the operation efficiency change condition of the entity equipment is calculated in real time, whether the operation efficiency change quantity of the entity equipment meets the allowable range is judged according to the evaluation result, the excessive loss of the entity equipment is not generated instantly, the early warning information is sent earlier than the warning information in most cases, and after the early warning information is sent, a supervisor can make a corresponding scheme in time.
Description
Technical Field
The invention belongs to the technical field of XR simulation remote supervision, and particularly relates to an interaction monitoring management system based on an XR technology.
Background
The XR technology is a 3D interaction technology which is started in recent years, the XR technology comprises technologies such as AR, VR and MR, the real-time interaction complex environment can be realized by utilizing a digital technology in a virtual environment and between a real world and a human body, and based on the technology, people gradually apply the technology to equipment exhibition and supervision, so that the full appearance of entity equipment can be reflected in the virtual environment, the real-time running condition of the entity equipment can be reflected, and therefore supervision personnel can monitor the running of the entity equipment more intuitively.
In the existing product, the running state information of the entity equipment is synchronized into the virtual image, because the running process of the equipment is always worn, some links may be damaged in the running process, and the running of the entity equipment can be gradually increased.
For example, a physical monitoring and managing system for workshop information with publication No. CN112346415B, because of lack of early warning for the operation state of the physical device, can feed back fault information after the physical device fails, and cannot actually achieve a good operation and maintenance control effect, and in an actual operation process, once the device fails, the device is often damaged along with other parts inside the device, which undoubtedly increases extra loss of the device.
Disclosure of Invention
The invention aims to provide an XR (X-ray fluorescence) technology-based interactive monitoring management system, which can preview the operation of entity equipment under the condition of monitoring the operation of the entity equipment, so that whether the change of the operation efficiency of the entity equipment meets the standard or not can be judged in real time.
The technical scheme adopted by the invention is as follows:
the utility model provides an interactive monitoring management system based on XR technique which characterized in that: the method comprises the following steps: the system comprises a data acquisition module, an image construction module, a monitoring module, an information synchronization module, a simulation operation module, a rehearsal module, an evaluation module, a central control unit and a central control unit;
the central control unit is respectively in communication connection with the data acquisition module, the image construction module, the monitoring module, the information synchronization module, the simulation operation module, the rehearsal module and the evaluation module;
the data acquisition module is used for acquiring the characteristic information of the entity equipment;
the image construction module is used for constructing a three-dimensional XR virtual image of the entity equipment according to the characteristic information of the entity equipment to obtain a virtual equipment image of the entity equipment;
the monitoring module is used for monitoring the running state of the entity equipment and acquiring the actual running state information of the real-time running of the entity equipment;
the information synchronization module is used for synchronizing the actual running state information to the virtual equipment image;
the virtual equipment image simulates the running state of the entity equipment according to the actual running state information to obtain a monitoring value of the running state of the entity equipment;
the preview module is used for simulating the running state of the entity equipment under the standard state information to obtain a standard value of the running state of the entity equipment;
the central control unit is used for receiving the monitoring value and the standard value of the monitoring value and sending the monitoring value and the standard value to a quality evaluation model to obtain quality information of the running state of the entity equipment, wherein the central control unit sends out an abnormal signal according to the quality information, the abnormal signal comprises alarm information and early warning information, and the priority of the alarm information is higher than that of the early warning information;
further comprising: the intelligent platform is connected with a plurality of central control units, a grade setting module and an execution module are preset in the intelligent platform, the grade setting module is used for determining the abnormal grade of all products in the same batch according to an abnormal signal fed back by the central control units, and the execution module is used for controlling the monitoring module to carry out high-frequency monitoring on the products in the same batch according to the abnormal grade;
the virtual equipment image simulates the running state of the entity equipment according to the actual running state information, and the step of obtaining the monitoring value of the running state of the entity equipment comprises the following steps:
acquiring actual running state information of the entity equipment, wherein the actual running state information comprises actual performance efficiency of the entity equipment, actual qualified rate of products, load time of the entity equipment and stop time of the entity equipment;
substituting the actual performance efficiency of the entity equipment, the actual qualified rate of products, the load time of the entity equipment and the stop time of the entity equipment into a formula:
the preview module is used for simulating the running state of the entity equipment under the standard state information to obtain the standard value of the running state of the entity equipment, and the steps are as follows:
acquiring initial state information of the entity equipment, wherein the initial state information comprises a trend value of performance efficiency information and product percent of pass information under the continuous operation of the entity equipment;
calculating a standard operation efficiency value of the entity equipment according to the initial state information, namely a standard value of the operation state of the entity equipment, wherein the calculation formula is as follows:
in the formula, a W mark represents an efficiency value of standard operation of the entity equipment, a P mark represents standard performance efficiency of the entity equipment, and a Q mark represents standard qualified rate of products;
the calculation process of the trend value of the performance efficiency information under the continuous operation of the entity equipment is as follows:
acquiring a plurality of continuous time periods of single operation of entity equipment, wherein the number of the time periods is set to be i =1,2,3, \8230;, n, and n is a positive integer;
acquiring a reference rate Si of the operation of the entity equipment in each single operation time period;
and substituting the reference rate of each entity equipment processing product into a formula:
wherein Pi represents the performance efficiency of the physical device, gi represents the total product input amount, and t represents the actual time of single operation of the physical device, wherein,
acquiring the performance efficiency of each entity device and substituting the performance efficiency into a trend value function, wherein the trend value function is as follows:
in the formula, X represents a trend value of the performance efficiency, and the performance efficiency of the entity device in the preview module in the initial state is consistent with the value thereof;
the evaluation module is used for substituting the monitoring value and the standard value into a quality evaluation model together to obtain the quality information of the running state of the entity equipment, and the steps are as follows:
constructing an entity equipment evaluation interval, wherein the value range of the evaluation interval is
；
Acquiring a monitoring value of the running state of the entity equipment;
obtaining a standard value of the running state of the entity equipment;
and substituting the monitoring value and the standard value into a quality evaluation model together, wherein an evaluation equation in the quality evaluation model is as follows:
wherein M represents a physical device evaluation score;
if M is more than-2% and less than 2%, the fluctuation of the running state of the entity equipment is within the safety range allowed by the error, the production requirement of the product can be met, and the interactive terminal does not act;
if M is more than or equal to 2% and less than 4%, the fluctuation of the running state of the entity equipment is in an early warning range, and the interactive terminal sends early warning information;
if M is larger than or equal to 4%, the fluctuation of the running state of the entity equipment is beyond the early warning range, and the interactive terminal directly sends alarm information;
if M is less than or equal to-2%, the fluctuation of the running state of the entity equipment exceeds the error allowable range, the actual running state information of the corresponding entity equipment in the state is marked, and the trend value of the performance efficiency information and the calculation formula of the product percent of pass information are not recorded.
In a preferred embodiment, the image building module builds a virtual device image of the physical device through a virtual reality technology, including:
the building unit is used for acquiring three-dimensional data of an actual environment, building a virtual environment and building a three-dimensional graph in the virtual environment according to the characteristic information of the entity equipment;
and the refreshing unit refreshes the three-dimensional graph according to the running state of the entity equipment, and the refreshing frequency is set to be 20 frames/second.
In a preferred scheme, the entity device is configured with a CTU module for acquiring an actual operation state of the entity device, and the actual operation state information of the entity device is converted into IP data by the CTU module and is sent to the monitoring module for storage.
In a preferred scheme, the system further comprises an interactive terminal, the interactive terminal establishes bidirectional communication connection with the monitoring module through a TCP protocol and a DES protocol, and the method specifically comprises the following steps:
the CTU module acquires IP data packages corresponding to actual running state information to obtain a TCP transfer package;
the TCP transfer packet is sent to an interactive terminal through a TCP protocol;
and the interactive terminal receives the TCP transfer packet, extracts data content from the TCP transfer packet and feeds back the data content to the virtual equipment image through the interactive terminal.
In a preferred scheme, the system further comprises a memory and a controller, wherein an application program and an operating system which can run on the processor are arranged in the memory, and when the processor executes the application program, the operation of the data acquisition module, the image construction module, the monitoring module, the information synchronization module, the simulation operation module, the rehearsal module and the evaluation module is realized.
The invention has the technical effects that:
the invention adopts the design of a preview module, when the simulation operation module synchronizes and simulates the operation state information of the entity equipment, the preview module can also synchronize and preview the operation of the entity equipment, and synchronize the operation state of the entity equipment into a virtual image according to the preview information, so that whether the operation of the entity equipment in the preview state is consistent with the operation of the entity equipment in the actual state can be visually represented, a supervisor can visually make a judgment, and can also synchronously obtain a monitoring value and a standard value when the entity equipment operates, and finally a quality evaluation model is used for comparing the standard value and the monitoring value, so that the operation efficiency change condition of the entity equipment is calculated in real time, whether the operation efficiency change quantity of the entity equipment meets an allowable range is judged according to an evaluation result, and because the excessive loss of the entity equipment is not generated instantly, the sending of early warning information is earlier than that of warning information under most conditions, after the sending of the early warning information, the supervisor can timely make a corresponding scheme, thereby avoiding the occurrence of unnecessary loss.
The invention adopts a feedback type monitoring mode, when the abnormal risk of a certain entity equipment is monitored, the abnormal risk is fed back to the central control unit and fed back to the intelligent platform by the central control unit, the intelligent platform counts the products put in the same batch as the risk equipment, and the monitoring of the batch of products is enhanced by the monitoring module, so that the processing measures can be taken in time, and the damage phenomenon of the subsequent existing batch can be avoided.
Drawings
FIG. 1 is a schematic flow diagram of a surveillance system according to an embodiment of the invention;
fig. 2 is a schematic diagram of a quality evaluation process of entity equipment in an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, embodiments accompanying figures of the present invention are described in detail below.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced otherwise than as specifically described herein, and it will be appreciated by those skilled in the art that the present invention may be practiced without departing from the spirit and scope of the present invention and that the present invention is not limited by the specific embodiments disclosed below.
Furthermore, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one implementation of the invention. The appearances of the phrase "in one preferred embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
Furthermore, the present invention is described in detail with reference to the drawings, and in the detailed description of the embodiments of the present invention, the cross-sectional view illustrating the structure of the device is not enlarged partially according to the general scale for convenience of illustration, and the drawings are only exemplary and should not be construed as limiting the scope of the present invention. In addition, the three-dimensional dimensions of length, width and depth should be included in the actual fabrication.
Referring to fig. 1, the present invention provides an interaction monitoring and management system based on XR technology, including:
the data acquisition module is used for acquiring the characteristic information of the entity equipment, and the characteristic information of the entity equipment at least comprises equipment appearance information, equipment depreciation information, equipment model information and equipment use condition information;
the image construction module is used for constructing a three-dimensional XR virtual image of the entity equipment according to the characteristic information of the entity equipment to obtain a virtual equipment image of the entity equipment;
the monitoring module is used for monitoring the running state of the entity equipment and acquiring the actual running state information of the real-time running of the entity equipment;
the information synchronization module is used for synchronizing the actual running state information to the virtual equipment image;
the virtual equipment image simulates the running state of the entity equipment according to the actual running state information to obtain a monitoring value of the running state of the entity equipment;
the preview module is used for simulating the running state of the entity equipment under the standard state information to obtain a standard value of the running state of the entity equipment;
the evaluation module is used for substituting the monitoring value and the standard value into the quality evaluation model together to obtain the quality information of the running state of the entity equipment;
the central control unit is respectively in communication connection with the data acquisition module, the image construction module, the monitoring module, the information synchronization module, the simulation operation module, the rehearsal module and the evaluation module, wherein the central control unit sends an abnormal signal according to the quality information, the abnormal signal comprises alarm information and early warning information, and the priority of the alarm information is higher than that of the early warning information.
In this embodiment, the physical device characteristic information acquired by the data acquisition module can be uploaded to the central control unit, the data acquisition module directly scans the device information, so that the device appearance information, the device depreciation information, the device model information and the device use condition information of the physical device can be acquired, the information is uploaded to the central control unit in the form of a data chain, the central control unit is provided with a PLC control system with a communication interface, and is specifically provided with a wireless communication mode, so that a supervisor can perform remote operation, the central control unit uploads the information to the image construction module after receiving the physical device characteristic information, the image construction module reads data sent by the central control unit and analyzes the physical device information, and a scale is reestablished according to the device information, so that the size of the physical device after generating a virtual image can be integrally adjusted, therefore, in different virtual environments, the sizes of the displayed devices are different, and can be specifically set according to the operation habits of the monitoring personnel, of course, the display forms of the virtual device images can also be set to be diversified, for example, the virtual device images can be switched to a coloring mode only when the appearances of the devices are observed, and the virtual device images can be switched to a semitransparent mode when the internal part structures of the devices are observed, and after the virtual device images are constructed, the virtual device images are mainly used for observing the running states of the physical devices in real time, so that the running states of the physical devices are required to be synchronized to the virtual device images in real time, the working states of the physical devices can be simulated, the monitoring personnel can realize the monitoring work of the devices without the side of the devices, and so on, the virtual images of a plurality of physical devices can be constructed in the same virtual environment, in the same virtual environment, the supervisor can supervise the running states of different entity equipment in real time by switching or zooming the size of the image, so that the running condition of the equipment is observed without manually walking in a factory building or a workshop in a reciprocating way, and each equipment is not required to be configured with a supervisor for supervision, thereby correspondingly saving the labor cost, but the equipment is often not sudden when in failure, in most cases, the loss of a part of components is excessive, and the most intuitive embodiment is the efficiency of the entity equipment for producing products, in the scheme, the running state of the equipment can be previewed through the previewing module, so that the equipment can be previewed based on the initial state information and the previous running state information of the entity equipment, the most intuitive embodiment of the running state information in the entity equipment is the processing and transmitting process of the products, therefore, the previewing result of the previewing module can be synchronized into the virtual image, for example, in the virtual equipment image, the actual state of the product is displayed as blue, the previewing state is displayed as red, whether the images of the product and the virtual image are overlapped can be observed in the virtual image, most intuitively embodied, the color distinguishing treatment can be emphasized in the product transmission process, so that a supervisor can definitely judge whether the actual operation efficiency of the entity equipment is consistent with the previewing operation efficiency, the operation efficiency of the entity equipment in a standard state can be obtained, then the operation efficiency and the standard operation efficiency in the actual operation state of the entity equipment are evaluated through the quality evaluation model, whether the operation of the entity equipment has the risk of failure or not can be obtained, and the purpose of remotely monitoring the operation state of the entity equipment can be realized, specifically, the data acquisition module can be acquisition equipment, the monitoring module mainly comprises various sensors, an information acquisition terminal, direct digital control and other intelligent equipment and the like, the monitoring module is mainly used for acquiring running state data of an equipment layer and carrying out processing such as filtering, shaping and amplification on the data, the information synchronization module can be a communication unit or communication equipment with synchronous data, the simulation operation module can be a simulation platform, and the evaluation module can be a computer processing device.
In one embodiment, the interactive monitoring and management system based on the XR technology further comprises an intelligent platform, the intelligent platform is connected with a plurality of central control units, a grade setting module and an execution module are preset in the intelligent platform, the grade setting module is used for determining the abnormal grade of all products in the same batch according to abnormal signals fed back by the central control units, and the execution module is used for controlling the monitoring module to perform high-frequency monitoring on the products in the same batch according to the abnormal grade.
In this embodiment, a feedback monitoring manner is adopted, when an entity device is monitored to have an abnormal risk, the abnormal risk is fed back to the central control unit through the central control unit, the central control unit feeds back the abnormal risk to the intelligent platform, the intelligent platform counts the products put in the same batch as the risk device, determines the abnormal grade of the batch of products, and the execution module controls the monitoring module to enhance the monitoring frequency of the batch of products according to the abnormal grade, so that processing measures can be taken timely, and the damage phenomenon of the subsequent existing batch can be avoided.
In a preferred embodiment, the image building module builds a virtual device image of the physical device through a virtual reality technology, including:
the building unit is used for acquiring three-dimensional data of an actual environment, building a virtual environment and building a three-dimensional graph in the virtual environment according to the characteristic information of the entity equipment;
and the refreshing unit refreshes the three-dimensional graph according to the running state of the entity equipment, and the refreshing frequency is set to be 20 frames/second.
It should be noted that, in general, people may regard a 24-frame/second continuous picture as a dynamic video when they observe it with their eyes in a relaxed state, and the purpose of setting the refresh frequency to 20 frames/second is mainly to make the pictures clearly visible to the supervisor, so that they can make a ready judgment on the operation of the device during the supervision process.
In a preferred embodiment, the entity device is configured with a CTU module for acquiring an actual operating state of the entity device, and the actual operating state information of the entity device is converted into IP data by the CTU module and is sent to the monitoring module for storage;
the CTU module is high-performance industrial wireless data acquisition and transmission equipment integrating DTU, RTU and short message receiving and sending functions, and transmits data to a server through a wireless network of an operator through a serial port.
In a preferred embodiment, the management system further includes an interactive terminal, and the interactive terminal establishes a bidirectional communication connection with the monitoring module through a TCP protocol and a DES protocol, specifically:
the CTU module acquires IP data corresponding to actual running state information and packs the IP data to obtain a TCP transfer packet;
the TCP transfer packet is sent to the interactive terminal through a TCP protocol;
and the interactive terminal receives the TCP transfer packet, extracts data content from the TCP transfer packet and feeds the data content back to the virtual equipment image through the interactive terminal.
In the embodiment, the data transmission is carried out by using the APN private network provided by the operator, so that the phenomenon that the data is stolen in the transmission process can be effectively avoided, the data collected by the serial port is transmitted to the APN data acquisition server provided by the operator in the APN private network mode, the interactive terminal carries out analysis according to the acquired data, and the analyzed data are stored in the database of the acquisition center so as to be convenient to call.
In a preferred embodiment, the step of obtaining the monitoring value of the running state of the physical device by simulating the running state of the physical device according to the actual running state information by the virtual device image is as follows:
a1, acquiring actual operation state information of entity equipment, wherein the actual operation state information comprises actual performance efficiency of the entity equipment, actual qualified rate of products, load time of the entity equipment and stop time of the entity equipment;
a2, substituting the actual performance efficiency of the entity equipment, the actual qualified rate of products, the load time of the entity equipment and the stop time of the entity equipment into a formula:
and calculating to obtain an actual operation efficiency value of the entity equipment, namely a monitoring value of the operation state of the entity equipment, wherein W represents the actual operation efficiency value of the entity equipment, P represents the actual performance efficiency of the entity equipment, Q represents the actual qualification rate of a product, LT represents the load time of the entity equipment, and ST represents the stop time of the entity equipment, and the values are all fixed constant values.
As described in the above steps A1-A2, when the monitoring value of the operation state of the entity device needs to be calculated, the actual performance efficiency, the actual qualification rate of the product, the load time of the entity device, and the stop time of the entity device need to be determined first, where the load time of the entity device is the total time of starting and operating the device, and the stop time of the entity device is the time consumed by the workers for loading and unloading, and this process is short, and because the loss generated by starting and stopping the device is large, the operation of the device will not be stopped in most cases, and these data are fixed constant values, for example, taking a cutting machine tool for processing hardware as an example, the actual performance efficiency is set to 0.8, the actual qualification rate of the product is 0.95, the load time of the entity device is 105min, and the stop time of the entity device is set to be a fixed constant valueIs 5min, then according to the formula
And then the monitoring value of the running state of the entity equipment can be calculated, and the specific calculation result is 0.72.
In a preferred embodiment, the step of the preview module simulating the operation status of the physical device under the standard status information to obtain the standard value of the operation status of the physical device is as follows:
b1, acquiring initial state information of the entity equipment, wherein the initial state information comprises a trend value of performance efficiency information and product percent of pass information under the continuous operation of the entity equipment;
b2, calculating a standard operation efficiency value of the entity equipment according to the initial state information, namely a standard value of the operation state of the entity equipment, wherein the calculation formula is as follows:
in the formula, the W mark represents the efficiency value of the standard operation of the entity equipment, the P mark represents the standard performance efficiency of the entity equipment, and the Q mark represents the standard qualification rate of products.
As described in the above steps B1-B2, when the standard value of the operation state of the entity device needs to be calculated, the performance efficiency trend value and the product yield trend value in the initial operation state of the device are determined first, wherein the calculation process of the performance efficiency trend value is specifically described below, and the fluctuation of the product yield is not too large, and only the yield obtained according to the previous operation state of the entity device needs to be directly substituted for calculation, so that the standard value of the product produced in a single period of the entity device can be effectively predicted by this method, and the subsequent standard value and the monitoring value are substituted for the quality evaluation module together for comparison, so that whether the operation efficiency change of the entity device is within the allowable range can be intuitively determined.
In a preferred embodiment, the calculation of the trend value of the performance efficiency information under the continuous operation of the physical device is as follows:
b101, acquiring a plurality of continuous time periods of single operation of entity equipment, wherein the number of the time periods is set to be i =1,2,3, \8230;, n, and n is a positive integer;
b102, acquiring a reference speed Si of the operation of the entity equipment in each single operation time period;
b103, substituting the reference rate of each physical equipment processing product into a formula:
in the formula, pi represents the performance efficiency of the physical device, gi represents the total input amount of the product, t represents the actual time of single operation of the physical device, wherein,
；
b104, acquiring the performance efficiency of each entity device and substituting the performance efficiency into a trend value function, wherein the trend value function is as follows:
in the formula, X represents a trend value of the performance efficiency, and the performance efficiency in the initial state of the entity device in the preview module is consistent with the value thereof.
As described in the above steps B101 to B104, since the physical devices are subjected to losses with different degrees after a long time of operation, the performance efficiency of the physical devices may be changed due to the losses, although the process is relatively long, the capacity of the physical devices may still be affected, the calculation of the trend value of the performance efficiency information needs to be performed according to the previous operation state of the physical devices, and is illustrated by taking the monitoring process of the cutting machine for processing hardware as an example, and is displayed by taking the virtual image of the actual operation device in the workshop as follows:
referring to the data shown in table 1, 10 sets of data of the operation state of the entity device before operation can be obtained, because the period of the loss of the entity device is long, the interval period of the 10 sets of data taken is 15 days, so that the change of the entity device can be clearly shown, then the performance efficiency corresponding to the 10 sets of data is obtained based on the change, then the standard performance efficiency of the entity device in the initial operation state can be obtained by substituting the performance efficiencies of the sets into a trend value function, the initial value of the performance efficiency of the entity device finally obtained is 0.81, then the performance efficiency value is substituted into a value formula, and finally the standard value of the operation of the entity device is 0.73.
Table 1: the performance energy efficiency table of the current operation state of the entity equipment is shown as the following table:
in a preferred embodiment, the step of the evaluation module substituting the monitored value and the standard value into the quality evaluation model together to obtain the quality information of the operation state of the physical device is as follows:
s1, constructing an entity equipment evaluation interval, wherein the evaluation interval has a value range of
；
S2, acquiring a monitoring value of the running state of the entity equipment;
s3, acquiring a standard value of the running state of the entity equipment;
s4, substituting the monitoring value and the standard value into a quality evaluation model together, wherein an evaluation equation in the quality evaluation model is as follows:
wherein M represents a physical device evaluation score;
s5, if M is more than-2% and less than 2%, the fluctuation of the running state of the entity equipment is within the safety range allowed by the error, the production requirement of the product can be met, and the interactive terminal does not act;
s6, if M is more than or equal to 2% and less than 4%, the fluctuation of the running state of the entity equipment is in an early warning range, and the interactive terminal sends early warning information;
s7, if M is larger than or equal to 4%, the fluctuation of the running state of the entity equipment is beyond the early warning range, and the interactive terminal directly sends alarm information;
and S8, if M is less than or equal to-2%, the fluctuation of the running state of the entity equipment exceeds the error allowable range, marking the actual running state information of the corresponding entity equipment in the state, and not recording the trend value of the performance efficiency information and the calculation formula of the product percent of pass information.
As described in the above steps S1 to S8, although the device is gradually worn when in use, it can be obtained from the data obtained in table 1 that as the loss of the device increases, the performance of the device increases, and although the loss is a small probability event, it indicates that an uncontrollable error exists in the operation result of the physical device, taking the cutting machine tool for producing hardware as an example, an allowable error range is preset, when comparing the monitored value and the standard value of the physical device, the operation quality of the physical device is determined based on the allowable error, here, the obtained monitored value 0.72 of the operation state of the physical device and the standard value 0.73 of the operation state of the physical device are substituted into the evaluation equation for operation, and finally the value of the evaluation score of the physical device is obtained as 1%, and the corresponding determination result indicates that the fluctuation of the operation state of the physical device is within the allowable error safety range, which indicates that the operation state of the physical device is normal, where the evaluation module may be.
In addition, when the quality evaluation score of the physical device is between 2% and 4%, it indicates that the operation of the physical device is developing in a bad direction, that is, it indicates that the loss of the physical device is beyond expectation, but within a controllable range, a worker needs to perform maintenance and overhaul in time to remove the fault of the physical device, so as to achieve the purpose of stabilizing the operation of the physical device, and when the quality evaluation score of the physical device is higher than 4%, it indicates that the loss of the physical device is too serious, and the loss exceeds the controllable range, and the worker needs to perform shutdown operation on the physical device in time, and the worker needs to perform overhaul on the physical device immediately, whereas when the quality evaluation score of the physical device is lower than-2%, the actual operation efficiency of the physical device is higher than the operation efficiency in a pre-demonstration state, which is an accidental time, when the pre-demonstration module performs pre-demonstration on the operation of the physical device, in order to ensure the authenticity of the performance efficiency value, and the pre-demonstration is not performed using this data, and under this data, it may be a quality inspection unit used with the physical device in combination with the physical device, thereby causing the qualification rate of the product, and the normal verification trend, but the worker does not need to perform normal verification of the normal operation of the physical device.
In a preferred embodiment, the management system further includes a memory and a controller, the memory is provided with an application program and an operating system which can run on the processor, wherein the processor implements the running of the data acquisition module, the image construction module, the monitoring module, the information synchronization module, the simulation running module, the rehearsal module and the evaluation module when executing the application program.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising one of 8230, and" comprising 8230does not exclude the presence of additional like elements in a process, apparatus, article, or method comprising the element.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present invention, and these improvements and modifications should also be construed as the protection scope of the present invention. Structures, devices, and methods of operation not specifically described or illustrated herein are not specifically illustrated or described, but are instead contemplated to be practiced in the art by those skilled in the art.
Claims (5)
1. The utility model provides an interactive monitoring management system based on XR technique which characterized in that: the method comprises the following steps: the system comprises a data acquisition module, an image construction module, a monitoring module, an information synchronization module, a simulation operation module, a rehearsal module, an evaluation module, a central control unit and a central control unit;
the central control unit is respectively in communication connection with the data acquisition module, the image construction module, the monitoring module, the information synchronization module, the simulation operation module, the rehearsal module and the evaluation module;
the data acquisition module is used for acquiring the characteristic information of the entity equipment;
the image construction module is used for constructing a three-dimensional XR virtual image of the entity equipment according to the characteristic information of the entity equipment to obtain a virtual equipment image of the entity equipment;
the monitoring module is used for monitoring the running state of the entity equipment and acquiring the actual running state information of the real-time running of the entity equipment;
the information synchronization module is used for synchronizing the actual running state information to the virtual equipment image;
the virtual equipment image simulates the running state of the entity equipment according to the actual running state information to obtain a monitoring value of the running state of the entity equipment;
the preview module is used for simulating the running state of the entity equipment under the standard state information to obtain a standard value of the running state of the entity equipment;
the central control unit is used for receiving the monitoring value and the standard value of the monitoring value and sending the monitoring value and the standard value to a quality evaluation model to obtain quality information of the running state of the entity equipment, wherein the central control unit sends out an abnormal signal according to the quality information, the abnormal signal comprises alarm information and early warning information, and the priority of the alarm information is higher than that of the early warning information;
further comprising: the intelligent platform is connected with a plurality of central control units, a grade setting module and an execution module are preset in the intelligent platform, the grade setting module is used for determining the abnormal grade of all products in the same batch according to an abnormal signal fed back by the central control units, and the execution module is used for controlling the monitoring module to carry out high-frequency monitoring on the products in the same batch according to the abnormal grade;
the virtual equipment image simulates the running state of the entity equipment according to the actual running state information, and the step of obtaining the monitoring value of the running state of the entity equipment comprises the following steps:
acquiring actual operation state information of the entity equipment, wherein the actual operation state information comprises actual performance efficiency of the entity equipment, actual qualified rate of products, load time of the entity equipment and stop time of the entity equipment;
substituting the actual performance efficiency of the entity equipment, the actual qualified rate of products, the load time of the entity equipment and the stop time of the entity equipment into a formula:
calculating to obtain an actual operation efficiency value of the entity equipment, namely a monitoring value of the operation state of the entity equipment, wherein W represents the actual operation efficiency value of the entity equipment, P represents the actual performance efficiency of the entity equipment, Q represents the actual qualification rate of a product, LT represents the load time of the entity equipment, and ST represents the stop time of the entity equipment, and the values are all fixed constant values;
the preview module is used for simulating the running state of the entity equipment under the standard state information to obtain the standard value of the running state of the entity equipment, and the steps are as follows:
acquiring initial state information of the entity equipment, wherein the initial state information comprises a trend value of performance efficiency information and product percent of pass information under the continuous operation of the entity equipment;
calculating a standard operating efficiency value of the entity equipment according to the initial state information, namely a standard value of the operating state of the entity equipment, wherein a calculation formula is as follows:
in the formula, a W mark represents an efficiency value of standard operation of the entity equipment, a P mark represents standard performance efficiency of the entity equipment, and a Q mark represents standard qualified rate of products;
the calculation process of the trend value of the performance efficiency information under the continuous operation of the entity equipment is as follows:
acquiring a plurality of continuous time periods of single operation of the entity equipment, wherein the number of the time periods is set as i =1,2,3, \8230;, n, and n is a positive integer;
acquiring a reference speed Si of the operation of the entity equipment in each single operation time period;
and substituting the reference rate of each entity equipment processing product into a formula:
wherein Pi represents the performance efficiency of the physical device, gi represents the total product input amount, and t represents the actual time of single operation of the physical device, wherein,
acquiring the performance efficiency of each entity device and substituting the performance efficiency into a trend value function, wherein the trend value function is as follows:
in the formula, X represents a trend value of the performance efficiency, and the performance efficiency in the initial state of the entity device in the preview module is consistent with the value thereof;
the evaluation module is used for substituting the monitoring value and the standard value into a quality evaluation model together to obtain the quality information of the running state of the entity equipment, and the steps are as follows:
constructing an entity equipment evaluation interval, wherein the value range of the evaluation interval is
；
Acquiring a monitoring value of the running state of the entity equipment;
acquiring a standard value of the running state of the entity equipment;
and substituting the monitoring value and the standard value into a quality evaluation model together, wherein an evaluation equation in the quality evaluation model is as follows:
wherein M represents the physical device assessment score;
if M is more than-2% and less than 2%, the fluctuation of the running state of the entity equipment is within the safety range allowed by the error, the production requirement of the product can be met, and the interactive terminal does not act;
if M is more than or equal to 2% and less than 4%, the fluctuation of the running state of the entity equipment is in the early warning range, and the interactive terminal sends early warning information;
if M is larger than or equal to 4%, the fluctuation of the running state of the entity equipment is beyond the early warning range, and the interactive terminal directly sends alarm information;
if M is less than or equal to-2%, the fluctuation of the running state of the entity equipment exceeds the error allowable range, the actual running state information of the corresponding entity equipment in the state is marked, and the trend value of the performance efficiency information and the calculation formula of the product percent of pass information are not recorded.
2. The XR technology-based interaction monitoring management system of claim 1, wherein: the image construction module builds the virtual equipment image of the entity equipment through the virtual reality technology, and the image construction module comprises:
the building unit is used for acquiring three-dimensional data of an actual environment, building a virtual environment and building a three-dimensional graph in the virtual environment according to the characteristic information of the entity equipment;
and the refreshing unit refreshes the three-dimensional graph according to the running state of the entity equipment, and the refreshing frequency is set to be 20 frames/second.
3. The XR technology-based interaction monitoring management system of claim 1, wherein: and the entity equipment is provided with a CTU module for acquiring the actual running state of the entity equipment, and the actual running state information of the entity equipment is converted into IP data through the CTU module and is sent to the monitoring module for storage.
4. The XR technology-based interaction monitoring and management system according to claim 3 wherein: the system also comprises an interactive terminal, wherein the interactive terminal establishes bidirectional communication connection with the monitoring module through a TCP protocol and a DES protocol, and specifically comprises the following steps:
the CTU module acquires IP data corresponding to actual running state information and packs the IP data to obtain a TCP transfer packet;
sending the TCP transfer packet to an interactive terminal through a TCP protocol;
and the interactive terminal receives the TCP transfer packet, extracts data content from the TCP transfer packet and feeds back the data content to the virtual equipment image through the interactive terminal.
5. The XR technology-based interaction monitoring management system according to claims 1-4, wherein: the device comprises a processor, and is characterized by further comprising a memory and a controller, wherein an application program and an operating system which can run on the processor are arranged in the memory, and when the processor executes the application program, the operation of a data acquisition module, an image construction module, a monitoring module, an information synchronization module, a simulation operation module, a rehearsal module and an evaluation module is realized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211039988.3A CN115115289B (en) | 2022-08-29 | 2022-08-29 | XR technology-based interactive monitoring management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211039988.3A CN115115289B (en) | 2022-08-29 | 2022-08-29 | XR technology-based interactive monitoring management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115115289A CN115115289A (en) | 2022-09-27 |
| CN115115289B true CN115115289B (en) | 2022-11-11 |
Family
ID=83335733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211039988.3A Active CN115115289B (en) | 2022-08-29 | 2022-08-29 | XR technology-based interactive monitoring management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115115289B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115512526A (en) * | 2022-11-17 | 2022-12-23 | 歌尔股份有限公司 | Production monitoring method and device |
| CN117234343B (en) * | 2023-11-16 | 2024-02-02 | 山东经鼎智能科技有限公司 | XR multi-terminal cooperation PaaS platform |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111708332A (en) * | 2020-05-28 | 2020-09-25 | 上海航天精密机械研究所 | Digital twin system of production line |
| CN114118677A (en) * | 2021-10-13 | 2022-03-01 | 中通服和信科技有限公司 | Tailing pond risk monitoring and early warning system based on Internet of things |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20210287459A1 (en) * | 2018-09-30 | 2021-09-16 | Strong Force Intellectual Capital, Llc | Digital twin systems and methods for transportation systems |
| CN111230887B (en) * | 2020-03-10 | 2021-01-26 | 合肥学院 | Industrial gluing robot running state monitoring method based on digital twin technology |
| CN112836404B (en) * | 2021-01-07 | 2023-09-19 | 大连理工大学 | Construction method of digital twin body of structural performance of intelligent excavator |
| CN114707227A (en) * | 2022-04-28 | 2022-07-05 | 水利部南京水利水文自动化研究所 | Dam safety early warning and warning method and system based on digital twins |
-
2022
- 2022-08-29 CN CN202211039988.3A patent/CN115115289B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111708332A (en) * | 2020-05-28 | 2020-09-25 | 上海航天精密机械研究所 | Digital twin system of production line |
| CN114118677A (en) * | 2021-10-13 | 2022-03-01 | 中通服和信科技有限公司 | Tailing pond risk monitoring and early warning system based on Internet of things |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115115289A (en) | 2022-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115115289B (en) | XR technology-based interactive monitoring management system | |
| CN102759911B (en) | Fully mechanized working face monitoring system and coal mining machine | |
| CN109947061A (en) | A kind of wisdom industrial information automated system using technology of Internet of things | |
| CN112231355A (en) | Visualization platform system of digital factory | |
| CN114360094B (en) | Three-dimensional visualization implementation method and system for large rolling mill | |
| CN110553686A (en) | Cold header running state monitoring system | |
| CN112777489B (en) | Safety monitoring and alarming system and method for crane hoisting process based on AI analysis | |
| CN112286148A (en) | Intelligent factory system based on Internet of things technology and digital management technology | |
| CN209373419U (en) | A kind of industrial automation system including monitoring unit, factory and monitoring device | |
| CN201557198U (en) | Video surveillance and control network management system | |
| CN207337179U (en) | A kind of intelligent leather belt transportation communication control system | |
| CN113554837B (en) | Monitoring alarm method and system | |
| WO2022121910A1 (en) | Factory server embedded in distributed control system and secure network structure thereof | |
| CN112506156B (en) | Visual digital twin factory server embedded in distributed control system | |
| CN209811120U (en) | Cold header control device | |
| CN107247443A (en) | A kind of intelligent leather belt transportation communication control system | |
| CN210573353U (en) | Cloud data monitoring device of roaster | |
| CN207867531U (en) | A kind of PROFIBUS bus-types fired power generating unit real time monitoring diagnostic device | |
| CN102778865A (en) | Preparation process of central centralized control method of plastics production line | |
| KR100928291B1 (en) | Engine remote control method for generator | |
| CN110781549A (en) | Panoramic roaming inspection method and system for pump station | |
| CN113554854B (en) | Enameled equipment stall alarm system | |
| CN204241908U (en) | The monitoring system of transformer station | |
| CN213338418U (en) | Data acquisition box and data analysis system | |
| CN106760471A (en) | Synchronous load control device based on ZigBee technology wireless monitor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |