CN116880247A - Equipment monitoring system based on augmented reality - Google Patents

Equipment monitoring system based on augmented reality Download PDF

Info

Publication number
CN116880247A
CN116880247A CN202310655273.9A CN202310655273A CN116880247A CN 116880247 A CN116880247 A CN 116880247A CN 202310655273 A CN202310655273 A CN 202310655273A CN 116880247 A CN116880247 A CN 116880247A
Authority
CN
China
Prior art keywords
actual operation
operation parameters
module
monitoring module
identification information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310655273.9A
Other languages
Chinese (zh)
Inventor
钱广璞
徐欣
陈罡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Electric Group Corp
Original Assignee
Shanghai Electric Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Electric Group Corp filed Critical Shanghai Electric Group Corp
Priority to CN202310655273.9A priority Critical patent/CN116880247A/en
Publication of CN116880247A publication Critical patent/CN116880247A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G05B19/0428—Safety, monitoring
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/24—Pc safety
    • G05B2219/24024—Safety, surveillance
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Testing And Monitoring For Control Systems (AREA)

Abstract

The present disclosure provides an augmented reality-based device monitoring system. The equipment monitoring system comprises a control module, a data forwarding module and an AR monitoring module which are sequentially in communication connection; the control module is electrically connected with the target equipment and is used for acquiring actual operation parameters of the target equipment; the data forwarding module is used for acquiring actual operation parameters in the control module and sending the actual operation parameters to the AR monitoring module; the AR monitoring module comprises virtual display units corresponding to different target devices which are built in advance; the AR monitoring module is used for receiving the actual operation parameters and displaying the actual operation parameters through the virtual display unit. The equipment monitoring system is not limited in a monitoring room like the traditional operation configuration software, and a user can intuitively check the actual operation parameters of the target equipment through a virtual display unit in the AR monitoring module on the site where the target equipment is placed.

Description

Equipment monitoring system based on augmented reality
Technical Field
The disclosure relates to the technical field of augmented reality, in particular to an augmented reality-based device monitoring system and AR (Augmented Reality ) device.
Background
At present, the monitoring of the running state of equipment is to establish a system for interaction between equipment and human-computer through various configuration software. The method specifically can collect various parameters of the equipment through configuration software and provide a graphical interface for display and interaction.
For example, the traditional motor monitoring mainly establishes a system for interaction between a motor and a human-computer through configuration software, and uses a PLC controller to realize control and detection of various actual operation parameters of the motor. Specifically, control I/O (input/output) points of the PLC are distributed for different actual operation parameters according to the operation and monitoring requirements of the motor, and communication is carried out through the PLC and configuration software, so that the operation state of the motor is monitored.
In general, the monitoring of the running states of the devices is performed in a special monitoring room, that is, the devices running the configuration software and the monitored devices are not in the same physical space, and the running states of each device cannot be intuitively known in the physical space where the monitored devices are located. In addition, the user needs to know the query conditions such as the placement position or the device number of each device, otherwise, it is difficult to accurately acquire various parameters of a specific device.
Disclosure of Invention
The disclosure provides an equipment monitoring system based on augmented reality for solving the technical problems.
The technical problems are solved by the following technical scheme:
in a first aspect, the present disclosure provides an augmented reality-based device monitoring system. The equipment monitoring system comprises a control module, a data forwarding module and an AR monitoring module which are sequentially in communication connection;
the control module is electrically connected with the target equipment and is used for acquiring actual operation parameters of the target equipment;
the data forwarding module is used for acquiring the actual operation parameters in the control module and sending the actual operation parameters to the AR monitoring module;
the AR monitoring module comprises virtual display units corresponding to different target devices which are built in advance; the AR monitoring module is used for receiving the actual operation parameters and displaying the actual operation parameters through the virtual display unit.
Optionally, the data forwarding module comprises a communication unit and a server unit;
the communication unit is respectively in communication connection with the control module and the server unit, and is used for reading the actual operation parameters in the control module and sending the actual operation parameters to the server unit;
the server unit is used for receiving the actual operation parameters and sending the actual operation parameters to the AR monitoring module.
Optionally, the server unit is configured to configure corresponding data storage spaces for different target devices, where the data storage spaces are used to store the actual operation parameters;
the AR monitoring module is used for sending a parameter acquisition request and equipment identification information to the server unit; wherein the data storage space corresponds to the device identification information;
the communication unit is used for uploading the actual operation parameters to a data storage space corresponding to the target equipment;
the server unit is configured to receive the parameter obtaining request, obtain the actual operation parameter from the data storage space corresponding to the target device according to the device identification information, and send the actual operation parameter to the AR monitoring module.
Optionally, the device identification information includes first identification information of a device to be displayed, and the actual operation parameter includes a first operation parameter of the device to be displayed;
the AR monitoring module is further used for determining the equipment to be displayed, acquiring the first identification information, receiving the first operation parameters and displaying the first operation parameters through the virtual display units corresponding to the equipment to be displayed; the device to be displayed is the target device in a first visual field range.
Optionally, the device identification information further includes second identification information of the device to be loaded, and the actual operation parameters further include second operation parameters of the device to be loaded;
the AR monitoring module is further used for determining the equipment to be loaded, acquiring the second identification information and receiving a second operation parameter; the device to be loaded is the target device in a second visual field range, and the second visual field range is adjacent to the first visual field range.
Optionally, the server unit is further configured to provide an instruction storage space for the AR monitoring module to control the target device;
the AR monitoring module further comprises virtual control units corresponding to different target devices, wherein the virtual control units are constructed in advance, and the AR monitoring module is used for responding to the triggering of the virtual control units, acquiring preset control instructions bound by the virtual control units, and uploading the device identification information corresponding to the virtual control units to the instruction storage space;
the server unit is used for sending a preset control instruction newly added in the instruction storage space to the communication unit;
the communication unit is used for receiving the preset control instruction and controlling the target equipment through the control module according to the preset control instruction.
Optionally, the communication unit is further configured to read the actual operation parameters according to a preset frequency, determine whether the actual operation parameters read in two adjacent times are the same, and if not, upload the actual operation parameters read currently to the data storage space to update the actual operation parameters;
the server unit is further configured to send the actual operation parameter to the AR monitoring module in response to the actual operation parameter update;
the AR monitoring module is further used for receiving the actual operation parameters and updating the actual operation parameters displayed by the virtual display unit.
Optionally, the server unit comprises an MQTT server.
Optionally, the virtual display unit is further configured to display a virtual model corresponding to the target device, which is built in advance, and change the virtual model according to the actual operation parameter.
Optionally, the actual operating parameter corresponds to a register address in the control module; the data forwarding module is used for reading the value of the register address to obtain the actual operation parameter, and modifying the value of the register address to modify the actual operation parameter.
Optionally, the target device includes a motor, the control module includes a PLC controller, a driver of the motor is electrically connected to the PLC controller, and the PLC controller is configured to control the motor through the driver.
Optionally, the AR monitoring module includes an AR device.
The above embodiments may be combined arbitrarily to obtain the preferred embodiments of the present disclosure, based on the common general knowledge in the art.
The positive progress effect of the present disclosure is:
the device monitoring system in the present disclosure acquires actual operating parameters of the target device in real time through a control module connected to the target device using IoT (Internet of Things ) technology, and transmits the actual operating parameters to the AR monitoring module through a data forwarding module. Based on the AR technology, actual operation parameters of each target device are displayed on a virtual display unit in the AR monitoring module. The equipment monitoring system is not limited in a monitoring room like the traditional operation configuration software, and a user can intuitively check the actual operation parameters of the target equipment through a virtual display unit in the AR monitoring module on the site where the target equipment is placed.
Drawings
Fig. 1 is a schematic block diagram of an apparatus monitoring system according to an embodiment of the disclosure;
fig. 2 is a schematic diagram of a first field of view of an AR monitoring module provided in an embodiment of the present disclosure;
fig. 3 is a schematic diagram of a second field of view of an AR monitoring module provided in an embodiment of the present disclosure;
fig. 4 is a schematic block diagram of a motor monitoring system according to an embodiment of the disclosure.
Detailed Description
The present disclosure is further illustrated by way of examples below, but is not thereby limited to the scope of the examples described.
It should be noted that, if there is a description of "first", "second", etc. in the embodiments of the present disclosure, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature.
In addition, the technical solutions of the embodiments may be combined with each other, but it is necessary to be based on the fact that those skilled in the art can realize the technical solutions, and when the technical solutions are contradictory or cannot be realized, the combination of the technical solutions should be considered as not exist, and is not within the protection scope of the present disclosure.
The present disclosure provides an augmented reality-based device monitoring system. As a possible implementation manner, the device monitoring system is shown in fig. 1, and includes a control module 101, a data forwarding module 102, and an AR monitoring module 103 that are sequentially connected in communication.
The control module 101 is electrically connected with the target device 100, and the control module 101 is used for acquiring actual operation parameters of the target device 100; the data forwarding module 102 is configured to obtain the actual operation parameters in the control module 101, and send the actual operation parameters to the AR monitoring module 103.
The AR monitoring module 103 comprises virtual display units corresponding to different target devices 100 which are built in advance; the AR monitoring module 103 is configured to receive the actual operation parameter and display the actual operation parameter through the virtual display unit.
Specifically, the data forwarding module 102 is configured to obtain, by using the control module 101, an actual operation parameter of the target device 100, and send the actual operation parameter to the AR monitoring module 103. The AR monitoring module 103 is configured to receive actual operation parameters of the target device 100, and display the respective actual operation parameters through virtual display units pre-built for different target devices 100.
Based on the above embodiment, after the user enters the place where the target device 100 is placed, the actual operation parameters of each target device 100 may be viewed through the virtual display unit in the AR monitoring module 103.
Illustratively, the virtual display unit in the AR monitoring module 103 is typically in the form of a "virtual billboard" that is displayed in hover near the target device 100.
As a possible implementation, the actual operating parameters correspond to register addresses in the control module 101. The data forwarding module 102 is configured to read the value of the register address to obtain the actual operating parameter and modify the value of the register address to modify the actual operating parameter.
Illustratively, the target device 100 includes a motor, and the control module 101 includes a PLC controller, with which a driver of the motor is electrically connected, for controlling the motor through the driver. That is, the data forwarding module 102 is configured to obtain and modify the actual operation parameters of the motor by reading and modifying the values of the register addresses in the PLC controller, so as to monitor the motor.
As a possible implementation, the data forwarding module 102 includes a communication unit and a server unit. The communication unit is respectively in communication connection with the control module 101 and the server unit, and is used for reading the actual operation parameters in the control module 101 and sending the actual operation parameters to the server unit. The server unit is configured to receive the actual operation parameters and send the actual operation parameters to the AR monitoring module 103.
Specifically, the server unit is configured to configure corresponding data storage spaces for different target devices 100, where the data storage spaces are used to store actual operating parameters. The communication unit is configured to upload the actual operation parameters to the data storage space corresponding to the target device 100. The AR monitoring module 103 is configured to send a parameter acquisition request and device identification information to the server unit; wherein the data storage space corresponds to the device identification information. The server unit is configured to receive the parameter obtaining request, obtain the actual operation parameter from the data storage space corresponding to the target device 100 according to the device identification information, and send the actual operation parameter to the AR monitoring module 103.
The server elements illustratively include MQTT (Message Queuing Telemetry Transport, message queue telemetry transport protocol) servers. The MQTT server may be provided at the cloud end or at the edge side, i.e., near the place where the target device 100 is placed.
In order to save the consumption of data transmission resources, as a feasible implementation manner, the communication unit is further configured to read the actual operation parameters according to a preset frequency, determine whether the actual operation parameters read in two adjacent times are the same, and if not, upload the actual operation parameters read currently to the data storage space to update the actual operation parameters.
The server unit is further configured to send the actual operating parameters to the AR monitoring module 103 in response to the actual operating parameter update.
The AR monitoring module 103 is further configured to receive the actual operation parameter and update the actual operation parameter displayed by the virtual display unit.
For example, in the communication unit, a cache array arrbuff_0 is reserved, and each time an interval of 50ms is set, the communication unit reads the actual operation parameters of the target device 100 in the control module 101 once, and assigns the read actual operation parameters to a cache array arrbuff_1. Then comparing the array ArrBuff_1 with the array ArrBuff_0, and when the two arrays are the same, not processing; when the two arrays are different, the value of the array ArrBuff_1 is assigned to ArrBuff_0, and the actual operation parameters in ArrBuff_1 are uploaded to the data storage space corresponding to the server unit. By the mechanism, under the condition that the actual operation parameters of the target device 100 acquired by the communication unit are not changed in the data query interval, no operation is performed, and the actual operation parameters are uploaded only when the actual operation parameters are changed.
Further, in order to reduce the data to be acquired, as a possible implementation manner, the device identification information includes first identification information of the device to be displayed, and the actual operation parameter includes first operation parameter of the device to be displayed.
The AR monitoring module 103 is further configured to determine a device to be displayed, obtain first identification information, receive a first operation parameter, and display the first operation parameter through a virtual display unit corresponding to the device to be displayed; wherein the device to be displayed is the target device 100 within the first field of view.
For example, the first field of view of the AR monitoring module may be set according to actual needs. As shown in fig. 2, the AR monitoring module includes an AR device, and sets a horizontal view of the AR monitoring module to 43 degrees, and a vertical view of the AR monitoring module to 29 degrees, that is, uses an origin 202 of the AR device as a vertex, and establishes a rectangular pyramid space with a horizontal angle 203 of 43 degrees and a vertical angle 204 of 29 degrees, that is, a first view range 201.
In the AR monitoring module, a device location map for placing the target devices is pre-built, and a virtual display unit and a virtual control unit of each target device are pre-built in the device location map, wherein the virtual display unit comprises a visual calibration point 205 of the corresponding target device. And establishing a connection line between the visual calibration point 205 of each target device and the origin 202 of the AR device, judging whether each connection line is spatially intersected with the rectangular pyramid, if so, determining the connection line as a device to be displayed by the AR monitoring module, acquiring first identification information of the device to be displayed, and sending a parameter acquisition request and the first identification information to a server unit.
The server unit is used for receiving the parameter acquisition request and the first identification information, acquiring the first operation parameter from the corresponding data storage space according to the first identification information, and sending the first operation parameter to the AR monitoring module.
The AR monitoring module is used for receiving the actual operation parameters and displaying the first operation parameters through the virtual display unit corresponding to the equipment to be displayed.
The virtual display unit in the AR monitoring module is ensured to display smoothly while the data required to be acquired is reduced as much as possible. As another possible embodiment, the device identification information further includes second identification information of the device to be loaded, and the actual operation parameter further includes second operation parameter of the device to be loaded.
The AR monitoring module is also used for determining equipment to be loaded, acquiring second identification information and receiving second operation parameters; wherein the device to be loaded is a target device within a second field of view, the second field of view being adjacent to the first field of view 201.
For example, in order to ensure that the display effect of the virtual display unit in the AR monitoring module is not stuck and delayed, the second field of view may be set as required. As shown in fig. 3, the second field of view 301 is adjacent to the first field of view 201.
The AR monitoring module determines the target device in the second field of view 301 as a device to be loaded, acquires second identification information of the device to be loaded, and sends the parameter acquisition and the first identification information to the server unit and also sends the second identification information.
The server unit is further configured to receive second identification information, acquire a second operation parameter from the corresponding data storage space according to the second identification information, and send the second operation parameter to the AR monitoring module.
The AR monitoring module is configured to receive the second operating parameter, but not display the second operating parameter.
Specifically, when the user moves the AR device, the to-be-displayed device in the first field of view 201 changes, that is, a part of to-be-loaded device originally in the second field of view 301 enters the first field of view 201, and at this time, since the second operation parameters of the to-be-loaded device are already acquired, reality can be performed in time through the virtual display unit corresponding to the to-be-loaded device, so as to ensure smooth pictures of the virtual display unit in the AR monitoring module.
As another possible implementation manner, the virtual display unit is further configured to implement a virtual model corresponding to the target device that is built in advance, and change the virtual model according to the actual operation parameters.
Specifically, according to actual operation parameters, the shape, color, particle special effects, hidden display and other attributes of the virtual model can be changed, so that the display change of the virtual equipment model is realized.
For example, as the operation temperature of the motor gradually increases, the color of the virtual model corresponding to the target device may be sequentially modified to blue, yellow, orange, and red.
As a possible implementation manner, the server unit is further configured to provide an instruction storage space for the AR monitoring module to control the target device;
the AR monitoring module further comprises virtual control units corresponding to different target devices which are built in advance, and the AR monitoring module is used for responding to the triggering of the virtual control units, acquiring preset control instructions bound by the virtual control units, and device identification information corresponding to the virtual control units and uploading the device identification information to the instruction storage space;
the server unit is used for sending a newly-added preset control instruction in the instruction storage space to the communication unit;
the communication unit is used for receiving a preset control instruction and controlling the target equipment through the control module according to the preset control instruction.
Specifically, the AR monitoring module may determine whether the virtual control unit is triggered by means of gesture recognition or the like.
According to the augmented reality-based equipment monitoring system, by means of the visual, interactive and virtual-real fusion characteristics of the AR technology, the actual operation parameters of the target equipment are transmitted to the AR monitoring module through the IOT technology, and all the actual operation parameters of the target equipment can be directly displayed in front of the target equipment so as to realize real-time monitoring on the real target equipment.
Moreover, conventional operation and maintenance monitoring data, namely actual operation parameters of the target equipment, can be projected at the maintained equipment position in real time in the form of three-dimensional animation, video and the like by using AR technology.
The working principle of the device monitoring system of the present embodiment is specifically described below with reference to examples:
referring to fig. 4, in a practical application scenario of motor monitoring, the above-mentioned device monitoring system is specifically a motor monitoring system. As shown in fig. 4, a motor monitoring system is used for monitoring a motor 400, and includes a PLC controller 401, a communication unit 402, an MQTT server 403, and AR glasses 404.
Specifically, the motor 400 may include a plurality of types of stepping motors, servo motors, asynchronous motors, and the like. The PLC controller 401 employs Siemens S7-200PLC. The AR glasses 404 are holonens 2 glasses, and AR programs developed based on Unity are built in the AR glasses 404. The communication unit 402 is programmed with c# and runs in raspberry group hardware.
The PLC controller 401 is connected with the corresponding motor 400 driver according to a general wiring and programming method, and realizes the control of the actual operation parameters of the motor 400 by the PLC. Specifically, the PLC controller 401 writes and reads a register address corresponding to an actual operation parameter through an input/output module of the PLC operating in the raspberry group, so as to obtain and modify the actual operation parameter of the motor 400.
The MQTT server 403 configures an independent publishable subscribed MQTT theme for each of the motors 400 and names the MQTT theme according to the device identification information of the motor 400. At the same time, an MQTT theme, named "TopicCMD", is also named for transmitting control instructions.
The communication unit 402 is mainly used for realizing data exchange between the PLC controller 401 and the MQTT server 403. The communication unit 402 operates in the raspberry group and establishes connection with the PLC controller 401 through a network cable. The communication module reads the parameter values stored in the register addresses corresponding to the actual operation parameters of the motor 400 in the PLC controller 401 at a certain frequency, for example, every 50 ms. The parameter values of the read actual operating parameters of the different motors 400 are converted into JSON data.
The JSON data includes contents such as device identification information (sn), parameter values (value_1, value_2, etc.), and time stamp (timestamp) of the motor 400. Illustratively, the JSON data is as follows:
“{“sn”:“100235”,
“Value_1”:5,
“Value_2”:18,
……，
“timestamp”:“1660187414”}”。
wherein, "sn" 100235 "is used for characterizing equipment identification information as 100235," value_1 "is used for characterizing actual operating parameter name as" value_1 "as parameter Value as 5," value_2 "is used for characterizing actual operating parameter name as" value_2 "as parameter Value as 18," timestamp "as" 1660187414 "is used for characterizing time for reading the data as" 2022-8-11:10:14 ". The method of converting the time stamp into the time-date format, which should be known to those skilled in the art, will not be described here.
The communication unit 402 is configured to issue JSON data of the motor 400 to MQTT topics corresponding to the device identification information in the MQTT server 403 according to the device identification information (sn value) of the motor 400.
The communication unit 402 reserves a cache array arrbuff_0 in the programming process, and each time the interval is 50ms, the communication unit 402 reads actual operation parameters (including parameter values of a plurality of actual operation parameters) of the motor 400 in the control module, and assigns the read parameter values to a cache array arrbuff_1. Then comparing the array ArrBuff_1 with the array ArrBuff_0, and when the two arrays are the same, not processing; when the two arrays are different, the value of the array ArrBuff_1 is assigned to ArrBuff_0, and ArrBuff_1 is converted into JSON data and sent to the MQTT topic corresponding to the device identification information in the MQTT server 403. By the mechanism, when the state of the device does not change in the data query interval, the device does not upload data, and the data is uploaded only when the state of the device changes.
The AR glasses 404 adopt holonens 2 glasses, and run a terminal AR program developed by Unity, and the main functions include subscribing and publishing MQTT topics in the MQTT server 403, visually presenting received data, and a man-machine interaction interface.
The AR glasses 404 pre-construct a virtual scene including a device location map in which the motors 400 are placed, and pre-construct a virtual display unit and a virtual control unit for each motor 400 in the device location map, the virtual display unit including a virtual model corresponding to the motor 400 and a visual index point for each motor 400. The AR glasses 404 collect field data through a camera of the AR glasses, and combine with a slam algorithm (Simultaneous Localization and Mapping, synchronous positioning and map building algorithm) to automatically match the virtual scene to the real scene, so as to achieve virtual-real correspondence.
Specifically, the horizontal field of view of the AR glasses 404 may be set to 43 degrees and the vertical field of view 29 degrees according to actual needs. A rectangular pyramid space with a vertical angle of 29+5=34 degrees and a horizontal angle of 43+5=48 degrees is established with the origin of AR glasses as the vertex. The AR glasses 404 set a first view range and a second view range, and a rectangular pyramid space with a vertical angle of 29 degrees and a horizontal angle of 43 degrees is established with an origin of the AR glasses as a vertex, as the first view range. Based on the first visual field range, the range corresponding to the vertical angle and the horizontal angle which are respectively expanded outwards by 5 degrees is the second visual field range.
The rectangular pyramid space moves in real time following the movement of the AR glasses 404. Specifically, a connection line between the visual calibration point of each motor 400 and the origin of the AR glasses 404 is established, and it is determined whether each connection line interferes with the rectangular pyramid space. If interference exists, subscribing to the MQTT theme corresponding to the motor 400; if there is no intervention, the MQTT topic corresponding to the motor 400 is unsubscribed. By this mechanism, it is only necessary to acquire the actual operation parameters of the motor 400 present in the first visual field range and the actual operation parameters of the motor 400 present in the second utility range, and it is only necessary to display the actual operation parameters of the motor 400 in the first visual field range, and it is not necessary to acquire the actual operation parameters of the motor 400 outside the first visual field range and the second visual field range. The effect of saving data transmission resources is achieved under the condition that normal functions are not affected.
The virtual display unit in the AR monitoring module includes a virtual display billboard and a virtual model of the motor 400. After receiving the JSON format, the terminal AR program first analyzes to obtain the actual operating parameters of the motor 400. Then, a part of the actual operation parameters is displayed through the virtual data sign, and another part of the actual operation parameters is expressed through the display variation of the virtual model of the motor 400. The method is specifically expressed as attributes such as motion, color, particle special effects, hidden display and the like of the virtual model.
The virtual control unit in the AR monitoring module includes a virtual button provided in the virtual display billboard. The virtual button is used to effect manipulation of the motor 400. Specifically, the virtual button is bound with a command sending function, and the function of the command sending function includes a preset control command, and when the command sending function triggers, the preset control command is converted into control command JSON data, and the control command JSON data is issued to the TopicCMD MQTT theme in the MQTT server 403. The control command JSON data includes the device identification information (sn), command value (cmd_), timestamp (timestamp), and the like of the motor 400, and has the following format:
“{"CMD":[
{“sn”:“100235”,
“Cmd_1”:5,
“Cmd_2”:18},
{“sn”:“100236”,
“Cmd_1”:6,
“Cmd_2”:13},
……，
“timestamp”:“1660187414”}]”。
the communication unit 402 in the raspberry group subscribes to the MQTT theme of the MQTT server 403, analyzes the control instruction JSON data sent by the MQTT theme in the MQTT server 403 when the control instruction JSON data is received, determines the corresponding motor 400 by combining the analyzed values of sn, and determines again according to the index value of each motor 400 in the data CMD. Finally, the parameter value of the actual operation parameter is written into the register address corresponding to the actual operation parameter in the PLC controller 401, so that the control of the motor 400 by the PLC controller 401 according to the control instruction sent by the AR glasses 404 is realized.
The user wears the AR glasses 404 on site where the motors 400 are placed, can intuitively view actual operation parameters of the motors 400 within the field of view of the AR glasses 404 on the virtual display unit, and can trigger the virtual control units of different motors 400 to realize monitoring of the respective motors 400.
The above-mentioned motor monitoring system, based on AR technology and IoT technology, reads and modifies the values of register addresses in the PLC controller 401 that controls the operation of the motor 400 in real time, and converts the data into visual elements such as data, animation, curves, etc. that can be presented in real time in the AR glasses 404 by analyzing the data, thereby helping a first-line staff to intuitively monitor the current operation state of the motor 400. And by combining with the positioning function of the AR, the actual operation parameters are projected to the vicinity of the corresponding motor 400, so that the problem that the data and the equipment need to be matched manually is solved.
While specific embodiments of the present disclosure have been described above, it will be appreciated by those skilled in the art that this is by way of example only, and the scope of the disclosure is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the principles and spirit of the disclosure, but such changes and modifications fall within the scope of the disclosure.

Claims (10)

1. The equipment monitoring system based on augmented reality is characterized by comprising a control module, a data forwarding module and an AR monitoring module which are sequentially in communication connection;
the control module is electrically connected with the target equipment and is used for acquiring actual operation parameters of the target equipment;
the data forwarding module is used for acquiring the actual operation parameters in the control module and sending the actual operation parameters to the AR monitoring module;
the AR monitoring module comprises virtual display units corresponding to different target devices which are built in advance; the AR monitoring module is used for receiving the actual operation parameters and displaying the actual operation parameters through the virtual display unit.
2. The device monitoring system of claim 1, wherein the data forwarding module comprises a communication unit and a server unit;
the communication unit is respectively in communication connection with the control module and the server unit, and is used for reading the actual operation parameters in the control module and sending the actual operation parameters to the server unit;
the server unit is used for receiving the actual operation parameters and sending the actual operation parameters to the AR monitoring module.
3. The device monitoring system of claim 2, wherein the server unit is configured to configure corresponding data storage spaces for different of the target devices, the data storage spaces being configured to store the actual operating parameters;
the AR monitoring module is used for sending a parameter acquisition request and equipment identification information to the server unit; wherein the data storage space corresponds to the device identification information;
the communication unit is used for uploading the actual operation parameters to a data storage space corresponding to the target equipment;
the server unit is configured to receive the parameter obtaining request, obtain the actual operation parameter from the data storage space corresponding to the target device according to the device identification information, and send the actual operation parameter to the AR monitoring module.
4. A device monitoring system according to claim 3, wherein the device identification information comprises first identification information of a device to be displayed, and the actual operating parameter comprises a first operating parameter of the device to be displayed;
the AR monitoring module is further used for determining the equipment to be displayed, acquiring the first identification information, receiving the first operation parameters and displaying the first operation parameters through the virtual display units corresponding to the equipment to be displayed; the device to be displayed is the target device in a first visual field range.
5. The device monitoring system of claim 4, wherein the device identification information further comprises second identification information of a device to be loaded, and the actual operating parameters further comprise second operating parameters of the device to be loaded;
the AR monitoring module is further used for determining the equipment to be loaded, acquiring the second identification information and receiving a second operation parameter; the device to be loaded is the target device in a second visual field range, and the second visual field range is adjacent to the first visual field range.
6. The device monitoring system of claim 3, wherein the server unit is further configured to provide instruction storage space for the AR monitoring module to manipulate the target device;
the AR monitoring module further comprises virtual control units corresponding to different target devices, wherein the virtual control units are constructed in advance, and the AR monitoring module is used for responding to the triggering of the virtual control units, acquiring preset control instructions bound by the virtual control units, and uploading the device identification information corresponding to the virtual control units to the instruction storage space;
the server unit is used for sending a preset control instruction newly added in the instruction storage space to the communication unit;
the communication unit is used for receiving the preset control instruction and controlling the target equipment through the control module according to the preset control instruction.
7. The device monitoring system according to claim 3, wherein the communication unit is further configured to read the actual operation parameters according to a preset frequency, determine whether the actual operation parameters read in two adjacent times are the same, and if they are not the same, upload the actual operation parameters read currently to the data storage space to update the actual operation parameters;
the server unit is further configured to send the actual operation parameter to the AR monitoring module in response to the actual operation parameter update;
the AR monitoring module is further used for receiving the actual operation parameters and updating the actual operation parameters displayed by the virtual display unit.
8. A device monitoring system according to claim 3, wherein the server unit comprises an MQTT server.
9. The device monitoring system according to any one of claims 1 to 8, wherein the virtual display unit is further configured to display a virtual model corresponding to the target device constructed in advance, and change the virtual model according to the actual operation parameter;
and/or the number of the groups of groups,
the actual operation parameters correspond to register addresses in the control module;
the data forwarding module is used for reading the value of the register address to obtain the actual operation parameter and modifying the value of the register address to modify the actual operation parameter;
and/or the number of the groups of groups,
the target equipment comprises a motor, the control module comprises a PLC controller, a driver of the motor is electrically connected with the PLC controller, and the PLC controller is used for controlling the motor through the driver.
10. The device monitoring system of any of claims 1-8, wherein the AR monitoring module comprises an AR device.
CN202310655273.9A 2023-06-05 2023-06-05 Equipment monitoring system based on augmented reality Pending CN116880247A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310655273.9A CN116880247A (en) 2023-06-05 2023-06-05 Equipment monitoring system based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310655273.9A CN116880247A (en) 2023-06-05 2023-06-05 Equipment monitoring system based on augmented reality

Publications (1)

Publication Number Publication Date
CN116880247A true CN116880247A (en) 2023-10-13

Family

ID=88268721

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310655273.9A Pending CN116880247A (en) 2023-06-05 2023-06-05 Equipment monitoring system based on augmented reality

Country Status (1)

Country Link
CN (1) CN116880247A (en)

Similar Documents

Publication Publication Date Title
CN110795148B (en) Method and device for generating layout file and electronic equipment
US20190312747A1 (en) Method, apparatus and system for controlling home device
US9606550B2 (en) Streaming graphic method and arrangement for building control systems
CN113806425A (en) Web application interface visualization implementation method, system, equipment and application
CN111696216B (en) Three-dimensional augmented reality panorama fusion method and system
CN110796727A (en) Machine room remote panoramic monitoring method based on virtual reality technology
CN112929602B (en) Data monitoring method and device based on image processing and related equipment
JP6430079B1 (en) Monitoring system and monitoring method
CN112783064A (en) Building intelligent control three-dimensional model display method and related equipment
CN113744390A (en) Park-oriented visual intelligent management and control platform
CN110597078A (en) Equipment control implementation method, device, electronic equipment, storage medium and system
CN114978925B (en) Object model creation method and system
KR20230085389A (en) Apparatus and method for providing digital twin service using computer graphics
US10140111B2 (en) Streaming graphic method and arrangement data for building control systems
CN116880247A (en) Equipment monitoring system based on augmented reality
CN113536154B (en) Method for realizing man-machine interaction by applying mobile terminal to industrial Internet
CN116450092A (en) Multi-display terminal simulation data synchronization and interaction method and system
CN113253965B (en) Mass data multi-view-port visual interaction method, system, equipment and storage medium
CN115756472A (en) Cloud edge cooperative industrial equipment digital twin operation monitoring method and system
Guo et al. Design of remote real-time measuring system of temperature and humidity based on Raspberry Pi and Java language
CN111736539B (en) Monitoring data display method, device, system, server and storage medium
CN112802190B (en) Method and device for establishing meteorological observation field operation management model
CN115941744A (en) Remote control system of centralized management and control platform
CN114915647B (en) Front edge equipment remote interaction experience system based on micro-service
CN116546057A (en) Strong real-time data communication method for digital twin application

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination