CN116167739A

CN116167739A - Method and system for managing equipment

Info

Publication number: CN116167739A
Application number: CN202211594843.XA
Authority: CN
Inventors: 罗文盛; 邵永浩; 陈巳阳; 蒋超伟; 何楷; 彭晋; 王浩; 王鹏; 刘佳敏; 王来源; 施振; 张增; 吴彦亨; 滕永平; 李志刚; 唐长应; 马静; 王申
Original assignee: Super High Voltage Co Of State Grid Ningxia Electric Power Co ltd
Current assignee: Super High Voltage Co Of State Grid Ningxia Electric Power Co ltd
Priority date: 2022-12-13
Filing date: 2022-12-13
Publication date: 2023-05-26

Abstract

The invention provides a method and a system for equipment management, which are applied to AR (augmented reality) eyeglass ends, wherein the method comprises the following steps: creating an inspection task for the target equipment through a background management end; receiving and executing the checking task to obtain a checking result; monitoring motion data of a target AR glasses end for executing the checking task through the background management end; and determining the working state of the target equipment and the working state of the patrol personnel at the end of the target AR glasses according to the checking result and the motion data. Aiming at improving the inspection efficiency and the inspection result accuracy of equipment.

Description

Method and system for managing equipment

Technical Field

The invention relates to the technical field of equipment inspection, in particular to a method and a system for equipment management.

Background

At present, for a power equipment system, operation and maintenance work of power transformation equipment is required to be carried out according to a period. With the construction of new (expansion) power transmission and transformation projects, the transformer stations and the matched equipment are increasingly increased, and the problems of wide distribution area, remote distance, equipment impurity, difficult on-site operation and maintenance management, low efficiency and the like exist. The state perception degree of operation and maintenance work is not synchronously improved due to the lack of technical support, and the workload of operation and maintenance personnel is in a straight line rising trend mainly due to the fact that the operation and maintenance work is not supported by manpower, and in the traditional operation and maintenance work, the problems that inspection is complex, inspection results are inaccurate and the like exist.

Disclosure of Invention

In view of the above, the present invention provides a method and system for device management. Aiming at improving the inspection efficiency and the inspection result accuracy of equipment.

In a first aspect of an embodiment of the present invention, a method for device management is provided, applied to an AR glasses end, where the method includes:

creating an inspection task for the target equipment through a background management end;

receiving and executing the checking task to obtain a checking result;

monitoring motion data of a target AR glasses end for executing the checking task through the background management end;

and determining the working state of the target equipment and the working state of the patrol personnel at the end of the target AR glasses according to the checking result and the motion data.

Optionally, the creating, by the background management end, an inspection task for the target device includes:

determining each target device to be checked from a device list;

creating a list of items to be inspected, which each target device needs to execute;

according to the target devices and the created item list to be checked, creating an initial checking task for each target device;

determining an optimal inspection planning path according to the initial inspection task;

And creating inspection tasks for the target devices according to the optimal inspection planning path and the initial inspection tasks.

Optionally, in the process of receiving and executing the inspection task to obtain an inspection result, the method further includes:

receiving the inspection task;

identifying equipment to be inspected by receiving a target AR eyeglass end of the inspection task;

and when the equipment to be inspected is the target equipment, executing the inspection task to obtain an inspection result.

Optionally, the method further comprises:

obtaining visible light images and depth information of the position of the target equipment;

creating a 3D space of the target device according to the visible light image and the depth information;

and when a space interaction instruction of a user is received, acquiring the 3D space of the target equipment so as to perform space interaction between the user and the 3D space.

Optionally, the monitoring, by the background management end, the motion data of the target AR glasses end performing the inspection task includes:

monitoring positioning data of the target AR glasses end for executing the checking task in real time through the background management end;

and determining the motion trail, the motion duration and the working duration of the target AR glasses end according to the positioning data.

Optionally, determining, according to the motion data, a working state of an inspection person at the target AR glasses end includes:

when the motion trail of the target AR eyeglass end is inconsistent with the optimal inspection planning path, sending an alarm signal to the target AR eyeglass end and recording the alarm signal;

when the ratio of the preset motion duration of the target AR glasses end to the predicted motion duration corresponding to the motion track in the preset motion duration exceeds a first set threshold, sending an alarm signal to the target AR glasses end and recording the alarm signal;

and when the ratio of the working time length of the target AR eyeglass end to the planning working time length corresponding to the checking task is lower than a second set threshold value, sending an alarm signal to the target AR eyeglass end and recording the alarm signal.

Optionally, the method further comprises:

setting different virtual illuminations in a 3D space of the constructed target device;

and rendering the constructed 3D space of the target equipment according to different virtual illuminations arranged in the 3D space of the target equipment to obtain 3D images of the target equipment with different 3D illumination effects.

Optionally, the method further comprises:

requesting remote collaboration;

The remote collaboration staff obtains the 3D space of the target equipment and the video data of the target equipment through the terminal equipment and displays the video data in a video interface in real time;

the remote collaboration staff freeze and mark the video picture on the video interface, and call the whiteboard on the video interface to write and draw;

and the remote collaboration personnel control the screen to be shared to the target AR glasses end in real time.

Optionally, in case a temperature check of the target device is included in the checking task, the method further comprises:

temperature measurement is carried out on the target equipment, and a temperature measurement result is obtained;

displaying the temperature measurement result in a display picture, wherein the temperature measurement result at least comprises a highest temperature, the position of the highest temperature and the center temperature of the display picture;

and when the temperature in the temperature measurement result exceeds a preset temperature alarm threshold, alarm prompt is carried out.

Optionally, the measuring the temperature of the target device to obtain a temperature measurement result includes:

the mapping relation between the RGB camera and the infrared camera is obtained by carrying out coordinate transformation calibration on the RGB camera and the infrared camera;

measuring the temperature of a target scene through an infrared camera to obtain a temperature field of the target scene, and estimating the depth information of sparse 3D point clouds in RGB images of the target scene in real time through a depth fusion system of a vision and inertia measurement unit;

Determining the depth of each 3D point of the sparse 3D point cloud in the RGB image in the infrared image according to the mapping relation and the depth information of the sparse 3D point cloud in the RGB image;

and correcting the temperature field according to the depth of each 3D point and a preset temperature distance compensation model to obtain a temperature measurement result.

Optionally, the method further comprises:

generating an alarm signal according to the temperature measurement result and the duration of the highest temperature in the temperature measurement result;

and when the target AR eyeglass end is not positioned at the position of the target equipment, sending the alarm signal to the target AR eyeglass end and the background management end.

Optionally, the generating an alarm signal according to the temperature measurement result and the duration of the highest temperature in the temperature measurement result includes:

generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is in a first preset range and lasts for a first preset duration;

and generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is higher than the first preset temperature and lasts for a second preset time period.

In a second aspect of the embodiments of the present invention, there is provided a system for device management, the system comprising:

The background management end is used for creating an inspection task for the target equipment;

the AR glasses end is used for receiving and executing the checking task so as to obtain a checking result;

the background management end is also used for monitoring the motion data of the target AR glasses end for executing the checking task;

and the state determining module is used for determining the working state of the target equipment and the working state of the patrol personnel at the target AR glasses end according to the checking result and the motion data.

Aiming at the prior art, the invention has the following advantages:

according to the device management method provided by the embodiment of the invention, the background management end and the AR glasses end are introduced to implement the device management inspection work, the background management end is used for creating the inspection task of the target device, the created inspection task aiming at the target device is sent to the corresponding AR glasses end, the AR glasses end receiving the inspection task is the target AR glasses end, the target AR glasses end receives and executes the inspection task to obtain an inspection result, and the background management end is used for monitoring the motion data of the target AR glasses end executing the inspection task so as to monitor the inspection personnel who carry out the inspection task through the target AR glasses end, so that the working state of the target device can be inspected, and the working state of the inspection personnel can be monitored through the target AR glasses end. According to the equipment management method, the background management end and the AR glasses end are introduced to conduct the equipment management inspection work, the AR glasses end participates in the inspection of the target equipment more accurately, and the inspection personnel cannot easily modify the motion data due to the closed mobile terminal of the AR glasses end, so that the background management end can monitor the inspection work of the inspection personnel more conveniently and accurately, and the inspection personnel is prevented from performing false inspection.

The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

FIG. 1 is a flow chart of a method for device management according to an embodiment of the present invention;

fig. 2 is a flow chart of a method for device management according to an embodiment of the present invention;

FIG. 3 is another flow chart of a method for device management according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a system for device management according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings.

Fig. 1 is a flowchart of a method for device management according to an embodiment of the present invention, as shown in fig. 1, where the method includes:

step S101: creating an inspection task for the target equipment through a background management end;

Step S102: receiving and executing the checking task to obtain a checking result;

step S103: monitoring motion data of a target AR glasses end for executing the checking task through the background management end;

step S104: and determining the working state of the target equipment and the working state of the patrol personnel at the end of the target AR glasses according to the checking result and the motion data.

In the embodiment of the invention, the target equipment to be checked is determined from all the equipment, and the checking task of the target equipment is established by the background management end aiming at the target equipment. The target device may include one or a plurality of target devices.

After the background management end creates the checking task of the target equipment, determining an AR eyeglass end which does not execute any checking task from all AR eyeglass ends, designating the target AR eyeglass end which is used for executing the checking task from the AR eyeglass end which does not execute any checking task, and sending the created checking task of the target equipment to the target AR eyeglass end. The target AR glasses end may include one or a plurality of target AR glasses ends.

After the target AR eyeglass receives the detection task of the target equipment which is established by the background management end, the inspection task is carried by the inspection personnel to be executed by the target AR eyeglass end so as to obtain an inspection result, and therefore the working state of the target equipment is monitored. One inspection person carries one target AR glasses end, and one inspection task can correspond to a plurality of target AR glasses ends so that the plurality of inspection persons can execute the created inspection task.

Meanwhile, in the process that the patrol personnel execute the patrol task through the target AR glasses, the background management end monitors and acquires the motion data of the target AR glasses for executing the patrol task in real time so as to determine the working state of the patrol personnel in the patrol process, and meanwhile, when the patrol personnel encounters emergency rescue, the current position of the patrol personnel can be determined through the motion data acquired by the background management end, and rescue is carried out on the patrol personnel in time.

In the invention, the creating the checking task of the target device through the background management end comprises the following steps: determining each target device to be checked from a device list; creating a list of items to be inspected, which each target device needs to execute; according to the target devices and the created item list to be checked, creating an initial checking task for each target device; determining an optimal inspection planning path according to the initial inspection task; and creating inspection tasks for the target devices according to the optimal inspection planning path and the initial inspection tasks.

In the embodiment of the invention, the creation of the inspection task for the target device through the background management end specifically comprises the following steps: creating a device list, and recording the devices which need to be inspected or checked into the device list. A total inspection item list is created, and various types of inspection items are entered into the total inspection item list, such as a temperature inspection item for temperature inspection of the target device, a pressure inspection item for pressure inspection of the target device, and the like. The executor performing the inspection task is entered.

When the equipment inspection or examination is required by the inspector, each target equipment which is required to be inspected or examined is firstly determined, and then each target equipment which is required to be inspected or examined is determined from the equipment list. After each target device to be inspected or inspected is determined, for each target device, an inspection item to be executed by each target device is determined from the total inspection item list. Since there may be a plurality of inspection items to be inspected at one target device at the same time, after determining each inspection item to be executed by each target device, a list of the inspection items to be executed by each target device is created, and the list of the inspection items to be inspected includes at least one type of inspection item. A total initial inspection task is generated based on the respective target devices and the respective lists of items to be inspected that the respective target devices are required to perform.

The invention can monitor the working state of the patrol personnel through the target AR glasses, so that in order to facilitate the follow-up monitoring of the working state of the patrol personnel accurately, the invention plans an optimal patrol path for the total initial inspection task in advance, and generates an inspection task for each target device according to the planned patrol path and the total initial inspection task. The inspection task comprises not only all target devices needing to be inspected and respective item lists to be inspected, which are required to be executed by all target devices, but also the optimal inspection path of the inspection task. The inspector needs to perform the inspection task along the optimal inspection path.

Wherein, in order to prevent the error setting of the inspection items, each inspection item is associated with the equipment, and when the equipment cannot perform the inspection of the related inspection item, the related inspection item cannot be created for the equipment. For example, with a data transmission relay apparatus, a possible test is an inspection item related to data transmission, and inspection of a pressure inspection item cannot be performed, so that when a target apparatus is a data transmission relay apparatus, inspection of a pressure inspection item cannot be created for the target apparatus. To prevent incorrect setting of inspection items, another embodiment of the present invention is: and creating a checking item list which can be executed for each device, wherein when the device needs to be checked, checking items can only be selected from the checking item list corresponding to the device to construct a checking item list of the device to be checked, and checking items which do not exist in the checking item list of the device cannot be constructed.

In the process of receiving and executing the inspection task to obtain an inspection result, the method further comprises: receiving the inspection task; identifying equipment to be inspected by receiving a target AR eyeglass end of the inspection task; and when the equipment to be inspected is the target equipment, executing the inspection task to obtain an inspection result.

In the embodiment of the invention, as a plurality of devices exist in an area in the actual use process, in order to prevent an inspector from detecting wrong devices and facilitate the inspector to execute inspection tasks, the invention scans and identifies the identification code of the device to be inspected through the target AR eyeglass end when the inspector executes the inspection tasks through the target AR eyeglass end, and pops up the device information of the device to be inspected when the identification code of the device to be inspected is used for determining that the device to be inspected belongs to the target device in the inspection tasks, so that the inspector can inspect the device to be inspected based on the item list to be inspected of the device to be inspected and the device information of the device to be inspected in the inspection tasks, and a corresponding inspection result is obtained. When the identification code of the equipment to be inspected is used for determining that the equipment to be inspected does not belong to the target equipment in the inspection task, the inspection personnel is warned through the target AR glasses end so as to prompt the inspection personnel that the equipment to be inspected does not belong to the target equipment in the inspection task, and prompt the inspection personnel to search the target equipment in the inspection task for inspection. The equipment information comprises equipment brief introduction, equipment notice, equipment inspection operation description and the like, so that the patrol personnel does not need to additionally record too much information, and is convenient for the patrol personnel to execute the patrol task. After the AR glasses end scans the device to identify the device and obtain the device information, historical inspection data, inspection notes, PDF files and the like can also be obtained for the device.

In the present invention, the method further comprises: obtaining visible light images and depth information of the position of the target equipment; creating a 3D space of the target device according to the visible light image and the depth information; and when a space interaction instruction of a user is received, acquiring the 3D space of the target equipment so as to perform space interaction between the user and the 3D space.

In the embodiments of the present invention, since the patrol personnel generally do not have complete technical capabilities, assistance from remote technicians is often sought during the patrol process. Therefore, in order to enable the remote technician to know the current state of the target equipment more clearly when the patrol inspector seeks assistance of the remote technician, the invention creates a 3D space for the target equipment through the target AR glasses end.

Specifically, the visible light image and depth information of the position of the target device are acquired through the target AR glasses end. According to the obtained visible light image and depth information, calculating through a preset algorithm to obtain three-dimensional space point cloud data of a scene where the target equipment is located, and according to the obtained three-dimensional space point cloud data, carrying out three-dimensional reconstruction on the scene where the target equipment is located to generate a three-dimensional geometric model of the target equipment, thereby constructing a 3D space for obtaining the target equipment, and storing the 3D space to a background management end. After the patrol personnel seek the assistance of the remote technical personnel, the terminal where the remote technical personnel is connected with the target AR glasses end held by the patrol personnel, and the video data acquired by the target AR glasses end in real time and the 3D space of the target equipment constructed by the visible light images and the depth information acquired by the target AR glasses end are acquired. And the remote technician sends a space interaction instruction to the background management end through the terminal equipment so as to carry out space interaction on the 3D space of the target equipment. Wherein the spatial interaction includes moving, scaling, rotating, deleting, etc., the target device within the 3D space of the target device to enable a remote technician to more carefully see the current state of the target device.

In the embodiment of the invention, the process of obtaining the visible light image and the depth information of the position of the target device further comprises the step of performing depth consistency check on the depth of the visible light image. Specific depth consistency checks include: projecting a point p in the visible light image to a world coordinate system and back projecting the point p to a corresponding neighborhood frame N _k On the above, depth values d (X, N) _k ) The depth value is compared with the neighborhood frame N _k Depth lambda (X, N) _k ) And comparing, wherein if the depth value of the p point is compared with the depth values of at least k neighborhood frames, the comparison results all accord with the formula 1, and the p point is determined to be a correct point.

However, the virtual object is provided in the consistency module, and the length and width of the virtual object are not fixed, but the aspect ratio of the image shot by the camera is fixed. In comparison, the virtual object is shown in the picture shot by the camera, the position of the virtual object can be the most middle, or can be at any position, and finally, whether the projection of the point p under the world coordinate system is completely covered in the virtual object or not is compared, or the number of the points p with preset proportion is in the virtual object is judged to be consistent. In addition, the shape of the virtual object is not a conventional shape, and can also be trapezoid or diamond so as to meet the requirement of the depth view.

If the inequality is not satisfied, the depth information is acquired again, and the depth information is an important factor for constructing the three-dimensional scene until the inequality is satisfied, and only if the depth information of each point is accurate, the three-dimensional space point cloud data of the scene can be established. For example, the data of each point in the depth direction of the three-dimensional space, the position of the object in the photographed image, the influence on the depth of the three-dimensional space, and the like.

In the present invention, the monitoring, by the background management end, the motion data of the target AR glasses end performing the inspection task includes: monitoring positioning data of the target AR glasses end for executing the checking task in real time through the background management end; and determining the motion trail, the motion duration and the working duration of the target AR glasses end according to the positioning data.

In an embodiment of the present invention, the monitoring, by the background management end, the motion data of the target AR glasses end performing the inspection task specifically includes: the method comprises the steps of monitoring positioning data of a target AR (augmented reality) eyeglass end for executing an inspection task in real time through a background management end, and determining a motion track, a motion duration and a working duration of the target AR eyeglass end through analyzing the positioning data. The working time of the target AR eyeglass end represents the time spent by the target AR eyeglass end in the time period of reaching the position of the target equipment to check the target equipment, and the working time does not comprise the time spent by the target AR eyeglass end in the moving process. Compared with mobile terminal equipment such as mobile phones, the closed system of the AR glasses end greatly reduces the possibility of tampering the motion data, so that the acquired motion data are more accurate.

In the invention, determining the working state of the patrol personnel at the target AR glasses end according to the motion data comprises the following steps: when the motion trail of the target AR eyeglass end is inconsistent with the optimal inspection planning path, sending an alarm signal to the target AR eyeglass end and recording the alarm signal; when the ratio of the preset motion duration of the target AR glasses end to the predicted motion duration corresponding to the motion track in the preset motion duration exceeds a first set threshold, sending an alarm signal to the target AR glasses end and recording the alarm signal; and when the ratio of the working time length of the target AR eyeglass end to the planning working time length corresponding to the checking task is lower than a second set threshold value, sending an alarm signal to the target AR eyeglass end and recording the alarm signal.

In the embodiment of the invention, the determined movement track of the target AR glasses end is compared with the optimal checking planning path in the checking task, when the deviation distance between the movement track of the target AR glasses end and the optimal checking planning path exceeds the set distance, the movement track of the target AR glasses end is determined to be inconsistent with the optimal checking planning path, so that the patrol personnel is prevented from deviating from the optimal checking planning path to be dangerous, meanwhile, the patrol personnel is prevented from intentionally or unintentionally checking some target equipment to cause the abnormality of the target equipment, and an alarm signal is sent to the target AR glasses end and recorded in a background management end. The background management end acquires the alarm signal and then sends the alarm signal to the AR glasses end, namely the AR glasses end has an abnormal condition alarm function, supports the butt joint of the video monitoring system and the early warning system, provides abnormal alarm information reminding for operation and maintenance personnel, and achieves rapid response of fault conditions.

In the embodiment of the invention, the motion trail in the range of the preset motion duration is acquired at intervals of the preset motion duration. According to the motion trail, predicting the predicted motion duration required by the patrol personnel, comparing the preset motion duration with the predicted motion duration, sending an alarm signal to the target AR eyeglass end when the ratio of the preset motion duration of the target AR eyeglass end to the predicted motion duration corresponding to the motion trail in the preset motion duration exceeds a first set threshold so as to prevent the patrol personnel from being out of work negatively, and sending an alarm signal to a background management end so as to prevent the patrol personnel from encountering emergency and failing to send a distress signal, and enabling a remote technician to timely confirm abnormality to the patrol personnel where the target AR eyeglass end is located so as to confirm whether the patrol personnel encounters the emergency or not, and timely organizing rescue when no response exists. The preset motion duration may be set according to an actual application scenario, which is not specifically limited herein, and the first setting threshold may also be set according to an actual application scenario, which is not specifically limited herein. For example, a first set threshold value is preset to be 2, the motion trail of the patrol personnel is a motion trail a within 30 seconds, the predicted time required by the patrol personnel to move along the motion trail is obtained by analyzing and processing the motion trail, if the ratio of the motion trail to the patrol personnel is 3, the motion trail to the patrol personnel exceeds the first set threshold value to be 2, and at the moment, an alarm signal is sent to a target AR (augmented reality) eyeglass end and an alarm signal is sent to a background management end.

In the embodiment of the invention, the checking task further comprises the planning working time length of the item list to be checked aiming at the single target device. When the target AR eyeglass end checks for a single target device, and the ratio between the spent working time length and the planning working time length of the single target device is lower than a second set threshold value, determining that the patrol personnel has the possibility of negative idle work, sending an alarm signal to the target AR eyeglass end, and recording the alarm signal in a background management end. For example, the second set threshold is preset to be 0.5, the planning working time for checking the target device 1 is 5 minutes, the working time for checking the target device 1 by the inspection staff is 2 minutes, the ratio of the two is 0.4 and is lower than the second set threshold, an alarm signal is sent to the target AR glasses end, and the alarm signal is recorded in the background management end. The second setting threshold may be set according to an actual application scenario, which is not specifically limited herein.

In the present invention, the method further comprises: setting different virtual illuminations in a 3D space of the constructed target device; and rendering the constructed 3D space of the target equipment according to different virtual illuminations arranged in the 3D space of the target equipment to obtain 3D images of the target equipment with different 3D illumination effects.

In the embodiment of the invention, in order to enable a remote technician to more clearly see the target equipment, different virtual illuminations are arranged in a 3D space for constructing the target equipment, so that the remote technician can see the state of the target equipment in an omnibearing manner when rotating, moving and scaling the 3D model of the target equipment. And rendering the constructed 3D space of the target equipment according to different virtual illuminations arranged in the 3D space of the target equipment to obtain 3D images of the target equipment with different 3D illumination effects. The method and the device solve the problem that the existing mobile terminal cannot preview or save the shadow effect images generated by different 3D illumination under the condition of not changing the physical scene, and improve the user experience.

In the embodiment of the present invention, as an preference, the AR glasses end may use a dual camera with the same structure and parameters, and obtain depth information of the scene in a multi-view stereo matching manner. In another preferred embodiment, the AR glasses end may also use infrared light, structured light, TOF (Time of flight) with higher computation performance to obtain depth information of the scene.

In the embodiment of the invention, besides obtaining the visible light image and depth information of the scene where the target device is located, 3D identification can be performed on the target device of the current entity, and corresponding contents such as pictures, videos, PDF files and the like are placed in the space where the target device is located, so that a device AR operation and maintenance space (namely the 3D space of the target device) with a plurality of fusion objects is constructed together. After the construction is completed, the operation and maintenance personnel can recognize and wake up the AR operation and maintenance space in the corresponding equipment environment through the AR equipment at any subsequent time. The AR display content stored in the 3D space can be subjected to space interaction operations such as deletion, movement, scaling, rotation and the like, so that flexible processing of the information display content in the equipment operation and maintenance space is met, presentation of the information data content is better realized, and operation and maintenance work is enabled.

For the format of the AR display content reserved in the 3D space, besides the line graph, the column graph, the cake graph, the scatter graph and other general data charts, the data interface is supported for realizing the dynamic refreshing and display of the data content, and the user is allowed to expand the data display mode of the corresponding type according to the set rule.

In the present invention, the method further comprises: requesting remote collaboration; the remote collaboration staff obtains the 3D space of the target equipment and the video data of the target equipment through the terminal equipment and displays the video data in a video interface in real time; the remote collaboration staff freeze and mark the video picture on the video interface, and call the whiteboard on the video interface to write and draw; and the remote collaboration personnel control the screen to be shared to the target AR glasses end in real time.

In the embodiment of the invention, when the patrol personnel seek technical support of the remote technical personnel, in order to facilitate communication between the remote technical personnel and the patrol personnel, the invention further comprises: the method comprises the steps that a patrol personnel sends a request remote collaboration request to a background management end through a target AR (augmented reality) eyeglass end, a background server sends the remote collaboration request to terminal equipment where the remote collaboration personnel are located after receiving the remote collaboration request, and 3D space of the target equipment and video data of the target equipment, which are acquired in real time through target AR eye segments, are acquired through the terminal equipment and are displayed in a video interface of the terminal equipment. The remote technician can switch back and forth between the 3D space of the target equipment and the video data of the target equipment, which are acquired by the target AR eye segments in real time, so that the current state of the target equipment can be known more clearly, and in order to facilitate communication with the patrol personnel, the remote cooperator can freeze and mark video pictures in a video interface, call a whiteboard on the video interface to write and draw, and share the content marked by the frozen screen of the remote technician and the content written and drawn on the whiteboard to the target AR eye end, thereby facilitating communication between the remote technician and the patrol personnel.

In the embodiment of the invention, the remote collaborators can also make labels on the 3D space of the target device and store the label records. Specifically, an AR 3D labeling means based on a visual positioning SLAM technology can be adopted, an expert can conduct AR guidance based on space on a live real-time picture, and a guidance result is synchronously displayed in the field of view of a live person. And after the assistance is finished, the system support can return to the scene scanned before to reproduce the AR annotation before through the annotation reproduction function. The method supports millisecond-level AR annotation scene restoration on different model devices, and supports increment storage and multi-scene fusion. Real-time temperature measurement can also be carried out on the equipment through the AR glasses end, and the highest temperature in the current picture is displayed according to the video picture.

In the present invention, in the case that the temperature check of the target device is included in the check task, the method further includes: temperature measurement is carried out on the target equipment, and a temperature measurement result is obtained; displaying the temperature measurement result in a display picture, wherein the temperature measurement result at least comprises a highest temperature, the position of the highest temperature and the center temperature of the display picture; and when the temperature in the temperature measurement result exceeds a preset temperature alarm threshold, alarm prompt is carried out.

In an embodiment of the present invention, when the inspection task for the target device includes temperature inspection for the target device, the method for device management provided by the present invention further includes: and (3) measuring the temperature of the target equipment to obtain a temperature measurement result, and combining the temperature measurement result with a display picture of the target AR glasses end so as to display the measured temperature at each position in the display picture. Wherein the measured temperature displayed in the display screen includes at least a maximum temperature in the display screen and a position of the maximum temperature in the video screen, and a center temperature of the display screen. And when the temperature in the temperature measurement result exceeds a preset temperature alarm threshold, alarming is carried out through the target AR glasses end. The temperature measurement picture comprises an infrared interface and an RGB interface, and the infrared interface is used for displaying different colors according to the temperature. The RGB interface then displays the actual picture of the device.

The preset temperature alarm threshold may be set correspondingly according to the target device, which is not limited herein. In the temperature measurement process, a temperature measurement video can be recorded, a record file is formed, and a calibration error can be set in the temperature measurement process, so that the temperature measurement process is adjusted by modifying the percentage.

In the present invention, the step of measuring the temperature of the target device to obtain a temperature measurement result includes: the mapping relation between the RGB camera and the infrared camera is obtained by carrying out coordinate transformation calibration on the RGB camera and the infrared camera; measuring the temperature of a target scene through an infrared camera to obtain a temperature field of the target scene, and estimating the depth information of sparse 3D point clouds in RGB images of the target scene in real time through a depth fusion system of a vision and inertia measurement unit; determining the depth of each 3D point of the sparse 3D point cloud in the RGB image in the infrared image according to the mapping relation and the depth information of the sparse 3D point cloud in the RGB image; and correcting the temperature field according to the depth of each 3D point and a preset temperature distance compensation model to obtain a temperature measurement result.

In the embodiment of the invention, the real-time temperature measurement can be performed on the target scene besides the real-time temperature measurement on the target equipment. The invention provides a distance compensation method for infrared temperature measurement based on vision and IMU depth fusion real-time distance measurement. The infrared thermal imaging technology is a technology that an infrared camera receives infrared radiation emitted by a measured target positioned at a certain distance and then a signal processing system converts the infrared radiation into a video thermal image of the target. The infrared thermal imaging temperature measurement technology is widely applied due to the characteristics of non-contact, high speed, no damage to the temperature field of the measured object and the like. Distance is a critical factor in temperature measurement. First, the molecular particles in the atmosphere can absorb infrared radiation, so that the far the infrared camera is away from a target object, the greater the attenuation of the infrared radiation in the atmosphere is, and the greater the influence on the temperature measurement accuracy is. And secondly, as the distance is increased, the relative field area of the same object is reduced, so that the quality of the output signal of the infrared camera is reduced, and the temperature measurement accuracy is affected.

The method specifically comprises three stages of preparation work, system initialization and an actual measurement process, wherein the actual measurement process is used for measuring the temperature of each frame of image once, and the real-time completion can be realized because the operation amount is not large.

The preparation work comprises the following steps: setting an initial blackbody temperature, measuring the measured temperature at different distances from the blackbody by an infrared camera, and recording the actual temperature at different distances to obtain a temperature distance meter; the interval distance is set to be 1 decimeter, and the blackbody temperature interval is set to be 1 degree; performing data fitting on the temperature distance table by adopting a least square method to obtain a temperature distance compensation model; and calibrating coordinate transformation between the RGB camera and the infrared camera to obtain a mapping relation between the RGB camera and the infrared camera.

The system initialization includes: and initializing a depth fusion system of the vision and inertia measurement unit, and obtaining the scale information of the system according to the scale information of the inertia measurement unit.

The actual measurements include: measuring the temperature of a target scene where target equipment is located through an infrared camera to obtain a temperature field of the target scene; the depth information of sparse 3D point cloud in RGB images of a target scene is estimated in real time by utilizing a depth fusion system of a vision and inertia measurement unit, and the depth fusion system of the vision and inertia measurement unit can be based on multi-state limiting extended Kalman filtering and also can be based on a nonlinear optimized vision inertial navigation odometer; according to the mapping relation between the RGB camera and the infrared camera, the corresponding positions of all 3D points in the sparse 3D point cloud in the RGB image in the infrared image are obtained, and therefore the depth of all 3D points in the sparse 3D point cloud in the RGB image in the infrared image is obtained; and correcting the temperature of the temperature field by utilizing the depth of each 3D point according to the temperature distance compensation model. Since this 3D point cloud is a sparse point cloud, it is necessary to interpolate the distance values of most 3D points with depth information of nearby 3D points.

In the present invention, the method further comprises: generating an alarm signal according to the temperature measurement result and the duration of the highest temperature in the temperature measurement result; and when the target AR eyeglass end is not positioned at the position of the target equipment, sending the alarm signal to the target AR eyeglass end and the background management end.

In the embodiment of the invention, in order to improve the generation accuracy of the alarm signal, the alarm signal is generated according to the difference of the temperature measurement result and the difference of the duration time, and when the target AR eyeglass end is not positioned at the position of the target equipment, the alarm signal is sent to the target AR eyeglass end and the background management end so as to prompt the patrol personnel and the far-end technician that the working state of the target equipment is abnormal and warn the related staff to go to the process in time. The temperature measurement result can be obtained by a sensor around the target equipment or by the target AR glasses end.

In the invention, the generating an alarm signal according to the temperature measurement result and the duration of the highest temperature in the temperature measurement result comprises the following steps: generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is in a first preset range and lasts for a first preset duration; and generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is higher than the first preset temperature and lasts for a second preset time period.

In an embodiment of the present invention, according to the temperature measurement result and the duration of the highest temperature in the temperature measurement result, one implementation manner of generating the alarm signal is: and generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is in the first preset range and lasts for a first preset duration. And generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is higher than the first preset temperature and lasts for a second preset time period.

For example, when the abnormal operating temperature of the target device is preset to be 150 ℃ and the extremely abnormal operating temperature is preset to be 200 ℃, and the operating temperature of the target device is displayed to be between 150 ℃ and 200 ℃ in the temperature measurement result of the target device, and the first preset duration is continued, a corresponding alarm signal is generated. And when the working temperature of the target equipment is displayed to be more than 200 ℃ in the temperature measurement result of the target equipment and the second preset time duration is continued, a corresponding alarm signal is generated. The second preset time period is smaller than the first preset time period.

In the embodiment of the invention, the AR glasses terminal and the background management terminal are connected in an unlimited amount, a user list for logging in an application platform of the AR glasses terminal is arranged at the background management terminal, and role setting and authority setting are carried out on each user. The background management end adds device information for each device in the created device list. While the inspection results include inspection results based on a single target device and total inspection results based on inspection tasks for ease of management of inspection results of inspection tasks. The checking result comprises checking event details, checking event occurrence time, a executive of the checking event and log data recorded by the executive. The inspection tasks comprise a daily inspection task, a patrol inspection task and a burst inspection task.

In the embodiment of the present invention, one implementation manner of setting, by the background management end, a user list of an application platform for logging in to the AR glasses end is: inquiring a user account list at the background management end, creating a user account, resetting a user password, editing user information and deleting the user account; inquiring a role list, creating a role, editing role authorities and deleting the role at the background management end; each user account corresponds to one or more roles.

In the embodiment of the invention, after a user logs in a background management end, the interface displays the name of a power station corresponding to the current user account, each power station is correspondingly provided with a plurality of devices, the devices are subjected to device information management and inspection item management, an inspection task is created by inputting the device information of target devices and the item list to be inspected, and finally, the information of each target device and the item list to be inspected, which are included in the inspection task, can be displayed through AR (augmented reality) glasses, so that the visual display of the device information of the target devices by inspection staff is ensured. The device information includes a device profile, device notes, and device inspection operation instructions. The target equipment to be inspected can be additionally added through input equipment codes, equipment names, equipment areas, equipment standard parameters, inspection requirements and other parameters. The inspection items of the target device may also be edited and added.

For an inspection task, task details of the inspection task may be viewed. The task details include the task type (daily task/patrol task/burst task), start time, end time, executor, hydropower station name, equipment number, inspection result, inspection record, and the like. The task details of the inspection task can also be shared with the relevant personnel who need to view without permission. For the inspection task in the inspection tasks, the inspection tasks can be added, including designating an executor, adding one or more target devices, and adding a specific inspection item for each target device, wherein the inspection item is the content in the edited inspection item list of each device. For burst tasks in the inspection tasks, a patrol task can be quickly generated for a certain device and timely issued to the AR glasses end. The task adding process includes designating an executor, adding one or more devices, adding a specific inspection item for each device.

In an embodiment of the present invention, as shown in fig. 2, the present invention provides an embodiment of an inspection process for inspecting daily tasks in tasks, including the steps of:

(1) The user wears AR glasses, logs in the application platform, and selects daily tasks.

(2) The user scans and identifies the equipment identification code through the camera at the head-wearing end of the AR glasses.

(3) After the identification is successful, the display equipment checks the interface.

(4) The user may choose to take a picture of the device, view a profile of the device, notice of the device, instructions for checking the device, etc.

(5) Remote assistance can be started at any time, and an assistance request is initiated to a remote expert.

(6) Submitting the device inspection result.

In an embodiment of the present invention, as shown in fig. 3, the present invention provides an embodiment of an inspection process for inspecting a patrol task/burst task in a task, including the following steps:

(1) The user wears AR glasses, logs in the application platform, and selects a patrol task or a burst task.

(2) And entering a task list, and selecting the name of the equipment to be checked.

(3) The user scans and identifies the equipment identification code through the camera at the head-wearing end of the AR glasses.

(4) After the identification is successful, the display equipment checks the interface.

(5) The user may choose to take a picture of the device, view a profile of the device, notice of the device, instructions for checking the device, etc.

(6) Remote assistance can be started at any time, and an assistance request is initiated to a remote expert.

(7) Submitting the device inspection result.

In the embodiment of the invention, for the alarm function, the invention also provides a preferred embodiment, wherein the motion trail of the personnel is recorded in the operation process, the automatic timing of the operation time of the operation and maintenance operation is supported, and when the motion estimation of the personnel in a preset time is recognized as an abnormal route, an alarm is sent out.

For example, the preset time is set to be half an hour, and the movement track of the staff is set to be from device 1 to device 2 to device 3 to device 4 in the present task. When the worker wears the AR glasses to carry out inspection or other works on the equipment, the movement track of the worker is positioned to be that the equipment 1 directly goes to the equipment 3 without going through the equipment 2, and the inspection work of the equipment 2 is ignored for more than half an hour, and then the alarm is given to the background management end and the AR glasses end.

The method for managing the equipment provided by the invention has the following advantages: checking the operation flow by adopting AR glasses standard equipment, realizing the issuing and receiving processing of tasks, and outputting and displaying the contents of each part in the operation and maintenance inspection process; the key information, the historical inspection record, the digital detection result, the standard operation flow, the reinforced working requirement and the like of each piece of equipment can be intuitively and effectively displayed in the inspection work through an AR visual enhancement technology. During remote assistance, a technical expert can see the picture on site clearly through the first visual angle, and on-site personnel can be guided to conduct fault location remotely based on modes of audio-video interaction, AR (augmented reality) tags, desktop sharing, picture real-time labeling and the like, so that remote assistance efficiency and accuracy are improved. When the live detection work is carried out, on one hand, the current test data can be checked and automatically recorded in real time through the AR technology, and on the other hand, the historical data can be conveniently retrieved, the data comparison analysis is carried out, and the detection report is automatically generated. The device can also realize accurate infrared temperature measurement based on the AR intelligent glasses.

A second aspect of the present invention provides a system for device management, as shown in fig. 4, the system 400 includes:

a background management end 401, configured to create an inspection task for a target device;

an AR glasses end 402, configured to receive and execute the inspection task to obtain an inspection result;

the background management end 401 is further configured to monitor motion data of a target AR glasses end that performs the inspection task;

and the state determining module 402 is configured to determine, according to the inspection result and the motion data, a working state of the target device and a working state of an inspection person at the end of the target AR glasses.

Optionally, the background management end includes:

a target device determining module, configured to determine each target device that needs to be checked from the device list;

the to-be-inspected item list creation module is used for creating to-be-inspected item lists which are required to be executed by each target device;

the initial inspection task creation module is used for creating initial inspection tasks for all target devices according to the target devices and the item list to be inspected, which needs to be executed by the created target devices;

the optimal inspection planning path determining module is used for determining an optimal inspection planning path according to the initial inspection task;

And the checking task creation module is used for creating checking tasks for each target device according to the optimal checking planning path and the initial checking task.

Optionally, the AR spectacle side comprises:

the checking task receiving module is used for receiving the checking task;

the equipment to be inspected identification module is used for identifying equipment to be inspected through the target AR glasses end for receiving the inspection task;

and the checking task execution module is used for executing the checking task when the equipment to be checked is the target equipment so as to obtain a checking result.

Optionally, the system further comprises:

the image information acquisition module is used for acquiring a visible light image and depth information of the position of the target equipment;

a 3D space creating module, configured to create a 3D space of the target device according to the visible light image and the depth information;

and the interaction module is used for acquiring the 3D space of the target equipment when receiving the space interaction instruction of the user so as to perform space interaction between the user and the 3D space.

Optionally, the background management end includes:

the positioning data acquisition module is used for monitoring the positioning data of the target AR glasses end for executing the checking task in real time through the background management end;

And the positioning data analysis module is used for determining the movement track, the movement duration and the working duration of the target AR glasses end according to the positioning data.

Optionally, the state determining module includes:

the first alarm signal sending module is used for sending an alarm signal to the target AR glasses end and recording the alarm signal when the motion trail of the target AR glasses end is inconsistent with the optimal inspection planning path;

the second alarm signal sending module is used for sending an alarm signal to the target AR glasses end and recording the alarm signal when the ratio of the preset motion duration of the target AR glasses end to the predicted motion duration corresponding to the motion trail in the preset motion duration exceeds a first set threshold;

and the third alarm signal sending module is used for sending an alarm signal to the target AR glasses end and recording the alarm signal when the ratio of the working time length of the target AR glasses end to the planning working time length corresponding to the checking task is lower than a second set threshold value.

Optionally, the system further comprises:

the virtual illumination setting module is used for setting different virtual illuminations in the 3D space of the constructed target device;

And the rendering module is used for rendering the constructed 3D space of the target equipment according to different virtual illumination arranged in the 3D space of the target equipment to obtain 3D images of the target equipment with different 3D illumination effects.

Optionally, the system further comprises:

the remote collaboration request module is used for requesting remote collaboration;

the video data display module is used for acquiring the 3D space of the target equipment and the video data of the target equipment by a remote collaboration staff through the terminal equipment and displaying the video data in a video interface in real time;

the display module is used for enabling remote collaboration personnel to freeze and mark video pictures on the video interface, and calling a whiteboard on the video interface to write and draw;

and the real-time sharing module is used for controlling the screen to be shared to the target AR glasses end in real time by the remote collaboration personnel.

Optionally, the system further comprises:

the temperature measuring module is used for measuring the temperature of the target equipment and obtaining a temperature measuring result;

the temperature measurement result display module is used for displaying the temperature measurement result in a display picture, wherein the temperature measurement result at least comprises a highest temperature, the position of the highest temperature and the center temperature of the display picture;

And the temperature measurement result alarm module is used for carrying out alarm prompt when the temperature in the temperature measurement result exceeds a preset temperature alarm threshold value.

Optionally, the temperature measurement module includes:

the coordinate calibration module is used for carrying out coordinate transformation calibration on the RGB camera and the infrared camera to obtain a mapping relation between the RGB camera and the infrared camera;

the temperature and depth measurement module is used for measuring the temperature of the target scene through the infrared camera to obtain a temperature field of the target scene, and estimating the depth information of sparse 3D point clouds in the RGB image of the target scene in real time through a depth fusion system of the vision and inertia measurement unit;

the depth determining module is used for determining the depth of each 3D point of the sparse 3D point cloud in the RGB image in the infrared image according to the mapping relation and the depth information of the sparse 3D point cloud in the RGB image;

and the temperature correction module is used for correcting the temperature field according to the depth of each 3D point and a preset temperature distance compensation model to obtain a temperature measurement result.

Optionally, the system further comprises:

the alarm signal generation module is used for generating an alarm signal according to the temperature measurement result and the duration of the highest temperature in the temperature measurement result;

And the alarm signal sending module is used for sending the alarm signal to the target AR eyeglass end and the background management end when the target AR eyeglass end is not positioned at the position of the target equipment.

Optionally, the alarm signal generating module includes:

the first alarm signal generation module is used for generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is in a first preset range and lasts for a first preset duration;

and the second alarm signal generation module is used for generating an alarm signal when the highest temperature in the temperature measurement result of the target equipment is higher than the first preset temperature and lasts for a second preset time period.

In the embodiment of the invention, the AR glasses end comprises an application platform system and a temperature measuring system, the application platform system is used for checking and managing equipment and a target scene, the temperature measuring system is used for measuring the temperature of the equipment in real time, and the highest temperature in the current picture is displayed according to the video picture.

The background management end is used for background management of the application platform system. For example, management of personnel and authority is performed, inspection tasks are issued, and task records of the inspection personnel are checked.

Specifically, the background management end comprises a user management module, a device management module, a task management module and a log management module. Preferably, the task management module comprises a daily task management module, a patrol task management module and a burst task management module.

The daily task is a device checking task which is performed by a user, and a device list to be checked is not scheduled. The inspection task and the burst task are inspection tasks in which a list of devices to be inspected is set by a background management end.

And editing a user list of an application platform for logging in the AR glasses end through a user management module, and setting roles and authorities for each user. Such as querying a list of user accounts, creating user accounts, resetting user passwords, editing user information, deleting user accounts, etc.; querying a list of roles, creating roles, editing the rights of roles, deleting roles, etc.

Editing a device list to be managed through a device management module, and adding device information for each device in the device list; an inspection item that needs to be inspected is set for each device.

For example, device list query, device addition, editing device details, deleting devices, device inspection item editing, system generation device two-dimensional codes, deleting devices, and the like are performed.

And establishing and editing the checking task to be performed through a task management module. The task management module can also be used for inquiring task records, checking task result details and the like for daily tasks except checking tasks.

For example, for daily tasks, daily task records may be queried and daily task result details viewed. For the inspection task, the inspection task list can be inquired, the inspection task can be issued, the inspection task configuration can be carried out, the inspection task can be edited, the inspection task can be deleted, the inspection task can be enabled/disabled, the inspection task result record can be inquired, and the inspection task result detail can be checked. For burst tasks, a burst task list can be checked, burst tasks can be issued, burst task configuration can be performed, burst tasks can be canceled, and burst task result details can be checked.

And viewing and editing the operation log formed on the AR glasses end through a log management module.

The application platform system of the AR glasses end comprises a task module, a remote collaboration module, a real-time data module and a setting module. Preferably, the task modules include a daily task module, a patrol task module, and a burst task module.

The method comprises the steps that through a task module, based on an inspection task or a daily task built by the user, two-dimensional code scanning is conducted on equipment to identify the equipment and acquire equipment information, whether detection contents of inspection items contained in the equipment are normal or not is checked and judged in sequence, the inspection results are recorded through a real-time data module, and when cooperation is needed, remote cooperation personnel are called through a remote cooperation module and interacted with the remote cooperation personnel; and selecting whether to start the screen recording function or not through the setting module.

It should be noted that, the application platform system of the present invention can be understood as an intelligent operation device APP for the individual soldiers. Likewise, an APP can be understood as a remote collaboration module.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.

The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A method of device management, for application to an AR eyewear side, the method comprising:

receiving and executing the checking task to obtain a checking result;

2. The method of device management according to claim 1, wherein creating, by the background manager, an inspection task for the target device includes:

determining each target device to be checked from a device list;

3. The method of device management according to claim 1, wherein in receiving and executing the inspection task to obtain an inspection result, the method further comprises:

receiving the inspection task;

4. The method of device management according to claim 1, wherein the method further comprises:

5. The method of device management according to claim 2, wherein the monitoring, by the background management side, of motion data of a target AR glasses side performing the inspection task includes:

6. The method of claim 5, wherein determining the operational status of the patrol personnel at the target AR-eyeglass end based on the motion data comprises:

7. The method of device management of claim 4, wherein the method further comprises:

8. The method of device management of claim 4, wherein the method further comprises:

requesting remote collaboration;

9. The method of device management according to claim 1, wherein in case a temperature check of the target device is included in the check task, the method further comprises:

10. The method of device management according to claim 9, wherein the performing temperature measurement on the target device to obtain a temperature measurement result includes:

11. The method of device management of claim 10, wherein the method further comprises:

12. The method of claim 11, wherein generating an alert signal based on the temperature measurement and a duration of a highest temperature of the temperature measurement comprises:

13. A system for device management, the system comprising: