CN116389534A - Equipment inspection method, system, device, equipment and medium based on mixed reality - Google Patents
Equipment inspection method, system, device, equipment and medium based on mixed reality Download PDFInfo
- Publication number
- CN116389534A CN116389534A CN202310660898.4A CN202310660898A CN116389534A CN 116389534 A CN116389534 A CN 116389534A CN 202310660898 A CN202310660898 A CN 202310660898A CN 116389534 A CN116389534 A CN 116389534A
- Authority
- CN
- China
- Prior art keywords
- inspection
- equipment
- target
- mixed reality
- solution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 391
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000012423 maintenance Methods 0.000 claims description 47
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 abstract description 16
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
- G07C1/20—Checking timed patrols, e.g. of watchman
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Abstract
The invention relates to the technical field of equipment inspection, and provides an equipment inspection method, a system, a device, equipment and a medium based on mixed reality, wherein the method comprises the following steps: acquiring an inspection task sheet corresponding to target inspection equipment; displaying a target solution generated based on equipment details of the target inspection equipment on a mixed reality equipment under the condition that the target inspection equipment is determined to need to be maintained; under the condition that a rejection instruction generated by the mixed reality equipment based on the operation of the patrol personnel on the target solution is received, the rejection instruction is sent to a remote guiding end, and guiding information generated by the remote guiding end based on the operation instruction of a target user is received; and receiving an inspection task sheet updated based on the guide information. The invention improves the efficiency of the equipment inspection process.
Description
Technical Field
The invention relates to the technical field of equipment inspection, in particular to a mixed reality-based equipment inspection method, a system, a device, equipment and a medium.
Background
The inspection operation and maintenance method of the railway station equipment is mainly realized by manpower. The inspection personnel carries a mobile terminal to an inspection site, uses the mobile terminal to scan a two-dimensional code beside the equipment, opens the machine, can use the terminal to inquire a corresponding instruction manual of the equipment during the period, and finishes the daily maintenance operation of the machine and the parts equipment thereof under the instruction of the manual, such as oiling, cleaning, maintenance, repair and the like. When the equipment has serious and professional problems and needs to be maintained, equipment is usually reported and maintained by waiting for professionals, so that the efficiency of the inspection process is lower.
Disclosure of Invention
The invention provides a device inspection method, a system, a device, equipment and a medium based on mixed reality, which are used for solving the technical problem of low efficiency in the existing inspection process of railway station equipment.
The invention provides a device inspection method based on mixed reality, which comprises the following steps:
acquiring an inspection task sheet corresponding to target inspection equipment;
displaying a target solution generated based on equipment details of the target inspection equipment on a mixed reality equipment under the condition that the target inspection equipment is determined to need to be maintained;
under the condition that a rejection instruction generated by the mixed reality equipment based on the operation of the patrol personnel on the target solution is received, the rejection instruction is sent to a remote guiding end, and guiding information generated by the remote guiding end based on the operation instruction of a target user is received;
and receiving an inspection task sheet updated based on the guide information.
According to the equipment inspection method based on mixed reality provided by the invention, the acquisition of the inspection task sheet corresponding to the target inspection equipment comprises the following steps:
selecting a target patrol equipment in a patrol area based on a mixed reality equipment, and displaying a navigation indication route generated based on the target patrol equipment on the mixed reality equipment;
and under the condition that the mixed reality equipment determines that the patrol personnel reaches the position of the target patrol equipment according to the navigation indication route, acquiring an inspection task list obtained by the patrol personnel based on the identification code of the target patrol equipment scanned by the mixed reality equipment.
According to the equipment inspection method based on mixed reality provided by the invention, after acquiring the inspection task list corresponding to the target inspection equipment, the method comprises the following steps:
displaying the inspection task list on the mixed reality equipment, and acquiring current state data of the target inspection equipment under the condition that the inspection personnel determines that the target inspection equipment does not need maintenance based on the mixed reality equipment;
submitting a checking task list for filling in the current state data.
According to the device inspection method based on mixed reality provided by the invention, after the target solution generated based on the device details of the target inspection device is displayed on the mixed reality device, the method comprises the following steps:
deducting a first solution under the condition that the patrol personnel reject the target solution and generate the first solution based on the mixed reality equipment;
and storing the first solution according to the deduction result under the condition that the execution of the first solution is determined.
According to the equipment inspection method based on mixed reality, which is provided by the invention, the equipment inspection method based on mixed reality further comprises the following steps:
outputting a picture displayed by the mixed reality equipment on the remote guiding end;
and marking the target inspection equipment on a picture displayed by the mixed reality equipment, and guiding the inspection personnel to maintain the marked target inspection equipment through voice.
The invention also provides a mixed reality-based equipment inspection system, which adopts the mixed reality-based equipment inspection method, and comprises the following steps:
the mixed reality equipment is used for displaying an inspection task list corresponding to the target inspection equipment;
the inspection management platform is used for generating a target solution based on equipment details of the target inspection equipment;
the mixed reality equipment is further used for generating a rejection instruction based on the operation of the patrol personnel on the target solution and sending the rejection instruction to the patrol management platform;
the remote guiding end is used for receiving the refusing instruction forwarded by the inspection management platform and generating guiding information based on the operation instruction of the target user;
the mixed reality equipment is also used for receiving the guide information forwarded by the inspection management platform and submitting an inspection task sheet updated based on the guide information to the inspection management platform.
According to the equipment inspection system based on mixed reality, the mixed reality equipment is further used for displaying a navigation indication route generated based on the target inspection equipment, scanning the identification code of the target inspection equipment and displaying an inspection task sheet obtained by scanning the identification code.
The invention also provides a device inspection device based on mixed reality, which comprises:
the inspection task list acquisition module is used for acquiring an inspection task list corresponding to the target inspection equipment;
the solution display module is used for displaying the target solution generated based on the equipment details of the target inspection equipment on the mixed reality equipment under the condition that the target inspection equipment is determined to need to be maintained;
the remote guidance module is used for sending the rejection instruction to a remote guidance end under the condition that the rejection instruction generated by the mixed reality equipment based on the operation of the patrol personnel on the target solution is received, and receiving guidance information generated by the remote guidance end based on the operation instruction of a target user;
and the inspection task sheet receiving module is used for receiving the inspection task sheet updated based on the guide information.
The invention also provides electronic equipment, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the equipment inspection method based on mixed reality when executing the program.
The invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a mixed reality based device inspection method as described in any of the above.
According to the equipment inspection method, system, device, equipment and medium based on mixed reality, the inspection task list corresponding to the target inspection equipment is obtained, the target solution generated based on the equipment details of the target inspection equipment is displayed on the mixed reality equipment under the condition that the target inspection equipment is required to be maintained, when an inspector refuses operation on the target solution displayed on the mixed reality equipment, an instruction for refusing the operation is sent to a remote guiding end, and guiding information generated by the remote guiding end based on the operation instruction of a remote expert is received, finally, the inspector maintains the equipment based on the guiding information and submits the filled inspection task list, so that inspection maintenance of the equipment is completed, and efficiency of equipment inspection process is improved.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a mixed reality-based equipment inspection method provided by the invention;
fig. 2 is a schematic diagram of an inspection flow in the method for inspecting equipment based on mixed implementation provided by the invention;
FIG. 3 is a second schematic flow chart of the mixed reality-based equipment inspection method provided by the invention;
fig. 4 is a general architecture diagram of the mixed reality-based equipment inspection system provided by the invention;
fig. 5 is a schematic structural diagram of a device inspection apparatus based on mixed reality provided by the invention;
fig. 6 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, the present invention provides a device inspection method based on mixed reality, including:
specifically, as shown in fig. 2, fig. 2 is a schematic view of an inspection flow in an equipment inspection method based on Mixed Reality, a target inspection device and an inspection task work order corresponding to the target inspection device exist in an inspection area are uniformly distributed to an MR (Mixed Reality) inspection device by a station equipment inspection supervision management terminal, the station equipment inspection supervision management terminal also has functions of classifying inspection personnel, inspecting and submitting the task work order, providing three-dimensional map navigation, providing equipment maintenance scheme, previewing maintenance scheme and the like, the inspection personnel scans an identification code (such as a two-dimensional code) of the target inspection device to start the target inspection device, and an inspection task order of the target inspection device can be loaded and displayed on the MR device.
specifically, as shown in fig. 2, the inspector maintains the railway client device (i.e., the target inspection device in this embodiment) according to the inspection task list in step sequence and fills in the inspection task list, in the inspection process, the inspector judges whether the target inspection device needs maintenance, if the target inspection device does not need maintenance, the inspector submits the filled-in inspection task list to the inspection management platform by using the MR device, wherein the filled-in inspection task list comprises details of each component, status data of each component and pictures of each component of the target inspection device, the inspection management platform inspects the received filled-in inspection task list by combining with the solution repository, and if the filled-in inspection task list passes through, the inspection task list is marked as "no maintenance" if the target inspection device does not need maintenance, and the inspection of the target inspection device is completed; if the filled inspection task list is not checked, namely, the target inspection equipment is determined to be required to be maintained, the inspection management platform informs inspection personnel through the MR equipment, and the inspection personnel submits a maintenance application work list to the inspection management platform so as to carry out a maintenance flow.
After the inspection personnel submits the application maintenance work order, the inspection personnel can choose whether to delay the maintenance work. If the patrol personnel chooses to delay the maintenance work, submitting the patrol task list to a patrol management platform, and marking the patrol task list as 'to be repaired' by the patrol management platform, wherein the patrol of the target patrol equipment is finished; if the patrol personnel chooses to process the maintenance work immediately, the patrol management platform combines a solution storage library and an artificial intelligence technology, generates a solution (namely a target solution in the embodiment) based on the received equipment details in the patrol task list submitted by the patrol personnel, and sends the target solution to the MR equipment to be displayed on the MR equipment for the patrol personnel to check.
specifically, as shown in fig. 2, after the inspection personnel checks the proposal of the target solution, the inspection personnel decides whether to follow the target solution for field maintenance or not, if the inspection personnel follow the target solution, the inspection personnel process the maintenance problem according to the target solution on site; if the patrol personnel do not follow the target solution, the solution for the maintenance problem can be automatically built according to own experience and theoretical knowledge accumulation of the patrol personnel. If the maintenance problem still cannot be solved, the patrol personnel can search for the remote expert guidance through the MR equipment, and the MR equipment sends a refusal instruction of the patrol personnel or an instruction of the patrol personnel searching for the remote expert guidance to the remote guidance end. The expert of the remote guidance checks the real-time picture before the eyes shot by the MR equipment worn by the inspector through the remote guiding end, and the picture comprises the target inspecting equipment and the hand operation of the inspector, the expert of the remote guidance marks the target inspecting equipment to be maintained remotely, and the voice guides the maintainer to maintain the target inspecting equipment, namely, receives guiding information generated by the remote guiding end based on the operation instruction of the expert of the remote guidance.
And step 400, receiving an inspection task sheet updated based on the guide information.
Specifically, as shown in fig. 2, after the inspection personnel goes through the maintenance process, the inspection personnel automatically judges whether the problem is solved, if the problem of the equipment is not solved, i.e. the equipment is not repaired, the inspection personnel can return to reselect whether the maintenance problem is delayed, if so, the inspection is finished; if the processing is not delayed, the process is re-entered, and a new round of maintenance work is started. If the problem of the target inspection equipment is solved, the inspection management platform stores the maintenance records, the inspection personnel submits the inspection task list, and the inspection management platform marks the inspection task list submitted by the inspection personnel as the inspection end of the repaired target inspection equipment.
According to the method, the device and the system, the inspection task list corresponding to the target inspection device is obtained, under the condition that the target inspection device needs to be maintained, the target solution generated based on the device details of the target inspection device is displayed on the mixed reality device, when an inspector refuses operation on the target solution displayed on the mixed reality device, an instruction for refusing the operation is sent to the remote guiding end, the guiding information generated by the remote guiding end based on the operation instruction of the remote expert is received, finally, the inspector maintains the device based on the guiding information, submits the filled inspection task list, inspection maintenance of the target inspection device is completed, and efficiency of the equipment inspection process is improved.
Referring to fig. 3, in an embodiment, the method for inspecting equipment based on mixed reality provided in the embodiment of the present application may further include:
and 120, under the condition that the mixed reality equipment determines that the patrol personnel reaches the position of the target patrol equipment according to the navigation indication route, acquiring an inspection task sheet obtained by the patrol personnel based on the identification code of the target patrol equipment scanned by the mixed reality equipment.
Specifically, the inspection personnel wear the MR equipment, an inspection area is selected on a display interface of the MR equipment, target inspection equipment is selected in the inspection area, then inspection is started to be performed on the target inspection equipment one by one, the inspection management platform distributes corresponding inspection task lists and navigation indication routes generated based on the target inspection equipment to the inspection personnel according to the inspection area selected by the inspection personnel and the target inspection equipment in the inspection area, the navigation routes and the navigation indication routes are marked in 3D (three-dimensional) in the visible area where the inspection personnel goes forward, the inspection personnel is guided to quickly arrive at the place where the target inspection equipment is located, the inspection management platform can be remotely connected with the MR equipment, the inspection management platform can determine whether the inspection personnel arrives at the position of the target inspection equipment according to the navigation indication routes through the position of the MR equipment, and the inspection personnel starts the target inspection equipment by scanning identification codes (such as two-dimensional codes) under the condition that the inspection personnel is determined to arrive at the position of the target inspection equipment according to the navigation indication routes, and the inspection task lists of the target inspection equipment can be loaded.
According to the embodiment, the mixed reality equipment is used for carrying out inspection navigation on inspection personnel, and the inspection task list of the target inspection equipment is displayed, so that the inspection personnel can inspect visually, and the equipment inspection efficiency is improved.
In an embodiment, the device inspection method based on mixed reality provided in the embodiment of the application may further include:
step 500, displaying the inspection task list on the mixed reality equipment, and acquiring current state data of the target inspection equipment under the condition that the inspection personnel determines that the target inspection equipment does not need maintenance based on the mixed reality equipment;
and 600, receiving an inspection task sheet submitted by the inspector based on the mixed reality equipment and filled with the current state data.
Specifically, as shown in fig. 2, the loaded inspection task list is displayed on the MR device, the inspection personnel maintain the target inspection device according to the inspection task list displayed on the MR device in a step sequence, and fill in the inspection task list according to the inspection result, in the inspection process, the inspection personnel judge whether the target inspection device needs to be maintained, if the target inspection device does not need to be maintained, the inspection personnel submit the filled inspection task list to the inspection management platform by using the MR device, wherein the filled inspection task list comprises details of each part of the target inspection device, state data of each part and pictures of each part, namely, the current state data of the target inspection device in the embodiment. And the inspection management platform examines the received filled inspection task list in combination with the solution storage library, and if the filled inspection task list passes the examination, the inspection management platform marks the filled inspection task list as 'no maintenance' and the inspection of the target inspection equipment is completed.
The embodiment provides a more diversified inspection problem solution through different processing modes of whether inspection personnel maintain based on target inspection equipment.
In an embodiment, the device inspection method based on mixed reality provided in the embodiment of the application may further include:
step 700, under the condition that it is determined that the patrol personnel refuses the target solution and generates a first solution based on the mixed reality device, deducting the first solution;
step 800, according to the deduction result, in case it is determined to execute the first solution, saving the first solution.
Specifically, as shown in fig. 2, after the patrol personnel checks the proposal of the target solution through the MR device, the patrol personnel decides whether to follow the target solution for field maintenance or not by himself, if the patrol personnel determines to follow the target solution through the MR device, the patrol personnel processes the maintenance problem on site according to the target solution displayed on the MR device; if the patrol personnel determines by the MR device that this target solution is not to be followed, the patrol personnel can create by himself by the MR device a solution to the maintenance problem, i.e. the first solution in the present embodiment, based on his own experience and theoretical knowledge accumulation.
If the patrol personnel select to automatically create the first solution, the detailed step flow of the first solution is required to be filled through the MR equipment, the first solution is submitted to the patrol management platform, the patrol management platform deducts the first solution by combining with the solution storage library, if the deduction is successful, the result shows that the first solution can solve the maintenance problem of the target patrol equipment, and the patrol personnel can process the maintenance problem of the target patrol equipment according to the first solution displayed on the MR equipment; if the deduction fails, the result shows that the first solution can not solve the maintenance problem of the target inspection equipment, the inspection personnel needs to return to the previous process, and the maintenance start is reselected according to the proposal of the target solution provided by the inspection management platform.
The embodiment provides more diversified inspection problem solutions through different processing modes of inspection personnel based on target solutions.
In an embodiment, the device inspection method based on mixed reality provided in the embodiment of the application may further include:
step 310, outputting a picture displayed by the mixed reality equipment on the remote guiding end;
and 320, marking the target inspection equipment on a picture displayed by the mixed reality equipment, and guiding the inspection personnel to maintain the marked target inspection equipment through voice.
Specifically, at the remote guiding end, an expert in equipment inspection can check real-time pictures shot by mixed reality equipment worn by an inspector through connection between the remote guiding end and the mixed reality equipment, wherein the real-time pictures comprise target inspection equipment and hand operation pictures of the inspector, then the expert in equipment inspection marks the problematic position of the target inspection equipment on the checked real-time pictures of the target inspection equipment, the inspector is informed of the marked position of the target inspection equipment in a voice guiding mode, the inspector maintains the marked position of the target inspection equipment, and the inspector can also view the mark made on the target inspection equipment in real time in the pictures displayed by the mixed reality equipment; the expert in the equipment inspection aspect can also check the three-dimensional model corresponding to the target inspection equipment on the remote guiding end, can carry out marking and other forms of description (such as words) in the three-dimensional model corresponding to the target inspection equipment through operating the three-dimensional model on the remote guiding end, and can display the three-dimensional model corresponding to the target inspection equipment on the mixed reality equipment, so that the inspector can check the internal marking of the three-dimensional model corresponding to the target inspection equipment through the three-dimensional model displayed on the mixed reality equipment, and can carry out maintenance according to the guiding description given by the expert in the equipment inspection aspect.
According to the embodiment, the remote guiding end is connected with the mixed reality equipment, so that the guiding information of the remote expert is transmitted in real time, and the inspection efficiency of the railway passenger station equipment is improved.
Referring to fig. 4, the present invention further provides a mixed reality-based equipment inspection system adopting the mixed reality-based equipment inspection method, where the mixed reality-based equipment inspection system includes:
the mixed reality equipment is used for displaying an inspection task list corresponding to the target inspection equipment;
the inspection management platform is used for generating a target solution based on equipment details of the target inspection equipment;
the mixed reality equipment is further used for generating a rejection instruction based on the operation of the patrol personnel on the target solution and sending the rejection instruction to the patrol management platform;
the remote guiding end is used for receiving the refusing instruction forwarded by the inspection management platform and generating guiding information based on the operation instruction of the target user;
the mixed reality equipment is also used for receiving the guide information forwarded by the inspection management platform and submitting an inspection task sheet updated based on the guide information to the inspection management platform.
Specifically, as shown in fig. 4, fig. 4 is a general architecture diagram of a device inspection system based on mixed reality, and the inspection MR device (i.e., the above mixed reality device), the device inspection system server (i.e., the above inspection management platform), and the remote expert guidance terminal (i.e., the above remote guidance terminal) in fig. 4 are taken as examples. In the whole inspection process of railway station equipment, an inspection task list corresponding to target inspection equipment (namely passenger ticket equipment, passenger service equipment, electromechanical equipment and the like in fig. 4) to be inspected in the railway station is displayed on the mixed reality equipment, after an inspector wears the mixed reality equipment, the inspection task list corresponding to the target inspection equipment can be checked in front of the eyes, and then the inspector fills in equipment details of the target inspection equipment and submits a maintenance application work list to an inspection management platform. And the patrol management platform (i.e. the equipment patrol system server in fig. 4) is used for generating a target solution based on the equipment details of the target patrol equipment, and sending the target solution to the mixed reality equipment to be displayed on the mixed reality equipment.
And finally, the mixed reality equipment is also used for receiving the guide information forwarded by the patrol management platform, submitting an inspection task list updated based on the guide information to the patrol management platform, and completing the patrol maintenance of the target patrol equipment.
In an embodiment, the mixed reality-based equipment inspection system provided in the embodiment of the application may further include:
the mixed reality device is further used for displaying a navigation indication route generated based on the target inspection device, scanning the identification code of the target inspection device and displaying an inspection task sheet obtained by scanning the identification code.
Specifically, the inspection management platform displays an inspection task list and map navigation distributed to the inspection personnel on the mixed reality equipment according to the inspection area and the target inspection equipment selected by the inspection personnel, 3D marks a navigation route and an indication in a visible area where the inspection personnel moves forward, guides the inspection personnel to quickly reach a place where the target inspection equipment is located, the inspection personnel scans an identification code (such as a two-dimensional code) of the target inspection equipment through the mixed reality equipment to start the target inspection equipment, the inspection task list of the target inspection equipment is loaded and displayed on the mixed reality equipment, and the inspection personnel maintains the target inspection equipment according to the step sequence of the inspection task list and fills in the inspection task list according to the inspection result.
In an embodiment, the mixed reality-based equipment inspection system provided in the embodiment of the application may further include:
the mixed reality equipment is further used for acquiring current state data of the target inspection equipment based on maintenance confirmation operation of the inspection personnel on the target inspection equipment, and submitting an inspection task sheet for filling the current state data to the inspection management platform.
Specifically, the inspection personnel maintain and fill in the inspection task list according to the step sequence, in the inspection process, the inspection personnel judge whether the target inspection equipment needs maintenance or not, if the target inspection equipment does not need maintenance, the inspection personnel submit the filled-in inspection task list to the inspection management platform through the mixed reality equipment, wherein the filled-in inspection task list comprises detail of each part, state data of each part and pictures of each part of the target inspection equipment, namely the current state data. And the inspection management platform examines the received filled inspection task list in combination with the solution storage library, and if the filled inspection task list passes the examination, the inspection management platform marks the filled inspection task list as 'no maintenance' and the inspection of the target inspection equipment is completed.
The device for inspecting equipment based on mixed reality provided by the invention is described below, and the device for inspecting equipment based on mixed reality described below and the method for inspecting equipment based on mixed reality described above can be correspondingly referred to each other.
Referring to fig. 5, the present invention further provides a device inspection apparatus based on mixed reality, including:
an inspection task sheet obtaining module 501, configured to obtain an inspection task sheet corresponding to a target inspection device;
a solution display module 502, configured to display, on a mixed reality device, a target solution generated based on device details of the target inspection device, in a case where it is determined that the target inspection device needs maintenance;
a remote guidance module 503, configured to, when receiving a rejection instruction generated by the mixed reality device based on an operation of the target solution by an inspector, send the rejection instruction to a remote guidance end, and receive guidance information generated by the remote guidance end based on an operation instruction of a target user;
and the inspection task sheet receiving module 504 is configured to receive an inspection task sheet updated based on the instruction information.
Optionally, the inspection task sheet acquisition module includes:
a navigation instruction route display unit for displaying a navigation instruction route generated based on a target patrol equipment on a mixed reality equipment, wherein the navigation instruction route display unit is used for selecting the target patrol equipment in a patrol area based on the mixed reality equipment;
and the inspection task list acquisition unit is used for acquiring an inspection task list obtained by the inspection personnel based on the identification code of the target inspection equipment scanned by the mixed reality equipment under the condition that the inspection personnel reach the position of the target inspection equipment according to the navigation indication route based on the mixed reality equipment.
Optionally, the mixed reality-based equipment inspection device includes:
the current state data acquisition module is used for displaying the inspection task list on the mixed reality equipment, and acquiring current state data of the target inspection equipment under the condition that the inspection personnel determines that the target inspection equipment does not need maintenance based on the mixed reality equipment;
and the inspection task list receiving module is used for receiving the inspection task list which is submitted by the patrol personnel based on the mixed reality equipment and filled with the current state data.
Optionally, the mixed reality-based equipment inspection device further includes:
a solution deduction module, configured to deduct a first solution when it is determined that the patrol personnel reject the target solution and generate the first solution based on the mixed reality device;
and the first solution saving module is used for saving the first solution according to the deduction result under the condition that the execution of the first solution is determined.
Optionally, the mixed reality-based equipment inspection device further includes:
the picture display module is used for outputting a picture displayed by the mixed reality equipment on the remote guiding end;
and the remote guiding maintenance module is used for marking the target inspection equipment on a picture displayed by the mixed reality equipment and guiding the inspection personnel to maintain the marked target inspection equipment through voice.
Fig. 6 illustrates a physical schematic diagram of an electronic device, as shown in fig. 6, which may include: processor 610, communication interface (Communications Interface) 620, memory 630, and communication bus 640, wherein processor 610, communication interface 620, and memory 630 communicate with each other via communication bus 640. The processor 610 may invoke logic instructions in the memory 630 to perform the mixed reality based device inspection method.
Further, the logic instructions in the memory 630 may be implemented in the form of software functional units and stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In yet another aspect, the present invention further provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the mixed reality based device inspection method provided by the above methods.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. The equipment inspection method based on mixed reality is characterized by comprising the following steps of:
acquiring an inspection task sheet corresponding to target inspection equipment;
displaying a target solution generated based on equipment details of the target inspection equipment on a mixed reality equipment under the condition that the target inspection equipment is determined to need to be maintained;
under the condition that a rejection instruction generated by the mixed reality equipment based on the operation of the patrol personnel on the target solution is received, the rejection instruction is sent to a remote guiding end, and guiding information generated by the remote guiding end based on the operation instruction of a target user is received;
and receiving an inspection task sheet updated based on the guide information.
2. The mixed reality based equipment inspection method according to claim 1, wherein the obtaining an inspection task sheet corresponding to the target inspection equipment comprises:
selecting a target patrol equipment in a patrol area based on a mixed reality equipment, and displaying a navigation indication route generated based on the target patrol equipment on the mixed reality equipment;
and under the condition that the mixed reality equipment determines that the patrol personnel reaches the position of the target patrol equipment according to the navigation indication route, acquiring an inspection task list obtained by the patrol personnel based on the identification code of the target patrol equipment scanned by the mixed reality equipment.
3. The mixed reality based equipment inspection method according to claim 2, wherein after obtaining the inspection task sheet corresponding to the target inspection equipment comprises:
displaying the inspection task list on the mixed reality equipment, and acquiring current state data of the target inspection equipment under the condition that the inspection personnel determines that the target inspection equipment does not need maintenance based on the mixed reality equipment;
and receiving an inspection task sheet which is submitted by the inspection personnel based on the mixed reality equipment and filled with the current state data.
4. The mixed reality based device inspection method of claim 1, wherein the displaying the target solution generated based on the device details of the target inspection device on the mixed reality device comprises:
deducting a first solution under the condition that the patrol personnel reject the target solution and generate the first solution based on the mixed reality equipment;
and storing the first solution according to the deduction result under the condition that the execution of the first solution is determined.
5. The mixed reality based equipment inspection method of claim 1, further comprising:
outputting a picture displayed by the mixed reality equipment on the remote guiding end;
and marking the target inspection equipment on a picture displayed by the mixed reality equipment, and guiding the inspection personnel to maintain the marked target inspection equipment through voice.
6. A mixed reality-based equipment inspection system, wherein the mixed reality-based equipment inspection system employs the mixed reality-based equipment inspection method according to any one of claims 1-5, and the mixed reality-based equipment inspection system comprises:
the mixed reality equipment is used for displaying an inspection task list corresponding to the target inspection equipment;
the inspection management platform is used for generating a target solution based on equipment details of the target inspection equipment;
the mixed reality equipment is further used for generating a rejection instruction based on the operation of the patrol personnel on the target solution and sending the rejection instruction to the patrol management platform;
the remote guiding end is used for receiving the refusing instruction forwarded by the inspection management platform and generating guiding information based on the operation instruction of the target user;
the mixed reality equipment is also used for receiving the guide information forwarded by the inspection management platform and submitting an inspection task sheet updated based on the guide information to the inspection management platform.
7. The mixed reality based device inspection system of claim 6, wherein the mixed reality device is further configured to display a navigation instruction route generated based on the target inspection device, scan an identification code of the target inspection device, and display an inspection job ticket obtained by scanning the identification code.
8. Equipment inspection device based on mixed reality, characterized by comprising:
the inspection task list acquisition module is used for acquiring an inspection task list corresponding to the target inspection equipment;
the solution display module is used for displaying the target solution generated based on the equipment details of the target inspection equipment on the mixed reality equipment under the condition that the target inspection equipment is determined to need to be maintained;
the remote guidance module is used for sending the rejection instruction to a remote guidance end under the condition that the rejection instruction generated by the mixed reality equipment based on the operation of the patrol personnel on the target solution is received, and receiving guidance information generated by the remote guidance end based on the operation instruction of a target user;
and the inspection task sheet receiving module is used for receiving the inspection task sheet updated based on the guide information.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the mixed reality based device inspection method of any one of claims 1 to 5 when the program is executed by the processor.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the mixed reality based device inspection method of any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310660898.4A CN116389534A (en) | 2023-06-06 | 2023-06-06 | Equipment inspection method, system, device, equipment and medium based on mixed reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310660898.4A CN116389534A (en) | 2023-06-06 | 2023-06-06 | Equipment inspection method, system, device, equipment and medium based on mixed reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116389534A true CN116389534A (en) | 2023-07-04 |
Family
ID=86969835
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310660898.4A Pending CN116389534A (en) | 2023-06-06 | 2023-06-06 | Equipment inspection method, system, device, equipment and medium based on mixed reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116389534A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909898A (en) * | 2019-11-28 | 2020-03-24 | 武汉农村商业银行股份有限公司 | Zero-knowledge bank machine room fault diagnosis and maintenance guidance system and method based on AR glasses |
| CN113222184A (en) * | 2021-01-29 | 2021-08-06 | 国网辽宁省电力有限公司大连供电公司 | Equipment inspection system and method based on augmented reality AR |
| CN113593071A (en) * | 2021-07-16 | 2021-11-02 | 苏州恒力智能科技有限公司 | Inspection method, inspection device, inspection system, computer equipment and storage medium |
| CN113920452A (en) * | 2021-10-12 | 2022-01-11 | 西安咸林能源科技有限公司 | AR-based intelligent inspection method and system |
| WO2022121911A1 (en) * | 2020-12-07 | 2022-06-16 | 北京达美盛软件股份有限公司 | Virtual inspection system and visualized factory system in augmented reality environment |
-
2023
- 2023-06-06 CN CN202310660898.4A patent/CN116389534A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909898A (en) * | 2019-11-28 | 2020-03-24 | 武汉农村商业银行股份有限公司 | Zero-knowledge bank machine room fault diagnosis and maintenance guidance system and method based on AR glasses |
| WO2022121911A1 (en) * | 2020-12-07 | 2022-06-16 | 北京达美盛软件股份有限公司 | Virtual inspection system and visualized factory system in augmented reality environment |
| CN113222184A (en) * | 2021-01-29 | 2021-08-06 | 国网辽宁省电力有限公司大连供电公司 | Equipment inspection system and method based on augmented reality AR |
| CN113593071A (en) * | 2021-07-16 | 2021-11-02 | 苏州恒力智能科技有限公司 | Inspection method, inspection device, inspection system, computer equipment and storage medium |
| CN113920452A (en) * | 2021-10-12 | 2022-01-11 | 西安咸林能源科技有限公司 | AR-based intelligent inspection method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5828969A (en) | Process for use with aircraft repairs | |
| CN104299287A (en) | Method and system for routing inspection of switching station | |
| US20120185260A1 (en) | System and method for inspecting equipment and estimating refurbishment costs thereof | |
| CN107817750A (en) | A kind of building monitoring system based on BIM | |
| CN110146035A (en) | Built-in fitting detection method, device, equipment and the system of component production line | |
| CN111861501A (en) | Complaint processing method, complaint processing system, computer device, and storage medium | |
| CN108704312A (en) | The test method and device of fine arts resource | |
| CN109961056A (en) | Traffic accident responsibility identification, system and equipment based on decision Tree algorithms | |
| CN110261392A (en) | Quality determining method, device, electronic equipment and system | |
| US6659610B2 (en) | Corneal endothelium analysis service method and system | |
| CN110728548B (en) | VR tourism product evaluation system | |
| CN116389534A (en) | Equipment inspection method, system, device, equipment and medium based on mixed reality | |
| CN111414595A (en) | Identity screening method, handheld device, background server and system | |
| CN113506383A (en) | Airplane strength test inspection method and system | |
| JP2021002166A (en) | Flight route determination device, flight route determination system, flight route determination method, and flight route determination program | |
| CN109460831A (en) | A kind of overhaul of the equipments operational method, device and system | |
| CN115171236A (en) | Inspection management method, inspection management platform and inspection management client | |
| CN110766322B (en) | Big data-based VR (virtual reality) tourism product evaluation method | |
| CN111179458A (en) | Method and device for routing inspection of rail transit equipment | |
| CN107104879A (en) | A kind of method and device of network interaction | |
| CN108345944A (en) | A kind of train closed loop intelligence repair method and system | |
| CN111262712B (en) | Group recommendation method, recommendation device, terminal, server and storage medium | |
| CN111598537A (en) | Personnel information management method and device based on graphic code, storage medium and terminal | |
| CN112990492A (en) | Method, device, equipment, medium and product for reporting hidden danger in charging station | |
| CN115983614A (en) | Intelligent operation and maintenance operation guiding equipment for maintenance scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |