CN117592974B

CN117592974B - Meta universe-based device maintenance method and device, electronic device and readable medium

Info

Publication number: CN117592974B
Application number: CN202410070226.2A
Authority: CN
Inventors: 陈琴
Original assignee: Beijing Huanyu Boya Technology Co ltd
Current assignee: Beijing Huanyu Boya Technology Co ltd
Filing date: 2024-01-18
Publication date: 2024-05-31
Anticipated expiration: 2044-01-18

Abstract

The embodiment of the disclosure discloses a meta-universe-based device maintenance method, a meta-universe-based device maintenance device, an electronic device and a readable medium. One embodiment of the method comprises the following steps: receiving operation monitoring information of rotating equipment; in response to determining that the running state identifier in the running monitoring information represents abnormal running, determining the rotating equipment represented by the equipment identifier in the running monitoring information as target equipment, and acquiring a real-time video stream shot by the field terminal aiming at the target equipment; constructing a meta space showing space according to the real-time video stream; labeling the meta-universe display space by using an equipment maintenance information base to obtain a labeled meta-universe display space; transmitting the labeling element universe display space to a remote terminal for synchronous display; and performing simulation maintenance on the virtual display model of the target equipment to obtain a simulation maintenance result. This embodiment achieves the resolution efficiency of the failure of the rotating apparatus.

Description

Meta universe-based device maintenance method and device, electronic device and readable medium

Technical Field

Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a meta-universe-based device repair method, apparatus, electronic device, and readable medium.

Background

Equipment maintenance is a technology for maintaining rotating equipment. Currently, when repairing a rotating device, the following methods are generally adopted: the field maintenance is performed manually.

However, when the rotating apparatus is maintained in the above manner, there are often the following technical problems:

first, manual maintenance is subject to experience limitations, resulting in failure of some equipment to be efficiently resolved, resulting in equipment that is not functioning properly for a long period of time.

Secondly, when the remote expert and the on-site maintenance personnel participate in equipment maintenance together in a remote guiding mode, the equipment is easily affected by the quality of an on-site shooting picture, so that the remote expert cannot fully know on-site conditions.

Disclosure of Invention

The disclosure is in part intended to introduce concepts in a simplified form that are further described below in the detailed description. The disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

Some embodiments of the present disclosure propose a metauniverse-based device repair method, apparatus, electronic device, and readable medium to address one or more of the technical problems mentioned in the background section above.

In a first aspect, some embodiments of the present disclosure provide a meta-universe based device repair method, the method comprising: receiving operation monitoring information of a rotating device, wherein the rotating device comprises: pump, motor, compressor and combustion engine, the above-mentioned operation monitoring information includes: a device identifier, an operating state identifier; in response to determining that the operation state identifier in the operation monitoring information represents abnormal operation, determining the rotating equipment represented by the equipment identifier in the operation monitoring information as target equipment, and acquiring a real-time video stream shot by a field terminal aiming at the target equipment; constructing a metauniverse display space according to the real-time video stream, wherein the metauniverse display space comprises a virtual display model of the target equipment; labeling the meta-universe display space by using an equipment maintenance information base to obtain a labeled meta-universe display space; transmitting the labeling meta space to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device; and according to the selection of the labeling information in the labeling meta universe display space by the field terminal and the at least one remote terminal and the maintenance operation of the virtual display model of the target equipment, performing simulation maintenance on the virtual display model of the target equipment, and obtaining a simulation maintenance result.

In a second aspect, some embodiments of the present disclosure provide a meta-universe based device repair apparatus, the apparatus comprising: a receiving unit configured to receive operation monitoring information of a rotating apparatus, wherein the rotating apparatus includes: pump, motor, compressor and combustion engine, the above-mentioned operation monitoring information includes: a device identifier, an operating state identifier; a determining unit configured to determine, in response to determining that the operation state identifier in the operation monitoring information indicates abnormal operation, a rotating device characterized by a device identifier in the operation monitoring information as a target device, and acquire a real-time video stream captured by a field terminal for the target device; a construction unit configured to construct a metauniverse display space according to the real-time video stream, wherein the metauniverse display space includes a virtual display model of the target device; the labeling unit is configured to label the meta-universe display space by using the equipment maintenance information base to obtain a labeled meta-universe display space; a transmitting unit configured to transmit the labeling element universe display space to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device; and the simulation unit is configured to simulate and maintain the virtual display model of the target equipment according to the selection of the labeling information in the labeling meta space display space by the field terminal and the at least one remote terminal and the maintenance operation of the virtual display model of the target equipment, so as to obtain a simulation maintenance result.

In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device having one or more programs stored thereon, which when executed by one or more processors causes the one or more processors to implement the method described in any of the implementations of the first aspect above.

In a fourth aspect, some embodiments of the present disclosure provide a computer readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.

The above embodiments of the present disclosure have the following advantageous effects: by the meta-universe-based equipment maintenance method of some embodiments of the present disclosure, equipment maintenance efficiency may be improved. Specifically, the reason for the low equipment maintenance efficiency is that: manual maintenance is subject to experience limitations, resulting in failure of some equipment to be efficiently resolved. Based on this, the meta-universe-based device repair method of some embodiments of the present disclosure first receives operation monitoring information of a rotating device, wherein the rotating device includes: pump, motor, compressor and combustion engine, the above-mentioned operation monitoring information includes: device identification, running state identification. Then, in response to determining that the operation state identifier in the operation monitoring information indicates abnormal operation, determining the rotating equipment represented by the equipment identifier in the operation monitoring information as a target equipment, and acquiring a real-time video stream shot by the field terminal aiming at the target equipment. And then, constructing a metauniverse display space according to the real-time video stream, wherein the metauniverse display space comprises a virtual display model of the target equipment. And then, marking the meta-universe display space by using an equipment maintenance information base to obtain a marked meta-universe display space. And then, the labeling meta space is sent to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device. Therefore, remote guidance on equipment maintenance can be realized through synchronous display with a remote terminal, and when on-site maintenance personnel encounters an unresolved problem, remote expert guidance can be sought, so that the failure resolution efficiency is improved. And finally, according to the selection of the labeling information in the labeling meta universe display space by the field terminal and the at least one remote terminal and the maintenance operation of the virtual display model of the target equipment, performing simulation maintenance on the virtual display model of the target equipment, and obtaining a simulation maintenance result. Thus, the failure resolution efficiency can be improved.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

FIG. 1 is a flow chart of some embodiments of a metauniverse-based device repair method according to the present disclosure;

FIG. 2 is a schematic structural diagram of some embodiments of a meta-universe based device repair apparatus of the present disclosure;

Fig. 3 is a schematic structural diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings. Embodiments of the present disclosure and features of embodiments may be combined with each other without conflict.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.

Referring to fig. 1, a flow 100 of some embodiments of a metauniverse-based device repair method in accordance with the present disclosure is shown. The meta-universe-based equipment maintenance method comprises the following steps of:

and step 101, receiving operation monitoring information of the rotating equipment.

In some embodiments, the execution body of the meta-universe based device repair method may receive the operation monitoring information of the rotating device through a wired connection or a wireless connection. Wherein, the rotating device can include but is not limited to: for pumps, motors, compressors and combustion engines. The operation monitoring information includes: device identification, running state identification. The device identification may be used to uniquely identify a device. The operating state identifiers may be preset and one operating state identifier may be used to uniquely identify one device operating state.

As an example, different operation status identifiers may represent normal operation, abnormal operation, and suspended operation, respectively.

Step 102, in response to determining that the operation state identifier in the operation monitoring information represents abnormal operation, determining the rotating equipment represented by the equipment identifier in the operation monitoring information as a target equipment, and acquiring a real-time video stream shot by the field terminal aiming at the target equipment.

In some embodiments, the executing body may determine, in response to determining that the operation status identifier in the operation monitoring information indicates abnormal operation, a rotating device represented by a device identifier in the operation monitoring information as a target device, and acquire a real-time video stream captured by the field terminal for the target device.

In some optional implementations of some embodiments, before determining that the running state identifier in the running monitoring information indicates abnormal running, the executing entity determines the rotating device represented by the device identifier in the running monitoring information as a target device, and obtains a real-time video stream captured by the field terminal for the target device, the executing entity may further execute the following steps:

the first step, obtaining the terminal positioning information of the field terminal.

And a second step of determining the device position information of the target device according to the pre-stored device information and the device identification of the target device. Wherein the device information includes: device identification, device location information.

And thirdly, generating navigation path information based on the terminal positioning information and the equipment position information. The navigation path information may be generated by Dijkstra (Dijkstra) algorithm or a-algorithm.

And step four, the navigation path information is sent to the field terminal for rendering and displaying.

And step 103, constructing a meta-universe display space according to the real-time video stream.

In some embodiments, the metauniverse presentation space includes a virtual presentation model of the target device. Wherein, all paste the two-dimensional code on every rotation equipment.

The executing body constructs a meta-universe display space according to the real-time video stream, and the method can comprise the following steps:

first, determining whether the real-time video stream includes a two-dimensional code image. Wherein, whether the real-time video stream includes the two-dimensional code image can be identified by using an image identification algorithm.

And secondly, responding to the fact that the real-time video stream contains the two-dimensional code image, and extracting the two-dimensional code image from the real-time video stream to obtain a two-dimensional code image set. Wherein, the two-dimensional code image in the two-dimensional code image set comprises a two-dimensional code.

The two-dimensional code image can be cut out from the real-time video stream, so that the two-dimensional code image can be extracted from the real-time video stream.

And thirdly, grouping each two-dimensional code image in the two-dimensional code image set to obtain a two-dimensional code image group set. The method comprises the steps of extracting image features of two-dimensional code images, and grouping the two-dimensional code images according to similarity among the image features.

And step four, generating a pending two-dimensional code image set based on each two-dimensional code image set in the two-dimensional code image set. The method comprises the steps that a complete two-dimensional code image can be selected from a two-dimensional code image group to serve as a to-be-determined two-dimensional code image.

Fifthly, acquiring equipment model information represented by each of the two-dimensional code image sets to be determined, and obtaining an equipment model information set. Wherein, the device model information in the device model information set includes: and (5) equipment identification and virtual display model. The virtual presentation model may be pre-created.

And sixthly, determining the equipment model information meeting the preset conditions in the equipment model information set as target equipment model information. The preset condition may be that the device identifier in the device model information is the same as the device identifier of the target device.

And seventh, constructing a meta space display space by utilizing the virtual display model and preset display background information in the target equipment model information. The scene can be paved for the virtual display model, so that a meta-universe display space is obtained.

In some optional implementations of some embodiments, the performing body performs grouping processing on each two-dimensional code image in the two-dimensional code image set to obtain a two-dimensional code image group set, and may include the following steps:

The first step, for each two-dimensional code image in the two-dimensional code image set, executes the following image preprocessing substeps:

And a first image preprocessing sub-step, namely utilizing a pre-trained two-dimensional code recognition model to recognize a two-dimensional code image area in the two-dimensional code image.

And a second image preprocessing sub-step, namely cutting the identified two-dimensional code image area from the two-dimensional code image to obtain a cut two-dimensional code area.

And a third image preprocessing sub-step, performing plane projection processing on the cut two-dimensional code area to obtain a projected two-dimensional code area image.

And secondly, grouping the projected two-dimensional code area images according to the obtained overlapping areas among the projected two-dimensional code area images to obtain a projected two-dimensional code area image group set.

And thirdly, determining the projection image group set as a two-dimensional code image group set.

Optionally, the executing body groups the projected two-dimensional code area images according to the obtained overlapping areas between the projected two-dimensional code area images to obtain a projected two-dimensional code area image group set, and may include the following steps:

A first step of selecting two projected two-dimensional code area images which are not subjected to overlapping area confirmation from the projected two-dimensional code area images as a first projected two-dimensional code area image and a second projected two-dimensional code area image, respectively, and performing the following overlapping area confirmation sub-step by using the first projected two-dimensional code area image and the second projected two-dimensional code area image:

A first overlapping region confirmation sub-step of executing the following conversion sub-step for the first projected two-dimensional code region image:

and a first conversion sub-step, performing black and white block identification on the first projection two-dimensional code area image.

And a second conversion sub-step of converting each of the identified black and white blocks into a first binary matrix according to the relative position in the first projected two-dimensional code area image. Wherein the black and white blocks can be converted into different numbers, respectively.

As an example, a black color tile may be converted to a digital 1 and a white color tile to a digital 0.

And a third conversion sub-step of selecting five rows or five columns sequentially arranged from the upper, lower, left and right of the first binary matrix as first edge vectors to obtain a first edge vector set.

A second overlapping region confirmation sub-step of executing the following conversion sub-step for the second projected two-dimensional code region image:

And a first conversion sub-step, performing black and white block identification on the second projection two-dimensional code area image.

And a second conversion sub-step of converting each of the identified black and white blocks into a second binary matrix according to the relative position in the second projected two-dimensional code area image.

And a third overlapping region confirmation sub-step of selecting five rows or five columns from the upper, lower, left and right of the second binary matrix in sequence as second edge vectors to obtain a second edge vector set.

And a fourth overlapping area confirmation sub-step of taking the second projected two-dimensional code area image and the first projected two-dimensional code area image as projected two-dimensional code area images with overlapping areas in response to determining that the first edge vector set and the second edge vector set have the first edge vector and the second edge vector which meet a preset contrast condition. The preset comparison condition may be that a vector distance value of the first edge vector and the second edge vector is smaller than a preset distance value.

In practice, the preset distance value may be set according to actual application conditions, which is not limited herein.

And secondly, taking each projected two-dimensional code area image with the overlapping area as a projected two-dimensional code area image group to obtain a projected two-dimensional code area image group set.

Optionally, the generating, by the executing body, the set of pending two-dimensional code images based on each two-dimensional code image group in the set of two-dimensional code image groups may include the following steps:

The first step, for each two-dimensional code image group in the two-dimensional code image group set, executes the following image generation sub-steps:

a first image generation sub-step of responding to the fact that a complete two-dimensional code image exists in the two-dimensional code image group, and taking the complete two-dimensional code image as a two-dimensional code image in the two-dimensional code image set;

and a second image generation sub-step, in response to determining that no complete two-dimensional code image exists in the two-dimensional code image group, stitching each two-dimensional code image in the two-dimensional code image group to obtain a stitched two-dimensional code image, and taking the stitched two-dimensional code image as a two-dimensional code image in the two-dimensional code image set.

The above step of constructing the meta space according to the real-time video stream and the step of expanding the meta space are taken as an invention point of the embodiment of the disclosure, which solves the second technical problem mentioned in the background art, namely that when a remote expert and a field maintenance person participate in equipment maintenance together in a remote guiding manner, the remote expert is easily affected by the field shooting picture quality, so that the remote expert cannot fully know the field situation. Factors that cause the above technical problems are often as follows: when the remote expert and the on-site maintenance personnel participate in equipment maintenance together in a remote guiding mode, the equipment is easily affected by the quality of an on-site shooting picture, so that the remote expert cannot fully know on-site conditions. If the above factors are solved, the effect of rapidly completing equipment maintenance through remote guidance can be achieved. In order to achieve the effect, the method and the device identify, group and extract the two-dimensional code images in the real-time video stream, further obtain a virtual display model of the current rotating device through the two-dimensional code images, and further generate a metaspace by utilizing the virtual display model. Thus, the remote terminal can realize maintenance guidance on the equipment in a virtual and three-dimensional metaspace.

And 104, marking the meta-universe display space by using the equipment maintenance information base to obtain a marked meta-universe display space.

In some embodiments, the equipment maintenance information in the equipment maintenance information base includes: the device identification, the initial equipment maintenance information set and the operating equipment maintenance information set, wherein the initial equipment maintenance information in the initial equipment maintenance information set and the operating equipment maintenance information in the operating equipment maintenance information set comprise at least one multimedia information.

The executing body marks the meta-universe display space by using an equipment maintenance information base to obtain a marked meta-universe display space, and the method can comprise the following steps:

first, equipment maintenance information with the same equipment identifier as the equipment identifier of the target equipment is selected from the equipment maintenance information base as target equipment maintenance information.

And secondly, displaying all initial equipment maintenance information and all operation equipment maintenance information in the target equipment maintenance information as marking information in the meta-universe display space to obtain a marking meta-universe display space.

And 105, transmitting the labeling meta space to at least one remote terminal for synchronous display.

In some embodiments, the execution body may send the tagging cosmic display space to at least one remote terminal for synchronous display. Wherein the at least one remote terminal is a virtual reality display device.

And 106, performing simulation maintenance on the virtual display model of the target equipment according to the selection of the labeling information in the labeling meta space display space by the field terminal and at least one remote terminal and the maintenance operation on the virtual display model of the target equipment, and obtaining a simulation maintenance result.

In some embodiments, the executing body performs simulation maintenance on the virtual display model of the target device according to the selection of the labeling information in the labeling meta space and the maintenance operation on the virtual display model of the target device by the field terminal and the at least one remote terminal, to obtain a simulation maintenance result, and may include the following steps:

and a first step of responding to the detection of the selection of the labeling information in the labeling meta space by the field terminal and the at least one remote terminal, and displaying the selected labeling information.

And secondly, in response to detection of confirmation operation of the displayed labeling information, performing simulation maintenance on the virtual display model of the target equipment according to the labeling information.

In some optional implementations of some embodiments, the execution body may further perform maintenance on the target device according to a procedure of the simulated maintenance in response to determining that the operation state of the target device is restored to normal as indicated by the simulated maintenance result.

With further reference to fig. 2, as an implementation of the method shown in the above figures, the present disclosure provides some embodiments of a meta-universe based equipment servicing device, corresponding to those method embodiments shown in fig. 1, which may be particularly applicable in a variety of electronic apparatuses.

As shown in fig. 2, the meta-universe based device repair apparatus 200 of some embodiments includes: a receiving unit 201, a determining unit 202, a constructing unit 203, a labeling unit 204, a transmitting unit 205, and an simulating unit 206. Wherein the receiving unit 201 is configured to receive operation monitoring information of a rotating apparatus, wherein the rotating apparatus includes: pump, motor, compressor and combustion engine, the above-mentioned operation monitoring information includes: a device identifier, an operating state identifier; a determining unit 202 configured to determine, in response to determining that the operation status identifier in the operation monitoring information indicates abnormal operation, a rotating device characterized by a device identifier in the operation monitoring information as a target device, and acquire a real-time video stream captured by a field terminal for the target device; a construction unit 203 configured to construct a metauniverse display space according to the real-time video stream, wherein the metauniverse display space includes a virtual display model of the target device; a labeling unit 204 configured to label the meta-universe display space by using an equipment maintenance information base, so as to obtain a labeled meta-universe display space; a transmitting unit 205 configured to transmit the labeling meta space to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device; and a simulation unit 206 configured to perform simulation maintenance on the virtual display model of the target device according to the selection of the labeling information in the labeling meta space display space by the field terminal and the at least one remote terminal and the maintenance operation on the virtual display model of the target device, so as to obtain a simulation maintenance result.

It will be appreciated that the elements recited in meta-universe based device repair unit 200 correspond to the various steps in the method described with reference to fig. 1. Thus, the operations, features, and advantages described above with respect to the method are equally applicable to the metauniverse-based device repair apparatus 200 and the units contained therein, and are not described herein.

Referring now to fig. 3, a schematic diagram of an electronic device 300 suitable for use in implementing some embodiments of the present disclosure is shown. The electronic device shown in fig. 3 is merely an example and should not impose any limitations on the functionality and scope of use of embodiments of the present disclosure.

As shown in fig. 3, the electronic device 300 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 301 that may perform various suitable actions and processes in accordance with a program stored in a Read Only Memory (ROM) 302 or a program loaded from a storage means 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the electronic apparatus 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.

In general, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 307 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; and communication means 309. The communication means 309 may allow the electronic device 300 to communicate with other devices wirelessly or by wire to exchange data. While fig. 3 shows an electronic device 300 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead. Each block shown in fig. 3 may represent one device or a plurality of devices as needed.

In particular, according to some embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via communications device 309, or from storage device 308, or from ROM 302. The above-described functions defined in the methods of some embodiments of the present disclosure are performed when the computer program is executed by the processing means 301.

It should be noted that, the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, the computer-readable signal medium may comprise a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving operation monitoring information of a rotating device, wherein the rotating device comprises: pump, motor, compressor and combustion engine, the above-mentioned operation monitoring information includes: a device identifier, an operating state identifier; in response to determining that the operation state identifier in the operation monitoring information represents abnormal operation, determining the rotating equipment represented by the equipment identifier in the operation monitoring information as target equipment, and acquiring a real-time video stream shot by a field terminal aiming at the target equipment; constructing a metauniverse display space according to the real-time video stream, wherein the metauniverse display space comprises a virtual display model of the target equipment; labeling the meta-universe display space by using an equipment maintenance information base to obtain a labeled meta-universe display space; transmitting the labeling meta space to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device; and according to the selection of the labeling information in the labeling meta universe display space by the field terminal and the at least one remote terminal and the maintenance operation of the virtual display model of the target equipment, performing simulation maintenance on the virtual display model of the target equipment, and obtaining a simulation maintenance result.

Computer program code for carrying out operations for some embodiments of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in some embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The described units may also be provided in a processor, for example, described as: a processor includes a receiving unit, a determining unit, a constructing unit, a labeling unit, a transmitting unit, and an simulating unit. The names of these units do not constitute a limitation of the unit itself in some cases, and for example, the receiving unit may also be described as "a unit that receives operation monitoring information of the rotating apparatus".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

Claims

1. A meta-universe based equipment servicing method, comprising:

Receiving operation monitoring information of a rotating device, wherein the rotating device comprises: pump, motor, compressor and combustion engine, the operation monitoring information includes: a device identifier, an operating state identifier;

in response to determining that the operation state identifier in the operation monitoring information represents abnormal operation, determining the rotating equipment represented by the equipment identifier in the operation monitoring information as target equipment, and acquiring a real-time video stream shot by a field terminal aiming at the target equipment;

Constructing a metauniverse display space according to the real-time video stream, wherein the metauniverse display space comprises a virtual display model of the target equipment;

Labeling the meta-universe display space by using an equipment maintenance information base to obtain a labeled meta-universe display space, wherein equipment maintenance information in the equipment maintenance information base comprises: the equipment identification, the initial equipment maintenance information set and the operation equipment maintenance information set, wherein the initial equipment maintenance information in the initial equipment maintenance information set and the operation equipment maintenance information in the operation equipment maintenance information set comprise at least one multimedia information;

transmitting the labeling meta space to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device;

According to the selection of the labeling information in the labeling meta universe display space by the field terminal and the at least one remote terminal and the maintenance operation of the virtual display model of the target equipment, performing simulation maintenance on the virtual display model of the target equipment to obtain a simulation maintenance result;

The construction of the meta-universe display space according to the real-time video stream comprises the following steps:

Determining whether the real-time video stream comprises a two-dimensional code image or not;

In response to determining that the real-time video stream contains a two-dimensional code image, extracting the two-dimensional code image from the real-time video stream to obtain a two-dimensional code image set;

grouping each two-dimensional code image in the two-dimensional code image set to obtain a two-dimensional code image group set;

generating a to-be-determined two-dimensional code image set based on each two-dimensional code image set in the two-dimensional code image set;

acquiring equipment model information represented by each undetermined two-dimensional code image set in the undetermined two-dimensional code image sets to obtain equipment model information sets;

determining the equipment model information meeting preset conditions in the equipment model information set as target equipment model information;

Constructing a meta space display space by utilizing a virtual display model and preset display background information in the target equipment model information;

Each two-dimensional code image in the two-dimensional code image set is subjected to grouping processing to obtain a two-dimensional code image group set, and the method comprises the following steps:

For each two-dimensional code image in the two-dimensional code image set, executing the following image preprocessing substeps:

Identifying a two-dimensional code image area in the two-dimensional code image by utilizing a pre-trained two-dimensional code identification model;

cutting the identified two-dimensional code image area from the two-dimensional code image to obtain a cut two-dimensional code area;

performing plane projection processing on the cut two-dimensional code area to obtain a projected two-dimensional code area image;

grouping the projected two-dimensional code area images according to the obtained overlapping areas among the projected two-dimensional code area images to obtain a projected two-dimensional code area image group set;

Determining the projection image group set as a two-dimensional code image group set;

the method for grouping the projected two-dimensional code area images according to the obtained overlapping areas among the projected two-dimensional code area images to obtain a projected two-dimensional code area image group set comprises the following steps:

Selecting two projected two-dimensional code area images which are not subjected to overlapping area confirmation from the projected two-dimensional code area images to serve as a first projected two-dimensional code area image and a second projected two-dimensional code area image respectively, and executing the following overlapping area confirmation substep by utilizing the first projected two-dimensional code area image and the second projected two-dimensional code area image:

For the first projected two-dimensional code region image, performing the following conversion sub-steps:

performing black and white block identification on the first projection two-dimensional code area image;

converting each identified black and white block into a first binary matrix according to the relative position in the first projection two-dimensional code area image;

Five rows or five columns are selected from the upper, lower, left and right of the first binary matrix respectively and sequentially arranged to be used as first edge vectors, and a first edge vector set is obtained;

for the second projected two-dimensional code region image, performing the following conversion sub-steps:

Performing black and white block identification on the second projected two-dimensional code area image;

Converting each identified black and white block into a second binary matrix according to the relative position in the second projection two-dimensional code area image;

selecting five rows or five columns from the upper, lower, left and right of the second binary matrix respectively to be sequentially arranged as second edge vectors, so as to obtain a second edge vector set;

In response to determining that the first edge vector set and the second edge vector set have first edge vectors and second edge vectors meeting preset comparison conditions, taking the second projected two-dimensional code area image and the first projected two-dimensional code area image as projected two-dimensional code area images with overlapping areas;

taking each projected two-dimensional code area image with the overlapping area as a projected two-dimensional code area image group to obtain a projected two-dimensional code area image group set;

Wherein generating the set of pending two-dimensional code images based on each two-dimensional code image set in the set of two-dimensional code image sets comprises:

for each two-dimensional code image group in the two-dimensional code image group set, executing the following image generation substeps:

In response to determining that a complete two-dimensional code image exists in the two-dimensional code image group, taking the complete two-dimensional code image as a two-dimensional code image in the two-dimensional code image set;

And in response to determining that the complete two-dimensional code image does not exist in the two-dimensional code image group, splicing all the two-dimensional code images in the two-dimensional code image group to obtain spliced two-dimensional code images, and taking the spliced two-dimensional code images as two-dimensional code images in the two-dimensional code image set.

2. The method of claim 1, wherein the method further comprises:

and responding to the determination that the operation state of the target equipment is recovered to be normal by the simulation maintenance result, and maintaining the target equipment according to the process of the simulation maintenance.

3. The method of claim 2, wherein prior to the determining that the operational status identifier in the operational monitoring information represents abnormal operation, determining the rotating device characterized by the device identifier in the operational monitoring information as a target device, and acquiring a real-time video stream captured by a field terminal for the target device, the method further comprises:

Acquiring terminal positioning information of the field terminal;

Determining the equipment position information of the target equipment according to the pre-stored equipment information and the equipment identification of the target equipment;

Generating navigation path information based on the terminal positioning information and the device position information;

and sending the navigation path information to the field terminal for rendering and displaying.

4. The method of claim 3, wherein labeling the metauniverse presentation space with the equipment maintenance information base to obtain a labeled metauniverse presentation space comprises:

Selecting equipment maintenance information with the same equipment identifier as the equipment identifier of the target equipment from the equipment maintenance information base as target equipment maintenance information;

And displaying all initial equipment maintenance information and all operation equipment maintenance information in the target equipment maintenance information as labeling information in the meta-universe display space to obtain a labeling meta-universe display space.

5. The method of claim 4, wherein simulating maintenance of the virtual display model of the target device based on selection of annotation information in the annotation metauniverse display space by the field terminal and the at least one remote terminal and maintenance operations on the virtual display model of the target device, resulting in simulated maintenance results, comprises:

Responsive to detecting selection of annotation information in the annotation meta space by the field terminal and the at least one remote terminal, displaying the selected annotation information;

and in response to detecting the confirmation operation of the displayed annotation information, performing simulation maintenance on the virtual display model of the target equipment according to the annotation information.

6. A meta-universe based device repair apparatus comprising:

A receiving unit configured to receive operation monitoring information of a rotating apparatus, wherein the rotating apparatus includes: pump, motor, compressor and combustion engine, the operation monitoring information includes: a device identifier, an operating state identifier;

A determining unit configured to determine a rotating device characterized by a device identifier in the operation monitoring information as a target device in response to determining that the operation state identifier in the operation monitoring information represents abnormal operation, and acquire a real-time video stream shot by a field terminal for the target device;

A building unit configured to build a metauniverse presentation space from the real-time video stream, wherein the metauniverse presentation space comprises a virtual presentation model of the target device;

the labeling unit is configured to label the meta-universe display space by utilizing an equipment maintenance information base to obtain a labeled meta-universe display space;

A transmitting unit configured to transmit the tagging element universe presentation space to at least one remote terminal for synchronous display, wherein the at least one remote terminal is a virtual reality display device;

the simulation unit is configured to perform simulation maintenance on the virtual display model of the target equipment according to the selection of the labeling information in the labeling meta space display space by the field terminal and the at least one remote terminal and the maintenance operation on the virtual display model of the target equipment, so as to obtain a simulation maintenance result;

Wherein the building unit is further configured to:

7. An electronic device, comprising:

One or more processors;

A storage device having one or more programs stored thereon,

When executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-5.

8. A computer readable medium having stored thereon a computer program, wherein the program when executed by a processor implements the method of any of claims 1-5.