CN113473078A - Infrared operation and maintenance inspection method and device based on augmented reality technology - Google Patents
Infrared operation and maintenance inspection method and device based on augmented reality technology Download PDFInfo
- Publication number
- CN113473078A CN113473078A CN202110641537.6A CN202110641537A CN113473078A CN 113473078 A CN113473078 A CN 113473078A CN 202110641537 A CN202110641537 A CN 202110641537A CN 113473078 A CN113473078 A CN 113473078A
- Authority
- CN
- China
- Prior art keywords
- infrared
- augmented reality
- control module
- fault
- maintenance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 69
- 238000012423 maintenance Methods 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000007689 inspection Methods 0.000 title claims abstract description 23
- 238000005516 engineering process Methods 0.000 title claims abstract description 19
- 239000011521 glass Substances 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 3
- 230000015556 catabolic process Effects 0.000 description 3
- 238000009413 insulation Methods 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000012774 insulation material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention relates to an infrared operation and maintenance inspection method based on an augmented reality technology, which comprises the following specific steps of: step S1: acquiring an infrared fault picture of the fault equipment shot by the augmented reality equipment, and transmitting the infrared fault picture to the control module; step S2: the control module processes the received infrared fault picture, matches the received infrared fault picture with the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, otherwise, the step is switched to S4; step S3: the control module transmits the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation; step S4: the control module transmits the infrared fault picture to the remote control center, auxiliary maintenance information transmitted back by the remote control center is transmitted back to the augmented reality device, and a display screen of the augmented reality device displays the auxiliary maintenance information. Compared with the prior art, the method has the advantages of improving the maintenance efficiency of the power system, saving the maintenance cost and the like.
Description
Technical Field
The invention relates to the technical field of electrical equipment, in particular to an infrared operation and maintenance inspection method and device based on an augmented reality technology.
Background
An important link in the detection process of the power system is partial discharge detection, partial discharge is one of main reasons causing insulation failure and is also an important sign and expression form of insulation degradation, the partial discharge is closely related to the degradation and breakdown process of an insulation material, and the insulation condition of electrical equipment can be effectively reflected. The infrared live test can detect the equipment condition by using technical means under the running state without power failure and without departing from the system, and master whether the equipment is in a normal running state or not so as to determine whether the equipment needs to be overhauled or not and how to overhaul the equipment. However, at present, the fault is mainly processed by inspection personnel, when the fault cannot be solved by itself, the inspection personnel needs to communicate with experts or manufacturers through telephones and the like, the communication mode has limited help for determining the root cause of the problem and solving the problem, the time consumption is serious, and the fault repairing period is long.
Chinese patent CN201310296270.7 discloses a cap integrated with 3D recognition and a 3D recognition method of the cap, which matches a real-time depth map of a photographed external environment and a 3D video image with an environment 3D model library to display a corresponding environment 3D model, but the environment matching is an integral matching, and there are many features to be matched, which cannot perform fast matching for a target feature, and there is no subsequent operation for a matching result.
Disclosure of Invention
The invention aims to provide an infrared operation and maintenance inspection method and device based on an augmented reality technology, aiming at overcoming the defects that the fault encountered by inspection local discharge can only be processed by inspection personnel and the time is seriously consumed by remote assistance in the prior art.
The purpose of the invention can be realized by the following technical scheme:
an infrared operation and maintenance inspection method based on augmented reality technology comprises the following specific steps:
step S1: acquiring an infrared fault picture of fault equipment shot by augmented reality equipment, and transmitting the infrared fault picture to a control module;
step S2: after processing the received infrared fault picture, the control module matches the received infrared fault picture according to the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, otherwise, the step is switched to S4;
step S3: the control module sends the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation;
step S4: the control module transmits the infrared fault picture to the remote control center, auxiliary maintenance information transmitted back by the remote control center is transmitted back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the auxiliary maintenance information.
The augmented reality device is provided with an infrared camera, a depth of field camera and a motion capture camera.
Further, the infrared trouble picture includes an infrared image taken by the infrared camera, a depth map taken by the depth camera, and a 3D video image taken by a motion capture camera.
Further, the infrared image is processed by Photoshop software in the control module.
Further, the depth map is processed by 3DMAX software in the control module.
Further, the 3D video image is processed by MAYA software in the control module.
And a UNREAL Engine is arranged in the control module, the processed infrared image, the depth map and the 3D video image are integrated, and the integrated infrared fault picture is matched with the infrared fault characteristics stored in the infrared fault characteristic library.
Augmented reality equipment is wear-type augmented reality glasses, including helmet, spectacle-frame and the lens that has the display screen function, helmet and spectacle-frame are connected through the linking arm.
Further, the infrared camera, the depth of field camera, and the motion capture camera are fixed to the eyeglass frame.
Furthermore, a rotating shaft is arranged on the connecting arm, and the connecting arm is detachably connected with the helmet.
The device for using the infrared operation and maintenance inspection method based on the augmented reality technology comprises a controller and a memory, wherein the controller comprises a control module, the memory comprises an infrared fault feature library, and the method is stored in the memory in the form of a computer program and executed by the controller, and when executed, the method realizes the following steps:
step S1: acquiring an infrared fault picture of fault equipment shot by augmented reality equipment, and transmitting the infrared fault picture to a control module;
step S2: after processing the received infrared fault picture, the control module matches the received infrared fault picture according to the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, otherwise, the step is switched to S4;
step S3: the control module sends the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation;
step S4: the control module transmits the infrared fault picture to the remote control center, auxiliary maintenance information transmitted back by the remote control center is transmitted back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the auxiliary maintenance information.
Compared with the prior art, the invention has the following beneficial effects:
1. according to the invention, the fault picture is shot through the augmented reality equipment and is matched with the infrared fault characteristics of the infrared fault characteristic library, and the maintenance guide animation guides a worker to maintain, so that the worker can deal with the situations of different faults, and the maintenance efficiency of the power system is improved.
2. According to the invention, the infrared fault picture is transmitted to the remote control center, the remote control center is used for maintenance guidance assistance, and the process of looking up before an expert is omitted, so that the maintenance cost is saved and the time is saved.
3. The augmented reality equipment used by the invention is head-mounted augmented reality glasses, so that a maintenance worker can conveniently wear the head-mounted augmented reality glasses during operation, the helmet is connected with the glasses frame through the connecting arm, the rotating shaft is arranged on the connecting arm, the glasses frame can rotate around the rotating shaft, and the connecting arm is detachably connected with the helmet, so that the connecting arm can be adjusted according to specific fault conditions, and the applicability of the augmented reality equipment is improved.
Drawings
FIG. 1 is a schematic flow chart of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and specific embodiments. The present embodiment is implemented on the premise of the technical solution of the present invention, and a detailed implementation manner and a specific operation process are given, but the scope of the present invention is not limited to the following embodiments.
As shown in fig. 1, an infrared operation and maintenance inspection method based on augmented reality technology matches a fault picture shot by augmented reality equipment with infrared fault characteristics, and guides a worker to maintain through maintenance guide animation, so that the maintenance efficiency of a power system is improved, and the method specifically comprises the following steps:
step S1: acquiring an infrared fault picture of the fault equipment shot by the augmented reality equipment, and transmitting the infrared fault picture to the control module;
step S2: after processing the received infrared fault picture, the control module matches the received infrared fault picture according to the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, and if not, the step is switched to S4;
step S3: the control module sends the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation;
step S4: the control module transmits the infrared fault picture to the remote control center, an expert of the remote center integrates auxiliary maintenance information according to the infrared fault picture, the control module sends the auxiliary maintenance information sent back by the remote control center to the augmented reality equipment, and a display screen of the augmented reality equipment displays the auxiliary maintenance information.
The augmented reality device is provided with an infrared camera, a depth of field camera and a motion capture camera.
The infrared trouble pictures include an infrared image taken by an infrared camera, a depth map taken by a depth camera, and a 3D video image taken by a motion capture camera.
The infrared image is processed by Photoshop software in the control module.
The depth map is processed by 3DMAX software in the control module.
The 3D video images are processed by the MAYA software in the control module.
And a UNREAL Engine is arranged in the control module, the processed infrared image, the depth map and the 3D video image are integrated, and the integrated infrared fault picture is matched with the infrared fault characteristics stored in the infrared fault characteristic library.
Augmented reality equipment is wear-type augmented reality glasses, including helmet, spectacle-frame and the lens that has the display screen function, helmet and spectacle-frame are connected through the linking arm, and the lens can show maintenance guide animation or supplementary maintenance information.
The infrared camera, the depth of field camera and the motion capture camera are fixed on the glasses frame.
Be equipped with the pivot on the linking arm, the spectacle-frame can revolute the pivot and rotate, and the linking arm can be dismantled with the helmet and be connected, can adjust the linking arm according to trouble particular case, exchanges the linking arm to the convenient position of observing the trouble of spectacle-frame.
The device for using the infrared operation and maintenance inspection method based on the augmented reality technology comprises a controller and a memory, wherein the controller comprises a control module, the memory comprises an infrared fault feature library, and the method is stored in the memory in the form of a computer program and executed by the controller, and the following steps are realized when the method is executed:
step S1: acquiring an infrared fault picture of the fault equipment shot by the augmented reality equipment, and transmitting the infrared fault picture to the control module;
step S2: after processing the received infrared fault picture, the control module matches the received infrared fault picture according to the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, and if not, the step is switched to S4;
step S3: the control module sends the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation;
step S4: the control module transmits the infrared fault picture to the remote control center, auxiliary maintenance information transmitted back by the remote control center is transmitted back to the augmented reality device, and a display screen of the augmented reality device displays the auxiliary maintenance information.
In addition, it should be noted that the specific embodiments described in the present specification may have different names, and the above descriptions in the present specification are only illustrations of the structures of the present invention. Minor or simple variations in the structure, features and principles of the present invention are included within the scope of the present invention. Various modifications or additions may be made to the described embodiments or methods may be similarly employed by those skilled in the art without departing from the scope of the invention as defined in the appending claims.
Claims (10)
1. An infrared operation and maintenance inspection method based on an augmented reality technology is characterized by comprising the following specific steps:
step S1: acquiring an infrared fault picture of fault equipment shot by augmented reality equipment, and transmitting the infrared fault picture to a control module;
step S2: after processing the received infrared fault picture, the control module matches the received infrared fault picture according to the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, otherwise, the step is switched to S4;
step S3: the control module sends the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation;
step S4: the control module transmits the infrared fault picture to the remote control center, auxiliary maintenance information transmitted back by the remote control center is transmitted back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the auxiliary maintenance information.
2. The infrared operation and maintenance inspection method based on the augmented reality technology according to claim 1, wherein an infrared camera, a depth camera and a motion capture camera are arranged on the augmented reality device.
3. The infrared operation and maintenance inspection method based on augmented reality technology according to claim 2, wherein the infrared fault picture comprises an infrared image taken by the infrared camera, a depth map taken by the depth camera, and a 3D video image taken by a motion capture camera.
4. The infrared operation and maintenance inspection method based on the augmented reality technology according to claim 3, wherein the infrared image is processed by Photoshop software in a control module.
5. The infrared operation and maintenance inspection method based on the augmented reality technology according to claim 3, wherein the depth map is processed by 3DMAX software in a control module.
6. The infrared operation and maintenance inspection method based on the augmented reality technology according to claim 3, wherein the 3D video image is processed by MAYA software in a control module.
7. The infrared operation and maintenance inspection method based on the augmented reality technology according to claim 2, wherein the augmented reality equipment is head-mounted augmented reality glasses and comprises a helmet, a glasses frame and lenses with a display screen function, and the helmet and the glasses frame are connected through a connecting arm.
8. The infrared operation and maintenance inspection method based on augmented reality technology according to claim 7, wherein the infrared camera, the depth camera and the motion capture camera are fixed on the glasses frame.
9. The infrared operation and maintenance inspection method based on the augmented reality technology according to claim 7, wherein a rotating shaft is arranged on the connecting arm, and the connecting arm is detachably connected with the helmet.
10. An apparatus using the infrared operation and maintenance inspection method based on augmented reality technology according to any one of claims 1-9, characterized in that the apparatus comprises a controller and a memory, the controller comprises a control module, the memory comprises an infrared fault feature library, the method is stored in the memory in the form of a computer program and executed by the controller, and when executed, the method realizes the following steps:
step S1: acquiring an infrared fault picture of fault equipment shot by augmented reality equipment, and transmitting the infrared fault picture to a control module;
step S2: after processing the received infrared fault picture, the control module matches the received infrared fault picture according to the infrared fault features stored in the infrared fault feature library, if the matching is successful, the step is switched to S3, otherwise, the step is switched to S4;
step S3: the control module sends the maintenance guidance animation of the infrared fault characteristics matched with the infrared fault picture back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the maintenance guidance animation;
step S4: the control module transmits the infrared fault picture to the remote control center, auxiliary maintenance information transmitted back by the remote control center is transmitted back to the augmented reality equipment, and a display screen of the augmented reality equipment displays the auxiliary maintenance information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110641537.6A CN113473078A (en) | 2021-06-09 | 2021-06-09 | Infrared operation and maintenance inspection method and device based on augmented reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110641537.6A CN113473078A (en) | 2021-06-09 | 2021-06-09 | Infrared operation and maintenance inspection method and device based on augmented reality technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113473078A true CN113473078A (en) | 2021-10-01 |
Family
ID=77869403
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110641537.6A Pending CN113473078A (en) | 2021-06-09 | 2021-06-09 | Infrared operation and maintenance inspection method and device based on augmented reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113473078A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025648A (en) * | 2017-03-20 | 2017-08-08 | 中国人民解放军空军工程大学 | A kind of board failure infrared image automatic testing method |
| CN107798391A (en) * | 2016-08-31 | 2018-03-13 | 王振福 | A kind of analysis of equipment fault using augmented reality and maintenance system |
| WO2018120090A1 (en) * | 2016-12-30 | 2018-07-05 | 深圳市柔宇科技有限公司 | Augmented reality interface implementation method and head-mounted display device |
| CN108879440A (en) * | 2018-06-20 | 2018-11-23 | 国网山东省电力公司济宁供电公司 | Intelligent examination and repair system and method based on wearable augmented reality display terminal and cloud platform |
| CN110212451A (en) * | 2019-05-28 | 2019-09-06 | 国网江西省电力有限公司电力科学研究院 | A kind of electric power AR intelligent patrol detection device |
| CN110736547A (en) * | 2019-10-17 | 2020-01-31 | 华能海南发电股份有限公司 | Photovoltaic panel fault intelligent diagnosis system based on infrared imaging technology |
| CN112001709A (en) * | 2020-09-04 | 2020-11-27 | 贵州电网有限责任公司 | Intelligent assignment scheduling AR multi-person remote assistance method based on ant colony algorithm |
| CN112018892A (en) * | 2020-09-04 | 2020-12-01 | 南京太司德智能电气有限公司 | Electric power operation and maintenance remote guidance system |
| US20200387127A1 (en) * | 2017-12-04 | 2020-12-10 | Enertiv Inc. | Technologies for fault related visual content |
| CN112729884A (en) * | 2020-12-22 | 2021-04-30 | 河北建设投资集团有限责任公司 | Equipment fault diagnosis method and device based on big data |
-
2021
- 2021-06-09 CN CN202110641537.6A patent/CN113473078A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107798391A (en) * | 2016-08-31 | 2018-03-13 | 王振福 | A kind of analysis of equipment fault using augmented reality and maintenance system |
| WO2018120090A1 (en) * | 2016-12-30 | 2018-07-05 | 深圳市柔宇科技有限公司 | Augmented reality interface implementation method and head-mounted display device |
| CN107025648A (en) * | 2017-03-20 | 2017-08-08 | 中国人民解放军空军工程大学 | A kind of board failure infrared image automatic testing method |
| US20200387127A1 (en) * | 2017-12-04 | 2020-12-10 | Enertiv Inc. | Technologies for fault related visual content |
| CN108879440A (en) * | 2018-06-20 | 2018-11-23 | 国网山东省电力公司济宁供电公司 | Intelligent examination and repair system and method based on wearable augmented reality display terminal and cloud platform |
| CN110212451A (en) * | 2019-05-28 | 2019-09-06 | 国网江西省电力有限公司电力科学研究院 | A kind of electric power AR intelligent patrol detection device |
| CN110736547A (en) * | 2019-10-17 | 2020-01-31 | 华能海南发电股份有限公司 | Photovoltaic panel fault intelligent diagnosis system based on infrared imaging technology |
| CN112001709A (en) * | 2020-09-04 | 2020-11-27 | 贵州电网有限责任公司 | Intelligent assignment scheduling AR multi-person remote assistance method based on ant colony algorithm |
| CN112018892A (en) * | 2020-09-04 | 2020-12-01 | 南京太司德智能电气有限公司 | Electric power operation and maintenance remote guidance system |
| CN112729884A (en) * | 2020-12-22 | 2021-04-30 | 河北建设投资集团有限责任公司 | Equipment fault diagnosis method and device based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7156731B2 (en) | Work support device, work support method and program | |
| US11676257B2 (en) | Method and device for detecting defect of meal box, server, and storage medium | |
| CN109934123B (en) | Fault code recognition system and method based on OCR technology, internet and AR technology | |
| CN109541828A (en) | A kind of the Mask Failure detection device and method of open air LCD operation maintenance system | |
| CN103359020A (en) | Motorcycle driving training or examination monitoring method and system | |
| CN103024428A (en) | Automatic correction device of panorama image system and correction method | |
| CN112616018B (en) | Stackable panoramic video real-time splicing method | |
| CN107480797B (en) | LNG dispenser fault diagnosis and elimination system and operation method thereof | |
| CN105046635A (en) | Intelligent substation equipment identification system and method based on Google glasses | |
| CN114007044A (en) | Opencv-based image splicing system and method | |
| CN114663996A (en) | Intelligent equipment inspection system based on AR augmented reality technology | |
| CN109326125A (en) | Picture quality diagnostic system and diagnostic method based on embedded system | |
| CN113473078A (en) | Infrared operation and maintenance inspection method and device based on augmented reality technology | |
| EP4020312A1 (en) | Traffic light recognition method, apparatus, device, storage medium, and program product | |
| CN110889514A (en) | Air traffic control station equipment emergency repair remote support system and method | |
| CN116152945A (en) | Under-mine inspection system and method based on AR technology | |
| CN115733957A (en) | Navigation equipment alarm processing method based on image recognition | |
| CN215897815U (en) | Auxiliary device for fault diagnosis of tobacco mechanical equipment | |
| CN115047624B (en) | Intelligent glasses control system | |
| CN106851190A (en) | A kind of low-power consumption electric power facility visualization of 3 d monitoring technology | |
| CN115619748A (en) | Method for monitoring glue color abnormity in gluing process of wind power blade | |
| CN212709189U (en) | Vehicle-mounted intelligent w-hud head-up display system | |
| CN113472998B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN115410154A (en) | Method for identifying thermal fault of electrical equipment of wind power engine room | |
| CN110944159A (en) | Information processing method, electronic equipment and information processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211001 |