CN116228778A - Insulator rupture detection method and system based on multi-mode information fusion - Google Patents
Insulator rupture detection method and system based on multi-mode information fusion Download PDFInfo
- Publication number
- CN116228778A CN116228778A CN202310518728.2A CN202310518728A CN116228778A CN 116228778 A CN116228778 A CN 116228778A CN 202310518728 A CN202310518728 A CN 202310518728A CN 116228778 A CN116228778 A CN 116228778A
- Authority
- CN
- China
- Prior art keywords
- insulator
- cracking
- breakage
- visible light
- inspection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N25/00—Investigating or analyzing materials by the use of thermal means
- G01N25/72—Investigating presence of flaws
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8887—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Pathology (AREA)
- Computing Systems (AREA)
- Analytical Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Immunology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Biochemistry (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Radiation Pyrometers (AREA)
- Investigating Or Analyzing Materials Using Thermal Means (AREA)
Abstract
The invention belongs to the technical field of insulator detection, and provides a method and a system for detecting insulator breakage based on multi-mode information fusion, which are used for solving the problem that accurate identification is difficult to realize by simply relying on a single-mode information method. The method for detecting the insulator breakage based on the multi-mode information fusion comprises the steps of identifying whether an insulator breakage abnormal region exists in an insulator inspection visible light image or not, and identifying whether an insulator temperature abnormal state region exists in an insulator inspection infrared image or not; when the insulator cracking abnormal region and the insulator temperature abnormal state region exist, calculating the intersection ratio of the insulator cracking region and the insulator temperature abnormal state region, and finally judging whether the insulator has a cracking defect according to the comparison result of the intersection ratio and a preset first threshold value, so that the accuracy of the insulator cracking defect is improved.
Description
Technical Field
The invention belongs to the technical field of insulator detection, and particularly relates to a method and a system for detecting insulator breakage based on multi-mode information fusion.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
In an electric power system, the use of insulators is to mechanically connect conductors with different units, and the insulators have an insulating effect on electric equipment or conductors and a fixing and hanging effect as parts with huge consumption and various types in a power grid. Because the insulator runs under the environments of strong electric field, high Wen Rizhao, mechanical stress, humidity, pollution and the like for a long time, when the insulator is deteriorated to a certain degree, the insulation performance of the insulator is reduced, and particularly on a high-voltage line, the deterioration of the insulator directly threatens the safe operation of a power system.
On one hand, the types of transformer substation equipment are various, the scenes are complex, the similarity of power equipment parts is high, and the equipment defect identification false detection rate is high; on the other hand, in an actual transformer substation scene, the occurrence frequency of the insulator defects is low, the insulator defects are located at the high position of the transformer substation, the swing shooting cannot be simulated manually, and the phenomenon that samples are few and are difficult to collect is caused. In insulator state monitoring, only the magnitude of the temperature rise value of the insulator or intelligent detection of equipment defects are considered, so that errors of detection results are easily caused, and normal operation of insulation is further affected. Therefore, accurate identification is difficult to achieve by simply relying on a single-mode information method.
Disclosure of Invention
In order to solve the technical problems in the background art, the invention provides a method and a system for detecting the breakage of an insulator based on multi-mode information fusion, which can realize the accurate identification and positioning of the breakage defect of the insulator.
In order to achieve the above purpose, the present invention adopts the following technical scheme:
the first aspect of the invention provides a method for detecting insulator breakage based on multi-mode information fusion.
A method for detecting insulator breakage based on multi-mode information fusion comprises the following steps:
acquiring an insulator inspection visible light image and an insulator inspection infrared image;
identifying whether an insulator cracking abnormal region exists in the insulator inspection visible light image, and identifying whether an insulator temperature abnormal state region exists in the insulator inspection infrared image;
when the insulator cracking abnormal region and the insulator temperature abnormal state region exist, calculating the intersection ratio of the insulator cracking region and the insulator temperature abnormal state region, and finally judging whether the insulator has cracking defects according to the comparison result of the intersection ratio and a preset first threshold value.
As an implementation mode, in the process of identifying whether an insulator cracking abnormal region exists in an insulator inspection visible light image, detecting all cracking abnormal regions and corresponding rectangular frame positions in the insulator inspection visible light image; then, all the images of the insulator cracking abnormal region are intercepted, and the images of the edge cracking abnormal region are finally identified according to the two classifiers.
As an implementation mode, a two-stage cascade model is adopted to process the visible light image of the insulator inspection, and whether an insulator cracking abnormal region exists or not is identified; the two-stage cascading model comprises a power transformation insulator cracking defect model and a classifier which are connected in series.
As one embodiment, in the process of identifying whether there is an insulator breakage abnormal region from the insulator inspection visible light image, further comprising:
weighting the probability of the output results of the power transformation insulator cracking defect model and the two classifiers respectively according to the preset output result influence factors of the power transformation insulator cracking defect model and the two classifiers, and judging that the edge cracking abnormal region exists when the weighted result exceeds a preset second threshold value.
As one embodiment, when the intersection ratio is greater than a preset first threshold value, it is determined that the insulator has a breakage defect.
In one embodiment, when the cross-over ratio is less than or equal to a preset first threshold, the insulator is judged to have a potential cracking defect, and a notification that further checking is needed is sent out.
As one implementation mode, when the potential cracking defect of the insulator is judged, and the potential cracking defect still exists after the insulator is monitored for a plurality of times in a time period, alarm information is sent out to inform the manual recheck of the fault.
The second aspect of the invention provides a multi-mode information fusion-based insulator breakage detection system.
A multi-modal information fusion based insulator rupture detection system comprising:
the image acquisition module is used for acquiring an insulator inspection visible light image and an insulator inspection infrared image;
the image processing module is used for identifying whether an insulator cracking abnormal region exists in the insulator inspection visible light image or not, and identifying whether an insulator temperature abnormal state region exists in the insulator inspection infrared image or not;
and the defect judging module is used for calculating the intersection ratio of the insulator cracking area and the insulator temperature abnormal state area when the insulator cracking abnormal area and the insulator temperature abnormal state area exist, and finally judging whether the insulator has a cracking defect or not according to the comparison result of the intersection ratio and a preset first threshold value.
In the image processing module, in the process of identifying whether an insulator cracking abnormal region exists in an insulator inspection visible light image, detecting all cracking abnormal regions and corresponding rectangular frame positions in the insulator inspection visible light image; then, all the images of the insulator cracking abnormal region are intercepted, and the images of the edge cracking abnormal region are finally identified according to the two classifiers.
In the image processing module, a two-stage cascade model is adopted to process the visible light image of the insulator inspection, and whether an insulator cracking abnormal region exists or not is identified; the two-stage cascading model comprises a power transformation insulator cracking defect model and a classifier which are connected in series.
Compared with the prior art, the invention has the beneficial effects that:
the innovation provides a multi-mode information fusion insulator breakage detection technology, a multi-mode image processing method combining a visible light image and an infrared image is adopted, a visible light image defect area is obtained by detecting and reclassifying the visible light image, the accurate positioning of the insulator breakage defect is realized, the temperature of an insulator sheet is obtained by infrared temperature measurement on the infrared image, and whether the insulator breakage defect is further judged according to the temperature distribution condition, so that the problem that accurate identification is difficult to realize by simply relying on a single-mode information method is solved, and the accuracy of the insulator breakage defect is improved.
Additional aspects of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention.
FIG. 1 is a flowchart of a method for detecting insulator breakage based on multi-modal information fusion in an embodiment of the invention;
fig. 2 is a schematic structural diagram of a detection system for insulator breakage based on multi-mode information fusion according to an embodiment of the present invention.
Detailed Description
The invention will be further described with reference to the drawings and examples.
It should be noted that the following detailed description is illustrative and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the present invention. As used herein, the singular is also intended to include the plural unless the context clearly indicates otherwise, and furthermore, it is to be understood that the terms "comprises" and/or "comprising" when used in this specification are taken to specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof.
Example 1
Referring to fig. 1, the method for detecting insulator breakage based on multi-mode information fusion according to the present embodiment includes:
step 1: and acquiring an insulator inspection visible light image and an insulator inspection infrared image.
The insulator inspection visible light image and the insulator inspection infrared image comprise video monitoring images, and robot or unmanned aerial vehicle inspection images.
Step 2: and identifying whether an insulator cracking abnormal region exists in the insulator inspection visible light image, and identifying whether an insulator temperature abnormal state region exists in the insulator inspection infrared image.
The surface temperature is typically 10-40 degrees when the insulator device is operating normally. Once the insulator porcelain body is broken and other defects occur, leakage current occurs in the insulator to cause heating. The surface temperature may rise to hundreds of degrees or even thousands of degrees due to the temperature rise at the damaged portion, the increase of internal penetrating leakage current, the increase of heat generation, and the like caused by the deterioration of the insulator.
In the specific implementation process, in the process of identifying whether an insulator cracking abnormal region exists in an insulator inspection visible light image, detecting all cracking abnormal regions and corresponding rectangular frame positions in the insulator inspection visible light image; then, all the images of the insulator cracking abnormal region are intercepted, and the images of the edge cracking abnormal region are finally identified according to the two classifiers.
For example: and processing the visible light image of the insulator inspection by using a two-stage cascade model. The two-stage cascading model comprises a power transformation insulator cracking defect model and a classifier which are connected in series.
The process for processing the visible light image of the insulator inspection by using the two-stage cascade model comprises the following steps:
processing the inspection image by using a power transformation insulator cracking defect model, and judging all cracking anomalies and the corresponding rectangular frame positions in the visible light image of the insulator inspection;
and according to the rectangular frame positions of all the insulator cracking abnormal areas, all the insulator cracking abnormal area images are intercepted from the inspection image, and then the image with the edge cracking abnormal area is finally identified according to the two classifiers.
In other embodiments, in identifying whether there is an insulator breakage abnormal region from the insulator inspection visible light image, further comprising:
weighting the probability of the output results of the power transformation insulator cracking defect model and the two classifiers respectively according to the preset output result influence factors of the power transformation insulator cracking defect model and the two classifiers, and judging that the edge cracking abnormal region exists when the weighted result exceeds a preset second threshold value.
The value of the second threshold may be specifically set by those skilled in the art according to the actual accuracy requirement, and will not be described in detail herein.
In this embodiment, the insulator breakage does not depend entirely on the results of the classification model, and the two-stage models (the electric power transformation insulator breakage defect model and the two classifiers, respectively) are set to detect the result influencing factors by evaluating the accuracy of the models, respectively. The stage 1 model is a power transformation insulator cracking defect model. The stage 2 model is a classifier.
If the detection result recognition rate of the stage 1 model is very high, the detection result of the stage 1 influences the factor range 0.7-1, and the detection result of the stage 2 influences the factor range 0-0.3; otherwise, the detection result of the stage 2 affects the factor range 0.7-1, and the detection result of the stage 1 affects the factor range 0-0.3; if the two-stage model recognition rate is not equal, the two influencing factors are respectively 0.5.
In the training process of the power transformation insulator cracking defect model and the classifier, a rectangular frame area of equipment defects is intercepted based on image information and xml files of an insulator cracking sample library, and an insulator cracking and insulator normal classification sample library is constructed.
For example: the power transformation insulator breakage defect model adopts a common target detection algorithm (a YOLO algorithm, a Cascade-Rcnn algorithm, a fast-Rcnn algorithm and the like) and is used for positioning power transformation equipment in the inspection image; the classifier then employs, for example: alexNet algorithm, VGG algorithm, resNet algorithm, etc. The embodiment further judges whether the equipment is defective or not by combining the detection and classification results, thereby realizing accurate positioning of the equipment defect.
Step 3: when the insulator cracking abnormal region and the insulator temperature abnormal state region exist, calculating the intersection ratio of the insulator cracking region and the insulator temperature abnormal state region, and finally judging whether the insulator has cracking defects or not according to the comparison result of the intersection ratio and a preset first threshold (for example, 0.5 or other values).
And judging that the insulator has a cracking defect when the cross ratio is larger than a preset first threshold value. And when the cross ratio is smaller than or equal to a preset first threshold value, judging that the potential cracking defect exists in the insulator, and sending a notification of further checking. When the potential breakage defect of the insulator is judged, and the insulator is still abnormal after being monitored for a plurality of times in a time period, an alarm is sent out to inform the possibility of the existence of the manual recheck fault.
In the embodiment, if the visible light image analysis result and the infrared image analysis result are abnormal, judging that the insulator breakage defect exists, and sending the insulator breakage defect to a mobile phone of a line operation and maintenance personnel as emergency defect information to solve potential faults in time; if the visible light image analysis result or the infrared image analysis result is abnormal, the potential defect is reported to the background, the monitoring is carried out for multiple times in a time-sharing way, if the potential defect is abnormal, the alarm is sent to the background, and the possibility of the existence of the fault is rechecked manually.
Example two
As shown in fig. 2, the embodiment provides a multi-mode information fusion-based insulator breakage detection system, which includes:
(1) The image acquisition module is used for acquiring the visible light images and the infrared images of the insulator inspection.
(2) The image processing module is used for identifying whether an insulator cracking abnormal region exists in the insulator inspection visible light image or not, and identifying whether an insulator temperature abnormal state region exists in the insulator inspection infrared image or not.
Specifically, in the image processing module, in the process of identifying whether an insulator cracking abnormal region exists in an insulator inspection visible light image, all cracking abnormal regions and corresponding rectangular frame positions in the insulator inspection visible light image are detected first; then, all the images of the insulator cracking abnormal region are intercepted, and the images of the edge cracking abnormal region are finally identified according to the two classifiers.
In the image processing module, a two-stage cascade model is adopted to process the visible light image of the insulator inspection, and whether an insulator cracking abnormal region exists or not is identified; the two-stage cascading model comprises a power transformation insulator cracking defect model and a classifier which are connected in series.
(3) And the defect judging module is used for calculating the intersection ratio of the insulator cracking area and the insulator temperature abnormal state area when the insulator cracking abnormal area and the insulator temperature abnormal state area exist, and finally judging whether the insulator has a cracking defect or not according to the comparison result of the intersection ratio and a preset first threshold value.
And in the defect judging module, judging that the insulator has defects when the cross ratio is larger than a preset first threshold value. And in the defect judging module, when the cross ratio is smaller than or equal to a preset first threshold value, judging that the potential defect exists in the insulator, and sending a notification of further checking.
It should be noted that, each module in the embodiment corresponds to each step in the first embodiment one to one, and the implementation process is the same, which is not described here.
In other embodiments, there is also provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps in the method for detecting insulator breakage based on multimodal information fusion as described above.
In some embodiments, there is also provided a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the method of detecting insulator breakage based on multimodal information fusion as described above when the program is executed.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. The method for detecting the insulator breakage based on the multi-mode information fusion is characterized by comprising the following steps of:
acquiring an insulator inspection visible light image and an insulator inspection infrared image;
identifying whether an insulator cracking abnormal region exists in the insulator inspection visible light image, and identifying whether an insulator temperature abnormal state region exists in the insulator inspection infrared image;
when the insulator cracking abnormal region and the insulator temperature abnormal state region exist, calculating the intersection ratio of the insulator cracking region and the insulator temperature abnormal state region, and finally judging whether the insulator has cracking defects according to the comparison result of the intersection ratio and a preset first threshold value.
2. The method for detecting the breakage of the insulator based on the multi-mode information fusion according to claim 1, wherein in the process of identifying whether an insulator breakage abnormal region exists in an insulator inspection visible light image, all breakage abnormalities in the insulator inspection visible light image and the positions of the corresponding rectangular frames are detected first; then, all the images of the insulator cracking abnormal region are intercepted, and the images of the edge cracking abnormal region are finally identified according to the two classifiers.
3. The method for detecting the breakage of the insulator based on the multi-mode information fusion according to claim 1 or 2, wherein a two-stage cascade model is adopted to process the visible light image of the insulator inspection, and whether an abnormal region of the breakage of the insulator exists or not is identified; the two-stage cascading model comprises a power transformation insulator cracking defect model and a classifier which are connected in series.
4. The method for detecting insulator breakage based on multi-modal information fusion as claimed in claim 3, wherein in the process of identifying whether there is an insulator breakage abnormal region from the insulator inspection visible light image, further comprising:
weighting the probability of the output results of the power transformation insulator cracking defect model and the two classifiers respectively according to the preset output result influence factors of the power transformation insulator cracking defect model and the two classifiers, and judging that the edge cracking abnormal region exists when the weighted result exceeds a preset second threshold value.
5. The method for detecting breakage of an insulator based on multi-mode information fusion according to claim 1, wherein when the cross-over ratio is greater than a preset first threshold, it is determined that the insulator has a breakage defect.
6. The method for detecting breakage of an insulator based on multi-modal information fusion as claimed in claim 1, wherein when the cross-over ratio is smaller than or equal to a preset first threshold, it is determined that a potential breakage defect exists in the insulator, and a notification that further checking is required is issued.
7. The method for detecting breakage of an insulator based on multi-mode information fusion according to claim 6, wherein when the potential breakage defect of the insulator is judged and the potential breakage defect still exists after monitoring for a plurality of times in a time period, an alarm message is sent to inform the manual recheck of the fault.
8. The utility model provides a detection system that insulator breaks based on multimodal information fuses which characterized in that includes:
the image acquisition module is used for acquiring an insulator inspection visible light image and an insulator inspection infrared image;
the image processing module is used for identifying whether an insulator cracking abnormal region exists in the insulator inspection visible light image or not, and identifying whether an insulator temperature abnormal state region exists in the insulator inspection infrared image or not;
and the defect judging module is used for calculating the intersection ratio of the insulator cracking area and the insulator temperature abnormal state area when the insulator cracking abnormal area and the insulator temperature abnormal state area exist, and finally judging whether the insulator has a cracking defect or not according to the comparison result of the intersection ratio and a preset first threshold value.
9. The multi-mode information fusion-based insulator rupture detection system according to claim 8, wherein in the image processing module, in the process of identifying whether an insulator rupture abnormality area exists in an insulator inspection visible light image, all rupture abnormalities in the insulator inspection visible light image and the positions of the corresponding rectangular frames are detected first; then, all the images of the insulator cracking abnormal region are intercepted, and the images of the edge cracking abnormal region are finally identified according to the two classifiers.
10. The multi-mode information fusion-based insulator breakage detection system according to claim 8 or 9, wherein in the image processing module, a two-stage cascade model is adopted to process an insulator inspection visible light image, and whether an insulator breakage abnormal region exists or not is identified; the two-stage cascading model comprises a power transformation insulator cracking defect model and a classifier which are connected in series.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310518728.2A CN116228778B (en) | 2023-05-10 | 2023-05-10 | Insulator rupture detection method and system based on multi-mode information fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310518728.2A CN116228778B (en) | 2023-05-10 | 2023-05-10 | Insulator rupture detection method and system based on multi-mode information fusion |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116228778A true CN116228778A (en) | 2023-06-06 |
| CN116228778B CN116228778B (en) | 2023-09-08 |
Family
ID=86570007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310518728.2A Active CN116228778B (en) | 2023-05-10 | 2023-05-10 | Insulator rupture detection method and system based on multi-mode information fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116228778B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117496133A (en) * | 2024-01-03 | 2024-02-02 | 山东工商学院 | Closed bus R-CNN temperature fault monitoring method based on multi-mode data |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005164565A (en) * | 2003-11-28 | 2005-06-23 | 3B System Inc | Defect detection method for flat panel light- related plate element in low and high resolution images |
| CN105043993A (en) * | 2015-07-14 | 2015-11-11 | 国网山东省电力公司电力科学研究院 | Method for detecting composite insulator based on multi-spectrum |
| CN204992418U (en) * | 2015-09-22 | 2016-01-20 | 南方电网科学研究院有限责任公司 | Automatic inspection device for defects of unmanned aerial vehicle power transmission line |
| CN105486751A (en) * | 2016-01-26 | 2016-04-13 | 国网上海市电力公司 | Equipment defect comprehensive detection system |
| US20170094228A1 (en) * | 2015-06-29 | 2017-03-30 | Quantum IR Technologies, LLC | Methods and systems for hotspot detection |
| CN107766801A (en) * | 2017-09-28 | 2018-03-06 | 中国南方电网有限责任公司超高压输电公司检修试验中心 | A kind of insulator recognition methods and device based on infrared heat point tracking |
| WO2018086299A1 (en) * | 2016-11-11 | 2018-05-17 | 广东电网有限责任公司清远供电局 | Image processing-based insulator defect detection method and system |
| CN108872819A (en) * | 2018-07-29 | 2018-11-23 | 湖南湖大华龙电气与信息技术有限公司 | Isolator detecting unmanned plane and method based on infrared thermal imagery and visible light |
| CN111650204A (en) * | 2020-05-11 | 2020-09-11 | 安徽继远软件有限公司 | Transmission line hardware defect detection method and system based on cascade target detection |
| CN111652857A (en) * | 2020-05-20 | 2020-09-11 | 国网河北省电力有限公司检修分公司 | Infrared detection method for insulator defects |
| WO2022052181A1 (en) * | 2020-09-09 | 2022-03-17 | 华北电力大学（保定） | Insulator defect detection method and system based on zero-shot learning |
| CN114359695A (en) * | 2021-12-31 | 2022-04-15 | 三峡大学 | Insulator breakage identification method based on uncertainty estimation |
| CN114429457A (en) * | 2022-01-19 | 2022-05-03 | 中国电建集团中南勘测设计研究院有限公司 | Intelligent fan blade defect detection method based on bimodal fusion |
| CN114612406A (en) * | 2022-03-03 | 2022-06-10 | 南京理工大学 | Photovoltaic panel defect detection method based on visible light and infrared vision |
| CN114792319A (en) * | 2022-06-23 | 2022-07-26 | 国网浙江省电力有限公司电力科学研究院 | Transformer substation inspection method and system based on transformer substation image |
| CN114841980A (en) * | 2022-05-19 | 2022-08-02 | 国网山东省电力公司潍坊市寒亭区供电公司 | Insulator defect detection method and system based on line patrol aerial image |
| CN115049663A (en) * | 2022-08-16 | 2022-09-13 | 星逻智能科技(苏州)有限公司 | Unmanned aerial vehicle-based double-light fusion insulator defect detection method and system |
| CN115546909A (en) * | 2022-10-11 | 2022-12-30 | 重庆紫光华山智安科技有限公司 | Living body detection method and device, access control system, equipment and storage medium |
| CN115601355A (en) * | 2022-11-10 | 2023-01-13 | 四川启睿克科技有限公司（Cn） | Method and device for detecting and classifying product surface defects and storage medium |
| CN116091472A (en) * | 2023-02-20 | 2023-05-09 | 浙江大学 | Intelligent detection method for defects of photovoltaic module by fusing visible light and infrared images |
-
2023
- 2023-05-10 CN CN202310518728.2A patent/CN116228778B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005164565A (en) * | 2003-11-28 | 2005-06-23 | 3B System Inc | Defect detection method for flat panel light- related plate element in low and high resolution images |
| US20170094228A1 (en) * | 2015-06-29 | 2017-03-30 | Quantum IR Technologies, LLC | Methods and systems for hotspot detection |
| CN105043993A (en) * | 2015-07-14 | 2015-11-11 | 国网山东省电力公司电力科学研究院 | Method for detecting composite insulator based on multi-spectrum |
| CN204992418U (en) * | 2015-09-22 | 2016-01-20 | 南方电网科学研究院有限责任公司 | Automatic inspection device for defects of unmanned aerial vehicle power transmission line |
| CN105486751A (en) * | 2016-01-26 | 2016-04-13 | 国网上海市电力公司 | Equipment defect comprehensive detection system |
| WO2018086299A1 (en) * | 2016-11-11 | 2018-05-17 | 广东电网有限责任公司清远供电局 | Image processing-based insulator defect detection method and system |
| CN107766801A (en) * | 2017-09-28 | 2018-03-06 | 中国南方电网有限责任公司超高压输电公司检修试验中心 | A kind of insulator recognition methods and device based on infrared heat point tracking |
| CN108872819A (en) * | 2018-07-29 | 2018-11-23 | 湖南湖大华龙电气与信息技术有限公司 | Isolator detecting unmanned plane and method based on infrared thermal imagery and visible light |
| CN111650204A (en) * | 2020-05-11 | 2020-09-11 | 安徽继远软件有限公司 | Transmission line hardware defect detection method and system based on cascade target detection |
| CN111652857A (en) * | 2020-05-20 | 2020-09-11 | 国网河北省电力有限公司检修分公司 | Infrared detection method for insulator defects |
| WO2022052181A1 (en) * | 2020-09-09 | 2022-03-17 | 华北电力大学（保定） | Insulator defect detection method and system based on zero-shot learning |
| CN114359695A (en) * | 2021-12-31 | 2022-04-15 | 三峡大学 | Insulator breakage identification method based on uncertainty estimation |
| CN114429457A (en) * | 2022-01-19 | 2022-05-03 | 中国电建集团中南勘测设计研究院有限公司 | Intelligent fan blade defect detection method based on bimodal fusion |
| CN114612406A (en) * | 2022-03-03 | 2022-06-10 | 南京理工大学 | Photovoltaic panel defect detection method based on visible light and infrared vision |
| CN114841980A (en) * | 2022-05-19 | 2022-08-02 | 国网山东省电力公司潍坊市寒亭区供电公司 | Insulator defect detection method and system based on line patrol aerial image |
| CN114792319A (en) * | 2022-06-23 | 2022-07-26 | 国网浙江省电力有限公司电力科学研究院 | Transformer substation inspection method and system based on transformer substation image |
| CN115049663A (en) * | 2022-08-16 | 2022-09-13 | 星逻智能科技(苏州)有限公司 | Unmanned aerial vehicle-based double-light fusion insulator defect detection method and system |
| CN115546909A (en) * | 2022-10-11 | 2022-12-30 | 重庆紫光华山智安科技有限公司 | Living body detection method and device, access control system, equipment and storage medium |
| CN115601355A (en) * | 2022-11-10 | 2023-01-13 | 四川启睿克科技有限公司（Cn） | Method and device for detecting and classifying product surface defects and storage medium |
| CN116091472A (en) * | 2023-02-20 | 2023-05-09 | 浙江大学 | Intelligent detection method for defects of photovoltaic module by fusing visible light and infrared images |
Non-Patent Citations (4)
| Title |
|---|
| JALIL,BUSHRA等: "Fault detection in power equipment via an unmanned aerial system using multi modal data", 《SENSORS》 * |
| 姚楠;蔡越;苗佳;: "基于智能图像的变电站设备绝缘子破裂裂纹识别研究", 现代电子技术, no. 22 * |
| 武建华;梁利辉;纪欣欣;刘云鹏;裴少通;: "基于YOLOv3算法的绝缘子红外图像故障检测方法", 广东电力, no. 09 * |
| 金立军;田治仁;高凯;肖嵘;: "基于红外与可见光图像信息融合的绝缘子污秽等级识别", 中国电机工程学报, no. 13 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117496133A (en) * | 2024-01-03 | 2024-02-02 | 山东工商学院 | Closed bus R-CNN temperature fault monitoring method based on multi-mode data |
| CN117496133B (en) * | 2024-01-03 | 2024-03-22 | 山东工商学院 | Closed bus R-CNN temperature fault monitoring method based on multi-mode data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116228778B (en) | 2023-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111582235B (en) | Alarm method, system and equipment for monitoring abnormal events in station in real time | |
| CN116228778B (en) | Insulator rupture detection method and system based on multi-mode information fusion | |
| CN111599031A (en) | Inspection data acquisition and analysis method and system for power inspection robot | |
| CN117590223B (en) | Online monitoring system and method for circuit breaker | |
| CN111797725A (en) | Equipment state detection method, device and system | |
| CN109474333A (en) | A kind of electric power optical cable real-time monitoring protection system based on deep learning | |
| CN112001327A (en) | Valve hall equipment fault identification method and system | |
| CN113449767B (en) | Multi-image fusion transformer substation equipment abnormity identification and positioning method | |
| CN109902373A (en) | A kind of area under one's jurisdiction Fault Diagnosis for Substation, localization method and system | |
| CN117031182B (en) | Method and system for detecting abnormal telemetering value of substation terminal | |
| CN111898872A (en) | Power grid fault diagnosis method based on micro-service architecture and storage medium | |
| CN113012107B (en) | Power grid defect detection method and system | |
| CN114460519A (en) | On-site and terminal fusion management system and method based on power transformer inspection | |
| CN114741255A (en) | Fault self-healing technology based on automatic execution of service scene | |
| KR102282505B1 (en) | Device and method for detecting abnormality in electrical equipment | |
| CN115587312B (en) | Fault point positioning method and system based on multidimensional big data analysis | |
| Adami et al. | New approach to improve high-voltage transmission line reliability | |
| CN114942364A (en) | Substation fault diagnosis method and system based on knowledge graph technology | |
| CN115690659A (en) | Transformer substation safety detection method and device under shielding condition | |
| CN116319269B (en) | New energy edge side communication module with communication fault self-detection and quick isolation functions | |
| AU2021103901A4 (en) | Method for identifying abnormity of overhead lines with unbalanced samples | |
| Jin et al. | Distribution Network Fault Identification Based on the Improved Transformer Network | |
| Guo et al. | A Method of Insulator Break Detection Based on Multimodal Information Fusion | |
| CN109507631A (en) | A kind of calibration method and device improving rate of plugging into | |
| CN109066618B (en) | The switching value method of inspection, device and storage medium based on short-term time scale |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |