CN112150412B - Insulator self-explosion defect detection method based on projection curve analysis - Google Patents

Insulator self-explosion defect detection method based on projection curve analysis Download PDF

Info

Publication number
CN112150412B
CN112150412B CN202010899222.7A CN202010899222A CN112150412B CN 112150412 B CN112150412 B CN 112150412B CN 202010899222 A CN202010899222 A CN 202010899222A CN 112150412 B CN112150412 B CN 112150412B
Authority
CN
China
Prior art keywords
insulator
insulator string
pixel
image
peak
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010899222.7A
Other languages
Chinese (zh)
Other versions
CN112150412A (en
Inventor
杨威
潘永贺
宋人杰
李英杰
顾志伟
洪宬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northeast Electric Power University
Changshan Power Supply Co of State Grid Zhejiang Electric Power Co Ltd
Original Assignee
Northeast Dianli University
Changshan Power Supply Co of State Grid Zhejiang Electric Power Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northeast Dianli University, Changshan Power Supply Co of State Grid Zhejiang Electric Power Co Ltd filed Critical Northeast Dianli University
Priority to CN202010899222.7A priority Critical patent/CN112150412B/en
Publication of CN112150412A publication Critical patent/CN112150412A/en
Application granted granted Critical
Publication of CN112150412B publication Critical patent/CN112150412B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/187Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20004Adaptive image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20028Bilateral filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20036Morphological image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing
    • G06T2207/20061Hough transform
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses an insulator self-explosion defect detection method based on projection curve analysis, which comprises the steps of utilizing a super-pixel segmentation method of local texture characteristics to carry out super-pixel segmentation on a gray image on the basis of extracting an insulator string from an original insulator image obtained by an unmanned aerial vehicle, determining an insulator string candidate region, utilizing Hough transform to carry out angle correction on the insulator string candidate region to obtain a target region of the insulator string to be detected, calculating the pixel proportion of pixel values in an insulator mask between peak sections, carrying out self-explosion defect fault detection on the insulator string region, accurately identifying an insulator string fault point by positioning and identifying through a vertical projection method, and finally accurately identifying the insulator string fault point by positioning and identifying through the vertical projection method to improve the identification rate and accuracy of the insulator fault point.

Description

Insulator self-explosion defect detection method based on projection curve analysis
Technical Field
The invention relates to the field of fault diagnosis of high-voltage wire insulator defects, in particular to a projection curve analysis-based insulator spontaneous explosion defect detection method.
Background
When the transmission line operates, the insulator is a special insulating control part and plays an important role in safe and stable operation of the transmission line. However, since the insulator is exposed to the open air for a long time, the insulator is very likely to have a failure such as spontaneous explosion and breakage due to the influence of the natural environment and heavy mechanical load. Once the insulator breaks down, hidden danger can be produced to transmission line's operation safety, can reduce transmission line's operating cycle when serious, can cause the power supply to break off even, the accident that takes place to have a power failure on a large scale causes huge loss of property. Therefore, the insulator condition is regularly monitored, the insulator fault can be effectively found and timely treated and replaced, and the method has important significance for the safe operation of a power system.
Traditional high voltage transmission equipment mode of patrolling and examining mainly uses the manual work to patrol and examine as the owner, and this kind of mode of patrolling and examining is inefficient, and some field of vision blind areas can't detect to power workman need climb the electricity tower, and intensity of labour is too big, and the security is low. At present, the technology for carrying out routing inspection and maintenance on high-voltage line equipment by utilizing an Unmanned Aerial Vehicle (UAV) is relatively mature in developed countries, the technology greatly reduces the labor cost and the labor intensity of workers, and the working efficiency is improved. Compare in traditional artifical pole-climbing mode of patrolling and examining, utilize unmanned aerial vehicle to patrol and examine the line and shoot, carry out analysis processes to the insulator according to image processing technique, and then realize the automated inspection insulator defect, can effectively reduce staff's burden, patrol and examine to transmission line is automatic to have realistic meaning. However, the existing detection technology has the problems of low precision and inaccurate defect positioning.
Disclosure of Invention
Aiming at the problems in the prior art, the invention creatively utilizes a super-pixel segmentation method of local texture characteristics to carry out super-pixel segmentation on a gray image and determine an insulator string candidate area; carrying out angle correction on the insulator string candidate region by using Hough transform to obtain a target region of the insulator string to be detected; and calculating the pixel proportion of pixel values in the insulator mask between the wave peak sections, carrying out self-explosion defect fault detection on the insulator string region, and positioning and identifying through a vertical projection method to accurately identify the fault point of the insulator string, thereby improving the identification rate and accuracy of the fault point of the insulator.
The technical scheme adopted for realizing the invention is as follows: a projection curve analysis-based insulator spontaneous explosion defect detection method is characterized by comprising the following steps:
(1) shooting an insulator string to be detected on an overhead tower power transmission line by an unmanned aerial vehicle to obtain an original image of the insulator string to be detected, wherein the original image of the insulator string to be detected comprises the insulator string and background information thereof, and the insulator string is an insulator assembly formed by serially connecting insulators with the same shape and size together through a core rod;
(2) graying the original image of the insulator string to be detected in the step (1) to obtain a gray image, performing superpixel segmentation on the gray image by using a superpixel segmentation method of local texture characteristics, determining an insulator string candidate region by combining an adaptive threshold method and image morphological operation, and storing the insulator string candidate region in a set I = { I = 1 ,I 2 ,...,I n N is the number of candidate regions;
(3) carrying out angle correction on the insulator string candidate regions in the step (2) by using Hough transform to obtain corrected images, carrying out vertical projection on each candidate region to obtain a projection curve graph, and analyzing the obtained curve graph to obtain a target region of the insulator string to be detected, wherein the method specifically comprises the following steps:
3.1 Using random consistent sampling to fit a main axis straight line of the candidate region, rotating the main axis of the candidate region to the horizontal direction, and starting traversing the insulator string candidate region set I, knowing that the insulator string candidate region image obtained in the step (2) is a binary image, knowing that pixel values corresponding to pixel points are only {0, 255} two values, and performing cumulative projection on pixel points with the pixel point value of 255 in the mask of the insulator candidate region image in the vertical direction to obtain a projection curve, wherein the pixel cumulative formula is as follows:
Figure BDA0002659417990000021
wherein S (x) represents a cumulative function of non-0 pixel values of the candidate area image mask of the insulator string in each column direction, (I, x) is a pixel point coordinate on the image, I (I, x) represents a pixel value of a pixel point (I, x) of a kth candidate area image, and r is a maximum line number corresponding to a two-dimensional matrix of the image mask along the horizontal direction;
3.2 To determine the candidate region as an insulator string, a sign determination function sgn (x) is set, and a difference component function Δ S (x) = S (x + 1) -S (x) is calculated to find a projection curve peak. The symbol decision function is formulated as follows:
Figure BDA0002659417990000022
when sgn (x) =0, a small part of straight line segments exist in a partial projection curve, so that the peak value of the projection curve cannot be conveniently extracted, the sgn (x) is traversed reversely, if the sgn (x + 1) ≧ 0, the sgn (x) =1 is set, otherwise, the sgn (x) = -1 is set; at this time, the original value of sgn (x) =0 is corrected, so as to extract the wave peak value of the projection curve at the later stage;
performing forward traversal on sgn (x), and knowing that when sgn (x + 1) -sgn (x) = -2, (x, S (x)) is a wave peak coordinate corresponding to the projection curve; storing the abscissa of the pixel points of all wave crests into a set x point ={x 1 ,x 2 ...x n In the formula, n is the number of peaks; computing a set x point Average projected cumulative value S of all peak points in the wave X_avgs And finding the maximum projected cumulative value S X_max (ii) a Peak point average projected cumulative value S X_avgs And a maximum projected cumulative value S X_max Respectively as follows:
Figure BDA0002659417990000031
S X_max =max(S(x i ))
setting peak threshold th =0.75 × s X_avgs +0.25*S X_max All the peak points of S (x) < th are dropped, and the set x is updated point And the peak mean value S X_avgs (ii) a Calculating the variance D of the peak value 2 The formula is as follows:
Figure BDA0002659417990000032
in the formula D 2 Representing the variance of the peak points, wherein n represents the number of the peak points;
setting variance threshold D th =5, candidate area decision formula is:
Figure BDA0002659417990000033
if the candidate area is an insulator string area, continuing to execute the next step, and if the candidate area is a non-insulator string area, returning to the step (2) to add 1 to the k value to continue to execute the next step;
(4) calculating the pixel proportion of pixel values in the insulator mask between the wave peak sections, and carrying out self-explosion defect fault detection on the insulator string region obtained in the step (3), wherein the method specifically comprises the following steps: considering from the insulator form wave structure, when the candidate area is an insulator string, after the image is vertically projected, the sudden change between two wave peak sections is found out according to a certain criterion as the position of the insulator with the self-explosion defect; from the sequence of peak points (x) 1 ,x 2 ,...x n ) Let g (x) be the pixel value of 255 in the insulator mask between peak segments p ) The pixel proportion is used as a characteristic for searching the self-explosion defect interval, and the pixel proportion formula is as follows:
Figure BDA0002659417990000034
in the formula, g (x) p ) Represents the pixel ratio, x, of 255 in the insulator mask between the peak sections p Is the p-th peak point in the sequence of peak points, row (I) k ) The width of the candidate region image of the ith insulator string in the set I is taken as the width of the candidate region image of the ith insulator string in the set I;
further, based on the fact that the self-explosion defect of the insulator has a small g (x) value, an insulator self-explosion defect position detection algorithm is constructed as follows:
4.1 Calculate area = (max (g (x)) p ))+min(g(x p ) )/2, wherein area is the number of intermediate ranges of g (x);
4.2 If)
Figure BDA0002659417990000035
Then the peak band [ x ] is indicated p ,x p+1 ]The self-explosion defect exists;
image mask I for insulator string in candidate region k And finally, inversely mapping the positions of the insulators detected under the coordinate system to an input image according to the variation relation between the image coordinates, and finishing the final positioning of the defects of the insulators of the image when the insulator string candidate region set I is traversed.
The super-pixel segmentation method of the local texture features comprises the following steps:
1) After converting an image from an RGB image into an LAB color space, initializing a clustering center, and calculating the similarity measurement D of two pixel points by combining texture features:
Figure BDA0002659417990000041
in the formula d c The color distance of two pixel points in Lab space, d s Is a spatial distance, d w The difference distance of the local texture features is obtained, s, m and c are constants, and the weights of the space, the color and the texture features in the similarity measurement are comprehensively represented;
wherein d is c ,d s ,d w Comprises the following steps:
Figure BDA0002659417990000042
Figure BDA0002659417990000043
Figure BDA0002659417990000044
in the formula, (l, a, b) represents pixel color characteristics, (x, y) is pixel space coordinates, and w is pixel texture characteristics;
2) Setting an undirected weighted graph G = { V, E } according to the obtained superpixel image, wherein V is a superpixel node set, E is an edge set formed by connecting edges of adjacent superpixels, and the shortest path edge weight value accumulation and calculation formula of any two superpixels comprises the following steps:
Figure BDA0002659417990000045
in the formula d g (r i ,r j ) Cumulative sum of edge weights representing the shortest path between any two superpixels, d c-lab (r i ,r j ) Is the mean color characteristic Euclidean distance, r, between two superpixels i 、r j Representing a super pixel node; computing superpixel boundary connectivity B con (r) the calculation formula is as follows:
Figure BDA0002659417990000046
in the formula B con (r) the connectivity of the super-pixel boundary is strong and weak, E (r) is the area of the geodesic distance weight expansion region, b is the number of pixels connected with the boundary in the statistical r, and when the super-pixel r is connected with the boundary, b is more than 0, otherwise, b =0;
Figure BDA0002659417990000051
and E (r) in the formula is as follows:
where norm is the normalization operation, exp represents an exponential function with the natural constant e as the base, σ is the equilibrium parameter and is set to σ =10;
3) Different weights are distributed according to the difference of the background super pixel characteristics, and the calculation formula is as follows:
Figure BDA0002659417990000052
in the formula B p (r) is the weight of the background super pixel, which represents the strength of the background attribute.Calculating the saliency C of the superpixel based on the background prior in combination with the weight value t (r i ):
Figure BDA0002659417990000053
In the formula C t (r i ) Representing the saliency of a super-pixel, D c (r i ,r j ) Is a background super pixel r i And super pixel r j The color euclidean distance in LAB space of (a); n is a radical of hydrogen B Is the number of background superpixels; d spa (r i ,r j ) Is a background super pixel r i And super pixel r j The spatial distance of (a);
4) Setting the number of the super pixels as K, and respectively setting the K as 150,200 and 600 different scales, so that more local details can be reserved in significance detection while the overall structure information is reserved; performing multi-scale fusion on the significance of the three superpixels under different scales, determining a superpixel significance map through normalization, and finally denoising by utilizing bilateral filtering to obtain a final significance map;
5) And after obtaining the saliency map of the insulator image, performing binary segmentation on the image by using a self-adaptive threshold method, removing noise points in the image by combining morphological operation, calculating a connected domain in the map as a candidate region, marking the candidate region, and preparing for next insulator fault detection.
Drawings
FIG. 1 is a flow chart of a method for detecting self-explosion defects of insulators based on projection curve analysis;
FIG. 2 is a result image after super-pixel segmentation processing of local texture features in an embodiment of a projection curve analysis-based method for detecting self-explosion defects of insulators;
FIG. 3 is a result image obtained by binary morphological processing in an embodiment of a projection curve analysis-based method for detecting self-explosion defects of insulators;
FIG. 4 is a schematic diagram of a vertical projection of an insulator/non-insulator candidate region in an embodiment of a projection curve analysis-based insulator spontaneous explosion defect detection method;
fig. 5 is an image of the recognition result of the self-explosion defect position of the insulator in the embodiment of the method for detecting the self-explosion defect of the insulator based on projection curve analysis.
Detailed Description
The present invention will be described in further detail with reference to the accompanying fig. 1 to 5 and the embodiments, which are described herein for illustrative purposes only and are not intended to limit the present invention.
Referring to a flow chart of a projection curve analysis-based insulator spontaneous explosion defect detection method shown in fig. 1, the projection curve analysis-based insulator spontaneous explosion defect detection method comprises the following steps:
(1) shooting an insulator string to be detected on an overhead tower power transmission line by an unmanned aerial vehicle to obtain an original image of the insulator string to be detected, wherein the original image of the insulator string to be detected comprises the insulator string and background information thereof, and the insulator string is an insulator assembly formed by serially connecting insulators with the same shape and size through a core rod;
(2) graying the original image of the insulator string to be detected in the step (1) to obtain a gray image, performing superpixel segmentation on the gray image by using a superpixel segmentation method of local texture characteristics, as shown in fig. 2, determining an insulator string candidate region by combining an adaptive threshold method and image morphology operation, and storing the insulator string candidate region in a set I = { I = 1 ,I 2 ,...,I n N is the number of candidate regions;
the super-pixel segmentation method of the local texture features comprises the following steps:
2.1 After the image is converted into an LAB color space from an RGB image, initializing a clustering center, and calculating the similarity measurement D of two pixel points by combining texture features:
Figure BDA0002659417990000061
in the formula d c Is the color distance, d, of two pixels in Lab space s Is a spatial distance, d w The difference distance of the local texture features is obtained, s, m and c are constants, and the weights of the space, the color and the texture features in the similarity measurement are comprehensively represented;
wherein, d c ,d s ,d w Comprises the following steps:
Figure BDA0002659417990000062
Figure BDA0002659417990000063
Figure BDA0002659417990000064
in the formula, (l, a, b) represents pixel color characteristics, (x, y) is pixel space coordinates, and w is pixel point texture characteristics;
2.2 According to the obtained superpixel image, setting an undirected weighted graph G = { V, E }, wherein V is a superpixel node set, E is an edge set formed by connecting edges of adjacent superpixels, and the shortest path edge weight value accumulation and calculation formulas of any two superpixels have the following formulas:
Figure BDA0002659417990000065
in the formula d g (r i ,r j ) Cumulative sum of shortest path edge weights, d, representing any two superpixels c-lab (r i ,r j ) Is the mean color characteristic Euclidean distance, r, between two superpixels i 、r j Representing a superpixel node; computing superpixel boundary connectivity B con (r) the calculation formula is as follows:
Figure BDA0002659417990000071
in the formula B con (r) the connectivity of the super-pixel boundary is strong and weak, E (r) is the area of the geodesic distance weight expansion region, b is the number of pixels connected with the boundary in the statistical r, and when the super-pixel r is connected with the boundary, b is more than 0, otherwise, b =0;
Figure BDA0002659417990000072
and E (r) in the formula is as follows:
where norm is the normalization operation, exp denotes an exponential function with a natural constant e as the base, σ is the equilibrium parameter and is set to σ =10;
2.3 Different weights are assigned according to the difference of background super-pixel characteristics, and the calculation formula is as follows:
Figure BDA0002659417990000073
in the formula B p (r) is the weight of the background superpixel, which represents the strength of the background attribute. Calculating the saliency C of the superpixel based on the background prior in combination with the weight value t (r i ):
Figure BDA0002659417990000074
In the formula C t (r i ) Representing the saliency of a super-pixel, D c (r i ,r j ) Is a background super pixel r i And a super pixel r j The color euclidean distance in LAB space of (a); n is a radical of hydrogen B Is the number of background superpixels; d spa (r i ,r j ) Is a background super pixel r i And super pixel r j The spatial distance of (a);
2.4 Setting the number of superpixels as K and setting the K as three different scales of 150,200 and 600 respectively, so that more local details can be reserved in significance detection while the overall structure information is reserved; carrying out multi-scale fusion on the significance of the three super-pixels under different scales, determining a super-pixel significance map through normalization, and finally denoising by utilizing bilateral filtering to obtain a final significance map;
2.5 After obtaining a saliency map of an insulator image, performing binary segmentation on the image by using an adaptive threshold method, removing noise points in the image by combining morphological operation, and calculating a connected domain in the map as a candidate region and marking the candidate region as shown in fig. 3 to prepare for next insulator fault detection.
(3) Performing angle correction on the insulator string candidate regions in the step (2) by using hough transform to obtain corrected images, performing vertical projection on each candidate region to obtain a projection curve graph, and analyzing the obtained curve graph to obtain a target region of the insulator string to be detected, as shown in fig. 4, specifically comprising:
3.1 Using random consistent sampling to fit a main axis straight line of the candidate region, rotating the main axis of the candidate region to the horizontal direction, and starting traversing the insulator string candidate region set I, knowing that the insulator string candidate region image obtained in the step (2) is a binary image, knowing that pixel values corresponding to pixel points are only {0, 255} two values, and performing cumulative projection on pixel points with the pixel point value of 255 in the mask of the insulator candidate region image in the vertical direction to obtain a projection curve, wherein the pixel cumulative formula is as follows:
Figure BDA0002659417990000081
wherein S (x) represents a cumulative function of non-0 pixel values of the candidate area image mask of the insulator string in each column direction, (I, x) is a pixel point coordinate on the image, I (I, x) represents a pixel value of a pixel point (I, x) of a kth candidate area image, and r is a maximum line number corresponding to a two-dimensional matrix of the image mask along the horizontal direction;
3.2 For determining the candidate region as the insulator string, a sign determination function sgn (x) is set, and a difference function Δ S (x) = S (x + 1) -S (x) is calculated for finding the peak of the projection curve. The sign decision function is formulated as follows:
Figure BDA0002659417990000082
when sgn (x) =0, a small part of straight line segments exist in a partial projection curve, so that the peak value of the projection curve cannot be conveniently extracted, the sgn (x) is traversed reversely, if the sgn (x + 1) ≧ 0, the sgn (x) =1 is set, otherwise, the sgn (x) = -1 is set; at this time, the original value of sgn (x) =0 is corrected, so as to extract the wave peak value of the projection curve at the later stage;
performing forward traversal on sgn (x), and knowing that when sgn (x + 1) -sgn (x) = -2, (x, S (x)) is a wave peak coordinate corresponding to the projection curve; storing the horizontal coordinates of the pixel points of all the wave crests to a set x point ={x 1 ,x 2 ...x n In which n is the number of peaks; computing a set x point Average projected cumulative value S of all peak points in the wave X_avgs And finding the maximum projected cumulative value S X_max (ii) a Peak point average projected cumulative value S X_avgs And a maximum projected cumulative value S X_max Respectively as follows:
Figure BDA0002659417990000083
S X_max =max(S(x i ))
setting peak threshold th =0.75 × s X_avgs +0.25*S X_max Deleting all the wave peak points with S (x) < th, and updating the set x point And the peak mean S X_avgs (ii) a Calculating the variance D of the peak value 2 The formula is as follows:
Figure BDA0002659417990000091
in the formula D 2 Representing the variance of the peak points, wherein n represents the number of the peak points;
setting a variance threshold D th =5, candidate region decision formula is:
Figure BDA0002659417990000092
if the candidate area is an insulator string area, continuing to execute the next step, and if the candidate area is a non-insulator string area, returning to the step (2) to add 1 to the k value to continue to execute the next step;
(4) calculating the pixel proportion of pixel values in the insulator mask between the wave peak sections, and carrying out self-explosion defect fault detection on the insulator string region obtained in the step (3), wherein the method specifically comprises the following steps: considering from the insulator form wave structure, when the candidate area is an insulator string, after the image is vertically projected, the sudden change between two wave peak sections is found out according to a certain criterion as the position of the insulator with the self-explosion defect; as shown in fig. 5, from a sequence of peak points (x) 1 ,x 2 ,...x n ) Let g (x) be the pixel value of 255 in the insulator mask between the peak sections p ) The pixel proportion is used as a characteristic for searching the spontaneous explosion defect interval, and the pixel proportion formula is as follows:
Figure BDA0002659417990000093
in the formula g (x) p ) Represents the pixel ratio, x, of 255 in the insulator mask between the peak sections p Is the p-th peak point in the sequence of peak points, row (I) k ) The width of the candidate region image of the ith insulator string in the set I is taken as the width of the candidate region image of the ith insulator string in the set I;
further, based on the fact that the self-explosion defect of the insulator has a small g (x) value, a self-explosion defect position detection algorithm of the insulator is constructed as follows:
4.1 Calculate area = (max (g (x)) p ))+min(g(x p ) ))/2, where area is the median of g (x);
4.2 If)
Figure BDA0002659417990000094
Then the peak band [ x ] is illustrated p ,x p+1 ]The self-explosion defect exists;
image mask I for insulator string in candidate region k The insulator position detected in the coordinate system can be finally mapped to the input image in an inverse manner according to the variation relation among the image coordinates, and when the insulator string candidate region set I is traversed, the image is completedAnd finally positioning the insulator defect.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, many modifications and adaptations can be made without departing from the principle of the present invention, and should be considered as the protection scope of the present invention.

Claims (1)

1. A projection curve analysis-based insulator spontaneous explosion defect detection method is characterized by comprising the following steps:
(1) shooting an insulator string to be detected on an overhead tower power transmission line by an unmanned aerial vehicle to obtain an original image of the insulator string to be detected, wherein the original image of the insulator string to be detected comprises the insulator string and background information thereof, and the insulator string is an insulator assembly formed by serially connecting insulators with the same shape and size together through a core rod;
(2) graying the original image of the insulator string to be detected in the step (1) to obtain a gray image, performing superpixel segmentation on the gray image by using a superpixel segmentation method of local texture characteristics, determining an insulator string candidate region by combining an adaptive threshold method and image morphological operation, and storing the insulator string candidate region in a set I = { I = 1 ,I 2 ,...,I n N is the number of candidate regions;
(3) carrying out angle correction on the insulator string candidate regions in the step (2) by using Hough transform to obtain corrected images, carrying out vertical projection on each candidate region to obtain a projection curve graph, and analyzing the obtained curve graph to obtain a target region of the insulator string to be detected, wherein the method specifically comprises the following steps:
3.1 Using random consistent sampling to fit a main axis straight line of the candidate region, rotating the main axis of the candidate region to the horizontal direction, and starting traversing the insulator string candidate region set I, knowing that the insulator string candidate region image obtained in the step (2) is a binary image, knowing that pixel values corresponding to pixel points are only {0, 255} two values, and performing cumulative projection on pixel points with the pixel point value of 255 in the mask of the insulator candidate region image in the vertical direction to obtain a projection curve, wherein the pixel cumulative formula is as follows:
Figure RE-FDA0003685249090000011
wherein S (x) represents a cumulative function of non-0 pixel values of the candidate area image mask of the insulator string in each column direction, (I, x) is a pixel point coordinate on the image, I (I, x) represents a pixel value of a pixel point (I, x) of a kth candidate area image, and r is a maximum line number corresponding to a two-dimensional matrix of the image mask along the horizontal direction;
3.2 In order to determine that the candidate region is an insulator string, a sign determination function is set to sgn (x), a difference quantity function Δ S (x) = S (x + 1) -S (x) is calculated to find a peak of a projection curve, when sgn (x) =0, a small part of straight line segments exist in a part of the projection curve, so that it is inconvenient to extract a peak value of the projection curve, the sgn (x) is reversely traversed, if sgn (x + 1) ≧ 0, sgn (x) =1 is set, and otherwise, sgn (x) = -1 is set; at this time, the original value of sgn (x) =0 is corrected, so as to extract the wave peak value of the projection curve at the later stage;
performing forward traversal on sgn (x), and knowing that when sgn (x + 1) -sgn (x) = -2, (x, S (x)) is a wave peak coordinate corresponding to the projection curve; storing the horizontal coordinates of the pixel points of all the wave crests to a set x point ={x 1 ,x 2 ...x n In the formula, n is the number of peaks; computing a set x point Average projected cumulative value S of all peak points in the wave X_avgs And finding the maximum projected cumulative value S X_max (ii) a Peak point average projected cumulative value S X_avgs And a maximum projected cumulative value S X_max Respectively as follows:
Figure RE-FDA0003685249090000021
S X_max =max(S(x i ))
setting peak threshold th =0.75 × s X_avgs +0.25*S X_max All the peak points of S (x) < th are dropped, and the set x is updated point And the peak mean value S X_avgs (ii) a Calculating the variance D of the peak value 2 The formula is as follows:
Figure RE-FDA0003685249090000022
x i ∈x point
in the formula, D 2 Representing the variance of the peak points, wherein n represents the number of the peak points;
setting a variance threshold D th =5, candidate area decision formula is:
Figure RE-FDA0003685249090000023
if the candidate region is an insulator string region, continuing to execute the next step, and if the candidate region is a non-insulator string region, returning to the step (2) to add 1 to the k value to continue to execute the next step;
(4) calculating the pixel proportion of pixel values in the insulator mask between the wave peak sections, and carrying out self-explosion defect fault detection on the insulator string region obtained in the step (3), wherein the method specifically comprises the following steps: considering from the insulator form wave structure, when the candidate area is an insulator string, after the image is vertically projected, the sudden change between two wave peak sections is found out according to a certain criterion as the position of the insulator with the self-explosion defect; in the set x point ={x 1 ,x 2 ...x n In the method, n is the number of wave crests, and the pixel value in the insulator mask between the wave crest segments is set as g (x) with the value of 255 p ) The pixel proportion is used as a characteristic for searching the self-explosion defect interval, and the pixel proportion formula is as follows:
Figure RE-FDA0003685249090000024
in the formula, g (x) p ) Represents the pixel ratio, x, of 255 in the insulator mask between the peak sections p For the p-th peak point in the sequence of peak points, row (I) k ) As the I-th insulator string candidate region in set IThe width of the image;
based on the fact that the self-explosion defect position of the insulator has a small g (x) value, a detection algorithm for the self-explosion defect position of the insulator is constructed as follows:
4.1 Calculate area = (max (g (x)) p ))+min(g(x p ) ))/2, where area is the median of g (x);
4.2 If)
Figure RE-FDA0003685249090000031
Then the peak band [ x ] is indicated p ,x p+1 ]The self-explosion defect exists;
image mask I for insulator string in candidate region k And finally, inversely mapping the positions of the insulators detected under the coordinate system to an input image according to the variation relation between the image coordinates, and finishing the final positioning of the defects of the insulators of the image when the insulator string candidate region set I is traversed.
CN202010899222.7A 2020-08-31 2020-08-31 Insulator self-explosion defect detection method based on projection curve analysis Active CN112150412B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010899222.7A CN112150412B (en) 2020-08-31 2020-08-31 Insulator self-explosion defect detection method based on projection curve analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010899222.7A CN112150412B (en) 2020-08-31 2020-08-31 Insulator self-explosion defect detection method based on projection curve analysis

Publications (2)

Publication Number Publication Date
CN112150412A CN112150412A (en) 2020-12-29
CN112150412B true CN112150412B (en) 2022-11-22

Family

ID=73890317

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010899222.7A Active CN112150412B (en) 2020-08-31 2020-08-31 Insulator self-explosion defect detection method based on projection curve analysis

Country Status (1)

Country Link
CN (1) CN112150412B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112862770B (en) * 2021-01-29 2023-02-14 珠海迪沃航空工程有限公司 Defect analysis and diagnosis system, method and device based on artificial intelligence
CN113887430B (en) * 2021-09-30 2024-04-30 国网山东省电力公司信息通信公司 Method and system for locating polling video text
CN114937039B (en) * 2022-07-21 2022-10-25 阿法龙(山东)科技有限公司 Intelligent detection method for steel pipe defects

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104281857B (en) * 2013-07-08 2017-08-04 中国科学院沈阳自动化研究所 A kind of isolator detecting method projected based on orthogonal direction
CN103886610B (en) * 2014-04-05 2016-08-17 东北电力大学 A kind of insulator image defect detection method
JP6625475B2 (en) * 2016-04-22 2019-12-25 株式会社 東京ウエルズ Defect inspection method and defect inspection system
CN106778734B (en) * 2016-11-10 2020-04-21 华北电力大学(保定) Sparse representation-based insulator string-falling defect detection method
CN106683075B (en) * 2016-11-22 2020-02-21 广东工业大学 Method for detecting bolt defects at cross arm of power transmission line tower
CN108010019B (en) * 2017-11-29 2022-03-25 国网电力科学研究院武汉南瑞有限责任公司 Defect detection method based on self-adaptive cutting of single insulator
CN110675387B (en) * 2019-09-26 2021-09-24 北京国网富达科技发展有限责任公司 Method and device for detecting structural defects of transmission line iron tower

Also Published As

Publication number Publication date
CN112150412A (en) 2020-12-29

Similar Documents

Publication Publication Date Title
CN112150412B (en) Insulator self-explosion defect detection method based on projection curve analysis
CN111428748B (en) HOG feature and SVM-based infrared image insulator identification detection method
Sohn et al. Automatic powerline scene classification and reconstruction using airborne lidar data
Wang et al. Recognition and drop-off detection of insulator based on aerial image
Wang et al. High-voltage power transmission tower detection based on faster R-CNN and YOLO-V3
CN112883878B (en) Automatic point cloud classification method under transformer substation scene based on three-dimensional grid
CN112435208B (en) Insulator region detection method for significant edge guidance
CN109712112B (en) Aerial photography insulator image positioning method based on local features
CN113409252B (en) Obstacle detection method for overhead transmission line inspection robot
CN111046950A (en) Image processing method and device, storage medium and electronic device
Ni et al. An improved Faster R-CNN for defect recognition of key components of transmission line
CN113327255A (en) Power transmission line inspection image processing method based on YOLOv3 detection, positioning and cutting and fine-tune
CN109523543A (en) A kind of wire strand breakage detection method based on Edge Distance
Zhu et al. Integrating saliency and ResNet for airport detection in large-size remote sensing images
CN112115770A (en) Method and system for identifying autonomous inspection defects of unmanned aerial vehicle of overhead line
CN115205256A (en) Power transmission line insulator defect detection method and system based on fusion of transfer learning
CN111220619B (en) Insulator self-explosion detection method
Hao et al. Detection of bird nests on power line patrol using single shot detector
Zhang et al. Defect detection of anti-vibration hammer based on improved faster R-CNN
Hong-Bin et al. Target tracking method of transmission line insulator based on multi feature fusion and adaptive scale filter
CN110223346B (en) Shape prior-based multi-insulator positioning method
Hao et al. Based on Surf feature extraction and insulator damage identification for capsule networks
Lv et al. Research on Insulator Defect Detection and Recognition in Overhead Transmission Line Based on Convolutional Neural Network
Zhang et al. Insulator segmentation algorithm based on k-means
CN114418968A (en) Power transmission line small target defect detection method based on deep learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20221017

Address after: No. 2 Wenfeng East Road, Changshan County, Quzhou City, Zhejiang Province 324200

Applicant after: Changshan power supply company of State Grid Zhejiang Electric Power Co.,Ltd.

Applicant after: NORTHEAST DIANLI University

Address before: No. 900, Century Avenue, Quzhou City, Zhejiang Province

Applicant before: Quzhou Guangming Electric Power Investment Group Co.,Ltd. Futeng Technology Branch

Applicant before: NORTHEAST DIANLI University

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant