CN112464789A - Power transmission line extraction method based on line characteristics - Google Patents

Power transmission line extraction method based on line characteristics Download PDF

Info

Publication number
CN112464789A
CN112464789A CN202011338502.7A CN202011338502A CN112464789A CN 112464789 A CN112464789 A CN 112464789A CN 202011338502 A CN202011338502 A CN 202011338502A CN 112464789 A CN112464789 A CN 112464789A
Authority
CN
China
Prior art keywords
edge
transmission line
image
line
power transmission
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011338502.7A
Other languages
Chinese (zh)
Other versions
CN112464789B (en
Inventor
吴艺
马云鹏
周明玉
王纯款
周亚琴
徐畅
刘凯祥
周清楷
盛惠兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu China Israel Industrial Technology Research Institute
Changzhou Campus of Hohai University
Original Assignee
Jiangsu China Israel Industrial Technology Research Institute
Changzhou Campus of Hohai University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu China Israel Industrial Technology Research Institute, Changzhou Campus of Hohai University filed Critical Jiangsu China Israel Industrial Technology Research Institute
Priority to CN202011338502.7A priority Critical patent/CN112464789B/en
Publication of CN112464789A publication Critical patent/CN112464789A/en
Application granted granted Critical
Publication of CN112464789B publication Critical patent/CN112464789B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • G06V20/13Satellite images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30181Earth observation
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y04INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
    • Y04SSYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
    • Y04S10/00Systems supporting electrical power generation, transmission or distribution
    • Y04S10/50Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Astronomy & Astrophysics (AREA)
  • Remote Sensing (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a power transmission line extraction method based on line characteristics, which is used for processing an acquired power transmission line aerial image based on the power transmission line characteristics in the aerial image and effectively extracting a complete power transmission line comprising straight lines, curves and other forms from a complex and various backgrounds. The method mainly comprises the steps of carrying out histogram equalization processing on an image brightness space, obtaining an edge image by utilizing an ED algorithm and generating a two-dimensional vector of the image through a vector tracking algorithm; on the basis of analyzing the line characteristic and non-line characteristic difference, extracting the power transmission line by using a length constraint method, a curvature constraint method and an endpoint projection method; and finally, obtaining the power transmission line with the single pixel width through iterative processing, and obtaining the complete power line by least square fitting. The problem that the traditional manual inspection method is time-consuming and labor-consuming is solved, and the method has high engineering application value.

Description

Power transmission line extraction method based on line characteristics
Technical Field
The invention relates to a line feature-based power transmission line extraction method, and belongs to the technical field of computer vision and power transmission line inspection.
Background
With the continuous development and promotion of national comprehensive national power, the rapid development of the society puts higher requirements on the construction of a power grid. The power transmission line is used as an important component in a power grid, and the stable operation of the power transmission line is an important guarantee for national safety power utilization. However, the power transmission line is often in a complex external environment, and vegetation, buildings and the like with different heights on the ground can pose potential threats to the power transmission line. If these objects are too close to the high voltage transmission line, accidents such as line trips may occur. Therefore, the environment of the power transmission line channel needs to be regularly inspected to ensure the safe and stable operation of the power transmission line.
Traditional manual line patrol is limited by topography, low efficiency, high cost and certain danger. Along with the increase of the scale of the power grid, the manual measurement mode cannot meet the requirements of coverage and instantaneity of power transmission line routing inspection. With the rapid development of small unmanned aerial vehicles and high-resolution visible light cameras, the unmanned aerial vehicle carries the visible light camera to acquire the image of the power transmission line, and the inspection of the power transmission line channel environment becomes a new research idea. The method has the advantages of high efficiency, low cost and high automation degree. Because the image data is susceptible to various factors such as the shooting environment and the shooting angle, the obtained image is not a simple power transmission line and mostly contains a complex background. Therefore, how to completely and effectively extract the power transmission line from the aerial image has important research significance for the power transmission line inspection field.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a power transmission line extraction method based on line characteristics, so that the power transmission line is accurately extracted, the working strength and the risk coefficient of inspection personnel are reduced, and the working efficiency is improved.
In order to achieve the purpose, the invention relates to a line feature-based power transmission line extraction method, which comprises the following steps:
preprocessing an aerial image acquired by an unmanned aerial vehicle through an image enhancement algorithm, improving the contrast between a power transmission line and a background in the aerial image, and obtaining a gray level image Igray
Extracting smooth and complete edge segments from the gray level image based on an edge detection algorithm to obtain an edge image Iedge,IedgeThe gray value of the pixel point of the middle edge segment is 255, IedgeThe gray value of the pixel point of the middle non-edge part is 0;
by vector tracking algorithm, IedgeThe edge segment in (1) is transformed into a two-dimensional vector and I is deletededgeThe edge segments of the middle and smaller than 20 pixel points are obtained as V1,V1={v1,v2,...,vi,...,vn1Wherein n1 is V1Number of medium two-dimensional vectors, viRepresenting a certain i-th two-dimensional vector, viComprising m pixels with a grey value of 255, denoted vi={(x1,y1),(x2,y2),...,(xm,ym)},(xm,ym)∈Iedge,m>20;
Based on the curve characteristics of the power transmission line, deleting all over-bent two-dimensional vectors to obtain a two-dimensional vector V2, V2={v'1,v'2,...v'i,...,v'n2},V2∈V1Wherein n2 is V2The number of the medium two-dimensional vectors;
two-dimensional vector V according to line segment projection method2Carrying out polymerization to obtain a two-dimensional vector V related to the transmission line3, V3={v″1,v”2,...,v″i,...,v”N},V3∈V2Wherein N represents V3The number of medium two-dimensional vectors also indicates the number of detected power lines, v ″i={(x1,y1),(x2,y2),...,(xt,yt) Representing the two-dimensional vector of the ith transmission line;
to V3All the two-dimensional vectors v ″' of the transmission lineiCarrying out iterative processing to obtain two-dimensional vector of transmission line with single pixel width
Figure BDA0002797946570000021
Figure BDA0002797946570000022
All transmission line two-dimensional vectors v ″)iThe vector set of the transmission line obtained after the iterative processing is V4
Figure BDA0002797946570000023
And fitting the power transmission line based on a least square method to determine a polynomial equation of the power transmission line in the aerial photography image.
Preferentially, the aerial image acquired by the unmanned aerial vehicle is preprocessed through an image enhancement algorithm, the contrast between a power transmission line and a background in the aerial image is improved, and a gray level image I is obtainedgrayThe method comprises the following steps:
a. the aerial image is a color RGB image, and the aerial image is IrgbEach corresponding color vector is (r, g, b), max is the maximum value among the r component, the g component, and the b component, min is the minimum value among the r component, the g component, and the b component, and the (h, s, v) value in the corresponding HSV space is:
Figure BDA0002797946570000024
according to the formula (1) adding IrgbRespectively obtaining saturation images I after converting into HSV spacehTone image IsAnd a luminance image Iv
b. For the v component, for the luminance image IvIs processed by histogram equalization to obtain I'vImproving the image contrast;
c. will Ih、IsAnd l'vAnd combining to obtain HSV images, wherein the corresponding vectors are (h ', s', v '), converting the HSV images into RGB color space, and the value of each color vector (r', g ', b') in the corresponding RGB color space is as follows:
Figure BDA0002797946570000031
wherein
Figure BDA0002797946570000032
p ═ v '× (1-s'), q ═ v '× (1-f × s'), t ═ v '× (1- (1-f) × s'), and the processed color RGB image is Ihrgb
d. Will IhrgbConverted into a grey-scale image IgrayAnd to IgrayAnd bilateral filtering is adopted, so that noise caused by equalization is eliminated, and background interference is reduced.
Preferably, the edge detection algorithm is based on from the grey scale image IgrayExtracting smooth and complete edge segments to obtain an edge map Iedge, IedgeThe gray value of the pixel point of the middle edge segment is 255, the gray value of the pixel point of the non-edge part is 0, and the specific steps are as follows:
a. firstly, the original gray image I is processed by a Gaussian filtergrayProcessing to obtain image Img0
b. Processing Img with Sobel operator0Obtaining a gradient map Img1
c. According to Img1Calculating Img0Obtaining an anchor point diagram Img2
d. Connecting and drawing each anchor point to obtain an edge graph Iedge,IedgeThe gray value of the middle background is 0, and the gray value of the transmission line is 255.
Preferably, I is determined by a vector tracking algorithmedgeThe edge segment in (1) is transformed into a two-dimensional vector and I is deletededgeThe edge segments of the middle and smaller than 20 pixel points are obtained as V1,V1={v1,v2,...,vi,...,vn1Wherein n1 is V1Number of medium two-dimensional vectors, viRepresenting a certain i-th two-dimensional vector, viComprising m pixels with a grey value of 255, denoted vi={(x1,y1),(x2,y2),...,(xm,ym) The method comprises the following steps:
in IedgeBased on the vector tracking algorithm, I is calculatededgeTo a two-dimensional vector V1
From IedgeThe left lower corner of the image is scanned line by line until a pixel with a gray value of 255 is found, and the pixel is taken as the starting position of the current vector and is recorded as a current pixel Q;
setting the gray value of the position of the current pixel Q as 0, searching 8 fields of the current pixel Q according to the sequence from left to right and from bottom to top, and recording the pixel with the first gray value of 255 as the current pixel Q;
then searching 8 fields of Q again according to the previous step until I is reachededgeAn edge, or a pixel with a gray value of 255 exists in 8 fields of the current pixel;
deleting I in vectorization processingedgeEdge segment of less than 20 pixels in the image, then V1Can be represented by formula (3), IedgeEach pixel value of (x) is not 0j,yj) Are assigned to V according to the above-mentioned assignment rule1In a different vector group vi
Figure BDA0002797946570000041
Preferably, based on the curve characteristic of the power transmission line, all over-bent two-dimensional vectors are deleted to obtain a two-dimensional vector V2, V2={v'1,v'2,...v'i,...,v'n2},V2∈V1Wherein n2 is V2The number of the medium two-dimensional vectors specifically includes the following contents:
arbitrary transmission line is arbitrarily divided into a plurality of successive segments { seg1,seg2,...,segaA is the number of segments, and the slope corresponding to each segment is ki,i∈[1,a];
The slope difference of the segments of the linear shape is 0, and the slope difference of the segments of the curved shape is less than a set threshold value delta k, namely | kc-ke|<Δk,kcAnd keIs the slope corresponding to any segment, and c, e ∈ [1, a ]];
The two-dimensional vector of any line segment obtained in the step 3) is represented by viIs denoted by vi={(x1,y1),(x2,y2),...,(xm,ym)}, (xm,ym)∈Iedge(ii) a V is to beiTrisection, expressed as
Figure BDA0002797946570000042
Wherein
Figure BDA0002797946570000043
Representing the m-th in the two-dimensional vector1A coordinate, i.e.
Figure BDA0002797946570000044
Figure BDA0002797946570000045
Representing the m-th in the two-dimensional vector2A coordinate, i.e.
Figure BDA0002797946570000046
Trisecting the transmission line into three parts based on the curvature characteristics of the transmission line
Figure BDA0002797946570000047
And
Figure BDA0002797946570000048
corresponding slopes are respectively
Figure BDA0002797946570000049
And
Figure BDA00027979465700000410
wherein
Figure BDA00027979465700000411
Computing
Figure BDA00027979465700000412
And
Figure BDA00027979465700000413
the difference in slope between the middle segments is SIwz=|kw-kzI, w, z ═ 1,2,3, delete SIwzA two-dimensional vector of ≧ Δ k.
Preferentially, the two-dimensional vector V is projected according to a line segment method2Carrying out polymerization to obtain a two-dimensional vector V related to the transmission line3, V3={v″1,v”2,...,v″i,...,v”N},V3∈V2Wherein N represents V3The number of medium two-dimensional vectors also indicates the number of detected power lines, v ″i={(x1,y1),(x2,y2),...,(xt,yt) Representing the two-dimensional vector of the ith transmission line, and comprising the following steps of:
two line segments are defined as l1And l2,l1Tangent sum of endpoints l2The tangents to the end points extend to the boundaries of the aerial image, l1Tangent sum of endpoints l2The tangent to the endpoint forms a projection point at the left edge of the boundary of the aerial image, denoted as { A, B }, l, respectively1Tangent sum of endpoints l2The coordinates of projection points formed by tangents of the end points on the right edge of the boundary of the aerial image, which are respectively marked as { A ', B' }, A, B, A 'and B', are respectively (0, y)A)、(0,yB)、(W,yA') And (W, y)B') W is the length of the aerial image, then l1Tangent sum of endpoints l2The projection distance of the tangent line of the end point on the left edge of the boundary of the aerial image is dA=|yA-yB|,l1Tangent sum of endpoints l2The projection distance of the tangent line of the end point on the right edge of the boundary of the aerial image is dB=|yA'-yB'If l1And l2Collinear, then projection distance dAAnd dBMin (d) should be satisfiedA,dB)≤T;
And if the polar coordinate equation of the tangent of the segment end point is rho-x-cos theta + y-sin theta, wherein rho is the polar diameter of the tangent, theta is the included angle between the tangent of the end point and the horizontal transverse axis of the aerial image, and (x, y) are the coordinates of the segment end point, d is the coordinate of the segment end pointAAnd dBCalculated from the following equation:
Figure BDA0002797946570000051
wherein l1And l2Respectively is l11=x·cosθ1+y·sinθ1, l22=x·cosθ2+y·sinθ2,ρ1Is 11Pole diameter of (a) (. theta.)1Is 11Angle between tangent line of end point and horizontal cross axis of aerial image, rho2Is 12Pole diameter of (a) (. theta.)2Is 12And the included angle between the tangent line of the end point and the horizontal transverse axis of the aerial image.
Preferably, for V3All the two-dimensional vectors v ″' of the transmission lineiCarrying out iterative processing to obtain two-dimensional vector of transmission line with single pixel width
Figure BDA0002797946570000052
Figure BDA0002797946570000053
All transmission line two-dimensional vectors v ″)iThe vector set of the transmission line obtained after the iterative processing is V4
Figure BDA0002797946570000054
The method specifically comprises the following steps:
first according to v ″)iThe abscissa of each point in the pair v ″, in order of small to largeiSorting to get v'i={(x'1,y'1),(x'2,y'2),...,(x't,y't) } mixing (x'1,y'1) As a starting point Pstart1(x, y), traverse v'iFind and (x'1,y'1) Is taken as the end point Pend1(x, y) passing through the starting point Pstart1(x, y) and an end point Pend1(x, y) obtaining
Figure BDA0002797946570000056
The new coordinates in (1) are
Figure BDA0002797946570000055
s is v'iMiddle Pstart1(x, y) to Pend1The total number of coordinates between (x, y); by v'iMiddle Pend1As a new starting point Pstart2(x, y) repeating the above steps until v ″'iAll the coordinates are traversed to obtain the linear quantity of single pixel width
Figure BDA0002797946570000061
And is
Figure BDA0002797946570000062
Figure BDA0002797946570000063
stIs v'iMiddle Pstartt(x, y) to PendtThe total number of coordinates between (x, y).
Preferentially, fitting and determining a polynomial equation of the power transmission line in the aerial photography image based on a least square method, specifically comprising the following steps:
line segment
Figure BDA0002797946570000064
Has a fitting equation of
Figure BDA0002797946570000065
ak(k ═ 0, 1.., n) is a fitting parameter, and n represents the number of poles of the fitting polynomial;
according to the least square method
Figure BDA0002797946570000066
Fitting is performed based on
Figure BDA0002797946570000067
Pixel point of (x)t,yt) Determining a fitting parameter ak(k ═ 0,1,..., n), fitting parameters ak(k ═ 0, 1.. times, n) is required to satisfy a condition that minimizes the sum of squares of the differences in the Y direction, as shown in equation (5):
Figure BDA0002797946570000068
deriving equation (5) to obtain a real symmetric positive definite matrix:
Figure BDA0002797946570000069
solving the formula (6) to obtain a fitting parameter a meeting the fitting conditionk(k ═ 0, 1.. times, n), determining a line segment
Figure BDA00027979465700000610
The equation of the corresponding power line in the aerial image.
Preferably, the gaussian filter uses a 5 × 5 gaussian kernel with σ ═ 1, and the background grayscale values include the sky grayscale values.
Preferably, the threshold Δ k is 0.27, and the threshold T is set to 10.
The invention achieves the following beneficial effects:
(1) according to the power transmission line extraction method based on the line characteristics, the contrast of the power transmission line is enhanced by performing histogram equalization processing on the brightness space, and the influence of environmental factors such as shooting color and illumination on the detection effect of the power transmission line is reduced;
(2) according to the method, based on the line segment characteristic information of the power transmission line in the aerial image, the complete two-dimensional vector of the power transmission line with the single-pixel width is effectively extracted from the complex background by means of curvature constraint, line end point projection, skeleton extraction, power transmission line fitting and the like, and the power transmission line with different line characteristics such as a straight line and a curve can be accurately positioned.
Drawings
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a schematic diagram of a geometric model of the power transmission line curvature feature of the present invention;
FIG. 3 is a schematic diagram of a line segment projection method according to the present invention.
Detailed Description
The following examples are only for illustrating the technical solutions of the present invention more clearly, and the protection scope of the present invention is not limited thereby.
It should be noted that, if there is a directional indication (such as up, down, left, right, front, and back) in the embodiment of the present invention, it is only used to explain the relative position relationship between the components, the motion situation, and the like in a certain posture, and if the certain posture is changed, the directional indication is changed accordingly.
The line feature-based power transmission line extraction method of the invention is as shown in fig. 1, and the specific operation flow is as follows:
1. preprocessing an aerial image acquired by the unmanned aerial vehicle through an image enhancement algorithm, improving the contrast between a power transmission line and a background, and obtaining a gray level image IgrayThe method comprises the following specific steps:
the three colors in the RGB color space have close relationship, and the images can be deformed by respectively processing the three colors; and in HSIn V space, hue, saturation and brightness directly correspond to the human visual perception characteristics and are not strongly related to each other. The aerial image is a color RGB image and is set as IrgbEach corresponding color vector is (r, g, b), max is the maximum of the r, g, b components, min is the minimum of the r, g, b components, and the (h, s, v) value in the corresponding HSV space is:
Figure BDA0002797946570000071
according to the formula (1) adding IrgbRespectively obtaining saturation images I after converting into HSV spacehTone image IsAnd a luminance image Iv
b. For the v component, for the luminance image IvIs processed by histogram equalization to obtain I'vThereby improving image contrast.
c. Will Ih、IsAnd l'vAnd (5) merging to obtain the HSV image, wherein the corresponding vector is (h ', s ', v '). Converting from HSV space to RGB color space, wherein each color vector (r ', g ', b ') in the corresponding RGB color space has the following value:
Figure BDA0002797946570000081
wherein
Figure BDA0002797946570000082
p ═ v '× (1-s'), q ═ v '× (1-f × s'), t ═ v '× (1- (1-f) × s'), and the processed color RGB image is Ihrgb
d. Will IhrgbConverted into a grey-scale image IgrayAnd to IgrayAnd bilateral filtering is adopted, so that noise caused by equalization is eliminated, and background interference is reduced.
2. Edge detection algorithm-based secondary gray image IgrayExtracting smooth and complete edge segments to obtain an edge image Iedge, IedgeThe gray value of the pixel point of the middle edge segment is 255, and the image of the non-edge partThe gray value of the pixel point is 0, and the specific steps are as follows:
a. firstly, the original gray image I is processed by a Gaussian filtergrayProcessing to obtain image Img0. The gaussian filter defaults to a 5 × 5 gaussian kernel with σ ═ 1.
b. Processing Img with Sobel operator0Obtaining a gradient map Img1
c. According to Img1Calculate the image Img0Obtaining an anchor point diagram Img2Where anchor points refer to pixels with a high probability of being present among edge pixels.
d. Connecting each anchor point generated in the step 2(c), and drawing an edge graph Iedge。IedgeThe gray value of the background such as the sky is 0, and the gray value of the transmission line is 255.
3. In IedgeBased on the edge, the edge is converted into a two-dimensional vector V by a vector tracking algorithm1. The basic process of vector tracking is: from IedgeThe left lower corner of the image is scanned line by line until a pixel with a gray value of 255 is found, and the pixel is taken as the starting position of the current vector and is recorded as a current pixel Q; setting the gray value of the position as 0, searching 8 fields of the pixel Q according to the sequence from left to right and from bottom to top, and recording the pixel with the first gray value of 255 as the current pixel; then searching 8 fields of Q again according to the previous step until reaching image IedgeAn edge, or a pixel with a gray value of 255 exists in 8 fields of the current pixel. Deleting short features with length less than 20 pixels in the vectorization process, then V1Can be represented by formula (5), IedgeEach of the points (x) not being 0j,yj) Are assigned to V according to the above-mentioned assignment rule1In a different vector group vi
Figure BDA0002797946570000091
4. The power lines in the aerial image are continuous and close to straight lines. As shown in FIG. 2, assume that any power line is incumbentIntentional segmentation into multiple consecutive segments { seg1,seg2,...,segaA is the number of segments, and the slope corresponding to each segment is ki,i∈[1,a](ii) a For straight line segments, the slope difference of each segment should be close to 0, and for curve segments, the slope difference of each segment is smaller than a set threshold value Δ k, i.e. | ki-kj|<Δk,ki,kjIs the slope corresponding to any segment, and i, j is E [1, a ]](ii) a Considering the power line with curve characteristics, the threshold Δ k is set to 0.27.
The arbitrary two-dimensional vector from step 3 is denoted vi={(x1,y1),(x2,y2),...,(xm,ym)},(xm,ym)∈Iedge. V is to beiTrisection, expressed as
Figure BDA0002797946570000092
Wherein
Figure BDA0002797946570000093
Representing the m-th in the two-dimensional vector1A coordinate, i.e.
Figure BDA0002797946570000094
Figure BDA0002797946570000095
Representing the m-th in the two-dimensional vector2A coordinate, i.e.
Figure BDA0002797946570000096
Trisecting the transmission line into three parts based on the curvature characteristics of the transmission line
Figure BDA0002797946570000097
And
Figure BDA0002797946570000098
corresponding slope of
Figure BDA0002797946570000099
And
Figure BDA00027979465700000910
wherein
Figure BDA00027979465700000911
Calculating each segment
Figure BDA00027979465700000912
And
Figure BDA00027979465700000913
the difference in slope SI betweenwz=|kw-kzI, w, z ═ 1,2,3, delete SIwzA two-dimensional vector V is obtained by the two-dimensional vector of more than or equal to delta k2,V2={v'1,v'2,...v'i,...,v'n2},V2∈V1
5. The line segment after the primary screening of the curvature is only a partial line segment on the power line, is incomplete, and is usually disconnected. Therefore, the aggregation needs to be further performed according to a line segment projection method, and if the two line segments are collinear, the two line segments are connected. The principle of the line segment projection method is shown in FIG. 3, wherein two line segments are assumed to be l1And l2Extending the line segment end points to the image boundary according to the tangent line of the line segment end points to form the projection points of { A, B } and { A ', B' }, A, B, A 'and B', respectively, corresponding to the coordinates of (0, y)A)、 (0,yB)、(W,yA') And (W, y)B') W is the length of the aerial image, and the projection distances at the two ends of the aerial image are dA=|yA-yB|,dB=|yA'-yB'L, |; if l is1And l2Collinear, then projection distance dAAnd dBMin (d) should be satisfiedA,dB) T is less than or equal to T. In order to prevent two line segments that are close and approximately parallel to each other from being determined to be collinear, and in consideration of the influence of the width of the power line, a threshold value T of 10 is set here.
And setting the polar coordinate equation of the tangent of the end point of the line segment as rho ═ x · cos θ + y · sin θ, wherein rho is the polar diameter of the tangent, and θ is the horizontal line between the tangent and the imageAngle of axis, then dAAnd dBCalculated from equation (4).
Figure BDA0002797946570000101
Wherein the line segment l1And l2The end point tangent equation of11=x·cosθ1+y·sinθ1, l22=x·cosθ2+y·sinθ2,ρ1Is 11Pole diameter of (a) (. theta.)1Is 11Angle between tangent line of end point and horizontal cross axis of aerial image, rho2Is 12Pole diameter of (a) (. theta.)2Is 12And the included angle between the tangent line of the end point and the horizontal transverse axis of the aerial image.
6. After the line segments are screened secondarily by the line segment projection method, the two-dimensional vector of the image can be changed from V3Represents:
Figure BDA0002797946570000102
n is the number of power lines. V' after the polymerization by the line segment projection method in step 5 in consideration of the influence of the width of the power lineiNo longer a single pixel width. To obtain the power line detection result of a single pixel width, v ″' is processediCarrying out iterative processing to obtain a vector with a single pixel width
Figure BDA0002797946570000103
Then
Figure BDA0002797946570000104
The method comprises the following specific steps: first according to v ″)iThe abscissa of each point in the pair v ″, in order of small to largeiSorting to get v'i={(x'1,y'1),(x'2,y'2),...,(x't,y't) } mixing (x'1,y'1) As a starting point Pstart1(x, y), sequentially traversev″′iFind and (x'1,y'1) Is taken as the end point Pend1(x, y) passing through the starting point Pstart1(x, y) and an end point Pend1(x, y) obtaining
Figure BDA0002797946570000105
The new coordinates in (1) are
Figure BDA0002797946570000106
s is v'iMiddle Pstart1(x, y) to Pend1The total number of points of (x, y); by v'iMiddle Pend1As a new starting point Pstart2(x, y) repeating the above steps until v ″'iAll the coordinates are traversed to obtain the linear quantity of single pixel width
Figure BDA0002797946570000107
And is
Figure BDA0002797946570000108
Figure BDA0002797946570000109
stIs v'iMiddle Pstartt(x, y) to PendtThe total number of coordinates between (x, y).
7. And fitting the transmission line. After the power line detection operation, there may be a situation where the power line is not complete. In the power line aerial image, the power line always penetrates through the whole image, so that the complete power line can be still determined through the partial fitting points. Suppose a line segment
Figure BDA00027979465700001010
Has a fitting equation of
Figure BDA00027979465700001011
ak(k ═ 0, 1.., n) denotes the fitting parameterization, and n denotes the number of poles of the fitting polynomial. According to the least square method
Figure BDA0002797946570000111
Fitting is performed to
Figure BDA0002797946570000112
Pixel point of (x)t,yt) Determining a fitting parameter ak(k ═ 0, 1.., n) minimizes the sum of squares of the differences in the Y direction, as shown in equation (6).
Figure BDA0002797946570000113
Derivation of equation (6) yields a true symmetric positive definite matrix:
Figure BDA0002797946570000114
solving the matrix can obtain a fitting parameter a meeting the fitting conditionk(k ═ 0, 1.., n), the equation for the power line in the image is determined.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.

Claims (10)

1. The method for extracting the power transmission line based on the line characteristics is characterized by comprising the following steps of:
preprocessing an aerial image acquired by an unmanned aerial vehicle through an image enhancement algorithm, improving the contrast between a power transmission line and a background in the aerial image, and obtaining a gray level image Igray
Extracting smooth and complete edge segments from the gray level image based on an edge detection algorithm to obtain an edge image Iedge,IedgeThe gray value of the pixel point of the middle edge segment is 255, IedgeThe gray value of the pixel point of the middle non-edge part is 0;
by vector tracking algorithm, IedgeIs changed intoConversion to two-dimensional vector and deletion of IedgeThe edge segments of the middle and smaller than 20 pixel points are obtained as V1,V1={v1,v2,...,vi,...,vn1Wherein n1 is V1Number of medium two-dimensional vectors, viRepresenting a certain i-th two-dimensional vector, viComprising m pixels with a grey value of 255, denoted vi={(x1,y1),(x2,y2),...,(xm,ym)},(xm,ym)∈Iedge,m>20;
Based on the curve characteristics of the power transmission line, deleting all over-bent two-dimensional vectors to obtain a two-dimensional vector V2,V2={v'1,v'2,...v'i,...,v'n2},V2∈V1Wherein n2 is V2The number of the medium two-dimensional vectors;
two-dimensional vector V according to line segment projection method2Carrying out polymerization to obtain a two-dimensional vector V related to the transmission line3,V3={v″1,v”2,...,v″i,...,v”N},V3∈V2Wherein N represents V3The number of medium two-dimensional vectors also indicates the number of detected power lines, v ″i={(x1,y1),(x2,y2),...,(xt,yt) Representing the two-dimensional vector of the ith transmission line;
to V3All the two-dimensional vectors v ″' of the transmission lineiCarrying out iterative processing to obtain two-dimensional vector of transmission line with single pixel width
Figure FDA0002797946560000011
Figure FDA0002797946560000012
All transmission line two-dimensional vectors v ″)iThe vector set of the transmission line obtained after the iterative processing is V4
Figure FDA0002797946560000013
And fitting the power transmission line based on a least square method to determine a polynomial equation of the power transmission line in the aerial photography image.
2. The line feature-based power transmission line extraction method according to claim 1,
preprocessing an aerial image acquired by an unmanned aerial vehicle through an image enhancement algorithm, improving the contrast between a power transmission line and a background in the aerial image, and obtaining a gray level image IgrayThe method comprises the following steps:
a. the aerial image is a color RGB image, and the aerial image is IrgbEach corresponding color vector is (r, g, b), max is the maximum value among the r component, the g component, and the b component, min is the minimum value among the r component, the g component, and the b component, and the (h, s, v) value in the corresponding HSV space is:
Figure FDA0002797946560000021
Figure FDA0002797946560000022
v=max
according to the formula (1) adding IrgbRespectively obtaining saturation images I after converting into HSV spacehTone image IsAnd a luminance image Iv
b. For the v component, for the luminance image IvIs processed by histogram equalization to obtain I'vImproving the image contrast;
c. will Ih、IsAnd l'vAnd combining to obtain HSV images, wherein the corresponding vectors are (h ', s', v '), converting the HSV images into RGB color space, and the value of each color vector (r', g ', b') in the corresponding RGB color space is as follows:
Figure FDA0002797946560000023
wherein
Figure FDA0002797946560000024
p ═ v '× (1-s'), q ═ v '× (1-f × s'), t ═ v '× (1- (1-f) × s'), and the processed color RGB image is Ihrgb
d. Will IhrgbConverted into a grey-scale image IgrayAnd to IgrayAnd bilateral filtering is adopted, so that noise caused by equalization is eliminated, and background interference is reduced.
3. The line feature-based power transmission line extraction method according to claim 1,
edge detection algorithm-based secondary gray image IgrayExtracting smooth and complete edge segments to obtain an edge map Iedge,IedgeThe gray value of the pixel point of the middle edge segment is 255, the gray value of the pixel point of the non-edge part is 0, and the specific steps are as follows:
a. firstly, the original gray image I is processed by a Gaussian filtergrayProcessing to obtain image Img0
b. Processing Img with Sobel operator0Obtaining a gradient map Img1
c. According to Img1Calculating Img0Obtaining an anchor point diagram Img2
d. Connecting and drawing each anchor point to obtain an edge graph Iedge,IedgeThe gray value of the middle background is 0, and the gray value of the transmission line is 255.
4. The line feature-based power transmission line extraction method according to claim 1,
by vector tracking algorithm, IedgeThe edge segment in (1) is transformed into a two-dimensional vector and I is deletededgeThe edge segments of the middle and smaller than 20 pixel points are obtained as V1,V1={v1,v2,...,vi,...,vn1Wherein n1 is V1Of medium two-dimensional vectorsNumber viRepresenting a certain i-th two-dimensional vector, viComprising m pixels with a grey value of 255, denoted vi={(x1,y1),(x2,y2),...,(xm,ym) The method comprises the following steps:
in IedgeBased on the vector tracking algorithm, I is calculatededgeTo a two-dimensional vector V1
From IedgeThe left lower corner of the image is scanned line by line until a pixel with a gray value of 255 is found, and the pixel is taken as the starting position of the current vector and is recorded as a current pixel Q;
setting the gray value of the position of the current pixel Q as 0, searching 8 fields of the current pixel Q according to the sequence from left to right and from bottom to top, and recording the pixel with the first gray value of 255 as the current pixel Q;
then searching 8 fields of Q again according to the previous step until I is reachededgeAn edge, or a pixel with a gray value of 255 exists in 8 fields of the current pixel;
deleting I in vectorization processingedgeEdge segment of less than 20 pixels in the image, then V1Can be represented by formula (3), IedgeEach pixel value of (x) is not 0j,yj) Are assigned to V according to the above-mentioned assignment rule1Different vector group v ini
Figure FDA0002797946560000031
5. The line feature-based power transmission line extraction method according to claim 1,
based on the curve characteristics of the power transmission line, deleting all over-bent two-dimensional vectors to obtain a two-dimensional vector V2,V2={v'1,v'2,...v'i,...,v'n2},V2∈V1Wherein n2 is V2The number of the medium two-dimensional vectors specifically includes the following contents:
arbitrary transmission line is arbitrarily divided into a plurality of successive segments { seg1,seg2,...,segaA is the number of segments, and the slope corresponding to each segment is ki,i∈[1,a];
The slope difference of the segments of the linear shape is 0, and the slope difference of the segments of the curved shape is less than a set threshold value delta k, namely | kc-ke|<Δk,kcAnd keIs the slope corresponding to any segment, and c, e ∈ [1, a ]];
The two-dimensional vector of any line segment obtained in the step 3) is represented by viIs denoted by vi={(x1,y1),(x2,y2),...,(xm,ym)},(xm,ym)∈Iedge(ii) a V is to beiTrisection, expressed as
Figure FDA0002797946560000041
Wherein
Figure FDA0002797946560000042
Representing the m-th in the two-dimensional vector1A coordinate, i.e.
Figure FDA0002797946560000043
Representing the m-th in the two-dimensional vector2A coordinate, i.e.
Figure FDA0002797946560000044
Trisecting the transmission line into three parts based on the curvature characteristics of the transmission line
Figure FDA0002797946560000045
And
Figure FDA0002797946560000046
corresponding slopes are respectively
Figure FDA0002797946560000047
And
Figure FDA0002797946560000048
wherein
Figure FDA0002797946560000049
Computing
Figure FDA00027979465600000410
And
Figure FDA00027979465600000411
the difference in slope between the middle segments is SIwz=|kw-kzI, w, z ═ 1,2,3, delete SIwzA two-dimensional vector of ≧ Δ k.
6. The line feature-based power transmission line extraction method according to claim 5,
two-dimensional vector V according to line segment projection method2Carrying out polymerization to obtain a two-dimensional vector V related to the transmission line3,V3={v″1,v”2,...,v″i,...,v”N},V3∈V2Wherein N represents V3The number of medium two-dimensional vectors also indicates the number of detected power lines, v ″i={(x1,y1),(x2,y2),...,(xt,yt) Representing the two-dimensional vector of the ith transmission line, and comprising the following steps of:
two line segments are defined as l1And l2,l1Tangent sum of endpoints l2The tangents to the end points extend to the boundaries of the aerial image, l1Tangent sum of endpoints l2The tangent to the endpoint forms a projection point at the left edge of the boundary of the aerial image, denoted as { A, B }, l, respectively1Tangent sum of endpoints l2The coordinates of projection points formed by tangents of the end points on the right edge of the boundary of the aerial image, which are respectively marked as { A ', B' }, A, B, A 'and B', are respectively (0, y)A)、(0,yB)、(W,yA') And (W, y)B') W is the length of the aerial image, then l1Tangent sum of endpoints l2The projection distance of the tangent line of the end point on the left edge of the boundary of the aerial image is dA=|yA-yB|,l1Tangent sum of endpoints l2The projection distance of the tangent line of the end point on the right edge of the boundary of the aerial image is dB=|yA'-yB'If l1And l2Collinear, then projection distance dAAnd dBMin (d) should be satisfiedA,dB)≤T;
And if the polar coordinate equation of the tangent of the segment end point is rho-x-cos theta + y-sin theta, wherein rho is the polar diameter of the tangent, theta is the included angle between the tangent of the end point and the horizontal transverse axis of the aerial image, and (x, y) are the coordinates of the segment end point, d is the coordinate of the segment end pointAAnd dBCalculated from the following equation:
Figure FDA0002797946560000051
wherein l1And l2Respectively is l11=x·cosθ1+y·sinθ1,l22=x·cosθ2+y·sinθ2,ρ1Is 11Pole diameter of (a) (. theta.)1Is 11Angle between tangent line of end point and horizontal cross axis of aerial image, rho2Is 12Pole diameter of (a) (. theta.)2Is 12And the included angle between the tangent line of the end point and the horizontal transverse axis of the aerial image.
7. The line feature-based power transmission line extraction method according to claim 1,
to V3All the two-dimensional vectors v ″' of the transmission lineiCarrying out iterative processing to obtain two-dimensional vector of transmission line with single pixel width
Figure FDA0002797946560000052
Figure FDA0002797946560000053
All transmission line two-dimensional vectors v ″)iThe vector set of the transmission line obtained after the iterative processing is V4
Figure FDA0002797946560000054
The method specifically comprises the following steps:
first according to v ″)iThe abscissa of each point in the pair v ″, in order of small to largeiSorting to obtain v ″)i={(x'1,y'1),(x'2,y'2),...,(x't,y't) } mixing (x'1,y'1) As a starting point Pstart1(x, y), traverse v'iFind and (x'1,y'1) Is taken as the end point Pend1(x, y) passing through the starting point Pstart1(x, y) and an end point Pend1(x, y) to obtain
Figure FDA00027979465600000513
The new coordinates in (1) are
Figure FDA0002797946560000055
s1Is v'iMiddle Pstart1(x, y) to Pend1The total number of coordinates between (x, y); by v'iMiddle Pend1As a new starting point Pstart2(x, y) repeating the above steps until v ″'iAll the coordinates are traversed to obtain the linear quantity of single pixel width
Figure FDA0002797946560000056
And is
Figure FDA0002797946560000057
Figure FDA0002797946560000058
stIs v'iMiddle Pstartt(x, y) to PendtThe total number of coordinates between (x, y).
8. The line feature-based power transmission line extraction method according to claim 7,
fitting the power transmission line based on a least square method to determine a polynomial equation of the power transmission line in an aerial photography image, and specifically comprises the following steps:
line segment
Figure FDA0002797946560000059
Has a fitting equation of
Figure FDA00027979465600000510
Representing fitting parameters, and n represents the pole number of the fitting polynomial;
according to the least square method
Figure FDA00027979465600000511
Fitting is performed based on
Figure FDA00027979465600000512
Pixel point of (x)t,yt) Determining a fitting parameter ak(k ═ 0,1,..., n), fitting parameters ak(k ═ 0, 1.. times, n) is required to satisfy a condition that minimizes the sum of squares of the differences in the Y direction, as shown in equation (5):
Figure FDA0002797946560000061
deriving equation (5) to obtain a real symmetric positive definite matrix:
Figure FDA0002797946560000062
solving the formula (6) to obtain a fitting parameter a meeting the fitting conditionk(k ═ 0, 1.. times, n), determining a line segment
Figure FDA0002797946560000063
The equation of the corresponding power line in the aerial image.
9. The line feature-based power transmission line extraction method of claim 3, wherein the Gaussian filter uses a 5 x 5 Gaussian kernel with σ ═ 1, and the background grayscale value comprises a sky grayscale value.
10. The method according to claim 6, wherein the threshold Δ k is 0.27, and the threshold T is 10.
CN202011338502.7A 2020-11-25 2020-11-25 Power transmission line extraction method based on line characteristics Active CN112464789B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011338502.7A CN112464789B (en) 2020-11-25 2020-11-25 Power transmission line extraction method based on line characteristics

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011338502.7A CN112464789B (en) 2020-11-25 2020-11-25 Power transmission line extraction method based on line characteristics

Publications (2)

Publication Number Publication Date
CN112464789A true CN112464789A (en) 2021-03-09
CN112464789B CN112464789B (en) 2022-09-02

Family

ID=74799964

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011338502.7A Active CN112464789B (en) 2020-11-25 2020-11-25 Power transmission line extraction method based on line characteristics

Country Status (1)

Country Link
CN (1) CN112464789B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116912273A (en) * 2023-09-13 2023-10-20 国网山东省电力公司莱芜供电公司 Three-dimensional GIS-based transmission line crossing construction scheme visualization method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107341470A (en) * 2017-07-03 2017-11-10 国网浙江省电力公司信息通信分公司 A kind of transmission of electricity line detecting method based on Aerial Images
US20180357788A1 (en) * 2016-08-11 2018-12-13 Changzhou Campus of Hohai University UAV Inspection Method for Power Line Based on Human Visual System
CN109325935A (en) * 2018-07-24 2019-02-12 国网浙江省电力有限公司杭州供电公司 A kind of transmission line faultlocating method based on unmanned plane image
CN109615598A (en) * 2018-12-10 2019-04-12 武汉大学 A kind of power transmission line recognition methods based on the free algorithm of edge mapping parameter

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180357788A1 (en) * 2016-08-11 2018-12-13 Changzhou Campus of Hohai University UAV Inspection Method for Power Line Based on Human Visual System
CN107341470A (en) * 2017-07-03 2017-11-10 国网浙江省电力公司信息通信分公司 A kind of transmission of electricity line detecting method based on Aerial Images
CN109325935A (en) * 2018-07-24 2019-02-12 国网浙江省电力有限公司杭州供电公司 A kind of transmission line faultlocating method based on unmanned plane image
CN109615598A (en) * 2018-12-10 2019-04-12 武汉大学 A kind of power transmission line recognition methods based on the free algorithm of edge mapping parameter

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116912273A (en) * 2023-09-13 2023-10-20 国网山东省电力公司莱芜供电公司 Three-dimensional GIS-based transmission line crossing construction scheme visualization method
CN116912273B (en) * 2023-09-13 2023-12-12 国网山东省电力公司莱芜供电公司 Three-dimensional GIS-based transmission line crossing construction scheme visualization method

Also Published As

Publication number Publication date
CN112464789B (en) 2022-09-02

Similar Documents

Publication Publication Date Title
CN109615611B (en) Inspection image-based insulator self-explosion defect detection method
CN111428748B (en) HOG feature and SVM-based infrared image insulator identification detection method
CN108108746B (en) License plate character recognition method based on Caffe deep learning framework
JP5542889B2 (en) Image processing device
US8155437B2 (en) Perceptually lossless color compression
US7672507B2 (en) Image processing methods and systems
CN111415363B (en) Image edge identification method
CN110516550B (en) FPGA-based lane line real-time detection method
CN104881841B (en) Aerial high-voltage power tower image splicing method based on edge features and point features
CN107818303B (en) Unmanned aerial vehicle oil and gas pipeline image automatic contrast analysis method, system and software memory
CN108961286B (en) Unmanned aerial vehicle image segmentation method considering three-dimensional and edge shape characteristics of building
CN106407983A (en) Image body identification, correction and registration method
CN110268442B (en) Computer-implemented method of detecting a foreign object on a background object in an image, device for detecting a foreign object on a background object in an image, and computer program product
CN115631116B (en) Aircraft power inspection system based on binocular vision
Mousa et al. Building detection and regularisation using DSM and imagery information
CN117036641A (en) Road scene three-dimensional reconstruction and defect detection method based on binocular vision
CN112991283A (en) Flexible IC substrate line width detection method based on super-pixels, medium and equipment
CN103679740B (en) ROI (Region of Interest) extraction method of ground target of unmanned aerial vehicle
CN112633274A (en) Sonar image target detection method and device and electronic equipment
CN113435452A (en) Electrical equipment nameplate text detection method based on improved CTPN algorithm
CN115937552A (en) Image matching method based on fusion of manual features and depth features
CN115841633A (en) Power tower and power line associated correction power tower and power line detection method
Yarlagadda et al. A reflectance based method for shadow detection and removal
CN112464789B (en) Power transmission line extraction method based on line characteristics
Chaloeivoot et al. Building detection from terrestrial images

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant