CN112799422A - Unmanned aerial vehicle flight control method and device for power inspection - Google Patents

Unmanned aerial vehicle flight control method and device for power inspection Download PDF

Info

Publication number
CN112799422A
CN112799422A CN202110365262.8A CN202110365262A CN112799422A CN 112799422 A CN112799422 A CN 112799422A CN 202110365262 A CN202110365262 A CN 202110365262A CN 112799422 A CN112799422 A CN 112799422A
Authority
CN
China
Prior art keywords
unmanned aerial
aerial vehicle
target object
tower
angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110365262.8A
Other languages
Chinese (zh)
Other versions
CN112799422B (en
Inventor
戴永东
姚建光
王茂飞
蒋中军
曹亚兵
翁蓓蓓
鞠玲
毛锋
卜鑫链
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taizhou Power Supply Co of State Grid Jiangsu Electric Power Co Ltd
Zhongxin Hanchuang Beijing Technology Co Ltd
Original Assignee
Taizhou Power Supply Co of State Grid Jiangsu Electric Power Co Ltd
Zhongxin Hanchuang Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taizhou Power Supply Co of State Grid Jiangsu Electric Power Co Ltd, Zhongxin Hanchuang Beijing Technology Co Ltd filed Critical Taizhou Power Supply Co of State Grid Jiangsu Electric Power Co Ltd
Priority to CN202110365262.8A priority Critical patent/CN112799422B/en
Publication of CN112799422A publication Critical patent/CN112799422A/en
Application granted granted Critical
Publication of CN112799422B publication Critical patent/CN112799422B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • G05D1/0808Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Abstract

The invention discloses an unmanned aerial vehicle flight control method and device for power inspection and an unmanned aerial vehicle, wherein the method comprises the following steps: controlling the unmanned aerial vehicle to fly above the tower to be detected; adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected; determining the horizontal safe distance of the tower to be detected; controlling the unmanned aerial vehicle to translate towards one side of the tower to be detected for a horizontal flight safety distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed; detecting a target object and collecting a target object image in the vertical descending process; the method can effectively reduce the cost of manpower and material resources for routing inspection planning.

Description

Unmanned aerial vehicle flight control method and device for power inspection
Technical Field
The invention relates to the technical field of unmanned aerial vehicles, in particular to a flight control method and device of an unmanned aerial vehicle for power inspection.
Background
The existing automatic electric power inspection planning of the unmanned aerial vehicle can be used for automatic inspection after the flight route of the unmanned aerial vehicle is planned in advance, the automatic electric power inspection planning mainly comprises two modes of manually teaching a flight point generation route and planning the flight route by using a GIS point cloud map, the manually teaching the flight point generation route requires workers to carry unmanned aerial vehicle equipment to go to the site to photograph all inspection points of an inspection target, an unmanned aerial vehicle flight route file is generated and stored and the site route is verified, and when the subsequent fine inspection is carried out, the unmanned aerial vehicle can directly load the flight route file of the inspection target to carry out route re-flight to complete the inspection of the. The GIS point cloud map track planning firstly needs to manually control an unmanned aerial vehicle to carry a laser radar to carry out laser scanning on a target in a field to generate a point cloud map, and then manually mark a flight point on the three-dimensional point cloud map to generate an unmanned aerial vehicle flight route. When the unmanned aerial vehicle patrols and examines, the power equipment is patrolled and examined according to the air route generated on the point cloud map. Therefore, according to any method, large manpower and material resources are needed to be used for early preparation for realizing full-automatic inspection, the intelligent degree is low, and the cost is high.
In addition, unmanned aerial vehicle is patrolling and examining the in-process in carrying out the electric wire netting shaft tower becomes more meticulous, because cloud platform camera parameter, self positioning accuracy, camera cloud platform rotation accuracy scheduling problem, unmanned aerial vehicle patrols and examines the waypoint position and can have certain deviation, can lead to the target to shoot incomplete or unclear phenomenon when shooing to influence subsequent image processing and target object defect identification's accuracy.
Disclosure of Invention
The invention provides an unmanned aerial vehicle flight control method and device for power inspection, which can effectively reduce the manpower and material resource investment of automatic inspection planning and effectively reduce the cost.
An unmanned aerial vehicle flight control method for power inspection comprises the following steps:
controlling the unmanned aerial vehicle to fly above the tower to be detected;
adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected;
determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected;
controlling the unmanned aerial vehicle to move horizontally towards one side of the tower to be detected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed;
and in the vertical descending process, detecting a target object and acquiring a target object image.
Further, the target course angle of the unmanned aerial vehicle is calculated by the following formula:
Figure 294583DEST_PATH_IMAGE001
wherein the content of the first and second substances,
Figure 149406DEST_PATH_IMAGE002
is the target course angle of the drone,
Figure 929143DEST_PATH_IMAGE003
for the resolved heading angle of the drone,
Figure 324353DEST_PATH_IMAGE004
is the deviation angle of the unmanned aerial vehicle and the target direction.
Further, the horizontal safety distance of the tower to be detected is calculated through the following formula:
Figure 325675DEST_PATH_IMAGE005
wherein D is the horizontal safe distance of the tower to be detected, R is the radius of the earth,
Figure 148138DEST_PATH_IMAGE006
and
Figure 352854DEST_PATH_IMAGE007
respectively the longitude and latitude of the drone location,
Figure 240170DEST_PATH_IMAGE008
and
Figure 909049DEST_PATH_IMAGE009
respectively the longitude and the latitude of the position of the tower to be detected.
Further, in the vertical descending process, detecting the target object and acquiring the image of the target object, including:
detecting whether a target object appears in a camera picture;
after a target object appears in a camera picture, performing frame selection on the target object to acquire two diagonal coordinates of a selection frame;
calculating the center coordinate of the selection frame according to the two diagonal coordinates;
and generating a pan-tilt control signal to control the pan-tilt to rotate according to the central coordinates of the selection frame, so that the target object is located at the center of the camera picture.
Further, after the target object appears in the camera picture, the method further comprises:
scanning a target object through a laser radar, and resolving a first relative position of the target object and the unmanned aerial vehicle; or calculating a second relative position of the target object and the unmanned aerial vehicle through the angle of the target object in the camera picture;
according to the first relative position or the second relative position of the target object and the unmanned aerial vehicle, the unmanned aerial vehicle is adjusted to a preset shooting position.
Further, the relationship between the first relative position of the unmanned aerial vehicle and the target object obtained by scanning the target object with the laser radar is as follows:
Figure 840096DEST_PATH_IMAGE010
Figure 781376DEST_PATH_IMAGE011
wherein X, Y, Z is the coordinate of the target object in the coordinate system of the unmanned aerial vehicle,
Figure 518388DEST_PATH_IMAGE012
is the distance between the target object and the lidar,
Figure 979456DEST_PATH_IMAGE013
is the installation angle of the laser radar,
Figure 409300DEST_PATH_IMAGE014
in order to set the installation height of the laser radar,
Figure 339341DEST_PATH_IMAGE015
is a scanning angle;
the relationship of the second relative positions of the target object and the drone is as follows:
Figure 614465DEST_PATH_IMAGE016
Figure 195619DEST_PATH_IMAGE017
wherein the content of the first and second substances,
Figure 530785DEST_PATH_IMAGE018
Figure 446657DEST_PATH_IMAGE019
Figure 525472DEST_PATH_IMAGE020
the pitch angle, the yaw angle and the roll angle of the tripod head are respectively;
Figure 961132DEST_PATH_IMAGE021
is the angle of the target object relative to the drone,
Figure 732779DEST_PATH_IMAGE022
is the angle of the object in the camera view.
Further, the center coordinates of the selection box are calculated by the following formula:
Figure 365974DEST_PATH_IMAGE023
Figure 248479DEST_PATH_IMAGE024
wherein the content of the first and second substances,
Figure 538646DEST_PATH_IMAGE025
and
Figure 481195DEST_PATH_IMAGE026
in order to select the two diagonal coordinates of the box,
Figure 106080DEST_PATH_IMAGE027
is the center coordinate of the selection box.
Further, generating a pan-tilt control signal to control the pan-tilt to rotate according to the center coordinates of the selection frame, so that the target is located at the center of the camera image, including:
calculating a rotation angle required by the target object to be positioned in the camera picture center cradle head according to the center coordinates of the selection frame;
and generating the cradle head control signal according to the rotation angle required by the cradle head to control the rotation of the cradle head.
Further, the required rotation angle of the holder comprises a rotation angle required in the horizontal direction and an angle required in the longitudinal rotation; the required rotation angle in the horizontal direction and the required angle in the longitudinal direction are calculated by the following formula:
Figure 526697DEST_PATH_IMAGE028
Figure 936950DEST_PATH_IMAGE029
wherein the content of the first and second substances,
Figure 50399DEST_PATH_IMAGE030
the required angle of rotation for the horizontal direction,
Figure 664045DEST_PATH_IMAGE031
in order to rotate the required angle in the longitudinal direction,
Figure 888353DEST_PATH_IMAGE027
w is the camera frame width, H is the camera frame height,
Figure 949850DEST_PATH_IMAGE032
the actual focal length of the camera is taken as the width of the pixel;
the pixel width is calculated by the following formula:
Figure 171884DEST_PATH_IMAGE033
Figure 584411DEST_PATH_IMAGE034
length is the diagonal Length of the photosensitive element of the camera,
Figure 799361DEST_PATH_IMAGE035
is the equivalent focal length of the camera.
An unmanned aerial vehicle flight control for power inspection, comprising:
the initial control module is used for controlling the unmanned aerial vehicle to fly above the tower to be detected;
the adjusting module is used for adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected;
the distance determining module is used for determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected;
the inspection control module is used for controlling the unmanned aerial vehicle to horizontally move towards one side of the tower to be inspected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed;
and the target detection module is used for detecting a target object and acquiring a target object image in the vertical descending process.
The invention provides an unmanned aerial vehicle flight control method and device for power inspection, which at least have the following beneficial effects:
(1) the inspection planning only needs to determine an inspection starting point according to the position information of the tower to be inspected, then the target is detected and the image of the target is collected in the descending process of the unmanned aerial vehicle, manual demonstration of the waypoint and manual marking of the waypoint are not needed, manpower and material resources for automatic inspection planning are effectively saved, the intelligent degree is high, and the production cost is effectively reduced;
(2) the cloud platform control signal is generated through calculation to adjust the cloud platform, so that the target object is located in the center of the camera picture, the image of the target object is collected at the moment, the obtained target object is more complete and clear, and the accuracy of subsequent image processing and target object defect identification is improved.
Drawings
Fig. 1 is a flowchart of an embodiment of a method for controlling the flight of an unmanned aerial vehicle for power inspection according to the present invention.
Fig. 2 is a schematic diagram of a patrol starting point in an application scenario in the unmanned aerial vehicle flight control method for power patrol provided by the invention.
Fig. 3 is a schematic structural diagram of an embodiment of the unmanned aerial vehicle flight control device for power inspection provided by the invention.
Fig. 4 is a schematic structural diagram of an embodiment of the unmanned aerial vehicle for power inspection provided by the invention.
Detailed Description
In order to better understand the technical solution, the technical solution will be described in detail with reference to the drawings and the specific embodiments.
Referring to fig. 1, in some embodiments, there is provided a method of drone flight control for power routing inspection, comprising:
s1, controlling the unmanned aerial vehicle to fly above the tower to be detected;
s2, adjusting the posture of the unmanned aerial vehicle to enable the target course angle of the unmanned aerial vehicle to face one side of the tower to be detected;
s3, determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected;
s4, controlling the unmanned aerial vehicle to move horizontally towards one side of the tower to be detected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed;
and S5, detecting the target object and acquiring the image of the target object in the vertical descending process.
Specifically, in step S1, control unmanned aerial vehicle to fly to the tower top of examining, include:
s11, determining the coordinate of the position above the tower to be detected according to the height information and the position information of the tower to be detected;
s12, controlling the unmanned aerial vehicle to fly above the tower to be detected according to the coordinates of the position above the tower to be detected.
The height information of the tower to be detected and the position information of the tower to be detected are obtained in advance, and the safe height distances of different types of towers are different. The position information of the tower to be detected comprises a GPS coordinate or an RTK coordinate, the GPS coordinate or the RTK coordinate of the tower to be detected is converted into a coordinate under an unmanned aerial vehicle coordinate system, the height of the tower to be detected and the safe height distance are added, a longitudinal coordinate is obtained, and therefore the coordinate of the position above the tower to be detected is obtained.
Further, in step S2, the target heading angle of the drone is calculated by the following formula:
Figure 980943DEST_PATH_IMAGE036
;(1)
wherein the content of the first and second substances,
Figure 108299DEST_PATH_IMAGE002
is the target course angle of the drone,
Figure 8122DEST_PATH_IMAGE003
for the resolved heading angle of the drone,
Figure 262648DEST_PATH_IMAGE004
is the deviation angle of the unmanned aerial vehicle and the target direction.
Further, in step S3, the horizontal safe distance of the tower to be detected is calculated according to the following formula:
Figure 564316DEST_PATH_IMAGE005
;(2)
wherein D is the horizontal safe distance of the tower to be detected, R is the radius of the earth,
Figure 49524DEST_PATH_IMAGE006
and
Figure 374327DEST_PATH_IMAGE007
respectively the longitude and latitude of the drone location,
Figure 744128DEST_PATH_IMAGE008
and
Figure 323139DEST_PATH_IMAGE009
respectively the longitude and the latitude of the position of the tower to be detected.
Further, in step S4, the unmanned aerial vehicle is controlled to move horizontally towards one side of the tower to be inspected and fly for the horizontal safety distance to reach the inspection starting point, and then the unmanned aerial vehicle is controlled to vertically descend at a preset speed.
The following further describes a specific application scenario.
Referring to fig. 2, the tower to be inspected is 100, and unmanned aerial vehicle be located a point, and horizontal safe distance is L, and unmanned aerial vehicle translation horizontal safe distance is located B point behind the L, and B point is for patrolling and examining the starting point, descends according to the speed of predetermineeing perpendicularly after arriving B point.
Further, in step S5, during the vertical descent process of the drone, detecting a target object and acquiring an image of the target object, specifically including:
s51, detecting whether a target object appears in the camera picture;
s52, after the target object appears in the camera picture, performing frame selection on the target object to acquire two diagonal coordinates of the selection frame;
s53, calculating the center coordinates of the selection frame according to the two diagonal coordinates;
and S54, generating a pan-tilt control signal to control the pan-tilt to rotate according to the center coordinates of the selection frame, so that the target is located at the center of the camera picture.
Specifically, after a target object appears in the camera picture, the target object is subjected to frame selection, the center coordinate of the selection frame is calculated, the required rotation angle of the cradle head for enabling the target object to be located at the center of the camera picture is calculated according to the center coordinate, and a cradle head control signal is generated.
Further, in step S51, acquiring an image by a camera, and performing target object recognition based on the YOLOv5 model; the target objects include but are not limited to insulators, cross arm hanging points, wire hanging points and the like.
As an optional implementation manner, after the target object appears in the camera frame, the method further includes:
scanning a target object through a laser radar, and resolving a first relative position of the target object and the unmanned aerial vehicle; or calculating a second relative position of the target object and the unmanned aerial vehicle through the angle of the target object in the camera picture;
according to the first relative position or the second relative position of the target object and the unmanned aerial vehicle, the unmanned aerial vehicle is adjusted to a preset shooting position.
The relationship between the first relative position of the target object and the unmanned aerial vehicle obtained by scanning the target object with the laser radar is as follows:
Figure 120194DEST_PATH_IMAGE010
;(3)
Figure 666713DEST_PATH_IMAGE011
;(4)
wherein X, Y, Z is the coordinate of the target object in the coordinate system of the unmanned aerial vehicle,
Figure 840205DEST_PATH_IMAGE012
is the distance between the target object and the lidar,
Figure 37837DEST_PATH_IMAGE013
is the installation angle of the laser radar,
Figure 5793DEST_PATH_IMAGE014
in order to set the installation height of the laser radar,
Figure 39608DEST_PATH_IMAGE015
is a scanning angle;
the relationship of the second relative positions of the target object and the drone is as follows:
Figure 751212DEST_PATH_IMAGE016
;(5)
Figure 298956DEST_PATH_IMAGE017
;(6)
wherein the content of the first and second substances,
Figure 437814DEST_PATH_IMAGE018
Figure 958925DEST_PATH_IMAGE019
Figure 395591DEST_PATH_IMAGE020
the pitch angle, the yaw angle and the roll angle of the tripod head are respectively;
Figure 380865DEST_PATH_IMAGE021
is the angle of the target object relative to the drone,
Figure 628307DEST_PATH_IMAGE022
is the angle of the object in the camera view.
According to the shooting specification of a power grid, shooting a target object at multiple angles is sometimes required, for example, the target object is directly in front of, directly above, directly below, obliquely above, obliquely below and the like, the target object is scanned through a laser radar, a first relative position of the target object and an unmanned aerial vehicle is solved, namely a coordinate of the target object under an unmanned aerial vehicle coordinate system, the position of the unmanned aerial vehicle can be adjusted according to the coordinate, so that the unmanned aerial vehicle is located at a preset shooting position, and the preset shooting position comprises the target object directly in front of, directly above, directly below, obliquely above, obliquely below and the like; or, still can obtain the angle of target object relative unmanned aerial vehicle according to the angle of target object in the camera picture, adjust unmanned aerial vehicle's position through this angle for unmanned aerial vehicle is located and predetermines the shooting position.
Further, in step S52, in the camera coordinate system, the target object is framed, the selection frame is rectangular, and two diagonal coordinates of the selection frame are obtained, each of which is a coordinate of the target object
Figure 699031DEST_PATH_IMAGE037
And
Figure 440853DEST_PATH_IMAGE038
further, in step S53, the center coordinates of the selection box are calculated according to the two diagonal coordinates, and the center coordinates of the selection box are calculated according to the following formula:
Figure 280633DEST_PATH_IMAGE023
;(7)
Figure 698976DEST_PATH_IMAGE024
;(8)
wherein the content of the first and second substances,
Figure 991417DEST_PATH_IMAGE025
and
Figure 35465DEST_PATH_IMAGE026
in order to select the two diagonal coordinates of the box,
Figure 729752DEST_PATH_IMAGE027
is the center coordinate of the selection box.
Specifically, in step S54, generating a pan/tilt control signal to control the pan/tilt rotation according to the center coordinates of the selection frame, so that the target is located at the center of the camera image, including:
calculating a rotation angle required by the target object to be positioned in the camera picture center cradle head according to the center coordinates of the selection frame;
and generating the cradle head control signal according to the rotation angle required by the cradle head to control the rotation of the cradle head.
Calculating a rotation angle required by the target object to be positioned in the camera picture center cradle head according to the center coordinates of the selection frame; the required rotation angle of the holder comprises a rotation angle required by the horizontal direction and a rotation angle required by the longitudinal rotation, and is specifically calculated by the following formula:
Figure 318996DEST_PATH_IMAGE028
;(9)
Figure 364312DEST_PATH_IMAGE029
;(10)
wherein the content of the first and second substances,
Figure 447937DEST_PATH_IMAGE030
the required angle of rotation for the horizontal direction,
Figure 996730DEST_PATH_IMAGE031
in order to rotate the required angle in the longitudinal direction,
Figure 84772DEST_PATH_IMAGE027
w is the camera frame width, H is the camera frame height,
Figure 289488DEST_PATH_IMAGE032
the actual focal length of the camera is taken as the width of the pixel;
the pixel width is calculated by the following formula:
Figure 675339DEST_PATH_IMAGE033
;(11)
Figure 78639DEST_PATH_IMAGE034
;(12)
length is the diagonal Length of the photosensitive element of the camera,
Figure 337582DEST_PATH_IMAGE035
is the equivalent focal length of the camera.
After the holder is rotated, the target object is located in the center of the camera picture, the image of the target object is collected at the moment, the obtained target object is more complete and clear, and the accuracy of subsequent image processing and target object defect identification is improved.
The method provided by the embodiment at least comprises the following beneficial effects:
(1) the inspection planning only needs to determine an inspection starting point according to the position information of the tower to be inspected, then the target is detected and the image of the target is collected in the descending process of the unmanned aerial vehicle, manual demonstration of the waypoint and manual marking of the waypoint are not needed, manpower and material resources for automatic inspection planning are effectively saved, the intelligent degree is high, and the production cost is effectively reduced;
(2) the cloud platform control signal is generated through calculation to adjust the cloud platform, so that the target object is located in the center of the camera picture, the image of the target object is collected at the moment, the obtained target object is more complete and clear, and the accuracy of subsequent image processing and target object defect identification is improved.
Referring to fig. 3, in some embodiments, there is provided a drone flight control for power routing inspection comprising:
the initial control module 201 is used for controlling the unmanned aerial vehicle to fly above the tower to be detected;
the adjusting module 202 is used for adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected;
the distance determining module 203 is used for determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected;
the inspection control module 204 is used for controlling the unmanned aerial vehicle to horizontally move towards one side of the tower to be inspected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed;
and the target detection module 205 is used for detecting a target object and acquiring a target object image in the vertical descending process.
Specifically, the initial control module 201 is further configured to determine a coordinate of a position above the tower to be detected according to the height information and the position information of the tower to be detected; and controlling the unmanned aerial vehicle to fly to the position above the tower to be detected according to the coordinates of the position above the tower to be detected.
The height information of the tower to be detected and the position coordinate information of the tower to be detected are obtained in advance, and the safe height distances of different types of towers are different. The position information of the tower to be detected comprises a GPS coordinate or an RTK coordinate, the GPS coordinate or the RTK coordinate of the tower to be detected is converted into a coordinate under an unmanned aerial vehicle coordinate system, the height of the tower to be detected and the safe height distance are added, a longitudinal coordinate is obtained, and therefore the coordinate of the position above the tower to be detected is obtained.
Further, the adjusting module 202 calculates a target heading angle of the drone by equation (1).
Further, the distance determining module 203 determines the horizontal safe distance of the tower to be detected by the formula (2).
Further, the target detection module 205 is configured to detect whether a target object appears in the camera frame; after a target object appears in a camera picture, performing frame selection on the target object to acquire two diagonal coordinates of a selection frame; calculating the center coordinate of the selection frame according to the two diagonal coordinates; and generating a pan-tilt control signal to control the pan-tilt to rotate according to the central coordinates of the selection frame, so that the target object is located at the center of the camera picture.
Further, the target detection module 205 is further configured to calculate, according to the center coordinate of the selection box, a rotation angle required for enabling the target object to be located at the center of the camera image cradle head; and generating the cradle head control signal according to the rotation angle required by the cradle head to control the rotation of the cradle head.
Wherein the target objects include but are not limited to insulators, cross arm hanging points and wire hanging points.
Further, the target detection module 205 is further configured to select a rectangular selection frame for the target object, and obtain two diagonal coordinates of the selection frame, where the two diagonal coordinates are respectively
Figure 29594DEST_PATH_IMAGE039
And
Figure 766606DEST_PATH_IMAGE040
and calculating the center coordinate of the selection frame according to the two diagonal coordinates, wherein the center coordinate of the selection frame is calculated through a formula (7) and a formula (8).
The required rotation angle of the holder comprises a rotation angle required in the horizontal direction and a rotation angle required in the longitudinal direction, and is specifically calculated through a formula (9) -a formula (12).
After the holder is rotated, the target object is located in the center of the camera picture, the image of the target object is collected at the moment, the obtained target object is more complete and clear, and the accuracy of subsequent image processing and target object defect identification is improved.
In addition, the device further comprises a relative position adjusting module 206, which is used for scanning the target object through a laser radar after the target object appears in the plane picture, and resolving a first relative position of the target object and the unmanned plane; or calculating a second relative position of the target object and the unmanned aerial vehicle through the angle of the target object in the camera picture; according to the first relative position or the second relative position of the target object and the unmanned aerial vehicle, the unmanned aerial vehicle is adjusted to a preset shooting position.
The first relative positional relationship is shown in equations (3) to (4), and the second relative positional relationship is shown in equations (5) to (6).
The device provided by the embodiment at least comprises the following beneficial effects:
(1) the inspection planning only needs to determine an inspection starting point according to the position information of the tower to be inspected, then the target is detected and the image of the target is collected in the descending process of the unmanned aerial vehicle, manual demonstration of the waypoint and manual marking of the waypoint are not needed, manpower and material resources for automatic inspection planning are effectively saved, the intelligent degree is high, and the production cost is effectively reduced;
(2) the cloud platform control signal is generated through calculation to adjust the cloud platform, so that the target object is located in the center of the camera picture, the image of the target object is collected at the moment, the obtained target object is more complete and clear, and the accuracy of subsequent image processing and target object defect identification is improved.
Referring to fig. 4, in some embodiments, a drone 301 is provided, where the drone 301 is loaded with a processor 305 and a storage module 306; the storage module 306 stores a plurality of instructions, and the processor 305 is configured to read the plurality of instructions and execute the method according to the above embodiment, for example: controlling the unmanned aerial vehicle to fly above the tower to be detected; adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected; determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected; controlling the unmanned aerial vehicle to move horizontally towards one side of the tower to be detected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed; and in the vertical descending process, detecting a target object and acquiring a target object image.
In addition, the unmanned aerial vehicle is also provided with a pan/tilt head 303 and a camera 304, the camera 304 is arranged in cooperation with the pan/tilt head 303, and the processor 305 is connected with the pan/tilt head 303 and the camera 304.
In some embodiments, there is also provided a computer-readable storage medium storing a plurality of instructions readable by a processor and performing the method of the above embodiments; for example: controlling the unmanned aerial vehicle to fly above the tower to be detected; adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected; determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected; controlling the unmanned aerial vehicle to move horizontally towards one side of the tower to be detected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed; and in the vertical descending process, detecting a target object and acquiring a target object image.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention. It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. The utility model provides an unmanned aerial vehicle flight control method for electric power inspection, its characterized in that includes:
controlling the unmanned aerial vehicle to fly above the tower to be detected;
adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected;
determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected;
controlling the unmanned aerial vehicle to move horizontally towards one side of the tower to be detected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed;
and in the vertical descending process, detecting a target object and acquiring a target object image.
2. The method of claim 1, wherein the target heading angle of the drone is calculated by the formula:
Figure 191374DEST_PATH_IMAGE001
wherein the content of the first and second substances,
Figure 621218DEST_PATH_IMAGE002
is the target course angle of the drone,
Figure 49794DEST_PATH_IMAGE003
for the resolved heading angle of the drone,
Figure 262601DEST_PATH_IMAGE004
is the deviation angle of the unmanned aerial vehicle and the target direction.
3. The method according to claim 1, characterized in that the horizontal safety distance of the tower to be inspected is calculated by the following formula:
Figure 594487DEST_PATH_IMAGE005
wherein D is the horizontal safe distance of the tower to be detected, R is the radius of the earth,
Figure 132916DEST_PATH_IMAGE006
and
Figure 783209DEST_PATH_IMAGE007
respectively the longitude and latitude of the drone location,
Figure 862024DEST_PATH_IMAGE008
and
Figure 563263DEST_PATH_IMAGE009
respectively the longitude and the latitude of the position of the tower to be detected.
4. The method of claim 1, wherein detecting the target object and acquiring an image of the target object during the vertical descent comprises:
detecting whether a target object appears in a camera picture;
after a target object appears in a camera picture, performing frame selection on the target object to acquire two diagonal coordinates of a selection frame;
calculating the center coordinate of the selection frame according to the two diagonal coordinates;
and generating a pan-tilt control signal to control the pan-tilt to rotate according to the central coordinates of the selection frame, so that the target object is located at the center of the camera picture.
5. The method of claim 4, wherein after the object appears in the camera view, further comprising:
scanning a target object through a laser radar, and resolving a first relative position of the target object and the unmanned aerial vehicle; or calculating a second relative position of the target object and the unmanned aerial vehicle through the angle of the target object in the camera picture;
according to the first relative position or the second relative position of the target object and the unmanned aerial vehicle, the unmanned aerial vehicle is adjusted to a preset shooting position.
6. The method of claim 5, wherein the first relative position of the drone and the target obtained by scanning the target with the lidar are in relation to one another as follows:
Figure 492167DEST_PATH_IMAGE010
Figure 646068DEST_PATH_IMAGE011
wherein X, Y, Z is the coordinate of the target object in the coordinate system of the unmanned aerial vehicle,
Figure 528574DEST_PATH_IMAGE012
is the distance between the target object and the lidar,
Figure 333587DEST_PATH_IMAGE013
is the installation angle of the laser radar,
Figure 948239DEST_PATH_IMAGE014
in order to set the installation height of the laser radar,
Figure 74590DEST_PATH_IMAGE015
is a scanning angle;
the relationship of the second relative positions of the target object and the drone is as follows:
Figure 698469DEST_PATH_IMAGE016
Figure 92410DEST_PATH_IMAGE017
wherein the content of the first and second substances,
Figure 940280DEST_PATH_IMAGE018
Figure 68773DEST_PATH_IMAGE019
Figure 545996DEST_PATH_IMAGE020
the pitch angle, the yaw angle and the roll angle of the tripod head are respectively;
Figure 810755DEST_PATH_IMAGE021
is the angle of the target object relative to the drone,
Figure 547636DEST_PATH_IMAGE022
is the angle of the object in the camera view.
7. The method of claim 4, wherein the center coordinates of the selection box are calculated by the following formula:
Figure 960162DEST_PATH_IMAGE023
Figure 394686DEST_PATH_IMAGE024
wherein the content of the first and second substances,
Figure 264684DEST_PATH_IMAGE025
and
Figure 923199DEST_PATH_IMAGE026
in order to select the two diagonal coordinates of the box,
Figure 744393DEST_PATH_IMAGE027
is the center coordinate of the selection box.
8. The method of claim 4, wherein generating a pan-tilt control signal to control the pan-tilt rotation according to the center coordinates of the selection frame so that the target is located at the center of the camera frame comprises:
calculating a rotation angle required by the target object to be positioned in the camera picture center cradle head according to the center coordinates of the selection frame;
and generating the cradle head control signal according to the rotation angle required by the cradle head to control the rotation of the cradle head.
9. The method of claim 8, wherein the desired rotational angle of the pan/tilt head comprises a desired rotational angle in a horizontal direction and a desired rotational angle in a longitudinal direction; the required rotation angle in the horizontal direction and the required angle in the longitudinal direction are calculated by the following formula:
Figure 513766DEST_PATH_IMAGE028
Figure 972691DEST_PATH_IMAGE029
wherein the content of the first and second substances,
Figure 598845DEST_PATH_IMAGE030
the required angle of rotation for the horizontal direction,
Figure 923647DEST_PATH_IMAGE031
in order to rotate the required angle in the longitudinal direction,
Figure 480399DEST_PATH_IMAGE027
w is the camera frame width, H is the camera frame height,
Figure 308678DEST_PATH_IMAGE032
the actual focal length of the camera is taken as the width of the pixel;
the pixel width is calculated by the following formula:
Figure 794148DEST_PATH_IMAGE033
Figure 606246DEST_PATH_IMAGE034
length is the diagonal Length of the photosensitive element of the camera,
Figure 779738DEST_PATH_IMAGE035
is the equivalent focal length of the camera.
10. The utility model provides an unmanned aerial vehicle flight control device for electric power is patrolled and examined, its characterized in that includes:
the initial control module is used for controlling the unmanned aerial vehicle to fly above the tower to be detected;
the adjusting module is used for adjusting the posture of the unmanned aerial vehicle to enable a target course angle of the unmanned aerial vehicle to face one side of the tower to be detected;
the distance determining module is used for determining the horizontal safety distance of the tower to be detected according to the position information of the unmanned aerial vehicle and the position information of the tower to be detected;
the inspection control module is used for controlling the unmanned aerial vehicle to horizontally move towards one side of the tower to be inspected and fly for the horizontal safe distance, and then controlling the unmanned aerial vehicle to vertically descend at a preset speed;
and the target detection module is used for detecting a target object and acquiring a target object image in the vertical descending process.
CN202110365262.8A 2021-04-06 2021-04-06 Unmanned aerial vehicle flight control method and device for power inspection Active CN112799422B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110365262.8A CN112799422B (en) 2021-04-06 2021-04-06 Unmanned aerial vehicle flight control method and device for power inspection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110365262.8A CN112799422B (en) 2021-04-06 2021-04-06 Unmanned aerial vehicle flight control method and device for power inspection

Publications (2)

Publication Number Publication Date
CN112799422A true CN112799422A (en) 2021-05-14
CN112799422B CN112799422B (en) 2021-07-13

Family

ID=75816259

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110365262.8A Active CN112799422B (en) 2021-04-06 2021-04-06 Unmanned aerial vehicle flight control method and device for power inspection

Country Status (1)

Country Link
CN (1) CN112799422B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113419564A (en) * 2021-08-24 2021-09-21 天津市普迅电力信息技术有限公司 Power channel inspection method based on fuzzy path
CN113759957A (en) * 2021-06-19 2021-12-07 国网浙江省电力有限公司浦江县供电公司 Unmanned aerial vehicle power line inspection method
CN114035606A (en) * 2021-11-05 2022-02-11 中国南方电网有限责任公司超高压输电公司广州局 Pole tower inspection system, pole tower inspection method, control device and storage medium
CN114215704A (en) * 2021-12-14 2022-03-22 复亚智能科技(太仓)有限公司 Power generation fan blade image acquisition device and method and storage medium
CN114379778A (en) * 2021-12-31 2022-04-22 国网湖北省电力有限公司超高压公司 System and method for detecting offset distance of tower top of electric power tower by using unmanned aerial vehicle
CN115357052A (en) * 2022-10-19 2022-11-18 复亚智能科技(太仓)有限公司 Method and system for automatically exploring interest points in video picture by unmanned aerial vehicle
CN116929308A (en) * 2023-09-18 2023-10-24 众芯汉创(江苏)科技有限公司 Unmanned aerial vehicle around-flight photographing method and system based on arbitrary point position information of tower

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004028610A (en) * 2002-06-21 2004-01-29 Soft Consultant Corp Mileage measuring method, system, recording medium and program
CN101902616A (en) * 2009-06-01 2010-12-01 金三立视频科技(深圳)有限公司 Quick stereo positioning method for video monitoring
CN102098499A (en) * 2011-03-24 2011-06-15 杭州华三通信技术有限公司 Pan/ tilt/ zoom (PTZ) camera control method, device and system thereof
CN103731630A (en) * 2012-10-16 2014-04-16 华为技术有限公司 Video monitoring method, equipment and system
CN105162042A (en) * 2015-10-19 2015-12-16 国网山东省电力公司莱芜供电公司 Power transmission line unmanned plane single tower patrol path standardizing control method
CN110907945A (en) * 2019-10-28 2020-03-24 广西电网有限责任公司电力科学研究院 Positioning method considering indoor and outdoor flight of unmanned aerial vehicle
CN110989657A (en) * 2019-11-15 2020-04-10 国网河南省电力公司洛阳供电公司 Mid-tower patrol inspection method based on unmanned aerial vehicle infrared detection
CN111079743A (en) * 2019-12-04 2020-04-28 国网新疆电力有限公司乌鲁木齐供电公司 Data acquisition method based on automatic insulator identification of unmanned aerial vehicle aerial photography data
CN111928811A (en) * 2020-09-22 2020-11-13 上海钛米机器人股份有限公司 Ground detection method, device, equipment and storage medium
CN111998832A (en) * 2020-08-12 2020-11-27 河北雷神科技有限公司 Laser point cloud-based inspection method for accurately positioning target object by using unmanned aerial vehicle
CN112154654A (en) * 2019-08-21 2020-12-29 深圳市大疆创新科技有限公司 Match shooting method, electronic equipment, unmanned aerial vehicle and storage medium
CN112200863A (en) * 2020-12-07 2021-01-08 华南理工大学 Unmanned aerial vehicle monitoring telegraph pole inclination system based on synchronous positioning and mapping
CN112598668A (en) * 2021-03-02 2021-04-02 北京大成国测科技有限公司 Defect identification method and device based on three-dimensional image and electronic equipment

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004028610A (en) * 2002-06-21 2004-01-29 Soft Consultant Corp Mileage measuring method, system, recording medium and program
CN101902616A (en) * 2009-06-01 2010-12-01 金三立视频科技(深圳)有限公司 Quick stereo positioning method for video monitoring
CN102098499A (en) * 2011-03-24 2011-06-15 杭州华三通信技术有限公司 Pan/ tilt/ zoom (PTZ) camera control method, device and system thereof
CN103731630A (en) * 2012-10-16 2014-04-16 华为技术有限公司 Video monitoring method, equipment and system
CN105162042A (en) * 2015-10-19 2015-12-16 国网山东省电力公司莱芜供电公司 Power transmission line unmanned plane single tower patrol path standardizing control method
CN112154654A (en) * 2019-08-21 2020-12-29 深圳市大疆创新科技有限公司 Match shooting method, electronic equipment, unmanned aerial vehicle and storage medium
CN110907945A (en) * 2019-10-28 2020-03-24 广西电网有限责任公司电力科学研究院 Positioning method considering indoor and outdoor flight of unmanned aerial vehicle
CN110989657A (en) * 2019-11-15 2020-04-10 国网河南省电力公司洛阳供电公司 Mid-tower patrol inspection method based on unmanned aerial vehicle infrared detection
CN111079743A (en) * 2019-12-04 2020-04-28 国网新疆电力有限公司乌鲁木齐供电公司 Data acquisition method based on automatic insulator identification of unmanned aerial vehicle aerial photography data
CN111998832A (en) * 2020-08-12 2020-11-27 河北雷神科技有限公司 Laser point cloud-based inspection method for accurately positioning target object by using unmanned aerial vehicle
CN111928811A (en) * 2020-09-22 2020-11-13 上海钛米机器人股份有限公司 Ground detection method, device, equipment and storage medium
CN112200863A (en) * 2020-12-07 2021-01-08 华南理工大学 Unmanned aerial vehicle monitoring telegraph pole inclination system based on synchronous positioning and mapping
CN112598668A (en) * 2021-03-02 2021-04-02 北京大成国测科技有限公司 Defect identification method and device based on three-dimensional image and electronic equipment

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113759957A (en) * 2021-06-19 2021-12-07 国网浙江省电力有限公司浦江县供电公司 Unmanned aerial vehicle power line inspection method
CN113419564A (en) * 2021-08-24 2021-09-21 天津市普迅电力信息技术有限公司 Power channel inspection method based on fuzzy path
CN113419564B (en) * 2021-08-24 2021-12-03 天津市普迅电力信息技术有限公司 Power channel inspection method based on fuzzy path
CN114035606A (en) * 2021-11-05 2022-02-11 中国南方电网有限责任公司超高压输电公司广州局 Pole tower inspection system, pole tower inspection method, control device and storage medium
CN114215704A (en) * 2021-12-14 2022-03-22 复亚智能科技(太仓)有限公司 Power generation fan blade image acquisition device and method and storage medium
CN114379778A (en) * 2021-12-31 2022-04-22 国网湖北省电力有限公司超高压公司 System and method for detecting offset distance of tower top of electric power tower by using unmanned aerial vehicle
CN114379778B (en) * 2021-12-31 2023-01-13 国网湖北省电力有限公司超高压公司 System and method for detecting offset distance of tower top of electric power tower by using unmanned aerial vehicle
CN115357052A (en) * 2022-10-19 2022-11-18 复亚智能科技(太仓)有限公司 Method and system for automatically exploring interest points in video picture by unmanned aerial vehicle
CN116929308A (en) * 2023-09-18 2023-10-24 众芯汉创(江苏)科技有限公司 Unmanned aerial vehicle around-flight photographing method and system based on arbitrary point position information of tower
CN116929308B (en) * 2023-09-18 2023-11-28 众芯汉创(江苏)科技有限公司 Unmanned aerial vehicle around-flight photographing method and system based on arbitrary point position information of tower

Also Published As

Publication number Publication date
CN112799422B (en) 2021-07-13

Similar Documents

Publication Publication Date Title
CN112799422B (en) Unmanned aerial vehicle flight control method and device for power inspection
US9639960B1 (en) Systems and methods for UAV property assessment, data capture and reporting
US10565787B1 (en) Systems and methods for enhanced 3D modeling of a complex object
US9886632B1 (en) Systems and methods for autonomous perpendicular imaging of test squares
US11017228B2 (en) Method and arrangement for condition monitoring of an installation with operating means
CN112904877A (en) Automatic fan blade inspection system and method based on unmanned aerial vehicle
CN106124517A (en) Detect many rotor wing unmanned aerial vehicles detection platform system in structural member surface crack and for the method detecting structural member surface crack
CN104298248A (en) Accurate visual positioning and orienting method for rotor wing unmanned aerial vehicle
CN113066120B (en) Intelligent pole and tower inclination detection method based on machine vision
CN107749072B (en) Unmanned aerial vehicle aerial image calibration method suitable for slope surface measurement
CN105045276A (en) Method and apparatus for controlling flight of unmanned plane
CN115793689A (en) Unmanned aerial vehicle automatic overhead transmission line inspection method and system based on front-end target identification
CN109445455B (en) Unmanned aerial vehicle autonomous landing method and control system thereof
KR101771492B1 (en) Method and system for mapping using UAV and multi-sensor
JP2021035833A (en) Inspection system
CN116501091B (en) Fan inspection control method and device based on unmanned aerial vehicle automatic adjustment route
CN114020002A (en) Method, device and equipment for inspecting fan blade by unmanned aerial vehicle, unmanned aerial vehicle and medium
CN113778137A (en) Unmanned aerial vehicle autonomous inspection method for power transmission line
CN114415708A (en) Road self-inspection method and device, unmanned aerial vehicle and storage medium
CN112327898B (en) Unmanned aerial vehicle well inspection navigation method and device and unmanned aerial vehicle
CN113987246A (en) Automatic picture naming method, device, medium and electronic equipment for unmanned aerial vehicle inspection
CN116974298A (en) Single-line laser radar-based transmission line simulated flight method and system
CN116297472A (en) Unmanned aerial vehicle bridge crack detection method and system based on deep learning
CN113900436B (en) Inspection control method, inspection control device, inspection control equipment and storage medium
CN113870228A (en) Tower crane surface oxidation damage identification, positioning and damage area statistical method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: No.2, Fenghuang West Road, Taizhou City, Jiangsu Province

Applicant after: STATE GRID JIANGSU ELECTRIC POWER Co.,Ltd. TAIZHOU POWER SUPPLY BRANCH

Applicant after: ZHONGXIN HANCHUANG (BEIJING) TECHNOLOGY Co.,Ltd.

Address before: 100094 room 129, 1st floor, building 5, 8 Dongbeiwang West Road, Haidian District, Beijing

Applicant before: ZHONGXIN HANCHUANG (BEIJING) TECHNOLOGY Co.,Ltd.

Applicant before: STATE GRID JIANGSU ELECTRIC POWER Co.,Ltd. TAIZHOU POWER SUPPLY BRANCH

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant