CN105353772A - Visual servo control method for unmanned aerial vehicle maneuvering target locating and tracking - Google Patents

Visual servo control method for unmanned aerial vehicle maneuvering target locating and tracking Download PDF

Info

Publication number
CN105353772A
CN105353772A CN201510785505.8A CN201510785505A CN105353772A CN 105353772 A CN105353772 A CN 105353772A CN 201510785505 A CN201510785505 A CN 201510785505A CN 105353772 A CN105353772 A CN 105353772A
Authority
CN
China
Prior art keywords
phi
psi
theta
coordinate system
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510785505.8A
Other languages
Chinese (zh)
Other versions
CN105353772B (en
Inventor
王立鹏
刘培强
周英伟
韩松
樊鹏辉
王小刚
杨超峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aerospace Age Feihong Technology Co., Ltd.
Original Assignee
China Academy of Aerospace Electronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Academy of Aerospace Electronics Technology Co Ltd filed Critical China Academy of Aerospace Electronics Technology Co Ltd
Priority to CN201510785505.8A priority Critical patent/CN105353772B/en
Publication of CN105353772A publication Critical patent/CN105353772A/en
Application granted granted Critical
Publication of CN105353772B publication Critical patent/CN105353772B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/12Target-seeking control
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • G05D1/0808Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

The invention belongs to the technical field of unmanned aerial vehicle flight control and machine visual intersection fusion, and particularly relates to a visual servo control method for unmanned aerial vehicle maneuvering target locating and tracking. The method comprises the steps that a geodetic coordinate system, a body coordinate system, a camera coordinate system, an image coordinate system and a body and geodetic transition coordinate system are established; and target locating and calculation of an attitude angle given value of target tracking and an attitude angle given value of course tracking are performed via the relationship between the established coordinate systems according to target imaging sequences so that visual servo control is completed. Target imaging is performed by using a single fixed camera only, and high-precision continuous locating and tracking of maneuvering targets are realized by controlling the attitude of an unmanned aerial vehicle. According to the method, a tracking holder or laser range finding equipment is not required so that load volume and cost can be effectively reduced and reconnaissance concealment can be enhanced.

Description

A kind of Visual servoing control method in UAV Maneuver target locating
Technical field
The invention belongs to the technical field of UAV Flight Control and machine vision mixing together, be specifically related to a kind of Visual servoing control method in UAV Maneuver target locating.
Background technology
And have man-machine compared with, unmanned plane has that volume is little, cost is low, maneuverability, easy to use and to plurality of advantages such as requirement for environmental conditions are lower.From being born from unmanned plane, its just constantly progress along with improving constantly of scientific and technological level, and be progressively widely used in the various fields such as military, civilian, police, performed task comprises: target reconnaissance, trace and monitor, target hit, injure assessment, rescue and relief work, personnel's search and rescue, terrain prospecting etc.The function of unmanned plane in daily life, value are shown up prominently; Effect in modernized war, status just progressively improve, and have become indispensable tactical weapon, and by means of the unique advantage of battlefield zero injures and deaths, its important air armament becoming future battlefield is unquestionable.Therefore in recent years, the growth momentum of domestic and international unmanned air vehicle technique is very swift and violent.
The location of maneuvering target and tracking are that unmanned plane scouts one of critical function followed the tracks of.Target localization is exactly by unmanned plane during flying parameter and load information, calculates the coordinate figure of impact point under earth coordinates; Target following is then according to locating information, is locked in all the time among unmanned plane load visual field by maneuvering target, and calculates the movable information of target by design con-trol strategy.The technology utilizing view data to carry out target identification reaches its maturity, and how to utilize the positioning result of target identification design servo control strategy carry out efficient target tracking be still domestic and international unmanned plane research focus and difficult point.
Due to small-sized limited with Small and micro-satellite load-carrying ability, in reconnaissance mission, general use carries out imaging reconnaissance without monopod video camera, video camera itself does not have tracking power, to realize target following function, need to utilize image information design con-trol algorithm, the position of control unmanned plane and attitude, by target lock-on heart region in the picture, realize location and the tracking of the maneuvering target of view-based access control model servo.
The inventive method can in military operation, and realize target is accurately located, the task such as surveillance and tracking and precision strike; In Multi computer cooperation, be conducive to collaborative finishing the work; In disaster relief, realize rapid rescue and treatment of the wounded etc.Therefore, the accurate locating and tracking of maneuvering target has important Research Significance and wide application prospect.
Summary of the invention
The present invention proposes a kind of Visual servoing control method in UAV Maneuver target locating, by carrying out Visual servoing control to unmanned plane, by target lock-on among camera field of view, reaching precision target location and tracking effect.
Concrete technical scheme of the present invention is as follows: the first step, determine the equipment states such as unmanned plane, GPS, Inertial Measurement Unit, video camera, determines camera intrinsic parameter and setting angle; Vector of unit length i on definition optical axis, obtains vector of unit length in the earth coordinates { expression under G} by coordinate system relation gp i, the optical axis asked by aircraft altitude and collinear image formation principle and ground intersection point A are in { the expression under G} gp a, and then try to achieve the expression of A under body axis system bp a;
Second step, according to scouting imaging select target point, by impact point t coordinate figure in the picture ( ix t, iy t) and camera intrinsic parameter, obtain impact point at the camera coordinate system { coordinate figure under C} cp t, in conjunction with camera installation locations, angle, the current longitude of aircraft, latitude, height and attitude angle, obtain impact point at the earth coordinates { coordinate of G} gp t, then resolved by earth model and obtain impact point longitude and latitude, realize target is accurately located;
3rd step, in conjunction with target localization result last time, according to the flight information of the time interval, aircraft, obtain the motion state that target is current, and estimate maneuvering target subsequent time position
4th step, with picture centre ip afor maneuvering target desired locations in the picture ip tr, then target is at { the desired locations under G} gp trfor gp a, according to error delta gp t= gp tr- gp tequation obtains attitude angle set-point θ t, φ tand ψ t;
5th step, by aircraft desired locations in flight track with aircraft current location gp bOerror delta gp bO, obtain attitude angle set-point φ respectively according to horizontal side direction control law and Longitudinal Control Law rand θ r.In conjunction with attitude angle set-point in task weight and the 4th step, obtain the total specified rate of each attitude angle, with each relevant rudder face of this servocontrol unmanned plane, the maximized Visual servoing control of stability margin in realize target locating and tracking process.
Beneficial effect: the present invention only needs to use single fixed camera to target imaging, by controlling UAV position and orientation, realize following the tracks of the high precision consecutive tracking of maneuvering target, the method is without the need to following the tracks of The Cloud Terrace and Laser Distance Measuring Equipment, significantly reduce volume and the cost of load, improve the disguise of scouting.The method is generally applicable to the target localization and tracking system of unmanned plane, is especially loaded with the SUAV (small unmanned aerial vehicle) of fixed cameras and the UAS of The Cloud Terrace motion failures.The method has important practical significance and having broad application prospects to unmanned plane (with other similar topworkies) high precision target locating, opens up certain guiding function to new location method.
Accompanying drawing explanation
Fig. 1 is the device connection diagram that unmanned plane target positioning and tracing method relates to;
Fig. 2 is each coordinate system used in Positioning and Tracking of Maneuvering Target process;
Fig. 3 is that under earth model, longitude and latitude and coordinate system represent relation schematic diagram;
Fig. 4 is the lower moving targets location tracing process schematic diagram of unmanned aerial vehicle flight path flight.
Embodiment
Below in conjunction with accompanying drawing, the UAV Maneuver target locating method embodiment of a kind of view-based access control model servo that the present invention proposes is described in detail.
1 unmanned aerial vehicle platform and coordinate system definition
For scouting UAS, unmanned aerial vehicle platform involved in the present invention comprises the parts such as aircraft subsystem, flight-control computer, pattern process computer, video camera, aircraft subsystem includes the equipment such as Inertial Measurement Unit and GPS, is used for measuring UAV Attitude and position.Main device connection diagram as shown in Figure 1.
In Positioning and Tracking of Maneuvering Target process, as shown in Figure 2, each coordinate system is defined as follows each coordinate system used:
{ G}: start to carry out the target locating moment with unmanned plane, the projection of center of gravity on ground is as overall changeless geodetic coordinates origin, and X-axis is parallel to warp, and Y-axis is parallel to parallel, and Z axis points to the earth's core perpendicular to XOY plane for earth coordinates.
Body axis system { B}: with unmanned plane center of gravity for initial point, be connected on unmanned plane, X-axis is parallel to design orientation of its axis head in unmanned plane symmetrical plane, and Y-axis is pointed on the right side of body perpendicular to unmanned plane symmetrical plane, and Z axis points to below fuselage perpendicular to X-axis in symmetrical plane.
{ C}: with video camera photocentre for initial point, X-axis and Y-axis are parallel to the vertical and horizontal straight line of image to camera coordinate system respectively, and Z axis is camera optical axis, vertical with the plane of delineation.Definition camera optical axis is with { the XOY plane angle of B} is angular altitude α, and optical axis is just on plane; Optical axis is with { the XOZ plane included angle of B} is azimuthal angle beta, and optical axis is just on the right side of plane.
{ I}: with image upper left angle point for initial point two-dimensional coordinate system, X-axis is parallel to the longitudinal pixel line in the image leftmost side to image coordinate system, and Y-axis is parallel to pixels across line, and coordinate figure x and y represents line number and the columns of pixel respectively.
{ GB}: with unmanned plane center of gravity for initial point, each axle of X, Y, Z is parallel to earth coordinates { G} in body the earth interim coordinate system.
In unmanned plane reconnaissance flight process, any time body axis system { relative to earth coordinates, { pose of G} represents B}, is uniquely determined by the longitude of aircraft, latitude, height and attitude angle.According to earth coordinates, { { longitude of B}, latitude and height, earth model can solve that { B} initial point is at { the coordinate under G} as shown in Figure 3 for G} and body axis system gp bO=( gx bO, gy bO, gz bO) t, can obtain in conjunction with the pitching angle theta of body, crab angle ψ, roll angle φ that { B} is in { the expression under G} { B} is in { the expression under G}
T B G = c θ c ψ s θ c ψ s φ - s ψ c φ s θ c ψ c φ + s ψ s φ x G B O c θ s ψ s θ s ψ s φ + c ψ c φ s θ s ψ c φ - c ψ s φ y G B O - s θ c θ s φ c θ c φ z G B O 0 0 0 1 - - - ( 1 )
T G B = c θ c ψ c θ s ψ - s θ - x G B O s θ c ψ s φ - s ψ c φ s θ s ψ s φ + c ψ c φ c θ s φ - y G B O s θ c ψ c φ + s ψ s φ s θ s ψ c φ - c ψ s φ c θ c φ - z G B O 0 0 0 1 - - - ( 2 )
Defined can be drawn by coordinate system, { B} is in { the expression under GB} { B} is in { the expression under GB} for:
T B G B = c θ c ψ s θ c ψ s φ - s ψ c φ s θ c ψ c φ + s ψ s φ 0 c θ s ψ s θ c ψ s φ + c ψ c φ s θ c ψ c φ - c ψ s φ 0 - s θ c θ s φ c θ c φ 0 0 0 0 1 - - - ( 3 )
T G B B = c θ c ψ c θ s ψ - s θ 0 s θ c ψ s φ - s ψ c φ s θ s ψ s φ + c ψ c φ c θ s φ 0 s θ c ψ c φ + s ψ s φ s θ s ψ c φ - c ψ s φ c θ c φ 0 0 0 0 1 - - - ( 4 )
{ C} is relative to { pose of B} is by video camera fixed position for camera coordinate system bp cO=( bx cO, by cO, bz cO) t, current angular altitude α and azimuthal angle beta determine, after setting angle is fixing, and C} the expression under B} immobilizes:
T C B = c α c β - s β s α c β x B C O c α s β c β s α s β y B C O - s α 0 c α z B C O 0 0 0 1 - - - ( 5 )
Image coordinate system and camera coordinate system relation are determined by camera intrinsic parameter, and camera intrinsic parameter comprises picture centre coordinate ip icent=( ix icent, iy icent, 1) t, focal distance f, proportionality factors lambda etc.From perspective projection model, at camera coordinate system, { under C}, coordinate is expressed as picture centre pixel coordinate cp icent=(0,0, f) t, then I} being expressed as under C}:
T I C = λ 0 0 - λ I x I c e n t 0 λ 0 - λ I y I c e n t 0 0 0 f 0 0 0 1 - - - ( 6 )
According to the relation between above-mentioned each coordinate system, under can obtaining a certain coordinate system easily, arbitrfary point represents at the coordinate of other coordinate systems.
2 maneuvering targets are accurately located
When unmanned plane flies to scouting region, open load video camera and start to scout, the intersection point on note optical axis and ground is A.According to the relation between each coordinate system mentioned above, vector of unit length i on definition camera light axis, then its at camera coordinate system, { homogeneous coordinates under C} are cp i=(0,0,1,1) t, according to the pose of video camera by formula (5), the body axis system { expression under B} can be obtained bp i:
P B i = T C B · P C i - - - ( 7 )
According to the pose of aircraft by formula (1), try to achieve the earth coordinates { expression under G} gp i:
P G i = T B G · P B i = T B G · T C B · P C i - - - ( 8 )
According to perspective imaging principle and imaging triangular relationship, calculated by aircraft altitude and obtain optical axis and ground intersection point A at the { coordinate under G} gp a.Obtain according to formula (2) again bp a, use in subsequent calculations.(by earth model and the current longitude and latitude of aircraft, by bp aa point longitude and latitude can be obtained.The initial point of earth coordinates can be got a certain moment platform information according to the method and calculate, also desirable known point.)
After unmanned plane finds target, select interesting target point, by selected impact point t in the image coordinate system { homogeneous coordinates under I} according to reconnaissance mission ip t=( ix t, iy t, 1,1) t, draw according to formula (6) cp t, then can obtain successively bp t, gp t:
P G t = T B G · P B t = T B G · T C B · P C t = T B G · T C B · T I C · P I t - - - ( 9 )
By earth model and longitude and latitude relation, obtain the longitude and latitude high information of impact point t, realize target is accurately located.For maneuvering target, the method can according to twice positioning states estimating target motion information.Usual pattern process computer processing speed quickly, according to the time interval of twice target localization, the flight information of aircraft, obtains the motion state that target is current, and estimates maneuvering target subsequent time position thus system hit rate is improved in maneuvering target hits.
Maneuvering target tracking under 3 unmanned plane Visual servoing control
In unmanned plane autonomous surveillance flight course, it is desirable to keep impact point in the center of image, to obtain maximum stability margin.For the scouting load having The Cloud Terrace, after providing unmanned plane reconnaissance route or trajectory planning, tracking and positioning can rely on the servocontrol lock onto target heart position in the picture of The Cloud Terrace.When load The Cloud Terrace motion failures or when there is no The Cloud Terrace, maximizing for realizing stability margin, can realize by controlling UAV Attitude, specific as follows:
According to the derivation of formula (7) and (8), convolution (3) and above required by bp a, can try to achieve respectively gp twith gBp tr= gp a, then error is Δ gp t= gp tr- gp t, system of equations obtains attitude angle set-point θ thus t, φ tand ψ t;
By aircraft desired locations in flight track with aircraft current location gp bOerror roll angle set-point φ is obtained according to horizontal side direction control law r
φ r = K φ ( y ~ G B O - y G B O ) + K d φ G y · B O - - - ( 10 )
Angle of pitch set-point θ is obtained respectively according to Longitudinal Control Law r
θ r = K θ ( z ~ G B O - z G B O ) - - - ( 11 )
In conjunction with task weight λ mdistribute the attitude angle set-point of target following and course line tracking, always exported
θ=λ mθ t+(1-λ mr
φ=λ mφ t+(1-λ mr(12)
ψ=ψ t
The inner ring controlled in this, as flight is given, each relevant rudder face of servocontrol unmanned plane, the maximized Visual servoing control of stability margin in realize target locating and tracking process.

Claims (7)

1. the Visual servoing control method in UAV Maneuver target locating, is characterized in that, described method application unmanned plane carries out Visual servoing control, by target lock-on among camera field of view.
2. the Visual servoing control method in a kind of UAV Maneuver target locating according to claim 1, it is characterized in that, described method establishment earth coordinates, body axis system, camera coordinate system, image coordinate system, body the earth interim coordinate system, by the relation between the coordinate system of above-mentioned foundation, carry out the calculating of the attitude angle set-point that the location of target and the attitude angle set-point of target following and course line are followed the tracks of, complete Visual servoing control.
3. the Visual servoing control method in a kind of UAV Maneuver target locating according to claim 2, is characterized in that, said method comprising the steps of:
A) equipment state and the device parameter of locating device on unmanned plane, Inertial Measurement Unit and video camera is determined, the device parameter of described video camera comprises camera intrinsic parameter and setting angle, point to according to camera intrinsic parameter and setting angle determination optical axis, the positional representation on unmanned plane body axis system by mutual relationship determination optical axis between each coordinate system and ground intersection point;
B) according to the scouting imaging of video camera, select target point, determines the coordinate position of impact point in camera coordinate system, then draws the position location of impact point on earth model in conjunction with the device parameter of video camera;
C) according to positioning result, in conjunction with the flight information of unmanned plane, obtain the motion state that impact point is current, and estimate the position at impact point lower a moment;
D) using the desired locations of picture centre as impact point, the attitude angle set-point of target following is gone out according to error calculation;
E) by the error of aircraft desired locations and aircraft current location in unmanned aerial vehicle flight path, the attitude angle set-point followed the tracks of in course line is obtained respectively according to horizontal side direction control law and Longitudinal Control Law, according to the attitude angle set-point that attitude angle set-point and the course line of target following are followed the tracks of, obtain the total specified rate of each attitude angle, with the relevant rudder face of this servocontrol unmanned plane, the maximized Visual servoing control of stability margin in realize target locating and tracking process.
4. the Visual servoing control method in a kind of UAV Maneuver target locating according to claim 3, it is characterized in that, described earth coordinates { G}: start to carry out the target locating moment with unmanned plane, the projection of center of gravity on ground is as overall changeless geodetic coordinates origin, X-axis is parallel to warp, Y-axis is parallel to parallel, and Z axis points to the earth's core perpendicular to XOY plane;
Body axis system { B}: with unmanned plane center of gravity for initial point, be connected on unmanned plane, X-axis is parallel to design orientation of its axis head in unmanned plane symmetrical plane, and Y-axis is pointed on the right side of body perpendicular to unmanned plane symmetrical plane, and Z axis points to below fuselage perpendicular to X-axis in symmetrical plane;
Camera coordinate system C}: with video camera photocentre for initial point, X-axis and Y-axis are parallel to the vertical and horizontal straight line of image respectively, and Z axis is camera optical axis, vertical with the plane of delineation; Definition camera optical axis is with { the XOY plane angle of B} is angular altitude α, and optical axis is just on plane; Optical axis is with { the XOZ plane included angle of B} is azimuthal angle beta, and optical axis is just on the right side of plane;
Image coordinate system I}: with image upper left angle point for initial point two-dimensional coordinate system, X-axis is parallel to the longitudinal pixel line in the image leftmost side, and Y-axis is parallel to pixels across line, and coordinate figure x and y represents line number and the columns of pixel respectively;
{ GB}: with unmanned plane center of gravity for initial point, each axle of X, Y, Z is parallel to earth coordinates { G} in body the earth interim coordinate system.
5. the Visual servoing control method in a kind of UAV Maneuver target locating according to claim 4, it is characterized in that, the relation between described coordinate system comprises:
Obtain according to locating information and earth model that { B} initial point is at { the coordinate under G} gp bO=( gx bO, gy bO, gz bO) t, obtain in conjunction with the pitching angle theta of body, crab angle ψ, roll angle φ that { B} is in { the expression under G} { B} is in { the expression under G}
T B G = c θ c ψ s θ c ψ s φ - c ψ c φ s θ c ψ c φ + s ψ s φ x G B O c θ s ψ s θ s ψ s φ + c ψ c φ s θ s ψ c φ - c ψ s φ y G B O - s θ c θ s ψ c θ c φ z G B O 0 0 0 1 - - - ( 1 )
T G B = c θ c ψ c θ s ψ - s θ - x G B O s θ c ψ s φ - c ψ c φ s θ s ψ s φ + c ψ c φ c θ s φ - y G B O s θ c ψ c φ + s ψ s φ s θ s ψ c φ - c ψ s φ c θ c φ - z G B O 0 0 0 1 - - - ( 2 )
Defined by coordinate system and draw, { B} is in { the expression under GB} { B} is in { the expression under GB} for:
T B G B = c θ c ψ s θ c ψ s φ - c ψ c φ s θ c ψ c φ + s ψ s φ 0 c θ s ψ s θ s ψ s φ + c ψ c φ s θ s ψ c φ - c ψ s φ 0 - s θ c θ s φ c θ c φ 0 0 0 0 1 - - - ( 3 )
T G B B = c θ c ψ c θ s ψ - s θ 0 s θ c ψ s φ - c ψ c φ s θ s ψ s φ + c ψ c φ c θ s φ 0 s θ c ψ c φ + s ψ s φ s θ s ψ c φ - c ψ s φ c θ c φ 0 0 0 0 1 - - - ( 4 )
{ C} is relative to { pose of B} is by video camera fixed position for camera coordinate system bp cO=( bx cO, by cO, bz cO) t, angular altitude α and azimuthal angle beta determine, C} being expressed as under B}:
T C B = c α c β - s β s α c β x B C O c α s β c β s α s β y B C O - s α 0 c α z B C O 0 0 0 1 - - - ( 5 )
Image coordinate system and camera coordinate system relation are determined by camera intrinsic parameter, and camera intrinsic parameter comprises picture centre coordinate ip icent=( ix icent, iy icent, 1) t, focal distance f, proportionality factors lambda; From perspective projection model, at camera coordinate system, { under C}, coordinate is expressed as picture centre pixel coordinate cp icent=(0,0, f) t, then I} being expressed as under C}:
T I C = λ 0 0 - λ I x I c e n t 0 λ 0 - λ I y I c e n t 0 0 0 f 0 0 0 1 - - - ( 6 ) .
6. the Visual servoing control method in a kind of UAV Maneuver target locating according to claim 5, it is characterized in that, the optical axis of described video camera and the intersection point on ground are A, and to be i, i in the homogeneous coordinates of camera coordinate system be the vector of unit length on camera light axis cp i=(0,0,1,1) t, according to the pose of video camera by formula (5), the body axis system { expression under B} can be obtained bp i:
P B i = T C B · P C i - - - ( 7 )
According to the pose of aircraft by formula (1), try to achieve the earth coordinates { expression under G} gp i:
P G i = T B G · P B i = T B G · T C B · P C i - - - ( 8 )
According to perspective imaging principle and imaging triangular relationship, calculated by aircraft altitude and obtain optical axis and ground intersection point A at the { coordinate under G} gp a, then obtain according to formula (2) bp a;
After unmanned plane finds target, by selected impact point t in the image coordinate system { homogeneous coordinates under I} ip t=( ix t, iy t, 1,1) t, draw according to formula (6) cp t, then can obtain successively bp t, gp t:
P G t = T B G · P B t = T B G · T C B · P C t = T B G · T C B · T I G · P I t - - - ( 9 ) .
7. the Visual servoing control method in a kind of UAV Maneuver target locating according to claim 6, is characterized in that, according to formula (7) and (8), and convolution (3) and trying to achieve bp a, try to achieve respectively gp twith gBp tr= gp a, then error is Δ gp t= gp tr- gp t, system of equations obtains attitude angle set-point θ thus t, φ tand ψ t;
By aircraft desired locations in flight track with aircraft current location gp bOerror roll angle set-point φ is obtained according to horizontal side direction control law r
φ r = K φ ( y ~ G B O - y G B O ) + K d φ y · G B O - - - ( 10 )
Angle of pitch set-point θ is obtained respectively according to Longitudinal Control Law r
θ r = K θ ( z ~ G B O - z G B O ) - - - ( 11 )
In conjunction with task weight λ mdistribute the attitude angle set-point of target following and course line tracking, always exported
θ=λ mθ t+(1-λ mr
φ=λ mφ t+(1-λ mr(12)
ψ=ψ t
The inner ring controlled in this, as flight is given, each rudder face of servocontrol unmanned plane, the Visual servoing control in realize target locating and tracking process.
CN201510785505.8A 2015-11-16 2015-11-16 A kind of Visual servoing control method in UAV Maneuver target locating Active CN105353772B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510785505.8A CN105353772B (en) 2015-11-16 2015-11-16 A kind of Visual servoing control method in UAV Maneuver target locating

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510785505.8A CN105353772B (en) 2015-11-16 2015-11-16 A kind of Visual servoing control method in UAV Maneuver target locating

Publications (2)

Publication Number Publication Date
CN105353772A true CN105353772A (en) 2016-02-24
CN105353772B CN105353772B (en) 2018-11-09

Family

ID=55329760

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510785505.8A Active CN105353772B (en) 2015-11-16 2015-11-16 A kind of Visual servoing control method in UAV Maneuver target locating

Country Status (1)

Country Link
CN (1) CN105353772B (en)

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105857582A (en) * 2016-04-06 2016-08-17 北京博瑞爱飞科技发展有限公司 Method and device for adjusting shooting angle, and unmanned air vehicle
CN105974941A (en) * 2016-07-27 2016-09-28 潘燕 Unmanned aerial vehicle reconnaissance system
CN106094876A (en) * 2016-07-04 2016-11-09 苏州光之翼智能科技有限公司 A kind of unmanned plane target locking system and method thereof
CN106197422A (en) * 2016-06-27 2016-12-07 东南大学 A kind of unmanned plane based on two-dimensional tag location and method for tracking target
CN106292721A (en) * 2016-09-29 2017-01-04 腾讯科技(深圳)有限公司 A kind of aircraft that controls follows the tracks of the method for destination object, equipment and system
CN106338286A (en) * 2016-10-08 2017-01-18 北京航天控制仪器研究所 Movable base measurement method
CN106354156A (en) * 2016-09-29 2017-01-25 腾讯科技(深圳)有限公司 Method and device for tracking target object, and air vehicle
CN106371461A (en) * 2016-09-08 2017-02-01 河海大学常州校区 Visual servo based video tracking flight object control system and method
CN106506944A (en) * 2016-10-31 2017-03-15 易瓦特科技股份公司 Image tracking method and equipment for unmanned plane
CN107146256A (en) * 2017-04-10 2017-09-08 中国人民解放军国防科学技术大学 Camera marking method under outfield large viewing field condition based on differential global positioning system
CN107192377A (en) * 2017-06-16 2017-09-22 深圳市可飞科技有限公司 Method, device and the aircraft of long-range measurement object coordinates
CN107452038A (en) * 2017-07-28 2017-12-08 武汉理工大学 Complex water areas method for tracking target based on AIS and active video camera
CN107710283A (en) * 2016-12-02 2018-02-16 深圳市大疆创新科技有限公司 A kind of filming control method, device and control device
CN108108697A (en) * 2017-12-25 2018-06-01 中国电子科技集团公司第五十四研究所 A kind of real-time UAV Video object detecting and tracking method
CN108476288A (en) * 2017-05-24 2018-08-31 深圳市大疆创新科技有限公司 Filming control method and device
CN108519067A (en) * 2018-03-21 2018-09-11 刘前进 Video camera, which moves in axis operating process, determines that photographic subjects sit calibration method
CN108572663A (en) * 2017-03-08 2018-09-25 通用汽车环球科技运作有限责任公司 Target following
CN108845335A (en) * 2018-05-07 2018-11-20 中国人民解放军国防科技大学 Unmanned aerial vehicle ground target positioning method based on image and navigation information
CN109143303A (en) * 2018-09-03 2019-01-04 天津远度科技有限公司 Flight localization method, device and fixed-wing unmanned plane
CN109143855A (en) * 2018-07-31 2019-01-04 西北工业大学 A kind of rotor wing unmanned aerial vehicle Visual servoing control method based on fuzzy SARSA study
CN109443349A (en) * 2018-11-14 2019-03-08 广州中海达定位技术有限公司 A kind of posture Course Measure System and its fusion method, storage medium
CN109631841A (en) * 2018-12-25 2019-04-16 中国地质大学(武汉) A kind of through street cross-sectioning method and device based on laser projection
CN109661631A (en) * 2018-03-27 2019-04-19 深圳市大疆创新科技有限公司 Control method, device and the unmanned plane of unmanned plane
CN109753076A (en) * 2017-11-03 2019-05-14 南京奇蛙智能科技有限公司 A kind of unmanned plane vision tracing implementing method
CN109945824A (en) * 2017-12-21 2019-06-28 中国科学院长春光学精密机械与物理研究所 A kind of method and system of carrier aircraft heading reference measurement and transmitting
CN110047108A (en) * 2019-03-07 2019-07-23 中国科学院深圳先进技术研究院 UAV position and orientation determines method, apparatus, computer equipment and storage medium
CN110075429A (en) * 2019-04-26 2019-08-02 上海交通大学 A kind of ultrasonic transducer air navigation aid, navigation device, electronic equipment and readable storage medium storing program for executing
CN110542407A (en) * 2019-07-23 2019-12-06 中国科学院长春光学精密机械与物理研究所 Method for acquiring positioning information of any pixel point of aerial image
CN111174765A (en) * 2020-02-24 2020-05-19 北京航天飞行控制中心 Planet vehicle target detection control method and device based on visual guidance
CN111562791A (en) * 2019-03-22 2020-08-21 沈阳上博智像科技有限公司 System and method for identifying visual auxiliary landing of unmanned aerial vehicle cooperative target
CN111586303A (en) * 2020-05-22 2020-08-25 浩鲸云计算科技股份有限公司 Control method and device for dynamically tracking road surface target by camera based on wireless positioning technology
CN111596693A (en) * 2020-06-17 2020-08-28 中国人民解放军国防科技大学 Ground target tracking control method and system of unmanned aerial vehicle based on pan-tilt camera
CN111798514A (en) * 2020-06-29 2020-10-20 山东大学日照智能制造研究院 Intelligent moving target tracking and monitoring method and system for marine ranching
CN112835376A (en) * 2019-11-22 2021-05-25 中国电力科学研究院有限公司 Machine head positioning method and system for unmanned aerial vehicle electricity testing
CN113744299A (en) * 2021-09-02 2021-12-03 上海安维尔信息科技股份有限公司 Camera control method and device, electronic equipment and storage medium
CN113949826A (en) * 2021-09-28 2022-01-18 航天时代飞鸿技术有限公司 Unmanned aerial vehicle cluster cooperative reconnaissance method and system under limited communication bandwidth condition
CN115511956A (en) * 2022-11-24 2022-12-23 南京理工大学 Unmanned aerial vehicle imaging positioning method
CN116164754A (en) * 2023-04-25 2023-05-26 中国电子科技集团公司第五十四研究所 Cloud deck virtualization method based on unmanned aerial vehicle motion state

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090118890A1 (en) * 2007-11-05 2009-05-07 Industrial Technology Research Institute Visual navigation system and method based on structured light
CN104501802A (en) * 2015-01-09 2015-04-08 中国人民解放军63961部队 Earth target capturing and identifying method used for high-speed aircraft
CN104655135A (en) * 2015-02-09 2015-05-27 南京邮电大学 Landmark-recognition-based aircraft visual navigation method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090118890A1 (en) * 2007-11-05 2009-05-07 Industrial Technology Research Institute Visual navigation system and method based on structured light
CN104501802A (en) * 2015-01-09 2015-04-08 中国人民解放军63961部队 Earth target capturing and identifying method used for high-speed aircraft
CN104655135A (en) * 2015-02-09 2015-05-27 南京邮电大学 Landmark-recognition-based aircraft visual navigation method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ICK H. WANG 等: "On Vision-Based Target Tracking and Range Estimation for Small UAVs", 《AIAA GUIDANCE, NAVIGATION, AND CONTROL CONFERENCE AND EXHIBIT》 *
廖粤峰 等: "基于自抗扰技术的四旋翼飞行器视觉伺服控制器设计", 《计算机测量与控制》 *
李静 等: "基于多特征自适应融合的视觉伺服跟踪控制方法研究", 《PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE》 *
谌婷: "小型无人直升机跟踪地面移动目标控制策略研究", 《中国优秀硕士学位论文全文数据库工程科技II辑》 *

Cited By (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105857582A (en) * 2016-04-06 2016-08-17 北京博瑞爱飞科技发展有限公司 Method and device for adjusting shooting angle, and unmanned air vehicle
CN106197422A (en) * 2016-06-27 2016-12-07 东南大学 A kind of unmanned plane based on two-dimensional tag location and method for tracking target
CN106094876A (en) * 2016-07-04 2016-11-09 苏州光之翼智能科技有限公司 A kind of unmanned plane target locking system and method thereof
CN105974941A (en) * 2016-07-27 2016-09-28 潘燕 Unmanned aerial vehicle reconnaissance system
CN106371461A (en) * 2016-09-08 2017-02-01 河海大学常州校区 Visual servo based video tracking flight object control system and method
CN106292721A (en) * 2016-09-29 2017-01-04 腾讯科技(深圳)有限公司 A kind of aircraft that controls follows the tracks of the method for destination object, equipment and system
CN106354156A (en) * 2016-09-29 2017-01-25 腾讯科技(深圳)有限公司 Method and device for tracking target object, and air vehicle
CN106338286A (en) * 2016-10-08 2017-01-18 北京航天控制仪器研究所 Movable base measurement method
CN106338286B (en) * 2016-10-08 2019-08-09 北京航天控制仪器研究所 A kind of moving base measurement method
CN106506944B (en) * 2016-10-31 2020-02-21 易瓦特科技股份公司 Image tracking method and device for unmanned aerial vehicle
CN106506944A (en) * 2016-10-31 2017-03-15 易瓦特科技股份公司 Image tracking method and equipment for unmanned plane
CN107710283A (en) * 2016-12-02 2018-02-16 深圳市大疆创新科技有限公司 A kind of filming control method, device and control device
WO2018098824A1 (en) * 2016-12-02 2018-06-07 深圳市大疆创新科技有限公司 Photographing control method and apparatus, and control device
CN107710283B (en) * 2016-12-02 2022-01-28 深圳市大疆创新科技有限公司 Shooting control method and device and control equipment
US11575824B2 (en) 2016-12-02 2023-02-07 SZ DJI Technology Co., Ltd. Photographing control method, apparatus, and control device
US10897569B2 (en) 2016-12-02 2021-01-19 SZ DJI Technology Co., Ltd. Photographing control method, apparatus, and control device
US11863857B2 (en) 2016-12-02 2024-01-02 SZ DJI Technology Co., Ltd. Photographing control method, apparatus, and control device
CN108572663B (en) * 2017-03-08 2021-12-21 通用汽车环球科技运作有限责任公司 Target tracking
CN108572663A (en) * 2017-03-08 2018-09-25 通用汽车环球科技运作有限责任公司 Target following
CN107146256B (en) * 2017-04-10 2019-07-05 中国人民解放军国防科学技术大学 Camera marking method under outfield large viewing field condition based on differential global positioning system
CN107146256A (en) * 2017-04-10 2017-09-08 中国人民解放军国防科学技术大学 Camera marking method under outfield large viewing field condition based on differential global positioning system
US11120261B2 (en) 2017-05-24 2021-09-14 SZ DJI Technology Co., Ltd. Imaging control method and device
CN108476288A (en) * 2017-05-24 2018-08-31 深圳市大疆创新科技有限公司 Filming control method and device
CN108476288B (en) * 2017-05-24 2021-05-07 深圳市大疆创新科技有限公司 Shooting control method and device
CN107192377A (en) * 2017-06-16 2017-09-22 深圳市可飞科技有限公司 Method, device and the aircraft of long-range measurement object coordinates
CN107452038A (en) * 2017-07-28 2017-12-08 武汉理工大学 Complex water areas method for tracking target based on AIS and active video camera
CN109753076A (en) * 2017-11-03 2019-05-14 南京奇蛙智能科技有限公司 A kind of unmanned plane vision tracing implementing method
CN109753076B (en) * 2017-11-03 2022-01-11 南京奇蛙智能科技有限公司 Unmanned aerial vehicle visual tracking implementation method
CN109945824A (en) * 2017-12-21 2019-06-28 中国科学院长春光学精密机械与物理研究所 A kind of method and system of carrier aircraft heading reference measurement and transmitting
CN108108697B (en) * 2017-12-25 2020-05-19 中国电子科技集团公司第五十四研究所 Real-time unmanned aerial vehicle video target detection and tracking method
CN108108697A (en) * 2017-12-25 2018-06-01 中国电子科技集团公司第五十四研究所 A kind of real-time UAV Video object detecting and tracking method
CN108519067B (en) * 2018-03-21 2020-09-22 刘前进 Method for determining coordinates of shooting target in camera shift operation process
CN108519067A (en) * 2018-03-21 2018-09-11 刘前进 Video camera, which moves in axis operating process, determines that photographic subjects sit calibration method
CN109661631A (en) * 2018-03-27 2019-04-19 深圳市大疆创新科技有限公司 Control method, device and the unmanned plane of unmanned plane
CN108845335A (en) * 2018-05-07 2018-11-20 中国人民解放军国防科技大学 Unmanned aerial vehicle ground target positioning method based on image and navigation information
CN109143855A (en) * 2018-07-31 2019-01-04 西北工业大学 A kind of rotor wing unmanned aerial vehicle Visual servoing control method based on fuzzy SARSA study
CN109143303A (en) * 2018-09-03 2019-01-04 天津远度科技有限公司 Flight localization method, device and fixed-wing unmanned plane
CN109443349A (en) * 2018-11-14 2019-03-08 广州中海达定位技术有限公司 A kind of posture Course Measure System and its fusion method, storage medium
CN109631841A (en) * 2018-12-25 2019-04-16 中国地质大学(武汉) A kind of through street cross-sectioning method and device based on laser projection
CN109631841B (en) * 2018-12-25 2020-08-07 中国地质大学(武汉) Method and device for measuring cross section of expressway based on laser projection
CN110047108A (en) * 2019-03-07 2019-07-23 中国科学院深圳先进技术研究院 UAV position and orientation determines method, apparatus, computer equipment and storage medium
CN111562791A (en) * 2019-03-22 2020-08-21 沈阳上博智像科技有限公司 System and method for identifying visual auxiliary landing of unmanned aerial vehicle cooperative target
CN110075429A (en) * 2019-04-26 2019-08-02 上海交通大学 A kind of ultrasonic transducer air navigation aid, navigation device, electronic equipment and readable storage medium storing program for executing
CN110542407A (en) * 2019-07-23 2019-12-06 中国科学院长春光学精密机械与物理研究所 Method for acquiring positioning information of any pixel point of aerial image
CN112835376A (en) * 2019-11-22 2021-05-25 中国电力科学研究院有限公司 Machine head positioning method and system for unmanned aerial vehicle electricity testing
CN112835376B (en) * 2019-11-22 2023-03-10 中国电力科学研究院有限公司 Machine head positioning method and system for unmanned aerial vehicle electricity testing
CN111174765B (en) * 2020-02-24 2021-08-13 北京航天飞行控制中心 Planet vehicle target detection control method and device based on visual guidance
CN111174765A (en) * 2020-02-24 2020-05-19 北京航天飞行控制中心 Planet vehicle target detection control method and device based on visual guidance
WO2021232826A1 (en) * 2020-05-22 2021-11-25 浩鲸云计算科技股份有限公司 Wireless-positioning-technology-based method and device for controlling camera to dynamically track road target
CN111586303A (en) * 2020-05-22 2020-08-25 浩鲸云计算科技股份有限公司 Control method and device for dynamically tracking road surface target by camera based on wireless positioning technology
CN111596693B (en) * 2020-06-17 2023-05-26 中国人民解放军国防科技大学 Ground target tracking control method and system for unmanned aerial vehicle based on pan-tilt camera
CN111596693A (en) * 2020-06-17 2020-08-28 中国人民解放军国防科技大学 Ground target tracking control method and system of unmanned aerial vehicle based on pan-tilt camera
CN111798514A (en) * 2020-06-29 2020-10-20 山东大学日照智能制造研究院 Intelligent moving target tracking and monitoring method and system for marine ranching
CN113744299B (en) * 2021-09-02 2022-07-12 上海安维尔信息科技股份有限公司 Camera control method and device, electronic equipment and storage medium
CN113744299A (en) * 2021-09-02 2021-12-03 上海安维尔信息科技股份有限公司 Camera control method and device, electronic equipment and storage medium
CN113949826A (en) * 2021-09-28 2022-01-18 航天时代飞鸿技术有限公司 Unmanned aerial vehicle cluster cooperative reconnaissance method and system under limited communication bandwidth condition
CN115511956A (en) * 2022-11-24 2022-12-23 南京理工大学 Unmanned aerial vehicle imaging positioning method
CN116164754A (en) * 2023-04-25 2023-05-26 中国电子科技集团公司第五十四研究所 Cloud deck virtualization method based on unmanned aerial vehicle motion state
CN116164754B (en) * 2023-04-25 2023-06-23 中国电子科技集团公司第五十四研究所 Cloud deck virtualization method based on unmanned aerial vehicle motion state

Also Published As

Publication number Publication date
CN105353772B (en) 2018-11-09

Similar Documents

Publication Publication Date Title
CN105353772B (en) A kind of Visual servoing control method in UAV Maneuver target locating
Borowczyk et al. Autonomous landing of a quadcopter on a high-speed ground vehicle
CN109911188B (en) Bridge detection unmanned aerial vehicle system in non-satellite navigation and positioning environment
CN102967305B (en) Multi-rotor unmanned aerial vehicle pose acquisition method based on markers in shape of large and small square
CN105501457A (en) Infrared vision based automatic landing guidance method and system applied to fixed-wing UAV (unmanned aerial vehicle)
EP2029970B1 (en) Beacon-augmented pose estimation
CN105644785B (en) A kind of UAV Landing method detected based on optical flow method and horizon
CN105182992A (en) Unmanned aerial vehicle control method and device
CN106155081B (en) A kind of a wide range of target monitoring of rotor wing unmanned aerial vehicle and accurate positioning method
CN105698762A (en) Rapid target positioning method based on observation points at different time on single airplane flight path
CN102506892B (en) Configuration method for information fusion of a plurality of optical flow sensors and inertial navigation device
CN106054929A (en) Unmanned plane automatic landing guiding method based on optical flow
Sohn et al. Vision-based real-time target localization for single-antenna GPS-guided UAV
Chen et al. An auto-landing strategy based on pan-tilt based visual servoing for unmanned aerial vehicle in GNSS-denied environments
CN106468552A (en) A kind of two-shipper crossing location method based on airborne photoelectric platform
Kim et al. Landing control on a mobile platform for multi-copters using an omnidirectional image sensor
CN106249755A (en) A kind of unmanned plane autonomous navigation system and air navigation aid
CN109669480B (en) Seeker control method for predicting target position
CN110764523B (en) Proportional-integral pre-pilot attack target method based on anti-saturation smooth transformation
CN110470304A (en) A kind of high-precision target positioning-speed-measuring method based on UAV electro-optical's platform
CN109669474B (en) Priori knowledge-based multi-rotor unmanned aerial vehicle self-adaptive hovering position optimization algorithm
CN105547295A (en) Ground target passive speed measuring method for airborne photoelectric observing and aiming system on basis of gyroscope speed measurement
CN102190081A (en) Vision-based fixed point robust control method for airship
CN109597432A (en) A kind of unmanned plane landing monitoring method and system based on vehicle-mounted pick-up unit
CN108445900A (en) A kind of unmanned plane vision positioning replacement differential technique

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 100000, No. 3, North Road, Yongfeng industrial base, Beijing, Haidian District

Patentee after: China Aerospace Era Electronics Co., Ltd.

Address before: 100094 Beijing city Haidian District Feng Ying Road No. 1

Patentee before: Shidai Electronic Corp. China Space

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200212

Address after: Room 3017, floor 3, building 23, No. 59, South lantianchang Road, Haidian District, Beijing 100000

Patentee after: Aerospace Age Feihong Technology Co., Ltd.

Address before: 100000, No. 3, North Road, Yongfeng industrial base, Beijing, Haidian District

Patentee before: China Aerospace Era Electronics Co., Ltd.