CN104102218B - The perception of view-based access control model servo and bypassing method and system - Google Patents
The perception of view-based access control model servo and bypassing method and system Download PDFInfo
- Publication number
- CN104102218B CN104102218B CN201410305109.6A CN201410305109A CN104102218B CN 104102218 B CN104102218 B CN 104102218B CN 201410305109 A CN201410305109 A CN 201410305109A CN 104102218 B CN104102218 B CN 104102218B
- Authority
- CN
- China
- Prior art keywords
- target
- angle
- envelope
- unmanned plane
- sigma
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
The present invention provides a kind of perception of view-based access control model servo and avoidance system, including unmanned plane, image capturing system, Visual servoing control system and navigation positioning system, the vision servo system includes sensation target detection and tracking module, safe envelope module and Visual servoing control device.The present invention also provides a kind of based on the bypassing method perceived with avoidance system, present invention achieves the quick sensing to ambient airspace environment, and do not installing any distance measuring sensor additional and be not required in the case that ground handling operator intervened and operated, the independent evasion manoeuvre completed to space flight target;Loading demands of the present invention are low, control accuracy is high, with higher intelligent, it is possible to increase the spatial domain flight safety ability of unmanned plane.
Description
Technical field
The present invention relates to Navigation of Pilotless Aircraft and control field, the perception of more particularly to a kind of view-based access control model servo and the side of evading
Method and system.
Background technology
Recently, as Military Application and civil area are increasingly strong to the demand of unmanned plane, add the civilian spatial domain neck of China
Domain further opens, and following spatial domain will be presented the unmanned plane of polytype function, have that man-machine to carry out spatial domain shared and integrated
Situation, spatial domain will be increasingly intensive.In the case, unmanned plane perceives and evades (Sense and Avoid, i.e. SAA) ability and incites somebody to action
Become into spatial domain flight, ensure the prerequisite of unmanned plane during flying safety.Unmanned plane is perceived and refers to that unmanned plane is utilized with evading
Airborne sensor or surface surveillance system complete the monitoring to spatial domain flight environment of vehicle and the state of airbound target is obtained, and touch to potential
The target for hitting threat carries out evading path planning, completes evasion manoeuvre action, so as to ensure the Route reform safety of unmanned plane.
SAA technologies are current unmanned air vehicle technique field key technology difficulties urgently to be resolved hurrily.2013, in U.S. FAA
In the integrated route map in UAS spatial domain that (Federal Aviation Administration) is issued, SAA is clearly proposed
Ability is the pre-requisite abilities that unmanned plane carries out national spatial domain flight.Its major function is divided into:Object detecting and tracking, collision threat
Estimate, evade path planning, evasion manoeuvre.
Unmanned aerial vehicle onboard SAA sensors include T-CAS, ADS-B, radar, laser radar, photoelectricity, infrared sensor etc..Its
In, photoelectric sensor as and effectively perceive extremely important to noncooperative target with evade means, particularly it is small-sized nobody
Machine system load, task, cost are limited, it is impossible to when carrying large-scale awareness apparatus such as radar, laser radar, based on photoelectricity
Advantage of the vision SAA system of sensor in terms of quality, power consumption, cost makes which be more easy in the small-sized system integration and application;
The characteristics of vision SAA passive type is perceived is applied to battlefield surroundings, stealthy task dispatching particular task occasion;And with ADS-B, TCAS etc.
Compare, vision SAA is not against acknowledgement mechanism, it is not necessary to Ground Control Information and satellite positioning information, i.e., can provide to non-conjunction
Make perception and the dodging ability of target independence.Therefore, vision SAA system of the research based on photoelectric sensor is significant.
The content of the invention
It is an object of the invention to provide a kind of perception of view-based access control model servo and bypassing method and system, existing to solve
Sensor bulk is big, power consumption is larger, the problem of the integrated application being unfavorable in small-sized UAS, and energy of the present invention
The quick sensing to ambient airspace environment is enough realized, Visual Feedback Control model is set up by the safe envelope of angle, nobody is controlled
Machine completes the perception to spatial domain target and evades.
The present invention provides a kind of perception of view-based access control model servo and avoidance system, including:
Unmanned plane, arranges automatic pilot on the unmanned plane, the automatic pilot receives flight control instruction and carries out
Fly and complete avoiding action of the unmanned plane to barrier;
Image capturing system, is mounted on the unmanned plane, for gathering the flying area image information of unmanned plane, adopts
The centralized array configuration of polyphaser various visual angles, and pass through camera interface real-time Transmission image information;
Visual servoing control system, is arranged on the unmanned plane, including sensation target detection and tracking module, rescue bag
Network module and Visual servoing control device, the image information that sensation target detection receives image capturing system transmission with tracking module is simultaneously
Realize the detection to airbound target in image, positioning and track, safe envelope module is carried out according to the target status information for obtaining
The generation of the safe envelope of plane of delineation angle, and generate image based on the safe envelope and evade angle, is input at this angle to regarding
Feel servo controller, Visual servoing control device output evasion manoeuvre angle, and the angle is passed through into Serial Port Transmission to automatic Pilot
Instrument completes avoiding action;
Navigation positioning system, is arranged on the unmanned plane, for setting up air route retrogression mechanism, navigation positioning system detection
To unmanned plane not in air route and when there is no threat, air route recurrence is carried out, make unmanned plane return to original air route.
Used as a kind of optimal way, heretofore described sensation target detection is with tracking module using at multi-path high-definition image
Platform DM8168.
The present invention also provides the bypassing method of a kind of perception of view-based access control model servo and avoidance system, including:
Step one, realizes being completely covered to the spatial domain in the flight angle of visual field by unmanned aerial vehicle onboard image capturing system,
Obtain the flying area image information of unmanned plane;
Step 2, sensation target detection and image letter in tracking module receiving step one in airborne Visual servoing control system
Cease and processed, complete the detection to airbound target in spatial domain picture, positioning and track;
Step 3, according to the airbound target status information obtained in step 2, safe envelope in Visual servoing control system
Module carries out the safe envelope of plane of delineation angle and generates, and determines that unmanned plane whether there is collision threat by safe envelope, for
Collision threat, is calculated and evades angle under image meaning;
Step 4, the visual server evaded in angle input Visual servoing control system in step 3, vision are watched
Evasion manoeuvre pitching and yaw angle that device output needs are taken, and is sent to unmanned plane automatic pilot and complete evasion manoeuvre;
Step 5, sets up air route retrogression mechanism using navigation positioning system, when unmanned plane does not have threat, makes unmanned plane
Return to original air route.
Used as a kind of optimal way, the concrete methods of realizing of the step 2 is as follows:
The view data that image capturing system is obtained in step one is sent to airborne visual servo control by camera data line
In system processed, sensation target detection and tracking module, wherein arrange tri- cameras of A, B, C, sensation target altogether in image capturing system
Detection adopts multi-path high-definition image processing platform DM8168 with tracking module, realizes entering the multi-channel video for obtaining using DM8168
Row is processed, and obtains the positional information p of target k moment a certain camera image plane in image capturing system by detection algorithmk
=[pxk,pyk], obtain relative angle of the target relative to the camera:
Wherein, w and h are the width and height of the image in units of pixel respectively, and f is camera lens focal length, and μ is picture dot
Size;
According to camera installation site, the relative angle that can obtain the target k moment relative to unmanned plane is Θk=[σk,γk],
Wherein
γk=γ '
In formulaRepresent that the target for detecting comes from image capturing system respectively
Camera A, camera B and camera C;
The angular velocity vector Ω of target is determined according to the angle change in front and back's momentk=[ωxk,ωyk]=Θk+1-Θk,k>0。
As another kind of optimal way, in the step 3, the generation step of safe envelope and evade the calculation procedure of angle
Including:
1. targeted security envelope circle is set up, the center of circle is impact point, chooses a radius initial value, and carried out with fixed speed
Increase;
2. safe envelope is set up according to target size oval, the oval center of circle is impact point, the length and envelope of ellipse short shaft
Round radius is equal, and the length of transverse is extrapolation of the length of short axle with target under current angular velocity in setting aside some time
Length sum, the direction of motion of the long axis direction parallel to target;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse
Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat based on safe envelope and indicate
Function, judges whether collision threat with this;
5. distance principle is evaded according to minimum, is found apart from the nearest point of initial target in the safe envelope of Plane Angle.
Especially, the concrete generation step of safe envelope and evade the concrete calculation procedure of angle such as in the step 3
Under:
1. targeted security envelope circle is set up, relative angular position Θ of the target k moment relative to unmanned plane is elected in the center of circle ask=
[σk, γk], choose a radius initial value r0, and increased with fixed speed, then
rk+1=rk+ ε, k=1,2,3 ...
rk=r0, k=0
Wherein ε is to fix growth rate, rk+1Represent the safe envelope radius of circle at k+1 moment;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point Θk=[σk,γk], long axis direction
Parallel to the direction of motion of target, i.e. target angular velocity ΩkDirection, the length of major axis and short axle selected by following equation respectively
Take:
A=rk(1+α‖Ωk‖),
B=rk,
In formula, a and b represents the oval major axis of envelope and short axle, r respectivelykFor the radius of k moment envelope circle, α is angular velocity
The scale factor of axial length is converted into, the factor is represented to evade and set aside some time, ‖ Ωk‖ is target angular velocity of satellite motion vector field homoemorphism;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse
Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign letter based on time k
Number lk, work as lk<When 0, it is believed that there is collision threat, collision threat is judged whether with this, wherein
WhereinRepresent that the major axes orientation of camera B, relative to the angle of unmanned plane major axes orientation, can generally be recognized
ForIt is sign function;
5. work as lk<When 0, distance principle is evaded according to minimum, distance is found in the safe envelope of Plane AngleNearest point s*
=[σ*,γ*] as minimum evasion manoeuvre point:
WhereinRepresent unit vector of the k moment perpendicular to target angular velocity vector.
Used as another optimal way, in the step 4, the concrete calculation procedure of evasion manoeuvre pitching and yaw angle is such as
Under:
1. defining Interactive matrix is
Speed control is set up in the Visual servoing control device of Visual servoing control system, feedback quantity is
The exponential damping of error is completed, output speed controlled quentity controlled variable V, Visual servoing control device are expressed as
In formula, λ is error extension attenuation quotient,Represent LePseudoinverse;
Due in Interactive matrix LeIn cannot obtain the information apart from d of target and the machine, Interactive matrix is split
It is as follows:
In formula, LωRepresent LeIn Angle ambiguity component, LtRepresent speed motor control component;
Obtain apart from unrelated Visual servoing control device:
In formula,Represent LωPseudoinverse;
To eliminate steady-state error, Visual servoing control device is compensated, it is as follows:
In formula, Ω represents the angular velocity of target motion,Represent the direction vector of error, ωx、ωy、ωzRepresent respectively
Three components of ω;
2. the angle of pitch and yaw angle for exporting be
In formula,And φcK () represents the angle of pitch and yaw angle of automatic pilot output attitude,And φ
K () represents the angle of pitch and yaw angle of unmanned plane current pose, Δ t represents Visual servoing control device output time interval steps,
ωy(k) and ωzK () represents the rate of pitch controlled quentity controlled variable and yaw rate of current time Visual servoing control device output respectively
Controlled quentity controlled variable, g represent acceleration of gravity, and V (k) represents the speed of current time unmanned plane.
Used as another optimal way, in the step 5, the concrete establishment step of air route retrogression mechanism is as follows:
1. unmanned plane is determined whether in air route by the machine navigation positioning system, when the machine not in air route when, navigated
Road returns;
2. confirm the recurrence air route angle of moment k
In formula,Represent minimum evasive maneuvering point position when air route returns;
Wherein PdIt is position of the machine on script air route when there is no evasion manoeuvre, Pd12And Pd13It is the machine respectively
In the two-dimensional position of XY and XZ planes;
PsIt is the machine current location obtained by the machine navigation positioning system, Ps12And Ps13It is the machine respectively in XY and XZ
The two-dimensional position of plane;
esIt is the machine direction vector obtained by the machine navigation positioning system, es12And es13It is the machine respectively in XY and XZ
The two-dimensional directional vector of plane.
Present invention achieves the quick sensing to ambient airspace environment, and do not installing any distance measuring sensor additional and be not required to
In the case that ground handling operator is intervened and is operated, the independent evasion manoeuvre completed to space flight target;This
Bright loading demands are low, control accuracy is high, with higher intelligent, it is possible to increase the spatial domain flight safety ability of unmanned plane.
Description of the drawings
Fig. 1 is the perception of the view-based access control model servo of the present invention and avoidance system structured flowchart;
Fig. 2 is the bypassing method flow chart of the perception with avoidance system of the view-based access control model servo of the present invention;
Fig. 3 a are the image capturing system camera array layout drawing of the present invention;
Fig. 3 b are the image capturing system camera array field of view angle schematic diagram of the present invention;
Fig. 4 is the safe envelope schematic diagram of plane of delineation angle of the present invention.
Specific embodiment
The present invention will be further described with reference to the accompanying drawings and examples.
As shown in figure 1, the present invention provides a kind of perception of view-based access control model servo and avoidance system, including:
Unmanned plane, arranges automatic pilot on the unmanned plane, the automatic pilot receives flight control instruction and carries out
Fly and complete avoiding action of the unmanned plane to barrier;
Image capturing system, is mounted on the unmanned plane, for gathering the flying area image information of unmanned plane, adopts
The centralized array configuration of polyphaser various visual angles, and pass through camera interface real-time Transmission image information;
Visual servoing control system, is arranged on the unmanned plane, including sensation target detection and tracking module, rescue bag
Network module and Visual servoing control device, the image information that sensation target detection receives image capturing system transmission with tracking module is simultaneously
Realize the detection to airbound target in image, positioning and track, safe envelope module is carried out according to the target status information for obtaining
The generation of the safe envelope of plane of delineation angle, and generate image based on the safe envelope and evade angle, is input at this angle to regarding
Feel servo controller, Visual servoing control device output evasion manoeuvre angle, and the angle is passed through into Serial Port Transmission to automatic Pilot
Instrument completes avoiding action;
Navigation positioning system, is arranged on the unmanned plane, for setting up air route retrogression mechanism, navigation positioning system detection
To unmanned plane not in air route and when there is no threat, air route recurrence is carried out, make unmanned plane return to original air route.
Wherein, in the present invention, sensation target detection adopts multi-path high-definition image processing platform DM8168 with tracking module.
As shown in Fig. 2 the present invention also provides the bypassing method of a kind of perception of view-based access control model servo and avoidance system, bag
Include:
Step one, realizes being completely covered to the spatial domain in the flight angle of visual field by unmanned aerial vehicle onboard image capturing system,
Obtain the flying area image information of unmanned plane.
Specified according to International Civil Aviation Organization, the angle of visual field of aircraft space must meet respectively:Horizontal field of view>± 110 °,
Vertical field of view>± 15 °, it is therefore necessary to which above-mentioned spatial domain can be completely covered, and should obtain clear accurate as far as possible
Information.Image capturing system, from for the angle of camera that is, must is fulfilled for using the centralized array configuration of polyphaser various visual angles
Big market and remote high-resolution imaging, and single camera lens are difficult to take into account in terms of the angle of visual field and focal length.Therefore, adopt
The centralized array configuration of polyphaser as shown in Figure 3 a, in figure, A, B, C are and are arranged on the camera increased on steady head, increase steady head
Ensure that the clear, acquisition of horizontal view angle image.Big field of view angle, tool are obtained using the focal length splicing of multiple telephoto lenses
Body field of view angle as shown in Figure 3 b, while improving detectivity to distant object.
Step 2, sensation target detection and image letter in tracking module receiving step one in airborne Visual servoing control system
Cease and processed, complete the detection to airbound target in spatial domain picture, positioning and track.
In small-sized unmanned plane, due to the restriction of communication bandwidth, tend not to realize the real time communication to high-definition image,
The long-distance transmissions of multi-path high-definition video are difficult to realize in current small-sized UAS.
The view data that image capturing system is obtained is sent in airborne Visual servoing control system by camera data line
Multi-path high-definition image processing platform DM8168, realizes processing the multi-channel video for obtaining using DM8168, is calculated by detecting
Method obtains the positional information p of target k moment a certain camera image plane in image capturing systemk=[pxk,pyk], obtain target
Relative to the relative angle of the camera:
Wherein, w and h are the width and height of the image in units of pixel respectively, and f is camera lens focal length, and μ is picture dot
Size;
According to camera installation site, the relative angle that can obtain the target k moment relative to unmanned plane is Θk=[σk,γk],
Wherein
γk=γ '
In formulaRepresent that the target for detecting comes from image capturing system respectively
Camera A, camera B and camera C.
The angular velocity vector Ω of target is determined according to the angle change in front and back's momentk=[ωxk,ωyk]=Θk+1-Θk,k>0。
Step 3, according to the airbound target status information obtained in step 2, safe envelope in Visual servoing control system
Module carries out the safe envelope of plane of delineation angle and generates, and determines that unmanned plane whether there is collision threat by safe envelope, for
Collision threat, is calculated and evades angle s under image meaning*=[σ*,γ*]。
Safe envelope is defined to indicate that aircraft and the smooth of target distance of minimum separation, closed curve or curved surface, is regarding
In feeling avoidance system, as distance cannot be obtained, therefore safe envelope cannot be set up according to the true three-dimension space of target, such as be schemed
Shown in 4, a kind of safe enveloping method based on angle is set up in the present invention, comprised the steps:
1. targeted security envelope circle is set up, the center of circle is impact point, chooses a radius initial value, and carried out with fixed speed
Increase;
2. safe envelope is set up according to target size oval, the oval center of circle is impact point, the length and envelope of ellipse short shaft
Round radius is equal, and the length of transverse is extrapolation of the length of short axle with target under current angular velocity in setting aside some time
Length sum, the direction of motion of the long axis direction parallel to target;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse
Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat based on safe envelope and indicate
Function, judges whether collision threat with this;
5. distance principle is evaded according to minimum, is found apart from the nearest point of initial target in the safe envelope of Plane Angle.
Safe enveloping method of the above-mentioned foundation based on angle can be carried out according to following concrete steps:
1. targeted security envelope circle is set up, relative angular position Θ of the target k moment relative to unmanned plane is elected in the center of circle ask=
[σk,γk], choose a radius initial value r0, and increased with fixed speed, then
rk+1=rk+ ε, k=1,2,3 ...
rk=r0, k=0
Wherein ε is to fix growth rate, for simulated three-dimensional space object the plane of delineation rate of expansion, rk+1Represent k
The safe envelope radius of circle at+1 moment, the r in Fig. 4 represent the radius of envelope circle;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point Θk=[σk,γk], long axis direction
Parallel to the direction of motion of target, i.e. target angular velocity ΩkDirection, a and b in Fig. 4 represent the oval major axis of envelope respectively
And the length of short axle, major axis and short axle is chosen by following equation respectively:
A=rk(1+α‖Ωk‖),
B=rk,
In formula, a and b represents the oval major axis of envelope and short axle, r respectivelykFor the radius of k moment envelope circle, α is angular velocity
The scale factor of axial length is converted into, the factor is represented to evade and set aside some time, ‖ Ωk‖ is target angular velocity of satellite motion vector field homoemorphism, i.e.,
The length of major axis is extrapolation length sum of the length of short axle with target under current angular velocity in setting aside some time;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse
Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule, real in concrete such as Fig. 4
Shown in line part;
The safe envelope both considered due to target be close to and translocation error exist cause evade angle surplus, while peace
Full envelope have also contemplated that the kinestate of target;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign letter based on time k
Number lk, work as lk<When 0, it is believed that there is collision threat, collision threat is judged whether with this, wherein
WhereinRepresent that the major axes orientation of camera B, relative to the angle of unmanned plane major axes orientation, can generally be recognized
ForIt is sign function;
5. work as lk<When 0, distance principle is evaded according to minimum, distance is found in the safe envelope of Plane AngleNearest point s*
=[σ*,γ*] as minimum evasion manoeuvre point:
WhereinRepresent unit vector of the k moment perpendicular to target angular velocity vector.
Step 4, will evade angle s in step 3*=[σ*,γ*] input Visual servoing control system in vision watch
Device is taken, evasion manoeuvre pitching and yaw angle that visual server output needsAnd unmanned plane is sent to by serial ports
Automatic pilot completes evasion manoeuvre.
1. defining Interactive matrix is
Speed control is set up in the Visual servoing control device of Visual servoing control system, feedback quantity is
The exponential damping of error is completed, output speed controlled quentity controlled variable V, Visual servoing control device are expressed as
In formula, λ is error extension attenuation quotient,Represent LePseudoinverse;
Due in Interactive matrix LeIn cannot obtain the information apart from d of target and the machine, Interactive matrix is split
It is as follows:
In formula, LωRepresent LeIn Angle ambiguity component, LtRepresent speed motor control component;
Obtain apart from unrelated Visual servoing control device:
In formula,Represent LωPseudoinverse;
To eliminate steady-state error, Visual servoing control device is compensated, it is as follows:
In formula, Ω represents the angular velocity of target motion,Represent the direction vector of error, ωx、ωy、ωzRepresent respectively
Three components of ω;
2. the angle of pitch and yaw angle for exporting be
In formula,And φcK () represents the angle of pitch and yaw angle of automatic pilot output attitude,And φ
K () represents the angle of pitch and yaw angle of unmanned plane current pose, Δ t represents Visual servoing control device output time interval steps,
ωy(k) and ωzK () represents the rate of pitch controlled quentity controlled variable and yaw rate of current time Visual servoing control device output respectively
Controlled quentity controlled variable, g represent acceleration of gravity, and V (k) represents the speed of current time unmanned plane.
Step 5, sets up air route retrogression mechanism using navigation positioning system, when unmanned plane does not have threat, makes unmanned plane
Return to original air route.
1. unmanned plane is determined whether in air route by the machine navigation positioning system, when the machine not in air route when, navigated
Road returns;
2. confirm the recurrence air route angle of moment k
In formula,Represent minimum evasive maneuvering point position when air route returns;
Wherein PdIt is position of the machine on script air route when there is no evasion manoeuvre, Pd12And Pd13It is the machine respectively
In the two-dimensional position of XY and XZ planes;
PsIt is the machine current location obtained by the machine navigation positioning system, Ps12And Ps13It is the machine respectively in XY and XZ
The two-dimensional position of plane;
esIt is the machine direction vector obtained by the machine navigation positioning system, es12And es13It is the machine respectively in XY and XZ
The two-dimensional directional vector of plane.
The method and system that the present invention is provided can be realized in the case where any distance measuring sensor is not installed additional, without behaviour
Make the evasion manoeuvre for completing to space flight target in the case that personnel intervene, loading demands are low, control accuracy is high, with higher
It is intelligent, it is possible to increase the spatial domain flight safety ability of unmanned plane.
Claims (7)
1. a kind of perception of view-based access control model servo and avoidance system, it is characterised in that include:
Unmanned plane, arranges automatic pilot on the unmanned plane, the automatic pilot receives flight control instruction and flown
And complete avoiding action of the unmanned plane to barrier;
Image capturing system, is mounted on the unmanned plane, for gathering the flying area image information of unmanned plane, using multiphase
The centralized array configuration of machine various visual angles, and pass through camera interface real-time Transmission image information;
Visual servoing control system, is arranged on the unmanned plane, including sensation target detection and tracking module, safe envelope mould
Block and Visual servoing control device, sensation target detection receive the image information of image capturing system transmission with tracking module and realize
Detection, positioning and tracking to airbound target in image, safe envelope module carry out image according to the target status information for obtaining
The generation of the safe envelope of Plane Angle, and angle is evaded based on safe envelope generation image, it is input into vision at this angle and watches
Controller, Visual servoing control device output evasion manoeuvre angle are taken, and it is complete to automatic pilot that the angle is passed through Serial Port Transmission
Into avoiding action;
Navigation positioning system, is arranged on the unmanned plane, and for setting up air route retrogression mechanism, navigation positioning system detects nothing
It is man-machine to carry out air route recurrence not in air route and when there is no threat, make unmanned plane return to original air route.
2. the perception of view-based access control model servo according to claim 1 and avoidance system, it is characterised in that the sensation target
Detection adopts multi-path high-definition image processing platform DM8168 with tracking module.
3. the bypassing method of a kind of perception of view-based access control model servo and avoidance system, it is characterised in that include:
Step one, realizes being completely covered to the spatial domain in the flight angle of visual field by unmanned aerial vehicle onboard image capturing system, obtains
The flying area image information of unmanned plane;
Step 2, sensation target detection in airborne Visual servoing control system receive image letter in the step one with tracking module
Cease and processed, complete the detection to airbound target in spatial domain picture, positioning and track;
The concrete methods of realizing of the step 2 is as follows:
The view data that image capturing system is obtained in the step one is sent to airborne visual servo control by camera data line
In system processed, sensation target detection and tracking module, wherein arrange tri- cameras of A, B, C, sensation target altogether in image capturing system
Detection adopts multi-path high-definition image processing platform DM8168 with tracking module, realizes entering the multi-channel video for obtaining using DM8168
Row is processed, and obtains the positional information p of target k moment a certain camera image plane in image capturing system by detection algorithmk
=[pxk,pyk], obtain relative angle of the target relative to the camera:
Wherein, w and h are the width and height of the image in units of pixel respectively, and f is camera lens focal length, and μ is picture dot chi
It is very little;
According to camera installation site, the relative angle that can obtain the target k moment relative to unmanned plane is Θk=[σk,γk], wherein
γk=γ '
In formulaRepresent that the target for detecting comes from the phase in image capturing system respectively
Machine A, camera B and camera C;
The angular velocity vector Ω of target is determined according to the angle change in front and back's momentk=[ωxk,ωyk]=Θk+1-Θk,k>0;
Step 3, according to the airbound target status information obtained in the step 2, safe envelope in Visual servoing control system
Module carries out the safe envelope of plane of delineation angle and generates, and determines that unmanned plane whether there is collision threat by safe envelope, for
Collision threat, is calculated and evades angle under image meaning;
Step 4, the visual server evaded in angle input Visual servoing control system in the step 3, vision are watched
Evasion manoeuvre pitching and yaw angle that device output needs are taken, and is sent to unmanned plane automatic pilot and complete evasion manoeuvre;
Step 5, sets up air route retrogression mechanism using navigation positioning system, when unmanned plane does not have threat, returns unmanned plane
Original air route.
4. bypassing method according to claim 3, it is characterised in that in the step 3 generation step of safe envelope and
The calculation procedure for evading angle includes:
1. targeted security envelope circle is set up, the center of circle is impact point, chooses a radius initial value, and increased with fixed speed
It is long;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point, the length and envelope circle of ellipse short shaft
Radius is equal, and the length of transverse is extrapolation length of the length of short axle with target under current angular velocity in setting aside some time
Sum, the direction of motion of the long axis direction parallel to target;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope by with ellipse short shaft is
The semiellipse along target direction of motion of cut-off rule moves reciprocal semicircle composition with along target;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign letter based on safe envelope
Number, judges whether collision threat with this;
5. distance principle is evaded according to minimum, is found apart from the nearest point of initial target in the safe envelope of Plane Angle.
5. bypassing method according to claim 4, it is characterised in that the concrete generation step of safe envelope in the step 3
Concrete calculation procedure that is rapid and evading angle is as follows:
1. targeted security envelope circle is set up, relative angular position Θ of the target k moment relative to unmanned plane is elected in the center of circle ask=[σk,
γk], choose a radius initial value r0, and increased with fixed speed, then
rk+1=rk+ ε, k=1,2,3 ...
rk=r0, k=0
Wherein ε is that the fixed of safe envelope radius of circle increases length, rk+1Represent the safe envelope radius of circle at k+1 moment;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point Θk=[σk,γk], long axis direction is parallel
In the direction of motion of target, i.e. target angular velocity ΩkDirection, the length of major axis and short axle chosen by following equation respectively:
A=rk(1+α‖Ωk‖),
B=rk,
In formula, a and b represents the oval major axis of envelope and short axle, r respectivelykFor the radius that k moment envelope is justified, α is that angular velocity is converted
For the scale factor of axial length, the factor is represented to evade and is set aside some time, ‖ Ωk‖ is target angular velocity of satellite motion vector field homoemorphism;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope by with ellipse short shaft is
The semiellipse along target direction of motion of cut-off rule moves reciprocal semicircle composition with along target;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign function l based on time kk,
Work as lk<When 0, there is collision threat, collision threat is judged whether with this, wherein
WhereinThe angle of the major axes orientation relative to unmanned plane major axes orientation of camera B is represented, wherein,
Sgn () is sign function;
5. work as lk<When 0, distance principle is evaded according to minimum, distance is found in the safe envelope of Plane AngleNearest point s*=
[σ*,γ*] as minimum evasion manoeuvre point:
WhereinRepresent unit vector of the k moment perpendicular to target angular velocity vector.
6. bypassing method according to claim 3, it is characterised in that evasion manoeuvre pitching and yaw angle in the step 4
The concrete calculation procedure of degree is as follows:
1. defining Interactive matrix is
Speed control is set up in the Visual servoing control device of Visual servoing control system, feedback quantity is
The exponential damping of error is completed, output speed controlled quentity controlled variable V, Visual servoing control device are expressed as
In formula, λ is error extension attenuation quotient,Represent LePseudoinverse;
Due in Interactive matrix LeIn cannot obtain the information apart from d of target and the machine, Interactive matrix is carried out splitting as follows:
In formula, LωRepresent LeIn Angle ambiguity component, LtRepresent speed motor control component;
Obtain apart from unrelated Visual servoing control device:
In formula,Represent LωPseudoinverse;
To eliminate steady-state error, Visual servoing control device is compensated, it is as follows:
In formula, Ω represents the angular velocity of target motion,Represent the direction vector of error, ωx、ωy、ωzRepresent ω's respectively
Three components;
2. the angle of pitch and yaw angle for exporting be
In formula,And φcK () represents the angle of pitch and yaw angle of automatic pilot output attitude,Represent with φ (k)
The angle of pitch and yaw angle of unmanned plane current pose, Δ t represent Visual servoing control device output time interval steps, ωy(k) and
ωzK () represents the rate of pitch controlled quentity controlled variable and yaw rate controlled quentity controlled variable of current time Visual servoing control device output respectively,
G represents acceleration of gravity, and V (k) represents the speed of current time unmanned plane.
7. bypassing method according to claim 3, it is characterised in that air route retrogression mechanism specifically builds in the step 5
Vertical step is as follows:
1. unmanned plane is determined whether in air route by the machine navigation positioning system, when the machine not in air route when, carry out air route and return
Return;
2. confirm the recurrence air route angle of moment k
In formula,Represent minimum evasive maneuvering point position when air route returns;
Wherein PdIt is position of the machine on script air route when there is no evasion manoeuvre, Pd12And Pd13The machine respectively in XY and
The two-dimensional position of XZ planes;
PsIt is the machine current location obtained by the machine navigation positioning system, Ps12And Ps13It is the machine respectively in XY and XZ planes
Two-dimensional position;
esIt is the machine direction vector obtained by the machine navigation positioning system, es12And es13It is the machine respectively in XY and XZ planes
Two-dimensional directional vector.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410305109.6A CN104102218B (en) | 2014-06-30 | 2014-06-30 | The perception of view-based access control model servo and bypassing method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410305109.6A CN104102218B (en) | 2014-06-30 | 2014-06-30 | The perception of view-based access control model servo and bypassing method and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104102218A CN104102218A (en) | 2014-10-15 |
CN104102218B true CN104102218B (en) | 2017-04-05 |
Family
ID=51670439
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410305109.6A Active CN104102218B (en) | 2014-06-30 | 2014-06-30 | The perception of view-based access control model servo and bypassing method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104102218B (en) |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DK3123260T3 (en) * | 2014-12-31 | 2021-06-14 | Sz Dji Technology Co Ltd | SELECTIVE PROCESSING OF SENSOR DATA |
CN104539906B (en) * | 2015-01-08 | 2017-06-09 | 西安费斯达自动化工程有限公司 | Image/laser range finding/ADS B monitor integral system |
CN104656663B (en) * | 2015-02-15 | 2017-12-01 | 西北工业大学 | A kind of unmanned plane formation of view-based access control model perceives and bypassing method |
CN104914877A (en) * | 2015-07-13 | 2015-09-16 | 沈阳飞羽航空科技有限公司 | Method for perceiving and evading light unmanned aerial vehicle autonomously |
JP6609833B2 (en) | 2015-12-09 | 2019-11-27 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッド | Method and system for controlling the flight of an unmanned aerial vehicle |
CN106056624A (en) * | 2016-05-24 | 2016-10-26 | 西北工业大学 | Unmanned aerial vehicle high-definition image small target detecting and tracking system and detecting and tracking method thereof |
CN106371461A (en) * | 2016-09-08 | 2017-02-01 | 河海大学常州校区 | Visual servo based video tracking flight object control system and method |
US10552691B2 (en) * | 2017-04-25 | 2020-02-04 | TuSimple | System and method for vehicle position and velocity estimation based on camera and lidar data |
CN110362098B (en) * | 2018-03-26 | 2022-07-05 | 北京京东尚科信息技术有限公司 | Unmanned aerial vehicle visual servo control method and device and unmanned aerial vehicle |
JP6974247B2 (en) * | 2018-04-27 | 2021-12-01 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co., Ltd | Information processing equipment, information presentation instruction method, program, and recording medium |
CN109947123B (en) * | 2019-02-27 | 2021-06-22 | 南京航空航天大学 | Unmanned aerial vehicle path tracking and autonomous obstacle avoidance method based on sight guidance law |
CN112766025B (en) * | 2019-11-04 | 2022-03-01 | 上海喜通装饰材料有限公司 | Airspace target state data identification system |
CN110908395A (en) * | 2019-11-26 | 2020-03-24 | 西北工业大学 | Improved unmanned aerial vehicle flight path real-time planning method |
CN112092805B (en) * | 2020-09-23 | 2021-10-19 | 北京理工大学 | Integrated control method and system for collision avoidance and collision damage reduction of intelligent vehicle |
CN112419417B (en) * | 2021-01-25 | 2021-05-18 | 成都翼比特自动化设备有限公司 | Unmanned aerial vehicle-based photographing point positioning method and related device |
CN113271409B (en) * | 2021-04-06 | 2022-07-01 | 南京极目机器人科技有限公司 | Combined camera, image acquisition method and aircraft |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2442133A1 (en) * | 2010-10-18 | 2012-04-18 | Raytheon Company | Systems and methods for collision avoidance in unmanned aerial vehicles |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8380367B2 (en) * | 2009-03-26 | 2013-02-19 | The University Of North Dakota | Adaptive surveillance and guidance system for vehicle collision avoidance and interception |
CN102707724B (en) * | 2012-06-05 | 2015-01-14 | 清华大学 | Visual localization and obstacle avoidance method and system for unmanned plane |
CN102854883B (en) * | 2012-07-04 | 2014-10-22 | 北京航空航天大学 | Modeling method for unmanned aerial vehicle (UAV) dynamic emergency collision avoidance area |
CN103149939B (en) * | 2013-02-26 | 2015-10-21 | 北京航空航天大学 | A kind of unmanned plane dynamic target tracking of view-based access control model and localization method |
CN103869822B (en) * | 2014-04-01 | 2016-09-07 | 西北工业大学 | The perception of many rotor wing unmanned aerial vehicles and avoidance system and bypassing method thereof |
-
2014
- 2014-06-30 CN CN201410305109.6A patent/CN104102218B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2442133A1 (en) * | 2010-10-18 | 2012-04-18 | Raytheon Company | Systems and methods for collision avoidance in unmanned aerial vehicles |
Non-Patent Citations (2)
Title |
---|
无人机复杂环境中跟踪运动目标的实时航路规划;梁宵 等;《北京航空航天大学学报》;20120930;第38卷(第9期);第1129-1133页 * |
电力巡线无人直升机障碍规避系统;郑天茹 等;《山东电力技术》;20121231(第185期);第14-17页 * |
Also Published As
Publication number | Publication date |
---|---|
CN104102218A (en) | 2014-10-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104102218B (en) | The perception of view-based access control model servo and bypassing method and system | |
CN103941747B (en) | The control method of unmanned aerial vehicle group and system | |
US8301318B2 (en) | Robotic vehicle remote control system having a virtual operator environment | |
US8065044B2 (en) | Vehicle guidance system | |
US10703508B1 (en) | Stereoscopic flight simulator with data acquisition | |
CN104656663A (en) | Vision-based UAV (unmanned aerial vehicle) formation sensing and avoidance method | |
CN106647790A (en) | Four-rotor unmanned aerial vehicle aircraft system oriented to complex environment and flying method | |
JP6081092B2 (en) | Method of operating a composite vision system in an aircraft | |
CN106249755B (en) | A kind of unmanned plane autonomous navigation system and air navigation aid | |
US20200191556A1 (en) | Distance mesurement method by an unmanned aerial vehicle (uav) and uav | |
Griffiths et al. | Obstacle and terrain avoidance for miniature aerial vehicles | |
US11556681B2 (en) | Method and system for simulating movable object states | |
CN108733064A (en) | A kind of the vision positioning obstacle avoidance system and its method of unmanned plane | |
CN102190081B (en) | Vision-based fixed point robust control method for airship | |
RU195749U1 (en) | Intelligent vision system for an unmanned aerial vehicle for solving navigation problems, building a three-dimensional map of the surrounding space and obstacles, and autonomous patrolling | |
Yu et al. | Stereo vision based obstacle avoidance strategy for quadcopter UAV | |
WO2014018071A1 (en) | Future scene generating system, device, and method for a remotely-operated vehicle | |
EP2523062B1 (en) | Time phased imagery for an artificial point of view | |
CN110333735A (en) | A kind of system and method for realizing the secondary positioning in unmanned plane land and water | |
CN105843251A (en) | Method, device, and system used for controlling aircraft | |
Miller et al. | UAV navigation based on videosequences captured by the onboard video camera | |
Minwalla et al. | Experimental evaluation of PICAS: An electro-optical array for non-cooperative collision sensing on unmanned aircraft systems | |
Lee et al. | Landing Site Inspection and Autonomous Pose Correction for Unmanned Aerial Vehicles | |
Gonçalves et al. | Vision-based automatic approach and landing of fixed-wing aircraft using a dense visual tracking | |
Bethke | Persistent vision-based search and track using multiple UAVs |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |