CN111610800B - Loosely-coupled unmanned aerial vehicle control system - Google Patents

Loosely-coupled unmanned aerial vehicle control system Download PDF

Info

Publication number
CN111610800B
CN111610800B CN202010455469.XA CN202010455469A CN111610800B CN 111610800 B CN111610800 B CN 111610800B CN 202010455469 A CN202010455469 A CN 202010455469A CN 111610800 B CN111610800 B CN 111610800B
Authority
CN
China
Prior art keywords
unmanned aerial
data
aerial vehicle
controller
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010455469.XA
Other languages
Chinese (zh)
Other versions
CN111610800A (en
Inventor
唐樟春
苟凌铭
夏艳君
丁林飞
魏晨竹
谢葭
李贵杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Electronic Science and Technology of China
Original Assignee
University of Electronic Science and Technology of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Electronic Science and Technology of China filed Critical University of Electronic Science and Technology of China
Priority to CN202010455469.XA priority Critical patent/CN111610800B/en
Publication of CN111610800A publication Critical patent/CN111610800A/en
Application granted granted Critical
Publication of CN111610800B publication Critical patent/CN111610800B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • G05D1/0808Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
    • G05D1/0816Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft to ensure stability
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link

Abstract

The invention discloses a loosely-coupled unmanned aerial vehicle control system, and relates to the field of unmanned aerial vehicle control technology. The invention comprises an unmanned aerial vehicle airborne system and a ground control system; the loosely-coupled unmanned aerial vehicle control system comprises an unmanned aerial vehicle, an inertial system module, a camera, an onboard controller and a wireless communication module; the inertial system module, the camera, the onboard controller and the wireless communication module are all arranged on the unmanned aerial vehicle, and the inertial system module, the camera and the wireless communication module are all electrically connected with the onboard controller; the ground control system comprises a ground controller and wireless communication, wherein the ground controller is electrically connected with the wireless communication; the unmanned aerial vehicle airborne control system is in communication connection with the ground control system. The processing efficiency of the processor is improved, the higher flexibility and the stronger system expansion capability of a software system are realized, and the requirement on the universality of the unmanned aerial vehicle system is met.

Description

Loosely-coupled unmanned aerial vehicle control system
Technical Field
The invention relates to the field of unmanned aerial vehicle control technology, in particular to a loosely-coupled unmanned aerial vehicle control system.
Background
An unmanned aerial vehicle, abbreviated as "unmanned aerial vehicle" ("UAV"), is an unmanned aerial vehicle that is operated using a radio remote control device and a self-contained program control device. Compared with a manned airplane, the unmanned aerial vehicle has the characteristics of small volume, low manufacturing cost, convenient use and flexible operation, is widely applied to civil use and military use, and can effectively improve the working efficiency by using the unmanned aerial vehicle to carry out power inspection and observe the conditions of ambient air, soil, vegetation and water quality in the civil aspect; in military terms, the unmanned aerial vehicle can be used for battlefield reconnaissance and monitoring, positioning and correcting, damage assessment, electronic warfare and the like, and the investment of personnel and cost can be effectively reduced.
At present, with the increasing use and the increasing complexity of unmanned aerial vehicles, the external environment information which needs to be acquired by the unmanned aerial vehicles is increased, and in the prior art, the unmanned aerial vehicles mostly adopt a control mode that a single airborne control system or an airborne control system is equipped with a ground station, but the equipped ground station has only a data display function and cannot feed back the control; in addition, most control systems adopt a global data undifferentiated processing mode, and all data information is processed and transmitted in the main processor one by one, which greatly increases the processing time of the processor; the loosely-coupled unmanned aerial vehicle control system provided by the invention adopts a mode that an airborne control system and a ground control system are added to control the unmanned aerial vehicle at the same time, and software can be debugged and modified on line in the ground control system, so that the telescopic capacity of the software system is greatly improved. And the data processing adopts a demand type processing mode, processes the data required by the function demand deployment and subscription, and effectively improves the data processing efficiency.
Disclosure of Invention
Aiming at the defects in the background art, the loosely-coupled unmanned aerial vehicle control system provided by the invention can improve the processing efficiency of the processor while ensuring the real-time performance of the system, realize higher flexibility and stronger system expansion capability of a software system, and meet the requirement of the universality of the unmanned aerial vehicle system.
The invention provides a technical scheme that: a loosely-coupled unmanned aerial vehicle control system comprises an unmanned aerial vehicle airborne system and a ground control system; unmanned aerial vehicle airborne system includes: the device comprises an inertial system module, a camera, an onboard controller and a wireless communication module; the inertial system module, the camera and the wireless communication module are electrically connected with the airborne controller; the ground control system comprises a ground controller and a wireless communication module, wherein the ground controller is electrically connected with the wireless communication module; the unmanned aerial vehicle airborne system and the ground control system realize data interaction through respective wireless communication modules; the inertial system module includes: accelerometers, gyroscopes, geomagnetism; acquiring environmental data through a camera, calculating the attitude of the unmanned aerial vehicle and the surrounding environment state of the unmanned aerial vehicle, acquiring data through an inertial system module, calculating the attitude of the unmanned aerial vehicle, fusing the attitudes of the unmanned aerial vehicle and the unmanned aerial vehicle, and controlling the unmanned aerial vehicle by combining the surrounding environment state of the unmanned aerial vehicle;
the ground controller and the airborne controller both adopt a loose coupling mode to control the unmanned aerial vehicle; the control method for controlling the unmanned aerial vehicle in the loose coupling mode comprises the following steps:
unmanned aerial vehicle machine carries system end:
the on-board controller classifies the obtained data according to different categories, including power category data, position category data and camera category data, and each category comprises: original data measured by self type, control output expected data of an airborne controller and control output expected data of a ground controller;
when the unmanned aerial vehicle takes off or does not need to track a target, the onboard controller needs to subscribe positioning data and power data of the unmanned aerial vehicle, the onboard controller analyzes and calculates acceleration data, attitude data, geomagnetic data and environmental air pressure data of the unmanned aerial vehicle, data are fused and converted into coordinate data of the unmanned aerial vehicle in the environment, the actual coordinate information of the unmanned aerial vehicle is used for calculating the motion characteristic of the unmanned aerial vehicle to be realized next, power pulse modulation control data are output after the motion characteristic is analyzed, and the electric controller is controlled to convert the output data into an alternating current control signal required by a motor so as to control the motion of the unmanned aerial vehicle; when the unmanned aerial vehicle needs to track the target, the onboard controller not only needs to subscribe positioning data and power data of the unmanned aerial vehicle, but also needs to subscribe camera data; the airborne controller needs to analyze and calculate target depth data, target attitude data, target characteristic data and target ranging data of cameras, extract targets, calculate coordinate information of the targets relative to the cameras, and calculate coordinate data of the targets relative to the unmanned aerial vehicles through coordinate conversion; calculating the motion characteristic of the unmanned aerial vehicle according to the calculated coordinate data, and outputting motion control as control information of a motor so as to realize the tracking of the unmanned aerial vehicle on a target;
ground control system end:
the ground controller classifies the obtained data according to different categories, including power category data, position category data and camera category data. The ground controller can process the subscription data required to be processed by the movement of the unmanned aerial vehicle in real time on the ground machine according to the processing mode of the onboard controller, then compares the processed calculation output result with the onboard control output stored in the category, and judges the running state of the onboard control system according to the comparison result for many times; the ground controller can store all data returned by wireless communication, display the running condition in the interface, correct the deviation in the control in real time by an instruction correction mode in the interface, analyze the data processing process in real time on line or off line so as to analyze the problems in the functional software design, and conveniently adjust, optimize and develop the software for the second time;
the camera is an intel real sense D435i depth camera which can recognize a minimum distance of 0.1m by vision, and the posture information of the camera can be calculated effectively and quickly by using the camera, it adopts the feature extraction and matching in the image by the feature transformation with invariable scale to obtain the preliminary feature matching point set, then, the obtained preliminary feature matching point set is screened out by adopting a random sampling consistency method to remove points with low matching precision and extract matching points with high matching precision in the image, the method is utilized to extract matching points with high matching precision from the images of the current frame and the next frame, the rotation data and the translation data of two adjacent frames are obtained by using the triangulation principle, and the posture change information of the camera can be obtained according to the rotation data and the translation data, and then converting the attitude information of the camera into the attitude information of the unmanned aerial vehicle through the coordinate relationship between the camera and the unmanned aerial vehicle. And finally, fusing the attitude information of the unmanned aerial vehicle obtained by the vision calculation with the attitude information obtained by the inertial system in a Kalman filtering mode to obtain accurate and reliable attitude information of the unmanned aerial vehicle.
The loosely-coupled unmanned aerial vehicle control system provided by the invention can improve the processing efficiency of the processor, realize higher flexibility and stronger system expansion capability of a software system and meet the requirement of the universality of the unmanned aerial vehicle system while ensuring the real-time performance of the system.
Drawings
Fig. 1 is a schematic structural diagram of a loosely coupled unmanned aerial vehicle control system according to an embodiment of the present invention.
Fig. 2 is a schematic view of the installation position of the inertial system module and the camera according to the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings.
A loosely coupled unmanned aerial vehicle control system comprises an unmanned aerial vehicle airborne system and a ground control system. The loose coupling unmanned aerial vehicle control system comprises an unmanned aerial vehicle, an inertia system module, a camera, an airborne controller and a wireless communication module. The inertial system module the camera the airborne controller and the wireless communication module are all arranged on the unmanned aerial vehicle, and the inertial system module the camera and the wireless communication module are all electrically connected with the airborne controller. The ground control system comprises a ground controller and wireless communication, wherein the ground controller is electrically connected with the wireless communication. The unmanned aerial vehicle airborne control system is in communication connection with the ground control system.
As a preferred mode of the present invention, the inertial system module of the unmanned aerial vehicle is a nine-axis attitude sensor module HI229 manufactured by the super nuclear electronics technologies company, which is integrated with a three-axis gyroscope, a three-axis acceleration meter, and a three-axis magnetometer. The newly developed data fusion algorithm is adopted in the module, the algorithm has extremely small data delay and phase distortion (less than 2.5ms), six axes of the algorithm deviate from zero by 0-0.5 degrees/min, nine axes of the algorithm have no drift, and the stability of the module is extremely good.
As a preferred mode of the invention, an intel real sense D435i depth camera is selected as a camera of the unmanned aerial vehicle, which can better mine environmental depth information and make visual modeling map data more reliable and stable by visually recognizing a minimum distance of 0.1 m.
As a preferred mode of the invention, the ground controller communicates with the unmanned aerial vehicle in a high-speed wireless communication mode, so that the real-time high efficiency of data transmission between the unmanned aerial vehicle and a ground system can be effectively ensured. The unmanned aerial vehicle and the airborne controller communicate in an Ethernet communication mode, and the real-time performance of data transmission between the unmanned aerial vehicle and the airborne device is guaranteed.
As a preferred mode of the invention, the processor of the onboard controller is Intel Core i 7-8550U; the processor of the ground controller is Intel Core i 7-8700K. Both of them adopt the Kurui i7 eight-generation processor, which can effectively ensure the real-time of data processing.
It should be noted that, in this embodiment, the inertial system module is for obtaining three-axis acceleration data, three-axis gyroscope data, and three-axis geomagnetic meter data of the unmanned aerial vehicle during flight. The camera is used for obtaining image depth data of the unmanned aerial vehicle in the flying process, then the obtained image data is used for estimating the attitude of the camera and carrying out visual modeling positioning on environment data obtained by the camera, then accurate attitude information of the unmanned aerial vehicle is obtained by fusing the attitude data of the unmanned aerial vehicle obtained by the inertial system and the estimated attitude data obtained by the camera, and finally the unmanned aerial vehicle is subjected to flying navigation by combining modeling information on the basis.
It should be noted that, in this embodiment, the inertial system module is installed at a geometric center position of the bottom support platform of the unmanned aerial vehicle, and a three-axis coordinate system of the unmanned aerial vehicle is established based on the geometric center position. The camera is fixedly installed at a position 15 cm below the inertial system module through the installation device, so that the coincidence between the coordinate system of the unmanned aerial vehicle and the coordinate system of the camera is guaranteed, and the coordinate change operation during fusion of the attitude data of the inertial system and the attitude data of the camera is reduced.
In this embodiment, the ground controller and the onboard controller both control the unmanned aerial vehicle in a loose coupling manner, that is, the unmanned aerial vehicle classifies all data obtained by its own measurement according to different categories, and then encapsulates the data of each category into a message category, where each message category includes original data obtained by the unmanned aerial vehicle, control output expected data of the onboard controller, and control output expected data of the ground controller. The functional tasks in the airborne controller and the ground controller are designed to be data processed according to message data related to task function subscription which needs to be completed by the airborne controller and the ground controller.
Meanwhile, in the embodiment, the subscription relationship between the controller and the message to be subscribed is managed by the manager created by the controller. The controller firstly provides a binding subscription application to the manager, and the manager records the message to be bound and creates a mapping relation between the message and the functional task providing the application, so that the data transmission efficiency and the data processing efficiency of the controller are effectively improved.
Meanwhile, it should be noted that, in this example, the ground controller can display the operation condition of the onboard control system in real time, and can pass the onboard controller to adjust and modify the execution condition of the unmanned aerial vehicle in a manner of sending a message command according to the actual operation condition. And the ground controller can also record and store the information data of the unmanned aerial vehicle received in real time through high-speed wireless communication into a ground computer, then carry out secondary restoration of the flight condition according to the offline data stored by the computer, analyze the problems in the functional software design according to the restoration of the flight condition, and analyze and debug the reason data generated by the problems. Problems are found through debugging, so that adjustment, optimization and secondary development of software are facilitated, and higher flexibility and stronger system expansion and contraction capacity of a software system are realized.

Claims (1)

1. A loosely-coupled unmanned aerial vehicle control system comprises an unmanned aerial vehicle airborne system and a ground control system; unmanned aerial vehicle airborne system includes: the device comprises an inertial system module, a camera, an onboard controller and a wireless communication module; the inertial system module, the camera and the wireless communication module are electrically connected with the airborne controller; the ground control system comprises a ground controller and a wireless communication module, wherein the ground controller is electrically connected with the wireless communication module; the unmanned aerial vehicle airborne system and the ground control system realize data interaction through respective wireless communication modules; the inertial system module includes: accelerometers, gyroscopes, geomagnetism; acquiring environmental data through a camera, calculating the attitude of the unmanned aerial vehicle and the surrounding environment state of the unmanned aerial vehicle, acquiring data through an inertial system module, calculating the attitude of the unmanned aerial vehicle, fusing the attitudes of the unmanned aerial vehicle and the unmanned aerial vehicle, and controlling the unmanned aerial vehicle by combining the surrounding environment state of the unmanned aerial vehicle;
the ground controller and the airborne controller both adopt a loose coupling mode to control the unmanned aerial vehicle; the control method for controlling the unmanned aerial vehicle in the loose coupling mode comprises the following steps:
unmanned aerial vehicle machine carries system end:
the on-board controller classifies the obtained data into different categories, including power category data, position category data and camera category data, and each category comprises: original data measured by self type, control output expected data of an airborne controller and control output expected data of a ground controller;
when the unmanned aerial vehicle takes off or does not need to track a target, the onboard controller needs to subscribe position data and power data of the unmanned aerial vehicle, the onboard controller analyzes and calculates acceleration data, attitude data, geomagnetic data and environmental air pressure data of the unmanned aerial vehicle, data are fused and converted into coordinate data of the unmanned aerial vehicle in the environment, the actual coordinate information of the unmanned aerial vehicle is used for calculating the motion characteristic of the unmanned aerial vehicle to be realized next, power pulse modulation control data are output after the motion characteristic is analyzed, and the electric controller is controlled to convert the output data into an alternating current control signal required by a motor so as to control the motion of the unmanned aerial vehicle; when the unmanned aerial vehicle needs to track a target, the onboard controller not only needs to subscribe position data and power data of the unmanned aerial vehicle, but also needs to subscribe camera data; the airborne controller needs to analyze and calculate target depth data, target attitude data, target characteristic data and target ranging data of cameras, extract targets, calculate coordinate information of the targets relative to the cameras, and calculate coordinate data of the targets relative to the unmanned aerial vehicles through coordinate conversion; calculating the motion characteristic of the unmanned aerial vehicle according to the calculated coordinate data, and outputting motion control as control information of a motor so as to realize the tracking of the unmanned aerial vehicle on a target;
ground control system end:
the ground controller classifies the obtained data according to different categories, including power data, position data and camera data; the ground controller can process the subscription data required to be processed by the movement of the unmanned aerial vehicle in real time on the ground control system according to the processing mode of the onboard controller, then compares the processed calculation output result with the onboard control output stored in the category, and judges the running state of the onboard control system according to the comparison result for many times; the ground controller can store all data returned by wireless communication, display the running condition in the interface, correct the deviation in the control in real time by an instruction correction mode in the interface, analyze the data processing process in real time on line or off line so as to analyze the problems in the functional software design, and conveniently adjust, optimize and develop the software for the second time;
the camera is an intel real sense D435i depth camera which can recognize a minimum distance of 0.1m by vision, and the posture information of the camera can be calculated effectively and quickly by using the camera, it adopts the feature extraction and matching in the image by the feature transformation with invariable scale to obtain the preliminary feature matching point set, then, the obtained preliminary feature matching point set is screened out by adopting a random sampling consistency method to remove points with low matching precision and extract matching points with high matching precision in the image, the method is utilized to extract matching points with high matching precision from the images of the current frame and the next frame, the rotation data and the translation data of two adjacent frames are obtained by using the triangulation principle, and the posture change information of the camera can be obtained according to the rotation data and the translation data, then converting the attitude information of the camera into the attitude information of the unmanned aerial vehicle through the coordinate relationship between the camera and the unmanned aerial vehicle; and finally, fusing the attitude information of the unmanned aerial vehicle obtained by the vision calculation with the attitude information obtained by the inertial system in a Kalman filtering mode to obtain accurate and reliable attitude information of the unmanned aerial vehicle.
CN202010455469.XA 2020-05-26 2020-05-26 Loosely-coupled unmanned aerial vehicle control system Active CN111610800B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010455469.XA CN111610800B (en) 2020-05-26 2020-05-26 Loosely-coupled unmanned aerial vehicle control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010455469.XA CN111610800B (en) 2020-05-26 2020-05-26 Loosely-coupled unmanned aerial vehicle control system

Publications (2)

Publication Number Publication Date
CN111610800A CN111610800A (en) 2020-09-01
CN111610800B true CN111610800B (en) 2021-07-06

Family

ID=72197717

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010455469.XA Active CN111610800B (en) 2020-05-26 2020-05-26 Loosely-coupled unmanned aerial vehicle control system

Country Status (1)

Country Link
CN (1) CN111610800B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650263B (en) * 2020-12-08 2022-03-15 电子科技大学 Control method of combined unmanned aerial vehicle

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101736089B1 (en) * 2015-01-08 2017-05-30 서울대학교산학협력단 UAV flight control device and method for object shape mapping and real-time guidance using depth map
FR3034595B1 (en) * 2015-03-31 2017-04-28 Thales Sa METHOD AND ELECTRONIC DEVICE FOR MANAGING, IN THE FORM OF SEQUENCES, MESSAGES EXCHANGED BETWEEN AN AIRCRAFT AND A GROUND STATION, ASSOCIATED COMPUTER PROGRAM PRODUCT
CN109885099A (en) * 2017-12-06 2019-06-14 智飞智能装备科技东台有限公司 A kind of visual identifying system for unmanned plane tracking lock target
CN108762286A (en) * 2018-05-31 2018-11-06 智飞智能装备科技东台有限公司 A kind of ground control system for the control that can fly to multiple UAVs
CN110550212A (en) * 2019-10-18 2019-12-10 中国兵器工业计算机应用技术研究所 air-ground cooperative unmanned system
CN111026150A (en) * 2019-11-25 2020-04-17 国家电网有限公司 System and method for pre-warning geological disasters of power transmission line by using unmanned aerial vehicle
CN111024066B (en) * 2019-12-10 2023-08-01 中国航空无线电电子研究所 Unmanned aerial vehicle vision-inertia fusion indoor positioning method

Also Published As

Publication number Publication date
CN111610800A (en) 2020-09-01

Similar Documents

Publication Publication Date Title
CN109911188B (en) Bridge detection unmanned aerial vehicle system in non-satellite navigation and positioning environment
US10914590B2 (en) Methods and systems for determining a state of an unmanned aerial vehicle
CN109885080B (en) Autonomous control system and autonomous control method
CN109887057B (en) Method and device for generating high-precision map
US10565732B2 (en) Sensor fusion using inertial and image sensors
EP3158417B1 (en) Sensor fusion using inertial and image sensors
CN108627153B (en) Rigid body motion tracking system based on inertial sensor and working method thereof
EP3734394A1 (en) Sensor fusion using inertial and image sensors
CN105793792A (en) Flight auxiliary method and system of unmanned aerial vehicle, unmanned aerial vehicle, and mobile terminal
CN106226803A (en) Localization method, device and unmanned plane
CN112789672B (en) Control and navigation system, gesture optimization, mapping and positioning techniques
Rhudy et al. Unmanned aerial vehicle navigation using wide-field optical flow and inertial sensors
Hirose et al. Implementation of UAV localization methods for a mobile post-earthquake monitoring system
CN108444468B (en) Directional compass integrating downward vision and inertial navigation information
CN107941167B (en) Space scanning system based on unmanned aerial vehicle carrier and structured light scanning technology and working method thereof
JP6934116B1 (en) Control device and control method for controlling the flight of an aircraft
CN111610800B (en) Loosely-coupled unmanned aerial vehicle control system
CN111247389A (en) Data processing method and device for shooting equipment and image processing equipment
CN109521785A (en) It is a kind of to clap Smart Rotor aerocraft system with oneself
JP2019191888A (en) Unmanned flying object, unmanned flying method and unmanned flying program
Fusini et al. Experimental validation of a uniformly semi-globally exponentially stable non-linear observer for gnss-and camera-aided inertial navigation for fixed-wing uavs
CN115237158A (en) Multi-rotor unmanned aerial vehicle autonomous tracking and landing control system and control method
Wang et al. Design and construction methodology of an indoor UAV system with embedded vision
CN113063401A (en) Unmanned aerial vehicle aerial survey system
CN113093759A (en) Robot formation construction method and system based on multi-sensor information fusion

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant