CN109164821A - 一种无人机姿态训练方法及装置 - Google Patents
一种无人机姿态训练方法及装置 Download PDFInfo
- Publication number
- CN109164821A CN109164821A CN201811123962.0A CN201811123962A CN109164821A CN 109164821 A CN109164821 A CN 109164821A CN 201811123962 A CN201811123962 A CN 201811123962A CN 109164821 A CN109164821 A CN 109164821A
- Authority
- CN
- China
- Prior art keywords
- information
- aerial vehicle
- unmanned aerial
- attitude
- reward
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012549 training Methods 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000003062 neural network model Methods 0.000 claims abstract description 18
- 238000013528 artificial neural network Methods 0.000 claims abstract description 14
- 230000002787 reinforcement Effects 0.000 claims description 26
- 238000011156 evaluation Methods 0.000 claims description 25
- 230000001133 acceleration Effects 0.000 claims description 7
- 239000007769 metal material Substances 0.000 claims description 7
- 238000005457 optimization Methods 0.000 claims description 7
- 230000007613 environmental effect Effects 0.000 abstract description 6
- 230000004044 response Effects 0.000 abstract description 2
- 230000009471 action Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000014616 translation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/08—Control of attitude, i.e. control of roll, pitch, or yaw
- G05D1/0808—Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manipulator (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811123962.0A CN109164821B (zh) | 2018-09-26 | 2018-09-26 | 一种无人机姿态训练方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811123962.0A CN109164821B (zh) | 2018-09-26 | 2018-09-26 | 一种无人机姿态训练方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109164821A true CN109164821A (zh) | 2019-01-08 |
CN109164821B CN109164821B (zh) | 2019-05-07 |
Family
ID=64892599
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811123962.0A Active CN109164821B (zh) | 2018-09-26 | 2018-09-26 | 一种无人机姿态训练方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109164821B (zh) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109696830A (zh) * | 2019-01-31 | 2019-04-30 | 天津大学 | 小型无人直升机的强化学习自适应控制方法 |
CN110059646A (zh) * | 2019-04-23 | 2019-07-26 | 暗物智能科技(广州)有限公司 | 训练动作规划模型的方法及目标搜索方法 |
CN110717260A (zh) * | 2019-09-26 | 2020-01-21 | 杭州电子科技大学 | 一种无人机机动能力模型建立方法 |
CN110989649A (zh) * | 2019-12-26 | 2020-04-10 | 中国航空工业集团公司沈阳飞机设计研究所 | 面向高机动固定翼无人机的飞行动作控制装置及训练方法 |
CN111415389A (zh) * | 2020-03-18 | 2020-07-14 | 清华大学 | 基于强化学习的无标签六维物体姿态预测方法及装置 |
CN111596677A (zh) * | 2020-05-07 | 2020-08-28 | 北京航空航天大学 | 一种基于在线学习的航天器临近操作自主控制方法及系统 |
CN112034834A (zh) * | 2019-05-15 | 2020-12-04 | 百度(美国)有限责任公司 | 使用强化学习来加速自动驾驶车辆的轨迹规划的离线代理 |
CN112131661A (zh) * | 2020-09-10 | 2020-12-25 | 南京大学 | 一种无人机自主跟拍运动目标的方法 |
CN112286216A (zh) * | 2020-11-11 | 2021-01-29 | 鹏城实验室 | 基于视觉识别的无人机自主降落无人艇的方法及系统 |
CN112486192A (zh) * | 2020-11-18 | 2021-03-12 | 四川大学 | 一种基于目的地运动预测的飞行器引导迁移学习训练算法 |
CN112506210A (zh) * | 2020-12-04 | 2021-03-16 | 东南大学 | 一种用于自主目标跟踪的无人机控制方法 |
CN113272829A (zh) * | 2019-01-14 | 2021-08-17 | 西门子股份公司 | 迁移学习的硬件加速器扩展—将训练扩展/完成到边缘 |
CN113436213A (zh) * | 2021-06-23 | 2021-09-24 | 上海极维信息科技有限公司 | 使用强化学习处理定位算法的区域边缘问题的方法 |
CN114355936A (zh) * | 2021-12-31 | 2022-04-15 | 深兰人工智能(深圳)有限公司 | 智能体的控制方法、装置、智能体及计算机可读存储介质 |
CN114489100A (zh) * | 2022-01-18 | 2022-05-13 | 中国地质大学(北京) | 基于姿态同步的超视距无人机遥控系统 |
CN115562345A (zh) * | 2022-10-28 | 2023-01-03 | 北京理工大学 | 一种基于深度强化学习的无人机侦测轨迹规划方法 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5448681A (en) * | 1992-03-27 | 1995-09-05 | National Semiconductor Corporation | Intelligent controller with neural network and reinforcement learning |
CN1590039A (zh) * | 2003-08-25 | 2005-03-09 | 索尼株式会社 | 机器人及机器人的姿态控制方法 |
CN103324085A (zh) * | 2013-06-09 | 2013-09-25 | 中国科学院自动化研究所 | 基于监督式强化学习的最优控制方法 |
CN103365296A (zh) * | 2013-06-29 | 2013-10-23 | 天津大学 | 一种四旋翼无人飞行器非线性输出反馈飞行控制方法 |
CN107020636A (zh) * | 2017-05-09 | 2017-08-08 | 重庆大学 | 一种基于策略梯度的机器人学习控制方法 |
CN107239728A (zh) * | 2017-01-04 | 2017-10-10 | 北京深鉴智能科技有限公司 | 基于深度学习姿态估计的无人机交互装置与方法 |
CN107479368A (zh) * | 2017-06-30 | 2017-12-15 | 北京百度网讯科技有限公司 | 一种基于人工智能的训练无人机控制模型的方法及系统 |
CN107817820A (zh) * | 2017-10-16 | 2018-03-20 | 复旦大学 | 一种基于深度学习的无人机自主飞行控制方法与系统 |
CN107856035A (zh) * | 2017-11-06 | 2018-03-30 | 深圳市唯特视科技有限公司 | 一种基于强化学习和全身控制器的鲁棒性动态运动方法 |
-
2018
- 2018-09-26 CN CN201811123962.0A patent/CN109164821B/zh active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5448681A (en) * | 1992-03-27 | 1995-09-05 | National Semiconductor Corporation | Intelligent controller with neural network and reinforcement learning |
CN1590039A (zh) * | 2003-08-25 | 2005-03-09 | 索尼株式会社 | 机器人及机器人的姿态控制方法 |
CN103324085A (zh) * | 2013-06-09 | 2013-09-25 | 中国科学院自动化研究所 | 基于监督式强化学习的最优控制方法 |
CN103365296A (zh) * | 2013-06-29 | 2013-10-23 | 天津大学 | 一种四旋翼无人飞行器非线性输出反馈飞行控制方法 |
CN107239728A (zh) * | 2017-01-04 | 2017-10-10 | 北京深鉴智能科技有限公司 | 基于深度学习姿态估计的无人机交互装置与方法 |
CN107020636A (zh) * | 2017-05-09 | 2017-08-08 | 重庆大学 | 一种基于策略梯度的机器人学习控制方法 |
CN107479368A (zh) * | 2017-06-30 | 2017-12-15 | 北京百度网讯科技有限公司 | 一种基于人工智能的训练无人机控制模型的方法及系统 |
CN107817820A (zh) * | 2017-10-16 | 2018-03-20 | 复旦大学 | 一种基于深度学习的无人机自主飞行控制方法与系统 |
CN107856035A (zh) * | 2017-11-06 | 2018-03-30 | 深圳市唯特视科技有限公司 | 一种基于强化学习和全身控制器的鲁棒性动态运动方法 |
Non-Patent Citations (4)
Title |
---|
YUANWANG,等: "A Novel Approach to Feedback Control with Deep Reinforcement Learning", 《10TH IFAC SYMPOSIUM ON ADVANCED CONTROL OF CHEMICAL PROCESSES ADCHEM 2018》 * |
叶秀峰: "基于双目视觉和深度学习的无人机人机交互系统", 《中国优秀硕士学位论文全文数据库工程科技II辑》 * |
沈超,等: "飞行器姿态的再励学习跟踪控制", 《2007中国控制与决策学术年会论文集》 * |
胡英柏: "基于强化学习与动态运动基元的移动机器人抓取研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113272829A (zh) * | 2019-01-14 | 2021-08-17 | 西门子股份公司 | 迁移学习的硬件加速器扩展—将训练扩展/完成到边缘 |
CN109696830B (zh) * | 2019-01-31 | 2021-12-03 | 天津大学 | 小型无人直升机的强化学习自适应控制方法 |
CN109696830A (zh) * | 2019-01-31 | 2019-04-30 | 天津大学 | 小型无人直升机的强化学习自适应控制方法 |
CN110059646A (zh) * | 2019-04-23 | 2019-07-26 | 暗物智能科技(广州)有限公司 | 训练动作规划模型的方法及目标搜索方法 |
CN112034834A (zh) * | 2019-05-15 | 2020-12-04 | 百度(美国)有限责任公司 | 使用强化学习来加速自动驾驶车辆的轨迹规划的离线代理 |
CN110717260A (zh) * | 2019-09-26 | 2020-01-21 | 杭州电子科技大学 | 一种无人机机动能力模型建立方法 |
CN110989649A (zh) * | 2019-12-26 | 2020-04-10 | 中国航空工业集团公司沈阳飞机设计研究所 | 面向高机动固定翼无人机的飞行动作控制装置及训练方法 |
CN110989649B (zh) * | 2019-12-26 | 2023-07-25 | 中国航空工业集团公司沈阳飞机设计研究所 | 面向高机动固定翼无人机的飞行动作控制装置及训练方法 |
CN111415389A (zh) * | 2020-03-18 | 2020-07-14 | 清华大学 | 基于强化学习的无标签六维物体姿态预测方法及装置 |
CN111415389B (zh) * | 2020-03-18 | 2023-08-29 | 清华大学 | 基于强化学习的无标签六维物体姿态预测方法及装置 |
CN111596677A (zh) * | 2020-05-07 | 2020-08-28 | 北京航空航天大学 | 一种基于在线学习的航天器临近操作自主控制方法及系统 |
CN111596677B (zh) * | 2020-05-07 | 2021-11-30 | 北京航空航天大学 | 一种基于在线学习的航天器临近操作自主控制方法及系统 |
CN112131661A (zh) * | 2020-09-10 | 2020-12-25 | 南京大学 | 一种无人机自主跟拍运动目标的方法 |
CN112286216A (zh) * | 2020-11-11 | 2021-01-29 | 鹏城实验室 | 基于视觉识别的无人机自主降落无人艇的方法及系统 |
CN112486192A (zh) * | 2020-11-18 | 2021-03-12 | 四川大学 | 一种基于目的地运动预测的飞行器引导迁移学习训练算法 |
CN112506210A (zh) * | 2020-12-04 | 2021-03-16 | 东南大学 | 一种用于自主目标跟踪的无人机控制方法 |
CN112506210B (zh) * | 2020-12-04 | 2022-12-27 | 东南大学 | 一种用于自主目标跟踪的无人机控制方法 |
CN113436213A (zh) * | 2021-06-23 | 2021-09-24 | 上海极维信息科技有限公司 | 使用强化学习处理定位算法的区域边缘问题的方法 |
CN114355936A (zh) * | 2021-12-31 | 2022-04-15 | 深兰人工智能(深圳)有限公司 | 智能体的控制方法、装置、智能体及计算机可读存储介质 |
CN114489100A (zh) * | 2022-01-18 | 2022-05-13 | 中国地质大学(北京) | 基于姿态同步的超视距无人机遥控系统 |
CN114489100B (zh) * | 2022-01-18 | 2023-07-04 | 中国地质大学(北京) | 基于姿态同步的超视距无人机遥控系统 |
CN115562345A (zh) * | 2022-10-28 | 2023-01-03 | 北京理工大学 | 一种基于深度强化学习的无人机侦测轨迹规划方法 |
Also Published As
Publication number | Publication date |
---|---|
CN109164821B (zh) | 2019-05-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109164821A (zh) | 一种无人机姿态训练方法及装置 | |
Raza et al. | Intelligent flight control of an autonomous quadrotor | |
Sarabakha et al. | Novel Levenberg–Marquardt based learning algorithm for unmanned aerial vehicles | |
Nie et al. | Three‐Dimensional Path‐Following Control of a Robotic Airship with Reinforcement Learning | |
Liang et al. | A scalable model-based learning algorithm with application to UAVs | |
Xiao et al. | Flying through a narrow gap using end-to-end deep reinforcement learning augmented with curriculum learning and sim2real | |
Zareb et al. | Evolutionary autopilot design approach for UAV quadrotor by using GA | |
CN109375642B (zh) | 一种无人机节能控制方法 | |
Zhang et al. | An adaptive neural network approach to the tracking control of micro aerial vehicles in constrained space | |
Deshpande et al. | Robust deep reinforcement learning for quadcopter control | |
Sarabakha et al. | Y6 tricopter autonomous evacuation in an indoor environment using Q-learning algorithm | |
CN113848982A (zh) | 一种四旋翼无人机栖停机动轨迹规划、跟踪控制方法 | |
Mohammed | Quadrotor Control Using Fractional-Order PI^ λ D^ μ Control | |
JP2024102049A (ja) | 相対エントロピーq学習を使ったアクション選択システムのトレーニング | |
CN113985732A (zh) | 针对飞行器系统的自适应神经网络控制方法及装置 | |
Wu et al. | Improved reinforcement learning using stability augmentation with application to quadrotor attitude control | |
Brahim et al. | Finite Time Adaptive SMC for UAV Trajectory Tracking Under Unknown Disturbances and Actuators Constraints | |
Megalingam et al. | Drone stability simulation using ros and gazebo | |
Jokar et al. | Adaptive fuzzy global fast terminal sliding mode control of an over-actuated flying robot | |
Hua et al. | A novel learning-based trajectory generation strategy for a quadrotor | |
Zhou et al. | Nonlinear system identification and trajectory tracking control for a flybarless unmanned helicopter: theory and experiment | |
CN116301007A (zh) | 基于强化学习的多四旋翼无人机集结型任务路径规划方法 | |
Touil et al. | Image-based visual servoing control of a quadcopter air vehicle | |
d’Apolito et al. | Flight control of a multicopter using reinforcement learning | |
Higgins et al. | Implementation of a learning-based explicit reference governor for constrained control of a UAV |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20210608 Address after: Room 613a, building 5, artificial intelligence Industrial Park, 266 Chuangyan Road, Qilin science and Technology Innovation Park, Nanjing, Jiangsu 210000 Patentee after: Nanjing Zhongke ultramicro Computer Technology Co.,Ltd. Address before: Room 1248, 12 / F, research complex building, Institute of computing technology, Chinese Academy of Sciences, No. 6, South Road, Haidian District, Beijing 100086 Patentee before: JEEJIO (BEIJING) TECHNOLOGY Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220803 Address after: Room 1248, 12 / F, research complex building, Institute of computing technology, Chinese Academy of Sciences, No. 6, South Road, Haidian District, Beijing 100086 Patentee after: JEEJIO (BEIJING) TECHNOLOGY Co.,Ltd. Address before: Room 613a, building 5, artificial intelligence Industrial Park, 266 Chuangyan Road, Qilin science and Technology Innovation Park, Nanjing, Jiangsu 210000 Patentee before: Nanjing Zhongke ultramicro Computer Technology Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
CP03 | Change of name, title or address |
Address after: Building 613A, Building 5, Qilin Artificial Intelligence Industrial Park, No. 266 Chuangyan Road, Qilin Technology Innovation Park, Nanjing City, Jiangsu Province, 211135 Patentee after: Zhongke Wuqi (Nanjing) Technology Co.,Ltd. Address before: Room 1248, 12 / F, research complex building, Institute of computing technology, Chinese Academy of Sciences, No. 6, South Road, Haidian District, Beijing 100086 Patentee before: JEEJIO (BEIJING) TECHNOLOGY Co.,Ltd. |
|
CP03 | Change of name, title or address |