CN111950873A - 基于深度强化学习的卫星实时引导任务规划方法及系统 - Google Patents
基于深度强化学习的卫星实时引导任务规划方法及系统 Download PDFInfo
- Publication number
- CN111950873A CN111950873A CN202010754302.3A CN202010754302A CN111950873A CN 111950873 A CN111950873 A CN 111950873A CN 202010754302 A CN202010754302 A CN 202010754302A CN 111950873 A CN111950873 A CN 111950873A
- Authority
- CN
- China
- Prior art keywords
- satellite
- time
- task planning
- target
- training
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Biophysics (AREA)
- Mathematical Physics (AREA)
- Biomedical Technology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computational Linguistics (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Game Theory and Decision Science (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Image Analysis (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010754302.3A CN111950873B (zh) | 2020-07-30 | 2020-07-30 | 基于深度强化学习的卫星实时引导任务规划方法及系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010754302.3A CN111950873B (zh) | 2020-07-30 | 2020-07-30 | 基于深度强化学习的卫星实时引导任务规划方法及系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111950873A true CN111950873A (zh) | 2020-11-17 |
CN111950873B CN111950873B (zh) | 2022-11-15 |
Family
ID=73338795
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010754302.3A Active CN111950873B (zh) | 2020-07-30 | 2020-07-30 | 基于深度强化学习的卫星实时引导任务规划方法及系统 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111950873B (zh) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112507614A (zh) * | 2020-12-01 | 2021-03-16 | 广东电网有限责任公司中山供电局 | 一种分布式电源高渗透率地区电网综合优化方法 |
CN113342054A (zh) * | 2021-06-29 | 2021-09-03 | 哈尔滨工业大学 | 利用深度强化学习的可变构航天器在轨自变构规划方法 |
CN113514866A (zh) * | 2021-04-19 | 2021-10-19 | 中国科学院微小卫星创新研究院 | 在轨伽马射线暴观测方法 |
CN114040447A (zh) * | 2021-10-19 | 2022-02-11 | 中国电子科技集团公司第五十四研究所 | 一种面向大速率星地链路通信业务智能流量负载均衡方法 |
CN114676471A (zh) * | 2022-04-21 | 2022-06-28 | 北京航天飞行控制中心 | 火星车的任务规划模型建立方法、装置、电子设备及介质 |
CN114978295A (zh) * | 2022-07-29 | 2022-08-30 | 中国人民解放军战略支援部队航天工程大学 | 一种面向卫星互联网的跨层抗干扰方法和系统 |
CN115021799A (zh) * | 2022-07-11 | 2022-09-06 | 北京理工大学 | 一种基于多智能体协同的低轨卫星切换方法 |
CN115509247A (zh) * | 2022-10-08 | 2022-12-23 | 北京理工大学 | 适用于强化学习的小天体着陆器动态目标规划训练方法 |
CN116307241A (zh) * | 2023-04-04 | 2023-06-23 | 暨南大学 | 基于带约束多智能体强化学习的分布式作业车间调度方法 |
CN117237816A (zh) * | 2023-08-15 | 2023-12-15 | 哈尔滨工程大学 | 一种面向星群遥感的海量需求时空统筹方法及其统筹系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170032245A1 (en) * | 2015-07-01 | 2017-02-02 | The Board Of Trustees Of The Leland Stanford Junior University | Systems and Methods for Providing Reinforcement Learning in a Deep Learning System |
CN110673637A (zh) * | 2019-10-08 | 2020-01-10 | 福建工程学院 | 一种基于深度强化学习的无人机伪路径规划的方法 |
CN110958680A (zh) * | 2019-12-09 | 2020-04-03 | 长江师范学院 | 面向能量效率的无人机群多智能体深度强化学习优化方法 |
-
2020
- 2020-07-30 CN CN202010754302.3A patent/CN111950873B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170032245A1 (en) * | 2015-07-01 | 2017-02-02 | The Board Of Trustees Of The Leland Stanford Junior University | Systems and Methods for Providing Reinforcement Learning in a Deep Learning System |
CN110673637A (zh) * | 2019-10-08 | 2020-01-10 | 福建工程学院 | 一种基于深度强化学习的无人机伪路径规划的方法 |
CN110958680A (zh) * | 2019-12-09 | 2020-04-03 | 长江师范学院 | 面向能量效率的无人机群多智能体深度强化学习优化方法 |
Non-Patent Citations (3)
Title |
---|
伍国威: "在轨实时引导多星成像任务规划方法研究", 《航天器工程》 * |
康绮等: "《机器学习中的不平衡分类方法》", 31 October 2017 * |
许瀚: "基于深度强化学习算法的卫星姿态控制算法研究", 《中国优秀博硕士学位论文全文数据库(硕士) 工程科技Ⅱ辑》 * |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112507614A (zh) * | 2020-12-01 | 2021-03-16 | 广东电网有限责任公司中山供电局 | 一种分布式电源高渗透率地区电网综合优化方法 |
CN113514866A (zh) * | 2021-04-19 | 2021-10-19 | 中国科学院微小卫星创新研究院 | 在轨伽马射线暴观测方法 |
CN113514866B (zh) * | 2021-04-19 | 2023-04-21 | 中国科学院微小卫星创新研究院 | 在轨伽马射线暴观测方法 |
CN113342054A (zh) * | 2021-06-29 | 2021-09-03 | 哈尔滨工业大学 | 利用深度强化学习的可变构航天器在轨自变构规划方法 |
CN114040447A (zh) * | 2021-10-19 | 2022-02-11 | 中国电子科技集团公司第五十四研究所 | 一种面向大速率星地链路通信业务智能流量负载均衡方法 |
CN114040447B (zh) * | 2021-10-19 | 2024-08-23 | 中国电子科技集团公司第五十四研究所 | 一种面向大速率星地链路通信业务智能流量负载均衡方法 |
CN114676471A (zh) * | 2022-04-21 | 2022-06-28 | 北京航天飞行控制中心 | 火星车的任务规划模型建立方法、装置、电子设备及介质 |
CN114676471B (zh) * | 2022-04-21 | 2022-09-13 | 北京航天飞行控制中心 | 火星车的任务规划模型建立方法、装置、电子设备及介质 |
CN115021799B (zh) * | 2022-07-11 | 2023-03-10 | 北京理工大学 | 一种基于多智能体协同的低轨卫星切换方法 |
CN115021799A (zh) * | 2022-07-11 | 2022-09-06 | 北京理工大学 | 一种基于多智能体协同的低轨卫星切换方法 |
CN114978295B (zh) * | 2022-07-29 | 2022-10-21 | 中国人民解放军战略支援部队航天工程大学 | 一种面向卫星互联网的跨层抗干扰方法和系统 |
CN114978295A (zh) * | 2022-07-29 | 2022-08-30 | 中国人民解放军战略支援部队航天工程大学 | 一种面向卫星互联网的跨层抗干扰方法和系统 |
CN115509247A (zh) * | 2022-10-08 | 2022-12-23 | 北京理工大学 | 适用于强化学习的小天体着陆器动态目标规划训练方法 |
CN116307241A (zh) * | 2023-04-04 | 2023-06-23 | 暨南大学 | 基于带约束多智能体强化学习的分布式作业车间调度方法 |
CN116307241B (zh) * | 2023-04-04 | 2024-01-05 | 暨南大学 | 基于带约束多智能体强化学习的分布式作业车间调度方法 |
CN117237816A (zh) * | 2023-08-15 | 2023-12-15 | 哈尔滨工程大学 | 一种面向星群遥感的海量需求时空统筹方法及其统筹系统 |
CN117237816B (zh) * | 2023-08-15 | 2024-07-30 | 哈尔滨工程大学 | 一种面向星群遥感的海量需求时空统筹方法及其统筹系统 |
Also Published As
Publication number | Publication date |
---|---|
CN111950873B (zh) | 2022-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111950873B (zh) | 基于深度强化学习的卫星实时引导任务规划方法及系统 | |
CN109933086B (zh) | 基于深度q学习的无人机环境感知与自主避障方法 | |
CN107169608B (zh) | 多无人机执行多任务的分配方法及装置 | |
CN109917818B (zh) | 基于地面机器人的协同搜索围堵方法 | |
Chakravarty et al. | CNN-based single image obstacle avoidance on a quadrotor | |
CN110874578B (zh) | 一种基于强化学习的无人机视角车辆识别追踪方法 | |
CN107103164B (zh) | 无人机执行多任务的分配方法及装置 | |
CN111982137B (zh) | 生成路线规划模型的方法、装置、设备和存储介质 | |
Scorsoglio et al. | Image-based deep reinforcement learning for autonomous lunar landing | |
EP3568810A1 (en) | Action selection for reinforcement learning using neural networks | |
CN111024080A (zh) | 一种无人机群对多移动时敏目标侦察路径规划方法 | |
CN114089776B (zh) | 一种基于深度强化学习的无人机避障方法 | |
CN116242364A (zh) | 一种基于深度强化学习的多无人机智能导航方法 | |
Fu et al. | Memory-enhanced deep reinforcement learning for UAV navigation in 3D environment | |
Wu et al. | Multi-phase trajectory optimization for an aerial-aquatic vehicle considering the influence of navigation error | |
Montella et al. | Reinforcement learning for autonomous dynamic soaring in shear winds | |
Kushleyev et al. | Planning for landing site selection in the aerial supply delivery | |
Yue et al. | A new search scheme using multi‐bee‐colony elite learning method for unmanned aerial vehicles in unknown environments | |
Lehman et al. | Addressing undesirable emergent behavior in deep reinforcement learning uas ground target tracking | |
CN116203987A (zh) | 一种基于深度强化学习的无人机集群协同避障方法 | |
CN115542947A (zh) | 一种四旋翼无人机的自主导航方法及无人机装置 | |
CN117136343A (zh) | 用于平衡自动感应交通工具的能源探测和观测时间的系统 | |
Le Floch et al. | Trajectory planning for autonomous parafoils in complex terrain | |
Hu et al. | A lunar robot obstacle avoidance planning method using deep reinforcement learning for data fusion | |
Niaraki et al. | Visual exploration and energy-aware path planning via reinforcement learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information | ||
CB03 | Change of inventor or designer information |
Inventor after: Chen Zhansheng Inventor after: Wu Guowei Inventor after: Cui Benjie Inventor after: Qu Yaobin Inventor after: Qian Feng Inventor after: Yang Yong Inventor after: Tong Qingwei Inventor after: Cao Anjie Inventor after: Deng Wudong Inventor before: Wu Guowei Inventor before: Cui Benjie Inventor before: Qu Yaobin Inventor before: Qian Feng Inventor before: Yang Yong Inventor before: Tong Qingwei Inventor before: Cao Anjie Inventor before: Deng Wudong |
|
GR01 | Patent grant | ||
GR01 | Patent grant |