CN112488452A - 一种基于深度强化学习的能源系统管理多时间尺度最优决策方法 - Google Patents
一种基于深度强化学习的能源系统管理多时间尺度最优决策方法 Download PDFInfo
- Publication number
- CN112488452A CN112488452A CN202011237161.4A CN202011237161A CN112488452A CN 112488452 A CN112488452 A CN 112488452A CN 202011237161 A CN202011237161 A CN 202011237161A CN 112488452 A CN112488452 A CN 112488452A
- Authority
- CN
- China
- Prior art keywords
- neural network
- artificial neural
- long
- term memory
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002787 reinforcement Effects 0.000 title claims abstract description 37
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000013528 artificial neural network Methods 0.000 claims abstract description 95
- 230000009471 action Effects 0.000 claims abstract description 67
- 238000004146 energy storage Methods 0.000 claims abstract description 20
- 230000007787 long-term memory Effects 0.000 claims abstract description 18
- 230000006403 short-term memory Effects 0.000 claims abstract description 18
- 238000007599 discharging Methods 0.000 claims abstract description 10
- 230000015654 memory Effects 0.000 claims description 76
- 230000006870 function Effects 0.000 claims description 25
- 230000000875 corresponding effect Effects 0.000 claims description 18
- 239000011159 matrix material Substances 0.000 claims description 12
- 238000011478 gradient descent method Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 description 5
- 230000033001 locomotion Effects 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000013178 mathematical model Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010248 power generation Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
- G06F30/27—Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Mathematical Physics (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Entrepreneurship & Innovation (AREA)
- Data Mining & Analysis (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Computer Hardware Design (AREA)
- Geometry (AREA)
- Supply And Distribution Of Alternating Current (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011237161.4A CN112488452B (zh) | 2020-11-06 | 2020-11-06 | 一种基于深度强化学习的能源系统管理多时间尺度最优决策方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011237161.4A CN112488452B (zh) | 2020-11-06 | 2020-11-06 | 一种基于深度强化学习的能源系统管理多时间尺度最优决策方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112488452A true CN112488452A (zh) | 2021-03-12 |
CN112488452B CN112488452B (zh) | 2023-03-31 |
Family
ID=74929113
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011237161.4A Active CN112488452B (zh) | 2020-11-06 | 2020-11-06 | 一种基于深度强化学习的能源系统管理多时间尺度最优决策方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112488452B (zh) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113110052A (zh) * | 2021-04-15 | 2021-07-13 | 浙大宁波理工学院 | 一种基于神经网络和强化学习的混合能量管理方法 |
CN113486698A (zh) * | 2021-04-30 | 2021-10-08 | 华中科技大学 | 一种氢燃料电池工作的识别预测方法、存储介质及系统 |
CN114707711A (zh) * | 2022-03-23 | 2022-07-05 | 特斯联科技集团有限公司 | 园区制冷机组多时间尺度最优调度方法及系统 |
CN115579943A (zh) * | 2022-10-12 | 2023-01-06 | 广州瑞鑫智能制造有限公司 | 基于交流供电和光伏供电互补的空压站供电系统及方法 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108427985A (zh) * | 2018-01-02 | 2018-08-21 | 北京理工大学 | 一种基于深度强化学习的插电式混合动力车辆能量管理方法 |
CN108932671A (zh) * | 2018-06-06 | 2018-12-04 | 上海电力学院 | 一种采用深度q神经网络调参的lstm风电负荷预测方法 |
CN109347149A (zh) * | 2018-09-20 | 2019-02-15 | 国网河南省电力公司电力科学研究院 | 基于深度q值网络强化学习的微电网储能调度方法及装置 |
CN110929948A (zh) * | 2019-11-29 | 2020-03-27 | 上海电力大学 | 基于深度强化学习的完全分布式智能电网经济调度方法 |
CN111547039A (zh) * | 2020-05-13 | 2020-08-18 | 北京理工大学 | 基于深度强化学习的混合动力车辆油门控制方法及系统 |
CN111884213A (zh) * | 2020-07-27 | 2020-11-03 | 国网北京市电力公司 | 一种基于深度强化学习算法的配电网电压调节方法 |
-
2020
- 2020-11-06 CN CN202011237161.4A patent/CN112488452B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108427985A (zh) * | 2018-01-02 | 2018-08-21 | 北京理工大学 | 一种基于深度强化学习的插电式混合动力车辆能量管理方法 |
CN108932671A (zh) * | 2018-06-06 | 2018-12-04 | 上海电力学院 | 一种采用深度q神经网络调参的lstm风电负荷预测方法 |
CN109347149A (zh) * | 2018-09-20 | 2019-02-15 | 国网河南省电力公司电力科学研究院 | 基于深度q值网络强化学习的微电网储能调度方法及装置 |
CN110929948A (zh) * | 2019-11-29 | 2020-03-27 | 上海电力大学 | 基于深度强化学习的完全分布式智能电网经济调度方法 |
CN111547039A (zh) * | 2020-05-13 | 2020-08-18 | 北京理工大学 | 基于深度强化学习的混合动力车辆油门控制方法及系统 |
CN111884213A (zh) * | 2020-07-27 | 2020-11-03 | 国网北京市电力公司 | 一种基于深度强化学习算法的配电网电压调节方法 |
Non-Patent Citations (7)
Title |
---|
VAN-HAI BUI ETAL: "Double Deep Q-Learning-Based Distributed Operation of Battery Energy Storage System Considering Uncertainties", 《IEEE》 * |
YUANKUN LIU ETAL: "Optimization Strategy Based on Deep Reinforcement Learning for Home Energy Management", 《CSEE JOURNAL OF POWER AND ENERGY SYSTEMS》 * |
刘威等: "基于深度强化学习的电网紧急控制策略研究", 《中国电机工程学报》 * |
张宇帆等: "基于深度长短时记忆网络的区域级超短期负荷预测方法", 《电网技术》 * |
张自东: "基于深度强化学习的微电网复合储能协调控制方法", 《电网技术》 * |
成庶等: "镉镍蓄电池寿命预测的PF-LSTM建模方法研究", 《铁道科学与工程学报》 * |
易灵芝等: "基于EEMD-GSGRU的锂电池寿命预测", 《储能科学与技术》 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113110052A (zh) * | 2021-04-15 | 2021-07-13 | 浙大宁波理工学院 | 一种基于神经网络和强化学习的混合能量管理方法 |
CN113110052B (zh) * | 2021-04-15 | 2022-07-26 | 浙大宁波理工学院 | 一种基于神经网络和强化学习的混合能量管理方法 |
CN113486698A (zh) * | 2021-04-30 | 2021-10-08 | 华中科技大学 | 一种氢燃料电池工作的识别预测方法、存储介质及系统 |
CN113486698B (zh) * | 2021-04-30 | 2023-09-26 | 华中科技大学 | 一种氢燃料电池工作的识别预测方法、存储介质及系统 |
CN114707711A (zh) * | 2022-03-23 | 2022-07-05 | 特斯联科技集团有限公司 | 园区制冷机组多时间尺度最优调度方法及系统 |
CN115579943A (zh) * | 2022-10-12 | 2023-01-06 | 广州瑞鑫智能制造有限公司 | 基于交流供电和光伏供电互补的空压站供电系统及方法 |
Also Published As
Publication number | Publication date |
---|---|
CN112488452B (zh) | 2023-03-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112488452B (zh) | 一种基于深度强化学习的能源系统管理多时间尺度最优决策方法 | |
CN111884213B (zh) | 一种基于深度强化学习算法的配电网电压调节方法 | |
CN109102126B (zh) | 一种基于深度迁移学习的理论线损率预测模型 | |
Wang et al. | Water quality prediction method based on LSTM neural network | |
Marino et al. | Building energy load forecasting using deep neural networks | |
WO2018161722A1 (zh) | 基于长短时记忆神经网络的电力负荷预测方法 | |
CN107563539A (zh) | 基于机器学习模型的短期和中长期电力负荷预测方法 | |
CN104217258B (zh) | 一种电力负荷条件密度预测方法 | |
CN116345578B (zh) | 基于深度确定性策略梯度的微电网运行优化调度方法 | |
CN109214565A (zh) | 一种适用于大电网分区调度的子区域系统负荷预测方法 | |
Dolatabadi et al. | Deep reinforcement learning-based self-scheduling strategy for a CAES-PV system using accurate sky images-based forecasting | |
El Bourakadi et al. | Multi-agent system based sequential energy management strategy for Micro-Grid using optimal weighted regularized extreme learning machine and decision tree | |
CN115377985A (zh) | 一种电网发电机组调度优化方法 | |
CN116207739A (zh) | 配电网优化调度方法、装置、计算机设备和存储介质 | |
Al-Hajj et al. | Multi-level stacking of long short term memory recurrent models for time series forecasting of solar radiation | |
CN114861980A (zh) | 一种基于bp-lstm模型的碳预测方法 | |
CN111799820B (zh) | 一种电力系统双层智能混合零星云储能对抗调控方法 | |
US20150097531A1 (en) | System and method for controlling networked, grid-level energy storage devices | |
CN116822722A (zh) | 水位预测方法、系统、装置、电子设备及介质 | |
Wilms et al. | On the necessity of exogenous variables for load, pv and wind day-ahead forecasts using recurrent neural networks | |
Xu et al. | Short-term electricity consumption forecasting method for residential users based on cluster classification and backpropagation neural network | |
CN112101651B (zh) | 电能源网络协调控制方法、系统及信息数据处理终端 | |
Mahto et al. | MPGCN-OPF: A message passing graph convolution approach for optimal power flow for distribution network | |
Mohammadi et al. | A Deep Learning‐to‐learning Based Control system for renewable microgrids | |
CN117220318B (zh) | 电网数字化驱动控制方法及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20221205 Address after: 300384 No. 6 Huake No. 7 Road, Binhai New Area, Tianjin Binhai High-tech Industrial Development Zone Applicant after: CETC Energy Co.,Ltd. Applicant after: Tianjin University Address before: 300384 No. 6 Huake No. 7 Road, Binhai New Area, Tianjin Binhai High-tech Industrial Development Zone Applicant before: The 18th Research Institute of China Electronics Technology Group Corporation Applicant before: Tianjin University |
|
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 300384 No. 6 Huake No. 7 Road, Binhai New Area, Tianjin Binhai High-tech Industrial Development Zone Applicant after: CETC Blue Sky Technology Co.,Ltd. Applicant after: Tianjin University Address before: 300384 No. 6 Huake No. 7 Road, Binhai New Area, Tianjin Binhai High-tech Industrial Development Zone Applicant before: CETC Energy Co.,Ltd. Applicant before: Tianjin University |
|
GR01 | Patent grant | ||
GR01 | Patent grant |