CN115526684A - Multi-agent low-carbon economic operation method for integrated energy system based on double-layer master-slave game - Google Patents

Abstract

The multi-agent low-carbon economic operation method of the integrated energy system based on the double-layer master-slave game includes the following steps: constructing an integrated energy system trading mechanism that considers ladder-type carbon trading; building an integrated energy system based on energy storage configured by the energy system operator ESO Structure; Based on the master-slave game theory, a two-layer master-slave game model of power generator-energy system operator-(energy producer, load aggregator) is established. The method proposed in the present invention can give full play to the active decision-making ability of each subject, promote the balance of interests of each subject, and realize the low-carbon and economical operation of the comprehensive energy system.

Description

Multi-agent low-carbon economic operation method for integrated energy system based on double-layer master-slave game

technical field

The invention belongs to the technical field of economic operation of an integrated energy system, and in particular relates to a multi-agent low-carbon economic operation method of an integrated energy system based on a double-layer master-slave game.

Background technique

With the increasing demand for energy in our country and the proposal of the "dual carbon" strategic goal, economy and low carbon have become the trend of future energy development. In this context, IES, which has the characteristics of multi-energy coupling and joint scheduling, has become an important form of efficient and clean energy utilization. How to further explore the potential of IES low-carbon economic operation is a topic worthy of further study.

After searching the existing technical literature, it is found that the literature [1]: "Considering the Stepped Carbon Trading Mechanism and Electric Hydrogen Integrated Energy System Thermoelectric Optimization" (Chen Jinpeng, Hu Zhijian, Chen Yingguang, etc. Considering the stepping carbon trading mechanism and electricity Thermoelectric optimization of integrated energy system for hydrogen production [J]. Electric Power Automation Equipment, 2021, 41(9): 48-54.) Constructed an IES decentralized scheduling model considering the cost of carbon trading, and aimed at the shortcomings of traditional carbon trading mechanisms, constructed In order to consider the IES low-carbon economic optimization model of ladder-type carbon trading, the economic and environmental benefits of IES are effectively played. However, the above literature [1] ignores the impact of demand-side elastic load on system optimization, and fails to fully utilize the ability of integrated demand response (Integrated Demand Response, IDR) resources to participate in low-carbon and economic regulation.

Literature [2]: "Distributed collaborative optimization operation strategy of community comprehensive energy system based on master-slave game" (Wang Haiyang, Li Ke, Zhang Chenghui, etc. Distributed collaborative optimization operation strategy of community comprehensive energy system based on master-slave game[J ]. Chinese Journal of Electrical Engineering, 2020, 40(17): 5435-5444.) Constructed a distributed IES optimization strategy with ESO as the leader and EP and LA as followers, which improves the supply and demand side benefits at the same time . However, ESO only guides the supply and demand side to participate in IDR through price signals, and lacks the ability to regulate the energy supply and demand balance of IES, which may cause supply and demand imbalances.

Literature [3]: "Multi-agent Non-cooperative Game Competition Model in Power Market Based on Berge-NS Equilibrium" (Ma Tiannan, Du Ying, Gou Quanfeng, et al. Multi-Agent Non-cooperative Game Competition Model in Power Market Based on Berge-NS Equilibrium[J ].Electric Power Automation Equipment, 2019,39(06):192-204.) studied the game competition of multiple subjects under the reform of the electricity market, and realized the win-win and coordinated development of multiple subjects. Literature [4]: "Bilateral contract transaction model between power generators and large users based on master-slave game" (Wu Cheng, Gao Bingtuan, Tang Yi, etc. Bilateral contract transaction model between power generators and large users based on master-slave game[J]. Electric Power System Automation, 2016, 40(22):56-62.) Based on bilateral contract transactions, a game model between multiple PPs and multiple large users is constructed, which provides an effective basis for game participants to formulate contract electricity prices.

However, the above literatures only focus on the research on the direct purchase of electricity by traditional large power users and PP, and have not yet involved the research on the direct purchase of IES that includes multiple energy flows and has a large demand for electricity.

Contents of the invention

In order to solve the above-mentioned technical problems, the present invention provides a multi-agent low-carbon economic operation method of an integrated energy system based on a double-layer master-slave game, which can give full play to the active decision-making ability of each subject, promote the balance of interests of each subject, and realize the integrated energy system IES low-carbon, economical operation.

The technical scheme that the present invention takes is:

The multi-agent low-carbon economic operation method of the comprehensive energy system based on the double-layer master-slave game includes the following steps:

Step 1: Build an integrated energy system trading mechanism that considers step-by-step carbon trading;

Step 2: Construct the basic structure of an integrated energy system configured with energy storage by the energy system operator ESO;

Step 3: Based on the master-slave game theory, establish a two-layer master-slave game model of power generator-energy system operator-energy producer and load aggregator.

In the step 1, the carbon emissions in the integrated energy system (Integrated Energy System, IES) mainly come from the upper-level power purchase and the energy supply equipment in the energy producer (Energy Producer, EP), according to the production capacity of the EP and the operation of the energy system The energy system operator (ESO) purchases electricity, and builds a ladder-type carbon trading model for EP and ESO.

The step-by-step carbon trading model of EP and ESO is as follows:

The carbon emissions in IES mainly come from the power purchase at the upper level and the energy supply equipment in the EP, and the carbon transaction cost of the power purchase at the upper level is borne by the ESO. The present invention constructs a ladder-type carbon trading mechanism, divides the intervals according to the amount of carbon emissions, and the carbon trading price increases with the increase of the amount of carbon emissions.

为阶梯型碳交易成本；E为碳排放量；c_c为碳交易价格；l为碳排放量区间长度；ω为增长系数。in,

E is the carbon emission amount; c _c is the carbon transaction price; l is the length of the carbon emission interval; ω is the growth coefficient.

In the step 2, the integrated energy system IES is divided into the energy system operator ESO, the energy producer EP and the load aggregator (Load Aggregator, LA), which interacts with the power producer (Power Producer, PP) externally, so that Ensure the reliability of energy supply. Among them, the energy system operator ESO has further enhanced the ability to regulate the operation of the integrated energy system IES by configuring energy storage equipment.

The ESO model of the energy system operator with energy storage is:

分别为ESO售能收益、购能费用、碳交易成本；C_sell为PP售电收益；C_ESO,om为储能的运行维护成本；

分别为ESO制定的购、售能价格；

分别为储电、储热装置的充电、充热功率；k_ESO为储能的运行维护成本系数；t表示时刻。Among them, f _ESO is the objective function of ESO; C _ESO,s , C _ESO,b ,

Respectively, ESO energy sales income, energy purchase fee, carbon transaction cost; C _sell is PP electricity sales income; C _ESO,om is the operation and maintenance cost of energy storage;

The purchase and sale price of energy respectively formulated for ESO;

are the charging and heating power of electricity storage and heat storage devices respectively; k _ESO is the operation and maintenance cost coefficient of energy storage; t is the time.

The configuration of energy storage enables the energy system operator ESO to coordinate the supply and demand balance of electricity and heat by adjusting the charging and discharging power of electricity storage and heat storage devices, namely:

为EP的输出功率；

为ESO向上级购电量；

为储电装置的充能功率，

为储电装置的放能功率，

为储热装置的充能功率，

为储热装置的放能功率；Among them, i∈(e,h,c) are electricity, heat, and cold energy respectively;

is the output power of EP;

Purchase electricity from superiors for ESO;

is the charging power of the power storage device,

is the discharge power of the storage device,

is the charging power of the heat storage device,

is the energy discharge power of the heat storage device;

为用户需求响应后的电负荷功率，

为用户需求响应后的热负荷功率，

为用户需求响应后的冷负荷功率。

is the electric load power after user demand response,

is the thermal load power after user demand response,

Cooling load power after user demand response.

In the step 3, the two-layer master-slave game proposed in the present invention describes the decision-making process among PP, ESO, EP and LA in pursuit of maximizing their respective benefits. In the two-layer master-slave game model, the energy system operator ESO is in the middle position connecting the power generation company PP, the energy producer EP, and the load aggregator LA, and can coordinate the balance of system supply and demand;

In the upper-level game, the energy system operator ESO acts as a follower of the power producer PP (leader), forming a master-slave game;

In the lower-level game, the energy system operator ESO, as the leader of the energy producer EP and the load aggregator LA (follower), constitutes a master-multiple-slave game. During the transaction process, PP's electricity sales price strategy will affect ESO's purchase of electricity from PP; at the same time, the IES internal energy purchase and sales price strategy formulated by ESO will affect EP's energy sales strategy and LA's demand response strategy. On the contrary, the change of EP energy sales strategy and LA demand response strategy will cause ESO to readjust the internal energy purchase and sale price strategy and the electricity purchase strategy from PP, which will further affect PP's electricity price adjustment strategy.

The above-mentioned energy transaction process conforms to the dynamic game characteristics of the master-slave hierarchical structure. Each subject realizes the balance of interests among each other by constantly updating its own strategy, and obtains a game equilibrium solution, so as to solve the conflict of interests of each subject and realize the balance of interests of multiple subjects.

In the step 3, the two-layer master-slave game model is expressed as:

The two-layer master-slave game model includes the basic elements of the master-slave game: game participants, decision variables, and utility functions; among them, the game participants are power generator PP, energy system operator ESO, energy producer EP and load aggregator LA; the decision variables are PP power sales price S _PP , ESO power purchase and energy purchase price S _ESO , EP sales energy S _EP , LA actual load S _LA ; the utility function of the game is the objective function of each subject, namely f _PP , f _ESO , {f _EP ,f _LA }.

Construct the carbon quota model of each subject, the actual carbon emission model and the carbon trading cost model, the three constitute a ladder carbon trading model, and cooperate with the ladder carbon trading model and comprehensive demand response to limit the carbon emissions of the integrated energy system IES .

The objective function of each subject is as follows:

(1) Generator PP revenue model:

The power generation company PP guides the energy system operator ESO to purchase electricity flexibly by formulating the electricity sales price, and reduces the cost of the energy system operator ESO to compensate for the shortage of resources while improving its own benefits. The power generation company PP aims to maximize the profit, and its objective function is:

f _PP ＝C _sell -C _PP

Among them, C _sell and C _PP are the power sales revenue and operating cost of the power generator _PP respectively; _{ρ s} is the power sales price of the power generator PP; c _m is the coefficient of the constant term of the generating function of the unit.

(2) ESO revenue model for energy system operators:

After the introduction of energy storage, the ESO revenue model of energy system operators is:

(3) EP revenue model for energy producers:

Energy producer EP adjusts unit output according to the energy purchase price set by ESO to maximize its own benefits. The objective function is:

为EP的碳交易成本；

分别为燃气轮机(Gas Turbine，GT)、燃气锅炉(Gas Boiler，GB)的输出功率；a_e为GT运行成本函数的二次项系数，b_e为GT运行成本函数的一次项系数，c_e为GT运行成本函数的常数项系数，a_h为GB运行成本函数的二次项系数，b_h为GB运行成本函数的一次项系数，c_h为GB运行成本函数的常数项系数。Among them, C _EP is the operating cost of the EP unit;

is the carbon trading cost of EP;

are the output power of Gas Turbine (GT) and Gas Boiler (GB), respectively; a _e is the quadratic term coefficient of GT operating cost function, b _e is the first term coefficient of GT operating cost function, c _e is The coefficient of the constant term of the GT operating cost function, a _h is the coefficient of the quadratic term of the GB operating cost function, b _h is the coefficient of the first term of the GB operating cost function, and _ch is the coefficient of the constant term of the GB operating cost function.

(4) LA income model of load aggregator:

Considering the energy utility and cost of the load aggregator LA, the load aggregator LA takes the maximum utility as its goal, and its objective function is:

f _LA ＝C _LA -C _ESO,s

为LA需求响应后的实际负荷功率。Among them, C _LA is the LA energy utility; α _i is the coefficient of the first-order item of the LA energy preference function, and β _i is the quadratic item coefficient of the LA energy preference function;

is the actual load power after LA demand response.

The present invention is a multi-agent low-carbon economic operation method of an integrated energy system based on a double-layer master-slave game, and the technical effects are as follows:

1) Step 1 of the present invention considers a ladder-type carbon trading mechanism while constructing an integrated energy system trading mechanism. Different from the traditional carbon trading mechanism, the ladder-type carbon trading mechanism is divided into intervals according to carbon emissions, and the carbon trading price increases with the increase of carbon emissions. Therefore, the comprehensive energy system trading mechanism that considers the ladder type carbon trading constructed by the present invention can effectively limit the carbon emission of the system.

2) Different from the traditional IES structure, the energy storage in the basic structure of the IES built in Step 2 of the present invention is configured by the ESO, so that the ESO can improve coordination by adjusting the charging and discharging power of the power storage device and the heat storage device The flexibility of electric heat supply and demand balance. Therefore, the basic structure of IES constructed by the present invention can simultaneously improve the ability and economy of ESO to adjust the balance between supply and demand of IES.

3) In the current research on IES economic operation based on game theory, there is little mention of PP and IES direct purchase of electricity. ESO only guides the supply and demand sides to participate in comprehensive demand response through price signals, and lacks the ability to regulate the balance of IES energy supply and demand. The benefit form is single. In the two-layer master-slave game model built in step 3 of the present invention, PP, ESO, EP and LA can formulate trading strategies according to their own benefits, coordinate the operation of internal equipment, thereby satisfying the balance between supply and demand, and exert the active decision-making ability of PP and IES for market transactions .

Description of drawings

Fig. 1 is a flow chart of the low-carbon economic operation method proposed by the present invention.

Figure 2 is a balance diagram of electric power supply and demand.

Figure 3 is a thermal power supply and demand balance diagram.

Figure 4 is a cooling power supply and demand balance diagram.

detailed description

Multi-agent low-carbon economic operation method of comprehensive energy system based on double-layer master-slave game. First, in order to reduce the carbon emissions of the integrated energy system, this method constructs an integrated energy system trading mechanism that considers step-by-step carbon trading. Secondly, in order to enhance the ability and benefits of energy system operators to participate in system regulation, this method constructs the basic structure of an integrated energy system in which energy storage is configured by energy system operators. Finally, based on the master-slave game theory, this method establishes a two-layer master-slave game model of power generators—energy system operators—(energy producers, load aggregators), so as to give full play to the initiative of power generators and integrated energy systems in market transactions. Decision-making capacity. The method proposed in the present invention can give full play to the active decision-making ability of each subject, promote the balance of interests of each subject, and realize the low-carbon and economical operation of the comprehensive energy system. As shown in Figure 1, the following steps are included:

Step 1: Build an integrated energy system trading mechanism that considers step-by-step carbon trading;

Step 2: Construct the basic structure of an integrated energy system configured with energy storage by the energy system operator ESO;

Step 3: Based on the master-slave game theory, establish a two-layer master-slave game model of power generator-energy system operator-(energy producer, load aggregator).

Fig. 1 is a flow chart of the low-carbon economic operation method proposed by the present invention. First, construct an IES trading mechanism that considers ladder-type carbon trading. Then, construct the basic structure of IES configured by ESO for energy storage. Afterwards, a multi-agent low-carbon economic interaction mechanism and model based on a two-layer master-slave game is established. In the two-layer master-slave game: ESO, as the follower of PP (leader), constitutes an upper layer game of one master and one slave; ESO, as the leader of EP and LA (follower), constitutes a lower layer game of one master and multiple slaves. Finally, each subject constantly updates its own strategy, obtains the game equilibrium solution, and realizes the multi-subject benefit balance.

Figure 2 is a balance diagram of electric power supply and demand. It can be seen from Figure 2 that during the period of 1:00-7:00 and 24:00, the load electric energy is completely provided by EP. On the one hand, the electric power is used for cooling by the electric refrigerator (Electric Refrigerator, ER), and on the other hand, it is purchased by the ESO and stored in the electric storage device. From 8:00 to 23:00, the electric power sold by EP does not meet the demand of electric load, and the shortfall power is made up by ESO's power storage equipment and ESO's purchase of power from PP. The main reason is that GT is affected by the actual output model of the unit and the power supply capacity of other main bodies, and adjusts its own output within an economic range to achieve stable GT operation. At the same time, while ESO plays a regulatory role, it also basically realizes the "low charge and high discharge" of electricity storage.

Figure 3 is a thermal power supply and demand balance diagram. Figure 3 shows that the main sources of thermal power in the system are the waste heat boiler (WHB) and the output of the GB unit, and the output fluctuations of the two are stable. The main reason is that it is most economical within this output range due to the influence of the actual unit output model. With the assistance of heat storage equipment in ESO, WHB and GB units in EP can flexibly adjust output to achieve economical operation. At the same time, ESO's heat storage equipment mainly releases heat from 11:00 to 13:00, and recharges from 21:00 to 24, which reflects the profit-making characteristics of ESO's "low charge and high discharge" of heat storage equipment.

Figure 4 is a cooling power supply and demand balance diagram. It can be seen from Figure 4 that EP prefers ER to output cooling power, the main reason is that ER cooling efficiency is higher and more economical. However, from 7:00 to 22:00, the maximum output of ER can no longer meet the demand of cooling load. At this time, the absorption refrigerator (Absorption Refrigerator, AR) contributes to make up for the cooling power shortage.

Comprehensive analysis of Figure 2, Figure 3, and Figure 4 shows that the output of renewable energy in the system has been fully utilized, and at the same time, through the cooperation of various energy supply equipment and purchased electric energy, the system load demand is effectively and economically met.

Table 1 Running results under different schemes

Table 1 shows the running results under different schemes. In order to verify the economy and low-carbon performance of the proposed method of the present invention, 4 schemes are set for comparative analysis:

Option 1 is not considering PP to participate in the game, considering ESO to configure energy storage, load demand response and carbon trading mechanism;

Scheme 2 considers the two-tier master-slave game, load demand response and carbon trading mechanism, and does not consider ESO to configure energy storage;

Scheme 3 does not consider load demand response (no game in the system), and considers ESO to configure energy storage and carbon trading mechanisms;

Scheme 4 is the strategy proposed by the present invention.

Comparing Scheme 1 and Scheme 4, PP in Scheme 1 sells electricity at the basic electricity price, which is lower, resulting in a reduction of 363 yuan in revenue. At the same time, the lower electricity price of PP further depresses the energy purchase price set by ESO, resulting in a reduction of EP revenue by 607 yuan. Option 4 can give full play to the active decision-making ability of PP to participate in the bidding, which is conducive to balancing the interests of various subjects and promoting the continuous cooperation between supply and demand subjects.

A comprehensive analysis of Scheme 2 and Scheme 4 shows that in Scheme 2, ESO does not have energy storage equipment, and only adjusts the supply and demand relationship of the system through price strategies, and cannot satisfy the EP unit output within the economical operating range through the energy storage margin, and at the same time increases the demand for PP. electricity purchase. The comprehensive change of the income of each subject in Scheme 2 is worse than that of Scheme 4, and the total carbon emission of the system has increased by 1057kg, which does not conform to the low-carbon concept. Compared with Scheme 4, the income of ESO increased by 288 yuan, the income of EP decreased by 1346 yuan, the income of LA decreased by 1467 yuan, and the total carbon emission increased by 1286kg. Obviously, Scheme 4 is more economical and low-carbon. In summary, the strategy proposed in the present invention has the advantages of economy and low carbon in each scheme, and can realize the balance of interests of each subject.

Claims (5)

1. The multi-agent low-carbon economic operation method of the comprehensive energy system based on the double-layer master-slave game is characterized in that it comprises the following steps: Step 1: Build an integrated energy system trading mechanism that considers step-by-step carbon trading; Step 2: Construct the basic structure of an integrated energy system configured with energy storage by the energy system operator ESO; Step 3: Based on the master-slave game theory, establish a two-layer master-slave game model based on power generators, energy system operators, energy producers, and load aggregators. 2. According to the multi-agent low-carbon economic operation method of the integrated energy system based on the double-layer master-slave game of claim 1, it is characterized in that: in the step 1, the carbon emissions in the integrated energy system IES mainly come from the power purchase and The energy supply equipment in the energy producer EP, according to the production capacity of the EP and the purchase power of the energy system operator ESO, builds a ladder carbon trading model for EP and ESO. 3. According to the multi-agent low-carbon economic operation method of the integrated energy system based on the double-layer master-slave game of claim 1, it is characterized in that: in the step 2, the integrated energy system IES is divided into energy system operators ESO, energy The producer EP and the load aggregator LA interact with the power producer PP externally; The ESO model of the energy system operator with energy storage is:

Among them, f _ESO is the objective function of ESO; C _ESO,s , C _ESO,b ,

Respectively, ESO energy sales income, energy purchase fee, carbon transaction cost; C _sell is PP electricity sales income; C _ESO,om is the operation and maintenance cost of energy storage;

The purchase and sale price of energy respectively formulated for ESO;

are the charging and heating power of electricity storage and heat storage devices respectively; k _ESO is the operation and maintenance cost coefficient of energy storage; t is the time; The configuration of energy storage enables the energy system operator ESO to coordinate the supply and demand balance of electricity and heat by adjusting the charging and discharging power of electricity storage and heat storage devices, namely:

Among them, i∈(e,h,c) are electricity, heat, and cold energy respectively;

is the output power of EP;

Purchase electricity from superiors for ESO;

is the charging power of the power storage device,

is the discharge power of the storage device,

is the charging power of the heat storage device,

is the energy discharge power of the heat storage device;

is the electric load power after user demand response,

is the thermal load power after user demand response,

Cooling load power after user demand response. 4. According to the multi-agent low-carbon economic operation method of the integrated energy system based on the double-layer master-slave game of claim 1, it is characterized in that: in the step 3, in the double-layer master-slave game model, the energy system operator ESO It is in the middle of contacting the power generation company PP, the energy producer EP, and the load aggregator LA, and can coordinate the balance of supply and demand in the system; In the upper-level game, the energy system operator ESO, as the follower of the power generation company PP, constitutes a master-slave game; in the lower-level game, the energy system operator ESO, as the leader of the energy producer EP and the load aggregator LA, constitutes a One master and many slaves game. 5. According to the multi-agent low-carbon economic operation method of the integrated energy system based on the double-layer master-slave game of claim 1, it is characterized in that: in the step 3, the double-layer master-slave game model is expressed as:

The two-layer master-slave game model includes the basic elements of the master-slave game: game participants, decision variables, and utility functions; among them, the game participants are power generator PP, energy system operator ESO, energy producer EP and load aggregator LA; the decision variables are PP power sales price S _PP , ESO power purchase and energy purchase price S _ESO , EP sales energy S _EP , LA actual load S _LA ; the utility function of the game is the objective function of each subject, namely f _PP , f _ESO ,{f _EP ,f _LA }; The objective function of each subject is as follows: (1) Generator PP revenue model: The power generation company PP guides the energy system operator ESO to purchase electricity flexibly by formulating the electricity sales price, and reduces the cost of the energy system operator ESO to compensate for the shortage of resources while improving its own benefits. The power generation company PP aims to maximize the profit, and its objective function is: f _PP ＝C _sell -C _PP

Among them, C _sell and C _PP are the power sales revenue and operating cost of the power generator _PP respectively; _{ρ s} is the power sales price of the power generator PP; c _m is the coefficient of the constant term of the generating function of the unit; (2) ESO revenue model for energy system operators: After the introduction of energy storage, the ESO revenue model of energy system operators is:

(3) EP revenue model for energy producers: Energy producer EP adjusts unit output according to the energy purchase price set by ESO to maximize its own benefits. The objective function is:

Among them, C _EP is the operating cost of the EP unit;

is the carbon trading cost of EP;

are the output power of gas turbine GT and gas boiler GB respectively; a _e is the quadratic term coefficient of GT operating cost function, b _e is the first term coefficient of GT operating cost function, c _e is the constant term coefficient of GT operating cost function, a _h is the quadratic term coefficient of the GB operating cost function, b _h is the first term coefficient of the GB operating cost function, c _h is the constant term coefficient of the GB operating cost function; (4) LA income model of load aggregator: Considering the energy utility and cost of the load aggregator LA, the load aggregator LA takes the maximum utility as its goal, and its objective function is: f _LA ＝C _LA -C _ESO,s

Among them, C _LA is the LA energy utility; α _i is the coefficient of the first-order item of the LA energy preference function, and β _i is the quadratic item coefficient of the LA energy preference function;

is the actual load power after LA demand response.

Images