JP6819807B2 - Air conditioning system, machine learning device and machine learning method - Google Patents

Description

The present disclosure relates to air conditioning systems, machine learning devices and machine learning methods.

Conventionally, an outside air conditioner that air-conditions the target space by heating or cooling the outside air and supplying it to the target space, and a target space by heating or cooling the air (inside air) in the target space and sending it to the target space. An air conditioning system having an air conditioner for performing air conditioning is known.

The air conditioning system is generally required to realize both energy saving and comfort. On the other hand, for example, in Patent Document 1 below, a model (operating capacity of each device) for determining a combination of a target value of evaporation temperature and a target value of supply air temperature based on an outside air temperature, an outside air humidity, and an indoor load factor. The model that determines the temperature) is disclosed.

JP-A-2018-173264

However, in order to actually optimize the operating capacity of each device using the above model, after installing the air conditioning system, the data is actually measured under various operating conditions and the characteristics of each device. It is necessary to build a model that reflects the above, and the workload after installation is high.

The present disclosure provides air conditioning systems, machine learning devices and machine learning methods for optimizing the operating capacities of outside air conditioners and air conditioners.

The air conditioning system according to the first aspect of the present disclosure is
It has an outside air harmonizing unit and a heat medium adjusting unit that adjusts the state of the heat medium flowing through the outside air harmonizing unit, and air-conditions the target space by taking in outside air and supplying it as supply air from the outside air harmonizing unit. Outside air conditioner and
It has a plurality of indoor units and a refrigerant adjusting unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, to supply the target space. An air conditioner that air-conditions the target space by
An air conditioning system comprising a machine learning device that learns at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
A state variable acquisition unit that acquires a state variable including the outside air condition, the inside air condition, the operation condition of the outside air conditioner, the operation condition of the air conditioner, and the set temperature or the set humidity of the target space.
A learning unit that learns by associating the state variable with at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
It has a reward calculation unit that calculates a reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
The learning unit calculates the reward in a cycle corresponding to the time from when at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner is changed until the total energy consumption changes. Learn using.

According to the first aspect of the present disclosure, it is possible to provide an air conditioning system that optimizes the operating capacities of the outside air conditioner and the air conditioner.

The second aspect of the present disclosure is the air conditioning system according to the first aspect.
The outside air harmonizing device includes a first fan that takes in the outside air and sends the supply air to the target space, and an external heat exchanger that exchanges heat between the outside air taken in by the first fan and the heat medium. Including
The operating capacity of the outside air conditioner includes a target value of the temperature of the supply air, a target value of the air volume of the first fan, a target value of the temperature of the heat medium flowing into the external heat exchanger, and the external adjustment. The target value of the evaporation temperature or enthalpy of the heat medium in the heat exchanger is included.

The third aspect of the present disclosure is the air conditioning system according to the second aspect.
The indoor unit of the air conditioner includes a second fan that takes in the inside air and sends it to the target space, and an air conditioning heat exchanger that exchanges heat between the inside air taken in by the second fan and the refrigerant.
The operating capacity of the air conditioner includes a target value of the evaporation temperature of the air conditioner.

Further, the fourth aspect of the present disclosure is the air conditioning system according to the third aspect.
The outside air condition includes the temperature of the outside air or the humidity of the outside air.
The inside air condition includes the temperature of the inside air or the humidity of the inside air.
The operating status of the outside air harmonizing device includes information indicating that the outside air harmonizing device is operating or stopped, information indicating that the outside air harmonizing device is in the cooling mode or the heating mode, and the information indicating that the outside air harmonizing device is in the cooling mode or the heating mode. Any of the air volume of the first fan, the flow rate of the heat medium, the temperature of the heat medium, the pressure of the heat medium, and the set value of the temperature of the supply air is included.
The operating status of the air conditioner includes information indicating that the air conditioner is in operation or stopped, information indicating that the air conditioner is in the cooling mode or the heating mode, and the information indicating that the air conditioner is in the cooling mode or the heating mode. Any of the air volume of the second fan, the flow rate of the refrigerant, the temperature of the refrigerant, the pressure of the refrigerant, and the set value of the evaporation temperature of the air conditioner is included.

The fifth aspect of the present disclosure is the air conditioning system according to the first aspect.
The energy consumption of the outside air harmonizing device includes each energy consumption of the chiller unit, the heat medium adjusting unit, and the outside air harmonizing unit included in the outside air harmonizing device.
The energy consumption of the air conditioner includes the energy consumption of the plurality of indoor units and the refrigerant adjusting unit.

The sixth aspect of the present disclosure is the air conditioning system according to the fifth aspect.
The energy consumption includes any of power consumption, carbon dioxide emissions, and energy cost.

Further, the machine learning device according to the eighth aspect of the present disclosure is
It has an outside air harmonizing unit and a heat medium adjusting unit that adjusts the state of the heat medium flowing through the outside air harmonizing unit, and air-conditions the target space by taking in outside air and supplying it as supply air from the outside air harmonizing unit. Outside air conditioner and
It has a plurality of indoor units and a refrigerant adjusting unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, to supply the target space. A machine learning device that learns at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner in an air conditioning system having an air conditioner for air-conditioning the target space.
A state variable acquisition unit that acquires a state variable including the outside air condition, the inside air condition, the operation condition of the outside air conditioner, the operation condition of the air conditioner, and the set temperature or the set humidity of the target space.
A learning unit that learns by associating the state variable with at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
It has a reward calculation unit that calculates a reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
The learning unit calculates the reward in a cycle corresponding to the time from when at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner is changed until the total energy consumption changes. Learn using.

According to the eighth aspect of the present disclosure, it is possible to provide a machine learning device that optimizes the operating capacities of the outside air conditioner and the air conditioner.

Further, the machine learning method according to the ninth aspect of the present disclosure is described.
It has an outside air harmonizing unit and a heat medium adjusting unit that adjusts the state of the heat medium flowing through the outside air harmonizing unit, and air-conditions the target space by taking in outside air and supplying it as supply air from the outside air harmonizing unit. Outside air conditioner and
It has a plurality of indoor units and a refrigerant adjusting unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, to supply the target space. A machine learning method for learning at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner in an air conditioning system having an air conditioner for air-conditioning the target space.
A state variable acquisition step of acquiring a state variable including the outside air condition, the inside air condition, the operation condition of the outside air conditioner, the operation condition of the air conditioner, and the set temperature or the set humidity of the target space.
A learning step of learning by associating the state variable with at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
It has a reward calculation step of calculating a reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
In the learning step, the reward calculated in a cycle corresponding to the time from when at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner is changed until the total energy consumption changes. Learn using.

According to the ninth aspect of the present disclosure, it is possible to provide a machine learning method for optimizing the operating capacities of the outside air conditioner and the air conditioner.

It is a figure which shows an example of the system configuration of an air conditioning system. It is a figure which shows the configuration example of the outside air harmonizer. It is a figure which shows the installation example of an air supply duct and an indoor unit in a target space. It is a figure which shows the structural example of an air conditioner. It is a figure which showed the machine learning apparatus and each part connected to the machine learning apparatus. It is a figure which shows an example of the hardware composition of the machine learning apparatus. It is a figure which shows an example of the functional structure of a machine learning apparatus. It is a figure which shows an example of the state variable stored in the state variable storage part. It is a flowchart which shows the flow of the reinforcement learning process by a machine learning device.

Hereinafter, each embodiment will be described with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals to omit duplicate explanations.

[First Embodiment]
<System configuration of air conditioning system>
First, the system configuration of the air conditioning system according to the first embodiment will be described. FIG. 1 is a diagram showing an example of a system configuration of an air conditioning system. The air conditioning system 100 is a system that realizes air conditioning in a target space SP included in a building such as a house, a building, a factory, or a public facility. In the first embodiment, the air conditioning system 100 is applied to a building BL including a plurality of target spaces SP (SP1, SP2, SP3).

As shown in FIG. 1, the air conditioning system 100
・ Outside air conditioner 10 (air conditioner unit, chiller unit), which is an example of "outside air conditioner",
・ Air conditioner 50 (indoor unit, outdoor unit), which is an example of "air conditioner",
・ Remote controller (remote control) 80,
・ Machine learning device 90,
Have.

The air conditioning system 100 takes in the outside air by the outside air harmonizing machine 10 and supplies it to the target space SP in harmony to perform air conditioning such as cooling, heating, ventilation, dehumidification, and humidification in the target space SP. The outside air is the air outside the target space SP, and in the first embodiment, it is the outdoor air.

Further, the air conditioning system 100 takes in the inside air by the air conditioner 50 and supplies it to the target space SP in harmony to perform air conditioning such as cooling, heating, and dehumidification in the target space SP. The inside air is the air in the target space SP.

In the air conditioning system 100, the air conditioning of the outside air conditioner 10 and the air conditioner 50 is controlled according to the command input to the remote controller 80. Specifically, in the air conditioning system 100, the machine learning device 90 operates the operating capacities of the outside air conditioner 10 and the air conditioner 50 (at least in any case) according to the command input to the remote controller 80 and the load condition at that time. Either one. However, both are set here. Details will be described later). Then, the outside air conditioner 10 and the air conditioner 50 operate so as to realize the operating capacity set by the machine learning device 90. The commands referred to here include commands related to start / stop, operation type, set temperature, set humidity, set air volume, and the like. Further, the load status includes the temperature of the outside air, which is the condition of the outside air, the humidity of the outside air, the temperature of the inside air, which is the condition of the inside air, the humidity of the inside air, and the like.

<Details of outside air conditioner>
Next, the details of the outside air conditioner 10 will be described with reference to FIGS. 2 and 3. FIG. 2 is a diagram showing a configuration example of an outside air harmonizer. Further, FIG. 3 is a diagram showing an installation example of an air supply duct and an indoor unit in the target space.

(1) Explanation of the entire outside air harmonizing machine First, the entire outside air harmonizing machine 10 will be described. Generally, in an outside air harmonizer, there are two methods of heat exchange between the outside air and the heat medium: a method in which the heat medium does not undergo a phase change (central method) and a method in which the heat medium evaporates or condenses (phase changes). There are types. The outside air conditioner 10 shown in FIG. 2 or the like may be of any type, but here, it is configured by a central method, and mainly includes a chiller unit 20, an air handling unit (air conditioner unit) 30, and an air supply duct 45. , And an external air conditioner control unit 49. During operation, the outside air conditioner 10 takes in the outside air OA in the air conditioner 30, cools or heats it, dehumidifies or humidifies it, and supplies it to the target space SP as an air supply SA via the air supply duct 45.

In the outside air conditioner 10, the heat medium circuit C1 and the external conditioner refrigerant circuit C2 are configured independently of each other.

The heat medium circuit C1 is a circuit in which a heat medium (here, water (cooling water)) that exchanges heat with the outside air OA circulates. The heat medium circuit C1 is configured so as to straddle the chiller unit 20 and the air conditioner unit 30. In the heat medium circuit C1, the outside air heat exchanger 33 arranged in the air conditioner unit 30, the heat medium heat exchanger 22 arranged in the chiller unit 20, and the heat medium pump Pa are mainly connected by the first pipe P1. It is composed of things. During the operation of the outside air conditioner 10, in the heat medium circuit C1, the heat medium pump Pa is controlled to the operating state, so that the heat medium flows in a predetermined direction (the direction indicated by the two-dot chain arrow d1 in FIG. 2). The flow rate of the heat medium in the heat medium circuit C1 is mainly adjusted by the rotation speed of the heat medium pump Pa.

The external conditioner refrigerant circuit C2 is a circuit in which a refrigerant serving as a cooling source or a heating source of the heat medium in the heat medium circuit C1 circulates. The external conditioner refrigerant circuit C2 is configured in the chiller unit 20. The external conditioner refrigerant circuit C2 mainly includes a refrigerant compressor 21 arranged in the chiller unit 20, a heat medium heat exchanger 22, a refrigerant expansion valve 23, a refrigerant heat exchanger 24, and a flow path switching valve 25. , Are connected by the second pipe P2. During the operation of the outside air conditioner 10, in the external conditioner refrigerant circuit C2, the refrigerant compressor 21 is controlled to the operating state and the opening degree of the refrigerant expansion valve 23 is controlled. As a result, in the external conditioner refrigerant circuit C2, the refrigerant flows in a predetermined direction (the direction indicated by the two-dot chain arrow d2 in FIG. 2 during the forward cycle operation and the direction opposite to d2 during the reverse cycle operation).

(2) Details of the chiller unit Next, the details of the chiller unit 20 constituting the outside air conditioner 10 will be described. The chiller unit 20 cools or heats the heat medium in the heat medium circuit C1 by performing a refrigerant cycle in the external conditioner refrigerant circuit C2. The chiller unit 20 mainly includes a refrigerant compressor 21, a heat medium heat exchanger 22, a refrigerant expansion valve 23, a refrigerant heat exchanger 24, a flow path switching valve 25, a chiller fan 26, and a heat medium pump Pa.

The refrigerant compressor 21 is a device that compresses a low-pressure refrigerant in a refrigerant cycle until it reaches a high pressure. Here, as the refrigerant compressor 21, a compressor having a closed structure with a built-in compressor motor is adopted. For example, a scroll type and a positive displacement type compression element is housed in the refrigerant compressor 21, and the compression element is rotationally driven by the compressor motor. The operating frequency of the compressor motor is controlled by an inverter, which controls the capacity of the refrigerant compressor 21. That is, the capacity of the refrigerant compressor 21 is variable.

The heat medium heat exchanger 22 is a heat exchanger that cools the heat medium by exchanging heat between the heat medium in the heat medium circuit C1 and the low-pressure refrigerant in the external conditioner refrigerant circuit C2. In the heat medium heat exchanger 22, a heat medium flow path communicating with the heat medium circuit C1 and a refrigerant flow path communicating with the external conditioner refrigerant circuit C2 are formed, and the heat medium heat exchanger 22 is a heat medium flow. The heat medium in the path and the refrigerant in the refrigerant flow path are configured to be heat exchangeable. The heat medium heat exchanger 22 functions as a low-pressure refrigerant evaporator during a forward cycle operation (cooling operation or dehumidification operation), and functions as a high-pressure refrigerant condenser or radiator during a reverse cycle operation (heating operation).

The refrigerant expansion valve 23 is a valve that functions as a refrigerant decompression means or a flow rate adjusting means. In the first embodiment, the refrigerant expansion valve 23 is an electric expansion valve capable of controlling the opening degree.

The refrigerant heat exchanger 24 is a heat exchanger that exchanges heat between the refrigerant in the external conditioner refrigerant circuit C2 and the passing air. The refrigerant heat exchanger 24 has a heat transfer tube and heat transfer fins that communicate with the external conditioner refrigerant circuit C2. In the refrigerant heat exchanger 24, heat exchange is performed between the air passing around the heat transfer tube and the heat transfer fin (the air flow generated by the chiller fan 26) and the refrigerant passing through the heat transfer tube. The refrigerant heat exchanger 24 functions as a condenser or radiator of the high-pressure refrigerant during the forward cycle operation and functions as an evaporator of the low-pressure refrigerant during the reverse cycle operation.

The flow path switching valve 25 switches the flow of the external conditioner refrigerant circuit C2. The flow path switching valve 25 has four connection ports, and is provided on the suction pipe and discharge pipe of the refrigerant compressor 21, the gas side of the refrigerant flow path of the heat medium heat exchanger 22, and the gas side of the refrigerant heat exchanger 24. Each is connected.

Specifically, the flow path switching valve 25 can switch between the first state and the second state. In the first state, the gas side of the refrigerant flow path of the heat medium heat exchanger 22 is communicated with the suction pipe of the refrigerant compressor 21, and the discharge pipe of the refrigerant compressor 21 and the gas side of the refrigerant heat exchanger 24 are connected. It is in a state of communication (see the solid line of the flow path switching valve 25 in FIG. 2). In the second state, the discharge pipe of the refrigerant compressor 21 and the gas side of the refrigerant flow path of the heat medium heat exchanger 22 are communicated with each other, and the gas side of the refrigerant heat exchanger 24 and the suction pipe of the refrigerant compressor 21 are connected. It is in a state of communication (see the broken line of the flow path switching valve 25 in FIG. 2). The flow path switching valve 25 is controlled to the first state during normal cycle operation (cooling operation or dehumidifying operation), and is controlled to the second state during reverse cycle operation (heating operation or the like).

The chiller fan 26 is a blower that generates an air flow that flows into the chiller unit 20, passes through the refrigerant heat exchanger 24, and flows out of the chiller unit 20. The air flow generated by the chiller fan 26 is a cooling source for the refrigerant in the refrigerant heat exchanger 24 during the normal cycle operation and a heating source for the refrigerant in the refrigerant heat exchanger 24 during the reverse cycle operation. The chiller fan 26 includes a fan motor, and the rotation speed is adjusted by controlling the fan motor with an inverter. That is, the chiller fan 26 has a variable air volume.

The heat medium pump Pa (heat medium adjusting unit) is arranged in the heat medium circuit C1. During the operation of the outside air conditioner 10, the heat medium pump Pa sucks and discharges the heat medium. The heat medium pump Pa includes a motor as a drive source, and the rotation speed is adjusted by controlling the motor with an inverter. That is, the heat medium pump Pa has a variable discharge flow rate.

(3) Details of the Air Han Unit (Outside Air Harmonizing Unit) Next, the details of the air Han unit 30 constituting the outside air conditioner 10 will be described. The air conditioner unit 30 cools, dehumidifies, heats, and / or humidifies the outside air OA. The air conditioner unit 30 mainly includes an outside air heat exchanger 33, a humidifier 35, and an air supply fan 38.

The outside air heat exchanger 33 (external heat exchanger) is a heat exchanger that functions as a cooler for outside air OA. The outside air heat exchanger 33 is arranged in the heat medium circuit C1. The outside air heat exchanger 33 has a heat transfer tube and heat transfer fins communicating with the heat medium circuit C1. In the outside air heat exchanger 33, heat exchange is performed between the outside air OA passing around the heat transfer tube and the heat transfer fin and the heat medium passing through the heat transfer tube.

The humidifier 35 is a device for humidifying the outside air OA that has passed through the outside air heat exchanger 33. The method and model of the humidifier 35 are not particularly limited, but here, a general natural evaporation type humidifier is adopted.

The air supply fan 38 (first fan) is a blower that takes in the outside air OA into the air conditioner unit 30 and sends it to the air supply duct 45. The model of the air supply fan 38 is not particularly limited, but in the first embodiment, a sirocco fan is adopted as the air supply fan 38. Here, in the air han unit 30, an outside air flow path FP through which the outside air OA flows is formed (see the broken line arrow “FP” in FIG. 2), and when the supply air fan 38 is in the operating state, the outside air flow path FP is formed. The outside air OA flows. The air supply fan 38 includes a fan motor, and the rotation speed is adjusted by controlling the fan motor with an inverter. That is, the air supply fan 38 has a variable air volume.

In the air conditioner 30, the outside air heat exchanger 33, the humidifier 35, and the air supply fan 38 are arranged in this order from the windward side to the leeward side of the outside air flow path FP. The leeward end of the outside air flow path FP is connected to the air supply duct 45.

Further, various sensors are arranged in the air conditioner unit 30. Examples of various sensors arranged in the air conditioner unit 30 include an outside air temperature sensor 301 that detects the temperature of the outside air OA sucked into the air conditioner unit 30, and an outside air humidity sensor 302 that detects humidity. Further, for example, an air supply temperature sensor 303 that detects the temperature (supply air temperature) of the air supply SA sent to the air supply duct 45 (that is, the target space SP) can be mentioned.

(4) Details of Air Supply Duct Next, details of the air supply duct 45 constituting the outside air conditioner 10 will be described. The air supply duct 45 is a member that forms a flow path for outside air OA. One end of the air supply duct 45 is connected to the air conditioner unit 30 so that the outside air OA flows in by driving the air supply fan 38. The other end of the air supply duct 45 is branched into a plurality of branches, and communicates with the target space SP at each branch destination.

As shown in FIG. 3, the other end (each branch destination) of the air supply duct 45 is connected to the intake hole H1 formed in the ceiling CL of the target space SP.

(5) Details of External Conditioner Control Unit Next, details of the external air conditioner control unit 49 constituting the outside air conditioner 10 will be described. The external air conditioner control unit 49 is a functional unit that controls the operation of each unit included in the outside air conditioner 10. The external controller control unit 49 is composed of a CPU, a memory, various electrical components, and the like. The external controller control unit 49 is connected to each device included in the external air conditioner 10 via wiring. Further, the external controller control unit 49 is electrically connected to the remote controller 80 and the machine learning device 90 via a communication line.

In the first embodiment, the external controller control unit 49 is configured by electrically connecting each microcomputer and each electrical component arranged in the chiller unit 20 and the air conditioner unit 30 to each other.

The external controller control unit 49 sets a target value of the supply air temperature (target air supply temperature Tsa) according to the set temperature and the load condition (however, in the first embodiment, the target value of the supply air temperature is set. (Set by machine learning device 90). The external controller control unit 49 operates each unit based on the target air supply temperature Tsa (for example, the capacity of the refrigerant compressor 21, the opening degree of the refrigerant expansion valve 23, the rotation speed of the heat medium pump Pa, the start / stop of the humidifier 35, etc. Alternatively, the rotation speed of the air supply fan 38, etc.) is adjusted as appropriate. As a result, the operating capacity of the outside air conditioner 10 is appropriately changed.

The "operating capacity" of the outside air conditioner 10 here mainly refers to a cooling (dehumidifying) capacity and a heating capacity. Specifically, the operating capacity of the outside air conditioner 10 directly depends on the state of the heat medium flowing through the external heat exchanger (flow rate, temperature, pressure, enthalpy, etc.) and / or the air volume of the first fan. It is determined based on, and indirectly, it is determined based on a predetermined target value (for example, a target value of supply air temperature, etc.).

When cooling is performed by supplying the outside air OA without performing latent heat treatment or microheat treatment (that is, when performing outside air cooling operation), the external air conditioner control unit 49 suspends the operation of each part of the chiller unit 20. Stop it.

(6) Flow of heat medium, refrigerant, cooling water and air during operation of the outside air harmonizer Next, the flow of heat medium, refrigerant, cooling water and air during operation of the outside air harmonizer 10 will be described. During the operation of the outside air conditioner 10, the heat medium pump Pa is normally driven, and the heat medium circulates in the heat medium circuit C1. Further, the refrigerant compressor 21 is driven, and the refrigerant circulates in the external conditioner refrigerant circuit C2.

During the operation of the outside air conditioner 10, in the heat medium circuit C1, the heat medium is cooled or heated by the heat medium heat exchanger 22 exchanging heat with the refrigerant flowing through the external conditioner refrigerant circuit C2. Specifically, the heat medium is cooled during the forward cycle operation, and the heat medium is heated during the reverse cycle operation. The heat medium cooled or heated in the heat medium heat exchanger 22 flows into the outside air heat exchanger 33 and is heated or cooled by exchanging heat with the outside air OA taken into the air conditioner unit 30. Specifically, the heat medium is heated during the forward cycle operation and cooled during the reverse cycle operation. The heat medium that has passed through the outside air heat exchanger 33 flows into the heat medium heat exchanger 22 again.

During the operation of the outside air conditioner 10, the refrigerant is compressed by the refrigerant compressor 21 in the external conditioner refrigerant circuit C2 and discharged as a high-pressure refrigerant. The high-pressure refrigerant discharged from the refrigerant compressor 21 is condensed or dissipated by heat exchange with the air flow generated by the chiller fan 26 in the refrigerant heat exchanger 24 during normal cycle operation. Further, the high-pressure refrigerant discharged from the refrigerant compressor 21 is condensed or dissipated by heat exchange with the heat medium in the heat medium circuit C1 at the heat medium heat exchanger 22 during the reverse cycle operation. The refrigerant condensed or dissipated in one of the refrigerant heat exchanger 24 and the heat medium heat exchanger 22 is decompressed by the refrigerant expansion valve 23 to become a low-pressure refrigerant, and then flows into the other heat exchanger to form a heat medium or air flow. It is evaporated or heated by exchanging heat with. After that, the refrigerant is sucked into the refrigerant compressor 21 again.

In the outside air heat exchanger 33, the outside air OA exchanges heat with the heat medium. Specifically, the outside air OA is cooled (or dehumidified) during the cooling operation, and the outside air OA is heated during the heating operation. The outside air OA that has passed through the outside air heat exchanger 33 is sent to the air supply duct 45 (target space SP). When the humidifier 35 is in an operating state, the air heated by heat exchange with the heat medium in the outside air heat exchanger 33 is sent to the air supply duct 45 after being humidified by the humidifier 35.

<Details of air conditioner>
Next, the details of the air conditioner 50 (air conditioner) will be described with reference to FIG. FIG. 4 is a diagram showing a configuration example of an air conditioner.

(1) Explanation of the entire air conditioner First, the entire air conditioner 50 will be described. The air conditioner 50 includes a refrigerant circuit RC, and circulates the refrigerant in the refrigerant circuit RC to perform a vapor compression refrigeration cycle to realize air conditioning such as cooling, dehumidifying, or heating of the target space SP. The air conditioner 50 has a plurality of operation modes, and operates according to the operation modes. Specifically, the air conditioner 50 has a cooling mode for cooling, a dehumidification mode for dehumidification, a heating mode for heating, and the like, and operates according to each operation mode.

The air conditioner 50 mainly includes one outdoor unit 60 that functions as a heat source unit, a plurality of indoor units (three in this case) that function as utilization units, and an air conditioner control unit 79. In the air conditioner 50, the refrigerant circuit RC is formed by connecting the outdoor unit 60 and each indoor unit 70 via the liquid side refrigerant connecting pipe LP1 and the gas side refrigerant connecting pipe GP1. The refrigerant sealed in the refrigerant circuit RC is not particularly limited, but for example, an HFC refrigerant such as R32 or R410A is sealed in the refrigerant circuit RC.

(2) Details of the outdoor unit Next, the details of the outdoor unit 60 (refrigerant adjusting unit) constituting the air conditioner 50 will be described. The outdoor unit 60 is arranged outside the target space SP. In the first embodiment, the outdoor unit 60 is arranged outdoors.

The outdoor unit 60 is connected to the indoor unit 70 via the liquid-side refrigerant connecting pipe LP1 and the gas-side refrigerant connecting pipe GP1, and constitutes a part of the refrigerant circuit RC. The outdoor unit 60 mainly includes a compressor 61, a four-way switching valve 62, an outdoor heat exchanger 63, and an outdoor fan 68.

Further, the outdoor unit 60 has a plurality of refrigerant pipes RP (first refrigerant pipes RP1 to fifth refrigerant pipes RP5). The first refrigerant pipe RP1 connects the gas side refrigerant connecting pipe GP1 and the four-way switching valve 62. The second refrigerant pipe RP2 connects the four-way switching valve 62 and the suction side of the compressor 61. The third refrigerant pipe RP3 connects the discharge side of the compressor 61 and the four-way switching valve 62. The fourth refrigerant pipe RP4 connects the four-way switching valve 62 and the gas side inlet / outlet of the outdoor heat exchanger 63. The fifth refrigerant pipe RP5 connects the liquid side inlet / outlet of the outdoor heat exchanger 63 and the liquid side refrigerant connecting pipe LP1.

The compressor 61 is a device that compresses the low-pressure refrigerant in the refrigeration cycle until it reaches a high pressure. Here, as the compressor 61, a compressor having a closed structure having a built-in compressor motor M61 is adopted. A positive displacement compression element (not shown) such as a rotary type or a scroll type is housed in the compressor 61, and the compression element is rotationally driven by the compressor motor M61. The operating frequency of the compressor motor M61 is controlled by an inverter, whereby the capacity of the compressor 61 is controlled. That is, the compressor 61 has a variable capacity.

The four-way switching valve 62 is a flow path switching means for switching the flow direction of the refrigerant in the refrigerant circuit RC. Each state of the four-way switching valve 62 is controlled according to the situation. The four-way switching valve 62 connects the first refrigerant pipe RP1 and the second refrigerant pipe RP2 and also connects the third refrigerant pipe RP3 and the fourth refrigerant pipe RP4 during normal cycle operation (cooling operation or dehumidifying operation). To do. As a result, the four-way switching valve 62 is controlled to the first state (see the solid line of the four-way switching valve 62 in FIG. 4). Further, the four-way switching valve 62 connects the first refrigerant pipe RP1 and the third refrigerant pipe RP3 and also connects the second refrigerant pipe RP2 and the fourth refrigerant pipe RP4 during the reverse cycle operation (heating operation). .. As a result, the four-way switching valve 62 is controlled to the second state (see the broken line of the four-way switching valve 62 in FIG. 4).

The outdoor heat exchanger 63 is a heat exchanger that exchanges heat between the passing air flow (outdoor air flow generated by the outdoor fan 68) and the refrigerant. The outdoor heat exchanger 63 functions as a refrigerant condenser or radiator during normal cycle operation. The outdoor heat exchanger 63 functions as a refrigerant evaporator during reverse cycle operation.

The outdoor fan 68 is a blower that generates an outdoor air flow. The outdoor air flow is the flow of outside air OA that flows into the outdoor unit 60, passes through the outdoor heat exchanger 63, and flows out to the outside of the outdoor unit 60. The outdoor air flow is a cooling source for the refrigerant in the outdoor heat exchanger 63 during the forward cycle operation and a heating source for the refrigerant in the outdoor heat exchanger 63 during the reverse cycle operation. The outdoor fan 68 includes a fan motor, and the rotation speed is adjusted by controlling the fan motor with an inverter. That is, the outdoor fan 68 has a variable air volume.

In addition, various sensors are arranged in the outdoor unit 60. Examples of various sensors arranged in the outdoor unit 60 include a suction pressure sensor that detects the pressure of the refrigerant sucked into the compressor 61, a discharge pressure sensor that detects the pressure of the refrigerant discharged from the compressor 61, and the like. (Not shown).

(3) Details of Indoor Unit Next, details of the indoor unit 70 constituting the air conditioner 50 will be described. The indoor unit 70 is arranged in the target space SP. In the first embodiment, the indoor unit 70 is associated with one of the target space SPs and is installed in each target space SP. In the first embodiment, each indoor unit 70 is a ceiling-embedded air-conditioning indoor unit installed in the ceiling CL of the target space SP (see, for example, FIG. 3). Each indoor unit 70 is installed so that the suction port and the air outlet are exposed from the ceiling CL in the target space SP.

As shown in FIG. 4, the indoor unit 70 is connected to the outdoor unit 60 via the liquid-side refrigerant connecting pipe LP1 and the gas-side refrigerant connecting pipe GP1, and constitutes a part of the refrigerant circuit RC. In the first embodiment, three indoor units 70 are connected to one outdoor unit 60. The indoor units 70 are arranged in parallel with each other.

Each indoor unit 70 has an expansion valve 71 and an indoor heat exchanger 72. Further, each indoor unit 70 includes a sixth refrigerant pipe RP6 that connects the liquid side inlet / outlet of the indoor heat exchanger 72 and the liquid side refrigerant connecting pipe LP1, and the gas side inlet / outlet and the gas side refrigerant connecting pipe of the indoor heat exchanger 72. It has a seventh refrigerant pipe RP7 that connects to GP1.

The expansion valve 71 is a valve that functions as a refrigerant reducing means or a flow rate adjusting means. In the first embodiment, the expansion valve 71 is an electric expansion valve capable of controlling the opening degree, and is connected to the sixth refrigerant pipe RP6 (more specifically, between the indoor heat exchanger 72 and the liquid side refrigerant connecting pipe LP1). To be placed).

The indoor heat exchanger 72 (air conditioning heat exchanger) is a heat exchanger that exchanges heat between the passing air flow (indoor air flow generated by the indoor fan 75) and the refrigerant. The indoor heat exchanger 72 functions as a refrigerant evaporator during normal cycle operation. The outdoor heat exchanger 63 functions as a refrigerant condenser or radiator during reverse cycle operation.

The indoor fan 75 (second fan) is a blower that generates an indoor air flow. The indoor air flow is the flow of the inside air IA (see FIG. 3) that flows into the indoor unit 70, passes through the indoor heat exchanger 72, and flows out of the indoor unit 70. The indoor air flow is a heating source for the refrigerant in the indoor heat exchanger 72 during the normal cycle operation, and is a cooling source for the refrigerant in the indoor heat exchanger 72 during the reverse cycle operation. The indoor fan 75 includes a fan motor, and the rotation speed is adjusted by controlling the fan motor with an inverter. That is, the indoor fan 75 has a variable air volume.

In addition, various sensors are arranged in the indoor unit 70. Examples of various sensors arranged in the indoor unit 70 include an indoor temperature sensor 701 that detects the temperature of the indoor air flow (inside air IA) sucked into the indoor unit 70, and an indoor humidity sensor 702 that detects humidity. .. Further, for example, a carbon dioxide concentration sensor 703 that detects the carbon dioxide concentration and a refrigerant temperature sensor 704 that detects the temperature of the refrigerant in the indoor heat exchanger 72 can be mentioned. The refrigerant temperature sensor 704 is arranged in the indoor heat exchanger 72 and detects the evaporation temperature of the refrigerant during normal cycle operation.

(4) Details of Air Conditioner Control Unit Next, details of the air conditioner control unit 79 constituting the air conditioner 50 will be described. The air conditioner control unit 79 is a functional unit that controls the operation of each unit included in the air conditioner 50. The air conditioner control unit 79 is composed of a CPU, a memory, various electrical components, and the like. The air conditioner control unit 79 is connected to each device included in the air conditioner 50 via wiring. Further, the air conditioner control unit 79 is electrically connected to various sensors arranged in the indoor unit 70. Further, the air conditioner control unit 79 is communicably connected to the remote controller 80 installed in the common target space SP. Further, the air conditioner control unit 79 is electrically connected to the remote controller 80 and the machine learning device 90 via a communication line.

In the first embodiment, the air conditioner control unit 79 is configured by electrically connecting each microcomputer and each electrical component arranged in the outdoor unit 60 and each indoor unit 70 to each other.

The air conditioner control unit 79 sets a target value (target evaporation temperature Te) of the evaporation temperature in each indoor unit 70 according to the set temperature and the load condition (however, in the first embodiment, the target value of the evaporation temperature). Is set by the machine learning device 90). The air conditioner control unit 79 appropriately adjusts the capacity of the compressor 61, the air volume of the outdoor fan 68, and the like based on the target evaporation temperature Te. As a result, the operating capacity of the air conditioner 50 is appropriately changed.

The "operating capacity" of the air conditioner 50 referred to here mainly refers to a cooling (dehumidifying) capacity and a heating capacity. Specifically, the operating capacity of the air conditioner 50 is directly based on the state of the refrigerant flowing through the air conditioning heat exchanger (flow rate, temperature, pressure, enthalpy, etc.) and / or the air volume of the second fan. It is determined, indirectly, based on a predetermined target value (for example, a target value of the evaporation temperature of the refrigerant).

(5) Flow of Refrigerant in Refrigerant Circuit Next, the flow of refrigerant in the refrigerant circuit during operation of the air conditioner 50 will be described separately for the normal cycle operation and the reverse cycle operation.

(5-1) During normal cycle operation In the air conditioner 50, the four-way switching valve 62 is controlled to the first state during normal cycle operation (cooling operation / dehumidifying operation). As a result, the refrigerant filled in the refrigerant circuit RC is mainly in the order of the compressor 61, the outdoor heat exchanger 63, the expansion valve 71 of the indoor unit 70 in operation, and the indoor heat exchanger 72 of the indoor unit 70 in operation. Circulates (refrigerant circulates in the positive cycle).

When the normal cycle operation is started, the capacity is controlled according to the cooling load (specifically, the target evaporation temperature Te) required by each indoor unit 70. Specifically, in the refrigerant circuit RC, the refrigerant is sucked into the compressor 61, compressed, and then discharged. The rotation speed of the compressor 61 is adjusted as appropriate. The gas refrigerant discharged from the compressor 61 flows into the gas side inlet / outlet of the outdoor heat exchanger 63 via the third refrigerant pipe RP3, the four-way switching valve 62, and the fourth refrigerant pipe RP4.

The gas refrigerant that has flowed into the gas side inlet / outlet of the outdoor heat exchanger 63 dissipates heat and condenses by exchanging heat with the outside air OA supplied by the outdoor fan 68, and becomes a liquid refrigerant in an overcooled state to become an outdoor heat exchanger. It flows out from the liquid side inlet / outlet of 63. The liquid refrigerant flowing out from the liquid side inlet / outlet of the outdoor heat exchanger 63 flows into the operating indoor unit 70 via the fifth refrigerant pipe RP5 and the liquid side refrigerant connecting pipe LP1.

The refrigerant that has flowed into the indoor unit 70 flows through the sixth refrigerant pipe RP6, flows into the expansion valve 71, is depressurized, and then flows into the liquid side inlet / outlet of the indoor heat exchanger 72. The opening degree of the expansion valve 71 is appropriately adjusted. The refrigerant that has flowed into the liquid side inlet / outlet of the indoor heat exchanger 72 evaporates by exchanging heat with the inside air IA supplied by the indoor fan 75, becomes a superheated gas refrigerant, and becomes the gas side inlet / outlet of the indoor heat exchanger 72. Outflow from.

The gas refrigerant flowing out from the gas side inlet / outlet of the indoor heat exchanger 72 passes through the seventh refrigerant pipe RP7, the gas side refrigerant connecting pipe GP1, the first refrigerant pipe RP1, the four-way switching valve 62, and the second refrigerant pipe RP2 again. It is sucked into the compressor 61.

(5-2) During reverse cycle operation In the air conditioner 50, the four-way switching valve 62 is controlled to the second state during the reverse cycle operation (heating operation). As a result, the refrigerant filled in the refrigerant circuit RC is mainly in the order of the compressor 61, the indoor heat exchanger 72 of the indoor unit 70 in operation, the expansion valve 71 of the indoor unit 70 in operation, and the outdoor heat exchanger 63. Circulates (refrigerant circulates in reverse cycle).

When the reverse cycle operation is started, capacity control is performed according to the heating load required by each indoor unit 70. Specifically, in the refrigerant circuit RC, the refrigerant is sucked into the compressor 61, compressed, and then discharged. The rotation speed of the compressor 61 is adjusted as appropriate. The gas refrigerant discharged from the compressor 61 flows into the operating indoor unit 70 via the second refrigerant pipe RP2, the four-way switching valve 62, and the first refrigerant pipe RP1, flows through the seventh refrigerant pipe RP7, and enters the room. It flows into the gas side inlet / outlet of the heat exchanger 72.

The gas refrigerant that has flowed into the gas side inlet / outlet of the indoor heat exchanger 72 radiates heat and condenses by exchanging heat with the inside air IA supplied by the indoor fan 75, and becomes a liquid refrigerant in an overcooled state. It flows out from the liquid side inlet / outlet of 72. The liquid refrigerant flowing out from the liquid side inlet / outlet of the indoor heat exchanger 72 flows into the expansion valve 71 via the fifth refrigerant pipe RP5, is decompressed, and then flows out from the indoor unit 70. The opening degree of the expansion valve 71 is appropriately adjusted.

The refrigerant flowing out of the indoor unit 70 flows into the outdoor unit 60 via the liquid-side refrigerant connecting pipe LP1. The refrigerant that has flowed into the outdoor unit 60 flows into the liquid side inlet / outlet of the outdoor heat exchanger 63 via the fifth refrigerant pipe RP5. The refrigerant that has flowed into the outdoor heat exchanger 63 evaporates by exchanging heat with the outside air OA supplied by the outdoor fan 68, becomes a superheated gas refrigerant, and flows out from the gas side inlet / outlet of the outdoor heat exchanger 63. The refrigerant flowing out of the outdoor heat exchanger 63 is sucked into the compressor 61 again through the fourth refrigerant pipe RP4, the four-way switching valve 62, and the second refrigerant pipe RP2.

<Details of remote control>
Next, the details of the remote controller 80 will be described. The remote controller 80 is an input device for the user to input various commands for individually switching the start / stop, operation type, set temperature, set humidity, set air volume, etc. of the outside air conditioner 10 and the air conditioner 50. The remote controller 80 also functions as a display device for displaying predetermined information (for example, various input commands, the temperature and humidity of the inside air IA, the temperature and humidity of the outside air OA, and the like).

<Details of machine learning device>
Next, the details of the machine learning device 90 will be described.

(1) Explanation of Outline of Machine Learning Device First, an outline of the machine learning device 90 will be described. FIG. 5 is a diagram showing a machine learning device and each part connected to the machine learning device. The machine learning device 90 is a functional unit that comprehensively controls the operation of the air conditioning system 100. The machine learning device 90 is electrically connected to the external conditioner control unit 49 and the air conditioner control unit 79, and transmits and receives signals to and from each other.

The machine learning device 90 transmits a predetermined signal (for example, a control signal for setting the target air supply temperature Tsa and the target evaporation temperature Te) to the external air conditioner control unit 49 and the air conditioner control unit 79, thereby transmitting the outside air. The operating capacities of the balancer 10 and the air conditioner 50 are controlled. Further, the machine learning device 90 acquires the state variables of the outside air conditioner 10 and the air conditioner 50 by receiving predetermined signals transmitted from the external air conditioner control unit 49 and the air conditioner control unit 79. Further, the machine learning device 90 acquires information for specifying the energy consumption of the outside air conditioner 10 and the air conditioner 50.

(2) Hardware Configuration of Machine Learning Device Next, the hardware configuration of the machine learning device 90 will be described. FIG. 6 is a diagram showing an example of the hardware configuration of the machine learning device. As shown in FIG. 6, the machine learning device 90 includes a CPU (Central Processing Unit) 601, a ROM (Read Only Memory) 602, and a RAM (Random Access Memory) 603. The CPU 601, ROM 602, and RAM 603 form a so-called computer. Further, the machine learning device 90 includes an auxiliary storage device 604, a display device 605, an operation device 606, and an I / F (Interface) device 607. The hardware of the machine learning device 90 is connected to each other via the bus 608.

The CPU 601 is an arithmetic device that executes various programs (for example, a machine learning program described later) installed in the auxiliary storage device 604. ROM 602 is a non-volatile memory. The ROM 602 functions as a main storage device, and stores various programs, data, and the like necessary for the CPU 601 to execute various programs installed in the auxiliary storage device 604. Specifically, ROM 602 stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface).

The RAM 603 is a volatile memory such as a DRAM (Dynamic Random Access Memory) or a SRAM (Static Random Access Memory). The RAM 603 functions as a main storage device and provides a work area that is expanded when various programs installed in the auxiliary storage device 604 are executed by the CPU 601.

The auxiliary storage device 604 stores various programs and information used when various programs are executed.

The display device 605 is a display device that displays the internal state of the machine learning device 90. The operation device 606 is, for example, an operation device for the manager of the machine learning device 90 to perform various operations on the machine learning device 90. The I / F device 607 is a connection device that connects to the external air conditioner control unit 49 and the air conditioner control unit 79 and transmits / receives a signal between the external air conditioner control unit 49 and the air conditioner control unit 79.

(3) Functional Configuration of Machine Learning Device Next, the functional configuration of the machine learning device 90 will be described. FIG. 7 is a diagram showing an example of the functional configuration of the machine learning device. As described above, the machine learning device 90 has a machine learning program installed, and when the program is executed, the machine learning device 90 has an energy consumption acquisition unit 710, a reward calculation unit 720, and a state variable acquisition. It functions as a part 730 and a reinforcement learning part 740.

The energy consumption acquisition unit 710 acquires information for specifying the energy consumption of the outside air conditioner 10 and the air conditioner 50. The information for specifying the energy consumption includes the power consumption of the outside air conditioner 10 and the air conditioner 50. Further, the information for specifying the energy consumption may include the coefficient of performance (COP). In addition, the information for identifying energy consumption may include CO ₂ emissions (carbon dioxide emissions), energy costs (electricity costs, gas costs), and the like.

In addition, the information for specifying the energy consumption of the outside air conditioner 10 acquired by the energy consumption acquisition unit 710 includes information.
-Information that identifies the energy consumption of the chiller unit 20 of the outside air conditioner 10.
Information that identifies the energy consumption of the air conditioner unit 30 of the outside air conditioner 10.
-Information that identifies the energy consumption of the heat medium pump Pa of the outside air conditioner 10.
Is included.

In addition, the information for specifying the energy consumption of the air conditioner 50 acquired by the energy consumption acquisition unit 710 includes information.
Information that identifies the energy consumption of the outdoor unit 60 of the air conditioner 50,
Information that identifies the energy consumption of the indoor unit 70 of the air conditioner 50,
Is included.

The energy consumption acquisition unit 710 adds the information for specifying the energy consumption of the acquired outside air conditioner 10 and the information for specifying the energy consumption of the acquired air conditioner 50, and notifies the reward calculation unit 720 of the total value. ..

The reward calculation unit 720 calculates a reward that correlates with the total value notified by the energy consumption acquisition unit 710, and notifies the reinforcement learning unit 740.

The state variable acquisition unit 730 acquires state variables from the outside air conditioner 10 and the air conditioner 50. The state variables acquired by the state variable acquisition unit 730 include operating condition information, load information, operation set value information, and the like.

The operating condition information is information indicating the state of the outside air and the state of the inside air when the air conditioning system 100 operates. Specifically, the state variable acquisition unit 730
・ As information indicating the condition of the outside air, the outside air temperature or the outside air humidity,
・ As information indicating the status of the inside air, the inside air temperature or inside air humidity,
To get.

The load information is information indicating the operating status of the outside air conditioner 10 and the operating status of the air conditioner 50. Specifically, the state variable acquisition unit 730 provides information indicating the operating status of the outside air conditioner 10.
Information indicating that the outside air conditioner 10 is operating or stopped,
Information indicating that the outside air conditioner 10 is in the cooling mode or the heating mode,
・ Air volume of the first fan of the outside air conditioner 10
・ Flow rate of heat medium of outside air conditioner 10
-The temperature of the heat medium of the outside air conditioner 10
・ Pressure of the heat medium of the outside air conditioner 10
・ Set value of supply air temperature of outside air conditioner 10
As information indicating the operating status of the air conditioner 50,
Information indicating that the air conditioner 50 is in operation or stopped,
Information indicating that the air conditioner 50 is in cooling mode or heating mode,
・ Air volume of the second fan of the air conditioner 50,
・ Flow rate of the refrigerant of the air conditioner 50,
・ Temperature of the refrigerant of the air conditioner 50,
・ The pressure of the refrigerant of the air conditioner 50,
・ Set value of evaporation temperature of air conditioner 50,
To get.

The operation set value information is information indicating a set value set when operating the air conditioning system 100. Specifically, the state variable acquisition unit 730 uses the operation set value information as information.
・ Indoor set temperature,
・ Indoor set humidity,
To get.

The state variable acquisition unit 730 stores these state variables acquired from the outside air conditioner 10 and the air conditioner 50 in the state variable storage unit 750 in association with the time information.

The reinforcement learning unit 740 is an example of the learning unit, has a load coordination control model 741, and changes the model parameters of the load coordination control model 741 so that the reward notified from the reward calculation unit 720 is maximized. As a result, the reinforcement learning unit 740 performs reinforcement learning on the load coordination control model 741 that associates the state variable with at least one of the operating capacity of the outside air conditioner 10 and the operating capacity of the air conditioner 50. In this way, the reinforcement learning unit 740 reduces the total value of the information that specifies the energy consumption of the outside air conditioner 10 and the information that specifies the energy consumption of the air conditioner 50, so as to reduce the total value. Reinforcement learning is performed for 741. As a result, the load coordinated control model 741 outputs at least one of the operating capacity of the outside air conditioner 10 and the operating capacity of the air conditioner 50.

Here, at least one is
-When controlling the outside air conditioner 10 and the air conditioner 50 by using the operating capacity of the outside air conditioner 10 output by the load coordinated control model 741 and the operating capacity of the air conditioner 50, respectively.
The outside air conditioner 10 is controlled by using the operating capacity of the outside air conditioner 10 output by the load coordination control model 741, and the reinforcement learning unit 740 is derived from the operating capacity of the outside air conditioner 10 based on a predetermined combination. When controlling the air conditioner 50 using the operating capacity, or
The air conditioner 50 is controlled by using the operating capacity of the air conditioner 50 output by the load coordination control model 741, and the reinforcement learning unit 740 is derived from the operating capacity of the air conditioner 50 based on a predetermined combination. When controlling the outside air conditioner 10 using the operating capacity,
Is included.

The operating capacity of the outside air conditioner 10 includes
・ Target value of supply air temperature of outside air conditioner 10
・ Target value of air volume of outside air conditioner 10
・ Target value of the temperature of the heat medium of the outside air conditioner 10
・ Target value of evaporation temperature of outside air conditioner 10
・ Target value of enthalpy of outside air harmonizer 10
Is included.

In addition, the operating capacity of the air conditioner 50 includes
・ Target value of evaporation temperature of air conditioner,
Is included.

In addition, the reward calculation unit 720 shall calculate the reward according to the learning cycle of the reinforcement learning unit 740. Specifically, the reward calculation unit 720 calculates the reward based on the total value of energy consumption from the previous reinforcement learning to the current reinforcement learning. However, the learning cycle of the reinforcement learning unit 740 is, for example, a cycle according to the time required from the change in the operating capacity of the outside air conditioner 10 or the operating capacity of the air conditioner 50 to the change in the total value of energy consumption. Suppose that

Further, in the reinforcement learning unit 740, when executing the load coordination control model 741, the state variables between the previous reinforcement learning and the current reinforcement learning are read, the average value of the read state variables is calculated, and then the load is loaded. It shall be input to the cooperative control model 741.

The operating capacity output by executing the load coordination control model 741 (in the case where only one operating capacity is output, it is derived based on the output operating capacity and the output operating capacity. The increased operating capacity) is transmitted to the destination by the reinforcement learning unit 740. Specifically, the operating capacity of the outside air conditioner 10 is transmitted to the external air conditioner control unit 49 by the reinforcement learning unit 740, and the operating capacity of the air conditioner 50 is transmitted to the air conditioner control unit 79 by the reinforcement learning unit 740. Will be done. As a result, the outside air conditioner 10 operates so as to realize the transmitted operating capacity, and the air conditioner 50 operates so as to realize the transmitted operating capacity.

(4) Details of State Variables Next, details of the state variables stored in the state variable storage unit 750 will be described. FIG. 8 is a diagram showing an example of a state variable stored in the state variable storage unit. As shown in FIG. 8, the state variable stored in the state variable storage unit 750 includes "time", "operation condition information", "load information", and "operation setting value information" as information items. .. Further, the information acquired by the state variable acquisition unit 730 is stored for each item in the "operation condition information", "load information", and operation setting value information, respectively.

The example of FIG. 8 shows a case where the learning cycle is 15 minutes to 30 minutes, and each information included in "operating condition information", "load information", and "operation setting value information" is 15 minutes to 30 minutes. The average value is calculated for each.

(5) Flow of Reinforcement Learning Process Next, the flow of reinforcement learning process by the machine learning device 90 will be described. FIG. 9 is a flowchart showing the flow of reinforcement learning processing by the machine learning device.

In step S901, the state variable acquisition unit 730 acquires a state variable from the outside air conditioner 10 and the air conditioner 50.

In step S902, the energy consumption acquisition unit 710 adds the acquired information for specifying the energy consumption of the outside air conditioner 10 and the acquired information for specifying the energy consumption of the air conditioner 50, and calculates a total value.

In step S903, the reinforcement learning unit 740 determines whether or not a predetermined learning cycle has elapsed. If it is determined in step S903 that the predetermined learning cycle has not elapsed (NO in step S903), the process returns to step S901.

On the other hand, if it is determined in step S903 that the predetermined learning cycle has elapsed (YES in step S903), the process proceeds to step S904.

In step S904, the reward calculation unit 720 calculates the reward based on the total value accumulated during the predetermined learning cycle.

In step S905, the reward calculation unit 720 determines whether or not the calculated reward is equal to or greater than a predetermined threshold value. If it is determined in step S905 that the threshold value is not equal to or higher than the predetermined threshold value (NO in step S905), the process proceeds to step S906.

In step S906, the reinforcement learning unit 740 performs reinforcement learning on the load coordination control model 741 so that the calculated reward is maximized.

In step S907, the reinforcement learning unit 740 executes the load coordination control model 741 by inputting the current state variable into the load coordination control model 741. As a result, the load coordinated control model 741 outputs at least one of the operating capacity of the outside air conditioner 10 and the operating capacity of the air conditioner 50. In the reinforcement learning unit 740, when only one of the operating capacities is output by the load coordination control model 741, the other operating capacity is derived based on a predetermined combination.

In step S908, the reinforcement learning unit 740 transmits the operating capacity of the outside air conditioner 10 to the external air conditioner control unit 49 and the output operating capacity of the air conditioner 50 to the air conditioner control unit 79. After that, the process returns to step S901.

On the other hand, if it is determined in step S905 that the threshold value is equal to or higher than a predetermined threshold value (YES in step S905), the reinforcement learning process is terminated.

<Summary>
As is clear from the above description, the air conditioning system according to the first embodiment is
・ It has an air han unit and a heat medium pump that adjusts the state of the heat medium flowing through the air han unit, and has an outside air conditioner that air-conditions the target space by taking in outside air and supplying it as supply air from the air han unit. ..
-It has a plurality of indoor units and an outdoor unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, and supplies it to the target space. It has an air conditioner that air-conditions the space.
-Has a machine learning device that learns at least one of the operating capacities of the outside air conditioner and the air conditioner.

Further, the machine learning device according to the first embodiment is
-Acquire the state variables including the outside air condition, the inside air condition, the operating condition of the outside air conditioner, the operating condition of the air conditioner, and the set temperature or the set humidity of the target space.
-Learn by associating the state variable with at least one of the operating capacities of the outside air conditioner and the air conditioner.
-Calculate the reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
-Use the calculated reward when learning by associating the state variable with at least one of the operating capacities of the outside air conditioner and the air conditioner.

As described above, according to the first embodiment, since the load coordinated control model is constructed using the data actually measured after the installation of the air conditioning system, it is possible to construct a highly accurate model that reflects the characteristics of the installed equipment. .. Further, according to the first embodiment, since the load coordination control model is automatically constructed by reinforcement learning, it is possible to reduce the work load after installation for starting the air conditioning system. Further, according to the first embodiment, the total energy consumption of the outside air conditioner and the air conditioner is set by setting the operating capacities of the outside air conditioner and the air conditioner using the constructed load coordination control model. Can be reduced.

That is, according to the first embodiment, it is possible to provide an air conditioning system, a machine learning device, and a machine learning method that optimize the operating capacities of the outside air conditioner and the air conditioner.

[Other Embodiments]
In the first embodiment, as the outside air conditioner 10, a chiller type in which the heat medium circuit C1 and the external conditioner refrigerant circuit C2 are configured independently of each other is illustrated. However, the outside air harmonizer 10 is not limited to the chiller type, and may be a direct expansion type in which the heat medium circuit C1 is not provided and the external conditioner refrigerant circuit C2 is connected to the outside air heat exchanger 33. ..

Further, in the first embodiment, when only one of the operating capacities is output by the load coordinated control model 741, the reinforcement learning unit 740 derives the other operating capacity based on a predetermined combination. Explained as what to do. However, the reinforcement learning unit 740 may be configured to transmit only one of the operating capacities output by the load coordination control model 741. Specifically, when the operating capacity of the outside air conditioner 10 is output by the load coordination control model 741, the outside air conditioner 10 is controlled by using the operating capacity, and the air conditioner 50 is changed as it is. You may let me. Alternatively, when the operating capacity of the air conditioner 50 is output by the load coordinated control model 741, the air conditioner 50 may be controlled using the operating capacity and the outside air conditioner 10 may be changed as a matter of course. Good.

Further, in the first embodiment, the details of the model (load cooperative control model) used when performing machine learning are not particularly mentioned, but any kind of model can be used as the model used when performing machine learning. It shall be applied. Specifically, any kind of model such as an NN (Neural Network) model, a random forest model, and an SVM (Support Vector Machine) model is applied.

Further, in the first embodiment, the details of the changing method when changing the model parameters are not particularly mentioned, but the changing method of the model parameters shall follow the type of the model.

Although the embodiments have been described above, it will be understood that various modifications of the embodiments and details are possible without departing from the purpose and scope of the claims.

100: Air conditioning system 10: Outside air conditioner 20: Chiller unit 30: Air conditioner unit 45: Air supply duct 49: External conditioner control unit 50: Air conditioner 60: Outdoor unit 70: Indoor unit 79: Air conditioner control unit 80: Remote control 90: Machine learning device 710: Energy consumption acquisition unit 720: Reward calculation unit 730: State variable acquisition unit 740: Reinforcement learning unit 741: Load coordination control model

Claims (8)

It has an outside air harmonizing unit and a heat medium adjusting unit that adjusts the state of the heat medium flowing through the outside air harmonizing unit, and air-conditions the target space by taking in outside air and supplying it as supply air from the outside air harmonizing unit. Outside air conditioner and
It has a plurality of indoor units and a refrigerant adjusting unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, to supply the target space. An air conditioner that air-conditions the target space by
An air conditioning system comprising a machine learning device that learns at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
A state variable acquisition unit that acquires a state variable including the outside air condition, the inside air condition, the operation condition of the outside air conditioner, the operation condition of the air conditioner, and the set temperature or the set humidity of the target space.
A learning unit that learns by associating the state variable with at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
It has a reward calculation unit that calculates a reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
The learning unit calculates the reward in a cycle corresponding to the time from when at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner is changed until the total energy consumption changes. An air conditioning system to learn using. The outside air harmonizing device includes a first fan that takes in the outside air and sends the supply air to the target space, and an external heat exchanger that exchanges heat between the outside air taken in by the first fan and the heat medium. Including
The operating capacity of the outside air conditioner includes a target value of the temperature of the supply air, a target value of the air volume of the first fan, a target value of the temperature of the heat medium flowing into the external heat exchanger, and the external adjustment. The air conditioning system according to claim 1, wherein the target value of the evaporation temperature or enthalpy of the heat medium in the heat exchanger is included. The indoor unit of the air conditioner includes a second fan that takes in the inside air and sends it to the target space, and an air conditioning heat exchanger that exchanges heat between the inside air taken in by the second fan and the refrigerant.
The air conditioning system according to claim 2, wherein the operating capacity of the air conditioner includes a target value of the evaporation temperature of the air conditioner. The outside air condition includes the temperature of the outside air or the humidity of the outside air.
The inside air condition includes the temperature of the inside air or the humidity of the inside air.
The operating status of the outside air harmonizing device includes information indicating that the outside air harmonizing device is operating or stopped, information indicating that the outside air harmonizing device is in the cooling mode or the heating mode, and the information indicating that the outside air harmonizing device is in the cooling mode or the heating mode. Any of the air volume of the first fan, the flow rate of the heat medium, the temperature of the heat medium, the pressure of the heat medium, and the set value of the temperature of the supply air is included.
The operating status of the air conditioner includes information indicating that the air conditioner is in operation or stopped, information indicating that the air conditioner is in the cooling mode or the heating mode, and the information indicating that the air conditioner is in the cooling mode or the heating mode. The air conditioning system according to claim 3, further comprising any one of an air volume of a second fan, a flow rate of the refrigerant, a temperature of the refrigerant, a pressure of the refrigerant, and a set value of an evaporation temperature of the air conditioner. The energy consumption of the outside air harmonizing device includes each energy consumption of the chiller unit, the heat medium adjusting unit, and the outside air harmonizing unit included in the outside air harmonizing device.
The air conditioning system according to claim 1, wherein the energy consumption of the air conditioner includes the energy consumption of the plurality of indoor units and the refrigerant adjusting unit. The air conditioning system according to claim 5, wherein the energy consumption includes any one of power consumption, carbon dioxide emissions, and energy cost. It has an outside air harmonizing unit and a heat medium adjusting unit that adjusts the state of the heat medium flowing through the outside air harmonizing unit, and air-conditions the target space by taking in outside air and supplying it as supply air from the outside air harmonizing unit. Outside air conditioner and
It has a plurality of indoor units and a refrigerant adjusting unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, to supply the target space. A machine learning device that learns at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner in an air conditioning system having an air conditioner for air-conditioning the target space.
A state variable acquisition unit that acquires a state variable including the outside air condition, the inside air condition, the operation condition of the outside air conditioner, the operation condition of the air conditioner, and the set temperature or the set humidity of the target space.
A learning unit that learns by associating the state variable with at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
It has a reward calculation unit that calculates a reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
The learning unit calculates the reward in a cycle corresponding to the time from when at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner is changed until the total energy consumption changes. A machine learning device that uses and learns. It has an outside air harmonizing unit and a heat medium adjusting unit that adjusts the state of the heat medium flowing through the outside air harmonizing unit, and air-conditions the target space by taking in outside air and supplying it as supply air from the outside air harmonizing unit. Outside air conditioner and
It has a plurality of indoor units and a refrigerant adjusting unit that adjusts the state of the refrigerant flowing through the indoor unit, and the indoor unit cools or heats the inside air, which is the air in the target space, to supply the target space. A machine learning method for learning at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner in an air conditioning system having an air conditioner for air-conditioning the target space.
A state variable acquisition step of acquiring a state variable including the outside air condition, the inside air condition, the operation condition of the outside air conditioner, the operation condition of the air conditioner, and the set temperature or the set humidity of the target space.
A learning step of learning by associating the state variable with at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner.
It has a reward calculation step of calculating a reward that correlates with the total energy consumption of the outside air conditioner and the air conditioner.
In the learning step, the reward calculated in a cycle corresponding to the time from when at least one of the operating capacity of the outside air conditioner and the operating capacity of the air conditioner is changed until the total energy consumption changes. A machine learning method for learning using.

Images