CN111083201A - Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things - Google Patents
Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things Download PDFInfo
- Publication number
- CN111083201A CN111083201A CN201911169997.2A CN201911169997A CN111083201A CN 111083201 A CN111083201 A CN 111083201A CN 201911169997 A CN201911169997 A CN 201911169997A CN 111083201 A CN111083201 A CN 111083201A
- Authority
- CN
- China
- Prior art keywords
- host
- hosts
- service
- energy
- energy consumption
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1029—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/329—Power saving characterised by the action undertaken by task scheduling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Abstract
An energy-saving resource allocation method for data-driven manufacturing service in the industrial Internet of things belongs to the industrial Internet of things optimization technology. The invention aims to realize real-time monitoring and adjustment of the distributed tasks, reduce the resource consumption of the system, ensure that SLA is delivered by a cloud manufacturing service provider and reduce the energy consumption and cooling cost of the host. Detecting the utilization rate of a CPU; determining all D2M services on SU-hosts and a D2M service selected from SO-hosts to be migrated out of the service; and searching suitable hosts to allocate resources for the D2M service determined to be moved, finding suitable hosts for D2M service migration by utilizing an energy and thermal perception resource allocation scheme, and performing service migration to reduce energy consumption. The invention considers the energy-saving consumption of resource allocation, carries out real-time monitoring and adjustment after the task allocation, reduces the resource consumption of the system, ensures that SLA is delivered by a cloud manufacturing service provider, and simultaneously reduces the energy consumption and the cooling cost of the host.
Description
Technical Field
The invention relates to an energy-saving resource allocation method for data-driven manufacturing service, and belongs to the industrial Internet of things optimization technology.
Background
Industry 4.0 refers to the process of manufacturing digitization for the purpose of creating an ecosystem for an industry that is focused on manufacturing and supply chain management. An industrial internet of things (IIoT) includes smart sensors, camera systems, smart meters, industrial robots and actuators to utilize smart machines and the ability to perform real-time analysis in a cloud-enabled IIoT environment. According to the relevant reports, predictions of IIoT market growth are expected to grow from $ 640 billion in 2018 to 914.0 billion dollars in 2023 with a compound annual growth rate of 7.39%. In data driven manufacturing (D2M) services, IIoT devices have great potential in sustainable and green practice, supply chain traceability, quality control and overall supply chain efficiency. Therefore, to provide efficient and accurate D2M services, a large amount of data is generated from these IIoT devices and used for analysis in cloud-enabled IIoT data centers.
Cloud-enabled IIoT environments provide MaaS, a manufacturing as a service, to the manufacturing industry, benefiting the industry by minimizing operational and management costs. MaaS includes different types of D2M services (e.g., supply chain management and optimization, predictive maintenance/analysis, and asset tracking and optimization), requiring significant computing, network, and storage resources to deliver to end service users. Therefore, the cloud-enabled IIoT environment requires a large amount of energy and increases with the rapid increase in D2M service demand. Currently, cloud-enabled IIoT data centers encounter problems of high energy consumption, high temperature and Service Level Agreement (SLA) violation, which are all huge challenges in the research community. For example, in the united states, cloud-enabled IIoT data centers consume approximately 2% (700 billion kilowatt-hours) of total energy. By 2030, the energy consumption of cloud-enabled IIoT data centers can be reduced from 8000TWh to 1200TWh if necessary. Therefore, improving the energy efficiency of cloud-supportable IIoT data centers is critical to a sustainable and cost-effective cloud-supportable IIoT environment. The energy consumption of the cloud-enabled IIoT environment is proportional to the energy consumption of the servers (hosts) and the heat dissipation cost or temperature of the hosts.
The prior art with the reference number of CN109491790A provides a container-based industrial internet of things edge computing resource allocation method and system, and the method comprises the following steps: dividing the tasks into n types according to the data types collected by the sensing layer, and obtaining the probability relation of the tasks sequentially reaching the edge server cluster through historical data statistics; distributing computing resources to the real-time tasks according to the system state space and the decision space, and performing sequence decision; according to a resource allocation algorithm based on reinforcement learning, a system selects the most reasonable strategy from three resource allocation strategies of low, medium and high according to the current state to allocate resources to the current task; and constructing a task scheduling processing model, creating a container, scheduling data to the container for processing and analysis, and deleting the container after the task is completed to complete distribution. In the prior art, under the condition of limited resources, the resources are distributed to different types of data calculation, and containers are created for processing and analysis, so that the resource use efficiency and the total task processing rate are improved. The prior art does not consider energy-saving consumption of resource allocation, and real-time monitoring and adjustment are not carried out after task allocation, so that the consumption of system resources is increased.
Disclosure of Invention
The invention provides an energy-saving resource allocation method for data-driven manufacturing service in an industrial Internet of things, aiming at realizing real-time monitoring and adjustment of allocated tasks, reducing system resource consumption, ensuring that SLA is delivered by a cloud manufacturing service provider and reducing host energy consumption and cooling cost.
The technical scheme adopted by the invention for solving the technical problems is as follows:
an energy-saving resource allocation method for data-driven manufacturing service in the industrial internet of things comprises the following steps:
step one, detecting the CPU utilization rate: detecting host CPU utilization in cloud enabled IIoT data center, then performing utilization classification (MCU), and setting three threshold values T according to the host CPU utilizationlower,Tmiddle,TupperClassifying hosts (hosts), and sequentially classifying the hosts into four classes, namely SU-hosts, SA-hosts, NL-hosts and SO-hosts, from low to high according to threshold values;
step two, determining all D2M services on SU-hosts and D2M services selected from SO-hosts (D2M services refer to data-driven manufacturing services) to be migrated out of the services;
and step three, searching a proper host to allocate resources for the D2M service determined to be moved in the step two, finding a host suitable for D2M service migration by using an energy and thermal perception resource allocation (ETV) scheme, and performing service migration to reduce energy consumption.
Further, three thresholds T are set in step onelower,Tmiddle,TupperThe determination process of (2) is:
the determination of the three thresholds is selected by a least median square regression model, and is specifically determined by using formulas (9) to (11):
Tupper=(1-c×LMS) (11)
LMS in the formula represents the square of the minimum median; and c represents a safety factor, and the value of c is 0.5.
Further, the utilization rate classification (MCU) based on the above three thresholds is described as follows:
1) obtaining the current ithPrediction of CPU utilization for a hostClassifying hosts to their corresponding affiliations
2) If, ifIdentifies the host as a member of the SO-hosts group, and hosts belonging to the group must migrate some D2M services to SA-hostsGroups to reduce SLA violations;
4) if, ifThe host is identified as one of the members and the hosts belonging to the group must migrate all of their D2M services into SA-hosts.
Further, the specific implementation process of the step two is as follows:
modeling energy consumption issues in a cloud-enabled IIoT environment, a set of n D2M services S ═ is defined (S)1,s2,....,sn) H ═ H needs to be placed on m hosts1,h2,....,hm) And G represents a gateway device; energy consumption of the cloud-enabled IIoT environment includes computational energy consumption and cooling energy consumption, observed time is divided into l (q ═ 1, 2.. ·, l) time slots, each time slot having a duration of κ;
the allocation of D2M services to the cloud-enabled IIoT data center is described with an energy consumption model and a cooling energy consumption model;
the energy consumption model is as follows:
wherein:representing the consumption of base power, P, by each hosthostRepresents the total power consumption consumed by the host,andmaximum power consumption of the host and the gateway in a period of time respectively; deltajHolding a binary value (0, 1); if the jth D2M service acquires resources from the host, the value of δ j is "1", otherwise, the value is "0"; CPU(s)j) Represents the total number of CPUs required for the jth D2M service; phostThe formula indicates that the utilization of the host is derived from the ratio of the total number of CPU cores per D2M service request associated with the D2M service to the total number of CPU cores of the host;
c is the capacity of the original bearer network, CmaxIs the maximum network capacity;consuming base power, P, on behalf of the gatewaygateRepresents the total power consumed by the gateway;
during the observation time, the overall computing power consumption of the cloud-enabled IIoT environment is represented by a matrix P,(q=1,2,..., l;i=1,2,...,m)the elements in the matrix P are determined;
in summary, the computational energy consumption model of the cloud-enabled IIoT environment is defined as follows:
the refrigeration energy consumption model is as follows:
in cloud-enabled IIoT data centers, the energy consumed by Computer Room Air Conditioners (CRACs), referred to as cooling energy, is dependent on the heat generated by the host and the efficiency of the CRACs; HR matrix d describes the relationship between each pair of hosts, with entry di,kRepresents the i-ththGenerating host to kthThe recirculation rate of each host; the heat contribution of all hosts affects the iththThe inlet temperature of each host in the observed time slot q is given by the following formula:
which is indicative of the inlet temperature, is,which is indicative of the temperature being supplied,
all inlet temperaturesWherein T isupIs the warning temperature (nominal 70 ℃), the temperature of the cold air provided from the CRAC is set by equation (4) as follows:
using the CoP model:
CoP(Tsupply)=0.0068(Tsupply)2+0.0008Tsupply+0.458 to describe the refrigeration energy consumption model:
and (3) integrating the models in the formula (3) and the formula (6) to obtain a total consumption model:
further optimization (7) can be achieved using equation (5), resulting in the final optimization objective:
searching for the best host to obtain resource allocation: the D2M resource allocation optimization is achieved by selecting the most appropriate host from either SO-hosts or SU-hosts at each scheduling interval based on obtaining the list of hosts and services, with the cost of each host calculated using equation (8), and compressing the host cost in each iteration.
Further, the specific implementation process of the step three is as follows:
balancing the trade-off between computing and cooling systems with an ETV resource allocation scheme, D2M service resource allocation is directly dependent on the current temperature of the hosts, which is the lowest temperature among hosts in the cloud-enabled IIoT data center when selecting hosts for resource allocation for the D2M service, constructed based on costs of energy and thermal energy, from a list of hosts, D2M service, Tlower、TmiddleUsing equation (8) to make a feasible host list, the host list search space is sorted to find the best feasible host list.
The invention has the following beneficial technical effects: the present invention provides a solution to how to reduce host power consumption and cooling costs while ensuring that SLAs are delivered by cloud manufacturing service providers. It can be seen that increasing the level of host resource utilization in a cloud-enabled IIoT data center can minimize the overall energy consumption of the cloud-enabled IIoT environment. However, simply increasing host utilization may affect the temperature of hosts and SLAs delivered by the cloud manufacturing service provider. Therefore, D2M service should be selected for reallocation from either service-overloaded hosts (SO hosts) or service-underloaded hosts (SU hosts) according to current resource demand to reduce SLA violations. The number of active hosts is reduced by switching idle hosts to a power saving mode to reduce power consumption. When D2M service workload demand increases, the host may be reactivated. The present invention performs energy-saving resource allocation using three main tasks: (1) detecting the utilization rate of a CPU; (2) selecting a D2M service from the SO host; (3) searching for a suitable host allocates resources for the D2M service. The invention considers the energy-saving consumption of resource allocation, carries out real-time monitoring and adjustment after the task allocation, reduces the resource consumption of the system, ensures that a cloud manufacturing service provider delivers SLA and reduces the energy consumption and cooling cost of the host.
Drawings
FIG. 1 shows that the MCU scheme uses three thresholds Tlower, Tmiddle, Tupper to classify host into four categories: graphs of the results of SU-hosts, SA-hosts, NL-hosts, and SO-hosts;
FIG. 2 is a graph of the energy consumption simulation results of the method of the present invention;
FIG. 3 is a graph of the results comparing the SLA violation percentage of KLA-MR, KMI-MP, RANDOM and PABFD to ETV;
FIG. 4 is a graph of the results of the ETV protocol compared to the KMI-MR, KMI-MP, RANDOM and PABFD methods;
FIG. 5 is a graph of simulation results of an ETV scheme versus host temperature of KMI-MR, KMI-MP, RANDOM, and PABFD;
FIG. 6 is a graph of simulation results of an ETV scheme versus host shutdown numbers of KMI-MR, KMI-MP, RANDOM, and PABFD;
the abscissa in fig. 1 represents cpu utilization, and the ordinate represents the number of hosts;
the abscissa in fig. 2 represents the different algorithms and the ordinate represents the energy consumption;
the abscissa in fig. 3 represents different algorithms, and the ordinate represents SLA metric violation rate;
the abscissa in fig. 4 represents the different algorithms and the ordinate represents the specific value of the ME2 index;
the abscissa in fig. 5 represents different algorithms and the ordinate represents the host temperature;
the abscissa in fig. 6 represents different algorithms, and the ordinate represents the number of host shutdowns;
the ETV protocol and KMI-MR, KMI-MP, RANDOM, and PABFD are defined herein, reference KMI-MR, reference KMI-MP, reference RANDOM, and reference PABFD, respectively.
Detailed Description
With reference to fig. 1 to 5, the energy-saving resource allocation method for data-driven manufacturing service in the internet of things of the industry according to the present invention is explained as follows:
1, modeling and problem formulation description of a system, and performing model research and formulation work on the energy consumption problem in the cloud-supported IIoT environment in order to better explain the problem. The following formalization is described:
a set of n D2M services S ═ (S)1,s2,....,sn) H ═ H needs to be placed on m hosts1,h2,...., hm) And G represents a gateway device. The energy consumption of the cloud-enabled IIoT environment includes computing energy consumption and cooling energy consumption. The observed time is divided into l (q ═ 1, 2.. eta., l) time slots, each time slot having a duration of κ. For the distribution algorithm for distributing D2M service to the cloud-enabled IIoT data center, we will describe its energy consumption model and thermal perception energy consumption model, respectively.
1.1 calculating energy consumption model
In the cloud-enabled IIoT environment, the computational energy consumption is determined by the energy consumed by the CPU, storage, memory, and network. However, the CPU is the primary computational energy consumer. Therefore, the computational power consumption model focuses mainly on the power consumption of the CPU. The energy consumed by the gateway is determined by its network carrying capacity, as follows:
each host consuming base powerTo support basic tasks such as networking, monitoring and running instance fans to perform host heat dissipation. Wherein P ishostRepresents the total power consumption consumed by the host,andthe maximum power consumption of the host and the gateway, respectively, over a period of time. C is the capacity of the original bearer network, CmaxIs the maximum network capacity. DeltajThe binary value (0,1) is maintained. If the jth D2M service gets resources from the host, then the value of δ j is "1", otherwise it is "0". CPU(s)j) Representing the total number of CPUs required for the jth D2M service. The above equation indicates that the utilization of the host is derived from the ratio of the total number of CPU cores per D2M service request associated with the D2M service to the total number of CPU cores of the host. During the observation time, the overall computing power consumption of the cloud-enabled IIoT environment is represented by a matrix P,(q 1, 2.. said., l; i 1, 2.. said., m) determines the elements in the matrix P. The computational energy consumption model of the cloud-enabled IIoT environment is defined as follows:
1.2 refrigeration energy consumption model
In cloud-enabled IIoT data centers, the energy consumed by Computer Room Air Conditioners (CRACs) is referred to as cooling energy. It depends on the heat generated by the host and the efficiency of the CRAC. Airflow patterns in typical cloud-enabled IIoT data centers are complex and therefore lead to thermal recirculation (HR). HR phenomenon is the hot air formed at the outlet of the main machineThe cloud-enabled IIoT data center recirculates and mixes with the chilled air provided by the CRACs. HR matrix d describes the relationship between each pair of hosts, with entry di,kRepresents the i-ththGenerating host to kthThe recirculation rate of each host. HR phenomenon in cloud-enabled IIoT data centers results in iththThe inlet temperature of the host in the observed time slot qAbove the temperature provided byThe cold air of (2). Therefore, the HR phenomenon plays a key role in the increase in energy consumption of cloud-enabled IIoT data centers. The heat contribution of all hosts affects the iththThe inlet temperature of each host in the observed time slot q is given by the following formula:
to ensure reliability of all hosts in cloud-enabled IIoT data centers, the temperature of all portals Wherein T isupIs the warning temperature (nominal 70 ℃). Therefore, we can set the cool air temperature provided from the CRAC by equation (4). The overall structure is as follows:
the amount of heat generated by the host is proportional to the calculated energy consumption. Efficiency of CRAC units in generalCharacterized by a coefficient of performance (CoP), expressed as cold energy, to remove 100J of heat. It should be noted that CoP is generally related to the temperature (T) of the cold air suppliedsupply) Is non-linear. We use the CoP model of the HP data center:
CoP(Tsupply)=0.0068(Tsupply)2+0.0008Tsupply+0.458。
thus, the energy consumption of the cooling can be described as follows:
by combining the above models, we can derive a total consumption model:
with equation (5), we can further optimize (7) to get the final optimization goal:
2 GreenIIoT framework
The frame is divided into two parts: 1. the scheme of a multi-threshold-based host CPU utilization classification (MCU) scheme is responsible for dividing host into four categories: SU-hosts, SA-hosts, NL-hosts, and SO-hosts. 2. The energy and thermal awareness resource allocation (ETV) scheme uses related algorithms to find a host suitable for D2M service migration, and performs service migration to reduce energy consumption.
2.1 MCU scheme
The MCU scheme utilizes three thresholds Tlower,Tmiddle,TupperHost is divided into four categories: SU-hosts, SA-hosts, NL-hosts, and SO-hosts. The specific division is shown in fig. 1:
the division of the three thresholds was chosen by least mean square regression (LMS). More specifically, it is determined using the formulas (9) to (11):
Tupper=(1-c×LMS) (11)
the MCU scheme is described as follows:
1) obtain the current ithPrediction of CPU utilization for a hostThis helps to classify the hosts into the belonging group to which they correspond.
2) If it is notIdentifies the host as a member of the SO-hosts group. Those hosts that fall into the group must migrate some D2M services to SA-hostsGroups, thereby reducing SLA violations in an energy efficient manner.
3) In cloud-enabled IIoT datacenters, migrating too much D2M service from one host to another results in an unnerving increase in energy consumption and high SLA violations. Thus, in NL-hostsThe hosts in the group, all of their D2M services, remain unchanged.
4) If it is notThe host is identified as one of the members. The hosts belonging to the group must migrate all of their D2M services into SA-hosts. As a result, the hosts in SU-hosts will switch to a low power mode to save a lot of energy. These hosts will be reactivated as resource demands increase.
2.2ETV protocol
In the cloud-enabled IIoT data center, an efficient resource allocation algorithm of the D2M service contributes to efficient utilization of resources and reduction of energy consumption. To balance the tradeoff between computing and cooling systems, an ETV resource allocation scheme is proposed. The basic idea of the scheme is as follows: the D2M service resource allocation is directly dependent on the current temperature of the host. This means that when a host is selected for the D2M service for resource allocation, the current temperature of that host is lower than the lowest temperature of the other hosts in the cloud-enabled IIoT data center.
"HostList" and "ServiceList" in algorithm 1 refer to a host and a service in the cloud-enabled IIoT data center, respectively. GreenIIoT is divided into two stages: the first stage is as follows: allocating host resources for the new service, the second stage: service overload and under-service hosts are detected to minimize energy consumption and SLA violations, and resources are allocated for services in SA-hosts. We have discussed the CPU classification threshold Tlower,Tmiddle,Tupper. First, the algorithm sorts all D2M services in descending order according to their MIPS requirements. Thereafter, it is checked whether the D2M service resource requirements meet the requirements of the available hosts. If D2M service finds a host that meets the requirements, then T is usedlowerAnd TmiddleThe threshold value checks the corresponding host group. If none of the hosts meet the new D2M service requirements, the host that turned on sleep mode allocates resources for it. The SO-hosts and SU-hosts detection stages are key to minimize energy consumption, avoid performance degradation, and reduce SLA violations. Upon detection of the SO-hosts, the D2M service to be migrated is selected. In the next phase, the selected D2M service should be placed in the host based on the host temperature. The next algorithm is to describe the master according to each master temperatureAnd (5) machine resource allocation workflow.
Algorithm 2 is as follows:
algorithm 2 searches for the best host to obtain resource allocation. It will take the list of hosts and services as input and return the best suited host for allocation. In the first phase, the most suitable host is selected from either SO-hosts or SU-hosts for each scheduling interval (5 minutes in this example). The cost of each host is calculated by using the formula (8), and the cost of the host is compressed in each iteration, so that D2M resource allocation optimization is realized.
Algorithm 3 is as follows:
algorithm 3 is built based on the cost of energy and heat. It is expressed as HostList, services, Tlower,TmiddleAs an input, and returns the best feasible host list (bestfeasble-HostList), whose cost is calculated by equation (8). The first stage of the algorithm is through the use of TlowerAnd TmiddleTo make a feasible host list (FeasibleHostList), which limits the search space for the best feasible host list and reduces the time complexity. Finally, the process will return a BestFeasibleHostList to which the cost of each host belongs.
3, the technical effects of the invention are verified as follows:
to illustrate the effect, we first introduce the SLA index and the energy efficiency index (ME 2).
SLA plays a quality index role in cloud-enabled IIoT data centers, measuring, for example, the quality of service provided by a cloud manufacturing service provider to cloud service users. The SLA metric is used to measure the performance characteristics of the service object. Over time, the computational performance of the SO-hosts may degrade, which may increase SLA violations. The SLA metric is critical to the energy sensitive algorithm, and can be defined as follows:
Energy efficiency index (ME 2): the energy efficiency index (ME2) describes the overall performance of the proposed solution on the cloud-supported IIoT data center. By using the index, the system energy consumption efficiency and the SLA violation can be known. The larger the value of ME2, the higher the overall performance of the solution in the cloud-enabled IIoT data center. Thus, if the ME2 value of the proposed solution is greater than other solutions, the solution may be more efficient in cloud-enabled IIoT datacenters. The formula for ME2 is described as follows:
and simulating the system environment by utilizing a cloudsim tool, and performing related tests on the simulated environment. The superiority of the system will be explained from five aspects:
1) energy consumption: the energy consumed by the host is primarily related to CPU and memory utilization. However, on modern hosts using large storage devices, multi-core CPUs and large hard disks, the traditional linear power consumption model is no longer applicable. Simulation results of this protocol were analyzed and compared with KMI-MR, KMI-MP, RANDOM, and PABFD. The results of the simulation of energy consumption are shown in fig. 2. In terms of energy consumption, the ETV method and KMI-MR, KMI-MP, PABFD, RANDOM methods have energy consumptions of 32.5kWh, 43.2kWh, 41.1kWh, 49.3kWh, 76.7kWh, respectively. In other words, ETV reduces consumption by 24%, 20%, 34% and 57% over KMI-MR, KMI-MP, PABFD and RANDOM, respectively, as shown in FIG. 2.
2) SLA violation: over-migrating the D2M service can result in severe SLA standard violations in cloud-enabled IIoT data centers. FIG. 3 compares the SLA violation percentage of KLA-MR, KMI-MP, RANDOM and PABFD to ETV. As in the 03-Mar experiment, the methods KMI-MR, KMI-MP, PABFD, RANDOM and ETV gave SLA violation percentages of 7.2%, 9.5%, 9%, 12% and 6%, respectively. In other words, the ETV protocol SLA was 16%, 36%, 33% and 50% less than KMI-MR, KMI-MP, PABFD and RANDOM, respectively. Thus, the proposed scheme reduces the percentage of SLA violations in cloud-enabled IIoT datacenters, as shown in fig. 3.
3) ME 2: ME2 is used to evaluate the overall performance of the cloud-enabled IIoT data center. Cloud manufacturing service providers aim to minimize energy consumption and violations of SLAs while maximizing overall performance. FIG. 4 shows that ME2 is better for the ETV scheme compared to KMI-MR, KMI-MP, RANDOM and PABFD methods. Methods KMI-ME 2 for MR, KMI-MP, PABFD, RANDOM and ETV were 16.2, 12.9, 13.1, 9.6 and 19.7, respectively. Thus, the overall performance with the ETV resource allocation scheme is much better than other approaches, as shown in fig. 4.
4) Temperature of the host: the temperature of the host directly affects the operating costs (energy consumption, cooling costs) of the cloud-enabled IIoT data center. FIG. 5 compares the results of simulations of this algorithm with host temperatures of KMI-MR, KMI-MP, RANDOM, and PABFD. The proposed ETV algorithm does not exceed the maximum temperature (T) due to its energy and thermally aware resource allocation schemeup). FIG. 4 shows that the temperature of the host is always Tup(70 ℃) nearby, which may maximize resource utilization and minimize cooling costs for the cloud-enabled IIoT environment, as shown in fig. 5.
5) The number of hosts is turned off: the reactivated host directly affects power consumption. If the number thereof increases, the energy consumption also increases. The host will reactivate when assigned to a new D2M service and shut down when idle is detected. FIG. 6 analyzes and compares the results of the simulation for the number of host shutdowns. In total, the ETV scheme was compared to the simulation results of KMI-MR, KMI-MP, RANDOM and PABFD for the number of master closures. In the 03-Mar experiment, the algorithms KMI-MR, KMI-MP, PABFD, RANDOM, and ETV host shut down times were 1950, 1800, 2200, 2500, and 1500, respectively. In other words, proposed solution (ETV) SLA violations were 23%, 16%, 31% and 40% less than KMI-MR, KMI-MP, PABFD and RANDOM, respectively. The following figure shows that the proposed solution (ETV) is more efficient than the KMI-MR, KMI-MP, PABFD and RANDOM methods, due to the smaller number of hosts that are reactivated. In this simulation setup, we use only 800 hosts. However, due to the reactivation of the host, the number of hosts that are shut down exceeds 800. Compared to the KMI-MR, KMI-MP, PABFD and RANDOM methods, the proposed scheme significantly reduces the number of host reactivations, as shown in FIG. 6.
Claims (5)
1. An energy-saving resource allocation method for data-driven manufacturing service in the industrial internet of things comprises the following steps: the method is characterized in that:
step one, detecting the CPU utilization rate: detecting the utilization rate of a host CPU in the cloud-enabled IIoT data center, then classifying the utilization rates, and setting three threshold values T according to the utilization rate of the host CPUlower,Tmiddle,TupperClassifying the hosts, and sequentially classifying the hosts into four classes, namely SU-hosts, SA-hosts, NL-hosts and S0-hosts according to threshold values from low to high;
step two, determining services to be migrated, all D2M services on SU-hosts and D2M services selected from S0-hosts;
and step three, searching a proper host to allocate resources for the D2M service determined to be moved in the step two, finding a host suitable for D2M service migration by using an energy and thermal perception resource allocation scheme, and performing service migration to reduce energy consumption.
2. The method for allocating energy-saving resources for data-driven manufacturing services in the internet of things of industry according to claim 1, wherein the method comprises the following steps: three threshold values T in the step onelower,Tmiddle,TupperThe determination process of (2) is:
the determination of the three thresholds is selected by a least median square regression model, and is specifically determined by using formulas (9) to (11):
Tupper=(1-c×LMS) (11)
LMS in the formula represents the square of the minimum median; and c represents a safety factor, and the value of c is 0.5.
3. The method for allocating energy-saving resources for data-driven manufacturing services in the internet of things of industry according to claim 2, wherein the method comprises the following steps:
the classification of the utilization rate based on the above three thresholds is described as follows:
1) obtaining the current ithPrediction of CPU utilization for a hostClassifying the hosts into an affiliated group corresponding thereto;
2) if, ifIdentifies the host as a member of the SO-hosts group, and hosts belonging to the group must migrate some D2M services toGroups to reduce SLA violations;
4. The method for allocating energy-saving resources for data-driven manufacturing services in the internet of things of industry according to claim 1, 2 or 3, wherein the specific implementation process of the second step is as follows:
modeling energy consumption issues in a cloud-enabled IIoT environment, a set of n D2M services S ═ is defined (S)1,s2,....,sn) H ═ H needs to be placed on m hosts1,h2,....,hm) And G represents a gateway device; energy consumption of the cloud-enabled IIoT environment includes computational energy consumption and cooling energy consumption, observed time is divided into l (q ═ 1, 2.. ·, l) time slots, each time slot having a duration of κ;
the allocation of D2M services to the cloud-enabled IIoT data center is described with an energy consumption model and a cooling energy consumption model;
the energy consumption model is as follows:
wherein:representing the consumption of base power, P, by each hosthostRepresents the total power consumption consumed by the host,andmaximum power consumption of the host and the gateway, respectively, over a period of time; deltajHolding a binary value (0, 1); if the jth D2M service gets resources from the host, then the value of δ j is "1", noThen "0"; CPU(s)j) Represents the total number of CPUs required for the jth D2M service; phostThe formula indicates that the utilization of the host is derived from the ratio of the total number of CPU cores per D2M service request associated with the D2M service to the total number of CPU cores of the host;
c is the capacity of the original bearer network, CmaxIs the maximum network capacity;consuming base power, P, on behalf of the gatewaygateRepresents the total power consumed by the gateway;
during the observation time, the overall computing power consumption of the cloud-enabled IIoT environment is represented by a matrix P, the elements in the matrix P are determined;
in summary, the computational energy consumption model of the cloud-enabled IIoT environment is defined as follows:
the refrigeration energy consumption model is as follows:
in cloud-enabled IIoT data centers, the energy consumed by Computer Room Air Conditioners (CRACs), referred to as cooling energy, depends on the heat generated by the host and the efficiency of the CRACs; HR matrix d describes the relationship between each pair of hosts, with entry di,kRepresents the i-ththGenerating host to kthThe recirculation rate of each host; the heat contribution of all hosts affects the iththThe inlet temperature of each host in the observed time slot q is given by the following formula:
which is indicative of the inlet temperature, is,which is indicative of the temperature being supplied,
all inlet temperaturesWherein T isupIs the warning temperature (nominal 70 ℃), the temperature of the cold air provided from the CRAC is set by equation (4) as follows:
using the CoP model:
CoP(Tsupply)=0.0068(Tsupply)2+0.0008Tsupply+0.458 to describe the refrigeration energy consumption model:
and (3) integrating the models in the formula (3) and the formula (6) to obtain a total consumption model:
further optimization (7) can be achieved using equation (5), resulting in the final optimization objective:
searching for the best host to obtain resource allocation: the D2M resource allocation optimization is achieved by selecting the most appropriate host from either SO-hosts or SU-hosts at each scheduling interval based on obtaining the list of hosts and services, with the cost of each host calculated using equation (8), and compressing the host cost in each iteration.
5. The energy-saving resource allocation method for the data-driven manufacturing service in the industrial Internet of things as claimed in claim 4, wherein the concrete implementation process of the third step is as follows:
balancing the trade-off between computing and cooling systems with an ETV resource allocation scheme, D2M service resource allocation is directly dependent on the current temperature of the hosts, which is the lowest temperature among hosts in the cloud-enabled IIoT data center when selecting hosts for resource allocation for the D2M service, constructed based on costs of energy and thermal energy, from a list of hosts, D2M service, Tlower、TmiddleUsing equation (8) to make a feasible host list, the host list search space is sorted to find the best feasible host list.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911169997.2A CN111083201B (en) | 2019-11-25 | 2019-11-25 | Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911169997.2A CN111083201B (en) | 2019-11-25 | 2019-11-25 | Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111083201A true CN111083201A (en) | 2020-04-28 |
CN111083201B CN111083201B (en) | 2022-03-04 |
Family
ID=70311638
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911169997.2A Active CN111083201B (en) | 2019-11-25 | 2019-11-25 | Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111083201B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115270139A (en) * | 2022-09-20 | 2022-11-01 | 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) | IoT equipment network service automatic vulnerability analysis method and system |
CN117148955A (en) * | 2023-10-30 | 2023-12-01 | 北京阳光金力科技发展有限公司 | Data center energy consumption management method based on energy consumption data |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100180275A1 (en) * | 2009-01-15 | 2010-07-15 | International Business Machines Corporation | Techniques for placing applications in heterogeneous virtualized systems while minimizing power and migration cost |
US20110191461A1 (en) * | 2010-02-02 | 2011-08-04 | International Business Machines Corporation | Systems and methods for using workload characteristics for sizing and placement for power-aware consolidation |
US20110282982A1 (en) * | 2010-05-13 | 2011-11-17 | Microsoft Corporation | Dynamic application placement based on cost and availability of energy in datacenters |
CN103957261A (en) * | 2014-05-06 | 2014-07-30 | 湖南体运通信息技术有限公司 | Cloud computing resource distributing method based on energy consumption optimization |
US20150039764A1 (en) * | 2013-07-31 | 2015-02-05 | Anton Beloglazov | System, Method and Computer Program Product for Energy-Efficient and Service Level Agreement (SLA)-Based Management of Data Centers for Cloud Computing |
CN106598733A (en) * | 2016-12-08 | 2017-04-26 | 南京航空航天大学 | Three-dimensional virtual resource scheduling method of cloud computing energy consumption key |
CN108052375A (en) * | 2017-12-29 | 2018-05-18 | 哈尔滨工业大学 | A kind of host overload detection method |
CN108292559A (en) * | 2016-02-05 | 2018-07-17 | Abb瑞士股份有限公司 | Method and system for the cooling system for controlling power equipment |
CN109491760A (en) * | 2018-10-29 | 2019-03-19 | 中国科学院重庆绿色智能技术研究院 | A kind of high-effect data center's Cloud Server resource autonomous management method and system |
-
2019
- 2019-11-25 CN CN201911169997.2A patent/CN111083201B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100180275A1 (en) * | 2009-01-15 | 2010-07-15 | International Business Machines Corporation | Techniques for placing applications in heterogeneous virtualized systems while minimizing power and migration cost |
US20110191461A1 (en) * | 2010-02-02 | 2011-08-04 | International Business Machines Corporation | Systems and methods for using workload characteristics for sizing and placement for power-aware consolidation |
US20110282982A1 (en) * | 2010-05-13 | 2011-11-17 | Microsoft Corporation | Dynamic application placement based on cost and availability of energy in datacenters |
US20150039764A1 (en) * | 2013-07-31 | 2015-02-05 | Anton Beloglazov | System, Method and Computer Program Product for Energy-Efficient and Service Level Agreement (SLA)-Based Management of Data Centers for Cloud Computing |
CN103957261A (en) * | 2014-05-06 | 2014-07-30 | 湖南体运通信息技术有限公司 | Cloud computing resource distributing method based on energy consumption optimization |
CN108292559A (en) * | 2016-02-05 | 2018-07-17 | Abb瑞士股份有限公司 | Method and system for the cooling system for controlling power equipment |
CN106598733A (en) * | 2016-12-08 | 2017-04-26 | 南京航空航天大学 | Three-dimensional virtual resource scheduling method of cloud computing energy consumption key |
CN108052375A (en) * | 2017-12-29 | 2018-05-18 | 哈尔滨工业大学 | A kind of host overload detection method |
CN109491760A (en) * | 2018-10-29 | 2019-03-19 | 中国科学院重庆绿色智能技术研究院 | A kind of high-effect data center's Cloud Server resource autonomous management method and system |
Non-Patent Citations (4)
Title |
---|
LIANPENG LI 等: "Minimizing SLA Violation and Power Consumption in Cloud Data Centers Using Host State 3-Order Markov Chain Model", 《2019 IEEE 21ST INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS;》 * |
RAHUL YADAV 等: "Adaptive Energy-Aware Algorithms for Minimizing Energy Consumption and SLA Violation in Cloud Computing", 《IEEE ACCESS》 * |
ZHOU ZHOU 等: "Minimizing SLA violation and power consumption in Cloud data centers using adaptive energy-aware algorithms", 《FUTURE GENERATION COMPUTER SYSTEMS》 * |
欧阳飞: "感知数据驱动的制造装备运行能量有效评估方法研究", 《万方数据库》 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115270139A (en) * | 2022-09-20 | 2022-11-01 | 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) | IoT equipment network service automatic vulnerability analysis method and system |
CN115270139B (en) * | 2022-09-20 | 2023-01-17 | 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) | IoT equipment network service automatic vulnerability analysis method and system |
CN117148955A (en) * | 2023-10-30 | 2023-12-01 | 北京阳光金力科技发展有限公司 | Data center energy consumption management method based on energy consumption data |
CN117148955B (en) * | 2023-10-30 | 2024-02-06 | 北京阳光金力科技发展有限公司 | Data center energy consumption management method based on energy consumption data |
Also Published As
Publication number | Publication date |
---|---|
CN111083201B (en) | 2022-03-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109800066B (en) | Energy-saving scheduling method and system for data center | |
Hameed et al. | A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems | |
Ilager et al. | ETAS: Energy and thermal‐aware dynamic virtual machine consolidation in cloud data center with proactive hotspot mitigation | |
Zhu et al. | A three-dimensional virtual resource scheduling method for energy saving in cloud computing | |
Zhang et al. | Towards joint optimization over ICT and cooling systems in data centre: A survey | |
Liu et al. | Renewable and cooling aware workload management for sustainable data centers | |
Chaudhry et al. | Thermal-aware scheduling in green data centers | |
Li et al. | Holistic energy and failure aware workload scheduling in Cloud datacenters | |
Kaushik et al. | T*: A data-centric cooling energy costs reduction approach for Big Data analytics cloud | |
US8856321B2 (en) | System to improve operation of a data center with heterogeneous computing clouds | |
Yi et al. | Efficient compute-intensive job allocation in data centers via deep reinforcement learning | |
US9037880B2 (en) | Method and system for automated application layer power management solution for serverside applications | |
Yi et al. | Toward efficient compute-intensive job allocation for green data centers: A deep reinforcement learning approach | |
Lee et al. | Proactive thermal-aware resource management in virtualized HPC cloud datacenters | |
Lee et al. | Vmap: Proactive thermal-aware virtual machine allocation in hpc cloud datacenters | |
Wang et al. | Opportunities and challenges to unify workload, power, and cooling management in data centers | |
Zhang et al. | Two-phase industrial manufacturing service management for energy efficiency of data centers | |
CN111813502B (en) | Computing resource management scheduling method for industrial edge node | |
Chaabouni et al. | Energy management strategy in cloud computing: a perspective study | |
Jin et al. | Energy-efficient task scheduling for CPU-intensive streaming jobs on Hadoop | |
CN111083201B (en) | Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things | |
Oxley et al. | Rate-based thermal, power, and co-location aware resource management for heterogeneous data centers | |
Mazidi et al. | Autonomic resource provisioning for multilayer cloud applications with K‐nearest neighbor resource scaling and priority‐based resource allocation | |
Zhang et al. | An energy and SLA-aware resource management strategy in cloud data centers | |
CN103984588B (en) | Virtual machine migration method based on temperature and system thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |