CN111083201A - Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things - Google Patents

Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things Download PDF

Info

Publication number
CN111083201A
CN111083201A CN201911169997.2A CN201911169997A CN111083201A CN 111083201 A CN111083201 A CN 111083201A CN 201911169997 A CN201911169997 A CN 201911169997A CN 111083201 A CN111083201 A CN 111083201A
Authority
CN
China
Prior art keywords
host
hosts
service
energy
energy consumption
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911169997.2A
Other languages
Chinese (zh)
Other versions
CN111083201B (en
Inventor
张伟哲
周擎阳
刘川意
何慧
方滨兴
王德胜
周勇林
朱勇
余翔湛
刘亚维
崔丽杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN201911169997.2A priority Critical patent/CN111083201B/en
Publication of CN111083201A publication Critical patent/CN111083201A/en
Application granted granted Critical
Publication of CN111083201B publication Critical patent/CN111083201B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1029Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/329Power saving characterised by the action undertaken by task scheduling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1008Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/50Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

An energy-saving resource allocation method for data-driven manufacturing service in the industrial Internet of things belongs to the industrial Internet of things optimization technology. The invention aims to realize real-time monitoring and adjustment of the distributed tasks, reduce the resource consumption of the system, ensure that SLA is delivered by a cloud manufacturing service provider and reduce the energy consumption and cooling cost of the host. Detecting the utilization rate of a CPU; determining all D2M services on SU-hosts and a D2M service selected from SO-hosts to be migrated out of the service; and searching suitable hosts to allocate resources for the D2M service determined to be moved, finding suitable hosts for D2M service migration by utilizing an energy and thermal perception resource allocation scheme, and performing service migration to reduce energy consumption. The invention considers the energy-saving consumption of resource allocation, carries out real-time monitoring and adjustment after the task allocation, reduces the resource consumption of the system, ensures that SLA is delivered by a cloud manufacturing service provider, and simultaneously reduces the energy consumption and the cooling cost of the host.

Description

Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things
Technical Field
The invention relates to an energy-saving resource allocation method for data-driven manufacturing service, and belongs to the industrial Internet of things optimization technology.
Background
Industry 4.0 refers to the process of manufacturing digitization for the purpose of creating an ecosystem for an industry that is focused on manufacturing and supply chain management. An industrial internet of things (IIoT) includes smart sensors, camera systems, smart meters, industrial robots and actuators to utilize smart machines and the ability to perform real-time analysis in a cloud-enabled IIoT environment. According to the relevant reports, predictions of IIoT market growth are expected to grow from $ 640 billion in 2018 to 914.0 billion dollars in 2023 with a compound annual growth rate of 7.39%. In data driven manufacturing (D2M) services, IIoT devices have great potential in sustainable and green practice, supply chain traceability, quality control and overall supply chain efficiency. Therefore, to provide efficient and accurate D2M services, a large amount of data is generated from these IIoT devices and used for analysis in cloud-enabled IIoT data centers.
Cloud-enabled IIoT environments provide MaaS, a manufacturing as a service, to the manufacturing industry, benefiting the industry by minimizing operational and management costs. MaaS includes different types of D2M services (e.g., supply chain management and optimization, predictive maintenance/analysis, and asset tracking and optimization), requiring significant computing, network, and storage resources to deliver to end service users. Therefore, the cloud-enabled IIoT environment requires a large amount of energy and increases with the rapid increase in D2M service demand. Currently, cloud-enabled IIoT data centers encounter problems of high energy consumption, high temperature and Service Level Agreement (SLA) violation, which are all huge challenges in the research community. For example, in the united states, cloud-enabled IIoT data centers consume approximately 2% (700 billion kilowatt-hours) of total energy. By 2030, the energy consumption of cloud-enabled IIoT data centers can be reduced from 8000TWh to 1200TWh if necessary. Therefore, improving the energy efficiency of cloud-supportable IIoT data centers is critical to a sustainable and cost-effective cloud-supportable IIoT environment. The energy consumption of the cloud-enabled IIoT environment is proportional to the energy consumption of the servers (hosts) and the heat dissipation cost or temperature of the hosts.
The prior art with the reference number of CN109491790A provides a container-based industrial internet of things edge computing resource allocation method and system, and the method comprises the following steps: dividing the tasks into n types according to the data types collected by the sensing layer, and obtaining the probability relation of the tasks sequentially reaching the edge server cluster through historical data statistics; distributing computing resources to the real-time tasks according to the system state space and the decision space, and performing sequence decision; according to a resource allocation algorithm based on reinforcement learning, a system selects the most reasonable strategy from three resource allocation strategies of low, medium and high according to the current state to allocate resources to the current task; and constructing a task scheduling processing model, creating a container, scheduling data to the container for processing and analysis, and deleting the container after the task is completed to complete distribution. In the prior art, under the condition of limited resources, the resources are distributed to different types of data calculation, and containers are created for processing and analysis, so that the resource use efficiency and the total task processing rate are improved. The prior art does not consider energy-saving consumption of resource allocation, and real-time monitoring and adjustment are not carried out after task allocation, so that the consumption of system resources is increased.
Disclosure of Invention
The invention provides an energy-saving resource allocation method for data-driven manufacturing service in an industrial Internet of things, aiming at realizing real-time monitoring and adjustment of allocated tasks, reducing system resource consumption, ensuring that SLA is delivered by a cloud manufacturing service provider and reducing host energy consumption and cooling cost.
The technical scheme adopted by the invention for solving the technical problems is as follows:
an energy-saving resource allocation method for data-driven manufacturing service in the industrial internet of things comprises the following steps:
step one, detecting the CPU utilization rate: detecting host CPU utilization in cloud enabled IIoT data center, then performing utilization classification (MCU), and setting three threshold values T according to the host CPU utilizationlower,Tmiddle,TupperClassifying hosts (hosts), and sequentially classifying the hosts into four classes, namely SU-hosts, SA-hosts, NL-hosts and SO-hosts, from low to high according to threshold values;
step two, determining all D2M services on SU-hosts and D2M services selected from SO-hosts (D2M services refer to data-driven manufacturing services) to be migrated out of the services;
and step three, searching a proper host to allocate resources for the D2M service determined to be moved in the step two, finding a host suitable for D2M service migration by using an energy and thermal perception resource allocation (ETV) scheme, and performing service migration to reduce energy consumption.
Further, three thresholds T are set in step onelower,Tmiddle,TupperThe determination process of (2) is:
the determination of the three thresholds is selected by a least median square regression model, and is specifically determined by using formulas (9) to (11):
Figure BDA0002288063450000021
Figure BDA0002288063450000022
Tupper=(1-c×LMS) (11)
LMS in the formula represents the square of the minimum median; and c represents a safety factor, and the value of c is 0.5.
Further, the utilization rate classification (MCU) based on the above three thresholds is described as follows:
1) obtaining the current ithPrediction of CPU utilization for a host
Figure BDA0002288063450000023
Classifying hosts to their corresponding affiliations
2) If, if
Figure BDA0002288063450000031
Identifies the host as a member of the SO-hosts group, and hosts belonging to the group must migrate some D2M services to SA-hosts
Figure BDA0002288063450000032
Groups to reduce SLA violations;
3) at NL-hosts
Figure BDA0002288063450000033
Hosts in the group, all their D2M services remain unchanged;
4) if, if
Figure BDA0002288063450000034
The host is identified as one of the members and the hosts belonging to the group must migrate all of their D2M services into SA-hosts.
Further, the specific implementation process of the step two is as follows:
modeling energy consumption issues in a cloud-enabled IIoT environment, a set of n D2M services S ═ is defined (S)1,s2,....,sn) H ═ H needs to be placed on m hosts1,h2,....,hm) And G represents a gateway device; energy consumption of the cloud-enabled IIoT environment includes computational energy consumption and cooling energy consumption, observed time is divided into l (q ═ 1, 2.. ·, l) time slots, each time slot having a duration of κ;
the allocation of D2M services to the cloud-enabled IIoT data center is described with an energy consumption model and a cooling energy consumption model;
the energy consumption model is as follows:
Figure BDA0002288063450000035
Figure BDA0002288063450000036
wherein:
Figure BDA0002288063450000037
representing the consumption of base power, P, by each hosthostRepresents the total power consumption consumed by the host,
Figure BDA0002288063450000038
and
Figure BDA0002288063450000039
maximum power consumption of the host and the gateway in a period of time respectively; deltajHolding a binary value (0, 1); if the jth D2M service acquires resources from the host, the value of δ j is "1", otherwise, the value is "0"; CPU(s)j) Represents the total number of CPUs required for the jth D2M service; phostThe formula indicates that the utilization of the host is derived from the ratio of the total number of CPU cores per D2M service request associated with the D2M service to the total number of CPU cores of the host;
c is the capacity of the original bearer network, CmaxIs the maximum network capacity;
Figure BDA00022880634500000310
consuming base power, P, on behalf of the gatewaygateRepresents the total power consumed by the gateway;
during the observation time, the overall computing power consumption of the cloud-enabled IIoT environment is represented by a matrix P,
Figure BDA00022880634500000311
(q=1,2,..., l;i=1,2,...,m)the elements in the matrix P are determined;
in summary, the computational energy consumption model of the cloud-enabled IIoT environment is defined as follows:
Figure BDA0002288063450000041
the refrigeration energy consumption model is as follows:
in cloud-enabled IIoT data centers, the energy consumed by Computer Room Air Conditioners (CRACs), referred to as cooling energy, is dependent on the heat generated by the host and the efficiency of the CRACs; HR matrix d describes the relationship between each pair of hosts, with entry di,kRepresents the i-ththGenerating host to kthThe recirculation rate of each host; the heat contribution of all hosts affects the iththThe inlet temperature of each host in the observed time slot q is given by the following formula:
Figure BDA0002288063450000042
Figure BDA0002288063450000043
which is indicative of the inlet temperature, is,
Figure BDA0002288063450000044
which is indicative of the temperature being supplied,
all inlet temperatures
Figure BDA0002288063450000045
Wherein T isupIs the warning temperature (nominal 70 ℃), the temperature of the cold air provided from the CRAC is set by equation (4) as follows:
Figure BDA0002288063450000046
using the CoP model:
CoP(Tsupply)=0.0068(Tsupply)2+0.0008Tsupply+0.458 to describe the refrigeration energy consumption model:
Figure BDA0002288063450000047
and (3) integrating the models in the formula (3) and the formula (6) to obtain a total consumption model:
Figure BDA0002288063450000048
further optimization (7) can be achieved using equation (5), resulting in the final optimization objective:
Figure BDA0002288063450000051
searching for the best host to obtain resource allocation: the D2M resource allocation optimization is achieved by selecting the most appropriate host from either SO-hosts or SU-hosts at each scheduling interval based on obtaining the list of hosts and services, with the cost of each host calculated using equation (8), and compressing the host cost in each iteration.
Further, the specific implementation process of the step three is as follows:
balancing the trade-off between computing and cooling systems with an ETV resource allocation scheme, D2M service resource allocation is directly dependent on the current temperature of the hosts, which is the lowest temperature among hosts in the cloud-enabled IIoT data center when selecting hosts for resource allocation for the D2M service, constructed based on costs of energy and thermal energy, from a list of hosts, D2M service, Tlower、TmiddleUsing equation (8) to make a feasible host list, the host list search space is sorted to find the best feasible host list.
The invention has the following beneficial technical effects: the present invention provides a solution to how to reduce host power consumption and cooling costs while ensuring that SLAs are delivered by cloud manufacturing service providers. It can be seen that increasing the level of host resource utilization in a cloud-enabled IIoT data center can minimize the overall energy consumption of the cloud-enabled IIoT environment. However, simply increasing host utilization may affect the temperature of hosts and SLAs delivered by the cloud manufacturing service provider. Therefore, D2M service should be selected for reallocation from either service-overloaded hosts (SO hosts) or service-underloaded hosts (SU hosts) according to current resource demand to reduce SLA violations. The number of active hosts is reduced by switching idle hosts to a power saving mode to reduce power consumption. When D2M service workload demand increases, the host may be reactivated. The present invention performs energy-saving resource allocation using three main tasks: (1) detecting the utilization rate of a CPU; (2) selecting a D2M service from the SO host; (3) searching for a suitable host allocates resources for the D2M service. The invention considers the energy-saving consumption of resource allocation, carries out real-time monitoring and adjustment after the task allocation, reduces the resource consumption of the system, ensures that a cloud manufacturing service provider delivers SLA and reduces the energy consumption and cooling cost of the host.
Drawings
FIG. 1 shows that the MCU scheme uses three thresholds Tlower, Tmiddle, Tupper to classify host into four categories: graphs of the results of SU-hosts, SA-hosts, NL-hosts, and SO-hosts;
FIG. 2 is a graph of the energy consumption simulation results of the method of the present invention;
FIG. 3 is a graph of the results comparing the SLA violation percentage of KLA-MR, KMI-MP, RANDOM and PABFD to ETV;
FIG. 4 is a graph of the results of the ETV protocol compared to the KMI-MR, KMI-MP, RANDOM and PABFD methods;
FIG. 5 is a graph of simulation results of an ETV scheme versus host temperature of KMI-MR, KMI-MP, RANDOM, and PABFD;
FIG. 6 is a graph of simulation results of an ETV scheme versus host shutdown numbers of KMI-MR, KMI-MP, RANDOM, and PABFD;
the abscissa in fig. 1 represents cpu utilization, and the ordinate represents the number of hosts;
the abscissa in fig. 2 represents the different algorithms and the ordinate represents the energy consumption;
the abscissa in fig. 3 represents different algorithms, and the ordinate represents SLA metric violation rate;
the abscissa in fig. 4 represents the different algorithms and the ordinate represents the specific value of the ME2 index;
the abscissa in fig. 5 represents different algorithms and the ordinate represents the host temperature;
the abscissa in fig. 6 represents different algorithms, and the ordinate represents the number of host shutdowns;
the ETV protocol and KMI-MR, KMI-MP, RANDOM, and PABFD are defined herein, reference KMI-MR, reference KMI-MP, reference RANDOM, and reference PABFD, respectively.
Detailed Description
With reference to fig. 1 to 5, the energy-saving resource allocation method for data-driven manufacturing service in the internet of things of the industry according to the present invention is explained as follows:
1, modeling and problem formulation description of a system, and performing model research and formulation work on the energy consumption problem in the cloud-supported IIoT environment in order to better explain the problem. The following formalization is described:
a set of n D2M services S ═ (S)1,s2,....,sn) H ═ H needs to be placed on m hosts1,h2,...., hm) And G represents a gateway device. The energy consumption of the cloud-enabled IIoT environment includes computing energy consumption and cooling energy consumption. The observed time is divided into l (q ═ 1, 2.. eta., l) time slots, each time slot having a duration of κ. For the distribution algorithm for distributing D2M service to the cloud-enabled IIoT data center, we will describe its energy consumption model and thermal perception energy consumption model, respectively.
1.1 calculating energy consumption model
In the cloud-enabled IIoT environment, the computational energy consumption is determined by the energy consumed by the CPU, storage, memory, and network. However, the CPU is the primary computational energy consumer. Therefore, the computational power consumption model focuses mainly on the power consumption of the CPU. The energy consumed by the gateway is determined by its network carrying capacity, as follows:
Figure BDA0002288063450000061
Figure BDA0002288063450000062
each host consuming base power
Figure BDA0002288063450000063
To support basic tasks such as networking, monitoring and running instance fans to perform host heat dissipation. Wherein P ishostRepresents the total power consumption consumed by the host,
Figure BDA0002288063450000064
and
Figure BDA0002288063450000065
the maximum power consumption of the host and the gateway, respectively, over a period of time. C is the capacity of the original bearer network, CmaxIs the maximum network capacity. DeltajThe binary value (0,1) is maintained. If the jth D2M service gets resources from the host, then the value of δ j is "1", otherwise it is "0". CPU(s)j) Representing the total number of CPUs required for the jth D2M service. The above equation indicates that the utilization of the host is derived from the ratio of the total number of CPU cores per D2M service request associated with the D2M service to the total number of CPU cores of the host. During the observation time, the overall computing power consumption of the cloud-enabled IIoT environment is represented by a matrix P,
Figure BDA0002288063450000066
(q 1, 2.. said., l; i 1, 2.. said., m) determines the elements in the matrix P. The computational energy consumption model of the cloud-enabled IIoT environment is defined as follows:
Figure BDA0002288063450000071
1.2 refrigeration energy consumption model
In cloud-enabled IIoT data centers, the energy consumed by Computer Room Air Conditioners (CRACs) is referred to as cooling energy. It depends on the heat generated by the host and the efficiency of the CRAC. Airflow patterns in typical cloud-enabled IIoT data centers are complex and therefore lead to thermal recirculation (HR). HR phenomenon is the hot air formed at the outlet of the main machineThe cloud-enabled IIoT data center recirculates and mixes with the chilled air provided by the CRACs. HR matrix d describes the relationship between each pair of hosts, with entry di,kRepresents the i-ththGenerating host to kthThe recirculation rate of each host. HR phenomenon in cloud-enabled IIoT data centers results in iththThe inlet temperature of the host in the observed time slot q
Figure BDA0002288063450000072
Above the temperature provided by
Figure BDA0002288063450000073
The cold air of (2). Therefore, the HR phenomenon plays a key role in the increase in energy consumption of cloud-enabled IIoT data centers. The heat contribution of all hosts affects the iththThe inlet temperature of each host in the observed time slot q is given by the following formula:
Figure BDA0002288063450000074
to ensure reliability of all hosts in cloud-enabled IIoT data centers, the temperature of all portals
Figure BDA0002288063450000075
Figure BDA0002288063450000076
Wherein T isupIs the warning temperature (nominal 70 ℃). Therefore, we can set the cool air temperature provided from the CRAC by equation (4). The overall structure is as follows:
Figure BDA0002288063450000077
Figure BDA0002288063450000078
the amount of heat generated by the host is proportional to the calculated energy consumption. Efficiency of CRAC units in generalCharacterized by a coefficient of performance (CoP), expressed as cold energy, to remove 100J of heat. It should be noted that CoP is generally related to the temperature (T) of the cold air suppliedsupply) Is non-linear. We use the CoP model of the HP data center:
CoP(Tsupply)=0.0068(Tsupply)2+0.0008Tsupply+0.458。
thus, the energy consumption of the cooling can be described as follows:
Figure BDA0002288063450000081
by combining the above models, we can derive a total consumption model:
Figure BDA0002288063450000082
with equation (5), we can further optimize (7) to get the final optimization goal:
Figure BDA0002288063450000083
2 GreenIIoT framework
The frame is divided into two parts: 1. the scheme of a multi-threshold-based host CPU utilization classification (MCU) scheme is responsible for dividing host into four categories: SU-hosts, SA-hosts, NL-hosts, and SO-hosts. 2. The energy and thermal awareness resource allocation (ETV) scheme uses related algorithms to find a host suitable for D2M service migration, and performs service migration to reduce energy consumption.
2.1 MCU scheme
The MCU scheme utilizes three thresholds Tlower,Tmiddle,TupperHost is divided into four categories: SU-hosts, SA-hosts, NL-hosts, and SO-hosts. The specific division is shown in fig. 1:
the division of the three thresholds was chosen by least mean square regression (LMS). More specifically, it is determined using the formulas (9) to (11):
Figure RE-GDA0002373549830000054
Figure BDA0002288063450000085
Tupper=(1-c×LMS) (11)
the MCU scheme is described as follows:
1) obtain the current ithPrediction of CPU utilization for a host
Figure BDA0002288063450000091
This helps to classify the hosts into the belonging group to which they correspond.
2) If it is not
Figure BDA0002288063450000092
Identifies the host as a member of the SO-hosts group. Those hosts that fall into the group must migrate some D2M services to SA-hosts
Figure BDA0002288063450000093
Groups, thereby reducing SLA violations in an energy efficient manner.
3) In cloud-enabled IIoT datacenters, migrating too much D2M service from one host to another results in an unnerving increase in energy consumption and high SLA violations. Thus, in NL-hosts
Figure BDA0002288063450000094
The hosts in the group, all of their D2M services, remain unchanged.
4) If it is not
Figure BDA0002288063450000095
The host is identified as one of the members. The hosts belonging to the group must migrate all of their D2M services into SA-hosts. As a result, the hosts in SU-hosts will switch to a low power mode to save a lot of energy. These hosts will be reactivated as resource demands increase.
2.2ETV protocol
In the cloud-enabled IIoT data center, an efficient resource allocation algorithm of the D2M service contributes to efficient utilization of resources and reduction of energy consumption. To balance the tradeoff between computing and cooling systems, an ETV resource allocation scheme is proposed. The basic idea of the scheme is as follows: the D2M service resource allocation is directly dependent on the current temperature of the host. This means that when a host is selected for the D2M service for resource allocation, the current temperature of that host is lower than the lowest temperature of the other hosts in the cloud-enabled IIoT data center.
Algorithm 1 is shown below.
Figure BDA0002288063450000096
Figure BDA0002288063450000101
"HostList" and "ServiceList" in algorithm 1 refer to a host and a service in the cloud-enabled IIoT data center, respectively. GreenIIoT is divided into two stages: the first stage is as follows: allocating host resources for the new service, the second stage: service overload and under-service hosts are detected to minimize energy consumption and SLA violations, and resources are allocated for services in SA-hosts. We have discussed the CPU classification threshold Tlower,Tmiddle,Tupper. First, the algorithm sorts all D2M services in descending order according to their MIPS requirements. Thereafter, it is checked whether the D2M service resource requirements meet the requirements of the available hosts. If D2M service finds a host that meets the requirements, then T is usedlowerAnd TmiddleThe threshold value checks the corresponding host group. If none of the hosts meet the new D2M service requirements, the host that turned on sleep mode allocates resources for it. The SO-hosts and SU-hosts detection stages are key to minimize energy consumption, avoid performance degradation, and reduce SLA violations. Upon detection of the SO-hosts, the D2M service to be migrated is selected. In the next phase, the selected D2M service should be placed in the host based on the host temperature. The next algorithm is to describe the master according to each master temperatureAnd (5) machine resource allocation workflow.
Algorithm 2 is as follows:
Figure BDA0002288063450000111
algorithm 2 searches for the best host to obtain resource allocation. It will take the list of hosts and services as input and return the best suited host for allocation. In the first phase, the most suitable host is selected from either SO-hosts or SU-hosts for each scheduling interval (5 minutes in this example). The cost of each host is calculated by using the formula (8), and the cost of the host is compressed in each iteration, so that D2M resource allocation optimization is realized.
Algorithm 3 is as follows:
Figure BDA0002288063450000121
algorithm 3 is built based on the cost of energy and heat. It is expressed as HostList, services, Tlower,TmiddleAs an input, and returns the best feasible host list (bestfeasble-HostList), whose cost is calculated by equation (8). The first stage of the algorithm is through the use of TlowerAnd TmiddleTo make a feasible host list (FeasibleHostList), which limits the search space for the best feasible host list and reduces the time complexity. Finally, the process will return a BestFeasibleHostList to which the cost of each host belongs.
3, the technical effects of the invention are verified as follows:
to illustrate the effect, we first introduce the SLA index and the energy efficiency index (ME 2).
SLA plays a quality index role in cloud-enabled IIoT data centers, measuring, for example, the quality of service provided by a cloud manufacturing service provider to cloud service users. The SLA metric is used to measure the performance characteristics of the service object. Over time, the computational performance of the SO-hosts may degrade, which may increase SLA violations. The SLA metric is critical to the energy sensitive algorithm, and can be defined as follows:
Figure BDA0002288063450000131
Figure BDA0002288063450000132
and
Figure BDA0002288063450000133
representing MIPS and MIPS assigned by all services, respectively.
Energy efficiency index (ME 2): the energy efficiency index (ME2) describes the overall performance of the proposed solution on the cloud-supported IIoT data center. By using the index, the system energy consumption efficiency and the SLA violation can be known. The larger the value of ME2, the higher the overall performance of the solution in the cloud-enabled IIoT data center. Thus, if the ME2 value of the proposed solution is greater than other solutions, the solution may be more efficient in cloud-enabled IIoT datacenters. The formula for ME2 is described as follows:
Figure BDA0002288063450000134
and simulating the system environment by utilizing a cloudsim tool, and performing related tests on the simulated environment. The superiority of the system will be explained from five aspects:
1) energy consumption: the energy consumed by the host is primarily related to CPU and memory utilization. However, on modern hosts using large storage devices, multi-core CPUs and large hard disks, the traditional linear power consumption model is no longer applicable. Simulation results of this protocol were analyzed and compared with KMI-MR, KMI-MP, RANDOM, and PABFD. The results of the simulation of energy consumption are shown in fig. 2. In terms of energy consumption, the ETV method and KMI-MR, KMI-MP, PABFD, RANDOM methods have energy consumptions of 32.5kWh, 43.2kWh, 41.1kWh, 49.3kWh, 76.7kWh, respectively. In other words, ETV reduces consumption by 24%, 20%, 34% and 57% over KMI-MR, KMI-MP, PABFD and RANDOM, respectively, as shown in FIG. 2.
2) SLA violation: over-migrating the D2M service can result in severe SLA standard violations in cloud-enabled IIoT data centers. FIG. 3 compares the SLA violation percentage of KLA-MR, KMI-MP, RANDOM and PABFD to ETV. As in the 03-Mar experiment, the methods KMI-MR, KMI-MP, PABFD, RANDOM and ETV gave SLA violation percentages of 7.2%, 9.5%, 9%, 12% and 6%, respectively. In other words, the ETV protocol SLA was 16%, 36%, 33% and 50% less than KMI-MR, KMI-MP, PABFD and RANDOM, respectively. Thus, the proposed scheme reduces the percentage of SLA violations in cloud-enabled IIoT datacenters, as shown in fig. 3.
3) ME 2: ME2 is used to evaluate the overall performance of the cloud-enabled IIoT data center. Cloud manufacturing service providers aim to minimize energy consumption and violations of SLAs while maximizing overall performance. FIG. 4 shows that ME2 is better for the ETV scheme compared to KMI-MR, KMI-MP, RANDOM and PABFD methods. Methods KMI-ME 2 for MR, KMI-MP, PABFD, RANDOM and ETV were 16.2, 12.9, 13.1, 9.6 and 19.7, respectively. Thus, the overall performance with the ETV resource allocation scheme is much better than other approaches, as shown in fig. 4.
4) Temperature of the host: the temperature of the host directly affects the operating costs (energy consumption, cooling costs) of the cloud-enabled IIoT data center. FIG. 5 compares the results of simulations of this algorithm with host temperatures of KMI-MR, KMI-MP, RANDOM, and PABFD. The proposed ETV algorithm does not exceed the maximum temperature (T) due to its energy and thermally aware resource allocation schemeup). FIG. 4 shows that the temperature of the host is always Tup(70 ℃) nearby, which may maximize resource utilization and minimize cooling costs for the cloud-enabled IIoT environment, as shown in fig. 5.
5) The number of hosts is turned off: the reactivated host directly affects power consumption. If the number thereof increases, the energy consumption also increases. The host will reactivate when assigned to a new D2M service and shut down when idle is detected. FIG. 6 analyzes and compares the results of the simulation for the number of host shutdowns. In total, the ETV scheme was compared to the simulation results of KMI-MR, KMI-MP, RANDOM and PABFD for the number of master closures. In the 03-Mar experiment, the algorithms KMI-MR, KMI-MP, PABFD, RANDOM, and ETV host shut down times were 1950, 1800, 2200, 2500, and 1500, respectively. In other words, proposed solution (ETV) SLA violations were 23%, 16%, 31% and 40% less than KMI-MR, KMI-MP, PABFD and RANDOM, respectively. The following figure shows that the proposed solution (ETV) is more efficient than the KMI-MR, KMI-MP, PABFD and RANDOM methods, due to the smaller number of hosts that are reactivated. In this simulation setup, we use only 800 hosts. However, due to the reactivation of the host, the number of hosts that are shut down exceeds 800. Compared to the KMI-MR, KMI-MP, PABFD and RANDOM methods, the proposed scheme significantly reduces the number of host reactivations, as shown in FIG. 6.

Claims (5)

1. An energy-saving resource allocation method for data-driven manufacturing service in the industrial internet of things comprises the following steps: the method is characterized in that:
step one, detecting the CPU utilization rate: detecting the utilization rate of a host CPU in the cloud-enabled IIoT data center, then classifying the utilization rates, and setting three threshold values T according to the utilization rate of the host CPUlower,Tmiddle,TupperClassifying the hosts, and sequentially classifying the hosts into four classes, namely SU-hosts, SA-hosts, NL-hosts and S0-hosts according to threshold values from low to high;
step two, determining services to be migrated, all D2M services on SU-hosts and D2M services selected from S0-hosts;
and step three, searching a proper host to allocate resources for the D2M service determined to be moved in the step two, finding a host suitable for D2M service migration by using an energy and thermal perception resource allocation scheme, and performing service migration to reduce energy consumption.
2. The method for allocating energy-saving resources for data-driven manufacturing services in the internet of things of industry according to claim 1, wherein the method comprises the following steps: three threshold values T in the step onelower,Tmiddle,TupperThe determination process of (2) is:
the determination of the three thresholds is selected by a least median square regression model, and is specifically determined by using formulas (9) to (11):
Figure FDA0002288063440000011
Figure FDA0002288063440000012
Tupper=(1-c×LMS) (11)
LMS in the formula represents the square of the minimum median; and c represents a safety factor, and the value of c is 0.5.
3. The method for allocating energy-saving resources for data-driven manufacturing services in the internet of things of industry according to claim 2, wherein the method comprises the following steps:
the classification of the utilization rate based on the above three thresholds is described as follows:
1) obtaining the current ithPrediction of CPU utilization for a host
Figure FDA0002288063440000016
Classifying the hosts into an affiliated group corresponding thereto;
2) if, if
Figure FDA0002288063440000013
Identifies the host as a member of the SO-hosts group, and hosts belonging to the group must migrate some D2M services to
Figure FDA0002288063440000014
Groups to reduce SLA violations;
3) in the field of
Figure FDA0002288063440000015
Hosts in the group, all their D2M services remain unchanged;
4) if, if
Figure FDA0002288063440000021
The host is identified as one of the members that the host belonging to the group must have all of itThe D2M service migrates into SA-hosts.
4. The method for allocating energy-saving resources for data-driven manufacturing services in the internet of things of industry according to claim 1, 2 or 3, wherein the specific implementation process of the second step is as follows:
modeling energy consumption issues in a cloud-enabled IIoT environment, a set of n D2M services S ═ is defined (S)1,s2,....,sn) H ═ H needs to be placed on m hosts1,h2,....,hm) And G represents a gateway device; energy consumption of the cloud-enabled IIoT environment includes computational energy consumption and cooling energy consumption, observed time is divided into l (q ═ 1, 2.. ·, l) time slots, each time slot having a duration of κ;
the allocation of D2M services to the cloud-enabled IIoT data center is described with an energy consumption model and a cooling energy consumption model;
the energy consumption model is as follows:
Figure FDA0002288063440000022
Figure FDA0002288063440000023
wherein:
Figure FDA0002288063440000024
representing the consumption of base power, P, by each hosthostRepresents the total power consumption consumed by the host,
Figure FDA0002288063440000025
and
Figure FDA0002288063440000026
maximum power consumption of the host and the gateway, respectively, over a period of time; deltajHolding a binary value (0, 1); if the jth D2M service gets resources from the host, then the value of δ j is "1", noThen "0"; CPU(s)j) Represents the total number of CPUs required for the jth D2M service; phostThe formula indicates that the utilization of the host is derived from the ratio of the total number of CPU cores per D2M service request associated with the D2M service to the total number of CPU cores of the host;
c is the capacity of the original bearer network, CmaxIs the maximum network capacity;
Figure FDA00022880634400000210
consuming base power, P, on behalf of the gatewaygateRepresents the total power consumed by the gateway;
during the observation time, the overall computing power consumption of the cloud-enabled IIoT environment is represented by a matrix P,
Figure FDA0002288063440000027
Figure FDA0002288063440000028
the elements in the matrix P are determined;
in summary, the computational energy consumption model of the cloud-enabled IIoT environment is defined as follows:
Figure FDA0002288063440000029
the refrigeration energy consumption model is as follows:
in cloud-enabled IIoT data centers, the energy consumed by Computer Room Air Conditioners (CRACs), referred to as cooling energy, depends on the heat generated by the host and the efficiency of the CRACs; HR matrix d describes the relationship between each pair of hosts, with entry di,kRepresents the i-ththGenerating host to kthThe recirculation rate of each host; the heat contribution of all hosts affects the iththThe inlet temperature of each host in the observed time slot q is given by the following formula:
Figure FDA0002288063440000031
Figure FDA0002288063440000032
which is indicative of the inlet temperature, is,
Figure FDA0002288063440000033
which is indicative of the temperature being supplied,
all inlet temperatures
Figure FDA0002288063440000034
Wherein T isupIs the warning temperature (nominal 70 ℃), the temperature of the cold air provided from the CRAC is set by equation (4) as follows:
Figure FDA0002288063440000035
using the CoP model:
CoP(Tsupply)=0.0068(Tsupply)2+0.0008Tsupply+0.458 to describe the refrigeration energy consumption model:
Figure FDA0002288063440000036
and (3) integrating the models in the formula (3) and the formula (6) to obtain a total consumption model:
Figure FDA0002288063440000037
further optimization (7) can be achieved using equation (5), resulting in the final optimization objective:
Figure FDA0002288063440000038
searching for the best host to obtain resource allocation: the D2M resource allocation optimization is achieved by selecting the most appropriate host from either SO-hosts or SU-hosts at each scheduling interval based on obtaining the list of hosts and services, with the cost of each host calculated using equation (8), and compressing the host cost in each iteration.
5. The energy-saving resource allocation method for the data-driven manufacturing service in the industrial Internet of things as claimed in claim 4, wherein the concrete implementation process of the third step is as follows:
balancing the trade-off between computing and cooling systems with an ETV resource allocation scheme, D2M service resource allocation is directly dependent on the current temperature of the hosts, which is the lowest temperature among hosts in the cloud-enabled IIoT data center when selecting hosts for resource allocation for the D2M service, constructed based on costs of energy and thermal energy, from a list of hosts, D2M service, Tlower、TmiddleUsing equation (8) to make a feasible host list, the host list search space is sorted to find the best feasible host list.
CN201911169997.2A 2019-11-25 2019-11-25 Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things Active CN111083201B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911169997.2A CN111083201B (en) 2019-11-25 2019-11-25 Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911169997.2A CN111083201B (en) 2019-11-25 2019-11-25 Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things

Publications (2)

Publication Number Publication Date
CN111083201A true CN111083201A (en) 2020-04-28
CN111083201B CN111083201B (en) 2022-03-04

Family

ID=70311638

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911169997.2A Active CN111083201B (en) 2019-11-25 2019-11-25 Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things

Country Status (1)

Country Link
CN (1) CN111083201B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115270139A (en) * 2022-09-20 2022-11-01 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) IoT equipment network service automatic vulnerability analysis method and system
CN117148955A (en) * 2023-10-30 2023-12-01 北京阳光金力科技发展有限公司 Data center energy consumption management method based on energy consumption data

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100180275A1 (en) * 2009-01-15 2010-07-15 International Business Machines Corporation Techniques for placing applications in heterogeneous virtualized systems while minimizing power and migration cost
US20110191461A1 (en) * 2010-02-02 2011-08-04 International Business Machines Corporation Systems and methods for using workload characteristics for sizing and placement for power-aware consolidation
US20110282982A1 (en) * 2010-05-13 2011-11-17 Microsoft Corporation Dynamic application placement based on cost and availability of energy in datacenters
CN103957261A (en) * 2014-05-06 2014-07-30 湖南体运通信息技术有限公司 Cloud computing resource distributing method based on energy consumption optimization
US20150039764A1 (en) * 2013-07-31 2015-02-05 Anton Beloglazov System, Method and Computer Program Product for Energy-Efficient and Service Level Agreement (SLA)-Based Management of Data Centers for Cloud Computing
CN106598733A (en) * 2016-12-08 2017-04-26 南京航空航天大学 Three-dimensional virtual resource scheduling method of cloud computing energy consumption key
CN108052375A (en) * 2017-12-29 2018-05-18 哈尔滨工业大学 A kind of host overload detection method
CN108292559A (en) * 2016-02-05 2018-07-17 Abb瑞士股份有限公司 Method and system for the cooling system for controlling power equipment
CN109491760A (en) * 2018-10-29 2019-03-19 中国科学院重庆绿色智能技术研究院 A kind of high-effect data center's Cloud Server resource autonomous management method and system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100180275A1 (en) * 2009-01-15 2010-07-15 International Business Machines Corporation Techniques for placing applications in heterogeneous virtualized systems while minimizing power and migration cost
US20110191461A1 (en) * 2010-02-02 2011-08-04 International Business Machines Corporation Systems and methods for using workload characteristics for sizing and placement for power-aware consolidation
US20110282982A1 (en) * 2010-05-13 2011-11-17 Microsoft Corporation Dynamic application placement based on cost and availability of energy in datacenters
US20150039764A1 (en) * 2013-07-31 2015-02-05 Anton Beloglazov System, Method and Computer Program Product for Energy-Efficient and Service Level Agreement (SLA)-Based Management of Data Centers for Cloud Computing
CN103957261A (en) * 2014-05-06 2014-07-30 湖南体运通信息技术有限公司 Cloud computing resource distributing method based on energy consumption optimization
CN108292559A (en) * 2016-02-05 2018-07-17 Abb瑞士股份有限公司 Method and system for the cooling system for controlling power equipment
CN106598733A (en) * 2016-12-08 2017-04-26 南京航空航天大学 Three-dimensional virtual resource scheduling method of cloud computing energy consumption key
CN108052375A (en) * 2017-12-29 2018-05-18 哈尔滨工业大学 A kind of host overload detection method
CN109491760A (en) * 2018-10-29 2019-03-19 中国科学院重庆绿色智能技术研究院 A kind of high-effect data center's Cloud Server resource autonomous management method and system

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
LIANPENG LI 等: "Minimizing SLA Violation and Power Consumption in Cloud Data Centers Using Host State 3-Order Markov Chain Model", 《2019 IEEE 21ST INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS;》 *
RAHUL YADAV 等: "Adaptive Energy-Aware Algorithms for Minimizing Energy Consumption and SLA Violation in Cloud Computing", 《IEEE ACCESS》 *
ZHOU ZHOU 等: "Minimizing SLA violation and power consumption in Cloud data centers using adaptive energy-aware algorithms", 《FUTURE GENERATION COMPUTER SYSTEMS》 *
欧阳飞: "感知数据驱动的制造装备运行能量有效评估方法研究", 《万方数据库》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115270139A (en) * 2022-09-20 2022-11-01 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) IoT equipment network service automatic vulnerability analysis method and system
CN115270139B (en) * 2022-09-20 2023-01-17 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) IoT equipment network service automatic vulnerability analysis method and system
CN117148955A (en) * 2023-10-30 2023-12-01 北京阳光金力科技发展有限公司 Data center energy consumption management method based on energy consumption data
CN117148955B (en) * 2023-10-30 2024-02-06 北京阳光金力科技发展有限公司 Data center energy consumption management method based on energy consumption data

Also Published As

Publication number Publication date
CN111083201B (en) 2022-03-04

Similar Documents

Publication Publication Date Title
CN109800066B (en) Energy-saving scheduling method and system for data center
Hameed et al. A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems
Ilager et al. ETAS: Energy and thermal‐aware dynamic virtual machine consolidation in cloud data center with proactive hotspot mitigation
Zhu et al. A three-dimensional virtual resource scheduling method for energy saving in cloud computing
Zhang et al. Towards joint optimization over ICT and cooling systems in data centre: A survey
Liu et al. Renewable and cooling aware workload management for sustainable data centers
Chaudhry et al. Thermal-aware scheduling in green data centers
Li et al. Holistic energy and failure aware workload scheduling in Cloud datacenters
Kaushik et al. T*: A data-centric cooling energy costs reduction approach for Big Data analytics cloud
US8856321B2 (en) System to improve operation of a data center with heterogeneous computing clouds
Yi et al. Efficient compute-intensive job allocation in data centers via deep reinforcement learning
US9037880B2 (en) Method and system for automated application layer power management solution for serverside applications
Yi et al. Toward efficient compute-intensive job allocation for green data centers: A deep reinforcement learning approach
Lee et al. Proactive thermal-aware resource management in virtualized HPC cloud datacenters
Lee et al. Vmap: Proactive thermal-aware virtual machine allocation in hpc cloud datacenters
Wang et al. Opportunities and challenges to unify workload, power, and cooling management in data centers
Zhang et al. Two-phase industrial manufacturing service management for energy efficiency of data centers
CN111813502B (en) Computing resource management scheduling method for industrial edge node
Chaabouni et al. Energy management strategy in cloud computing: a perspective study
Jin et al. Energy-efficient task scheduling for CPU-intensive streaming jobs on Hadoop
CN111083201B (en) Energy-saving resource allocation method for data-driven manufacturing service in industrial Internet of things
Oxley et al. Rate-based thermal, power, and co-location aware resource management for heterogeneous data centers
Mazidi et al. Autonomic resource provisioning for multilayer cloud applications with K‐nearest neighbor resource scaling and priority‐based resource allocation
Zhang et al. An energy and SLA-aware resource management strategy in cloud data centers
CN103984588B (en) Virtual machine migration method based on temperature and system thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant