CN106201847A - Consider method for allocating tasks, device and the system of the decay of cloud platform host performance - Google Patents

Consider method for allocating tasks, device and the system of the decay of cloud platform host performance Download PDF

Info

Publication number
CN106201847A
CN106201847A CN201610512166.0A CN201610512166A CN106201847A CN 106201847 A CN106201847 A CN 106201847A CN 201610512166 A CN201610512166 A CN 201610512166A CN 106201847 A CN106201847 A CN 106201847A
Authority
CN
China
Prior art keywords
host
tasks
performance
task allocation
zdl
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610512166.0A
Other languages
Chinese (zh)
Other versions
CN106201847B (en
Inventor
夏云霓
郭坤银
罗辛
李蔚凌
王元斗
吴全旺
杨瑞龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Jinyuyun Energy Technology Co ltd
Original Assignee
Chongqing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University filed Critical Chongqing University
Priority to CN201610512166.0A priority Critical patent/CN106201847B/en
Publication of CN106201847A publication Critical patent/CN106201847A/en
Application granted granted Critical
Publication of CN106201847B publication Critical patent/CN106201847B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3433Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment for load management

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a kind of method for allocating tasks considering that cloud platform host performance is decayed, relate to cloud computing system control field, comprise the steps of: first, monitor each main frame and gather its performance information;Secondly, assessment main frame current performance and load, assess each host performance attenuation degree;Then, new task allocative decision is generated according to the host performance dough softening;Finally, main frame is automatically distributed to new arrival task;In addition the invention also discloses and based on said method a kind of consider the task allocation apparatus that cloud platform host performance is decayed and the system comprising this device.The present invention, when carrying out new task allocation schedule, have evaluated performance degradation degree and the expection backlog quantity of each main frame, it is to avoid new task is distributed to the main frame that performance degradation degree is high, backlog is many, makes task scheduling approach more reasonable.

Description

Task allocation method, device and system considering performance attenuation of cloud platform host
Technical Field
The invention belongs to the field of cloud computing system control, and particularly relates to a task allocation method, device and system considering cloud platform host performance attenuation.
Background
Cloud computing is an internet-based computing approach by which shared software and hardware resources and information can be provided to computers and other devices on demand. Compared with traditional software and computing forms, cloud computing has the remarkable advantages of loose coupling, on-demand, controllable cost, virtual resources, heterogeneous cooperation and the like, and is more suitable for applications such as electronic commerce, flexible manufacturing, mobile internet and the like.
A cloud platform refers to a distributed computing system composed of multiple heterogeneous hosts connected together by a network and used for carrying enterprise-level applications providing online cloud services. In the cloud platform, a large number of hosts are centrally and uniformly managed, so that a stable power supply environment required by the operation of the hosts, and appropriate temperature and humidity control and network bandwidth conditions can be guaranteed.
Like other software and hardware systems, the load of the host in the cloud platform is also in real-time change. Because the cloud computing system is mostly used for high-load and high-complexity applications such as large-scale scientific computing, real-time finance, online transaction, streaming media multicast and the like, the host computer of the cloud computing system is often in an overload running state. After the cloud host runs under a high load for a long time, the overall performance of the cloud host is attenuated. If the task scheduling and load balancing strategy neglects performance degradation, the batch crash of tasks accumulated on the host with degraded performance is very easy to occur, and a great loss is caused. In the traditional task scheduling and allocating strategy, the allowable newly-added task capacity is calculated only according to the current load, the resource utilization rate and the reliability state of each host and each node, and the task allocation and scheduling scheme is determined according to the static data, so that the real-time performance fluctuation and attenuation of each host in the cloud computing system are ignored, and the situation that a new task is allocated to the host which is in a performance reduction situation although the performance is not low at present is not actively avoided.
Under the background, how to dynamically track the operation situation of the cloud platform, track and predict the performance change of the cloud host in real time, perform early warning on the performance attenuation condition, and realize a reasonable task allocation strategy becomes a research hotspot and difficulty.
Disclosure of Invention
In view of the above-mentioned drawbacks of the prior art, the technical problems to be solved by the present invention are: the problem that task allocation is misappropriate due to the fact that host performance attenuation is not considered in cloud system task allocation in the prior art is solved. Aiming at the problem, the invention provides a task allocation method, a device and a system considering the performance attenuation of a cloud platform host.
In order to achieve the above object, the present invention provides a task allocation method considering performance attenuation of a cloud platform host, comprising the following steps:
monitoring each host and collecting performance information of each host; the performance information includes the total running time KT of the hostiTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiRecording the downtime of the host; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
step two, evaluating the current performance and load of the host: calculating the equivalent survival rate CHL of each host in t timeiMultitask failure rate RWSXLiEquivalent execution rate DXZXiAnd average task input rate PJL of all hosts;
evaluating the performance attenuation degree of each host, evaluating the potential task stock of each host within the next t time, evaluating the load satisfaction degree of each host under the condition of considering the occurrence of the fault, and evaluating the performance attenuation degree of each host; wherein,
potential task inventory ZDLiComprises the following steps:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
load satisfaction MZDidXZX with host execution rateiProportional to the amount of potential mission inventory ZDLiInversely proportional to the host equivalent survival rate CHLiAnd the number of error tasks CWiCorrelation; degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
step four, generating a new task allocation scheme according to the performance attenuation of each host: degree of attenuation of performance SJDiIs positive and has a performance attenuation degree SJDiThe ratio of the average performance attenuation degree of each host is larger than b and the average equivalent execution rate of each host is DXZXiTo process its potential task inventory ZDLiThe host computer with the required time larger than c × t is marked as not accepting the new task, otherwise, the host computer is marked as accepting the new task, wherein, b (satisfies 1)<b<10) And c (satisfy 1)<c<10) Parameters are predefined for the system administrator.
Step five, automatically distributing the host computer to the newly arrived task continuously and updating the load satisfaction degree; when all hosts do not bear tasks, rejecting the newly arrived task; otherwise, the task is distributed to the host with the maximum load satisfaction value, and the ZDL is usediAnd increasing the value by 1 and updating the load satisfaction degree.
Further, the equivalent survival rate CHLiThe calculation formula is as follows:
wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
further, the multitask failure rate is:
RWSXL i = 1 - ( CHL i ) CW i
further, the equivalent execution rate is:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0
further, the average task input rate is:
P J L = &Sigma; i = 0 n XD i t n
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
Further, the load satisfaction is:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e
further, the fourth step is: marking the hosts with positive performance attenuation values, the ratio of the performance attenuation degrees to the average performance attenuation degrees of the hosts is greater than b, and the time required for processing the potential task inventory by the average equivalent execution rate of the hosts is greater than c x t as not accepting the new task, otherwise, marking the hosts as capable of accepting the new task; wherein b (1 < b <10 is satisfied) and c (1 < c <10 is satisfied) are parameters predetermined by a system administrator.
Further, in step five, the new task allocation scheme has a validity period, and the validity period of the new task allocation scheme is as follows:
Y X Q = &Sigma; i = 0 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e
and when the validity period of the new task allocation scheme is reached, executing a jump to execute the step one.
The invention also provides a task allocation device considering the performance attenuation of the cloud platform host, which comprises a cloud system performance monitoring module, a performance attenuation early warning module, a new task allocation scheme generation module and a new task allocation control module;
cloud system performance monitoring moduleEach host is monitored in block, performance information is collected, and the total running time KT of the host is obtainediTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiThe host downtime record is sent to the performance attenuation early warning module; running the main machine for total time KTiTotal number of completed tasks KWCiSending the value to a new task allocation control module; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
the performance attenuation early warning module calculates the equivalent execution rate DXZXiSending the value to a new task allocation scheme generation module, and calculating the performance attenuation degree SJDiAnd potential task inventory ZDLiSending the value to a new task allocation scheme generation module to store the potential task inventory ZDLiSending the value to a new task allocation control module;
potential task inventory ZDLiThe calculation formula is as follows:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i ;
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
load satisfaction MZDiProportional to the host execution rate, inversely proportional to the potential task stock, and related to the host equivalent survival rate and the number of error tasks; degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
and the new task allocation scheme generation module generates a new task allocation scheme and the new task allocation control module allocates the tasks.
Further, the equivalent survival rate CHLiThe calculation formula is as follows:
wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
further, multitask failure rate RWSXLiThe calculation formula is as follows:
RWSXL i = 1 - ( CHL i ) CW i ;
further, the equivalent execution rate DXZXiThe calculation formula is as follows:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0 ;
further, the average task input rate PJL is calculated by the following formula:
P J L = &Sigma; i = 0 n XD i t n ;
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
Further, the load satisfies the MZDiComprises the following steps:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e ;
further, the new task allocation scheme has a validity period, and the calculation formula of the validity period of the new task allocation scheme is as follows:
Y X Q = &Sigma; i = 0 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e .
in addition, the invention also provides a task allocation system considering the performance attenuation of the cloud platform host, which comprises a cloud platform server, wherein the cloud platform server is internally provided with a cloud platform host performance attenuation task allocation device; the cloud platform host performance attenuation task allocation device comprises a cloud system performance monitoring module, a performance attenuation early warning module, a new task allocation scheme generation module and a new task allocation control module;
the cloud system performance monitoring module monitors each host, collects performance information of each host, and runs the host for the total time KTiTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiThe host downtime record is sent to the performance attenuation early warning module; running the main machine for total time KTiTotal number of completed tasks KWCiSending the value to a new task allocation control module; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
the performance attenuation early warning module calculates the equivalent execution rate DXZXiSending the value to a new task allocation scheme generation module, and calculating the performance attenuation degree SJDiAnd potential task inventory ZDLiSending the value to a new task allocation scheme generation module to store the potential task inventory ZDLiSending the value to a new task allocation control module;
potential task inventory ZDLiThe calculation formula is as follows:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i ;
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
load satisfaction MZDiProportional to the host execution rate, and potential taskThe service stock is inversely proportional and is related to the equivalent survival rate of the host and the number of error tasks; degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
and the new task allocation scheme generation module generates a new task allocation scheme and the new task allocation control module allocates the tasks.
Further, the equivalent survival rate CHLiThe calculation formula is as follows:
wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
further, multitask failure rate RWSXLiThe calculation formula is as follows:
RWSXL i = 1 - ( CHL i ) CW i ;
further, the equivalent execution rate DXZXiThe calculation formula is as follows:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0 ;
further, the average task input rate PJL is calculated by the following formula:
P J L = &Sigma; i = 0 n XD i t n ;
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
Further, the load satisfies the MZDiComprises the following steps:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e ;
further, the new task allocation scheme has a validity period, and the calculation formula of the validity period of the new task allocation scheme is as follows:
Y X Q = &Sigma; i = 0 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e .
the invention has the beneficial effects that: the invention fully considers the dynamic fluctuation of the host performance in the cloud system, calculates the processing capacity satisfaction degree and the performance attenuation degree of each host closer to the actual task load, evaluates the performance attenuation degree and the expected backlog task quantity of each host, avoids distributing new tasks to the hosts with high performance attenuation degree and more backlog tasks, and ensures that the task scheduling scheme is more reasonable. Compared with a static task scheduling management strategy, the method realizes dynamic load balancing and can obtain better effect under the unreliable and high-load system operation environment.
Drawings
Fig. 1 is a flowchart illustrating a task allocation method according to an embodiment of the present invention, in which performance degradation of a cloud platform host is considered.
Fig. 2 is a schematic diagram of a task allocation apparatus according to an embodiment of the present invention, which considers performance degradation of a host of a cloud platform.
FIG. 3 is a schematic diagram of a specific embodiment of the task allocation system of the present invention that takes into account cloud platform host performance degradation.
Detailed Description
The invention is further illustrated by the following examples in conjunction with the accompanying drawings:
as shown in fig. 1, the present embodiment provides a task allocation method considering performance degradation of a cloud platform host, specifically including the following steps:
step one, collecting real-time performance information of a host
The cloud system performance monitoring module obtains each host in the cloud platform, and obtains the number of tasks KWC completed by the host when the host starts to runiThe time KT elapsed from the start of the system operation to the presenti. Acquiring the number WC of tasks completed in the latest t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiRecording the downtime of the host;
wherein, the system has not finished the task just in the beginning of the operation, at this moment the KWCiThe initial value is set to 1. If the time elapsed from the start of the system to the present is less than t, KTiIs set to t. i is a subscript value to indicate the host number of the variable, and i is more than 0 and less than or equal to n; the time interval t is given by the cloud system administrator and is set to 100 to 1000 milliseconds.
Obtaining the downtime record of the host, and setting the time HF consumed by the latest downtime of each host in t timeiAnd the interval XF from the recovery moment to the current moment after the latest downtime within the time ti(ii) a If there is no downtime within t time, HFiAnd XFiAre recorded as-1.
Finally, the cloud system performance monitoring module acquires the WCi、KTi、KWCi、XDi、CTJi、CWi、QCi、XFi、HFiThe value is sent to a performance parameter preprocessing unit and an attenuation degree evaluation unit in a performance attenuation early warning module, and K is obtainedWCiAnd KTiThe value is sent to the new task assignment control module.
Step two, evaluating the current performance and load of the host:
a performance parameter preprocessing unit in a performance attenuation early warning module firstly calculates the equivalent survival rate CHL of each host within t timei
Wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
then, calculating the task failure rate of each host considering the multi-task failure:
RWSXL i = 1 - ( CHL i ) CW i
then, calculating the equivalent execution rate of each host within t time:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0
note that because CHLiThe value cannot be 0 and the above calculation does not have the divisor 0.
Then, the average task input rate of each host is calculated:
P J L = &Sigma; i = 0 n XD i t n
finally, the performance parameter preprocessing unit calculates the calculated PJL and CHLiAnd RWSXLiThe value is sent to an attenuation degree evaluation unit in a performance attenuation early warning module, and DXZX is sent toiThe value is sent to a new task allocation plan generation module.
Step three, evaluating the performance attenuation degree of each host
The attenuation degree evaluation unit in the performance attenuation early warning module firstly calculates the maximum possible potential task stock to be processed by each host within the next t time:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i
wherein a is a weight coefficient preset by a cloud system manager and satisfies 0<a<1, and in general, any real number between 0.3 and 0.7 may be taken. The above mentionedThe intuitive meaning of the formula is that the estimated maximum stock task in the next t time can be estimated as the weighted task input rate multiplied by the time t and then the' number of migrated tasks QCi"AND" Re-submit the number of tasks CTJ completed by execution after an error or suspensioni", multiply the expected number of rerun executions by" the number of tasks CW in error in the most recent t timei"; max is the operation of maximizing the number of sets. Note that RWSXLiThe value is more than or equal to 0 and less than 1, so that 1-RWSXL does not existiAs in the case of a divisor of 0.
Next, the variable MZD for the attenuation evaluating unit celliMarking the load satisfaction degree of each host, namely the degree of the current host execution rate which can still adapt to the task load under the condition of considering the occurrence of the fault:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e
as can be seen, the satisfaction with ZDLiThe value is inversely proportional to the equivalent execution rate DXZX of the hostiAnd is also related to the host equivalent survival rate and the number of error tasks. Wherein mean is the operation of averaging the number of sets. Notably, because of the KWCiValue minimum 1, KTiThe minimum value is also t, and the above calculation does not have the divisor 0.
Next, the attenuation degree evaluation unit calculates the performance attenuation degree of each host in consideration of load and reliability:
SJD i = JMZD i - MZD i JMZD i i f JMZD i < &infin; 0 e l s e
wherein JMZDiRepresents the old satisfaction value of host i, whose initial value is set to positive infinity. The intuitive meaning of the formula is that the satisfaction degree is considered to be unchanged initially, so that the attenuation degree is 0, namely the default of the first calculation is set to be 0; whenever the old satisfaction value is less than positive infinity, i.e., not the first calculation, the attenuation is calculated as the ratio of the new and old satisfaction difference divided by the old attenuation. It is noted that the above-mentioned calculation structure may be negative, indicating that the performance of the host is not degraded, but rather improved.
Next, the attenuation degree evaluation unit subjects the MZD toiValue to JMZDiIt means that the satisfaction value generated in the current round is used as the old satisfaction value when the performance degradation degree evaluation is performed in the next round.
Finally, the attenuation degree evaluation unit calculates the SJDiAnd ZDLiSending the value to a new task allocation scheme generation module to convert the ZDL value to a value for the next taskiThe value is sent to the new task assignment control module.
Step four, generating a new task allocation scheme according to the performance attenuation of each host:
firstly, a new task allocation scheme generation module calculates a marking variable JSiTo determine whether each host accepts new tasks:
JS i = 0 i f SJD i m e a n { SJD i | 0 < i &le; n } > b , SJD i > 0 , ZDL i t &times; m e a n { DXZX i | 0 < i &le; n } > c 1 e l s e
wherein b (1 < b <10 is satisfied) and c (1 < c <10 is satisfied) are predetermined parameters. The intuitive meaning of the above calculation is that if the performance attenuation of a certain host is greater than b times of the average performance attenuation of each host, the performance attenuation of the host is positive, and the maximum possible potential task inventory to be processed by the host needs t time which is more than c times of the average equivalent execution rate of each host, the host is considered to be unsuitable for carrying a new task from the viewpoint of performance attenuation and backlog task. The larger the values of b and c are taken, the fewer hosts are determined to be unsuitable for receiving new tasks.
Finally, the new task assignment scheme generation module generates JSiThe value is sent to the new task assignment control module.
Step five, newly arrived task allocation
Firstly, the new task allocation control module calculates the validity period of the task scheduling policy in the current round:
Y X Q = &Sigma; i = 0 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e
the intuitive significance of the formula is that when all the hosts are judged to be suitable for receiving new tasks, the overall performance of the system is stable, so that the validity of the control in the current round can be increased moderately; otherwise, the smaller t time is taken as the effective period length.
At time YXQ, whenever a new task request arrives, the new task assignment control module calculates the update load satisfaction of each host:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e
the new task assignment control module then assigns this newly arrived task to "all-host computation-tagged variable JSiIs 1 and has a maximum MZDiHost of value ", while the ZDL of this host getting the new taskiValue, self-increment by 1 (i.e. increase ZDL by one)iUpdate to old ZDLiThe value is increased by 1); if all the host computer's mark variable JSiBoth are 0, this newly arrived task is rejected.
It is worth mentioning that the satisfaction can be directly updated after a task is allocated, and a new task is directly allocated when waiting for the new task. Meanwhile, when a new task comes, the satisfaction degree can be updated, and then the new task is redistributed.
Once the execution time of step five reaches YXQ, step one is entered and a new round of execution of the loop back and forth is started.
The intuitive significance of the operation is that the variable JS is markediFirstly, determining the range of alternative hosts which can accept the new task, then selecting the host with the maximum load satisfaction degree among the alternative hosts to accept the new task, and receiving the ZDL of the host after the taskiThe value is increased by 1 to ensure that other hosts have the potential to accept hosts as tasks after the next new task arrives.
The embodiment also provides a task allocation device considering the performance attenuation of the cloud platform host. As shown in fig. 2, the apparatus comprises: the system comprises a cloud system performance monitoring module, a performance attenuation early warning module, a new task allocation scheme generating module and a new task allocation control module.
As shown in fig. 3, the embodiment further discloses a task allocation system considering the performance attenuation of the cloud platform host, which includes a cloud platform server, and a task allocation device considering the performance attenuation of the cloud platform host is disposed in the cloud platform server; the task allocation device considering the performance attenuation of the cloud platform host comprises a cloud system performance monitoring module, a performance attenuation early warning module, a new task allocation scheme generation module and a new task allocation control module.
The cloud system performance monitoring module monitors each host, collects performance information of each host, and runs the host for the total time KTiTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiThe host downtime record is sent to the performance attenuation early warning module; running the main machine for total time KTiTotal number of completed tasks KWCiSending the value to a new task allocation control module; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
the performance attenuation early warning module calculates the equivalent execution rate DXZXiSending the value to a new task allocation scheme generation module, and calculating the performance attenuation degree SJDiAnd potential task inventory ZDLiSending the value to a new task allocation scheme generation module to store the potential task inventory ZDLiSending the value to a new task allocation control module;
potential task inventory ZDLiThe calculation formula is as follows:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i ;
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
load satisfaction MZDiProportional to the host execution rate, inversely proportional to the potential task stock, and related to the host equivalent survival rate and the number of error tasks; degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
and the new task allocation scheme generation module generates a new task allocation scheme and the new task allocation control module allocates the tasks.
In this embodiment, calculationTo obtain equivalent survival rate CHLi(ii) a Wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
in this embodiment, calculationObtaining multitask failure rate RWSXLi
In this embodiment, calculationGet the equivalent execution rate DXZXi
In this embodiment, calculationObtaining an average task input rate PJL;
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
In this embodiment, calculation
And obtaining the load satisfaction degree MZDi.
In this embodiment, the new task allocation scheme has a validity period, and the calculation is performed
And obtaining the validity period of the new task allocation scheme.
In conclusion, the method, the device and the system provided by the invention fully consider the dynamic fluctuation of the host performance in the cloud system, calculate the processing capacity satisfaction degree and the performance attenuation degree of each host closer to the actual task load, evaluate the performance attenuation degree and the expected backlog task quantity of each host, avoid distributing a new task to the host with high performance attenuation degree and more backlog tasks, and enable the task scheduling scheme to be more reasonable. Compared with a static task scheduling management strategy, the method realizes dynamic load balancing and can obtain better effect under the unreliable and high-load system operation environment.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.

Claims (10)

1. A task allocation method considering performance attenuation of a cloud platform host is characterized by comprising the following steps:
monitoring each host and collecting performance information of each host; the performance information comprises the total running time KT of the hostiTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiRecording the downtime of the host; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
step two, evaluating the current performance and load of the host: calculating the equivalent survival rate CHL of each host in t timeiMultitask failure rate RWSXLiEquivalent execution rate DXZXiAnd average task input rate PJL of all hosts;
evaluating the performance attenuation degree of each host, and evaluating the potential task stock ZDL of each host in the next t timeiEvaluating the load satisfaction degree MZD of each host considering the occurrence of the faultiEvaluating the degree of performance attenuation SJD of each hosti(ii) a Wherein,
the inventory of potential tasks ZDLiComprises the following steps:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
the load satisfaction degree MZDiProportional to the host execution rate, inversely proportional to the potential task stock, and related to the host equivalent survival rate and the number of error tasks; the degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
step four, generating a new task allocation scheme according to the performance attenuation of each host: attenuating the performance by SJDiIs positive and the degree of performance attenuation SJDiThe ratio of the average performance attenuation degree of each host is larger than b and the average equivalent execution rate of each host is DXZXiTo process the potential task inventory ZDL thereofiThe host computer with the required time larger than c × t is marked as not accepting the new task, otherwise, the host computer is marked as accepting the new task, wherein, b (satisfies 1)<b<10) And c (satisfy 1)<c<10) Presetting parameters for a system manager;
step five, continuously automatically distributing the host to the newly arrived task and updating the load satisfaction degree MZDi(ii) a When all hosts do not bear tasks, rejecting the newly arrived task; otherwise, the task is executedLoad sharing satisfaction degree MZDiLargest host, and the ZDLiIncreasing the value by 1, and updating the load satisfaction degree MZDi
2. The method for task allocation according to claim 1, wherein the method comprises the following steps:
the equivalent survival rate CHLiThe calculation formula is as follows:
wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
the multitask failure rate RWSXLiComprises the following steps:
RWSXL i = 1 - ( CHL i ) CW i
the equivalent execution rate DXZXiComprises the following steps:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0
the average task input rate PJL is:
P J L = &Sigma; i = 0 n XD i t n
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
3. The method of claim 1, wherein the load satisfaction degree MZD is set to account for cloud platform host performance degradationiComprises the following steps:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e .
4. the method according to claim 1, wherein in the step five, the new task allocation scheme has a validity period, and the validity period of the new task allocation scheme is:
Y X Q = &Sigma; i = 1 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e
and when the validity period of the new task allocation scheme is reached, executing a jump to execute the step one.
5. A task allocation device considering performance attenuation of a cloud platform host is characterized in that: the system comprises a cloud system performance monitoring module, a performance attenuation early warning module, a new task allocation scheme generation module and a new task allocation control module;
the cloud system performance monitoring module monitors each host, collects performance information of each host, and runs the host for total time KTiTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiSending the host downtime record to the performance attenuation early warning module; running the main machine for total time KTiTotal number of completed tasks KWCiSending the value to the new task allocation control module; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
the performance attenuation early warning module calculates the equivalent execution rate DXZXiSending the value to a new task allocation scheme generation module, and calculating load satisfaction degree MZDiThe calculated performance attenuation degree SJDiAnd potential task inventory ZDLiSending the value to a new task allocation scheme generation module to store the potential task inventory ZDLiSending the value to a new task allocation control module;
the inventory of potential tasks ZDLiThe calculation formula is as follows:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i + CTJ i + CW i 1 - RWSXL i ;
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
the load satisfaction degree MZDiProportional to the host execution rate, inversely proportional to the potential task stock, and related to the host equivalent survival rate and the number of error tasks; the degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
and the new task allocation scheme generation module generates a new task allocation scheme and the new task allocation control module allocates the tasks.
6. The task allocation device according to claim 5, wherein the task allocation device takes into account the performance degradation of the cloud platform host computer:
the equivalent survival rate CHLiThe calculation formula is as follows:
wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within the time t;
the multitask failure rate RWSXLiThe calculation formula is as follows:
RWSXL i = 1 - ( CHL i ) CW i ;
the equivalent execution rate DXZXiThe calculation formula is as follows:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0 ;
the average task input rate PJL is calculated by the formula:
P J L = &Sigma; i = 0 n XD i t n ;
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
7. The device of claim 5, wherein the load satisfaction degree MZD is set to account for performance degradation of the cloud platform hostiComprises the following steps:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e ;
the new task allocation scheme has a validity period, and the calculation formula of the validity period of the new task allocation scheme is as follows:
Y X Q = &Sigma; i = 1 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e
8. a task allocation system considering performance attenuation of a cloud platform host comprises a cloud platform server and is characterized in that: a cloud platform host performance attenuation task distribution device is arranged in the cloud platform server; the cloud platform host performance attenuation task allocation device comprises a cloud system performance monitoring module, a performance attenuation early warning module, a new task allocation scheme generation module and a new task allocation control module;
the cloud system performance monitoring module monitors each host, collects performance information of each host, and runs the host for total time KTiTotal number of completed tasks KWCiAnd the number of tasks completed WC within the last t timeiThe number XD of newly arrived tasks of each hostiNumber of completed tasks for host error or re-submission after suspension CTJiNumber of faulty tasks CWiAnd the number of migrated tasks QCiSending the host downtime record to the performance attenuation early warning module; running the main machine for total time KTiTotal number of completed tasks KWCiSending the value to the new task allocation control module; wherein i is a subscript value to indicate the host number to which the variable belongs, and i is more than 0 and less than or equal to n;
the performance attenuation early warning module calculates the equivalent execution rate DXZXiSending the value to a new task allocation scheme generation module, and calculating the performance attenuation degree SJDiAnd potential task inventory ZDLiSending the value to a new task allocation scheme generation module to store the potential task inventory ZDLiSending the value to a new task allocation control module;
the inventory of potential tasks ZDLiThe calculation formula is as follows:
ZDL i = t &times; ( ( 1 - a ) &times; P J L + m a x { XD i t | 0 < i &le; n } ) + QC i +
CTJ i + CW i 1 - RWSXL i ;
wherein a satisfies 0< a <1, and is a weight coefficient preset by a cloud system manager;
the load satisfaction degree MZDiProportional to the host execution rate, inversely proportional to the potential task stock, and related to the host equivalent survival rate and the number of error tasks; the degree of performance decay SJDiWhen the first calculation is carried out, the default is set to 0, and the non-first calculation is carried out to satisfy the MZDiJMZDiJMZD of the difference and old satisfactioniThe ratio of (A) to (B);
and the new task allocation scheme generation module generates a new task allocation scheme and the new task allocation control module allocates the tasks.
9. The system of claim 8, wherein the task allocation system is configured to account for performance degradation of the cloud platform hosts and is further configured to:
the equivalent survival rate CHLiThe calculation formula is as follows:
wherein, HFiXF the latest time spent in downtime within tiThe interval time from the recovery moment to the current moment after the latest downtime within t time;
The multitask failure rate RWSXLiThe calculation formula is as follows:
RWSXL i = 1 - ( CHL i ) CW i ;
the equivalent execution rate DXZXiThe calculation formula is as follows:
DXZX i = WC i - CTJ i WC i + QC i &times; ( t WC i &times; CHL i ) - 1 i f WC i > 0 KWC i KT i e l s e i f WC i = 0 ;
the average task input rate PJL is calculated by the formula:
P J L = &Sigma; i = 0 n XD i t n ;
wherein the number of tasks KWCiThe initial value is 1; when the total running time of the system is less than t, KTiIs set to t.
10. The system of claim 8, wherein the load satisfaction metric MZD is defined asiComprises the following steps:
MZD i = ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i ZDL i i f ZDL i > 0 ( 1 - ( CHL i ) m e a n { CW i | 0 < i < < n } ) &times; DXZX i KWC i &times; t KT i e l s e ;
the new task allocation scheme has a validity period YXQ, and the new task allocation scheme validity period calculation formula is as follows:
Y X Q = &Sigma; i = 1 n ZDL i m e a n { KWC i KT i | 0 < i &le; n } + t i f m e a n { JS i | 0 < i &le; n } = 1 t e l s e .
CN201610512166.0A 2016-06-30 2016-06-30 Consider method for allocating tasks, the device and system of the decaying of cloud platform host performance Active CN106201847B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610512166.0A CN106201847B (en) 2016-06-30 2016-06-30 Consider method for allocating tasks, the device and system of the decaying of cloud platform host performance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610512166.0A CN106201847B (en) 2016-06-30 2016-06-30 Consider method for allocating tasks, the device and system of the decaying of cloud platform host performance

Publications (2)

Publication Number Publication Date
CN106201847A true CN106201847A (en) 2016-12-07
CN106201847B CN106201847B (en) 2019-04-23

Family

ID=57462966

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610512166.0A Active CN106201847B (en) 2016-06-30 2016-06-30 Consider method for allocating tasks, the device and system of the decaying of cloud platform host performance

Country Status (1)

Country Link
CN (1) CN106201847B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213588A (en) * 2018-09-17 2019-01-15 重庆大学 A kind of cloud data center Batch Arrival task allocation apparatus, system and method
CN110347502A (en) * 2019-06-21 2019-10-18 无锡华云数据技术服务有限公司 Load equilibration scheduling method, device and the electronic equipment of cloud host server

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104023042A (en) * 2013-03-01 2014-09-03 清华大学 Cloud platform resource scheduling method
CN104063282A (en) * 2014-05-06 2014-09-24 重庆大学 Management method, device and server for IaaS cloud variable scale resource pool
CN104111875A (en) * 2014-07-03 2014-10-22 重庆大学 Device, system and method for dynamically controlling number of newly-increased tasks at cloud data center
CN105208119A (en) * 2015-09-21 2015-12-30 重庆大学 Cloud data central task allocation method, device and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104023042A (en) * 2013-03-01 2014-09-03 清华大学 Cloud platform resource scheduling method
CN104063282A (en) * 2014-05-06 2014-09-24 重庆大学 Management method, device and server for IaaS cloud variable scale resource pool
CN104111875A (en) * 2014-07-03 2014-10-22 重庆大学 Device, system and method for dynamically controlling number of newly-increased tasks at cloud data center
CN105208119A (en) * 2015-09-21 2015-12-30 重庆大学 Cloud data central task allocation method, device and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213588A (en) * 2018-09-17 2019-01-15 重庆大学 A kind of cloud data center Batch Arrival task allocation apparatus, system and method
CN110347502A (en) * 2019-06-21 2019-10-18 无锡华云数据技术服务有限公司 Load equilibration scheduling method, device and the electronic equipment of cloud host server

Also Published As

Publication number Publication date
CN106201847B (en) 2019-04-23

Similar Documents

Publication Publication Date Title
US20190121672A1 (en) Automated capacity provisioning method using historical performance data
Yang et al. A cost-aware auto-scaling approach using the workload prediction in service clouds
US7467291B1 (en) System and method for calibrating headroom margin
US9325585B1 (en) Mission-driven autonomous and adaptive resource management
Rao et al. QoS guarantees and service differentiation for dynamic cloud applications
CN107003887A (en) Overloaded cpu setting and cloud computing workload schedules mechanism
US9037880B2 (en) Method and system for automated application layer power management solution for serverside applications
US20150074679A1 (en) Dynamic Scaling for Multi-Tiered Distributed Computing Systems
Niu et al. Cost-effective cloud HPC resource provisioning by building semi-elastic virtual clusters
US20140325524A1 (en) Multilevel load balancing
CN105159782A (en) Cloud host based method and apparatus for allocating resources to orders
Mekala et al. A DRL-based service offloading approach using DAG for edge computational orchestration
CN103164283A (en) Method and system for dynamic scheduling management of virtualized resources in virtualized desktop system
Bi et al. SLA-based optimisation of virtualised resource for multi-tier web applications in cloud data centres
US10621018B2 (en) Link optimization for callout request messages
CN103294546A (en) Multi-dimensional resource performance interference aware on-line virtual machine migration method and system
CN112579304A (en) Resource scheduling method, device, equipment and medium based on distributed platform
Anglano et al. FC2Q: exploiting fuzzy control in server consolidation for cloud applications with SLA constraints
CN112261120B (en) Cloud-side cooperative task unloading method and device for power distribution internet of things
Choi et al. pHPA: A proactive autoscaling framework for microservice chain
WO2018099090A1 (en) Method and apparatus for determining main scheduler from cloud computing system
Delavar et al. A synthetic heuristic algorithm for independent task scheduling in cloud systems
Kowsigan et al. An efficient performance evaluation model for the resource clusters in cloud environment using continuous time Markov chain and Poisson process
CN113672345A (en) IO prediction-based cloud virtualization engine distributed resource scheduling method
CN112219191A (en) Self-configuration of services and servers in a data center

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220624

Address after: 400060 21-office30, No.73, Nanping West Road, Nan'an District, Chongqing

Patentee after: CHONGQING JINYUYUN ENERGY TECHNOLOGY CO.,LTD.

Address before: 400045 No. 174 Sha Jie street, Shapingba District, Chongqing

Patentee before: Chongqing University