CN103780646A - Cloud resource scheduling method and system - Google Patents

Cloud resource scheduling method and system Download PDF

Info

Publication number
CN103780646A
CN103780646A CN201210404063.4A CN201210404063A CN103780646A CN 103780646 A CN103780646 A CN 103780646A CN 201210404063 A CN201210404063 A CN 201210404063A CN 103780646 A CN103780646 A CN 103780646A
Authority
CN
China
Prior art keywords
server
factor
policy group
value
constraints
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210404063.4A
Other languages
Chinese (zh)
Other versions
CN103780646B (en
Inventor
皮剑
罗福明
周庚申
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China the Great Wall science and technology group Limited by Share Ltd
Original Assignee
China Great Wall Computer Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Great Wall Computer Shenzhen Co Ltd filed Critical China Great Wall Computer Shenzhen Co Ltd
Priority to CN201210404063.4A priority Critical patent/CN103780646B/en
Publication of CN103780646A publication Critical patent/CN103780646A/en
Application granted granted Critical
Publication of CN103780646B publication Critical patent/CN103780646B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention is suitable for the technical field of cloud computing and provides a cloud resource scheduling method and system. The method comprises the following steps: receiving a submitted resource request; based on a constraint condition of the resource request, screening out servers according with the constraint condition; based on external data values, internal status values and operation and maintenance data values, calculating efficiency values of the servers according with the constraint condition; and selecting the server, of which the efficiency value is the largest, from the servers according with the constraint condition and allocating the server, of which the efficiency value is the largest, to the resource request. The efficiency values of the serves are calculated based on historical records, performance statistics and external data input, the efficiency values are optimized by continuously optimizing calculating parameters of the efficiency values, and the resources are allocated to the resource request based on the efficiency values, so that dynamic and reasonable resource allocation can be realized, and resource allocation can be automatically optimized continuously.

Description

A kind of dispatching method of cloud resource and system
Technical field
The invention belongs to cloud computing technology field, relate in particular to a kind of dispatching method and system of cloud resource.
Background technology
Cloud computing utilizes the transmittability of high speed internet, the resources such as calculating, storage, software and services are transplanted to the extensive high-performance computer, personal computer, virtual machine of the Internet centralized management from the personal computer that disperses or server, thereby make user use these resources as using electric power, a kind of new computation schema has been explained in cloud computing: application, data and IT resource offer user in the mode of service by network and use.
Cloud scheduling of resource refers in a specific cloud environment, according to resource service regeulations, carries out the process of scheduling of resource between different resources.Under prior art, cloud platform resource scheduling strategy adopts average scheduling mode, random schedule mode or the utilization of resources to maximize the single tactful modes such as scheduling, make resource can not get rational utilization, thereby be difficult to rational Resources allocation, reduced the performance of whole task.
Summary of the invention
The object of the embodiment of the present invention is to provide a kind of method and system of cloud scheduling of resource, cannot realize the problem of resource rational utilization to solve prior art.
Embodiments of the invention are achieved in that a kind of method of cloud scheduling of resource, said method comprising the steps of:
Receive the resource request of submitting to;
According to the constraints of resource request, filter out the server that meets described constraints;
Calculating meets external data value, internal state value and the O&M data value of the server of described constraints;
According to default weights, outside data value, internal state value and O&M data value are weighted to summation, calculate the efficiency value of the server that meets constraints;
In the server that meets described constraints, select the server of efficiency value maximum, and give described resource request the server-assignment of described efficiency value maximum.
Another object of embodiments of the invention is to provide a kind of system of cloud scheduling of resource, and described system comprises:
Receiving element, for receiving the resource request of submission;
Screening unit, for according to the constraints of resource request, filters out the server that meets described constraints;
The first computing unit, for calculating external data value, internal state value and the O&M data value of the server that meets described constraints;
The second computing unit, for according to default weights, is weighted summation to outside data value, internal state value and O&M data value, calculates the efficiency value of the server that meets constraints;
Allocation units, for select the server of efficiency value maximum at the server that meets described constraints, and give described resource request the server-assignment of described efficiency value maximum.
The embodiment of the present invention is passed through server historical data, performance statistics and external data COMPREHENSIVE CALCULATING server efficiency value, realize processing by demand and dynamic assignment data, solve prior art and existed resource distribution mode single, the problem of resource unreasonable distribution.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the realization flow figure of the method for cloud scheduling of resource provided by the invention;
Fig. 2 is the modular structure figure of the system of cloud scheduling of resource provided by the invention;
Fig. 3 is the realization flow figure of the method for the cloud scheduling of resource that provides of one embodiment of the invention;
Fig. 4 is the realization flow figure of the method for the cloud scheduling of resource that provides of another embodiment of the present invention;
Fig. 5 is the modular structure figure of the system of the cloud scheduling of resource that provides of another embodiment of the present invention;
Fig. 6 is the modular structure figure of the system of the cloud scheduling of resource that provides of another embodiment of the present invention;
Fig. 7 is the strategy group evolution schematic diagram that the embodiment of the present invention provides.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The invention provides a kind of method of cloud scheduling of resource, as shown in Figure 1, concrete steps comprise described method:
The resource request that S101, reception are submitted to;
S102, according to the constraints of resource request, filter out the server that meets described constraints;
S103, calculating meet external data value, internal state value and the O&M data value of the server of described constraints;
S104, according to default weights, outside data value, internal state value and O&M data value are weighted to summation, calculate the efficiency value of server that meets constraints;
S105, in the each server that meets described constraints, select the server of efficiency value maximum, and give described resource request the server-assignment of described efficiency value maximum.
Optionally, the method that realizes S103 specifically can comprise:
According to the each assembly combination property of server P prodcut, server failure rate R error, brand public credibility S brandwith product testing score P evaluate, and external data in the initial policy group input EDI factor
Figure BDA00002288826600041
with breakdown loss factor sigma, calculate the external data value of the server that meets constraints,
Figure BDA00002288826600042
and
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memory, hard disk average read-write speed Avg_S rw, switch average delay Avg_D switch, the comprehensive caloric value H of server serverwith server energy consumption C server, and cpu load factor ω, internal memory load factor θ and input and output I/O raising efficiency factor mu in initial policy group, calculates the internal state value of the server that meets constraints,
Figure BDA00002288826600051
Figure BDA00002288826600052
and
According to the server O&M failure rate E in historical record history, server uses duration T, server status record S history, server performance parameter P history, year power consumption C power, year Operational Visit amount V, maximum concurrent number N and maximum application load N apps,, and ODI factor set δ, server decay factor ε and concurrent load factor ρ in initial policy group, calculates the O&M data value of the server that meets constraints,
Figure BDA00002288826600053
Figure BDA00002288826600054
Optionally, said method also comprises:
By the default time interval, obtain optimal policy group, use the factor in optimal policy group to replace the factor in initial policy group.
Optionally, described pressing the default time interval, obtains optimal policy group, and the factor that uses the factor in optimal policy group to replace in initial policy group is specially:
By the default EDI factor
Figure BDA00002288826600055
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and an initial policy group of concurrent load factor ρ composition;
Use random function to generate M group randomized policy group, described M is greater than 1 integer, the EDI factor in randomized policy group
Figure BDA00002288826600056
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and concurrent load factor ρ are in threshold range;
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memorywith hard disk average read-write speed Avg_S rwcarry out equivalent weighted sum and obtain the load value of server, in Servers-all, choose the server of load value minimum as simulated environment.
In default simulated environment, test randomized policy group, in the time that the operation of randomized policy group causes the direct fault of simulated environment, directly delete the randomized policy group that causes fault;
According to the default time interval, the performance parameter of the rear system of randomized policy group operation that randomized policy group more of the same clan is maximum, the optimum corresponding randomized policy group of performance parameter of getting the rear system of operation is optimal policy group, and uses the factor in optimal policy group to replace the factor in initial policy group.
The invention provides a kind of system of cloud scheduling of resource, described system as shown in Figure 2, specifically comprises:
Receiving element 21, for receiving the resource request of submission;
Screening unit 22, for according to the constraints of resource request, filters out the server that meets described constraints;
The first computing unit 23, for calculating external data value, internal state value and the O&M data value of the server that meets described constraints;
The second computing unit 24, for according to default weights, is weighted summation to outside data value, internal state value and O&M data value, calculates the efficiency value of the server that meets constraints;
Allocation units 25, for calculating the efficiency value of the server that meets described constraints according to external data value, internal state value and O&M data value.
Optionally, described the second computing unit 23 specifically for:
According to the each assembly combination property of server P prodcut, server failure rate R error, brand public credibility S brandwith product testing score P evaluate, and external data in the initial policy group input EDI factor
Figure BDA00002288826600071
with breakdown loss factor sigma, calculate the external data value of the server that meets constraints,
Figure BDA00002288826600072
and
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memory, hard disk average read-write speed Avg_S rw, switch average delay Avg_D switch, the comprehensive caloric value H of server serverwith server energy consumption C server, and cpu load factor ω, internal memory load factor θ and input and output I/O raising efficiency factor mu in initial policy group, calculates the internal state value of the server that meets constraints,
Figure BDA00002288826600073
Figure BDA00002288826600074
and
According to the server O&M failure rate E in historical record history, server uses duration T, server status record S history, server performance parameter P history, year power consumption C power, year Operational Visit amount V, maximum concurrent number N and maximum application load N apps,, and ODI factor set δ, server decay factor ε and concurrent load factor ρ in initial policy group, calculates the O&M data value of the server that meets constraints,
Figure BDA00002288826600075
Figure BDA00002288826600076
Optionally, described system further comprises:
Replacement unit, for according to the default time interval, obtains optimal policy group, uses the factor in optimal policy group to replace the factor in initial policy group.
Optionally, described replacement unit is further used for:
By the default EDI factor
Figure BDA00002288826600081
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and an initial policy group of concurrent load factor ρ composition;
Use random function to generate M group randomized policy group, described M is greater than 1 integer, the EDI factor in randomized policy group
Figure BDA00002288826600082
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and concurrent load factor ρ are in threshold range;
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memorywith hard disk average read-write speed Avg_S rwcarry out equivalent weighted sum and obtain the load value of server, divide default space size as simulated environment at the server of load value minimum.
In default simulated environment, test randomized policy group, in the time that the operation of randomized policy group causes the direct fault of simulated environment, directly delete the randomized policy group that causes fault;
According to the default time interval, the performance parameter of the rear system of randomized policy group operation that randomized policy group more of the same clan is maximum, the optimum corresponding randomized policy group of performance parameter of getting the rear system of operation is optimal policy group, and uses the factor in optimal policy group to replace the factor in initial policy group.
Fig. 3 shows the realization flow of the method for the cloud scheduling of resource that one embodiment of the invention provides, and details are as follows for the method process:
The resource request that S301, reception are submitted to;
S302, according to the constraints of resource request, in cloud system, filter out the server that meets described constraints;
In the present embodiment, suppose and have 10 station server clusters, a new request, constraints is that server O&M failure rate must not exceed the average occupancy of 0.2%, CPU and is no more than 70%, the application load amount on server is no more than 8.Three parameters such as the application load amount on server O&M failure rate, the average occupancy of CPU and the server of 10 station servers are as shown in table 1:
Figure BDA00002288826600091
Table 1
In table 1, filter out this 4 station server of Server_2, Server_5, Server_9 and Server_10 according to constraints and meet constraints.
S303, calculating meet external data value, internal state value and the O&M data value of the server of constraints;
In the present embodiment, needing the server of considering is Server_2, Server_5, Server_9 and the Server_10 filtering out in step S302, calculates external data value, internal state value and the O&M data value of these servers.
External data input (External Data Input, EDI) refers to obtains from outside channel, to equipment in cloud resource pool or apply the relevant index such as reliability, actual performance; Cloud resource pool (Cloud pool, CP) refers to the IT resources such as server that cloud platform controls by Intel Virtualization Technology and distributed computing technology, memory device, network.Obtaining after the formation inventory of cloud resource pool, can connect the external data input that EDI center obtains the equipment in CP, also can direct labor import aforesaid external data input, the major parameter of external data input and the computational methods of external data value are as shown in table 2;
Figure BDA00002288826600101
Table 2
In table 2, the EDI factor and the breakdown loss factor are to read from initial policy group.
Status data input (Status Data Input, SDI) is the data that monitor state obtains, and the major parameter of SDI and the computational methods of internal state value are as shown in table 3;
Figure BDA00002288826600111
Table 3
In table 3, the cpu load factor, internal memory load factor and the I/O raising efficiency factor are to obtain from initial policy group.
O&M data inputs (Operation Data Input, ODI) refer to the state recording of accumulative total and the data of personnel's operation, and the major parameter of ODI and O&M data value are as shown in table 4;
Figure BDA00002288826600112
Figure BDA00002288826600121
Table 4
In table 4, the ODI factor, server decay factor and concurrent load factor are to obtain from initial policy group.
S304, calculating meet the efficiency value of the server of constraints;
In the present embodiment, first the efficiency value of each server calculates needs to set EDI weights, SDI weights and ODI weights, and described weights can be for being less than 1, be greater than 1 or equal 1 positive number;
Efficiency value Potency=EDI*EDI weights+SDI*SDI weights+ODI*ODI weights;
Suppose that in step S303, result of calculation is as shown in table 5, and EDI weights, SDI weights and ODI weights are all 1;
Computer Server_2 Server_5 Server_9 Server_10
EDI 1702 2201 1910 1855
SDI 271 255 301 299
ODI 3301 2901 3088 3125
Table 5
According to data in table 5 and weights, the efficiency value that the efficiency value that the efficiency value that the efficiency value that can calculate Server_2 is 5274, Server_5 is 5357, Server_9 is 5299, Server_10 is 5279.
S305, in the described server that meets constraints, select in the server of efficiency value maximum, and give described resource request the server-assignment of described efficiency value maximum.
In the present embodiment, step S304 calculates the efficiency value maximum of Server_9, and therefore this resource request is assigned to Server_9.
Fig. 4 shows the realization flow of the method for the cloud scheduling of resource that another embodiment of the present invention provides, and details are as follows for the method process:
S401, by the default EDI factor
Figure BDA00002288826600131
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and an initial policy group of concurrent load factor ρ composition;
In the present embodiment, Figure 7 shows that example, before system brings into operation, preset above-mentioned whole factor assignment, and by an initial policy group of above-mentioned whole factor composition.
S402, use random function generate M(M and are greater than 1 integer) group randomized policy group, the EDI factor of described randomized policy group
Figure BDA00002288826600132
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and concurrent load factor ρ are in threshold range;
In the present embodiment, first whole factors are set to effective scope, in effective range, give at random different values by all factors of initial policy group; Figure 7 shows that example, start to generate 3 groups of randomized policy groups at first evolution cycle and be respectively strategy group 1, strategy group 2, strategy group 3; Before the second evolution cycle starts, strategy group 2 is because cause simulated environment fault and be eliminated in first cycle, start strategy group 1 random generation strategy group a, strategy group b and strategy group c at the second evolution cycle, strategy group 3 random generation strategy group e, strategy group f and strategy group g.
S403, the average occupancy Avg_O of the CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memorywith hard disk average read-write speed Avg_S rwcarry out equivalent weighted sum and obtain the load value of server, divide default space size as simulated environment at the server of load value minimum;
S404, in default simulated environment, test randomized policy group, in the time that the operation of randomized policy group causes the direct fault of simulated environment, directly delete the randomized policy group that causes fault;
In the present embodiment, Figure 7 shows that example, in first evolution cycle, strategy group 2 is deleted because causing simulated environment operation troubles, and in second evolution cycle, strategy organizes that b, c and g cause simulated environment operation troubles and deleted.
S405, according to the default time interval, obtain optimal policy group, and use the factor in optimal policy group to replace the factor in initial policy group.
In the present embodiment, default certain time interval, carries out once strategy group a cycle in the time interval and relatively, selects optimal policy group.The strategy of selecting optimal policy group is first to determine the maximum randomized policy group of normal strategy group of the same clan, the performance parameter optimum of system after operation be chosen in simulated environment in the maximum randomized policy group of strategy group of the same clan in, described performance parameter can be calculated and obtain according to the failure rate of operation, load balance, also can obtain according to the calculation of parameter of other operations, performance parameter computational methods specifically realize according to actual conditions demand;
Still Figure 7 shows that example, in first evolution cycle, the random variation of initial policy group has generated tactful group 1, strategy group 2 and strategy group 3, in simulated environment, strategy group 2 is eliminated because of operation troubles, strategy group 1 and strategy group 3 are all the variations of initial policy group, therefore their strategy group of the same clan is all the other side, therefore cannot find optimal policy group by quantity more of the same clan, suppose that the performance parameter that tactful group 1 is moved rear system is better than the tactful performance parameter of organizing the rear system of 3 operation, strategy group 1 is optimal policy group in the time that first evolution cycle finishes so, replace the factor of initial policy group by the factor of strategy group 1,
In the second evolution cycle, the strategy group 1 of survival is by random variation generation strategy group a, strategy group b and strategy group c, the strategy group 3 of survival is by random variation generation strategy group e, strategy group f and strategy group g, by the operation in simulated environment, strategy group a, strategy group e and strategy group f survive, strategy group e has strategy group f of the same clan, strategy group f has strategy group e of the same clan, and tactful tuple a is without tactful group of the same clan, therefore select optimal policy group can compare by comparison strategy group e and the postrun performance parameter of tactful ancestral f, in strategy group e and strategy group f, select optimal policy group, and replace the factor of initial policy group by the factor of optimal policy group,
Make to use the same method in the follow-up cycle and select optimal policy group, and replace the factor of initial policy group by the factor of optimal policy group, also have much for the method for optimal policy group selection, do not repeat one by one at this.
In the present embodiment, carry out the random mode generating by the factor to default, in the environment of simulation, implement and compare result of implementation, guaranteed the more and more optimization of the factor; The factor is to affect the variable that efficiency value calculates, and the optimization of the factor can cause efficiency value optimization, and final cloud system is more and more reasonable to the distribution of resource.
The modular structure figure that Figure 5 shows that the system of the cloud scheduling of resource that another embodiment of the present invention provides, for convenience of explanation, only illustrates the part relevant to the embodiment of the present invention.
The system of this cloud scheduling of resource comprises:
Receiving element 51, for receiving the resource request of submission;
Screening unit 52 for according to the constraints of resource request, filters out the server that meets described constraints in cloud system;
The first computing unit 53, for calculating external data value, internal state value and the O&M data value of the server that meets constraints
The second computing unit 54, for calculating the efficiency value of the server that meets constraints;
Allocation units 55 are selected in the server of efficiency value maximum in the described server that meets constraints, and give described resource request the server-assignment of described efficiency value maximum.
The modular structure figure that Figure 6 shows that the system of the cloud scheduling of resource that another embodiment of the present invention provides, for convenience of explanation, only illustrates the part relevant to the embodiment of the present invention.
The system of this cloud scheduling of resource comprises:
Replacement unit 61, for according to the default time interval, obtains optimal policy group, uses the factor in optimal policy group to replace the factor in initial policy group.
Described replacement unit 61 specifically comprises:
Grouping module 611, for by the default EDI factor
Figure BDA00002288826600161
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and an initial policy group of concurrent load factor ρ composition;
Generation module 612, is greater than 1 integer for using random function to generate M(M) group randomized policy group, the EDI factor of randomized policy group
Figure BDA00002288826600162
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and concurrent load factor ρ are in threshold range;
Simulated environment arranges module 613, for the average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memorywith hard disk average read-write speed Avg_S rwcarry out equivalent weighted sum and obtain the load value of server, divide default space size as simulated environment at the server of load value minimum;
Test module 614, for testing randomized policy group in default simulated environment, in the time that the operation of randomized policy group causes the direct fault of simulated environment, directly deletes the randomized policy group that causes fault;
Replacement module 615, for according to the default time interval, obtains optimal policy group, and uses the factor in optimal policy group to replace the factor in initial policy group.
One of ordinary skill in the art will appreciate that and just divide according to function logic for above-described embodiment included modules, but be not limited to above-mentioned division, as long as can realize corresponding function; In addition, the concrete title of each functional module also, just for the ease of mutual differentiation, is not limited to protection scope of the present invention.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any modifications of doing within the spirit and principles in the present invention, be equal to and replace and improvement etc., within all should being included in protection scope of the present invention.

Claims (8)

1. a dispatching method for cloud resource, is characterized in that, described method comprises:
Receive the resource request of submitting to;
According to the constraints of resource request, filter out the server that meets described constraints;
Calculating meets external data value, internal state value and the O&M data value of the server of described constraints;
According to default weights, outside data value, internal state value and O&M data value are weighted to summation, calculate the efficiency value of the server that meets constraints;
In the server that meets described constraints, select the server of efficiency value maximum, and give described resource request the server-assignment of described efficiency value maximum.
2. the method for claim 1, is characterized in that, external data value, internal state value and O&M data value that described calculating meets the server of described constraints are specially:
According to the each assembly combination property of server P prodcut, server failure rate R error, brand public credibility S brandwith product testing score P evaluate, and external data in the initial policy group input EDI factor
Figure FDA00002288826500011
with breakdown loss factor sigma, calculate the external data value of the server that meets constraints,
Figure FDA00002288826500012
and
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memory, hard disk average read-write speed Avg_S rw, switch average delay Avg_D switch, the comprehensive caloric value H of server serverwith server energy consumption C server, and cpu load factor ω, internal memory load factor θ and input and output I/O raising efficiency factor mu in initial policy group, calculates the internal state value of the server that meets constraints,
Figure FDA00002288826500021
and
According to the server O&M failure rate E in historical record history, server uses duration T, server status record S history, server performance parameter P history, year power consumption C power, year Operational Visit amount V, maximum concurrent number N and maximum application load N apps,, and ODI factor set δ, server decay factor ε and concurrent load factor ρ in initial policy group, calculates the O&M data value of the server that meets constraints,
Figure FDA00002288826500022
Figure FDA00002288826500023
3. method as claimed in claim 1 or 2, is characterized in that, described method also comprises:
By the default time interval, obtain optimal policy group, use the factor in optimal policy group to replace the factor in initial policy group.
4. method as claimed in claim 3, described pressing the default time interval, obtains optimal policy group, and the factor that uses the factor in optimal policy group to replace in initial policy group is specially:
By the default EDI factor
Figure FDA00002288826500024
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and an initial policy group of concurrent load factor ρ composition;
Use random function to generate M group randomized policy group, described M is greater than 1 integer, the EDI factor in randomized policy group
Figure FDA00002288826500025
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and concurrent load factor ρ are in threshold range;
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memorywith hard disk average read-write speed Avg_S rwcarry out equivalent weighted sum and obtain the load value of server, divide default space size as simulated environment at the server of load value minimum.
In default simulated environment, test randomized policy group, in the time that the operation of randomized policy group causes the direct fault of simulated environment, directly delete the randomized policy group that causes fault;
According to the default time interval, the performance parameter of the rear system of randomized policy group operation that randomized policy group more of the same clan is maximum, the optimum corresponding randomized policy group of performance parameter of getting the rear system of operation is optimal policy group, and uses the factor in optimal policy group to replace the factor in initial policy group.
5. a dispatching patcher for cloud resource, is characterized in that, described system comprises:
Receiving element, for receiving the resource request of submission;
Screening unit, for according to the constraints of resource request, filters out the server that meets described constraints;
The first computing unit, for calculating external data value, internal state value and the O&M data value of the server that meets described constraints;
The second computing unit, for according to default weights, is weighted summation to outside data value, internal state value and O&M data value, calculates the efficiency value of the server that meets constraints;
Allocation units, for select the server of efficiency value maximum at the server that meets described constraints, and give described resource request the server-assignment of described efficiency value maximum.
6. system as claimed in claim 5, is characterized in that, described the first computing unit specifically for:
According to the each assembly combination property of server P prodcut, server failure rate R error, brand public credibility S brandwith product testing score P evaluate, and external data in the initial policy group input EDI factor
Figure FDA00002288826500041
with breakdown loss factor sigma, calculate the external data value of the server that meets constraints,
Figure FDA00002288826500042
and
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memory, hard disk average read-write speed Avg_S rw, switch average delay Avg_D switch, the comprehensive caloric value H of server serverwith server energy consumption C server, and cpu load factor ω, internal memory load factor θ and input and output I/O raising efficiency factor mu in initial policy group, calculates the internal state value of the server that meets constraints,
Figure FDA00002288826500043
Figure FDA00002288826500044
and
According to the server O&M failure rate E in historical record history, server uses duration T, server status record S history, server performance parameter P history, year power consumption C power, year Operational Visit amount V, maximum concurrent number N and maximum application load N apps,, and ODI factor set δ, server decay factor ε and concurrent load factor ρ in initial policy group, calculates the O&M data value of the server that meets constraints,
Figure FDA00002288826500045
7. the system as described in claim 5 or 6, is characterized in that, described system further comprises:
Replacement unit, for according to the default time interval, obtains optimal policy group, uses the factor in optimal policy group to replace the factor in initial policy group.
8. system as claimed in claim 7, is characterized in that, described replacement unit further specifically for:
By the default EDI factor
Figure FDA00002288826500051
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and an initial policy group of concurrent load factor ρ composition;
Use random function to generate M group randomized policy group, described M is greater than 1 integer, the EDI factor in randomized policy group
Figure FDA00002288826500052
breakdown loss factor sigma, cpu load factor ω, internal memory load factor θ, I/O raising efficiency factor mu, ODI factor delta, server decay factor ε and concurrent load factor ρ are in threshold range;
The average occupancy Avg_O of CPU obtaining according to collection cpu, the average occupancy Avg_O of internal memory memorywith hard disk average read-write speed Avg_S rwcarry out equivalent weighted sum and obtain the load value of server, dividing default space size as simulated environment at the server of load value minimum.
In default simulated environment, test randomized policy group, in the time that the operation of randomized policy group causes the direct fault of simulated environment, directly delete the randomized policy group that causes fault;
According to the default time interval, the performance parameter of the rear system of randomized policy group operation that randomized policy group more of the same clan is maximum, the optimum corresponding randomized policy group of performance parameter of getting the rear system of operation is optimal policy group, and uses the factor in optimal policy group to replace the factor in initial policy group.
CN201210404063.4A 2012-10-22 2012-10-22 Cloud resource scheduling method and system Active CN103780646B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210404063.4A CN103780646B (en) 2012-10-22 2012-10-22 Cloud resource scheduling method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210404063.4A CN103780646B (en) 2012-10-22 2012-10-22 Cloud resource scheduling method and system

Publications (2)

Publication Number Publication Date
CN103780646A true CN103780646A (en) 2014-05-07
CN103780646B CN103780646B (en) 2017-04-12

Family

ID=50572471

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210404063.4A Active CN103780646B (en) 2012-10-22 2012-10-22 Cloud resource scheduling method and system

Country Status (1)

Country Link
CN (1) CN103780646B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105099782A (en) * 2015-08-18 2015-11-25 北京京东世纪贸易有限公司 Method and system for controlling big data resource of cloud environment cluster
CN105162840A (en) * 2015-07-31 2015-12-16 清华大学 Online distributed request scheduling and service management method and agent system
CN105335229A (en) * 2014-07-25 2016-02-17 杭州华三通信技术有限公司 Business resource scheduling method and apparatus
CN105763636A (en) * 2016-04-15 2016-07-13 北京思特奇信息技术股份有限公司 Optimal host selection method and system in distributed system
WO2017128980A1 (en) * 2016-01-29 2017-08-03 华为技术有限公司 Method and device for managing resources in cloud platform
CN107277143A (en) * 2017-06-21 2017-10-20 郑州云海信息技术有限公司 A kind of resource matched management method and device
CN107645397A (en) * 2016-07-21 2018-01-30 阿里巴巴集团控股有限公司 A kind of system, device and method that fault simulation is carried out in distributed system
WO2018072619A1 (en) * 2016-10-20 2018-04-26 阿里巴巴集团控股有限公司 Resource scheduling method, device, and system
CN108780403A (en) * 2016-03-10 2018-11-09 沃拉斯堤技术解决方案公司 To the system and method being managed for the cloud computing resources of information system
CN105306597B (en) * 2015-11-19 2019-05-14 国家电网公司 A kind of cloud computing service method of quality control
CN110019313A (en) * 2017-12-30 2019-07-16 中国移动通信集团四川有限公司 Method for optimizing resources, device, equipment and medium
CN110691118A (en) * 2019-08-30 2020-01-14 许昌许继软件技术有限公司 Service selection method and device in micro-service cluster
CN110764904A (en) * 2019-09-23 2020-02-07 合肥中科类脑智能技术有限公司 Resource scheduling method and system based on FPGA chip
CN113392988A (en) * 2021-05-10 2021-09-14 贵州乌江水电开发有限责任公司乌江渡发电厂 Maintenance file management method for paperless operation of hydraulic power plant
CN116483013A (en) * 2023-06-19 2023-07-25 成都实时技术股份有限公司 High-speed signal acquisition system and method based on multichannel collector

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1300988A (en) * 1999-06-17 2001-06-27 国际商业机器公司 System and method for comprehensive load distribution and source management in Internet network
US20020059429A1 (en) * 1999-01-20 2002-05-16 Geoffrey C. Carpenter Client-side method and apparatus for improving the availability and performance of network mediated services
US20020198995A1 (en) * 2001-04-10 2002-12-26 International Business Machines Corporation Apparatus and methods for maximizing service-level-agreement profits
US20040230317A1 (en) * 2003-05-15 2004-11-18 Sun Microsystems, Inc. Method, system, and program for allocating storage resources
CN101026617A (en) * 2006-02-18 2007-08-29 华为技术有限公司 Media resource scheduling method for IMS network
CN101067823A (en) * 2006-05-02 2007-11-07 国际商业机器公司 System and method for optimizing federated databases magagement
CN101610433A (en) * 2009-07-10 2009-12-23 北京邮电大学 The multi-constraint condition routing selection method that a kind of support policy is resolved
CN101841526A (en) * 2010-03-04 2010-09-22 清华大学 Cluster streaming media server system applied to large-scale user demand
CN101909196A (en) * 2009-06-05 2010-12-08 华为技术有限公司 Channel-switching handling method, system and related equipment
EP2357561A1 (en) * 2004-03-13 2011-08-17 Adaptive Computing Enterprises, Inc. System and method for providing advanced reservations in a compute environment
CN102624922A (en) * 2012-04-11 2012-08-01 武汉大学 Method for balancing load of network GIS heterogeneous cluster server
CN102681889A (en) * 2012-04-27 2012-09-19 电子科技大学 Scheduling method of cloud computing open platform
CN102739770A (en) * 2012-04-18 2012-10-17 上海和辰信息技术有限公司 Method and system for scheduling resource based on cloud computing

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020059429A1 (en) * 1999-01-20 2002-05-16 Geoffrey C. Carpenter Client-side method and apparatus for improving the availability and performance of network mediated services
CN1300988A (en) * 1999-06-17 2001-06-27 国际商业机器公司 System and method for comprehensive load distribution and source management in Internet network
US20020198995A1 (en) * 2001-04-10 2002-12-26 International Business Machines Corporation Apparatus and methods for maximizing service-level-agreement profits
US20040230317A1 (en) * 2003-05-15 2004-11-18 Sun Microsystems, Inc. Method, system, and program for allocating storage resources
EP2357561A1 (en) * 2004-03-13 2011-08-17 Adaptive Computing Enterprises, Inc. System and method for providing advanced reservations in a compute environment
CN101026617A (en) * 2006-02-18 2007-08-29 华为技术有限公司 Media resource scheduling method for IMS network
CN101067823A (en) * 2006-05-02 2007-11-07 国际商业机器公司 System and method for optimizing federated databases magagement
CN101909196A (en) * 2009-06-05 2010-12-08 华为技术有限公司 Channel-switching handling method, system and related equipment
CN101610433A (en) * 2009-07-10 2009-12-23 北京邮电大学 The multi-constraint condition routing selection method that a kind of support policy is resolved
CN101841526A (en) * 2010-03-04 2010-09-22 清华大学 Cluster streaming media server system applied to large-scale user demand
CN102624922A (en) * 2012-04-11 2012-08-01 武汉大学 Method for balancing load of network GIS heterogeneous cluster server
CN102739770A (en) * 2012-04-18 2012-10-17 上海和辰信息技术有限公司 Method and system for scheduling resource based on cloud computing
CN102681889A (en) * 2012-04-27 2012-09-19 电子科技大学 Scheduling method of cloud computing open platform

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105335229A (en) * 2014-07-25 2016-02-17 杭州华三通信技术有限公司 Business resource scheduling method and apparatus
CN105335229B (en) * 2014-07-25 2020-07-07 新华三技术有限公司 Scheduling method and device of service resources
CN105162840A (en) * 2015-07-31 2015-12-16 清华大学 Online distributed request scheduling and service management method and agent system
CN105162840B (en) * 2015-07-31 2018-12-28 清华大学 Distribution on line formula request scheduling and service management and agency plant
CN105099782A (en) * 2015-08-18 2015-11-25 北京京东世纪贸易有限公司 Method and system for controlling big data resource of cloud environment cluster
CN105306597B (en) * 2015-11-19 2019-05-14 国家电网公司 A kind of cloud computing service method of quality control
WO2017128980A1 (en) * 2016-01-29 2017-08-03 华为技术有限公司 Method and device for managing resources in cloud platform
US10805385B2 (en) 2016-01-29 2020-10-13 Huawei Technologies Co., Ltd. Method and apparatus for managing resource on cloud platform
CN108780403A (en) * 2016-03-10 2018-11-09 沃拉斯堤技术解决方案公司 To the system and method being managed for the cloud computing resources of information system
CN105763636B (en) * 2016-04-15 2019-01-15 北京思特奇信息技术股份有限公司 The selection method and system of optimal host in a kind of distributed system
CN105763636A (en) * 2016-04-15 2016-07-13 北京思特奇信息技术股份有限公司 Optimal host selection method and system in distributed system
CN107645397A (en) * 2016-07-21 2018-01-30 阿里巴巴集团控股有限公司 A kind of system, device and method that fault simulation is carried out in distributed system
CN107645397B (en) * 2016-07-21 2021-01-05 阿里巴巴集团控股有限公司 System, device and method for fault simulation in distributed system
TWI780065B (en) * 2016-10-20 2022-10-11 香港商阿里巴巴集團服務有限公司 Method, apparatus and system for resource scheduling
CN107967173A (en) * 2016-10-20 2018-04-27 阿里巴巴集团控股有限公司 A kind of methods, devices and systems of scheduling of resource
WO2018072619A1 (en) * 2016-10-20 2018-04-26 阿里巴巴集团控股有限公司 Resource scheduling method, device, and system
CN107277143A (en) * 2017-06-21 2017-10-20 郑州云海信息技术有限公司 A kind of resource matched management method and device
CN110019313A (en) * 2017-12-30 2019-07-16 中国移动通信集团四川有限公司 Method for optimizing resources, device, equipment and medium
CN110691118A (en) * 2019-08-30 2020-01-14 许昌许继软件技术有限公司 Service selection method and device in micro-service cluster
CN110764904A (en) * 2019-09-23 2020-02-07 合肥中科类脑智能技术有限公司 Resource scheduling method and system based on FPGA chip
CN110764904B (en) * 2019-09-23 2022-10-28 北京中科云脑智能技术有限公司 Resource scheduling method and system based on FPGA chip
CN113392988A (en) * 2021-05-10 2021-09-14 贵州乌江水电开发有限责任公司乌江渡发电厂 Maintenance file management method for paperless operation of hydraulic power plant
CN113392988B (en) * 2021-05-10 2023-06-09 贵州乌江水电开发有限责任公司乌江渡发电厂 Maintenance file management method for paperless operation of hydropower plant
CN116483013A (en) * 2023-06-19 2023-07-25 成都实时技术股份有限公司 High-speed signal acquisition system and method based on multichannel collector
CN116483013B (en) * 2023-06-19 2023-09-05 成都实时技术股份有限公司 High-speed signal acquisition system and method based on multichannel collector

Also Published As

Publication number Publication date
CN103780646B (en) 2017-04-12

Similar Documents

Publication Publication Date Title
CN103780646B (en) Cloud resource scheduling method and system
CN110022226B (en) Object-oriented data acquisition system and acquisition method
CN110225074B (en) Communication message distribution system and method based on equipment address domain
CN104038540B (en) Method and system for automatically selecting application proxy server
CN109617099B (en) Virtual energy storage coordination control system and method thereof
CN103248659A (en) Method and system for dispatching cloud computed resources
CN102694868A (en) Cluster system implementation and task dynamic distribution method
CN104133727A (en) Load distribution method based on real-time resources
CN102929961A (en) Data processing method and device thereof based on building quick data staging channel
CN102025753B (en) Load balancing method and equipment for data resources of servers
CN105071994B (en) A kind of mass data monitoring system
CN104283959A (en) Performance-grading-based storage mechanism suitable for cloud platform
CN102637138A (en) Method for computing and scheduling virtual machine
CN103577337B (en) Space allocation method and device for storage system
CN106681823A (en) Load balancing method for processing MapReduce data skew
Mylavarapu et al. An optimized capacity planning approach for virtual infrastructure exhibiting stochastic workload
CN106326012A (en) Web application cluster buffer utilization method and system
CN104111875A (en) Device, system and method for dynamically controlling number of newly-increased tasks at cloud data center
CN103501509B (en) A kind of method and device equalizing radio network controller load
CN104378239A (en) Rapid reliability index statistical system and method based on cluster frame
CN103902310A (en) Scheduling system and method for starting of virtual machines
CN107277143A (en) A kind of resource matched management method and device
CN112968962B (en) Cloud platform storage resource scheduling method based on distributed computer cluster architecture
CN109522129A (en) A kind of resource method for dynamically balancing, device and relevant device
CN112612579B (en) Virtual machine deployment method, storage medium and computer equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder

Address after: 518057 computer building of the Great Wall, Nanshan District science and Technology Park, Shenzhen, Guangdong

Patentee after: China the Great Wall science and technology group Limited by Share Ltd

Address before: 518057 computer building of the Great Wall, Nanshan District science and Technology Park, Shenzhen, Guangdong

Patentee before: China Changcheng Computer Shenzhen Co., Ltd.

CP01 Change in the name or title of a patent holder