CN107402812A - Cluster resource dispatching method, device, equipment and storage medium - Google Patents
Cluster resource dispatching method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN107402812A CN107402812A CN201710375321.3A CN201710375321A CN107402812A CN 107402812 A CN107402812 A CN 107402812A CN 201710375321 A CN201710375321 A CN 201710375321A CN 107402812 A CN107402812 A CN 107402812A
- Authority
- CN
- China
- Prior art keywords
- resource
- scheduler
- scheduling
- cluster
- applicant
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides a kind of cluster resource dispatching method, device and storage medium, for two or more Resource Schedulers in cluster, one of Resource Scheduler is preassigned as primary resource scheduler, other Resource Schedulers are as secondary Resource Scheduler, secondary Resource Scheduler is associated with least one secondary resource applicant, and this method includes：Primary resource scheduler determines the resource in cluster；Secondary Resource Scheduler receives the resource scheduling request that secondary resource applicant is initiated, and the resource scheduling request that secondary resource applicant is initiated is transmitted into primary resource scheduler；Primary resource scheduler receives the resource scheduling request that secondary Resource Scheduler is sent, and the resource in cluster determines that scheduling of resource result is sent to secondary Resource Scheduler；Scheduling of resource result is sent to secondary resource applicant by secondary Resource Scheduler.The embodiment of the present application is avoided that the problem of unreasonable scheduling of resource and scheduling result conflict, and excessive transformation need not be done to the Resource Scheduler in cluster, and cost of implementation is relatively low.
Description
Technical field
The application is related to field of computer technology, more particularly to cluster resource dispatching method, device, equipment and storage are situated between
Matter.
Background technology
At present, there is the situation that multiple Scheduling Frameworks coexist for same cluster, a kind of common processing mode is to collect
Group is horizontally or vertically cut into multiple subsets, and each subset is given a Resource Scheduler (or Scheduling Framework) and carried out
Scheduling.Horizontal cutting refers to：By every machine in cluster, a part of fixed resource is all marked off, a subset is formed, based on money
Source forms another subset.Vertical cutting refers to：Part machine composition a subset in cluster, remaining machine composition is another
Individual subset.Under such a mode, either horizontal cutting or vertical cutting, each Resource Scheduler can be all caused to be responsible for whole
A part for individual cluster resource, it is impossible to shared by flexibly allocating each subset of resources according to the number of upper-layer service application resource
Ratio.Therefore during resource use, partial scheduling device will have inadequate resource, and partial scheduling device can have resource
The situation of waste.
Another common mode is：Cluster is not subjected to resource cutting, but voluntarily dispatched by multiple Resource Schedulers,
But by the voluntarily decision-making of multiple schedulers, so it is possible that scheduling result conflict and situation about being dispatched again, therefore meeting
The problem of causing dispatching efficiency not high.
The content of the invention
To overcome problem present in correlation technique, this application provides cluster resource dispatching method, device, equipment and deposit
Storage media.
A kind of cluster resource dispatching method, for two or more Resource Schedulers in cluster, preassign wherein
One Resource Scheduler is as primary resource scheduler, and other Resource Schedulers are as secondary Resource Scheduler, the secondary scheduling of resource
Device is associated with least one secondary resource applicant, and methods described includes：
The primary resource scheduler determines the resource in the cluster；
The secondary Resource Scheduler receives the resource scheduling request that the secondary resource applicant is initiated, by the secondary resource Shen
The resource scheduling request please just initiated is transmitted to the primary resource scheduler；
The primary resource scheduler receives the resource scheduling request that the secondary Resource Scheduler is sent, according in the cluster
Resource determine that scheduling of resource result is sent to the secondary Resource Scheduler；
The scheduling of resource result is sent to the secondary resource applicant by the secondary Resource Scheduler.
In an optional implementation, the primary resource scheduler is associated with least one primary resource applicant, institute
Stating method also includes：
The primary resource scheduler receives the resource scheduling request that the primary resource applicant initiates, according in the cluster
Resource determine that scheduling of resource result is sent to the primary resource applicant.
In an optional implementation, methods described also includes：
When meeting switching condition, switch a Resource Scheduler in other described Resource Schedulers as the main money
Source scheduler.
In an optional implementation, the switching condition includes following one or more conditions：
Error rate meets that default error thresholds, scheduling duration meet that preset duration threshold value, current time reach preset time
Or the number of the resource scheduling request of the primary resource applicant initiation and the resource scheduling request of the secondary resource applicant initiation
Amount difference is more than predetermined number threshold value.
A kind of cluster resource dispatching method, methods described are directed to the cluster for comprising at least two Resource Schedulers, refer in advance
Fixed one of Resource Scheduler is as primary resource scheduler, and other Resource Schedulers are secondary Resource Scheduler, the secondary resource
Scheduler is associated with least one secondary resource applicant, and methods described is applied to secondary Resource Scheduler, including：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
In resource determine scheduling of resource result；
The scheduling of resource result is sent to the secondary resource applicant.
A kind of cluster resource dispatching method, methods described are directed to the cluster for comprising at least two Resource Schedulers, refer in advance
Fixed one of Resource Scheduler is as primary resource scheduler, and other Resource Schedulers are secondary Resource Scheduler, the secondary resource
Scheduler is associated with least one secondary resource applicant, and methods described is applied to primary resource scheduler, including：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, with by described
The scheduling of resource result is sent to the secondary resource applicant by secondary Resource Scheduler.
In an optional implementation, the primary resource scheduler is associated with least one primary resource applicant, institute
Stating method also includes：
The resource scheduling request that the primary resource applicant initiates is received, the resource in the cluster determines that resource is adjusted
Degree result is sent to the primary resource applicant.
A kind of cluster resource dispatching device, for the cluster including at least two Resource Schedulers, preassign wherein one
For individual Resource Scheduler as primary resource scheduler, other Resource Schedulers are secondary Resource Scheduler, and the secondary Resource Scheduler closes
At least one secondary resource applicant is associated with, described device is applied to secondary Resource Scheduler, including：
Request receiving module, it is used for：Receive the resource scheduling request that the secondary resource applicant is initiated；
Forwarding module is asked, is used for：The resource scheduling request is transmitted to the primary resource scheduler；
Scheduling result receiving module, is used for：Receive what the primary resource scheduler was sent according to the secondary Resource Scheduler
Resource scheduling request, the scheduling of resource result determined from the resource in the cluster；
Scheduling result forwarding module, is used for：The scheduling of resource result is sent to the secondary resource applicant.
A kind of cluster resource dispatching device, for the cluster including at least two Resource Schedulers, preassign wherein one
For individual Resource Scheduler as primary resource scheduler, other Resource Schedulers are secondary Resource Scheduler, and the secondary Resource Scheduler closes
At least one secondary resource applicant is associated with, described device is applied to primary resource scheduler, including：
Resource determination module, it is used for：Determine the resource in the cluster；
Request receiving module, it is used for：The secondary Resource Scheduler forwarding is received, is initiated by the secondary resource applicant
Resource scheduling request；
Scheduling result determining module, is used for：Described in resource in the cluster determines that scheduling of resource result is sent to
Secondary Resource Scheduler, so that the scheduling of resource result is sent into the secondary resource applicant by the secondary Resource Scheduler.
A kind of computer equipment, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
In resource determine scheduling of resource result；
The scheduling of resource result is sent to the secondary resource applicant.
A kind of computer equipment, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, with by described
The scheduling of resource result is sent to the secondary resource applicant by secondary Resource Scheduler.
A kind of computer-readable storage medium, have program stored therein in the storage medium instruction, and described program instruction includes：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
In resource determine scheduling of resource result；
The scheduling of resource result is sent to the secondary resource applicant.
A kind of computer-readable storage medium, have program stored therein in the storage medium instruction, and described program instruction includes：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, with by described
The scheduling of resource result is sent to the secondary resource applicant by secondary Resource Scheduler.
The technical scheme that embodiments herein provides can include the following benefits：
In the embodiment of the present application, for the cluster of multiple Resource Schedulers be present, a scheduler is set to be adjusted for primary resource
Device is spent, primary resource scheduler is responsible for dispatching algorithm core logic, the resource scheduling request of other Resource Schedulers, is forwarded to master
Resource Scheduler, and the scheduling result of primary resource scheduler is fetched, although equivalent to multiple Resource Schedulers be present, perform tune
The scheduler of degree strategy only has one, thus whole cluster resource need not be horizontally or vertically cut into multiple subsets, from
And the irrational problem of the scheduling of resource in correlation technique is avoided, simultaneously because a Resource Scheduler is scheduled certainly
Plan, therefore be also not in the problem of scheduling result conflicts.The scheme of the embodiment of the present application need not be adjusted to the resource in cluster
Degree device does excessive transformation, and cost of implementation is relatively low.
It should be appreciated that the general description and following detailed description of the above are only exemplary and explanatory, not
The application can be limited.
Brief description of the drawings
Accompanying drawing herein is merged in specification and forms the part of this specification, shows the implementation for meeting the application
Example, and be used to together with specification to explain the principle of the application.
Figure 1A is a kind of application scenario diagram of cluster resource dispatching method of the application according to an exemplary embodiment.
Figure 1B is a kind of application scenario diagram of cluster resource dispatching method of the application according to an exemplary embodiment.
Fig. 1 C are a kind of flow charts of cluster resource dispatching method of the application according to an exemplary embodiment.
Fig. 2 is the flow chart of another cluster resource dispatching method according to an exemplary embodiment.
Fig. 3 is the flow chart of another cluster resource dispatching method according to an exemplary embodiment.
Fig. 4 is one of computer equipment where cluster resource dispatching device of the application according to an exemplary embodiment
Kind hardware structure diagram.
Fig. 5 is a kind of block diagram of cluster resource dispatching device of the application according to an exemplary embodiment.
Fig. 6 is the block diagram of another cluster resource dispatching device of the application according to an exemplary embodiment.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following description is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended
The example of the consistent apparatus and method of some aspects be described in detail in claims, the application.
It is only merely for the purpose of description specific embodiment in term used in this application, and is not intended to be limiting the application.
" one kind " of singulative used in the application and appended claims, " described " and "the" are also intended to including majority
Form, unless context clearly shows that other implications.It is also understood that term "and/or" used herein refers to and wrapped
Containing the associated list items purpose of one or more, any or all may be combined.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only used for same type of information being distinguished from each other out.For example, do not departing from
In the case of the application scope, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on linguistic context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determining ".
With the fast development of internet and the rapid development of business, business datum amount is in explosive growth, each to calculate system
System, storage system, application system is also with the growth that quickly grows of business, the data resource of bulky complex, to traditional data
Analysis, treatment technology bring huge challenge.The data-handling capacity of traditional separate unit high-performance server can not meet
The demand of substantial amounts of network service and increasing data-intensive applications, the development based on Distributed Calculation, at present generally
Solved the above problems using Clustering.
Cluster is one group of computing device interconnected independently of each other, by express network, is entered by cluster resource scheduling system
Row management, the scheduling system allow to accommodate and manage multiple different systems (computation model) simultaneously, that is to say each calculating mould
Type is disposed and operated on unified resource management platform, it is possible to achieve the resource unified management of model and distribution, makes multiple meters
One cluster of model sharing is calculated, so as to make full use of cluster resource, reduces O＆M cost and hardware cost.Cluster resource scheduling system
System has carried out one layer of abstract, shielding to bottom hardware resource (such as internal memory, CPU, network bandwidth, hard disk, I/O or GPU etc.)
The isomerism of hardware, resource unified management and scheduling are provided for resource applicants such as the various applications in upper strata or services.
The scheduling of resource for the resource applicant that Resource Scheduler in cluster resource scheduling system is used in cluster please
Ask, resource is distributed for the resource applicant in the resource of cluster.Under normal circumstances, a cluster only exists a scheduling of resource
Device, however, in some cases, it is also possible to the situation that same cluster has multiple Scheduling Frameworks to coexist occur.For example,
Fuxi (Fuxi) system wishes compatible open source community Yarn interface, and a variety of calculating that Yarn is supported are run in a manner of compatible
Model, after Fuxi system compatibles Yarn interface, Fuxi systems and the cluster formed after Yarn system compatibles, then there are two
Resource Scheduler.In other examples, it is also possible to be problem left over by history or be that multiple resource allocation schedulers were integrated
Cross the stage or be that more team/business each develop situations such as compatibility etc. is carried out after the scheduler of oneself, cause to have in anxious group
The situation that multiple Scheduling Frameworks coexist.
There is the situation that multiple Scheduling Frameworks coexist for same cluster, a kind of common processing mode is to carry out cluster
Multiple subsets are horizontally or vertically cut into, each subset is given a Resource Scheduler (or Scheduling Framework) and is scheduled.
Horizontal cutting refers to：By every machine in cluster, a part of fixed resource is all marked off, a subset is formed, based on resource group
Into another subset.Vertical cutting refers to：By the part machine composition a subset in cluster, remaining machine forms another height
Collection.Under such a mode, either horizontal cutting or vertical cutting, each Resource Scheduler can be all caused to be responsible for entirely collecting
A part for group's resource, it is impossible to according to upper-layer service application resource number and ratio shared by flexibly allocating each subset of resources
Example.Therefore during resource use, partial scheduling device will have inadequate resource, and partial scheduling device can have resource wave
Situation about taking.
Another common mode is：Cluster is not subjected to resource cutting, but voluntarily dispatched by multiple Resource Schedulers,
But by the voluntarily decision-making of multiple schedulers, so it is possible that scheduling result conflict and situation about being dispatched again, therefore meeting
The problem of causing dispatching efficiency not high.
And scheme provided herein, for the cluster of multiple Resource Schedulers be present, set based on a scheduler
Resource Scheduler, primary resource scheduler are responsible for dispatching algorithm core logic, the resource scheduling request of other Resource Schedulers, all turned
Primary resource scheduler is issued, and fetches the scheduling result of primary resource scheduler, although equivalent to multiple Resource Schedulers being present,
The scheduler for performing scheduling strategy only has one, thus whole cluster resource need not be horizontally or vertically cut into more height
Collection, so as to avoid the irrational problem of the scheduling of resource in correlation technique, simultaneously because a Resource Scheduler is adjusted
Decision-making is spent, therefore is also not in the problem of scheduling result conflicts.The scheme of the embodiment of the present application need not be to the money in cluster
Source scheduler does excessive transformation, and cost of implementation is relatively low.Next the embodiment of the present application is described in detail.
As shown in Figure 1A, it is a kind of application of cluster resource dispatching method of the application according to an exemplary embodiment
Scene graph, Figure 1A include：
Resource Scheduler, using two Resource Schedulers as signal in Figure 1A, this embodiment scheme may be used also in practical application
To be adapted to the cluster of two or more scheduler.In Figure 1A, preassign one of Resource Scheduler and dispatched as primary resource
Device, other Resource Schedulers are as secondary Resource Scheduler.In the present embodiment, the system where primary resource scheduler is adjusted with secondary resource
System compatible where spending device forms a cluster.
The set of work queue, i.e. resource applicant.Each work queue corresponds to Resource Scheduler, with two in Figure 1A
As signal, a variety of situations such as two or more are can also be in practical application.Wherein, the resource bid of primary resource scheduler association
Side is referred to as primary resource applicant, and the resource applicant of secondary Resource Scheduler association is referred to as secondary resource applicant.It should be noted that
Primary resource scheduler and secondary Resource Scheduler have point of major-minor, but primary resource applicant and secondary resource applicant are in the cluster, all
It is as the applicant that resource bid is carried out to corresponding Resource Scheduler, without point of major-minor.For example side in the present embodiment
Just, the resource applicant associated by title to the resource applicant that primary resource scheduler associates with secondary Resource Scheduler carries out area
Point.
Resource applicant, that is, need to apply for a side of resource.For example, the business side for configuring cluster has all kinds
Task, for example externally provide various services, internal data maintenance, data query, data mining, data management or data
Analysis etc., these tasks may need a variety of different types of computing systems, to adapt to different calculating tasks, these
The operation of calculating task, it is required for running, it is necessary to the support of resource on hardware.
The set of resource in resource pool, i.e. cluster.In practical application, resource is various dimensions, and resource can be divided by its type
Can be specifically internal memory, CPU, network bandwidth, hard disk, I/O or GPU etc. for computing resource, storage resource and Internet resources etc.
Deng.
With reference to Figure 1B and Fig. 1 C, Figure 1B is the application scenario diagram of another cluster resource dispatching method, and Fig. 1 C are the application
A kind of flow chart of cluster resource dispatching method according to an exemplary embodiment, including：
101. the primary resource scheduler determines the resource in the cluster.
102-103. secondary Resource Schedulers receive the resource scheduling request that the secondary resource applicant is initiated, by institute
State the resource scheduling request that secondary resource applicant is initiated and be transmitted to the primary resource scheduler.
104. the primary resource scheduler receives the resource scheduling request that the secondary Resource Scheduler is sent, according to the collection
Resource in group determines that scheduling of resource result is sent to the secondary Resource Scheduler.
105. the scheduling of resource result is sent to the secondary resource applicant by the secondary Resource Scheduler.
In the present embodiment, executor of the primary resource scheduler as scheduling strategy, and secondary Resource Scheduler is then right as its
Intermediate between secondary resource applicant and the primary resource scheduler answered.When secondary Resource Scheduler receives the secondary resource applicant
During the resource scheduling request of initiation, resource scheduling request is transmitted to main money by secondary Resource Scheduler without scheduling of resource
Source scheduler, it that is to say and give the power to make decision of scheduling of resource to primary resource scheduler.
Wherein, primary resource scheduler, practical application are used as the one of of multiple Resource Schedulers in cluster-specific
In can flexibly handle, such as can be randomly assigned；Either determined according to the hardware environment where each Resource Scheduler,
Such as the higher Resource Scheduler of hardware condition can be selected as primary resource scheduler；Either according to primary resource scheduler
History scheduling of resource situation and determine, such as can be according to correlated performances such as the history scheduling of resource error rates of each Resource Scheduler
Index, select optimal conduct primary resource scheduler etc..
The essence of scheduling of resource, i.e., all kinds of resources distributed according to the resource requirement of resource applicant for it in cluster.It is main
Resource Scheduler, using rule, carries out resource allocation according to certain resource between different resource applicant.Different calculating
Task correspond to different resource bid persons, each calculating task correspond on clustered node one or more processes (or
Thread).The purpose of scheduling of resource is to distribute suitable resource for resource bid person, enables the calculating task base of resource bid person
Calculating process is completed in the resource distributed, and is caused on the premise of resource bid person's demand is met, task completion time is most
Measure it is small, and resource utilization try one's best height.Specifically, primary resource scheduler can be pre-configured with first in first out, equity dispatching, ability
The resource dispatching strategy such as scheduling or delay dispatching carries out scheduling of resource, and specific resource dispatching strategy and processing procedure may be referred to
Explanation in correlation technique, the present embodiment are not construed as limiting to this.
Secondary Resource Scheduler receives the resource scheduling request that secondary resource applicant is initiated, and secondary Resource Scheduler can be at this
Added in resource scheduling request secondary Resource Scheduler mark (such as the IP address of secondary Resource Scheduler, MAC Address, port or
Title etc.) after relay to primary resource scheduler, so that primary resource scheduler identifies that the resource scheduling request is adjusted by secondary resource
Spend device to initiate, and scheduling of resource result is fed back into secondary Resource Scheduler.Scheduling of resource result can include the money distributed
IP address, MAC Address, port, title or the resource size in source etc..
In an optional implementation, for primary resource scheduler, it is associated with least one primary resource applicant,
The primary resource scheduler receives the resource scheduling request that the primary resource applicant initiates, and the resource in the cluster is true
Determine scheduling of resource result and be sent to the primary resource applicant.In the present embodiment, for primary resource scheduler, what it was associated
The resource scheduling request of primary resource applicant, then primary resource scheduler is committed to, scheduling of resource is still carried out by primary resource scheduler,
Scheduling of resource result is directly transmitted back to primary resource applicant.
Scheduling of resource is not involved in because secondary Resource Scheduler is only used as intermediate, the resource in cluster all transfers to primary resource
Scheduler is scheduled.For secondary Resource Scheduler, primary resource scheduler is a scheduling of resource decision-making in cluster
Module, for primary resource scheduler, secondary Resource Scheduler is a resource applicant.Each secondary resource applicant is come
Say, secondary resource applicant can't perceive the presence of primary resource scheduler, but think that secondary Resource Scheduler is exactly that resource is adjusted
Spend policymaker；For each primary resource applicant, primary resource applicant will not also perceive the presence of secondary Resource Scheduler.
Therefore, for the cluster of two or more Resource Schedulers be present, the present embodiment will may not necessarily entirely collect
Group's resource level is vertically cut into multiple subsets, so as to avoid the irrational problem of the scheduling of resource in correlation technique,
Simultaneously because a Resource Scheduler is scheduled decision-making, therefore it is also not in the problem of scheduling result conflicts.The application
The scheme of embodiment need not do excessive transformation to the Resource Scheduler in cluster, and cost of implementation is relatively low, it is only necessary to by compared with
Small transformation can dexterously solve coexistence problems of multiple Scheduling Frameworks in same cluster.
In cluster resource scheduling process, in some examples, it can use always by specified Resource Scheduler conduct
Primary resource scheduler carries out scheduling of resource decision-making；In other examples, it can also be when meeting switching condition, described in switching
A Resource Scheduler in other Resource Schedulers is as the primary resource scheduler.Wherein, the switching condition can basis
Need and flexible configuration, such as can be following one or more conditions：
Error rate meets that default error thresholds, scheduling duration meet that preset duration threshold value, current time reach preset time
Or the number of the resource scheduling request of the primary resource applicant initiation and the resource scheduling request of the secondary resource applicant initiation
Amount difference is more than predetermined number threshold value.
By the above-mentioned means, it can be selected when needing based on some secondary Resource Scheduler and the switching in cluster
Resource Scheduler, and former primary resource scheduler then switches to secondary Resource Scheduler, so as to be asked in primary resource scheduler
In the case of topic, decision-making is scheduled by other Resource Schedulers.Specifically, adjusted because each Resource Scheduler is equipped with resource
Degree strategy, former primary resource scheduler switch to secondary Resource Scheduler, can be that former primary resource scheduler detects satisfaction switching bar
Part, former primary resource scheduler select a secondary Resource Scheduler to be sent to switching notice, and former primary resource scheduler stops resource and adjusted
Degree, the secondary Resource Scheduler starts scheduling of resource after receiving switching notice, so as to complete handoff procedure.
As shown in Fig. 2 be the flow chart of another cluster resource scheduling of the application according to an exemplary embodiment,
For the cluster including at least two Resource Schedulers, one of Resource Scheduler is preassigned as primary resource scheduler,
Other Resource Schedulers are secondary Resource Scheduler, and the secondary Resource Scheduler is associated with least one secondary resource applicant, described
Method is applied to secondary Resource Scheduler, including：
In step 201, the resource scheduling request that the secondary resource applicant is initiated is received；
In step 202, the resource scheduling request is transmitted to the primary resource scheduler；
In step 203, the scheduling of resource that the primary resource scheduler is sent according to the secondary Resource Scheduler is received to ask
Ask, the scheduling of resource result determined from the resource in the cluster；
In step 204, the scheduling of resource result is sent to the secondary resource applicant.
As shown in figure 3, be the application according to an exemplary embodiment a kind of cluster resource scheduling flow chart, institute
State method and be directed to the cluster for comprising at least two Resource Schedulers, preassign one of Resource Scheduler and adjusted as primary resource
Device is spent, other Resource Schedulers are secondary Resource Scheduler, and the secondary Resource Scheduler is associated with least one secondary resource applicant,
Methods described is applied to primary resource scheduler, including：
In step 301, the resource in the cluster is determined；
In step 302, the secondary Resource Scheduler forwarding is received, the resource initiated by the secondary resource applicant is adjusted
Degree request；
In step 303, the resource in the cluster determines that scheduling of resource result is sent to the secondary scheduling of resource
Device, so that the scheduling of resource result is sent into the secondary resource applicant by the secondary Resource Scheduler.
In an optional implementation, the primary resource scheduler is associated with least one primary resource applicant, institute
Stating method also includes：
The resource scheduling request that the primary resource applicant initiates is received, the resource in the cluster determines that resource is adjusted
Degree result is sent to the primary resource applicant.
It is corresponding with the embodiment of foregoing cluster resource dispatching method, present invention also provides cluster resource dispatching device and
The embodiment of its electronic equipment applied.
The embodiment of the application cluster resource dispatching device can be applied in computer equipment.Device embodiment can pass through
Software is realized, can also be realized by way of hardware or software and hardware combining.Exemplified by implemented in software, anticipated as a logic
Device in justice, it is by corresponding computer program in nonvolatile memory by the processor that cluster resource where it is dispatched
Instruction reads what operation in internal memory was formed.For hardware view, as shown in figure 4, being the application cluster resource dispatching device
A kind of hardware structure diagram of place computer equipment, except the processor 410 shown in Fig. 4, internal memory 430, network interface 420, with
And outside nonvolatile memory 440, reality of the computer equipment at the place of device 431 generally according to the server in embodiment
Function, other hardware can also be included, this is repeated no more.
As shown in figure 5, be a kind of block diagram of cluster resource dispatching device of the application according to an exemplary embodiment,
For the cluster including at least two Resource Schedulers, one of Resource Scheduler is preassigned as primary resource scheduler,
Other Resource Schedulers are secondary Resource Scheduler, and the secondary Resource Scheduler is associated with least one secondary resource applicant, described
Device is applied to secondary Resource Scheduler, including：
Request receiving module 51, is used for：Receive the resource scheduling request that the secondary resource applicant is initiated.
Forwarding module 52 is asked, is used for：The resource scheduling request is transmitted to the primary resource scheduler.
Scheduling result receiving module 53, is used for：The primary resource scheduler is received to be sent according to the secondary Resource Scheduler
Resource scheduling request, from the cluster resource determine scheduling of resource result.
Scheduling result forwarding module 54, is used for：The scheduling of resource result is sent to the secondary resource applicant.
As shown in fig. 6, it is the frame of another cluster resource dispatching device of the application according to an exemplary embodiment
Figure, for the cluster including at least two Resource Schedulers, preassign one of Resource Scheduler and dispatched as primary resource
Device, other Resource Schedulers are secondary Resource Scheduler, and the secondary Resource Scheduler is associated with least one secondary resource applicant, institute
State device and be applied to primary resource scheduler, including：
Resource determination module 61, is used for：Determine the resource in the cluster；
Request receiving module 62, is used for：The secondary Resource Scheduler forwarding is received, is initiated by the secondary resource applicant
Resource scheduling request；
Scheduling result determining module 63, is used for：Resource in the cluster determines that scheduling of resource result is sent to institute
Secondary Resource Scheduler is stated, so that the scheduling of resource result is sent into the secondary resource bid by the secondary Resource Scheduler
Side.
Accordingly, the embodiment of the present application also provides a kind of cluster resource dispatching device, including：Processor；At storage
Manage the memory of device executable instruction；Wherein, the processor is configured as：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
In resource determine scheduling of resource result；
The scheduling of resource result is sent to the secondary resource applicant.
Accordingly, the embodiment of the present application also provides a kind of cluster resource dispatching device, including：Processor；At storage
Manage the memory of device executable instruction；Wherein, the processor is configured as：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, with by described
The scheduling of resource result is sent to the secondary resource applicant by secondary Resource Scheduler.
The function of modules and the implementation process of effect specifically refer to above-mentioned interaction in above-mentioned cluster resource dispatching device
The implementation process of step is corresponded in processing method, will not be repeated here.
Accordingly, the application also provides a kind of computer-readable storage medium, and have program stored therein instruction in the storage medium, institute
Stating programmed instruction includes：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
In resource determine scheduling of resource result；
The scheduling of resource result is sent to the secondary resource applicant.
Accordingly, the application also provides a kind of computer-readable storage medium, and have program stored therein instruction in the storage medium, institute
Stating programmed instruction includes：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, with by described
The scheduling of resource result is sent to the secondary resource applicant by secondary Resource Scheduler.
The embodiment of the present application can use the storage medium for wherein including program code in one or more (including but unlimited
In magnetic disk storage, CD-ROM, optical memory etc.) on the form of computer program product implemented.Computer can use storage
Medium includes permanent and non-permanent, removable and non-removable media, can realize information by any method or technique
Storage.Information can be computer-readable instruction, data structure, the module of program or other data.The storage medium of computer
Example include but is not limited to：Phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory
(DRAM), other kinds of random access memory (RAM), read-only storage (ROM), Electrically Erasable Read Only Memory
(EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM), digital versatile disc
(DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus or any other non-biography
Defeated medium, the information that can be accessed by a computing device available for storage.
For device embodiment, because it corresponds essentially to embodiment of the method, so related part is real referring to method
Apply the part explanation of example.Device embodiment described above is only schematical, wherein described be used as separating component
The module of explanation can be or may not be physically separate, can be as the part that module is shown or can also
It is not physical module, you can with positioned at a place, or can also be distributed on multiple mixed-media network modules mixed-medias.Can be according to reality
Need to select some or all of module therein to realize the purpose of application scheme.Those of ordinary skill in the art are not paying
In the case of going out creative work, you can to understand and implement.
Those skilled in the art will readily occur to the application its after considering specification and putting into practice the invention applied here
Its embodiment.The application is intended to any modification, purposes or the adaptations of the application, these modifications, purposes or
Person's adaptations follow the general principle of the application and the common knowledge in the art do not applied including the application
Or conventional techniques.Description and embodiments are considered only as exemplary, and the true scope of the application and spirit are by following
Claim is pointed out.
It should be appreciated that the precision architecture that the application is not limited to be described above and is shown in the drawings, and
And various modifications and changes can be being carried out without departing from the scope.Scope of the present application is only limited by appended claim.
The preferred embodiment of the application is the foregoing is only, not limiting the application, all essences in the application
God any modification, equivalent substitution and improvements done etc., should be included within the scope of the application protection with principle.
Claims (13)
1. a kind of cluster resource dispatching method, for two or more Resource Schedulers in cluster, preassign wherein one
Individual Resource Scheduler is as primary resource scheduler, and other Resource Schedulers are as secondary Resource Scheduler, the secondary Resource Scheduler
At least one secondary resource applicant is associated with, methods described includes：
The primary resource scheduler determines the resource in the cluster；
The secondary Resource Scheduler receives the resource scheduling request that the secondary resource applicant is initiated, by the secondary resource applicant
The resource scheduling request of initiation is transmitted to the primary resource scheduler；
The primary resource scheduler receives the resource scheduling request that the secondary Resource Scheduler is sent, according to the money in the cluster
Source determines that scheduling of resource result is sent to the secondary Resource Scheduler；
The scheduling of resource result is sent to the secondary resource applicant by the secondary Resource Scheduler.
2. according to the method for claim 1, the primary resource scheduler is associated with least one primary resource applicant, described
Method also includes：
The primary resource scheduler receives the resource scheduling request that the primary resource applicant initiates, according to the money in the cluster
Source determines that scheduling of resource result is sent to the primary resource applicant.
3. according to the method for claim 2, methods described also includes：
When meeting switching condition, the Resource Scheduler switched in other described Resource Schedulers is adjusted as the primary resource
Spend device.
4. according to the method for claim 3, the switching condition includes following one or more conditions：
Error rate meets that default error thresholds, scheduling duration meet that preset duration threshold value, current time reach preset time or institute
The quantity for stating the resource scheduling request and the resource scheduling request of the secondary resource applicant initiation of primary resource applicant initiation is poor
More than predetermined number threshold value.
5. a kind of cluster resource dispatching method, methods described is directed to the cluster for comprising at least two Resource Schedulers, preassigns
For one of Resource Scheduler as primary resource scheduler, other Resource Schedulers are secondary Resource Scheduler, and the secondary resource is adjusted
Degree device is associated with least one secondary resource applicant, and methods described is applied to secondary Resource Scheduler, including：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
The scheduling of resource result that resource determines；
The scheduling of resource result is sent to the secondary resource applicant.
6. a kind of cluster resource dispatching method, methods described is directed to the cluster for comprising at least two Resource Schedulers, preassigns
For one of Resource Scheduler as primary resource scheduler, other Resource Schedulers are secondary Resource Scheduler, and the secondary resource is adjusted
Degree device is associated with least one secondary resource applicant, and methods described is applied to primary resource scheduler, including：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, to pass through the secondary money
The scheduling of resource result is sent to the secondary resource applicant by source scheduler.
7. according to the method for claim 6, the primary resource scheduler is associated with least one primary resource applicant, described
Method also includes：
The resource scheduling request that the primary resource applicant initiates is received, the resource in the cluster determines scheduling of resource knot
Fruit is sent to the primary resource applicant.
8. a kind of cluster resource dispatching device, for the cluster including at least two Resource Schedulers, preassign one of them
For Resource Scheduler as primary resource scheduler, other Resource Schedulers are secondary Resource Scheduler, the secondary Resource Scheduler association
There is at least one secondary resource applicant, described device is applied to secondary Resource Scheduler, including：
Request receiving module, it is used for：Receive the resource scheduling request that the secondary resource applicant is initiated；
Forwarding module is asked, is used for：The resource scheduling request is transmitted to the primary resource scheduler；
Scheduling result receiving module, is used for：Receive the resource that the primary resource scheduler is sent according to the secondary Resource Scheduler
Dispatch request, the scheduling of resource result determined from the resource in the cluster；
Scheduling result forwarding module, is used for：The scheduling of resource result is sent to the secondary resource applicant.
9. a kind of cluster resource dispatching device, for the cluster including at least two Resource Schedulers, preassign one of them
For Resource Scheduler as primary resource scheduler, other Resource Schedulers are secondary Resource Scheduler, the secondary Resource Scheduler association
There is at least one secondary resource applicant, described device is applied to primary resource scheduler, including：
Resource determination module, it is used for：Determine the resource in the cluster；
Request receiving module, it is used for：Receive the secondary Resource Scheduler forwarding, the resource initiated by the secondary resource applicant
Dispatch request；
Scheduling result determining module, is used for：Resource in the cluster determines that scheduling of resource result is sent to the secondary money
Source scheduler, so that the scheduling of resource result is sent into the secondary resource applicant by the secondary Resource Scheduler.
10. a kind of computer equipment, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
The scheduling of resource result that resource determines；
The scheduling of resource result is sent to the secondary resource applicant.
11. a kind of computer equipment, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, to pass through the secondary money
The scheduling of resource result is sent to the secondary resource applicant by source scheduler.
12. a kind of computer-readable storage medium, have program stored therein instruction in the storage medium, and described program instruction includes：
Receive the resource scheduling request that the secondary resource applicant is initiated；
The resource scheduling request is transmitted to the primary resource scheduler；
The resource scheduling request that the primary resource scheduler is sent according to the secondary Resource Scheduler is received, from the cluster
The scheduling of resource result that resource determines；
The scheduling of resource result is sent to the secondary resource applicant.
13. a kind of computer-readable storage medium, have program stored therein instruction in the storage medium, and described program instruction includes：
Determine the resource in the cluster；
Receive the secondary Resource Scheduler forwarding, the resource scheduling request initiated by the secondary resource applicant；
Resource in the cluster determines that scheduling of resource result is sent to the secondary Resource Scheduler, to pass through the secondary money
The scheduling of resource result is sent to the secondary resource applicant by source scheduler.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710375321.3A CN107402812A (en) | 2017-05-24 | 2017-05-24 | Cluster resource dispatching method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710375321.3A CN107402812A (en) | 2017-05-24 | 2017-05-24 | Cluster resource dispatching method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107402812A true CN107402812A (en) | 2017-11-28 |
Family
ID=60405198
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710375321.3A Pending CN107402812A (en) | 2017-05-24 | 2017-05-24 | Cluster resource dispatching method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107402812A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110908792A (en) * | 2018-09-17 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN110912967A (en) * | 2019-10-31 | 2020-03-24 | 北京浪潮数据技术有限公司 | Service node scheduling method, device, equipment and storage medium |
| CN114840125B (en) * | 2022-03-30 | 2024-04-26 | 曙光信息产业(北京)有限公司 | Device resource allocation and management method, device resource allocation and management device, device resource allocation and management medium, and program product |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040071144A1 (en) * | 2002-10-10 | 2004-04-15 | Ofer Beeri | Method and system for distributed single-stage scheduling |
| CN104461740A (en) * | 2014-12-12 | 2015-03-25 | 国家电网公司 | Cross-domain colony computing resource gathering and distributing method |
| CN105743995A (en) * | 2016-04-05 | 2016-07-06 | 北京轻元科技有限公司 | Transplantable high-available container cluster deploying and managing system and method |
| CN106126332A (en) * | 2016-06-27 | 2016-11-16 | 北京京东尚科信息技术有限公司 | Distributed timing task scheduling system and method |
-
2017
- 2017-05-24 CN CN201710375321.3A patent/CN107402812A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040071144A1 (en) * | 2002-10-10 | 2004-04-15 | Ofer Beeri | Method and system for distributed single-stage scheduling |
| CN104461740A (en) * | 2014-12-12 | 2015-03-25 | 国家电网公司 | Cross-domain colony computing resource gathering and distributing method |
| CN105743995A (en) * | 2016-04-05 | 2016-07-06 | 北京轻元科技有限公司 | Transplantable high-available container cluster deploying and managing system and method |
| CN106126332A (en) * | 2016-06-27 | 2016-11-16 | 北京京东尚科信息技术有限公司 | Distributed timing task scheduling system and method |
Non-Patent Citations (1)
| Title |
|---|
| 汪洋: ""通信网云计算平台资源调度策略与算法研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110908792A (en) * | 2018-09-17 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN110908792B (en) * | 2018-09-17 | 2023-04-14 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN110912967A (en) * | 2019-10-31 | 2020-03-24 | 北京浪潮数据技术有限公司 | Service node scheduling method, device, equipment and storage medium |
| CN114840125B (en) * | 2022-03-30 | 2024-04-26 | 曙光信息产业(北京)有限公司 | Device resource allocation and management method, device resource allocation and management device, device resource allocation and management medium, and program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11256554B2 (en) | Reducing overlay network overhead across container hosts | |
| Ge et al. | GA-based task scheduler for the cloud computing systems | |
| US20170329643A1 (en) | Distributed node intra-group task scheduling method and system | |
| CN108701059A (en) | Multi-tenant resource allocation methods and system | |
| CN109710400A (en) | The method and device of thread resources grouping | |
| JP2020507135A (en) | Exclusive agent pool distribution method, electronic device, and computer-readable storage medium | |
| CN111506404A (en) | Kubernetes-based shared GPU (graphics processing Unit) scheduling method | |
| CN110537169A (en) | Cluster resource management in distributed computing system | |
| CN108924214A (en) | A kind of load-balancing method of computing cluster, apparatus and system | |
| EP3191948A1 (en) | Computing instance launch time | |
| CN112416585A (en) | GPU resource management and intelligent scheduling method for deep learning | |
| CN110163473A (en) | A kind of monitoring method and equipment of Task Progress | |
| CN106506670A (en) | A kind of cloud platform virtual resource high speed dispatching method and system | |
| CN108241531A (en) | A kind of method and apparatus for distributing resource for virtual machine in the cluster | |
| CN106202092A (en) | The method and system that data process | |
| CN115543577B (en) | Covariate-based Kubernetes resource scheduling optimization method, storage medium and device | |
| CN107402812A (en) | Cluster resource dispatching method, device, equipment and storage medium | |
| US20170357537A1 (en) | Virtual machine dispatching method, apparatus, and system | |
| CN109471725A (en) | Resource allocation methods, device and server | |
| CN114968566A (en) | Container scheduling method and device under shared GPU cluster | |
| CN105491117A (en) | Flow chart data processing system and method for real time data analysis | |
| CN109189578A (en) | Storage server distribution method, device, management server and storage system | |
| CN111124619B (en) | Container scheduling method for secondary scheduling | |
| CN110262896A (en) | A kind of data processing accelerated method towards Spark system | |
| CN116302453B (en) | Task scheduling method and device for quantum electronic hybrid platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171128 |
|
| RJ01 | Rejection of invention patent application after publication |