CN100473065C - A network-oriented machine group working management system and realizing method thereof - Google Patents
A network-oriented machine group working management system and realizing method thereof Download PDFInfo
- Publication number
- CN100473065C CN100473065C CNB2004100294783A CN200410029478A CN100473065C CN 100473065 C CN100473065 C CN 100473065C CN B2004100294783 A CNB2004100294783 A CN B2004100294783A CN 200410029478 A CN200410029478 A CN 200410029478A CN 100473065 C CN100473065 C CN 100473065C
- Authority
- CN
- China
- Prior art keywords
- resource
- job
- moderator
- grid
- client server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
This invention provides a grid faced cluster operation management system and method for realizing same, which contains the arbitrator maintaining the joint operation needed information and total resource information taken from every grid node server, the neachievediator responses large joint operation without user involving. Said invention fully utilizes various kinds of resources in grid, greatly raises resource availability and completes the operation can not be realized in single computer.
Description
Technical field
The present invention relates to grid and Network of Workstation technical field, be meant a kind of cluster job management system and its implementation especially towards grid.
Background technology
In a large enterprise, all there is relatively independent Network of Workstation in each department, the operation of existing single independent Network of Workstation and resource management system generally are made up of four parts, be respectively user command, comprise graphic user interface (GUI) or command line mode, client server (Server), job scheduler (Sched) and operation actuator (Execd).
Figure 1 shows that the operation and the resource management system of existing single Network of Workstation.Submit to node 101 to receive user command, this user command can be divided into three grades of domestic consumer, operator and keepers, all can move by order line or graphic user interface mode, be the interface that user and system manager carry out operation submission, monitoring operation and system management configuration.Client server 102 in the service node is in charge of operation in the group of planes and resource information, the reception various requests from client, is safeguarding the table of node, formation, operation and user right information in the group of planes.Job scheduler 103 in the scheduling node obtains load condition by collect operation and the resource information on all nodes the group of planes from Server from Execd, and according to scheduling strategy, decision moves on which XM.Three functions of operation actuator 104 main realizations in the XM: the one, according to the instruction of Server, running job is set up resource limit, the resource that monitoring results takies, notice client server job run end etc.; The 2nd, resource management function, the monitoring resource request of response Sched is as the running status of operation and free memory etc.; The 3rd, communicate by letter with Execd on other nodes of running job, guarantee the normal load and the end of concurrent job.
Though existing cluster job management system can be realized the resource in this group of planes is managed and dispatches, but development along with society, people find the solution the continuous expansion of problem domain, the problem that is run into becomes increasingly complex, in finding the solution the process of these new problems, local computational resource can't satisfy people's demand.And existing cluster job management system can't be realized job management and resource-sharing between a plurality of group of planes, promptly can't realize management and job scheduling to gridding resource, the management that fulfils assignment of multiple resource in can not joint trellis can not adapt to present grid system.
Having part relevant with submission with job management in the grid now, mainly is information service center (InfoService) and Resource Manager (Resource Manager).Information service center in the grid is mainly finished work such as the discovery of information in the grid computing environment, registration, inquiry, modifications, provides one of grid computing environment true, real-time dynamic reflection.If the various resources in the information spinner grid computing environment of its processing, as data resource and computational resource etc., the description of service and other main body (entity).Each resource in the grid is all managed by corresponding unique grid resource person, and Resource Manager is mainly realized use and the condition monitoring to institute's management resource.
At first need the resource request to information service center submit job needs before the grid user submit job, resource information tabulation of information server central service after receiving that the user asks, is searched the resource information tabulation, returns all available the Resources lists.According to these available the Resources lists, to select employed resource by the user, and selected Resource Manager execution is submitted in operation and a detailed resource requirement table, Resource Manager moves this user job on the resource of being managed.Resource Manager is monitored the resource behaviour in service of grid at any time, and constantly up-to-date resource operating position is notified to information service center, and upgrade in time resource information tabulation of information service center responds the resource request that the operation in the grid proposes at any time.
There are following defective in job management system in the above-mentioned grid and commit method: the using and dispatching user and opaque of resource, the user is consultation information service centre in advance, to obtain all resource informations that satisfy job requirements and to make their own selection, determine promptly which Resource Manager operation is submitted to.And the information resources that information service center is safeguarded tabulation always has the regular hour to lag behind and error with present resource behaviour in service.When this error is big, may cause job run unsuccessful.In addition, under this mode, the user need wait for the resource query result, and needs to participate in resource allocation process, has reduced user's operating efficiency.
How to make existing cluster job management system can support grid system, and in the job management procedure of supporting grid, do not need the user to participate in any scheduling of resource and management work, become one of present research contents.
Summary of the invention
In view of this, the object of the present invention is to provide a kind of cluster job management system and its implementation, make the user not need to participate in any scheduling of resource and management work, only need on grid, get final product by submit job towards grid.
For achieving the above object, technical scheme of the present invention is achieved in that
A kind of cluster job management system towards grid, at least comprise the more than one grid node that constitutes by cluster job management system independently, comprise client server Serverd and operation actuator in this grid node, should comprise also that moderator Arbitor, scheduler Negotiator and storage needed the memory of combined dispatching job queue towards the cluster job management system of grid, wherein
Described moderator, when local resource can not satisfy the job request resource requirement, reception is from the job request information of client server, and the node of the job request resource requirement that receives is satisfied in inquiry, and this job request information is sent to the interior client server of this grid node; When single gridding resource can not be finished this job request information, can not put into the memory that needs the combined dispatching job queue by the job request information that single gridding resource is finished; When scheduler is finished scheduling, and after scheduling result returned to moderator, this scheduling result returned to carry out this requesting users server; When between grid node during laod unbalance, the long client server of control operation formation by routing queue will be in queueing condition job transfer give the client server that is in the idle condition grid node;
Described scheduler obtains from moderator and treats job information, and the job scheduler in the grid node obtains the behaviour in service information of current resource, carries out the global resource scheduling according to predefined algorithm, and scheduling result is returned to moderator.
A kind of application process of system as mentioned above is characterized in that, this method may further comprise the steps:
After a, moderator receive user's job request information, judge whether global resource can satisfy the required resource of this operation that receives, if, execution in step b then, otherwise to the error message and the process ends of user's retrieval system inadequate resource;
B, judge that the resource that whether has in the current global resource in certain grid node can satisfy the required resource of the described operation of step a, if, then the described job request of step a is sent to the client server that can satisfy this operation resource requirement, and process ends; Otherwise the described job request of step a is put into the formation that needs the combined dispatching operation wait for scheduling, and process ends.Preferably, the described judgement of step b is to finish from the aggregate resource information that the client server in each grid node obtains according to moderator.
Preferably, this method further comprises: moderator is the scheduling result of self scheduling device in the future, be transmitted to the client server that can satisfy the operation resource requirement, after this client server receives job request information from Arbitor, the current behaviour in service information of change local resource, and notify this node that can satisfy the operation resource requirement to start and operation.
Preferably, the method that described scheduler carries out scheduling of resource is: scheduler from moderator obtain treat job information after, job scheduler Schedd in all grid nodes on the scheduling node sends the lock resource order, and, carry out scheduling of resource according to predefined algorithm from the user mode information that each Schedd obtains current resource; After scheduling is finished, discharge resource lock, notify each Schedd to change the behaviour in service information of current resource simultaneously, return scheduling result to moderator then according to scheduling result.
Preferably, if the user job solicited message that moderator receives comes from the grid node, then this method further comprises:
Before step a carries out, after the client server in the grid node receives user's job request information, judge at first whether local resource can satisfy the required resource of this operation, if, then the operation that this job request information is put into local maintenance is lined up, otherwise, execution in step a again; Step b is described the described job request of step a is sent to the client server that can satisfy this operation resource requirement after, the client server of this job request information of initiation is informed in the address that moderator will be carried out the server of this operation.
Preferably, this method further comprises: the long Serverd of moderator control operation formation by routing queue will be in queueing condition job transfer give the client server that is in the idle condition grid node.
Use the cluster job management system towards grid provided by the present invention, safeguard the job information need combined dispatching and the aggregate resource information that obtains from the Serverd of each grid node by moderator (Arbitor), be responsible for the combined dispatching of large-scale operation by scheduler (Negotiator), thereby not needing to have realized the user to participate in any scheduling of resource and management work, only need be on grid the purpose of submit job.Use the present invention, for the user, its occupation mode is in full accord with the mode of use job management system in a group of planes, local area network (LAN).The present invention has made full use of the various resources in the grid, has improved the utilance of resource greatly, and can also finish the operation that single computational resource can't be realized.
Description of drawings
Figure 1 shows that the operation and the resource management system of existing single Network of Workstation;
Figure 2 shows that the general structure frame schematic diagram of using the cluster job management system towards grid of the present invention;
Figure 3 shows that use of the present invention in certain grid node submit job give the process chart of moderator;
Figure 4 shows that and use the process chart that the interior direct submit job of client of non-grid node of the present invention is given moderator.
Embodiment
For making technical scheme of the present invention clearer, again the present invention is done detailed description further below in conjunction with accompanying drawing.
Thinking of the present invention is: safeguard the job information need combined dispatching and the aggregate resource information that obtains from the Serverd of each grid node by moderator (Arbitor), be responsible for the combined dispatching of large-scale operation by scheduler (Negotiator), thereby make the user not need to participate in any scheduling of resource and management work, only need get final product by submit job on grid, its occupation mode is in full accord with the mode of use job management system in a group of planes, local area network (LAN).Use the present invention, not only can make full use of the various computational resources in the grid, improve the utilance of resource greatly, and can also finish the operation that single computational resource can't be realized.
Figure 2 shows that the general structure frame schematic diagram of using the cluster job management system towards grid of the present invention.Arbitor 202 is used to safeguard the job information that needs combined dispatching and the aggregate resource information of obtaining from the Serverd of each grid node.After the job request information of moderator reception from client server, can satisfy the grid node of this operation resource requirement according to this job request information inquiry, and send this job request information in the grid node place grid that can satisfy this operation resource requirement Serverd.If the resource of all single grid nodes all can not satisfy the required resource of this job request in the system, then Arbitor puts into the memory 201 that storage needs the combined dispatching job queue with this job request, and promptly all need the operation of combined dispatching all to be placed into needing in the combined dispatching job queue of Arbitor maintenance.In addition, if the job queue in certain grid node is long, and some grid node is in idle condition, then the long Serverd of Arbitor control operation formation by routing queue will be in queueing condition job transfer give the Serverd of idle grid node, thereby between grid node, realize load balance.
If the Serverd in certain grid node is when receiving job request information from the local user, after then all node resources in it judges local grid 204 all can not satisfy the required resource of operation, just this job request information is sent to moderator.
Certainly, above-mentionedly in the cluster operation system of grid, also can comprise one or more client, when client has job request, directly job request information be sent to moderator.
Figure 3 shows that use of the present invention in certain grid node submit job give the process chart of moderator.
Serverd in the step 302, this grid node judges whether local resource can satisfy this job request, if then execution in step 303, otherwise execution in step 304;
Figure 4 shows that and use the process chart that the interior direct submit job of client of non-grid node of the present invention is given moderator.
The method of above-mentioned scheduling of resource is: Negotiator from Arbitor obtain treat job information after, send the lock resource order to the Schedd of all gridding scheduling intranodals, and, carry out scheduling of resource according to predefined algorithm from the user mode that each Schedd obtains current resource; After scheduling is finished, discharge resource lock, notify each Schedd to change the behaviour in service information of current resource simultaneously, return scheduling result to Arbitor then according to scheduling result.
After Arbitor receives scheduling result information from Negotiator, this scheduling result is passed to the client server that can satisfy in the grid of operation resource requirement node place, after this client server receives job request information from Arbitor, the current behaviour in service information of change local resource, and notify this node that can satisfy the operation resource requirement to start and operation.
In addition, if the job queue in certain grid node is long, and some grid node is in idle condition, then the long Serverd of Arbitor control operation formation by routing queue will be in queueing condition job transfer give the Serverd of idle grid node, thereby between grid node, realize load balance.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (7)
1, a kind of cluster job management system towards grid, at least comprise the more than one grid node that constitutes by cluster job management system independently, comprise client server Serverd and operation actuator in this grid node, it is characterized in that, should comprise also that moderator Arbitor, scheduler Negotiator and storage needed the memory of combined dispatching job queue towards the cluster job management system of grid, wherein
Described moderator, when local resource can not satisfy the job request resource requirement, reception is from the job request information of client server, and the node of the job request resource requirement that receives is satisfied in inquiry, and this job request information is sent to the interior client server of this grid node; When single gridding resource can not be finished this job request information, can not put into the memory that needs the combined dispatching job queue by the job request information that single gridding resource is finished; When scheduler is finished scheduling, and after scheduling result returned to moderator, this scheduling result is returned to the client server of carrying out this job request; When between grid node during laod unbalance, the long client server of control operation formation by routing queue will be in queueing condition job transfer give the client server that is in the idle condition grid node;
Described scheduler obtains from moderator and treats job information, and the job scheduler in the grid node obtains the behaviour in service information of current resource, carries out the global resource scheduling according to predefined algorithm, and scheduling result is returned to moderator.
2, a kind of application process of system according to claim 1 is characterized in that, this method may further comprise the steps:
After a, moderator receive user's job request information, judge whether global resource can satisfy the required resource of this operation, if, execution in step b then, otherwise to the error message and the process ends of user's retrieval system inadequate resource;
B, judge that the resource that whether has in the current global resource in certain grid node can satisfy the required resource of the described operation of step a, if, then the described job request of step a is sent to the client server that can satisfy this operation resource requirement, and process ends; Otherwise the described job request of step a is put into the formation that needs the combined dispatching operation wait for scheduling, and process ends.
3, method according to claim 2 is characterized in that, the described judgement of step b is to finish from the aggregate resource information that the client server in each grid node obtains according to moderator.
4, method according to claim 2, it is characterized in that, this method further comprises: moderator is the scheduling result of self scheduling device in the future, be transmitted to the client server that can satisfy the operation resource requirement, after this client server receives job request information from Arbitor, the current behaviour in service information of change local resource, and notify this node that can satisfy the operation resource requirement to start and operation.
5, method according to claim 4, it is characterized in that, the method of described scheduling is: scheduler from moderator obtain treat job information after, job scheduler Schedd in all grid nodes on the scheduling node sends the lock resource order, and, carry out scheduling of resource according to predefined algorithm from the user mode information that each Schedd obtains current resource; After scheduling is finished, discharge resource lock, notify each Schedd to change the behaviour in service information of current resource simultaneously, return scheduling result to moderator then according to scheduling result.
6, method according to claim 2 is characterized in that, if the user job solicited message that moderator receives comes from the grid node, then this method further comprises:
Before step a carries out, after the client server in the grid node receives user's job request information, judge at first whether local resource can satisfy the required resource of this operation, if, then the operation that this job request information is put into local maintenance is lined up, otherwise, execution in step a again;
Step b is described the described job request of step a is sent to the client server that can satisfy this operation resource requirement after, the client server of this job request information of initiation is informed in the address that moderator will be carried out the client server of this operation.
7, according to claim 2 or 6 described methods, it is characterized in that this method further comprises: the long Serverd of moderator control operation formation by routing queue will be in queueing condition job transfer give the client server that is in the idle condition grid node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100294783A CN100473065C (en) | 2004-03-19 | 2004-03-19 | A network-oriented machine group working management system and realizing method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100294783A CN100473065C (en) | 2004-03-19 | 2004-03-19 | A network-oriented machine group working management system and realizing method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1671135A CN1671135A (en) | 2005-09-21 |
| CN100473065C true CN100473065C (en) | 2009-03-25 |
Family
ID=35042196
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100294783A Expired - Fee Related CN100473065C (en) | 2004-03-19 | 2004-03-19 | A network-oriented machine group working management system and realizing method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100473065C (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100373343C (en) * | 2005-12-26 | 2008-03-05 | 北京航空航天大学 | Service grid scheduling device and scheduling method |
| CN100440802C (en) * | 2005-12-26 | 2008-12-03 | 北京航空航天大学 | Service gridding system and method for processing operation |
| CN101005396B (en) * | 2006-01-16 | 2010-07-28 | 中国科学院计算技术研究所 | Method for support network resource dynamic integration and cooperation under network environment |
| CN100488113C (en) * | 2006-01-16 | 2009-05-13 | 中国科学院计算技术研究所 | Event driven dynamic service combining method under network environment |
| CN103380608B (en) * | 2011-03-09 | 2015-12-02 | 中国科学院计算机网络信息中心 | Converge the method for queuing message and job information in a computing environment |
| CN103019837A (en) * | 2011-09-27 | 2013-04-03 | 中国移动通信集团公司 | Resource scheduling method, device and terminal equipment |
| CN102930475B (en) * | 2012-09-18 | 2016-07-06 | 曙光信息产业(北京)有限公司 | A kind of petroleum application method for packing mutual based on PBS |
| CN102970161A (en) * | 2012-11-12 | 2013-03-13 | 珠海金山网络游戏科技有限公司 | Cloud machine deployment platform and deployment method |
-
2004
- 2004-03-19 CN CNB2004100294783A patent/CN100473065C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1671135A (en) | 2005-09-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6996614B2 (en) | Resource allocation in data processing systems | |
| CN101533417B (en) | A method and system for realizing ETL scheduling | |
| CN102655532B (en) | Distributed heterogeneous virtual resource integration management method and system | |
| US7447693B2 (en) | Dynamic cluster database architecture | |
| CN102387173B (en) | MapReduce system and method and device for scheduling tasks thereof | |
| US20040243709A1 (en) | System and method for cluster-sensitive sticky load balancing | |
| CN104040486A (en) | Decoupling PAAS resources, jobs, and scheduling | |
| CN104040485A (en) | PAAS hierarchial scheduling and auto-scaling | |
| CN110046039A (en) | Method for scheduling task and system, control centre's server and storage medium | |
| CN101098348B (en) | Methods and systems for dynamically acquiring MAC addresses | |
| EP3114589B1 (en) | System and method for massively parallel processing database | |
| CN110597639B (en) | CPU distribution control method, device, server and storage medium | |
| CN101427220A (en) | Componentized automatic provisioning and management of computing environments for computing utilities | |
| CN108616424B (en) | Resource scheduling method, computer equipment and system | |
| CN100473065C (en) | A network-oriented machine group working management system and realizing method thereof | |
| CN106210052A (en) | A kind of wide area electrical power services management method | |
| JPWO2005116832A1 (en) | Computer system, method and program for controlling job execution in a distributed processing environment | |
| JP2007286703A (en) | Master and slave license management method, master and slave license management method and master and slave license management program | |
| JP4568289B2 (en) | Apparatus for arbitration in computing utility systems | |
| CN100440802C (en) | Service gridding system and method for processing operation | |
| JP2001229058A (en) | Data base server processing method | |
| CN111913784A (en) | Task scheduling method and device, network element and storage medium | |
| JPH10198643A (en) | Distributed computer system | |
| JP4211645B2 (en) | A computer system with a dedicated processor | |
| CN112291320A (en) | Distributed two-layer scheduling method and system for quantum computer cluster |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090325 Termination date: 20210319 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |