CN101446906A - Dispatching method for multi-batch processing tasks and system thereof - Google Patents
Dispatching method for multi-batch processing tasks and system thereof Download PDFInfo
- Publication number
- CN101446906A CN101446906A CNA2008101929096A CN200810192909A CN101446906A CN 101446906 A CN101446906 A CN 101446906A CN A2008101929096 A CNA2008101929096 A CN A2008101929096A CN 200810192909 A CN200810192909 A CN 200810192909A CN 101446906 A CN101446906 A CN 101446906A
- Authority
- CN
- China
- Prior art keywords
- batch processing
- processing task
- scheduling
- running status
- dispatch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a dispatching system for multi-batch processing tasks, comprising database service equipment and at least one application service equipment, wherein, the application service equipment comprises a trigger unit used for triggering dispatching the multi-batch processing tasks and a batch processing dispatching unit used for dispatching the batch processing tasks with the operating state being ready-to-run or operation failure of the multi-batch processing tasks according to preset regulation rules when the trigger unit triggers the regulation to the multi-batch processing tasks The invention also discloses a dispatching method for multi-batch processing tasks. By adopting the invention, all application service equipment can flexibly dispatch every batch of processing tasks in the multi-batch processing tasks according to the dispatching rules, thereby shortening total operating time during operating the multi-batch processing tasks of the system and improving efficiency of operating the multi-batch processing tasks of the system.
Description
Technical field
The present invention relates to technical field of data processing, relate in particular to a kind of dispatching method and system of multi-batch processing task.
Background technology
The batch processing task is meant on computers need not manual intervention and carry out the operation of series of programs, and it need not man-machine interactively, and all input data in advance are arranged in program or the command line parameter.
Existing a kind of batch processing task scheduling system, it dispatches by the Windows task scheduling then by writing autoexec to the scheduling of a plurality of batch processing tasks on time, owing to allocating time is fixed, so can only trigger each batch processing task on time.But, since in the reality working time of total system fixing, also be unfixed so dispatch the time of a batch processing task, therefore, can not satisfy system well and not have the requirement that artificial intervention is handled automatically in fixing time point triggering batch processing task.
In addition, because pre-configured scheduling to a plurality of batch processing tasks, cause the batch processing task of each application service equipment calls to be fixed, and call fixed order between a plurality of batch processing tasks, and, when one in the system (or many) platform service equipment breaks down, the batch processing task that is configured on this service equipment can't be moved, and cause the efficient of system's operation multi-batch processing task low.
Summary of the invention
The object of the present invention is to provide a kind of dispatching method and system of multi-batch processing task, made that application service equipment can be according to the batch processing task in the scheduling rule flexible dispatching multi-batch processing task, the efficient of raising system operation multi-batch processing task.
According to an aspect of the present invention, provide a kind of dispatching method of multi-batch processing task, this method comprises:
Trigger the scheduling of described multi-batch processing task;
According to the scheduling rule that presets, dispatch the be as the criterion batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task.
According to a further aspect in the invention, provide a kind of dispatching system of multi-batch processing task, comprised database service equipment and at least one application service equipment, wherein, described application service equipment comprises:
Trigger element is used to trigger the scheduling of described multi-batch processing task;
The batch processing scheduling unit when being used for described trigger element and triggering scheduling to described multi-batch processing task, according to the scheduling rule that presets, is dispatched the be as the criterion batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task.
In the present invention, application service equipment is dispatched batch processing task in the multi-batch processing task by scheduling rule, make this group batch processing task can a plurality of application service equipment in system on co-ordination, the equilibrium operation of each application service equipment in the realization system, avoid the operating pressure of single application service equipment, thus the efficient of raising system operation multi-batch processing task.
Description of drawings
Fig. 1 is the dispatching method schematic flow sheet of the multi-batch processing task of the embodiment of the invention one.
Fig. 2 is the dispatching method schematic flow sheet of the multi-batch processing task of the embodiment of the invention two.
Fig. 3 is the process synoptic diagram of a batch processing task of scheduling of the embodiment of the invention.
Fig. 4 is the dispatching system structural representation of the multi-batch processing task of the embodiment of the invention three.
Fig. 5 is the structural representation of application service equipment of the dispatching system of the embodiment of the invention.
Fig. 6 is the structural representation of a batch processing scheduling unit of application service equipment shown in Figure 5.
Fig. 7 is the structural representation of another batch processing scheduling unit of application service equipment shown in Figure 5.
Embodiment
Below in conjunction with accompanying drawing the present invention is described further.
Fig. 1 is the dispatching method schematic flow sheet of the multi-batch processing task of the embodiment of the invention one.With reference to figure 1, this method comprises:
S101 triggers the scheduling of multi-batch processing task.
In the embodiment of the invention, triggering can comprise following to the mode of the scheduling of one group of batch processing task:
Running status according to a special batch processing task triggers; Logo file arrives and triggers; The manual triggering; Or regularly trigger.Herein, can be after other batch processing tasks or program are finished, generate a logo file.Certainly, also can adopt the triggering mode of other prior aries, trigger the scheduling of multi-batch processing task.
Step S102 according to the scheduling rule that presets, dispatches the be as the criterion batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task.
Alternatively, the scheduling rule in the embodiment of the invention comprises one of following or combination in any:
According to the definite batch processing task that will dispatch of the operation duration information of the batch processing task in the described multi-batch processing task;
According to the definite batch processing task that will dispatch of the running status of the batch processing task in the described multi-batch processing task;
According to the definite batch processing task that will dispatch of the operation IP address information of the batch processing task in the described multi-batch processing task;
According to the definite batch processing task that will dispatch of the precedence information of the batch processing task in the described multi-batch processing task.
In the present embodiment, alternatively, application service equipment also comprised and carries out the step whether quantity of judging the batch processing task of moving reaches predetermined value before execution in step S102.When being judged as when not reaching predetermined value, then according to the be as the criterion batch processing task of the capable or operation failure of received shipment of the scheduling rule management and running state that presets.When being judged as when reaching predetermined value, then no longer dispatch the batch processing task.Wherein, batch processing task refers to the batch processing task in above-mentioned one group of batch processing task.
Fig. 2 is the dispatching method schematic flow sheet of the multi-batch processing task of the embodiment of the invention two.
Present embodiment is that example is described with a kind of financial risks solution.This financial risks solution can be handled credit risk, asset-liabilities risk, transaction risk and market liquidity risk in phase, and asset-liabilities risk in the asset portfolio and credit risk are carried out transfer of funds price.
In the present embodiment, one group of batch processing task (being called RunID) is used for finishing some particular task in the financial risks solution, and it can be used for analyzing asset portfolio tables of data, product set ID, reach the corresponding various dates.The method of analyzing can be the net income simulation, sensitivity analysis etc.
With reference to figure 2, the method for present embodiment may further comprise the steps:
Step S201 obtains the running status of the interval batch processing task of accounting.
In the present embodiment, the running status of each batch processing task all can be divided into four kinds, is respectively: prepare operation, represent with 9; Move, represent with 1; Move successfully, represent with 2; The operation failure is represented with 3.The data message of one group of RunID can be configured into database service equipment during system initialization, when system's decision will move this group RunID, the running status of all RunID can be changed to 9.System triggers scheduling to this RunID according to the running status of the interval batch processing task of accounting.
The running status that gets access to the interval batch processing task of accounting is 9 o'clock, execution in step S202.The running status that gets access to the interval batch processing task of accounting is 2 o'clock, execution in step S207.When the running status that gets access to the interval batch processing task of accounting is other states (for example, the operation failure), execution in step S215.
Step S202, the running status that gets access to the interval batch processing task of accounting is 9 o'clock, and the running status of the interval batch processing task of accounting is changed to 1.
In the embodiment of the invention, after the running status of the interval batch processing task of accounting is changed to 1, comprise that also the time with current database is changed to the start time of the interval batch processing task of this accounting, the concluding time is changed to sky, and the IP address information is changed to should be with the IP address information of service equipment.
Step S203 empties the table as a result of database.
Step S204 is provided with the data of database date.
In the embodiment of the invention, step S203 and step S204 belong to the initialization data storehouse.
Step S205, rolling accounting interval.
In the present embodiment, rolling accounting interval comprises: calculate the fate X that rolls and call the interval order of rolling accounting.Wherein, Start Date+1 of fate X=Data Date-current account phase.For example, when adopting the risk management system of Kamakura company, call when the rolling accounting is interval orders, the 5th parameter is set to X, adopts krm_capp 3 username password CF X, and krm_capp is the order of operation one executable program.Herein, constant of the 1st parameter configuration, decision is that one of operation is an interval batch processing task of accounting or a RunID etc.; The 2nd parameter is user name; The 3rd parameter is password; The 4th parameter is the title of interval batch processing task of accounting or RunID; The 5th is the fate X that rolls, if operation RunID does not then have the 5th parameter.
Step S206 is changed to 2 with the running status of the interval batch processing task of accounting.
In the present embodiment, the running status of the interval batch processing task of accounting is changed to 2, and the interval batch processing task run of expression accounting finishes, and behind the preferred execution in step S215, returns the starting point of the interval batch processing task of application service equipment scheduling accounting.Alternatively, also can be execution in step S215 not, directly return the starting point of the interval batch processing task of application service equipment scheduling accounting.
Step S207 searches the container of groups of containers.
In the present embodiment,, be used for loading the order line of the RunID that will move in the groups of containers for application service equipment, thus can calling according to this batch processing task of order line deactivation.Wherein, each container in the groups of containers comprises two fields at least, and a field is used to load the running status of RunID, and another field is used to load the order line of calling this RunID.
Step S208 finds a container, according to the running status of the RunID in it, judges whether this RunID moves.Be judged as and be execution in step S209.Be judged as not execution in step S213.
In the present embodiment, the running status that gets access to the interval batch processing task of accounting is 2 o'clock, can be each container in the groups of containers of traversal applications service equipment.Judge whether the container find is moving RunID, can judge by the running status of this RunID of storing in the container.When running status is 1, represent that this RunID moves.
Step S209 obtains the running status of this RunID in this container.If running status is 2 o'clock, execution in step S210, execution in step S212 then.If running status is 3 o'clock, execution in step S211, execution in step S212 then.If rreturn value is 1 o'clock, execution in step S214.
Step S210, this RunID operation normal termination is written to database with running status 2 and concluding time.
Step S211, this RunID operation exception finishes, and running status 3 and concluding time are written to database.
Step S212 empties the field contents of this container.
, comprise the order line of calling RunID herein, and the running status of this RunID.
Step S213, the order line of a new RunID of scheduling is to this container, to move this RunID.
In the embodiment of the invention, alternatively, the total RunID number that can move simultaneously according to the performance and the database in the database service equipment of application service equipment is set the number that every application service equipment can start RunID simultaneously.Before execution in step S213, also can carry out and (for example judge the current predetermined value that whether reaches operation RunID number of this application service equipment, judge the running status of the RunID in each container in the groups of containers), just can not transfer new RunID again if reached application service equipment, direct execution in step S215, can guarantee the normal oepration at full load of this application service equipment like this, realize the equally loaded of a plurality of application service equipment.In the embodiment of the invention, predetermined value is preferably set to the maximum number that every application service equipment can move RunID simultaneously.
In the present embodiment, according to the scheduling rule scheduling RunID that presets.Wherein, scheduling rule comprises one of following or combination in any:
According to the definite RunID that will dispatch of the operation duration information of RunID;
According to the definite RunID that will dispatch of the running status of RunID;
According to the definite RunID that will dispatch of the IP address information that writes down among the RunID;
According to the definite RunID that will dispatch of the service priority information of RunID.
In the present embodiment, alternatively, RunID service priority information can be according to the operation duration of RunID and/how many its occupying system resources dispose.
In the present embodiment, can preferably call the RunID for preparing operation at first according to the running status of RunID, secondly be the RunID that operation was failed.Alternatively, also can be to call the RunID that operation was failed earlier, call the RunID for preparing operation then.
In the present embodiment, utilize the operation duration information of RunID to determine the RunID that will call among one group of RunID according to the static programming principle.Because the RunID of each operation meeting start-of-record time and concluding time, and the working time of each RunID, each variation was not too big, so can be with reference to the time of historical RunID operation.Alternatively, several range sections of operation duration value can be set, from database, obtain the operation duration information of RunID, judge to belong to which range section according to the operation duration of RunID then, thereby determine whether to dispatch this RunID.Alternatively, also can be that the operation duration according to each RunID comes to be each RunID configuration preference level information, determine whether to dispatch this RunID according to precedence information.Preferred working time, long RunID was the high RunID of priority, can make the time of whole RunID operation minimum like this.
The static programming principle that present embodiment is used is described below.
If be t1～tr r RunID working time, total n application service equipment.If be T1～Tn the working time of each application service equipment.Because server is parallel running, thus total consuming time be Tmax.Constraint condition is
Ask the target sequence of the minimum value Tmin of Tmax to be
Analysis draws
, promptly the working time on each application service equipment mean time comparatively, can reach the total run time minimum.During each application service device free, priority scheduling the longest RunID working time can make approximate realization working time of each application service equipment average, thereby total consuming time the shortest.For example, two application service equipment of A, B have 4 RunID:t1, t2, t3, t4, and the execution time was respectively 11,8,1,4 hours, then A at first dispatches t1, B dispatches t2, and after t2 was finished, B dispatched t4, after t1 is finished, A dispatches t3, and then last operation finishes 12 hours consuming time (two application service equipment are 12 hours) minimum consuming time.So transferred the operation state the longest working time that is as the criterion among the capable RunID of received shipment when application service equipment at every turn, can realize that total run time is the shortest.
In the embodiment of the invention, call the RunID of running status for the operation failure, whether its IP address of checking original this RunID of operation is the IP address that its application service equipment is called in preparation now, if not, then can call (promptly when a RunID after operation failure on the machine, then change a machine next time and carry out, get rid of the possibility that mechanical disorder causes RunID operation failure).This makes has the successful possibility of operation on an other application service equipment at the RunID of operation failure on the application service equipment.Even certain application service equipment breaks down, other application service equipment still can be finished all RunID operations.Behind application service equipment calls to the new RunID, this RunID that calls just brings into operation.
Step S214 has judged whether to travel through each container of groups of containers.If, execution in step S215.If not, return execution in step S207.Next search the next container that does not also travel through in the groups of containers.
Step S215 suspends and carries out a period of time.
In the embodiment of the invention, this step is alternatively, but the embodiment of the invention is preferably carried out this step.The process of application service equipment executes to after the interval batch processing task of accounting, suspends a period of time and carries out work again, and preferred time range is 1 minute.After groups of containers of application service equipment traversal, also suspend a period of time and carry out work again, preferred time range is 1 minute.Process in the embodiment of the invention " suspend carry out a period of time " be since the working time of each batch processing task all greater than 15 minutes, if so ceaselessly obtain the state of batch processing task, the state of batch processing task all is to move under most of situation.If suspend 1～5 minute at every turn, promptly reduced consume system resources, the efficient that the batch processing task status that obtains changes does not have minimizing yet.Certainly
As shown in Figure 2, in the embodiment of the invention, time-out is got back to execution in step S201 after carrying out a period of time, obtains the running status of the interval batch processing task of accounting.Alternatively, in the embodiment of the invention, if application service equipment gets access to the running status of the interval batch processing task of accounting for to move successfully, so behind application service equipment execution of step S214 and step S215, can also be to get back to execution in step S207, search the container in the groups of containers.
The course of work that new RunID of process transfer is moved is described further below.Fig. 3 is the process synoptic diagram of a batch processing task of scheduling of the embodiment of the invention.With reference to figure 3, it comprises:
Step S301 searches an order line that is used to call RunID, and the application service IP address of equipment of this RunID record is not to use service equipment IP address, and its running status is 9 or 3, is preferably 3.In the present embodiment, the application service IP address of equipment of record is meant that this RunID is called and moves once, just can note the IP address that the last time calls the application service equipment of this RunID.
Whether step S302 finds an order line that satisfies the batch processing task of above-mentioned condition.If find, execution in step S303.If do not find, execution in step S308 then.
Step S303 inserts specified containers in the groups of containers with this order line.
Step S304 according to this order line, starts calling of batch processing task.
Herein, application service equipment dynamically produces a process and carries out this operation.
Whether step S305 starts success.If execution in step S306.If not, execution in step S307.
Step S306, with the running status 1 of this batch processing task, start time (database current time), concluding time (putting sky) and should write database with the IP address information of service equipment.
In the present embodiment, all store the running status of this batch processing task in database and the container.
Step S307 empties the order in this specified containers.
Step S308 does not handle.
After step S306, step S307 and step S308 are performed, the operation of application service device end current process.
The embodiment of the invention also provides a kind of system of multi-batch processing task scheduling, and this system comprises database service equipment and at least one application service equipment.Fig. 4 is the dispatching system structural representation of the multi-batch processing task of the embodiment of the invention three.As shown in Figure 4, the dispatching system 1 of multi-batch processing task comprises database service equipment 10 and 3 application service equipment 22,24 and 26, wherein:
In the embodiment of the invention, the data message of all batch processing tasks can be configured into the database in the database service equipment 10 during system initialization.In the present embodiment, the running status of each batch processing task all can be divided into four kinds, is respectively: prepare operation, represent with 9; Move, represent with 1; Move successfully, represent with 2; The operation failure is represented with 3.When system's decision will move the batch processing task, system 1 can be changed to the running status of all batch processing services prepared operation 9.
Fig. 5 is the structural representation of application service equipment of the dispatching system of this aspect embodiment.Other application service equipment are identical with the structure of application service equipment 22.As shown in Figure 5, application service equipment 22 comprises:
Batch processing scheduling unit 222 when being used for described trigger element 220 and triggering scheduling to described multi-batch processing task, is dispatched the be as the criterion batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task according to the scheduling rule that presets.
Fig. 6 is the structural representation of a batch processing scheduling unit of application service equipment shown in Figure 5.As shown in Figure 6, batch processing scheduling unit 222 comprises: first judging unit 2220, acquiring unit 2221, the second judging units 2223 and scheduling execution units 2225.Below each Elementary Function module is described further.
First judging unit 2220, when being used for trigger element 220 and triggering scheduling to described multi-batch processing task, whether the quantity of judging the batch processing task of moving in the described application service equipment reaches predetermined value, and described batch processing task belongs to described multi-batch processing task.
Acquiring unit 2221 is used for first judging unit 2227 and is judged as when not reaching, and obtains the running status of the batch processing task in the described multi-batch processing task, is judged as when reaching preset value, then undo.Herein, batch processing scheduling unit 222 will not dispatched new RunID.Can guarantee the oepration at full load of application service equipment like this, thereby realize the equally loaded of a plurality of application service equipment.In the present embodiment, preset value is preferably the maximum number of the batch processing task that can move in the application service equipment.
In the embodiment of the invention, arbitrary application service equipment 22,24 or 26 is used for according to the be as the criterion batch processing task of the capable or operation failure of received shipment of the running status that dispatching principle is dispatched described many batches of place's tasks.Wherein, alternatively, described scheduling rule comprises one of following or combination in any:
According to the definite batch processing task that will dispatch of the precedence information of batch processing task;
According to the definite batch processing task that will dispatch of the operation duration information of batch processing task;
According to the definite batch processing task that will dispatch of the running status of batch processing task;
According to the definite batch processing task that will call of the IP address information that writes down in the batch processing task.
In the embodiment of the invention, can be the priority scheduling running status capable batch processing task of received shipment that is as the criterion, next calls the batch processing task of running status for the operation failure; The batch processing task of operation failure that also can be the priority scheduling running status be, next calls the running status capable batch processing task of received shipment that is as the criterion.
Alternatively, the acquiring unit 2221 of batch processing scheduling unit 222 also is used for obtaining running status, the operation duration information of the batch processing task of described multi-batch processing task.Then described second judging unit 2223 is used for judging whether to dispatch described batch processing task according to scheduling rule, the running status of obtaining and operation duration information.In the embodiment of the invention, can be the long batch processing task of priority scheduling operation duration.Further, can also be the priority scheduling running status batch processing task that received shipment is capable, the operation duration is long that is as the criterion.
Alternatively, the acquiring unit 2221 of batch processing scheduling unit 222 can also be running status, the precedence information that is used to obtain described batch processing task.Then described second judging unit 2223 is used for determining whether to dispatch described batch processing task according to scheduling rule and the running status and the precedence information that obtain.In the present embodiment, the precedence information that can how many each batch processing tasks be set according to the history run duration information and/or the occupying system resources of each batch processing task.The mode that precedence information is set certainly includes but not limited to aforesaid way.
Alternatively, the acquiring unit 2221 of batch processing scheduling unit 222 can also be running status, the operation IP address information that is used to obtain described batch processing task.Then described second judging unit 2223 is used for determining whether to dispatch described batch processing task according to scheduling rule, the running status of obtaining and operation IP address information.
Alternatively, the acquiring unit 2221 of batch processing scheduling unit 222 can also be running status, operation IP address information and the precedence information that is used to obtain described batch processing task.Then described second judging unit 2223 is used for determining whether to dispatch described batch processing task according to scheduling rule, the running status of obtaining, operation IP address information and precedence information.
Alternatively, the acquiring unit 2221 of batch processing scheduling unit 222 can also be running status, operation IP address information and the operation duration information that is used to obtain described batch processing task.Then described second judging unit 2223 is used for determining whether to dispatch described batch processing task according to scheduling rule, the running status of obtaining, operation IP address information and operation duration information.
In the embodiment of the invention, can be the running status of the batch processing task that gets access to when application service equipment 22 during for the operation failure, the operation IP address of priority scheduling record be should be with the batch processing task of service equipment IP address.
Need to prove that the information that acquiring unit 2221 obtains includes but not limited to above-mentioned embodiment, it is according to the needs of the scheduling rule that presets, the information difference of the batch processing task of obtaining.
Fig. 7 is the structural representation of another batch processing scheduling unit of application service equipment shown in Figure 5.As shown in Figure 7, batch processing scheduling unit 222 comprises:
Acquiring unit 2221 when being used for trigger element 220 and triggering scheduling to described multi-batch processing task, obtains the running status of the batch processing task in the described multi-batch processing task;
The function class of the function of each unit module of present embodiment and unit module shown in Figure 6 together.
The system of the embodiment of the invention according to the be as the criterion batch processing task of the capable or operation failure of received shipment of the running status in the scheduling rule scheduling multi-batch processing task that presets, sees the description of the method for the embodiment of the invention to how for details, does not repeat them here.
In the present embodiment, record the various information (comprising running status) of all RunID in the database, all dispose an identical batch processing scheduling unit on each application service equipment, any one batch processing scheduling unit can both be dispatched all RunID and move.When an application service equipment failure, other application service equipment still can be dispatched the off-duty RunID of residue, as long as there is an application service equipment not have fault just can execute all RunID.
The one side of the embodiment of the invention, the priority that can how much dispose the batch processing task according to the working time or the occupying system resources of batch processing task, batch processing task definition that can working time is identical or close with this is a same priority, the assurance time, identical or close batch processing task was carried out simultaneously, make the working time of entire system the shortest, improve the efficient of system.
The embodiment of the invention on the other hand, need not to use under the situation of third party software or Clustering, according to the performance of application service equipment the upper limit of the batch processing task of operation is set, can on many application services equipment, realizes equally loaded, reach making full use of system resource.
Alternatively, through the above description of the embodiments, those skilled in the art can be well understood to each embodiment and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware.Based on such understanding, the part that technique scheme contributes to prior art in essence in other words can embody with the form of software product, this computer software product can be stored in the computer-readable recording medium, as ROM/RAM, disk, CD etc., comprise that some instructions are with so that a computer equipment (can be a personal computer, server, perhaps network equipment etc.) carry out the described method of some part of each embodiment or embodiment.
Certainly, the above is a preferred implementation of the present invention, should be understood that; for those skilled in the art; under the prerequisite that does not break away from the principle of the invention, can also make some improvements and modifications, these improvements and modifications also are considered as protection scope of the present invention.
Claims (12)
1. the dispatching method of a multi-batch processing task is characterized in that, described method comprises:
Trigger the scheduling of described multi-batch processing task;
According to the scheduling rule that presets, dispatch the be as the criterion batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task.
2. dispatching method according to claim 1 is characterized in that, described scheduling rule comprises:
According to the definite batch processing task that will dispatch of the operation duration information of the batch processing task in the described multi-batch processing task.
3. dispatching method according to claim 1 is characterized in that, described scheduling rule comprises:
According to the definite batch processing task that will dispatch of the running status of the batch processing task in the described multi-batch processing task.
4. dispatching method according to claim 3 is characterized in that, described scheduling rule also comprises:
According to the definite batch processing task that will dispatch of the precedence information of the batch processing task in the described multi-batch processing task.
5. according to the described dispatching method of one of claim 2 to 4, it is characterized in that described scheduling rule also comprises: according to the definite batch processing task that will dispatch of the operation IP address information of the batch processing task in the described multi-batch processing task.
6. dispatching method according to claim 1, it is characterized in that, the scheduling rule that described basis presets is dispatched running status in the described multi-batch processing task and is as the criterion before the step of batch processing task of the capable or operation failure of received shipment, and described method further comprises:
Whether the quantity of judging the batch processing task of moving in the application service equipment reaches predetermined value, described batch processing task belongs to described multi-batch processing task, be not judged as and reach, then carry out scheduling rule that described basis presets and dispatch the be as the criterion step of batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task.
7. the dispatching system of a multi-batch processing task comprises database service equipment and at least one application service equipment, it is characterized in that described application service equipment comprises:
Trigger element is used to trigger the scheduling of described multi-batch processing task;
The batch processing scheduling unit when being used for described trigger element and triggering scheduling to described multi-batch processing task, is dispatched the be as the criterion batch processing task of the capable or operation failure of received shipment of running status in the described multi-batch processing task according to the scheduling rule that presets.
8. dispatching system according to claim 7 is characterized in that, described batch processing scheduling unit comprises:
First judging unit when being used for described trigger element and triggering scheduling to described multi-batch processing task, judges whether the quantity of the batch processing task of moving in the described application service equipment reaches predetermined value, and described batch processing task belongs to described multi-batch processing task;
Acquiring unit is used for described first judgment unit judges when not reaching, and obtains the running status of the batch processing task in the described multi-batch processing task;
Second judging unit is used for judging whether to dispatch described batch processing task according to described scheduling rule, the described running status obtained;
Scheduling execution units, be used for when described second judgment unit judges when being, dispatch described batch processing task, the capable or operation failure of received shipment that is as the criterion of the running status of described batch processing task.
9. dispatching system according to claim 7 is characterized in that, described batch processing scheduling unit comprises:
Acquiring unit when being used for described trigger element and triggering scheduling to described multi-batch processing task, obtains the running status of the batch processing task in the described multi-batch processing task;
Second judging unit is used for judging whether to dispatch described batch processing task according to described scheduling rule, the described running status obtained;
Scheduling execution units, be used for when described second judgment unit judges when being, dispatch described batch processing task, the capable or operation failure of received shipment that is as the criterion of the running status of described batch processing task.
10. dispatching system according to claim 9 is characterized in that:
Described acquiring unit also is used for obtaining the operation duration information of the batch processing task of described multi-batch processing task;
Described second judging unit also is used for judging whether to dispatch described batch processing task according to the described operation duration information that obtains.
11. dispatching system according to claim 9 is characterized in that:
Described acquiring unit also is used to obtain the precedence information of described batch processing task;
Described second judging unit also is used for determining whether to dispatch described batch processing task according to the described precedence information that obtains.
12., it is characterized in that according to the described dispatching system of one of claim 9 to 11:
Described acquiring unit also is used to obtain the operation IP address information of described batch processing task;
Described second judging unit also is used for determining whether to dispatch described batch processing task according to the described operation IP address information of obtaining.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101929096A CN101446906B (en) | 2008-12-31 | 2008-12-31 | Dispatching method for multi-batch processing tasks and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101929096A CN101446906B (en) | 2008-12-31 | 2008-12-31 | Dispatching method for multi-batch processing tasks and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101446906A true CN101446906A (en) | 2009-06-03 |
| CN101446906B CN101446906B (en) | 2011-05-04 |
Family
ID=40742596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008101929096A Active CN101446906B (en) | 2008-12-31 | 2008-12-31 | Dispatching method for multi-batch processing tasks and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101446906B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092794A (en) * | 2014-07-25 | 2014-10-08 | 中国工商银行股份有限公司 | Batch course processing method and system |
| CN104462302A (en) * | 2014-11-28 | 2015-03-25 | 北京京东尚科信息技术有限公司 | Distributed data processing coordination method and system |
| CN104702532A (en) * | 2015-02-11 | 2015-06-10 | 杭州华三通信技术有限公司 | Transaction processing method and transaction processing equipment |
| CN105404611A (en) * | 2015-11-09 | 2016-03-16 | 南京大学 | Matrix model based multi-calculation-engine automatic selection method |
| US10037242B2 (en) | 2016-06-22 | 2018-07-31 | Microsoft Technology Licensing, Llc | Failure detection in a processing system |
| CN110175073A (en) * | 2019-05-31 | 2019-08-27 | 杭州数梦工场科技有限公司 | Dispatching method, sending method, device and the relevant device of data exchange operation |
| CN110580019A (en) * | 2019-07-24 | 2019-12-17 | 浙江双一智造科技有限公司 | edge calculation-oriented equipment calling method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6243735B1 (en) * | 1997-09-01 | 2001-06-05 | Matsushita Electric Industrial Co., Ltd. | Microcontroller, data processing system and task switching control method |
| CN101202761B (en) * | 2007-12-04 | 2010-11-03 | 赵晓宇 | System of distributed resource scheduling and method thereof |
-
2008
- 2008-12-31 CN CN2008101929096A patent/CN101446906B/en active Active
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092794A (en) * | 2014-07-25 | 2014-10-08 | 中国工商银行股份有限公司 | Batch course processing method and system |
| CN104092794B (en) * | 2014-07-25 | 2017-08-11 | 中国工商银行股份有限公司 | Batch process handling method and system |
| CN104462302A (en) * | 2014-11-28 | 2015-03-25 | 北京京东尚科信息技术有限公司 | Distributed data processing coordination method and system |
| CN104462302B (en) * | 2014-11-28 | 2018-04-27 | 北京京东尚科信息技术有限公司 | A kind of distributed data processing coordination approach and system |
| CN104702532A (en) * | 2015-02-11 | 2015-06-10 | 杭州华三通信技术有限公司 | Transaction processing method and transaction processing equipment |
| CN104702532B (en) * | 2015-02-11 | 2019-03-15 | 新华三技术有限公司 | A kind of method for processing business and equipment |
| CN105404611A (en) * | 2015-11-09 | 2016-03-16 | 南京大学 | Matrix model based multi-calculation-engine automatic selection method |
| CN105404611B (en) * | 2015-11-09 | 2018-07-20 | 南京大学 | A kind of automatic selecting method of more computing engines based on matrix model |
| US10037242B2 (en) | 2016-06-22 | 2018-07-31 | Microsoft Technology Licensing, Llc | Failure detection in a processing system |
| CN110175073A (en) * | 2019-05-31 | 2019-08-27 | 杭州数梦工场科技有限公司 | Dispatching method, sending method, device and the relevant device of data exchange operation |
| CN110175073B (en) * | 2019-05-31 | 2022-05-31 | 杭州数梦工场科技有限公司 | Scheduling method, sending method, device and related equipment of data exchange job |
| CN110580019A (en) * | 2019-07-24 | 2019-12-17 | 浙江双一智造科技有限公司 | edge calculation-oriented equipment calling method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101446906B (en) | 2011-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101446906B (en) | Dispatching method for multi-batch processing tasks and system thereof | |
| US10642866B1 (en) | Automated load-balancing of partitions in arbitrarily imbalanced distributed mapreduce computations | |
| US7676807B2 (en) | Method and system for cascaded processing a plurality of data objects | |
| CN105159768A (en) | Task management method and cloud data center management platform | |
| US20080271032A1 (en) | Data Processing Network | |
| CN112068936B (en) | Workflow management platform and workflow management system | |
| CN104699363B (en) | A kind of window interface shows method and system | |
| US20100250734A1 (en) | Server reassignment support system and server reassignment support method | |
| CN103336714A (en) | Operation scheduling method and device | |
| EP1654647B1 (en) | A method of assigning objects to processing units | |
| US11315133B2 (en) | System and method for minimizing latency in data consumption system | |
| WO2021204013A1 (en) | Intelligent dispatching method, apparatus and device, and storage medium | |
| CN112114973A (en) | Data processing method and device | |
| CN114625533A (en) | Distributed task scheduling method and device, electronic equipment and storage medium | |
| WO2017074320A1 (en) | Service scaling for batch processing | |
| CN117035636A (en) | Workflow sub-process dynamic generation method, device, equipment and storage medium | |
| CN115658248A (en) | Task scheduling method and device, electronic equipment and storage medium | |
| CN116263717A (en) | Order service processing method and device based on event | |
| CN113436018A (en) | Asset hosting business processing method and device, storage medium and electronic equipment | |
| CN111538491A (en) | Data event processing method, device, equipment and storage medium | |
| WO2021096346A1 (en) | A computer-implemented system for management of container logs and its method thereof | |
| CN111353766A (en) | Service process processing system and method of distributed service system | |
| CN110597608A (en) | Task processing method and device, distributed system and storage medium | |
| JP2020135426A (en) | Information processing system, information processing method, and information processing program | |
| CN110188069A (en) | A kind of csv file storage method, device and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |