CN106293971A - A kind of method and apparatus of distributed task dispatching - Google Patents
A kind of method and apparatus of distributed task dispatching Download PDFInfo
- Publication number
- CN106293971A CN106293971A CN201610665798.0A CN201610665798A CN106293971A CN 106293971 A CN106293971 A CN 106293971A CN 201610665798 A CN201610665798 A CN 201610665798A CN 106293971 A CN106293971 A CN 106293971A
- Authority
- CN
- China
- Prior art keywords
- task
- information
- node
- instances
- execution result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides the method and apparatus that a kind of distributed task scheduling calls, the method includes: the task static defining information of each task node is carried out persistent storage；Monitor task trigger condition by task dispatcher, read corresponding task static defining information；Task instances is generated according to the task static defining information read；The first task of the previous task node according to current task node performs state and performs task remote scheduling, and receives the task execution result information of return；Perform downstream node task according to dependence between the second execution status of task in this task execution result information and task, and update above-mentioned task instances according to this task execution result information.The distributed task dispatching method that the embodiment of the present invention provides can realize each operation system is carried out United Dispatching management, each operation system only need to focus on the realization of the Business Processing of task own, thus reduce complexity that task management safeguards and task flow perform during the risk made mistakes.
Description
Technical field
The present invention relates to computer information technology field, in particular to a kind of distributed task dispatching method and
Device.
Background technology
At present, in large-scale systematic group, comprise the operation system of each difference in functionality, and these operation systems may
All there is the task that needs timing performs, such as one electric quotient system system, it is probably and is made up of multiple operation systems, such as order
Operation system, account operation system, payment transaction system；On physical structure, whole electricity quotient system system is dispersed in by these exactly
Different physics dispose the systematic group that upper operation system is constituted.Along with task multiformity increase, systematic group institute faced by times
Business treating capacity and complexity are gradually increased, and therefore, how to improve task process performance and become a weight into Clustering research
Wanting one of target, the task scheduling system being now capable of task flexible configuration is most important.
Currently, a kind of method providing distributed task dispatching in correlation technique, the method specifically includes that passes through task
Module is set the relevant configuration information of each task node is sent to task scheduling system；This task scheduling system receives configuration letter
Store after breath；The task that needs perform is extracted when task trigger condition meets；Tasks carrying is complete, more new task information
Trigger to storage wait next time.In the method, task scheduling system includes multiple task dispatcher, for operation system
In multiple different tasks be scheduling.
During realizing the present invention, inventor finds at least to there is problems in that in correlation technique in correlation technique
The task scheduling mode being embedded in each system be generally directed at processing in oneself system scope of task, but, be present in
Task between each operation system of systematic group all there may be dependency, therefore, each business in service layer and system level
System safeguards that the task scheduling of oneself will increase the complexity that task management is safeguarded respectively, flow of task also can be made to perform simultaneously
Also can become chaotic.
Summary of the invention
In view of this, the purpose of the embodiment of the present invention is the method and apparatus providing a kind of distributed task dispatching, with
Solve the problem that complexity increases and flow of task performs confusion that task management is safeguarded, it is achieved by task scheduling, flow process control
The management of system is stripped out between each operation system, forms a kind of method to the management of each operation system task United Dispatching, fall
The risk that the complexity of low task management maintenance and task flow are made mistakes during performing.
First aspect, a kind of method embodiments providing distributed task dispatching, the method includes:
The task static defining information of each task node is carried out persistent storage, wherein, described task static defining
Information includes: dependence and task schedule information between task essential information, task；
Monitor task trigger condition by task dispatcher, detect that described task trigger condition then reads corresponding task
Static defining information, and determine the current task node that described task trigger condition is corresponding；
Generate task instances according to the described task static defining information read, and described task instances is carried out persistence
Storage；
Task corresponding to the previous task node of described current task node is transferred real according to dependence between described task
Execution status of task in example；
Perform state according to the described first task transferred and perform task remote scheduling, and receive the tasks carrying knot of return
Really information；
Perform according to dependence between the second execution status of task in described task execution result information and described task
Downstream node task, and update described task instances according to described task execution result information.
In conjunction with first aspect, embodiments provide the first possible embodiment of first aspect, Qi Zhongsuo
Before the task static defining information to each task node of stating carries out persistent storage, also include:
Directed acyclic graph structures is used to flow to determine task according to the execution of the dependency between each task node and task
Between dependence, wherein, described directed acyclic graph structures includes: the task flow reruned in the fixed cycle is defined and described
Being a directed acyclic graph within the described fixed cycle, each task in the acyclic figure of described directed graph regards a task joint as
Point, dependence between described task is regarded on each limit in the acyclic figure of described directed graph as；
Corresponding appointing is determined according to the call method during remote scheduling that task node each described is corresponding and parameter information
Business schedule information, wherein, described call method is provided by the provider of task executing method, and described parameter information includes that task is held
The input parameter that the provider of row method requires.
In conjunction with first aspect, embodiments provide the embodiment that the second of first aspect is possible, wherein, institute
State and perform state execution task remote scheduling according to the described first task transferred, and receive the task action result letter of return
Breath, including:
Judge that the described first task transferred performs the most all successes of state；
If it is not, then the first task of described task instances is performed state to be set to failure, and terminate described task instances
Corresponding duty cycle, until detecting next task trigger condition by task dispatcher；
Long-range standard open calling interface is the most then utilized to call according to call method type in described task call information
Corresponding remote address, performs task remote scheduling according to described remote address, and receives the task execution result information of return,
Wherein, the data structure of described long-range standard open calling interface include following in one or more: task number, business day
Phase, call-back manner or call parameters, the data structure of described task execution result information include following in one or many
Kind: task number, business date or execution status of task.
In conjunction with first aspect, embodiments provide the third possible embodiment of first aspect, wherein, institute
State remote address and perform task remote scheduling, and receive the task execution result information of return, including:
When the synchronous mark in described task essential information is asynchronous call and task call side carries at task executing method
When supplier has performed, receive described task executing method provider according to returning that described long-range standard open calling interface carries
The described task execution result information that tune method returns.
In conjunction with first aspect, embodiments provide the 4th kind of possible embodiment of first aspect, wherein, institute
State and perform downstream joint according to dependence between the second execution status of task in described task execution result information and described task
Point task, and update described task instances according to described task execution result information, including:
Check whether the second execution status of task in the described task execution result information returned is successfully；
If it is not, then control task scheduler retries scheduling according to the attribute that retries of task to task, until task becomes
Merit or number of retries are more than predetermined threshold value, and update described task instances according to described task execution result information；
The most then perform downstream node task according to dependence between described task, and according to described task action result
Task instances described in information updating, wherein, the data structure of described task instances include following in one or more: task
Number, batch sequence number, first task perform state, job start time, job end time or number of retries, described batch
Sequence number represents the cycle numbering of described task instances.
Second aspect, the embodiment of the present invention additionally provides the device of a kind of distributed task dispatching, including:
Information storage module, for the task static defining information of each task node being carried out persistent storage, wherein,
Described task static defining information includes: task essential information, dependence and task schedule information between task；
Information reading module, for monitoring task trigger condition by task dispatcher, detects that described task triggers bar
Part then reads corresponding task static defining information, and determines the current task node that described task trigger condition is corresponding；
Task instances generation module is for generating task instances according to the described task static defining information read and right
Described task instances carries out persistent storage；
First task performs state and transfers module, for transferring described current task joint according to dependence between described task
First task in the task instances corresponding to previous task node of point performs state；
Task scheduling modules, performs task remote scheduling for performing state according to the described first task transferred, and connects
Receive the task execution result information returned；
Task instances more new module, for according to the second execution status of task in described task execution result information and institute
State dependence between task and perform downstream node task, and update described task instances according to described task execution result information.
In conjunction with second aspect, embodiments provide the first possible embodiment of second aspect, wherein, institute
State device, also include:
Between task, dependence determines module, for using directed acyclic graph structures according to the dependence between each task node
Property and task execution flow to determine dependence between task, wherein, described directed acyclic graph structures includes: will be in the fixed cycle
The task flow reruned defines and is described as a directed acyclic graph within the described fixed cycle, the acyclic figure of described directed graph
In each task regard a task node as, each limit in the acyclic figure of described directed graph regard as between described task rely on close
System；
Task call information determination module, for according to the called side during remote scheduling that task node each described is corresponding
Method and parameter information determine corresponding task schedule information, and wherein, described call method is carried by the provider of task executing method
Confession, described parameter information includes the input parameter that the provider of task executing method requires.
In conjunction with second aspect, embodiments provide the embodiment that the second of second aspect is possible, wherein, institute
State task scheduling modules to include:
Judging unit: for judging that the described first task transferred performs the most all successes of state；
First perform task scheduling unit, for when described first task perform state at least one be unsuccessfully time, by institute
The first task execution state stating task instances is set to failure, and terminates the duty cycle that described task instances is corresponding, until
Next task trigger condition is detected by task dispatcher；
Second perform task scheduling unit, for when described first task perform state all successful time, utilize preset
Long-range standard open calling interface call corresponding remote address, root according to call method type in described task call information
Perform task remote scheduling according to described remote address, and receive the task execution result information of return.
In conjunction with second aspect, embodiments provide the third possible embodiment of second aspect, wherein,
Two perform task scheduling unit includes；
Asynchronous call receives subelement, is used for when the synchronous mark in described task essential information is asynchronous call and task
Called side, when task executing method provider has performed, receives described task executing method provider according to described long-range mark
The described task execution result information that the callback method that quasi-open call interface carries returns.
In conjunction with second aspect, embodiments provide the 4th kind of possible embodiment of second aspect, wherein, institute
State task instances more new module to include:
Inspection unit, for checking that whether the second execution status of task in the described task execution result information of return is
Success；
First perform task instances updating block, for when described second execution status of task be unsuccessfully time control task tune
Degree device retries scheduling according to the attribute that retries of task to task, until Mission Success or number of retries are more than predetermined threshold value,
And update described task instances according to described task execution result information；
Second perform task instances updating block, for when described second execution status of task be successfully time, according to described
Between task, dependence performs downstream node task, and updates described task instances according to described task execution result information.
In the method and apparatus of the distributed task dispatching of embodiment of the present invention offer, the method includes: to each
The task static defining information of business node carries out persistent storage；Intercept described task trigger condition by task dispatcher, read
Take corresponding task static defining information；Task instances is generated according to the task static defining information read；According to current task
The first task of the previous task node of node performs state and performs task remote scheduling, and receives the task action result of return
Information；Downstream node is performed according to dependence between the second execution status of task in described task execution result information and task
Task, and update described task instances according to described task execution result information.The embodiment of the present invention is by by task scheduling side
Formula is independent from each operation system, and each operation system only need to focus on the realization of the Business Processing of task own, it is thus possible to fall
The complexity that low task management is safeguarded, the most unified management and running also reduce the risk made mistakes during task flow performs.
For making the above-mentioned purpose of the present invention, feature and advantage to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by embodiment required use attached
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, and it is right to be therefore not construed as
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to this
A little accompanying drawings obtain other relevant accompanying drawings.
Fig. 1 shows the schematic flow sheet of the method for the distributed task dispatching that the embodiment of the present invention provided；
Fig. 2 shows the signal of directed acyclic graph in the method for the distributed task dispatching that the embodiment of the present invention provided
Figure；
Fig. 3 shows that in the method for the distributed task dispatching that the embodiment of the present invention provided, task dispatcher is carried out remotely
The flow chart of task scheduling concrete grammar；
Fig. 4 shows the structural representation of the device of a kind of distributed task dispatching that the embodiment of the present invention provided.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the embodiment of the present invention
Middle accompanying drawing, is clearly and completely described the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only
It is a part of embodiment of the present invention rather than whole embodiments.Generally real with the present invention illustrated described in accompanying drawing herein
The assembly executing example can be arranged with various different configurations and design.Therefore, below to the present invention's provided in the accompanying drawings
The detailed description of embodiment is not intended to limit the scope of claimed invention, but is merely representative of the selected reality of the present invention
Execute example.Based on embodiments of the invention, the institute that those skilled in the art are obtained on the premise of not making creative work
There are other embodiments, broadly fall into the scope of protection of the invention.
Can only process in oneself system scope in view of the task scheduling mode being embedded in prior art in each system
Task, each operation system is safeguarded that the task scheduling of oneself can increase the complexity that task management is safeguarded, is held for flow of task
Row also can seem chaotic.Based on this, the embodiment of the present invention provide a kind of distributed task dispatching method and apparatus, below by
Embodiment is described.
As it is shown in figure 1, a kind of method embodiments providing distributed task dispatching, the method may be used for pipe
Reason is dispersed in the task node of each operation system in system cluster, it is achieved task carries out unified management and dispatching, reduces task
Complexity that management is safeguarded and task flow perform during the risk made mistakes, wherein, the method comprising the steps of S101-S106,
Specific as follows:
Step S101: the task static defining information of each task node is carried out persistent storage, and wherein, task is static
Definition information includes: dependence and task schedule information between task essential information, task；
Step S102: monitoring task trigger condition by task dispatcher, the task trigger condition of detecting then reads accordingly
Task static defining information, and determine the current task node that this task trigger condition is corresponding；
Step S103: generate task instances according to the task static defining information read, and this task instances is held
Change storage for a long time；
Step S104: transfer task corresponding to the previous task node of current task node according to dependence between task real
First task in example performs state；
Step S105: perform state according to the first task transferred and perform task remote scheduling, and receive the task of return
Execution result information；
Step S106: perform according to dependence between the second execution status of task in task execution result information and task
Downstream node task, and update task instances according to task execution result information.
Concrete, the information persistent storage of task in order to preserve the task related data information produced in task scheduling,
The persistence of these information is the data basis of task scheduling, the attribute of logger task, the state of execution and object information.
In the embodiment that the present invention provides, by abstract for task for having task number, task name, description, task trigger condition
Deng the object of static attribute, a static attribute as task is persisted in storage.Wherein, triggering mode can be timing
Trigger or event triggers, the service selection specifically performed with specific reference to task, present invention preferably employs clocked flip.Preferably
, the data structure of task essential information include following in one or more: task number, business name, description, task touch
Clockwork spring part, whether retry or synchronous mark.In the embodiment of the present invention, the storage of task essential information uses and such as table 1 below but does not limits
Persistent storage, wherein, the summit task of the i.e. directed acyclic graph of task node is carried out in the data structure shown in form 1 content,
Task number is unique mark of task, and synchronous mark represents synchronization or asynchronous call, if number of repetition represents a task
When performing unsuccessfully, the most again can perform according to the number of retries in task.Until Mission Success, or
Number of retries uses until exhausted.
Table 1: task essential information
Further, for correlation technique only exists the data structure describing individual task node, the reality that the present invention provides
Execute example in order to the dependence that describes clearly between task, and automatic seeking footpath when performing for task flow provides foundation, base
In this, before the task static defining information of each task node is carried out persistent storage, also include:
Directed acyclic graph structures is used to flow to determine task according to the execution of the dependency between each task node and task
Between dependence, wherein, described directed acyclic graph structures includes: the task flow reruned in the fixed cycle is defined and described
Being a directed acyclic graph within the described fixed cycle, each task in the acyclic figure of described directed graph regards a task joint as
Point, dependence between described task is regarded on each limit in the acyclic figure of described directed graph as.The oriented nothing of task flow is improved with this
Ring graph structure, and be persisted in storage.
Concrete, the described fixed cycle can directed acyclic by sky but in units of being not limited to sky, in the described fixed cycle
The task flow that figure represents forms a duty cycle.
Preferably, in the embodiment of the present invention, the directed acyclic graph of employing as in figure 2 it is shown, wherein, have task job1, job2,
Job3, job4, task dependence is:
Job1 follow-up is for job2 with follow-up for job3 for job2, job2 of job4, job4 follow-up.
Concrete, each task in directed acyclic graph is regarded a node as, every in the acyclic figure of described directed graph
Dependence between described task is regarded on individual limit as, between described task the data structure of dependence include following in one or many
Kind: originating task number, goal task number or description.In the embodiment of the present invention, between task dependence storage use such as table 2 below but
It is not limited to the data structure shown in form 2 content and carries out persistent storage.
Table 2: dependence between task
| Dependence |
| Originating task number |
| Goal task number |
| Describe |
Further, in embodiments of the invention, the method performing to need specific execution service logic of a task
With the parameter required for the method, therefore, the present invention is that the specific execution method of task defines a task call information
Data structure, concrete, before the task static defining information of each task node is carried out persistent storage, also include:
Determine that corresponding task is adjusted according to the call method during remote scheduling that each task node is corresponding and parameter information
Degree information, wherein, described call method is provided by the execution side of multitask method, and described parameter information includes the offer of multitask method
The input parameter of Fang Yaoqiu.
Further, in order to realize remote scheduling, perform the scheduler task across multiple physical machines, and unify with this
Dispatch each task node in distributed system and the task flow being made up of node each in distributed system, the embodiment of the present invention
Middle task call information stores URL (Uniform Resource Locator, the unified resource of the method for a far call
Finger URL), the method is provided by the provider of concrete task executing method, and the parameter information of storage is the task of far call
The input parameter that the provider of execution method requires.When scheduling performs certain task, it will pass through according to the parameter of this task
The URL calling remote invocation method starts the Logic of Tasks execution performing remote system.
Preferably, the data structure of described task call information include following in one or more: task number, target
Task number or description.In the embodiment of the present invention, between task, dependence storage employing such as table 3 below but is not limited to form 3 content
Shown data structure carries out persistent storage, wherein with the static data of task number associated task.
Table 3: task call information
| Task call information |
| Task number (with the static data of this associated task) |
| Call method |
| Parameter |
Further, after task static defining information persistent storage step, for realizing the clocked flip of scheduler task, this
Inventive embodiments provides a kind of specific scheduler, this scheduler be responsible for the remote scheduling of task, realize distributed
Task scheduling across multiple physical machines.Task dispatcher can be monitored each task entrained by task essential information always and trigger
Condition.Can create when meeting task trigger condition a task instances to storage, then, according to the tune in task call information
Use method attribute, call concrete task call method, after tasks carrying completes, update task instances.
Concrete, in order to realize accurately calling of task, it is ensured that the order of task performs, when task dispatcher listens to touch
During the task of sending out, read the static defining information of task, and generate a task instances according to these information, to this task instances
Information carries out persistent storage.
Preferably, the data structure of described task instances include following in one or more: task number, batch sequence
Number, first task perform state, job start time, job end time or number of retries.The embodiment of the present invention uses table 4
But being not limited to the data structure persistent storage task instances information of content in form 4, wherein, task number is for associated task
Static data, described batch sequence number represents the cycle numbering of described task instances, owing to the task in the present invention is all in one
In the directed acyclic graph of fixed cycle, can determine that this task instances belongs to by the batch number in task instances data structure
In that cycle, preferably employing the business date batch number as task in the present invention, concrete, first task performs state
In success, failure or waiting, in the present embodiment, after the task instances of a task node initializes, just
The first task begun perform state for waiting in, represent and be triggered execution in wait；When the first task of task node performs shape
State be successfully time represent that task completes.
Table 4: task instances information
Further, after task instances generates, task dispatcher transfers described current task according to dependence between task
First task in the corresponding task instances of the previous task node of node performs state, concrete, according to first transferred
Execution status of task execution task remote scheduling, and receive the task execution result information of return, including:
Judge that the first task transferred performs the most all successes of state；
If it is not, the state that then first task of task instances performed is set to failure, and it is corresponding to terminate described task instances
Duty cycle, until next task trigger condition detected by task dispatcher；
Long-range standard open calling interface is the most then utilized to call according to call method type in described task call information
Corresponding remote address, performs task remote scheduling according to described remote address, and receives the task execution result information of return.
Concrete, still as a example by directed acyclic graph shown in above-mentioned Fig. 2: it is assumed that current task node is as job2, then task is adjusted
The task instances corresponding for previous task node job1 with job4 of task node job2 transferred by degree device according to dependence between task
In first task perform state, it is judged that the first task transferred performs the most all successes of state, if it is not, then that task is real
The first task of example performs state and is set to failure, and terminates the duty cycle that described task instances is corresponding, the most no longer performs
Subsequent node job3 of job2 and job2, until detecting next task trigger condition by task dispatcher；The most then
Long-range standard open calling interface is utilized to call corresponding remote address according to call method type in described task call information,
Perform task remote scheduling according to described remote address, and receive the task execution result information of return.
Wherein, for realizing each system is unified task scheduling, this task dispatcher uses but is not limited to http, web-
The mode of service calls long-range task executing method, needs the provider of task executing method according to the embodiment of the present invention
Defined in standard open calling interface.
Preferably, the data structure of described long-range standard open calling interface include following in one or more: appoint
Business number, business date, call-back manner or call parameters, the data structure of described task execution result information include following in
One or more: task number, business date or execution status of task.Embodiment of the present invention employing table 5 but be not limited to table
The data structure of content-defined long-range standard open calling interface in lattice 5, wherein, task number is unique mark of task, parameter
For tasks carrying desired parameters, further for realizing asynchronous call, callback method defined in data structure.
Table 5: remotely standard open calling interface data structure
| Title | Explanation |
| Task number | Unique mark of task |
| Date | |
| Callback method | For asynchronous call |
| Parameter | Tasks carrying desired parameters |
Further, after the provider of task executing method has performed (normal/abnormal), need to define according to the present invention
Standard task execution result information is notified the called side of task.
Further, for realizing asynchronous call, perform task remote scheduling according to remote address, and receive the task of return
Execution result information, including:
When the synchronous mark in task essential information is that asynchronous call and task call side are task executing method provider
When execution completes, receive the callback method that described task executing method provider carries according to long-range standard open calling interface and return
The described task execution result information returned.
Concrete, the data structure of described task execution result information include following in one or more: task number,
Date or the second execution status of task.Preferably, embodiment of the present invention employing table 6 but be not limited in form 6 content-defined
Task execution result information data structure, wherein, described task number is unique mark of task, described second execution status of task
Be represented by successfully, failure, in operation or wait.
Table 6: task execution result information data structure
| Title | Explanation |
| Task number | Unique mark of task |
| Date | |
| Second execution status of task | In success/failure/operation/wait |
Further, perform according to dependence between the second execution status of task in task execution result information and task
Downstream node task, and update task instances according to task execution result information, including:
Check whether the second execution status of task in the task execution result information returned is successfully；
If it is not, then control task scheduler retries scheduling according to the attribute that retries of task to task, until task becomes
Merit or number of retries are more than predetermined threshold value, and update described task instances according to task execution result information；
The most then perform downstream node task according to dependence between task, and according to described task result information updating
Described task instances.
Concrete, when the downstream node of current task node is multiple, check respectively for preposition of the plurality of downstream node
Business node, detects when wherein certain downstream node only has current task node to be previous task node, performs this downstream node
Task, and the downstream node task of this downstream node is performed according to dependence between task.Still with directed acyclic shown in above-mentioned Fig. 2
As a example by figure, the downstream node of current task node job1 is job2 and job4, now detects that downstream node job4 is the most current
Task node is previous task node, then perform node job4, then perform under node job4 according to dependence between task
Trip node job2.
Preferably, in the embodiment of the present invention, the task dispatcher task trigger condition to carrying in task essential information
Monitoring be a continual process.When listening to triggering task, scheduler carries out the execution of remote task scheduling.See
Fig. 3, it is shown that in the distributed task dispatching method that the embodiment of the present invention is provided, task dispatcher carries out remote task scheduling
The flow chart of concrete grammar, the method following steps:
Step S201: read the essential information of task, task call information, the dependence of task, according to above static
Definition information is created that a task instances；
Step S202: according to the dependence of task, checks that the previous task node of current task node is the completeest
Become.If not being fully completed, the first task in task instances being performed state and is set to failure, if be fully completed, continuing
Step S203；
Step S203: according to calling corresponding remote address in task call information；
Step S204: receive the task result data that task executing method provider returns；
Step S205: check the second execution status of task returned, if it fails, scheduler can retry genus according to task
Property task retried scheduling, until Mission Success or number of retries are finished, perform step 6, if successful execution step
S206；
Step S206: update the information such as the state of task instances, end time, elapsed time according to result data.
Concrete, in above scheduler performs remote task scheduling steps, the first node in task flow is by configuring
Task trigger condition triggers, now, it is not necessary to judges the first task execution state of previous task node and directly holds
Row task remote scheduling, after this task node runs succeeded, can find downstream node according to the directed graph of task；If this
When business performs unsuccessfully, the most again can perform according to the number of retries in task, until Mission Success, or
Person's number of retries uses until exhausted.If number of retries is finished, still performs failure, then task status can be set to failure.If
The all preposition node tasks of downstream node is complete, and the most automatically performs the task call of downstream node.
After non-first task node is completed by upstream task node, task triggers when flowing to go to this node, it is also possible to by
The task trigger condition of configuration triggers.If being flowed to go to this node by task trigger, then read according to dependence between task
The task number of downstream node, reads corresponding task static defining information according to this task number, generates task instances and according to front
Method of stating performs task scheduling task；If triggered by the task trigger condition configured, when previous task is not fully complete, triggers and lose
Losing, task status is set to failure, when waiting previous task to complete again to trigger this node, can again trigger tasks carrying.
Understand based on above-mentioned analysis, compared with prior art, the side of the distributed task dispatching that the embodiment of the present invention provides
In method, by the task static defining information of each task node is carried out persistent storage；Intercepted by task dispatcher again
Described task trigger condition, reads corresponding task static defining information；Generate according to the task static defining information read and appoint
Pragmatic example；The first task of the previous task node according to current task node performs state and performs task remote scheduling, and connects
Receive the task execution result information returned；Further according to the second execution status of task in described task execution result information and task
Between dependence perform downstream node task, and according to described task execution result information update described task instances, with solve
The complexity that task management is safeguarded increases and flow of task performs chaotic problem, it is achieved by task scheduling, Row control
Management is stripped out between each system, forms a kind of method to the management of each system task United Dispatching, reduces task management
The risk that the complexity safeguarded and task flow are made mistakes during performing；Further, by dependence between definition task, appoint
Business schedule information, task instances, long-range standard open calling interface, and by task dispatcher, task trigger condition is held
Continue and intercept, it is achieved that the clocked flip of task, order perform, the verification dependency of task, far call, synchronous/asynchronous are called,
And support the retrying of task.
The embodiment of the present invention also provides for the device of a kind of distributed task dispatching, and as shown in Figure 4, this device includes:
Information storage module 51, for the task static defining information of each task node is carried out persistent storage, its
In, described task static defining information includes: task essential information, dependence and task schedule information between task；
Information reading module 52, for monitoring task trigger condition by task dispatcher, detects task trigger condition
Then read corresponding task static defining information, and determine the current task node that this task trigger condition is corresponding；
Task instances generation module 53, for generating task instances according to the described task static defining information read, and
This task instances is carried out persistent storage；
First task performs state and transfers module 54, for transferring described current task node according to dependence between task
Task instances corresponding to previous task node in first task perform state；
Task scheduling modules 55, performs task remote scheduling for performing state according to the first task transferred, and receives
The task execution result information returned；
Task instances more new module 56, for according to the second execution status of task in task execution result information and task
Between dependence perform downstream node task, and according to task execution result information update task instances.
In the embodiment that the present invention provides, by the task static defining information of each task node is carried out persistence
Storage；Intercept described task trigger condition by task dispatcher again, read corresponding task static defining information；According to reading
Task static defining information generate task instances；The first task of the previous task node according to current task node performs shape
State performs task remote scheduling, and receives the task execution result information of return；Further according in described task execution result information
The second execution status of task and task between dependence perform downstream node task, and according to described task execution result information
Updating described task instances, the complexity safeguarded to solve task management increases and flow of task performs chaotic problem, real
Now by task scheduling, the management of Row control is stripped out between each system, is formed a kind of to each system task United Dispatching pipe
The method of reason, reduce complexity that task management safeguards and task flow perform during the risk made mistakes.
Further, said apparatus, also include:
Between task, dependence determines module, for using directed acyclic graph structures according to the dependence between each task node
Property and task execution flow to determine dependence between task, wherein, described directed acyclic graph structures includes: will be in the fixed cycle
The task flow reruned defines and is described as a directed acyclic graph within the described fixed cycle, the acyclic figure of described directed graph
In each task regard a task node as, each limit in the acyclic figure of described directed graph regard as between described task rely on close
System；
Task call information determination module, for according to the called side during remote scheduling that task node each described is corresponding
Method and parameter information determine corresponding task schedule information, and wherein, described call method is carried by the provider of task executing method
Confession, described parameter information includes the input parameter that the provider of task executing method requires.
Further, above-mentioned task scheduling modules includes:
Judging unit: for judging that the first task transferred performs the most all successes of state；
First perform task scheduling unit, for when first task perform state at least one be unsuccessfully time, by task reality
The first task of example performs state and is set to failure, and terminates the duty cycle that described task instances is corresponding, until passing through task
Scheduler detects next task trigger condition；
Second perform task scheduling unit, for when first task perform state all successful time, utilize preset remote
Journey standard open calling interface calls corresponding remote address, according to institute according to call method type in described task call information
State remote address and perform task remote scheduling, and receive the task execution result information of return.
Further, above-mentioned second execution task scheduling unit includes；
Asynchronous call receives subelement, is used for when the synchronous mark in described task essential information is asynchronous call and task
Called side, when task executing method provider has performed, receives described task executing method provider according to described long-range mark
The described task execution result information that the callback method that quasi-open call interface carries returns.
Further, above-mentioned task instances more new module includes:
Inspection unit: whether the second execution status of task in the task execution result information checking return is for becoming
Merit；
First perform task instances updating block, for when the second execution status of task be unsuccessfully time, control task scheduling
Device retries scheduling according to the attribute that retries of task to task, until Mission Success or number of retries are more than predetermined threshold value, and
Described task instances is updated according to task execution result information；
First perform task instances updating block, for when the second execution status of task be successfully time, then according to described
Between business, dependence performs downstream node task, and according to task instances described in described task result information updating according to described
The task execution result information that between business, dependence performs updates described task instances.
In the device of a kind of distributed task dispatching that the embodiment of the present invention provides, by the task to each task node
Static defining information carries out persistent storage；Intercept described task trigger condition by task dispatcher again, read corresponding appointing
Business static defining information；Task instances is generated according to the task static defining information read；Preposition according to current task node
The first task of task node performs state and performs task remote scheduling, and receives the task execution result information of return；Root again
Downstream node task is performed according to dependence between the second execution status of task in described task execution result information and task, and
Updating described task instances according to described task execution result information, the complexity safeguarded to solve task management increases and appoints
The problem that business flow performing is chaotic, it is achieved by task scheduling, the management of Row control is stripped out between each system, forms one
Method to the management of each system task United Dispatching, during reducing complexity and the task flow execution of task management maintenance
The risk made mistakes.
Further, adjusted by dependence, task schedule information, task instances, long-range standard open between definition task
With interface, and by task dispatcher persistently intercepting task trigger condition, it is achieved that the clocked flip of task, order are held
Row, the verification dependency of task, far call, synchronous/asynchronous are called, and the retrying of the task of support.
The device of a kind of distributed task dispatching that the embodiment of the present invention is provided can be the specific hardware on equipment or
Software that person is installed on equipment or firmware etc..The device that the embodiment of the present invention is provided, it realizes the technology of principle and generation
Effect is identical with preceding method embodiment, for briefly describing, and the not mentioned part of device embodiment part, refer to preceding method real
Execute corresponding contents in example.Those skilled in the art is it can be understood that arrive, for convenience and simplicity of description, described above
The specific works process of system, device and unit, be all referred to the corresponding process in said method embodiment, at this no longer
Repeat.
In embodiment provided by the present invention, it should be understood that disclosed apparatus and method, can be by other side
Formula realizes.Device embodiment described above is only that schematically such as, the division of described unit, the most only one are patrolled
Volume function divides, and actual can have other dividing mode when realizing, the most such as, multiple unit or assembly can in conjunction with or can
To be integrated into another system, or some features can be ignored, or does not performs.Another point, shown or discussed each other
Coupling direct-coupling or communication connection can be the INDIRECT COUPLING by some communication interfaces, device or unit or communication link
Connect, can be electrical, machinery or other form.
The described unit illustrated as separating component can be or may not be physically separate, shows as unit
The parts shown can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of the present embodiment scheme
's.
It addition, each functional unit in the embodiment that the present invention provides can be integrated in a processing unit, it is possible to
Being that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.
If described function is using the form realization of SFU software functional unit and as independent production marketing or use, permissible
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words
The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter
Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual
People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.
And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM, Read-OnlyMemory), random access memory are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.
It should also be noted that similar label and letter represent similar terms, therefore, the most a certain Xiang Yi in following accompanying drawing
Individual accompanying drawing is defined, then need not it be defined further and explains in accompanying drawing subsequently, additionally, term " the
One ", " second ", " the 3rd " etc. are only used for distinguishing and describe, and it is not intended that instruction or hint relative importance.
It is last it is noted that the detailed description of the invention of embodiment described above, the only present invention, in order to the present invention to be described
Technical scheme, be not intended to limit, protection scope of the present invention is not limited thereto, although with reference to previous embodiment to this
Bright it is described in detail, it will be understood by those within the art that: any those familiar with the art
In the technical scope that the invention discloses, the technical scheme described in previous embodiment still can be modified or can be light by it
It is readily conceivable that change, or wherein portion of techniques feature is carried out equivalent；And these are revised, change or replace, do not make
The essence of appropriate technical solution departs from the spirit and scope of embodiment of the present invention technical scheme.All should contain the protection in the present invention
Within the scope of.Therefore, protection scope of the present invention should described be as the criterion with scope of the claims.
Claims (10)
1. the method for a distributed task dispatching, it is characterised in that described method includes:
The task static defining information of each task node is carried out persistent storage, wherein, described task static defining information
Including: dependence and task schedule information between task essential information, task；
Monitor task trigger condition by task dispatcher, detect that described task trigger condition then reads corresponding task static
Definition information, and determine the current task node that described task trigger condition is corresponding；
Generate task instances according to the described task static defining information read, and described task instances is carried out persistence deposit
Storage；
Transfer in the task instances that the previous task node of described current task node is corresponding according to dependence between described task
First task perform state；
Perform state according to the described first task transferred and perform task remote scheduling, and receive the task action result letter of return
Breath；
Downstream is performed according to dependence between the second execution status of task in described task execution result information and described task
Node tasks, and update described task instances according to described task execution result information.
Method the most according to claim 1, it is characterised in that the described task static defining information to each task node
Before carrying out persistent storage, also include:
Use directed acyclic graph structures to determine according to the execution flow direction of the dependency between each task node and task to depend between task
The relation of relying, wherein, described directed acyclic graph structures includes: the task flow reruned in the fixed cycle is defined and is described as one
Individual directed acyclic graph within the described fixed cycle, each task in the acyclic figure of described directed graph regards a task node as,
Dependence between described task is regarded on each limit in the acyclic figure of described directed graph as；
Determine that corresponding task is adjusted according to the call method during remote scheduling that task node each described is corresponding and parameter information
Degree information, wherein, described call method is provided by task executing method provider, and described parameter information includes task executing method
The input parameter that provider requires.
Method the most according to claim 1, it is characterised in that the described first task that described basis is transferred performs state and holds
Row task remote scheduling, and receive the task execution result information of return, including:
Judge that the described first task transferred performs the most all successes of state；
If it is not, the state that then first task of described task instances performed is set to failure, and it is corresponding to terminate described task instances
Duty cycle, until next task trigger condition detected by task dispatcher；
Long-range standard open calling interface is the most then utilized to call accordingly according to call method type in described task call information
Remote address, perform task remote scheduling according to described remote address, and receive the task execution result information of return, its
In, the data structure of described long-range standard open calling interface include following in one or more: task number, business day
Phase, call-back manner or call parameters, the data structure of described task execution result information include following in one or many
Kind: task number, business date or execution status of task.
Method the most according to claim 3, it is characterised in that described according to described remote address perform task remotely adjust
Degree, and receive the task execution result information of return, including:
When the synchronous mark in described task essential information is that asynchronous call and task call side are task executing method provider
When execution completes, receive the readjustment side that described task executing method provider carries according to described long-range standard open calling interface
The described task execution result information that method returns.
Method the most according to claim 1, it is characterised in that described according to second in described task execution result information
Dependence execution downstream node task between execution status of task and described task, and according to described task execution result information more
New described task instances, including:
Check whether the second execution status of task in the described task execution result information returned is successfully；
If it is not, then control task scheduler retries scheduling according to the attribute that retries of task to task, until Mission Success or
Number of retries is more than predetermined threshold value, and updates described task instances according to described task execution result information；
The most then perform downstream node task according to dependence between described task, and according to described task execution result information
Update described task instances, wherein, the data structure of described task instances include following in one or more: task number,
Batch sequence number, first task perform state, job start time, job end time or number of retries, described batch sequence number
Represent the cycle numbering of described task instances.
6. the device of a distributed task dispatching, it is characterised in that described device includes:
Information storage module, for the task static defining information of each task node is carried out persistent storage, wherein, described
Task static defining information includes: task essential information, dependence and task schedule information between task；
Information reading module, for monitoring task trigger condition by task dispatcher, detects described task trigger condition then
Read corresponding task static defining information, and determine the current task node that described task trigger condition is corresponding；
Task instances generation module, for generating task instances according to the described task static defining information read, and to described
Task instances carries out persistent storage；
First task performs state and transfers module, for transferring described current task node according to dependence between described task
First task in the task instances that previous task node is corresponding performs state；
Task scheduling modules, performs task remote scheduling for performing state according to the described first task transferred, and reception is returned
The task execution result information returned；
Task instances more new module, for according to the second execution status of task in described task execution result information and described
Between business, dependence performs downstream node task, and updates described task instances according to described task execution result information.
Device the most according to claim 6, it is characterised in that described device also includes:
Between task, dependence determines module, for using directed acyclic graph structures according to the dependency between each task node and
The execution of task flows to determine dependence between task, and wherein, described directed acyclic graph structures includes: will repeat in the fixed cycle
The task flow run defines and is described as a directed acyclic graph within the described fixed cycle, in the acyclic figure of described directed graph
Each task regards a task node as, and dependence between described task is regarded on each limit in the acyclic figure of described directed graph as；
Task call information determination module, for according to the call method during remote scheduling that task node each described is corresponding and
Parameter information determines corresponding task schedule information, and wherein, described call method is provided by the provider of task executing method, institute
State the input parameter that parameter information includes that the provider of task executing method requires.
Device the most according to claim 6, it is characterised in that described task scheduling modules includes:
Judging unit, for judging that the described first task transferred performs the most all successes of state；
First perform task scheduling unit, for when described first task perform state at least one be unsuccessfully time, by described
The first task of pragmatic example performs state and is set to failure, and terminates the duty cycle that described task instances is corresponding, until passing through
Task dispatcher detects next task trigger condition；
Second perform task scheduling unit, for when described first task perform state all successful time, utilize preset remote
Journey standard open calling interface calls corresponding remote address, according to institute according to call method type in described task call information
State remote address and perform task remote scheduling, and receive the task execution result information of return.
Device the most according to claim 8, it is characterised in that described second performs task scheduling unit includes；
Asynchronous call receives subelement, is used for when the synchronous mark in described task essential information is asynchronous call and task call
Side, when task executing method provider has performed, receives described task executing method provider and opens according to described long-range standard
Put the described task execution result information of the callback method return that calling interface carries.
Device the most according to claim 6, it is characterised in that described task instances more new module includes:
Inspection unit, whether the second execution status of task in the described task execution result information checking return is for becoming
Merit；
First perform task instances updating block, for when described second execution status of task be unsuccessfully time control task dispatcher
The attribute that retries according to task retries scheduling to task, until Mission Success or number of retries are more than predetermined threshold value, and root
Described task instances is updated according to described task execution result information；
Second perform task instances updating block, for when described second execution status of task be successfully time, according to described task
Between dependence perform downstream node task, and according to described task execution result information update described task instances.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610665798.0A CN106293971A (en) | 2016-08-15 | 2016-08-15 | A kind of method and apparatus of distributed task dispatching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610665798.0A CN106293971A (en) | 2016-08-15 | 2016-08-15 | A kind of method and apparatus of distributed task dispatching |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106293971A true CN106293971A (en) | 2017-01-04 |
Family
ID=57670745
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610665798.0A Pending CN106293971A (en) | 2016-08-15 | 2016-08-15 | A kind of method and apparatus of distributed task dispatching |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106293971A (en) |
Cited By (52)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106815071A (en) * | 2017-01-12 | 2017-06-09 | 上海轻维软件有限公司 | Big data job scheduling system based on directed acyclic graph |
| CN107526631A (en) * | 2017-09-01 | 2017-12-29 | 百度在线网络技术（北京）有限公司 | A kind of Mission Monitor method, apparatus, equipment and medium |
| CN107977260A (en) * | 2017-11-23 | 2018-05-01 | 北京神州泰岳软件股份有限公司 | Task submits method and device |
| CN108769154A (en) * | 2018-05-15 | 2018-11-06 | 北京工业大学 | Date storage method based on directed acyclic graph and distributed account book |
| CN108804576A (en) * | 2018-05-22 | 2018-11-13 | 华中科技大学 | A kind of domain name hierarchical structure detection method based on link analysis |
| CN108932157A (en) * | 2017-05-22 | 2018-12-04 | 北京京东尚科信息技术有限公司 | Method, system, electronic equipment and the readable medium of distributed treatment task |
| CN108958915A (en) * | 2018-06-28 | 2018-12-07 | 中国建设银行股份有限公司 | Timed task executes method and device |
| CN109086986A (en) * | 2018-07-20 | 2018-12-25 | 中国邮政储蓄银行股份有限公司 | job scheduling method and device |
| CN109375996A (en) * | 2018-09-27 | 2019-02-22 | 安徽省鼎众金融信息咨询服务有限公司 | A kind of support dependence managerial role scheduling system |
| CN109426572A (en) * | 2017-08-29 | 2019-03-05 | 杭州海康威视数字技术股份有限公司 | Task processing method, device and electronic equipment |
| CN109445926A (en) * | 2018-11-09 | 2019-03-08 | 杭州玳数科技有限公司 | Data task dispatching method and data task dispatch system |
| CN109460437A (en) * | 2018-11-19 | 2019-03-12 | 南京苏宁易付宝网络科技有限公司 | Event-handling method and processing system under a kind of distributed environment |
| CN109508289A (en) * | 2018-10-25 | 2019-03-22 | 阿里巴巴集团控股有限公司 | Test method and device, electronic equipment |
| CN109542600A (en) * | 2018-11-15 | 2019-03-29 | 口碑(上海)信息技术有限公司 | Distributed task dispatching system and method |
| CN109558254A (en) * | 2018-11-21 | 2019-04-02 | 北京京东尚科信息技术有限公司 | Asynchronism callback method, system, device and computer readable storage medium |
| CN109814998A (en) * | 2019-01-22 | 2019-05-28 | 中国联合网络通信集团有限公司 | A kind of method and device of multi-process task schedule |
| CN109901918A (en) * | 2017-12-08 | 2019-06-18 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus handling overtime task |
| CN110275768A (en) * | 2019-06-28 | 2019-09-24 | 北京字节跳动网络技术有限公司 | Data processing method, device and electronic equipment |
| CN110308979A (en) * | 2019-06-27 | 2019-10-08 | 苏宁消费金融有限公司 | The asynchronous process frame and its implementation of task based access control scheduling |
| CN110362315A (en) * | 2019-07-17 | 2019-10-22 | 中国工商银行股份有限公司 | Software systems dispatching method and device based on DAG |
| CN110414840A (en) * | 2019-07-29 | 2019-11-05 | 中国工商银行股份有限公司 | Method, system and the relevant device of across dispatch area carry out United Dispatching |
| CN110884537A (en) * | 2019-11-14 | 2020-03-17 | 通号城市轨道交通技术有限公司 | Linkage function implementation system and method |
| CN110928653A (en) * | 2019-10-24 | 2020-03-27 | 浙江大搜车软件技术有限公司 | Cross-cluster task execution method and device, computer equipment and storage medium |
| CN110928668A (en) * | 2019-12-09 | 2020-03-27 | 北京思特奇信息技术股份有限公司 | ZooKeeper-based cloud task scheduling method and system |
| CN110968401A (en) * | 2018-09-28 | 2020-04-07 | 北京国双科技有限公司 | Task scheduling method and device based on Quartz |
| CN110990134A (en) * | 2019-11-21 | 2020-04-10 | 深圳前海环融联易信息科技服务有限公司 | Intelligent task scheduling method and device, computer equipment and storage medium |
| CN111062624A (en) * | 2019-12-19 | 2020-04-24 | 深圳盈佳信联科技有限公司 | Task management platform and method for automatic distribution and push |
| CN111291123A (en) * | 2020-02-12 | 2020-06-16 | 支付宝(杭州)信息技术有限公司 | Task node management method and device |
| CN111290911A (en) * | 2020-01-21 | 2020-06-16 | 上海悦易网络信息技术有限公司 | Method and equipment for detecting mobile terminal task |
| CN111400017A (en) * | 2020-03-26 | 2020-07-10 | 华泰证券股份有限公司 | Distributed complex task scheduling method |
| CN111768288A (en) * | 2020-06-02 | 2020-10-13 | 北京同邦卓益科技有限公司 | Service processing method and device, electronic equipment and storage medium |
| CN111782679A (en) * | 2020-06-22 | 2020-10-16 | 深圳市酷开网络科技有限公司 | Method and device for supervising data processing process, computer equipment and storage medium |
| CN111815200A (en) * | 2020-07-31 | 2020-10-23 | 深圳壹账通智能科技有限公司 | Task scheduling method and device, computer equipment and storage medium |
| CN112131297A (en) * | 2020-09-28 | 2020-12-25 | 广州亚信技术有限公司 | Data processing method, device, equipment and storage medium |
| CN112199184A (en) * | 2020-11-02 | 2021-01-08 | 杭州安恒信息技术股份有限公司 | Cross-language task scheduling method, device, equipment and readable storage medium |
| CN112214289A (en) * | 2019-07-11 | 2021-01-12 | 腾讯科技（深圳）有限公司 | Task scheduling method and device, server and storage medium |
| CN112346842A (en) * | 2020-11-19 | 2021-02-09 | 广州嘉为科技有限公司 | Workflow task scheduling method based on directed acyclic graph |
| CN112433950A (en) * | 2020-11-30 | 2021-03-02 | 天津五八到家货运服务有限公司 | Method for automatically building test environment, electronic equipment and storage medium |
| CN112667383A (en) * | 2020-12-31 | 2021-04-16 | 北京高途云集教育科技有限公司 | Task execution and scheduling method, system, device, computing equipment and medium |
| CN112667384A (en) * | 2020-12-31 | 2021-04-16 | 青岛海尔科技有限公司 | Task flow scheduling method, device, storage medium and electronic device |
| CN112860389A (en) * | 2019-11-27 | 2021-05-28 | 上海哔哩哔哩科技有限公司 | Task scheduling method based on state machine |
| CN113010531A (en) * | 2021-02-05 | 2021-06-22 | 成都库珀区块链科技有限公司 | Block chain BAAS system task scheduling framework based on directed acyclic graph |
| CN113010289A (en) * | 2021-03-17 | 2021-06-22 | 杭州遥望网络科技有限公司 | Task scheduling method, device and system |
| CN113268318A (en) * | 2021-04-07 | 2021-08-17 | 北京思特奇信息技术股份有限公司 | Task scheduling method and distributed system |
| CN113485820A (en) * | 2021-08-03 | 2021-10-08 | 北京百度网讯科技有限公司 | Task scheduling system and implementation method, device and medium thereof |
| CN113656468A (en) * | 2020-05-12 | 2021-11-16 | 北京市天元网络技术股份有限公司 | Task flow triggering method and device based on NIFI |
| CN113760476A (en) * | 2020-06-04 | 2021-12-07 | 广州虎牙信息科技有限公司 | Task dependency processing method and related device |
| CN114490001A (en) * | 2022-02-17 | 2022-05-13 | 支付宝(杭州)信息技术有限公司 | Method, device and equipment for executing aggregated event stream |
| CN115658749A (en) * | 2022-10-25 | 2023-01-31 | 工银瑞信基金管理有限公司 | Directed acyclic graph-based fund product sorting method and device and electronic equipment |
| CN115987751A (en) * | 2023-03-20 | 2023-04-18 | 阿里云计算有限公司 | Cloud network architecture and method for maintaining entity objects with dependencies |
| WO2023202006A1 (en) * | 2022-04-20 | 2023-10-26 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for task execution |
| CN117610325A (en) * | 2024-01-24 | 2024-02-27 | 中国人民解放军国防科技大学 | Distributed optimal design node scheduling method, system and equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103677973A (en) * | 2013-09-01 | 2014-03-26 | 西安重装渭南光电科技有限公司 | Distributed multi-task scheduling management system |
| CN104461502A (en) * | 2014-11-03 | 2015-03-25 | 广州汇讯营销咨询有限公司 | Task management method and system based on Hadoop |
| US9037723B2 (en) * | 2011-05-31 | 2015-05-19 | Red Hat, Inc. | Triggering workload movement based on policy stack having multiple selectable inputs |
| CN104765641A (en) * | 2014-01-02 | 2015-07-08 | 中国移动通信集团安徽有限公司 | Job scheduling method and system |
| CN104965754A (en) * | 2015-03-31 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Task scheduling method and task scheduling apparatus |
| CN105700943A (en) * | 2015-12-31 | 2016-06-22 | 上海百事通信息技术股份有限公司 | Distributed task scheduling method and system |
-
2016
- 2016-08-15 CN CN201610665798.0A patent/CN106293971A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9037723B2 (en) * | 2011-05-31 | 2015-05-19 | Red Hat, Inc. | Triggering workload movement based on policy stack having multiple selectable inputs |
| CN103677973A (en) * | 2013-09-01 | 2014-03-26 | 西安重装渭南光电科技有限公司 | Distributed multi-task scheduling management system |
| CN104765641A (en) * | 2014-01-02 | 2015-07-08 | 中国移动通信集团安徽有限公司 | Job scheduling method and system |
| CN104461502A (en) * | 2014-11-03 | 2015-03-25 | 广州汇讯营销咨询有限公司 | Task management method and system based on Hadoop |
| CN104965754A (en) * | 2015-03-31 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Task scheduling method and task scheduling apparatus |
| CN105700943A (en) * | 2015-12-31 | 2016-06-22 | 上海百事通信息技术股份有限公司 | Distributed task scheduling method and system |
Non-Patent Citations (2)
| Title |
|---|
| 孟宪福: "分布式环境下任务调度模型研究", 《大连理工大学学报》 * |
| 殷进勇，等；: "优先约束的混合实时任务动态调度算法", 《计算机集成制造系统》 * |
Cited By (72)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106815071A (en) * | 2017-01-12 | 2017-06-09 | 上海轻维软件有限公司 | Big data job scheduling system based on directed acyclic graph |
| CN108932157A (en) * | 2017-05-22 | 2018-12-04 | 北京京东尚科信息技术有限公司 | Method, system, electronic equipment and the readable medium of distributed treatment task |
| CN109426572A (en) * | 2017-08-29 | 2019-03-05 | 杭州海康威视数字技术股份有限公司 | Task processing method, device and electronic equipment |
| CN107526631A (en) * | 2017-09-01 | 2017-12-29 | 百度在线网络技术（北京）有限公司 | A kind of Mission Monitor method, apparatus, equipment and medium |
| CN107526631B (en) * | 2017-09-01 | 2021-01-08 | 百度在线网络技术（北京）有限公司 | Task monitoring method, device, equipment and medium |
| CN107977260B (en) * | 2017-11-23 | 2020-08-28 | 鼎富智能科技有限公司 | Task submitting method and device |
| CN107977260A (en) * | 2017-11-23 | 2018-05-01 | 北京神州泰岳软件股份有限公司 | Task submits method and device |
| CN109901918A (en) * | 2017-12-08 | 2019-06-18 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus handling overtime task |
| CN109901918B (en) * | 2017-12-08 | 2024-04-05 | 北京京东尚科信息技术有限公司 | Method and device for processing overtime task |
| CN108769154A (en) * | 2018-05-15 | 2018-11-06 | 北京工业大学 | Date storage method based on directed acyclic graph and distributed account book |
| CN108769154B (en) * | 2018-05-15 | 2021-01-01 | 北京工业大学 | Data storage method based on directed acyclic graph and distributed account book |
| CN108804576A (en) * | 2018-05-22 | 2018-11-13 | 华中科技大学 | A kind of domain name hierarchical structure detection method based on link analysis |
| CN108804576B (en) * | 2018-05-22 | 2021-08-20 | 华中科技大学 | Domain name hierarchical structure detection method based on link analysis |
| CN108958915A (en) * | 2018-06-28 | 2018-12-07 | 中国建设银行股份有限公司 | Timed task executes method and device |
| CN109086986A (en) * | 2018-07-20 | 2018-12-25 | 中国邮政储蓄银行股份有限公司 | job scheduling method and device |
| CN109375996A (en) * | 2018-09-27 | 2019-02-22 | 安徽省鼎众金融信息咨询服务有限公司 | A kind of support dependence managerial role scheduling system |
| CN110968401A (en) * | 2018-09-28 | 2020-04-07 | 北京国双科技有限公司 | Task scheduling method and device based on Quartz |
| CN109508289A (en) * | 2018-10-25 | 2019-03-22 | 阿里巴巴集团控股有限公司 | Test method and device, electronic equipment |
| CN109508289B (en) * | 2018-10-25 | 2021-06-29 | 创新先进技术有限公司 | Test method and device and electronic equipment |
| CN109445926A (en) * | 2018-11-09 | 2019-03-08 | 杭州玳数科技有限公司 | Data task dispatching method and data task dispatch system |
| CN109542600A (en) * | 2018-11-15 | 2019-03-29 | 口碑(上海)信息技术有限公司 | Distributed task dispatching system and method |
| CN109542600B (en) * | 2018-11-15 | 2020-12-25 | 口碑(上海)信息技术有限公司 | Distributed task scheduling system and method |
| CN109460437B (en) * | 2018-11-19 | 2021-05-28 | 南京苏宁易付宝网络科技有限公司 | Event processing method and system in distributed environment |
| CN109460437A (en) * | 2018-11-19 | 2019-03-12 | 南京苏宁易付宝网络科技有限公司 | Event-handling method and processing system under a kind of distributed environment |
| CN109558254A (en) * | 2018-11-21 | 2019-04-02 | 北京京东尚科信息技术有限公司 | Asynchronism callback method, system, device and computer readable storage medium |
| CN109814998A (en) * | 2019-01-22 | 2019-05-28 | 中国联合网络通信集团有限公司 | A kind of method and device of multi-process task schedule |
| CN110308979A (en) * | 2019-06-27 | 2019-10-08 | 苏宁消费金融有限公司 | The asynchronous process frame and its implementation of task based access control scheduling |
| CN110275768A (en) * | 2019-06-28 | 2019-09-24 | 北京字节跳动网络技术有限公司 | Data processing method, device and electronic equipment |
| CN112214289A (en) * | 2019-07-11 | 2021-01-12 | 腾讯科技（深圳）有限公司 | Task scheduling method and device, server and storage medium |
| CN110362315A (en) * | 2019-07-17 | 2019-10-22 | 中国工商银行股份有限公司 | Software systems dispatching method and device based on DAG |
| CN110362315B (en) * | 2019-07-17 | 2023-05-12 | 中国工商银行股份有限公司 | DAG-based software system scheduling method and device |
| CN110414840A (en) * | 2019-07-29 | 2019-11-05 | 中国工商银行股份有限公司 | Method, system and the relevant device of across dispatch area carry out United Dispatching |
| CN110928653A (en) * | 2019-10-24 | 2020-03-27 | 浙江大搜车软件技术有限公司 | Cross-cluster task execution method and device, computer equipment and storage medium |
| CN110884537A (en) * | 2019-11-14 | 2020-03-17 | 通号城市轨道交通技术有限公司 | Linkage function implementation system and method |
| CN110990134B (en) * | 2019-11-21 | 2023-12-26 | 深圳前海环融联易信息科技服务有限公司 | Intelligent task scheduling method and device, computer equipment and storage medium |
| CN110990134A (en) * | 2019-11-21 | 2020-04-10 | 深圳前海环融联易信息科技服务有限公司 | Intelligent task scheduling method and device, computer equipment and storage medium |
| CN112860389A (en) * | 2019-11-27 | 2021-05-28 | 上海哔哩哔哩科技有限公司 | Task scheduling method based on state machine |
| CN110928668B (en) * | 2019-12-09 | 2022-06-07 | 北京思特奇信息技术股份有限公司 | ZooKeeper-based cloud task scheduling method and system |
| CN110928668A (en) * | 2019-12-09 | 2020-03-27 | 北京思特奇信息技术股份有限公司 | ZooKeeper-based cloud task scheduling method and system |
| CN111062624A (en) * | 2019-12-19 | 2020-04-24 | 深圳盈佳信联科技有限公司 | Task management platform and method for automatic distribution and push |
| CN111290911A (en) * | 2020-01-21 | 2020-06-16 | 上海悦易网络信息技术有限公司 | Method and equipment for detecting mobile terminal task |
| CN111291123A (en) * | 2020-02-12 | 2020-06-16 | 支付宝(杭州)信息技术有限公司 | Task node management method and device |
| CN111400017A (en) * | 2020-03-26 | 2020-07-10 | 华泰证券股份有限公司 | Distributed complex task scheduling method |
| CN113656468B (en) * | 2020-05-12 | 2024-02-27 | 北京市天元网络技术股份有限公司 | Task flow triggering method and device based on NIFI |
| CN113656468A (en) * | 2020-05-12 | 2021-11-16 | 北京市天元网络技术股份有限公司 | Task flow triggering method and device based on NIFI |
| CN111768288A (en) * | 2020-06-02 | 2020-10-13 | 北京同邦卓益科技有限公司 | Service processing method and device, electronic equipment and storage medium |
| CN111768288B (en) * | 2020-06-02 | 2023-12-08 | 北京同邦卓益科技有限公司 | Service processing method, device, electronic equipment and storage medium |
| CN113760476B (en) * | 2020-06-04 | 2024-02-09 | 广州虎牙信息科技有限公司 | Task dependency processing method and related device |
| CN113760476A (en) * | 2020-06-04 | 2021-12-07 | 广州虎牙信息科技有限公司 | Task dependency processing method and related device |
| CN111782679B (en) * | 2020-06-22 | 2024-03-26 | 深圳市酷开网络科技股份有限公司 | Supervision method and device for data processing process, computer equipment and storage medium |
| CN111782679A (en) * | 2020-06-22 | 2020-10-16 | 深圳市酷开网络科技有限公司 | Method and device for supervising data processing process, computer equipment and storage medium |
| CN111815200A (en) * | 2020-07-31 | 2020-10-23 | 深圳壹账通智能科技有限公司 | Task scheduling method and device, computer equipment and storage medium |
| CN112131297A (en) * | 2020-09-28 | 2020-12-25 | 广州亚信技术有限公司 | Data processing method, device, equipment and storage medium |
| CN112199184A (en) * | 2020-11-02 | 2021-01-08 | 杭州安恒信息技术股份有限公司 | Cross-language task scheduling method, device, equipment and readable storage medium |
| CN112346842A (en) * | 2020-11-19 | 2021-02-09 | 广州嘉为科技有限公司 | Workflow task scheduling method based on directed acyclic graph |
| CN112346842B (en) * | 2020-11-19 | 2024-03-26 | 广州嘉为科技有限公司 | Workflow task scheduling method based on directed acyclic graph |
| CN112433950A (en) * | 2020-11-30 | 2021-03-02 | 天津五八到家货运服务有限公司 | Method for automatically building test environment, electronic equipment and storage medium |
| CN112667384A (en) * | 2020-12-31 | 2021-04-16 | 青岛海尔科技有限公司 | Task flow scheduling method, device, storage medium and electronic device |
| CN112667383A (en) * | 2020-12-31 | 2021-04-16 | 北京高途云集教育科技有限公司 | Task execution and scheduling method, system, device, computing equipment and medium |
| CN112667383B (en) * | 2020-12-31 | 2024-02-09 | 北京高途云集教育科技有限公司 | Task execution and scheduling method, system, device, computing equipment and medium |
| CN113010531B (en) * | 2021-02-05 | 2022-11-01 | 成都库珀创新科技有限公司 | Block chain BAAS system task scheduling framework based on directed acyclic graph |
| CN113010531A (en) * | 2021-02-05 | 2021-06-22 | 成都库珀区块链科技有限公司 | Block chain BAAS system task scheduling framework based on directed acyclic graph |
| CN113010289A (en) * | 2021-03-17 | 2021-06-22 | 杭州遥望网络科技有限公司 | Task scheduling method, device and system |
| CN113268318A (en) * | 2021-04-07 | 2021-08-17 | 北京思特奇信息技术股份有限公司 | Task scheduling method and distributed system |
| CN113485820A (en) * | 2021-08-03 | 2021-10-08 | 北京百度网讯科技有限公司 | Task scheduling system and implementation method, device and medium thereof |
| CN114490001A (en) * | 2022-02-17 | 2022-05-13 | 支付宝(杭州)信息技术有限公司 | Method, device and equipment for executing aggregated event stream |
| WO2023202006A1 (en) * | 2022-04-20 | 2023-10-26 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for task execution |
| CN115658749A (en) * | 2022-10-25 | 2023-01-31 | 工银瑞信基金管理有限公司 | Directed acyclic graph-based fund product sorting method and device and electronic equipment |
| CN115658749B (en) * | 2022-10-25 | 2023-05-26 | 工银瑞信基金管理有限公司 | Fund product ordering method and device based on directed acyclic graph and electronic equipment |
| CN115987751A (en) * | 2023-03-20 | 2023-04-18 | 阿里云计算有限公司 | Cloud network architecture and method for maintaining entity objects with dependencies |
| CN117610325B (en) * | 2024-01-24 | 2024-04-05 | 中国人民解放军国防科技大学 | Distributed optimal design node scheduling method, system and equipment |
| CN117610325A (en) * | 2024-01-24 | 2024-02-27 | 中国人民解放军国防科技大学 | Distributed optimal design node scheduling method, system and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106293971A (en) | A kind of method and apparatus of distributed task dispatching | |
| WO2019006654A1 (en) | Financial self-service equipment maintenance dispatch generation method, hand-held terminal and electronic device | |
| CN104115447A (en) | Allowing destroy scheme configuration method and device under cloud computing architecture | |
| CN106844198A (en) | Distributed dispatching automation test platform and method | |
| CN104572290A (en) | Method and device for controlling message processing threads | |
| US20140013315A1 (en) | Scheduled and quarantined software deployment based on dependency analysis | |
| CN104239148A (en) | Distributed task scheduling method and device | |
| CN102254016B (en) | Cloud-computing-environment-oriented fault-tolerant parallel Skyline inquiry method | |
| CN105094982A (en) | Multi-satellite remote sensing data processing system | |
| CN106027328A (en) | Cluster monitoring method and system based on application container deployment | |
| CN110096342A (en) | Task processing method, device, server and storage medium | |
| CN103678051B (en) | A kind of online failure tolerant method in company-data processing system | |
| CN109614227A (en) | Task resource concocting method, device, electronic equipment and computer-readable medium | |
| CN112328307A (en) | Development, operation and maintenance integrated system | |
| CN109271172A (en) | A kind of host behavior extension method and device of swarm cluster | |
| CN112506691B (en) | Digital twin application fault recovery method and system for multi-energy system | |
| CN104951367A (en) | Virtualized cloud fault-tolerant task scheduling method | |
| Priya et al. | Fault tolerance-genetic algorithm for grid task scheduling using check point | |
| Almurshed et al. | A fault-tolerant workflow composition and deployment automation IoT framework in a multicloud edge environment | |
| CN106875018B (en) | Method and device for automatic maintenance of super-large-scale machine | |
| CN111404757A (en) | Cloud-based cross-network application integration system | |
| CN106293922A (en) | Asynchronous task processing method and system | |
| US11068487B2 (en) | Event-stream searching using compiled rule patterns | |
| CN104021033A (en) | Method and system for hashing busy processing nodes | |
| CN103336721A (en) | Method, device and system for allocating database operation request |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170104 |