CN102467532A - Task processing method and task processing device - Google Patents
Task processing method and task processing device Download PDFInfo
- Publication number
- CN102467532A CN102467532A CN201010541352XA CN201010541352A CN102467532A CN 102467532 A CN102467532 A CN 102467532A CN 201010541352X A CN201010541352X A CN 201010541352XA CN 201010541352 A CN201010541352 A CN 201010541352A CN 102467532 A CN102467532 A CN 102467532A
- Authority
- CN
- China
- Prior art keywords
- task
- node
- data object
- record
- present node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a task processing method and a task processing device. The main technical scheme comprises: acquiring a pre-generated task list, wherein the task list internally comprises logic relationship among the tasks represented by the relationship of father and son nodes, task records corresponding to each node, and scanning priority information generated for nodes of father nodes as the lower layer nodes for each layer; and according to the scanning priority information, and aiming at each node corresponding to each priority, respectively executing: executing the tasks according to the task records corresponding to the current nodes if the current nodes corresponding to the current priority are root nodes, and executing the tasks according to the task records of the current nodes if the current nodes corresponding to the current priority are not root nodes, and executing the tasks according to the task records of the current nodes when the tasks corresponding to the father nodes of the current nodes are determined to be executed successfully. According to the technical scheme, the task processing method and the task processing device can be suitable for more task logic relationship structures, and the task executing process does not rely on the task executing procedure stipulated in task allocation.
Description
Technical field
The present invention relates to technical field of data processing, relate in particular to a kind of task processing method and Task Processing Unit.
Background technology
Along with the continuous development of mobile communication technology and going from strength to strength of mobile communication market; Class of business is also in continuous increase; Each common carrier is also more and more meticulousr to the analyze demands of user communication data and traffic data; Become increasingly complex, many reasons make the task of needing in the background data base to carry out statistics also increase accordingly.
With the oracle database is example, as will carrying out the analysis of related data, needs to accomplish that legacy data empties, committed steps such as new data generation, index creation and content statistics.In task quantity relatively more after a little while, can be that carrier is regularly carried out SQL statement (being the SQL operation) through batch SQL (Structured Query Language, SQL) statement script; But; Along with the continuous increase of task quantity, such SQL operation also constantly increases thereupon, and under the related increasing situation of task; Relation between all statistics tasks also begins complicacy, and the sequencing of execution also receives strict restriction.Therefore, along with the increase of task quantity, traditional is the mode that carrier is carried out SQL statement with batch SQL statement script, thresholds such as management maintenance will occur.
In order to tackle the bigger situation of task quantity; A kind of prior art relevant with the present invention provides the quick retrieval of a kind of task tree based on SQL database and generated the method that shows, this technical scheme converts the task node numbering of task tree into information that SQL can sort, is specially each group numeral of task node numbering is carried out the numerical value weighted; Carry out code conversion again; Form database and can differentiate the ordering numerical value of size, the ordering numerical value according to obtaining sorts to task node through sql like language; Realization is to the retrieval of task tree, and further generation shows.Wherein: numerical value weighted process multiply by weighting factor for each the group numeral with the task node numbering, accomplishes weighted; The code conversion process is with each group numeral of the numbering of the task node after the weighted, carries out the connection of character string by its order in the task node serial number, obtains the Final Format conversion value of task node numbering, and numerical value promptly sorts.This method has realized the identification of task order and tree-like demonstration, thereby under a fairly large number of situation of task, has realized the management maintenance to task.But there is following several problem in this method in practical application:
1, only can handle the The Logic of Tasks relation of tree structure
Promptly only can handle the logical relation of the corresponding a plurality of child node tasks of a father node task; And in the actual count environment; Logical relation between task trends towards complicacy; Be not limited to tree structure, also possibly wrapped various logic relations such as reticulate texture, ring texture, promptly except that the corresponding a plurality of child node tasks of a father node task; The situation that also comprises the corresponding a plurality of father node tasks of a node task obviously can not be able to handle through tree structure and to the ordering of coding to the processing of this kind situation based on above-mentioned prior art.
2, can't satisfy the demand of execution sequence dynamic change
In the above-mentioned prior art, task sorted to depend on the ordering of node serial number is handled, need promptly before task is carried out, just need will number definite just for task provides the numbering that can be used for sorting during the task configuration.Numbering is in case confirm that execution sequence just no longer changes.And in actual count work; Logical relation between the statistics task; Confirm dynamically that according to the preparation of employed data object in the statistics i.e. logical relation definition between the task can make the task execution sequence change often, and this can't solve through regular coding.
In sum, the above-mentioned prior art that depends on task relational tree and mission number, poor for applicability to the The Logic of Tasks relational structure, and the task execution sequence of task implementation regulation when depending on the task configuration.
Summary of the invention
In view of this; The embodiment of the invention provides a kind of task processing method and Task Processing Unit; This technical scheme can be applicable to more The Logic of Tasks relational structure with respect to prior art, and the task implementation does not rely on the task execution sequence of stipulating when task disposes.
The embodiment of the invention realizes through following technical scheme:
An aspect according to the embodiment of the invention provides a kind of task processing method, comprising:
Obtain the task list that generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in the said task list and be the scan priority information of each layer as the node generation of the father node of lower level node;
According to said scan priority information,, carry out respectively to each node of corresponding each priority:
If the present node of corresponding current priority is a root node, then execute the task according to the corresponding task record of present node;
If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.
Another aspect according to the embodiment of the invention also provides a kind of Task Processing Unit, comprising:
The task list generation unit, the task list that is used for generating in advance;
The task list acquiring unit; Be used to obtain the task list that said task list generation unit generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in the said task list and be the scan priority information of each layer as the node generation of the father node of lower level node;
Task processing unit is used for according to said scan priority information, to each node of corresponding each priority, carries out respectively: if the present node of corresponding current priority is a root node, then execute the task according to the corresponding task record of present node; If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.
Above-mentioned at least one technical scheme that provides through the embodiment of the invention; When task is handled; At first obtain the task list that generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in this task list and be the scan priority information of each layer as the node generation of the father node of lower level node; Then according to scan priority information; To each node of corresponding each priority, respectively task is handled, that is: if the present node of corresponding current priority is a root node; Then execute the task according to the corresponding task record of present node; If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.According to this technical scheme, the logical relation between each task that can represent through father and son's node relationships with respect to prior art, can be suitable for more The Logic of Tasks relational structure better, for example, and tree-shaped logical relation result, netted logical relation structure etc.; And with respect to prior art; Need not pre-configured task execution sequence; The task execution sequence of regulation when task executions does not rely on the task configuration; And according to confirming dynamically as scan priority information and task record that the node of the father node of lower level node generates whether the task of present node is carried out, thereby improved the task processing more flexible for each layer.
Other features and advantages of the present invention will be set forth in instructions subsequently, and, partly from instructions, become obvious, perhaps understand through embodiment of the present invention.The object of the invention can be realized through the structure that in the instructions of being write, claims and accompanying drawing, is particularly pointed out and obtained with other advantages.
Description of drawings
Accompanying drawing is used to provide further understanding of the present invention, and constitutes the part of instructions, is used to explain the present invention with the embodiment of the invention, is not construed as limiting the invention.In the accompanying drawings:
The process flow diagram that the task processes that Fig. 1 provides for the embodiment of the invention one is corresponding;
The process flow diagram that the process of the configuration task configured list that Fig. 2 provides for the embodiment of the invention one is corresponding;
The process flow diagram that the process of the generation task list that Fig. 3 provides for the embodiment of the invention one is corresponding;
The process flow diagram that the task implementation that Fig. 4 provides for the embodiment of the invention one is corresponding;
The Task Processing Unit synoptic diagram one that Fig. 5 provides for the embodiment of the invention two;
The Task Processing Unit synoptic diagram two that Fig. 6 provides for the embodiment of the invention two.
Embodiment
The implementation of the task execution sequence of regulation when being suitable for more multitask logical relation structure and not relying on the task configuration in order to provide; The embodiment of the invention provides a kind of task processing method and Task Processing Unit; Below in conjunction with Figure of description the preferred embodiments of the present invention are described; Should be appreciated that preferred embodiment described herein only is used for explanation and explains the present invention, and be not used in qualification the present invention.And under the situation of not conflicting, embodiment and the characteristic among the embodiment among the application can make up each other.
Embodiment one
The embodiment of the invention one provides a kind of task processing method; This task processing method can be applicable to the multiple-task logical relation; The The Logic of Tasks relation and the cancellated The Logic of Tasks relation that are particularly useful for tree construction; And, the task execution sequence of regulation when the implementation of this method does not rely on the task configuration.
Task processes as shown in Figure 1, that this embodiment one provides mainly comprises the steps 101 to step 107:
Step 101, obtain in advance the task list that generates.
In this step 101, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in the task list that gets access to and be the scan priority information of each layer as the node generation of the father node of lower level node.
Step 102, according to the scan priority information that comprises in the task list, select a priority that was not selected as current priority.
In this step 102, can be current priority by priority of height select progressively on earth preferably according to priority.
Step 103, from each node of current priority, select a non-selected node, and judge whether this node of selecting is root node, if, execution in step 104, if not, execution in step 105.
Step 104, execute the task, and continue step 106 according to the corresponding task record of present node.
Step 105, after the corresponding task of the father node of confirming present node is all by successful execution, execute the task according to the task record of present node, continue execution in step 106.
Step 106, judge whether each node of current priority all is selected, if execution in step 107 if not, is returned step 103.
Whether all priority in step 107, the task list all were selected, if, then finish, if not, then return step 102.
So far, the task handling flow process is finished.
The described process of above flow process is the main flow process of the task treatment scheme that provides of the embodiment of the invention one, and the step that wherein relates to is a kind of preferred implementation.In the corresponding flow process of Fig. 1,,, promptly carry out respectively to each node of corresponding each priority processing procedure of executing the task respectively through step 102 to step 107:
If the present node of corresponding current priority is a root node, then execute the task according to the corresponding task record of present node;
If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.
In the above-mentioned flow process of Fig. 1 correspondence; Carry out above-mentioned each node processing procedure of executing the task respectively through serial mode to corresponding each priority; In the practical application, when executing the task processing respectively, also can adopt the parallel processing mode to each node of corresponding each priority; Promptly through a plurality of threads respectively to each node of different priorities processing of executing the task, thereby the efficient that the raising task is handled.
The embodiment of the invention one also provides the concrete mode that generates task list in advance; Particularly; When generating task list is according to pre-configured task configured list, below describes to the process of configuration task configured list and according to the process that the task configured list generates task list respectively.
One, the process of configuration task configured list:
The task layoutprocedure need take into full account the degree that statistics task can conclude and simplify, and utilizes information such as Oracle tables of data logger task logical relation, statement template, source data object tabulation, target data list object, list of available resources and the detection of termination condition.
Particularly, as shown in Figure 2, the process of configuration task configured list further comprises:
Logical relation layoutprocedure, SQL statement template configuration process and other parameter configuration process;
Wherein, following to the configuration instruction of each process:
1, logical relation layoutprocedure comprises:
According to pending flow of task, dispose the logical relation between each task and represent through father and son's node relationships; And the task executive condition that disposes each node correspondence.
Wherein, Because in the embodiment of the invention one is to represent the logical relation between each task through father and son's node relationships; And make the logical relation between the task be not limited to the logical relation of tree structure through the configuration of task executive condition; Can also be cancellated logical relation, if cancellated logical relation needs through the corresponding a plurality of father nodes of task executive condition statement present node.Logical relation between each task node can be through each node corresponding nodes sign mark, the identification information that be used for unique identification this node of node identification for generating to each node.
Configuration through the task executive condition; The correctness and the convenience of logical relation statement be can guarantee, convenience and readability taken into account simultaneously, in the concrete implementation of task the task configuration; Can the task of a task node be performed; To confirm by the corresponding task executive condition of this node, and promptly detect the task executive condition and meet then and execute the task, detect not through then not executing the task.
2, SQL statement template configuration process comprises:
, can simplify through behind the inductive generalization the task statement of the same action type of correspondence,, reach the purpose of simplifying configuration effort with respect to listing all SQL statements in the prior art one by one to the template statement deposits in the task configured list in the respective record.
For realizing the templating of SQL statement; All adopt the form of self-defined reserved word to express to the parameter that can conclude in the system; Generally speaking, the SQL statement template comprises: be used to represent the self-defined reserved field of source data object and the self-defined reserved field that is used to represent the target data object; According to system requirements, this SQL statement template comprising on the basis of above-mentioned self-defined reserved field, can further include to be used to represent the self-defined reserved field of storage resources and the self-defined reserved field that is used to represent the remote data base link resources.
For ease of understanding, in concrete the realization, the SQL statement module can be described below:
To be used to represent that the self-defined reserved field of target data object is defined as TGTOBJ;
To be used to represent that the self-defined reserved field of source data object is defined as SRCOBJ;
To be used to represent that the self-defined reserved field of storage resources is defined as TABLESPACE;
To be used to represent that the remote data base link resources is defined as DBLINK.
On the basis of above-mentioned definition, the task that script needs many statements to represent can be unified to be reduced to a statement and get final product, for example: many task statements from the same remote data base chain can simplify into:
CREATE?TABLE?TGTOBJ?AS?SELECT*FROM?SRCOBJDBLINK
Article one, the SQL statement template gets final product.
Above-mentioned SQL statement template representation: on local data base, pass through the database link of DBLINK by name, the source data object in the duplicate remote database (tables of data) content, and create destination object (tables of data).
More particularly, SQL statement can for:
Create?table?subscriber?tablespace?data538h?as?select*from?tbcs.subscriberyybcv；
In this SQL statement, local subscriber is the target data object, and the subscriber in the remote data base is source data object, and data538 is the table space title; Yybcv is the remote data base contact names.This SQL statement is illustrated on the data538h table space by name of local data base through the database link of yybcv by name, and name is called the content of subscriber table in the duplicate remote database, and is created as the table of subscriber by name.
The method that the embodiment of the invention one provides can realize in the authority tolerance band exhausted most DML (Data Manipulation Language; DML) and the templating of DDL (Data Definition Language, database schema definitional language) statement support.
3, other parameter configuration process comprises:
Other parameter of configuration comprises source data object, target data object to task operating.
On the basis of configuration above-mentioned parameter, further configuration store resource, remote data base link resources and the isoparametric configuration of suspension of task condition.
Wherein:
Source data object, target data object can be realized the support to enumerated list and dynamic sql; Task particularly still comprises support in the target data object, so that can make target data object and source data object form correct corresponding relation when generating to self-defined reserved word TGTOBJ;
Storage resources (being table space) is used for providing to program and can selects the database resource that uses, with the success ratio of guaranteeing that task is carried out, makes the task executions influence that consumption is produced to the data base resource minimum.
The setting of suspension of task condition can be used to prevent that task from being hung or carry out the task performance period and set.
Two, generate the process of task list according to the task configured list:
As shown in Figure 3, generate the process of task list, mainly comprise the steps 301 to the described process of step 306:
In the preferred implementation of this step 301, the task configured list that obtains comprises task executive condition, source data object, the target data object of logical relation information between each task of representing through father and son's node relationships, task that each node is corresponding and the information of representing through self-defined reserved field such as SQL statement template.
In the preferred implementation of this step 303; For fully estimating the order that current task should be scanned; Program is carried out full table scan to the task allocation list, and the internodal relation of father and son is confirmed to be recycled the priority (scan priority) when extracting after each task gets into task list in the foundation table.According to logical relation information; Be the node generation scan priority information of each layer as the father node of lower level node; Wherein, the scan priority that is positioned at the corresponding same scan priority of the node of one deck and this node layer is higher than the priority as the lower level node of its child node.The embodiment of the invention one is described out the logical level of current task in whole task list through this mode, so that this task can be arrived by priority scan when scanning, the mode with respect to prior art relies on circulation to scan one by one merely reduces the scan round number of times.
In the preferred implementation of this step 305; Through parsing to parameter in source data object in the task configured list and the target data object; Confirm the concrete title of source data object and target data object, and the corresponding relation of source data object and target data object.For example, the source data object parameter comprises a plurality of data objects after resolving, and like tab1, tab2, tab3 etc., the destination object parameter forms corresponding with it object oriented through meeting after resolving, and can not cause confusion.Particularly; Parsing to parameter in source data object in the task configured list and the target data object; Comprise: source data is to as comprising the source data that can get access to after the carrying out SQL statement to the picture title in the parameter; And target data is to as can realizing the conversion of source data to the picture title through the key word SRCOBJ of definition before calling in the parameter, thereby obtains target data to the picture title.For example; Source data is to as there being a SQL in the parameter; Can obtain after the execution to be called: two tables of tab1 and tab2, and target to as in the parameter through to the calling of self defining keywords SRCOBJ, can source data be circulated the substitution target to carrying out in the statement as parameter to the conversion result as parameter; And obtain one to one target data to the picture title, like tab1_test and tab2_test.
The SQL statement template that this node of step 306, the source data object that will have corresponding relation and the substitution of target data object is corresponding generates SQL statement, and the SQL statement that this node is corresponding and task executive condition add task list as the task record of this node.
In above-mentioned steps 304 and the step 306, can distribute batch number for the task list that this task configured list generates, and be saved to task list together with the batch number that distributes., for making full use of server resource, reduce the process stand-by period here, the appointment process is according to the order of scan priority scan task progressively in the scheduling.If the task list that given batch number not, program acquiescence read up-to-date generation and be not performed the batch number that finishes is carried out.
So far, generate the flow process end of task list according to the task configured list that obtains.Among the above embodiment, preferably can be after the scan priority information of confirming each node layer, according to scan priority information and executing step 305, with the correctness that guarantees that corresponding relation is resolved.But in the practical application, in the above-mentioned flow process, step 303 and step 305 do not have strict priority execution sequence, can first execution in step 305 execution in step 303, perhaps these two step executed in parallel again; And step 304 and step 306 also can merge execution.
The above-mentioned process that generates task list according to the task configured list can get into task list and generate link after receive task that the user sends and generating order.This link is carried out by Automatic Program, need not manual intervention.
In the above-mentioned process according to task configured list generation task list; If the task configured list that step 301 is obtained also comprises storage resources information and remote data base link resources information that each node is corresponding; Then in the above-mentioned steps 306; Promptly behind the corresponding relation of confirming source data object and target data object, also further comprise the steps:
The source data object that has corresponding relation and target data object, the storage resources information of node correspondence and the SQL statement template of this node correspondence of remote data base link resources information substitution are generated SQL statement.
The embodiment of the invention one also provides a preferred implementation of the corresponding flow process of Fig. 1; In this preferred implementation; Before carrying out above-mentioned steps 105, promptly before the corresponding task of the father node of confirming present node is all by successful execution, also further carry out following steps:
From the node of corresponding current priority, obtain the task record of the task record of a node as present node;
Confirm that according to the task record of present node the corresponding task of present node is not carried out and task status is an original state.
Wherein, the task status of task comprises: do not carry out, wait for, detect, carry out, accomplish, end, artificially end etc., here, task status is that original state is not execution.Wherein:
Task status is not for carrying out, and after expression should generate this task, this task was carried out the original state of each task in the tabulation;
Task status is for detecting, the state when the expression process reads termination condition and executive condition and detects;
Task status is for waiting for, expression is not passed through the task executive condition detection of this task, and this task gets into waiting status;
Task status is represented the suspension of task condition of this task is detected the termination condition that meets for ending, and this task gets into abort state;
Task status is to carry out, and expression detects through (if there is the suspension of task condition, then also need detects the suspension of task condition and pass through) the task executive condition of this task, and this task gets into executing state;
Task status representes that for accomplishing this task runs succeeded, and gets into completion status;
Task status is artificial the termination, representes that this task by pseudoinstruction's termination, then gets into artificial abort state.
Further; If confirm that according to the task record of present node the corresponding task of said node is not carried out and task status is not original state; Then do not get into the implementation of step 105, and return the task record that from the node of corresponding current priority, obtains a node process as the task record of present node.
Execution through above-mentioned steps; On the corresponding process base of Fig. 1, further before execution in step 105, carry out above-mentioned steps, promptly confirm according to the task record of present node that the corresponding task of present node is not carried out and task status be original state after execution in step 105; Thereby avoid repetitive schedule to same node; For example, for being selected but owing to factors such as the task executive condition does not satisfy cause the selection that repeats of the unenforced node of this task, thereby improve task handling efficient.
The embodiment of the invention one also provides a preferred implementation of the corresponding flow process of Fig. 1; In this preferred implementation, if in the above-mentioned steps 105, the task that father node of definite present node is corresponding is all by successful execution; Then do not continue execution in step 106, and carry out following process:
The task status of the task that present node is corresponding is updated to wait;
After the corresponding task status of not executing the task of all nodes of confirming current priority was wait, this task status of not executing the task of initialization was an original state.
Through above-mentioned flow process, after this task status of not executing the task is original state in initialization, can dispatch this task of being in init state again, promptly return step 103.
The embodiment of the invention one also provides in the step 104 and step 105 of the corresponding flow process of Fig. 1, the preferred implementation of executing the task according to the corresponding task record of present node, i.e. task implementation.
Specifically as shown in Figure 4, this task implementation mainly comprises the steps:
Step 401, obtain present node for task record.
In this step 401, the task record of present node comprises task executive condition and the SQL statement that is used to indicate this task implementation.
Step 402, the task executive condition that comprises according to the corresponding task record of present node determine whether to satisfy the task executive condition, if, execution in step 403, if not, execution in step 404.
Step 403, the SQL statement that comprises according to the corresponding task record of present node are executed the task, and so far, the corresponding task of present node is carried out flow process finish.
The task status of step 404, task that present node is corresponding is updated to wait; And after confirming to satisfy the corresponding task executive condition of present node; SQL statement according to this present node is corresponding is executed the task, and so far, the corresponding task of present node is carried out flow process finish.
In the above-mentioned steps 402, the task executive condition is pre-configured, during concrete configuration, according to the demands of different of task, the various tasks executive condition can be set.For example, need in the statistics earlier table1, table2 to be directed at this locality, then according to table1; Table2 generates table3; Therefore the priority of table1, table2 generation is 1 grade in logic, and table3 is generated as 2 grades, also has other operation but be based on table1, table2; Such as creating index, creating of the same namely etc., logically also be 2 grades.Therefore, be 2 grades equally, carry out which task earlier and will confirm according to the task executive condition of setting, like this, can be for the task appointed task executive condition that generates table3: table1, table2 all generate.Do not generate like table1, table2, then carry out earlier generation table the establishment index, to create of the same name etc. be 2 grades task in logic.
In the above-mentioned steps 403, in the process that the SQL statement that comprises according to the corresponding task record of present node is executed the task, if task runs succeeded; Then task status is changed to " success ", is obstructed, then error message is recorded in the task status if carry out; Form daily record, supply the user to verify afterwards.
If in commission; Meet accident, need the execution of urgent aborting task tabulation, the user can carry out halt instruction; " artificial end " state of will specifying the task that is not performed of lot number (being defaulted as the task that all are not performed) all to be changed to is realized the termination that tabulation is carried out to each task.After treating conditions permit,, task control module is recovered the execution that continues of " the artificial termination " state task again through restore instruction.
According to above-described task layoutprocedure, when carrying out the task configuration for node, can also further dispose the suspension of task condition of this node, and the suspension of task condition is included in the task record of this node.In the case, before carrying out above-mentioned steps 402, further carry out following steps:
Suspension of task condition according to the corresponding task record of present node comprises is confirmed discontented this suspension of task condition.
Promptly when not satisfying the suspension of task condition, carry out above-mentioned steps 402 and subsequent step.
When confirming to satisfy the suspension of task condition, then end to carry out this task as if the suspension of task condition that comprises according to the corresponding task record of present node.
In the above-mentioned flow process, the suspension of task condition is pre-configured, and the main effect that configuration task is ended condition comprises two aspects: the one, and the task that prevents was waited for by indefinite duration.During the task fixation; Through the accurate task executions order of setting SQL inspect statement, but task can not handled waiting status and consumes resources always when the task executive condition does not possess, and can in task terminates bar part, the setting task carry out the time limit for this reason; If surpass this time limit, then this task is promptly ended; The 2nd, can be used for setting flexibly the task executions cycle; For example; Certain task specifies in setting-up time (as every month No. 1) and just is allowed to carry out; Can pass through statement " select 1 from dual where to_char (sysdate, ' DD ') <>' 01 ' " and be limited to that this task is not performed in other dates.
The technique scheme that provides according to the embodiment of the invention one; In practical application; Can be through the various logic relational structure between ORACLE tables of data logger task corresponding SQL statement template, storage resources parameter and task etc.; And the execution sequence that dynamically sets the tasks in view of the above, generate in batches task list and supply that executive process is concurrent to read execution.Can realize flexible management and control (comprising functions such as increasing degree of parallelism, process start and stop, the execution that continues) through instruction in the implementation, as much as possible promote task executions efficient under by the prerequisite of correct order successful execution at support mission to executive process.
And; Based on the Oracle tables of data; Confirm scan priority and the definition of task executive condition, suspension of task condition is realized the judgement to scanning sequency and execution sequence through father node, reach the record of complex logic relation between statistics task and accurately understand.
Task scheduling mechanism based on many detection means designs such as the task executive condition of the father node execution status of task of present node, present node, suspension of task condition, current task states; Keep relatively independent when guaranteeing that concurrent process can be executed the task by correct order, as much as possible reduce the stand-by period between concurrent process and cause resource waste thus.As the deep application of this task scheduling mechanism, functions such as the executory breakpoint of task continues, start and stop arbitrarily, the increase of concurrent process quantity are achieved simultaneously, have strengthened the human intervention means in the task implementation.
Parameters such as source data object, target data object, storage resources, database link in DDL and the DML statement are summarized extraction; And it is alternative with self-defined reserved word; Realization is simplified and the templating support the task perform statement; When carrying out, come dynamically to confirm complete task statement through analytical calculation again to each parameter; The workload and the complexity in i.e. simplification task when customization, the reliability that raising task again runs succeeded, also avoided because of task carry out cause to system resource take unbalanced.
Embodiment two
The embodiment of the invention two provides a kind of Task Processing Unit; This Task Processing Unit can be applicable to the processing of multiple-task logical relation; The The Logic of Tasks relation and the cancellated The Logic of Tasks relation that are particularly useful for tree construction; And, the task execution sequence of regulation when the implementation of this method does not rely on the task configuration.
Task Processing Unit as shown in Figure 5, that this embodiment two provides mainly comprises:
Task list generation unit 501, task list acquiring unit 502 and task processing unit 503;
Wherein:
Task list generation unit 501, the task list that is used for generating in advance;
Task list acquiring unit 502; Be used to obtain the task list that task list generation unit 501 generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in this task list and be the scan priority information of each layer as the node generation of the father node of lower level node;
As shown in Figure 6, in the preferred implementation that the embodiment of the invention two provides, the task list generation unit 501 that comprises in the Task Processing Unit shown in Figure 5 can further include:
Task configured list acquisition module 501A, scan priority generation module 501B, SQL statement generation module 501C and task list logging modle 501D;
Wherein:
Task configured list acquisition module 501A; Be used to obtain the task configured list, said task configured list comprises task executive condition, source data object, the target data object of logical relation information between each task of representing through father and son's node relationships, task that each node is corresponding and the SQL statement template of representing through self-defined reserved field;
Scan priority generation module 501B; Be used for the logical relation information that comprises according to the task configured list that task configured list acquisition module 501A obtains; Be the node generation scan priority information of each layer as the father node of lower level node; Wherein, the scan priority that is positioned at the corresponding same scan priority of the node of one deck and this node layer is higher than the priority as the lower level node of its child node;
SQL statement generation module 501C; Corresponding source data object and the target data object of node that is used for comprising through the task configured list that task configured list acquisition module 501A is obtained resolved the corresponding relation of confirming said source data object and target data object, and will exist the source data object of corresponding relation and the corresponding SQL statement template of the said node of target data object substitution to generate SQL statement;
Task list logging modle 501D; The logical relation information that scan priority information that is used for scan priority generation module 501B is generated and task configured list comprise adds task list, and the task executive condition that comprises in corresponding SQL statement of the node that SQL statement generation module 501C is generated and the task configured list adds task list as the task record of said node.
In the preferred implementation that the embodiment of the invention two provides, the SQL statement generation module 501C that Task Processing Unit shown in Figure 6 comprises specifically is used for:
Source data object that has corresponding relation and corresponding the comprising of the said node of target data object substitution are used to represent the self-defined reserved field of source data object and are used to represent that the SQL statement template of the self-defined reserved field of target data object generates SQL statement.
In the preferred implementation that the embodiment of the invention two provides, the SQL statement generation module 501C that Task Processing Unit shown in Figure 6 comprises specifically is used for:
Also comprise storage resources information and the remote data base link resources information that each node is corresponding at said task configured list; And said SQL statement template also comprises when being used to represent the self-defined reserved field of storage resources and being used to represent the self-defined reserved field of remote data base link resources; Behind the corresponding relation of confirming said source data object and target data object, the source data object that has corresponding relation and target data object, the storage resources information of said node correspondence and the SQL statement template of the said node correspondence of remote data base link resources information substitution are generated SQL statement.
In the preferred implementation that the embodiment of the invention two provides, the task processing unit 503 that Task Processing Unit shown in Figure 5 comprises specifically is used for:
Before the corresponding task of the father node of confirming present node is all by successful execution, from the node of corresponding current priority, obtain the task record of the task record of a node as present node; And confirm that according to the task record of said present node the corresponding task of said present node is not carried out and task status is an original state.
In the preferred implementation that the embodiment of the invention two provides, the task processing unit 503 that Task Processing Unit shown in Figure 5 comprises also is used for:
During all by successful execution, the task status of the task that said present node is corresponding is updated to wait in the corresponding task of the father node of not confirming present node; And after the corresponding task status of not executing the task of all nodes of confirming current priority was wait, the said task status of not executing the task of initialization was an original state.
In the preferred implementation that the embodiment of the invention two provides, the task processing unit 503 that Task Processing Unit shown in Figure 5 comprises specifically is used for:
If the present node of corresponding current priority is a root node, when the task executive condition that comprises according to the corresponding task record of present node confirms to satisfy said task executive condition, execute the task according to the SQL statement that the corresponding task record of present node comprises;
If the present node of corresponding current priority is not a root node; When the corresponding task of the father node of confirming present node all confirms to satisfy said task executive condition by successful execution and according to the task executive condition that the corresponding task record of present node comprises, execute the task according to the SQL statement that the corresponding task record of present node comprises.
In the preferred implementation that the embodiment of the invention two provides, the task processing unit 503 that Task Processing Unit shown in Figure 5 comprises also is used for:
When the task executive condition that comprises according to the corresponding task record of present node confirms not satisfy said task executive condition; The task status of the task that present node is corresponding is updated to wait; And after confirming to satisfy the corresponding task executive condition of said present node, execute the task according to the SQL statement that said present node is corresponding.
In the preferred implementation that the embodiment of the invention two provides, the task processing unit 503 that Task Processing Unit shown in Figure 5 comprises also is used for:
When the task record of node also comprises the suspension of task condition; Before the task executive condition that comprises according to the corresponding task record of present node confirms to satisfy said task executive condition, confirm not satisfy said suspension of task condition according to the suspension of task condition that the corresponding task record of present node comprises.
In the preferred implementation that the embodiment of the invention two provides, the task processing unit 503 that Task Processing Unit shown in Figure 5 comprises also is used for:
When the suspension of task condition that comprises according to the corresponding task record of present node confirms to satisfy said suspension of task condition, end to carry out said task.
Should be appreciated that the unit that above Task Processing Unit comprises is merely the logical partitioning of carrying out according to the function of this device realization, in the practical application, can carry out the stack or the fractionation of said units.And the function that the Task Processing Unit that this embodiment two provides is realized is corresponding one by one with the task processing method flow process that the foregoing description one provides; The more detailed treatment scheme that realizes for this device; In the foregoing description one, done detailed description, be not described in detail here.
Above-mentioned at least one technical scheme that provides through the embodiment of the invention; When task is handled; At first obtain the task list that generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in this task list and be the scan priority information of each layer as the node generation of the father node of lower level node; Then according to scan priority information; To each node of corresponding each priority, respectively task is handled, that is: if the present node of corresponding current priority is a root node; Then execute the task according to the corresponding task record of present node; If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.According to this technical scheme, the logical relation between each task that can represent through father and son's node relationships with respect to prior art, can be suitable for more The Logic of Tasks relational structure better, for example, and tree-shaped logical relation result, netted logical relation structure etc.; And with respect to prior art; Need not pre-configured task execution sequence; The task execution sequence of regulation when task executions does not rely on the task configuration; And according to confirming dynamically as scan priority information and task record that the node of the father node of lower level node generates whether the task of present node is carried out, thereby improved the task processing more flexible for each layer.
The Task Processing Unit that task processing method that provides according to the embodiment of the invention one and embodiment two provide; Obtaining on the basis of above technique effect; More concrete technological means according to the embodiment of the invention is taked can also further obtain following technique effect:
Compared with prior art, because prior art is the execution sequence of the strictness that defines in advance, on the process concurrent scheduling, can reduce the efficient of concurrent execution because of the strictness restriction of order; Form a plurality of processes consuming time and one process situation very nearly the same of executing the task of executing the task; And the technical scheme that the embodiment of the invention provides, the task execution sequence of regulation when disposing owing to the task that do not rely on, therefore; Can be through the parallel processing mode, to improve the efficient that task is handled.
Compared with prior art; Carry out the task change in the daily servicing when (as increasing or deletion) because prior art fully based on the implementation of the The Logic of Tasks of nodes encoding relation and task execution sequence control task, makes, can exert an influence in proper order related task executions in logic; Cause because the coding of a task changes; Cause all inter-related task execution sequences to be affected, even can cause inter-related task to carry out failure, and the technical scheme that the embodiment of the invention provides; Because the task execution sequence of regulation when not relying on the task configuration; Therefore, avoided renewal and management process, improved the success ratio that task is carried out for the task execution sequence.
Compared with prior art,, and do not relate to support, comprise that SQL statement templating support reaches the support to dynamic sql statistics task configuration aspect because the content that prior art is set forth has only related to the processing to the ordering of SQL task.So-called templating is supported, and is meant the SQL task to same type, in the task custom tabular, adopts the form of template to explain, and will carry out SQL statement and need not all to list all; And the dynamic sql support is meant the support that the data object title that comprises in the statistics task is needed dynamically generate according to actual conditions the back execution.And according to the embodiment of the invention; Disposed the SQL statement template; Make the close SQL statement of many forms on template, become in full accord, therefore can the task that template is consistent add in the task configured list, then through definition and design to parameter as a task configuration record; Make executive process that this template is reduced into many SQL statements to be carried out and put into task execution tabulation, and need not in maintenance process, the task configured list to be added many task records one by one.
Compared with prior art, the embodiment of the invention also realizes accurate description and the deciphering to complex logic relation between statistics task, and the statistics task order of guaranteeing to rely on each other that foundation is correct when carrying out is by successful execution.The reliability of customized task successful execution is strengthened, safeguard that convenience is improved.Logical relation in the actual count environment between task often is not limited to tree structure; Also wrap cancellated logical relation; Promptly except that the corresponding a plurality of child node tasks of a father node task; The situation that also comprises the corresponding a plurality of father node tasks of a node task, this kind situation is explained itself with regard to out of true with tree structure, means ignoring many logical relations.And, note the testing conditions that all father node tasks are run succeeded through to the definition of task executive condition, just can make current task and a plurality of father's tasks be implemented in logic related.
Logic statement design can change execution sequence according to actual conditions.Task is performed process according to scanning sequency earlier and scans in task list; If but the task executive condition does not possess; Then can delay be handled, rather than be processed immediately, executive process can continue to detect other and not execute the task then; Discovery task executive condition meets execution, waits not execute the task all whether to be possessed the task executive condition now by not possessing from the original executive condition of new inspection again after scanned of task.This is adjusted task executions in proper order automatically, when guaranteeing the executive process high efficiency, can guarantee the reliability that task runs succeeded again.
Flexible design on the task scheduling; Disturb the design of means for manual work interface and condition are provided; Make the user can under the situation that has executive process, can increase the also number of rows of process as required; And, realize termination and start and stop to task in the task list through change to task status, strengthen the management and control ability that task is carried out.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, belong within the scope of claim of the present invention and equivalent technologies thereof if of the present invention these are revised with modification, then the present invention also is intended to comprise these changes and modification interior.
Claims (20)
1. a task processing method is characterized in that, comprising:
Obtain the task list that generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in the said task list and be the scan priority information of each layer as the node generation of the father node of lower level node;
According to said scan priority information,, carry out respectively to each node of corresponding each priority:
If the present node of corresponding current priority is a root node, then execute the task according to the corresponding task record of present node;
If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.
2. the method for claim 1 is characterized in that, generates the mode of task list in advance, comprising:
Obtain the task configured list, said task configured list comprises task executive condition, source data object, the target data object of logical relation information between each task of representing through father and son's node relationships, task that each node is corresponding and the SQL statement template of representing through self-defined reserved field;
According to said logical relation information; Be the node generation scan priority information of each layer as the father node of lower level node; Wherein, The scan priority that is positioned at the corresponding same scan priority of the node of one deck and this node layer is higher than the priority as the lower level node of its child node, and said logical relation information and said precedence information are added task list;
And
Through said node corresponding source data object and target data object are resolved the corresponding relation of confirming said source data object and target data object; And the corresponding SQL statement template of the said node of source data object and the substitution of target data object that will have corresponding relation generates SQL statement, and the SQL statement that said node is corresponding and task executive condition add task list as the task record of said node.
3. method as claimed in claim 2 is characterized in that, said SQL statement template comprises:
Be used to represent the self-defined reserved field of source data object and the self-defined reserved field that is used to represent the target data object.
4. method as claimed in claim 3 is characterized in that, said task configured list also comprises storage resources information and the remote data base link resources information that each node is corresponding; And said SQL statement template also comprises and is used to represent the self-defined reserved field of storage resources and the self-defined reserved field that is used to represent the remote data base link resources;
After confirming the corresponding relation of said source data object and target data object, also comprise:
The source data object that has corresponding relation and target data object, the storage resources information of said node correspondence and the SQL statement template of the said node correspondence of remote data base link resources information substitution are generated SQL statement.
5. the method for claim 1 is characterized in that, before the corresponding task of the father node of confirming present node is all by successful execution, also comprises:
From the node of corresponding current priority, obtain the task record of the task record of a node as present node;
Confirm that according to the task record of said present node the corresponding task of said present node is not carried out and task status is an original state.
6. the method for claim 1 is characterized in that, if do not confirm the corresponding task of the father node of present node all by successful execution, said method also comprises:
The task status of the task that said present node is corresponding is updated to wait;
After the corresponding task status of not executing the task of all nodes of confirming current priority was wait, the said task status of not executing the task of initialization was an original state.
7. the method for claim 1 is characterized in that, the task record of node comprises task executive condition and the SQL statement that is used to indicate this task implementation;
Said task record according to the present node correspondence is executed the task, and comprising:
When the task executive condition that comprises according to the corresponding task record of present node confirms to satisfy said task executive condition, execute the task according to the SQL statement that the corresponding task record of present node comprises.
8. method as claimed in claim 7 is characterized in that, when the task executive condition that comprises according to the corresponding task record of present node confirms not satisfy said task executive condition, also comprises:
The task status of the task that present node is corresponding is updated to wait, and after confirming to satisfy the corresponding task executive condition of said present node, executes the task according to the SQL statement that said present node is corresponding.
9. method as claimed in claim 7 is characterized in that the task record of node also comprises the suspension of task condition;
Before the task executive condition that comprises according to the corresponding task record of present node confirms to satisfy said task executive condition, also comprise:
Suspension of task condition according to the corresponding task record of present node comprises confirms not satisfy said suspension of task condition.
10. method as claimed in claim 9 is characterized in that, when the suspension of task condition that comprises according to the corresponding task record of present node confirms to satisfy said suspension of task condition, also comprises:
End to carry out said task.
11. a Task Processing Unit is characterized in that, comprising:
The task list generation unit, the task list that is used for generating in advance;
The task list acquiring unit; Be used to obtain the task list that said task list generation unit generates in advance, comprise the task record of the logical relation between each task of representing through father and son's node relationships, corresponding each node in the said task list and be the scan priority information of each layer as the node generation of the father node of lower level node;
Task processing unit is used for according to said scan priority information, to each node of corresponding each priority, carries out respectively: if the present node of corresponding current priority is a root node, then execute the task according to the corresponding task record of present node; If the present node of corresponding current priority be a root node, during all by successful execution, execute the task according to the task record of present node in the task of the father node correspondence of confirming present node.
12. device as claimed in claim 11 is characterized in that, said task list generation unit comprises:
Task configured list acquisition module; Be used to obtain the task configured list, said task configured list comprises task executive condition, source data object, the target data object of logical relation information between each task of representing through father and son's node relationships, task that each node is corresponding and the SQL statement template of representing through self-defined reserved field;
The scan priority generation module; Be used for according to said logical relation information; Be the node generation scan priority information of each layer as the father node of lower level node; Wherein, the scan priority that is positioned at the corresponding same scan priority of the node of one deck and this node layer is higher than the priority as the lower level node of its child node;
The SQL statement generation module; Be used for resolving the corresponding relation of confirming said source data object and target data object, and will exist the source data object of corresponding relation and the corresponding SQL statement template of the said node of target data object substitution to generate SQL statement through source data object and target data object to said node correspondence;
The task list logging modle; The logical relation information that scan priority information that is used for said scan priority generation module is generated and said task configured list comprise adds task list, and the task executive condition that comprises in corresponding SQL statement of the node that said SQL statement generation module is generated and the said task configured list adds task list as the task record of said node.
13. device as claimed in claim 12 is characterized in that, said SQL statement generation module specifically is used for:
Source data object that has corresponding relation and corresponding the comprising of the said node of target data object substitution are used to represent the self-defined reserved field of source data object and are used to represent that the SQL statement template of the self-defined reserved field of target data object generates SQL statement.
14. device as claimed in claim 13 is characterized in that, said SQL statement generation module specifically is used for:
Also comprise storage resources information and the remote data base link resources information that each node is corresponding at said task configured list; And said SQL statement template also comprises when being used to represent the self-defined reserved field of storage resources and being used to represent the self-defined reserved field of remote data base link resources; Behind the corresponding relation of confirming said source data object and target data object, the source data object that has corresponding relation and target data object, the storage resources information of said node correspondence and the SQL statement template of the said node correspondence of remote data base link resources information substitution are generated SQL statement.
15. device as claimed in claim 11 is characterized in that, said task processing unit specifically is used for:
Before the corresponding task of the father node of confirming present node is all by successful execution, from the node of corresponding current priority, obtain the task record of the task record of a node as present node; And confirm that according to the task record of said present node the corresponding task of said present node is not carried out and task status is an original state.
16. device as claimed in claim 11 is characterized in that, said task processing unit also is used for:
During all by successful execution, the task status of the task that said present node is corresponding is updated to wait in the corresponding task of the father node of not confirming present node; And after the corresponding task status of not executing the task of all nodes of confirming current priority was wait, the said task status of not executing the task of initialization was an original state.
17. device as claimed in claim 11 is characterized in that, said task processing unit specifically is used for:
If the present node of corresponding current priority is a root node, when the task executive condition that comprises according to the corresponding task record of present node confirms to satisfy said task executive condition, execute the task according to the SQL statement that the corresponding task record of present node comprises;
If the present node of corresponding current priority is not a root node; When the corresponding task of the father node of confirming present node all confirms to satisfy said task executive condition by successful execution and according to the task executive condition that the corresponding task record of present node comprises, execute the task according to the SQL statement that the corresponding task record of present node comprises.
18. device as claimed in claim 17 is characterized in that, said task processing unit also is used for:
When the task executive condition that comprises according to the corresponding task record of present node confirms not satisfy said task executive condition; The task status of the task that present node is corresponding is updated to wait; And after confirming to satisfy the corresponding task executive condition of said present node, execute the task according to the SQL statement that said present node is corresponding.
19. device as claimed in claim 17 is characterized in that, said task processing unit also is used for:
When the task record of node also comprises the suspension of task condition; Before the task executive condition that comprises according to the corresponding task record of present node confirms to satisfy said task executive condition, confirm not satisfy said suspension of task condition according to the suspension of task condition that the corresponding task record of present node comprises.
20. device as claimed in claim 19 is characterized in that, said task processing unit also is used for:
When the suspension of task condition that comprises according to the corresponding task record of present node confirms to satisfy said suspension of task condition, end to carry out said task.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010541352XA CN102467532A (en) | 2010-11-12 | 2010-11-12 | Task processing method and task processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010541352XA CN102467532A (en) | 2010-11-12 | 2010-11-12 | Task processing method and task processing device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102467532A true CN102467532A (en) | 2012-05-23 |
Family
ID=46071175
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010541352XA Pending CN102467532A (en) | 2010-11-12 | 2010-11-12 | Task processing method and task processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102467532A (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102880473A (en) * | 2012-09-28 | 2013-01-16 | 五八有限公司 | Method and device for task execution based on quartz framework |
| CN103019859A (en) * | 2012-12-05 | 2013-04-03 | 北京普泽天玑数据技术有限公司 | Method and system for calling service request |
| CN103530742A (en) * | 2013-10-28 | 2014-01-22 | 金蝶软件（中国）有限公司 | Method and device for increasing scheduling operation speed |
| CN104407848A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data processing method and device |
| CN104536814A (en) * | 2015-01-16 | 2015-04-22 | 北京京东尚科信息技术有限公司 | Method and system for processing workflow |
| CN104639461A (en) * | 2014-12-31 | 2015-05-20 | 北京华为数字技术有限公司 | Scheduling method, device and system for business data |
| CN107194608A (en) * | 2017-06-13 | 2017-09-22 | 复旦大学 | A kind of mass-rent towards disabled person community marks Task Assigned Policy |
| CN107291533A (en) * | 2016-03-31 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Determine method, the device of upstream node bottleneck degree and system bottleneck degree |
| CN107766381A (en) * | 2016-08-22 | 2018-03-06 | 北京京东尚科信息技术有限公司 | Data query method, system and electronic equipment |
| CN108595678A (en) * | 2018-05-02 | 2018-09-28 | 网易（杭州）网络有限公司 | Task data processing method and processing device, electronic equipment, storage medium |
| CN108762953A (en) * | 2018-05-25 | 2018-11-06 | 连云港杰瑞电子有限公司 | A kind of message queue implementation method |
| CN109240813A (en) * | 2018-08-21 | 2019-01-18 | 广东工业大学 | Task schedule and task immigration method in a kind of mobile cloud computing |
| CN109298940A (en) * | 2018-09-28 | 2019-02-01 | 考拉征信服务有限公司 | Calculation task allocating method, device, electronic equipment and computer storage medium |
| CN109739667A (en) * | 2019-01-10 | 2019-05-10 | 广州华多网络科技有限公司 | A kind of consuming method of message, device and equipment |
| CN109901926A (en) * | 2019-01-25 | 2019-06-18 | 平安科技（深圳）有限公司 | Method, server and storage medium based on big data behavior scheduling application task |
| CN110018891A (en) * | 2018-11-28 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of task management system, a kind of task management method and device |
| CN110502589A (en) * | 2019-08-20 | 2019-11-26 | 阿里巴巴集团控股有限公司 | A kind of node genetic connection determines method, apparatus and electronic equipment |
| CN110895484A (en) * | 2018-09-12 | 2020-03-20 | 北京奇虎科技有限公司 | Task scheduling method and device |
| CN111104144A (en) * | 2019-12-27 | 2020-05-05 | 珠海金山网络游戏科技有限公司 | Anchor point updating method and device |
| CN112559525A (en) * | 2020-12-15 | 2021-03-26 | 中国工商银行股份有限公司 | Data checking system, method, device and server |
| CN112817724A (en) * | 2021-02-05 | 2021-05-18 | 苏州互方得信息科技有限公司 | Task allocation method capable of dynamically arranging sequence |
| CN113626609A (en) * | 2021-08-10 | 2021-11-09 | 南方电网数字电网研究院有限公司 | Electric power measurement knowledge map construction method, device, equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1704936A (en) * | 2004-05-31 | 2005-12-07 | 深圳宇龙计算机通信科技（深圳）有限公司 | Data conversion or synchronization method between data bases |
| CN101477543A (en) * | 2008-01-03 | 2009-07-08 | 埃森哲环球服务有限公司 | System and method for automating ETL application |
-
2010
- 2010-11-12 CN CN201010541352XA patent/CN102467532A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1704936A (en) * | 2004-05-31 | 2005-12-07 | 深圳宇龙计算机通信科技（深圳）有限公司 | Data conversion or synchronization method between data bases |
| CN101477543A (en) * | 2008-01-03 | 2009-07-08 | 埃森哲环球服务有限公司 | System and method for automating ETL application |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102880473A (en) * | 2012-09-28 | 2013-01-16 | 五八有限公司 | Method and device for task execution based on quartz framework |
| CN103019859A (en) * | 2012-12-05 | 2013-04-03 | 北京普泽天玑数据技术有限公司 | Method and system for calling service request |
| CN103019859B (en) * | 2012-12-05 | 2018-02-16 | 北京普泽创智数据技术有限公司 | A kind of method and system to service request scheduling |
| CN103530742A (en) * | 2013-10-28 | 2014-01-22 | 金蝶软件（中国）有限公司 | Method and device for increasing scheduling operation speed |
| CN103530742B (en) * | 2013-10-28 | 2019-01-29 | 金蝶软件（中国）有限公司 | Improve the method and device of scheduling arithmetic speed |
| CN104407848A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data processing method and device |
| CN104407848B (en) * | 2014-10-29 | 2018-11-06 | 中国建设银行股份有限公司 | A kind of data processing method and device |
| CN104639461A (en) * | 2014-12-31 | 2015-05-20 | 北京华为数字技术有限公司 | Scheduling method, device and system for business data |
| CN104639461B (en) * | 2014-12-31 | 2018-04-27 | 北京华为数字技术有限公司 | A kind of dispatching method of business datum, apparatus and system |
| CN104536814A (en) * | 2015-01-16 | 2015-04-22 | 北京京东尚科信息技术有限公司 | Method and system for processing workflow |
| CN104536814B (en) * | 2015-01-16 | 2019-01-22 | 北京京东尚科信息技术有限公司 | A kind of method and system handling workflow |
| CN107291533A (en) * | 2016-03-31 | 2017-10-24 | 阿里巴巴集团控股有限公司 | Determine method, the device of upstream node bottleneck degree and system bottleneck degree |
| CN107291533B (en) * | 2016-03-31 | 2020-10-30 | 阿里巴巴集团控股有限公司 | Method and device for determining upstream node bottleneck degree and system bottleneck degree |
| CN107766381A (en) * | 2016-08-22 | 2018-03-06 | 北京京东尚科信息技术有限公司 | Data query method, system and electronic equipment |
| CN107194608B (en) * | 2017-06-13 | 2021-09-17 | 复旦大学 | Crowd-sourcing labeling task allocation method for disabled person community |
| CN107194608A (en) * | 2017-06-13 | 2017-09-22 | 复旦大学 | A kind of mass-rent towards disabled person community marks Task Assigned Policy |
| CN108595678A (en) * | 2018-05-02 | 2018-09-28 | 网易（杭州）网络有限公司 | Task data processing method and processing device, electronic equipment, storage medium |
| CN108762953A (en) * | 2018-05-25 | 2018-11-06 | 连云港杰瑞电子有限公司 | A kind of message queue implementation method |
| CN108762953B (en) * | 2018-05-25 | 2022-03-15 | 连云港杰瑞电子有限公司 | Message queue realizing method |
| CN109240813B (en) * | 2018-08-21 | 2021-12-24 | 广东工业大学 | Task scheduling and task migration method in mobile cloud computing |
| CN109240813A (en) * | 2018-08-21 | 2019-01-18 | 广东工业大学 | Task schedule and task immigration method in a kind of mobile cloud computing |
| CN110895484A (en) * | 2018-09-12 | 2020-03-20 | 北京奇虎科技有限公司 | Task scheduling method and device |
| CN109298940A (en) * | 2018-09-28 | 2019-02-01 | 考拉征信服务有限公司 | Calculation task allocating method, device, electronic equipment and computer storage medium |
| CN110018891A (en) * | 2018-11-28 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of task management system, a kind of task management method and device |
| CN110018891B (en) * | 2018-11-28 | 2023-11-21 | 创新先进技术有限公司 | Task management system, task management method and device |
| CN109739667A (en) * | 2019-01-10 | 2019-05-10 | 广州华多网络科技有限公司 | A kind of consuming method of message, device and equipment |
| CN109901926A (en) * | 2019-01-25 | 2019-06-18 | 平安科技（深圳）有限公司 | Method, server and storage medium based on big data behavior scheduling application task |
| CN110502589A (en) * | 2019-08-20 | 2019-11-26 | 阿里巴巴集团控股有限公司 | A kind of node genetic connection determines method, apparatus and electronic equipment |
| CN110502589B (en) * | 2019-08-20 | 2023-12-01 | 创新先进技术有限公司 | Node blood-edge relationship determination method and device and electronic equipment |
| CN111104144A (en) * | 2019-12-27 | 2020-05-05 | 珠海金山网络游戏科技有限公司 | Anchor point updating method and device |
| CN111104144B (en) * | 2019-12-27 | 2023-10-20 | 珠海金山数字网络科技有限公司 | Anchor point updating method and device |
| CN112559525A (en) * | 2020-12-15 | 2021-03-26 | 中国工商银行股份有限公司 | Data checking system, method, device and server |
| CN112559525B (en) * | 2020-12-15 | 2024-02-27 | 中国工商银行股份有限公司 | Data checking system, method, device and server |
| CN112817724A (en) * | 2021-02-05 | 2021-05-18 | 苏州互方得信息科技有限公司 | Task allocation method capable of dynamically arranging sequence |
| CN113626609A (en) * | 2021-08-10 | 2021-11-09 | 南方电网数字电网研究院有限公司 | Electric power measurement knowledge map construction method, device, equipment and storage medium |
| CN113626609B (en) * | 2021-08-10 | 2024-03-26 | 南方电网数字电网研究院有限公司 | Electric power metering knowledge graph construction method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102467532A (en) | Task processing method and task processing device | |
| CN109684053B (en) | Task scheduling method and system for big data | |
| CN102508919B (en) | Data processing method and system | |
| US10102039B2 (en) | Converting a hybrid flow | |
| CN105719126B (en) | system and method for scheduling Internet big data tasks based on life cycle model | |
| CN104572122A (en) | Software application data generating device and method | |
| CN106104533A (en) | Process the data set in large data storage vault | |
| CN111125444A (en) | Big data task scheduling management method, device, equipment and storage medium | |
| CN103441900A (en) | Centralization cross-platform automated testing system and control method thereof | |
| CN105354239A (en) | Configuration data processing model based processing center data stream processing method | |
| CN109635024A (en) | A kind of data migration method and system | |
| CN109408493A (en) | A kind of moving method and system of data source | |
| CN112148788A (en) | Data synchronization method and system for heterogeneous data source | |
| CN115374102A (en) | Data processing method and system | |
| CN109298868A (en) | Intelligent dynamic deployment and unloading method for mapping image data processing software | |
| CN107103064A (en) | Data statistical approach and device | |
| CN111475564A (en) | Streaming data processing method, system, computer equipment and storage medium | |
| CN109299180A (en) | A kind of data warehouse ETL operating system | |
| CN114741375A (en) | Rapid and automatic data migration system and method for multi-source heterogeneous database | |
| CN110619014A (en) | ETL-based data extraction method | |
| CN112163017B (en) | Knowledge mining system and method | |
| CN112365157A (en) | Intelligent dispatching method, device, equipment and storage medium | |
| Fernando et al. | Hybrid framework for master data management | |
| CN107423035B (en) | Product data management system in software development process | |
| CN105630997A (en) | Data parallel processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120523 |