CN104731663A - Task processing method and system - Google Patents
Task processing method and system Download PDFInfo
- Publication number
- CN104731663A CN104731663A CN201510150111.5A CN201510150111A CN104731663A CN 104731663 A CN104731663 A CN 104731663A CN 201510150111 A CN201510150111 A CN 201510150111A CN 104731663 A CN104731663 A CN 104731663A
- Authority
- CN
- China
- Prior art keywords
- task
- subtask
- node
- task processing
- processing node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Multi Processors (AREA)
Abstract
The embodiment of the invention provides a task processing method and system. A task to be processed is dismantled into multiple sub tasks, the sub tasks are distributed to task processing nodes, after the task processing nodes receive the sub tasks, whether the number of the sub tasks which are processed currently is not lower than a preset number threshold value is determined, if the number of the sub tasks which are processed currently is not lower than the preset number threshold value, processing rejection information to the sub tasks is fed back to task allocation nodes, and after the task allocation nodes receive the processing rejection information, the sub tasks are allocated to the task processing nodes which do not feed back processing rejection information to the sub tasks. In this way, when the sub tasks allocated to a certain task processing node are many, the task processing node can reject processing of subsequent allocated sub tasks, the task allocation nodes allocate the sub tasks rejected by the task processing node to other task processing nodes, balance of the number of the sub tasks of the task processing nodes is achieved, the situation that the operation speed of the task processing nodes is reduced due to the fact that the sub tasks are too many is avoided, and the situation that resources are wasted due to the fact that the sub tasks are too few is also avoided.
Description
Technical field
The present invention relates to task processing technology field, particularly relate to task processing method and system.
Background technology
Along with the development of science and technology, the processing power of electronic equipment is more and more higher, and accordingly, electronic equipment task to be dealt with also becomes increasingly complex.By a complicated task is split as multiple subtask, and subtask is assigned to the enterprising row relax of multiple task processing nodes, the processing speed of task can be improved.
Detailed process after electronic equipment receives task is at every turn:
First the task of complexity is split as multiple subtask;
Then each subtask is assigned randomly to the enterprising row relax of multiple task processing nodes.
Inventor studies discovery: when the task that electronic equipment receives is more, just need to carry out task fractionation and distribution frequently.Because the subtask distributed is more, therefore easily occur that a part of task processing node needs subtask to be processed more, and the situation that other a part of task processing node needs subtask to be processed less.When needing subtask to be processed more, by causing, the load of task processing node is higher, and then affects the travelling speed of task processing node, even causes the machine of delaying of task processing node.And when needing subtask to be processed less, idle condition will be in after task processing node processes subtask, waste resource.
Summary of the invention
The object of the embodiment of the present invention is to provide a kind of task processing method and system, and the task processing node travelling speed too much caused to avoid sub-tasks reduces and the very few wasting of resources caused of sub-tasks.
For achieving the above object, the embodiment of the invention discloses a kind of task processing method, being applied to task allocation node, described task allocation node is connected with multiple task processing node, and described method comprises:
Obtain waiting task, described waiting task is split as multiple subtask;
To each subtask, be all handled as follows:
This subtask is assigned to a described task processing node;
The notification message that the task processing node that reception has been assigned with this subtask feeds back for this subtask;
If described notification message is the refusal processing messages to this subtask, then this subtask is assigned to the task processing node of the refusal processing messages do not fed back this subtask, the step of the notification message that the task processing node that the described reception of continuation execution has been assigned with this subtask feeds back for this subtask, wherein, described refusal processing messages is that task processing node feeds back to described task allocation node when the quantity determining that it works as the subtask of pre-treatment is not less than predetermined number threshold value.
Optionally, also comprise:
When described notification message is the agreement processing messages to this subtask, obtain the process progress msg that described task processing node sends;
After the abnormal notice of the process receiving the transmission of described task processing node, according to the process progress msg sending the abnormal task processing node notified of this process, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed, wherein, the abnormal notice of described process is task processing node determining that the speed of its process subtask sends lower than during pre-set velocity threshold value.
Optionally, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server, described acquisition waiting task, comprising: obtain the waiting task that described task interface module receives.
Optionally, described described waiting task is split as multiple subtask, comprises:
According to the granularity threshold value of the subtask of presetting, calculate the reference position of each subtask in described waiting task and the final position of each subtask;
To each subtask: the subtask object reference position of the task identification of described waiting task, this subtask, the final position of this subtask and waiting task parameter information being encapsulated as this subtask;
Describedly this subtask is assigned to a described task processing node, comprises: the subtask object of this subtask is assigned to a described task processing node.
A kind of task processing method, be applied to task processing node, described task processing node is connected with task allocation node, and described method comprises:
Obtain the subtask that described task allocation node distributes, wherein, this subtask is that described task allocation node obtains after splitting waiting task;
Determine whether the quantity of this task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, if, then to the refusal processing messages of described task allocation node feedback to this subtask, with the task processing node making described task allocation node this subtask is assigned to the refusal processing messages do not fed back this subtask.
Optionally, also comprise:
Determining that this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, to the agreement processing messages of described task allocation node feedback to this subtask;
Obtain the process progress msg of this task processing node Processing tasks;
Described process progress msg is sent to described task allocation node, determine that whether the speed of this task processing node process subtask is lower than pre-set velocity threshold value, if, then to the abnormal notice of described task allocation node transmission processing, to make described task allocation node after receiving the abnormal notice of described process, according to the process progress msg that this task processing node sends, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed.
Optionally, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server.
A kind of task processing system, be applied to task allocation node, described task allocation node is connected with multiple task processing node, and described system comprises: task split cells, first allocation units, notify receiving element and allocation units again,
Described task split cells, for obtaining waiting task, is split as multiple subtask by described waiting task;
Described allocation units first, for each subtask, are assigned to a described task processing node by this subtask;
Described notice receiving element, for receiving the notification message that the task processing node that has been assigned with this subtask feeds back for this subtask, if described notification message is the refusal processing messages to this subtask, then allocation units again described in triggering; Wherein, described refusal processing messages is task processing node feeds back to described task allocation node described notice receiving element when the quantity determining that it works as the subtask of pre-treatment is not less than predetermined number threshold value;
Described allocation units again, for this subtask being assigned to the task processing node of the refusal processing messages do not fed back this subtask, trigger described notice receiving element.
Optionally, also comprise: progress obtains unit and task transfers unit,
Described progress obtains unit, for being the agreement processing messages to this subtask at described notification message, obtains the process progress msg that described task processing node sends;
Described task transfers unit, for after the abnormal notice of the process receiving the transmission of described task processing node, according to the process progress msg sending the abnormal task processing node notified of this process, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed, wherein, the abnormal notice of described process is task processing node determining that the speed of its process subtask sends lower than during pre-set velocity threshold value.
Optionally, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, each task processing node is only arranged in a server, described task split cells specifically for: obtain described task interface module receive waiting task, described waiting task is split as multiple subtask.
Optionally, described task split cells, comprising: task obtains subelement, position calculation subelement and task encapsulation subelement,
Described task obtains subelement, for obtaining waiting task;
Described position calculation subelement, for the granularity threshold value according to the subtask of presetting, calculates the reference position of each subtask in described waiting task and the final position of each subtask;
Described task encapsulation subelement, for each subtask: the subtask object reference position of the task identification of described waiting task, this subtask, the final position of this subtask and waiting task parameter information being encapsulated as this subtask;
Described allocation units first, specifically for: to each subtask, the subtask object of this subtask is assigned to a described task processing node.
A kind of task processing system, be applied to task processing node, described task processing node is connected with task allocation node, and described system comprises: subtask obtains module, quantity determination module and message feedback module,
Described subtask obtains module, and for obtaining the subtask that described task allocation node distributes, wherein, this subtask is that described task allocation node obtains after splitting waiting task;
Described quantity determination module, for determining whether the quantity of this task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, if so, then triggers described message feedback module;
Described message feedback module, for the refusal processing messages of described task allocation node feedback to this subtask, with the task processing node making described task allocation node this subtask is assigned to the refusal processing messages do not fed back this subtask.
Optionally, also comprise: acceptance message feedback module, progress obtain module, progress sending module, speed determination module and notice sending module,
Described acceptance message feedback module, for determining that at described quantity determination module this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, to the agreement processing messages of described task allocation node feedback to this subtask;
Described progress obtains module, for obtaining the process progress msg of this task processing node Processing tasks;
Described progress sending module, for being sent to described task allocation node by described process progress msg;
Described speed determination module, for determining that whether the speed of this task processing node process subtask is lower than pre-set velocity threshold value, if so, then triggers described notice sending module;
Described notice sending module, for notifying to described task allocation node transmission processing is abnormal, to make described task allocation node after receiving the abnormal notice of described process, according to the process progress msg that this task processing node sends, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed.
Optionally, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server.
The task processing method that the embodiment of the present invention provides and system, task processing node can determine after receiving subtask whether its quantity working as the subtask of pre-treatment is not less than predetermined number threshold value, if, then feed back to task allocation node by the refusal processing messages of this subtask, after task allocation node receives this refusal processing messages, this subtask is assigned to the task processing node of the refusal processing messages do not fed back this subtask.Like this, when the subtask distributing to a certain task processing node is more, this task processing node will refuse the subtask processing subsequent allocations, and then other task processing nodes are distributed in the subtask that task allocation node is refused, thus achieve the equilibrium of task processing node subtask quantity, both avoided because subtask too much causes the travelling speed of task processing node to reduce, turn avoid the waste causing resource because subtask is very few.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
The process flow diagram of a kind of task processing method that Fig. 1 provides for the embodiment of the present invention;
The process flow diagram of the another kind of task processing method that Fig. 2 provides for the embodiment of the present invention;
The process flow diagram of the another kind of task processing method that Fig. 3 provides for the embodiment of the present invention;
The process flow diagram of the another kind of task processing method that Fig. 4 provides for the embodiment of the present invention;
The structural representation of a kind of task processing system that Fig. 5 provides for the embodiment of the present invention;
The structural representation of the another kind of task processing system that Fig. 6 provides for the embodiment of the present invention;
The structural representation of the another kind of task processing system that Fig. 7 provides for the embodiment of the present invention;
The structural representation of the another kind of task processing system that Fig. 8 provides for the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
As shown in Figure 1, a kind of task processing method that the embodiment of the present invention provides, is applied to task allocation node, and described task allocation node is connected with multiple task processing node, and the method can comprise:
S100, acquisition waiting task, be split as multiple subtask by described waiting task;
Wherein, task allocation node can also with task interface model calling, described multiple task processing node is arranged in multiple server, each task processing node is only arranged in a server, S100 obtains waiting task, can comprise: obtain the waiting task that described task interface module receives.
Concrete, task allocation node, task interface module and task processing node are the ingredient of task processing system, and task processing system can be communicated with external unit by task interface module.Like this, although task processing system comprises multiple different equipment, owing to providing external unified interface, therefore can avoid code redundancy and too be coupled.Certainly, database can also be included in task processing system, with the various data in store tasks processing procedure.
Meanwhile, because multiple task processing node is arranged in multiple server, therefore task allocation node can call the task processing node Processing tasks in each server, thus achieves distributed deployment.Wherein, task allocation node, communication mechanism between task interface module and task processing node can adopt remote procedure call protocol to coordinate distributed application program coordination service zookeeper to realize.
Optionally, waiting task of the present invention can be message push task, as iOS overall situation propelling movement task, batch client push task.Task interface module can also be connected with client device, and collects the client identification for Push Service that client device uploads, such as: the client on the operating system iOS of apple equipment needs the token information uploading apple Push Service.Client on Android system need upload the user id that its Push Service used is distributed.The message push task that task processing system can be initiated by task interface module receiving system called side.The mode that task is passed to task allocation node by task interface module can have multiple, such as, directly transmit or pass through database indirect transfer.
Concrete, the process that described waiting task is split as multiple subtask by S100 can comprise:
According to the granularity threshold value of the subtask of presetting, calculate the reference position of each subtask in described waiting task and the final position of each subtask;
To each subtask: the subtask object reference position of the task identification of described waiting task, this subtask, the final position of this subtask and waiting task parameter information being encapsulated as this subtask.
Wherein, waiting task parameter information is the parameter information of task processing node required relevant non-process scope in task processes, these parameters all come from waiting task, when waiting task is message push task, waiting task parameter information can comprise: message displaying method, message redirect mode etc.
Wherein, task splits node after fractionation obtains multiple subtask, can edit and upgrade the state of each subtask in a database, as unallocated, process in, processed armed state, also the information of the task processing node of each subtask with update process can be edited in a database, such as, when the information of the task processing node of this subtask of pre-treatment.Certainly, task splits the information that node can obtain each task processing node in task processing system, as address information, when the number information of pre-treatment subtask, the number information etc. of task processing node.After the information of task processing node changes, task splits this information also corresponding renewal that node obtains.
To each subtask, all carry out the process of following steps S200 to S400:
S200, this subtask is assigned to a described task processing node;
Wherein, S200 can comprise: the subtask object of this subtask is assigned to a described task processing node.
Concrete, can be chosen by poll, foundation weight is chosen etc. is chosen mode from multiple task processing node, is chosen the task processing node distributing this subtask.
After subtask object is assigned to task processing node, task processing node just can process subtask according to the information in the object of subtask.
Concrete, subtask type in the object of foundation subtask and the range of transmission of subtask are from the corresponding facility information of data base querying, and select corresponding Push Service, the client device of such as iOS system selects Apple's Push Service, and Android device selects Android Push Service.Task processing node pushes in the process of task periodically can push progress, after processing the subtask of distribution, to task allocation node transmission processing completion notice to task allocation node feedback message in processing messages.
The notification message that the task processing node that S300, reception have been assigned with this subtask feeds back for this subtask;
If the described notification message of S400 is the refusal processing messages to this subtask, then this subtask is assigned to the task processing node of the refusal processing messages do not fed back this subtask, continue to perform step S300, wherein, described refusal processing messages is that task processing node feeds back to described task allocation node when the quantity determining that it works as the subtask of pre-treatment is not less than predetermined number threshold value.
Be understandable that, after subtask is assigned to task processing node by task allocation node, if the quantity of task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, task processing node will send refusal processing messages to task allocation node.After task allocation node receives this refusal processing messages, the subtask distributing to this task processing node is distributed to the task processing node of the refusal processing messages do not fed back this subtask.Like this, ensure that on the one hand task processing node when the quantity of the subtask of pre-treatment can not be too many, on the other hand by the sub-distribution again of subtask, also ensure that this subtask can be performed in time.
A kind of task processing method that the embodiment of the present invention provides, achieve the equilibrium of the subtask quantity of task processing node process, both avoided because subtask too much causes the travelling speed of task processing node to reduce, turn avoid the waste causing resource because subtask is very few.
As shown in Figure 2, the another kind of task processing method that the embodiment of the present invention provides, can also comprise:
S500, when described notification message is the agreement processing messages to this subtask, obtain described task processing node send process progress msg;
Wherein, processing progress msg can be processed complete subtask quantity and subtask mark, untreated complete subtask quantity and subtask mark or the mark of the current subtask just processed.
S600, after receiving the abnormal notice of process that described task processing node sends, according to the process progress msg sending the abnormal task processing node notified of this process, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed, wherein, the abnormal notice of described process is task processing node determining that the speed of its process subtask sends lower than during pre-set velocity threshold value.
Concrete, behind the untreated subtask of task processing node redistributing the abnormal notice of transmission processing, the record of the subtask of process can also be responsible for according to the task processing node in the subtask distribution condition after redistributing subtask more new database.
Be understandable that, due to task processing node numerous and distribution on a different server, therefore when certain server occurs that the machine of delaying or network interruption or the operation of task processing node are made mistakes, the whole subtasks making corresponding task processing node processes are suspended to perform and maybe cannot perform, and then cause the execution of whole waiting task slowly even to perform failure.
Other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node, lower than the abnormal notice of the process sent during pre-set velocity threshold value, process by the speed of task processing node in process subtask that can obtain embodiment illustrated in fig. 2 after this notice of acquisition.Like this, just ensure that the task processing node gone wrong is responsible for the timely execution of the subtask processed, and then also ensure that the timely execution of waiting task.
When due to the quantity of subtask of process more and cause the speed of task processing node process subtask slower time, the parton task matching being responsible for by this task processing node processing can improve the speed of its process subtask to other task processing nodes.
As shown in Figure 3, the embodiment of the present invention additionally provides another kind of task processing method, is applied to task processing node, and described task processing node is connected with task allocation node, and the method can comprise:
S001, obtain described task allocation node distribute subtask, wherein, this subtask is that described task allocation node obtains after splitting waiting task;
Wherein, task allocation node can also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server.
Concrete, task allocation node, task interface module and task processing node are the ingredient of task processing system, and task processing system can be communicated with external unit by task interface module.Like this, although task processing system comprises multiple different equipment, owing to providing external unified interface, therefore can avoid code redundancy and too be coupled.Certainly, database can also be included in task processing system, with the various data in store tasks processing procedure.
Meanwhile, because multiple task processing node is arranged in multiple server, therefore task allocation node can call the task processing node Processing tasks in each server, thus achieves distributed deployment.Wherein, task allocation node, communication mechanism between task interface module and task processing node can adopt remote procedure call protocol to coordinate distributed application program coordination service zookeeper to realize.
Optionally, waiting task of the present invention is message push task, as iOS overall situation propelling movement task, batch client push task.Task interface module can also be connected with client device, and collects the client identification for Push Service that client device uploads, such as: the client on the operating system iOS of apple equipment needs the token information uploading apple Push Service.Client on Android system need upload the user id that its Push Service used is distributed.The message push task that task processing system can be initiated by task interface module receiving system called side.The mode that task is passed to task allocation node by task interface module can have multiple, such as, directly transmit or pass through database indirect transfer.
S002, determine whether this task processing node is not less than predetermined number threshold value when the quantity of subtask of pre-treatment, if so, then performs S003;
Concrete, if this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, then task processing node just can process this subtask.Concrete, when waiting task is message push task, task processing node can according to the range of transmission of the subtask type in the object of subtask and subtask from the corresponding facility information of data base querying, and select corresponding Push Service, the client device of such as iOS system selects Apple's Push Service, and Android device selects Android Push Service.Task processing node pushes in the process of task periodically can push progress, after processing the subtask of distribution, to task allocation node transmission processing completion notice to task allocation node feedback message in processing messages.
S003, to the refusal processing messages of described task allocation node feedback to this subtask, with the task processing node making described task allocation node this subtask is assigned to the refusal processing messages do not fed back this subtask.
Be understandable that, after subtask is assigned to task processing node by task allocation node, if the quantity of task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, task processing node will send refusal processing messages to task allocation node.After task allocation node receives this refusal processing messages, the subtask distributing to this task processing node is distributed to the task processing node of the refusal processing messages do not fed back this subtask.Like this, ensure that on the one hand task processing node when the quantity of the subtask of pre-treatment can not be too many, on the other hand by the sub-distribution again of subtask, also ensure that this subtask can be performed in time.
A kind of task processing method that the embodiment of the present invention provides, achieve the equilibrium of the subtask quantity of task processing node process, both avoided because subtask too much causes the travelling speed of task processing node to reduce, turn avoid the waste causing resource because subtask is very few.
On basis embodiment illustrated in fig. 3, as shown in Figure 4, the another kind of task processing method that the embodiment of the present invention provides, can also comprise:
S004, determining that this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, to the agreement processing messages of described task allocation node feedback to this subtask;
S005, obtain the process progress msg of this task processing node Processing tasks;
Wherein, processing progress msg can be processed complete subtask quantity and subtask mark, untreated complete subtask quantity and subtask mark or the mark of the current subtask just processed.
S006, described process progress msg is sent to described task allocation node, determine that whether the speed of this task processing node process subtask is lower than pre-set velocity threshold value, if, then to the abnormal notice of described task allocation node transmission processing, to make described task allocation node after receiving the abnormal notice of described process, according to the process progress msg that this task processing node sends, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed.
Concrete, task allocation node, behind the untreated subtask of task processing node redistributing the abnormal notice of transmission processing, can also be responsible for the record of the subtask of process according to the task processing node in the subtask distribution condition after redistributing subtask more new database.
Be understandable that, due to task processing node numerous and distribution on a different server, therefore when certain server occurs that the machine of delaying or network interruption or the operation of task processing node are made mistakes, the whole subtasks making corresponding task processing node processes are suspended to perform and maybe cannot perform, and then cause the execution of whole waiting task slowly even to perform failure.
Embodiment illustrated in fig. 4 can the speed of process subtask lower than during pre-set velocity threshold value to the abnormal notice of task allocation node transmission processing, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed by task allocation node.Like this, just ensure that the task processing node gone wrong is responsible for the timely execution of the subtask processed, and then also ensure that the timely execution of waiting task.
Corresponding with embodiment of the method shown in Fig. 1, present invention also offers a kind of task processing system.
As shown in Figure 5, a kind of task processing system that the embodiment of the present invention provides, be applied to task allocation node, described task allocation node is connected with multiple task processing node, this system can comprise: task split cells 100, first allocation units 200, notice receiving element 300 and allocation units 400 again
Described task split cells 100, for obtaining waiting task, is split as multiple subtask by described waiting task;
Wherein, described task allocation node can also with task interface model calling, described multiple task processing node is arranged in multiple server, each task processing node is only arranged in a server, described task split cells 100 can be specifically for: obtain the waiting task that described task interface module receives, described waiting task is split as multiple subtask.
Concrete, task allocation node, task interface module and task processing node are the ingredient of task processing system, and task processing system can be communicated with external unit by task interface module.Like this, although task processing system comprises multiple different equipment, owing to providing external unified interface, therefore can avoid code redundancy and too be coupled.Certainly, database can also be included in task processing system, with the various data in store tasks processing procedure.
Wherein, described task split cells 100, can comprise: task obtains subelement, position calculation subelement and task encapsulation subelement,
Described task obtains subelement, for obtaining waiting task;
Described position calculation subelement, for the granularity threshold value according to the subtask of presetting, calculates the reference position of each subtask in described waiting task and the final position of each subtask;
Described task encapsulation subelement, for each subtask: the subtask object reference position of the task identification of described waiting task, this subtask, the final position of this subtask and waiting task parameter information being encapsulated as this subtask.
Wherein, task splits node after fractionation obtains multiple subtask, can edit and upgrade the state of each subtask in a database, as unallocated, process in, processed armed state, also the information of the task processing node of each subtask with update process can be edited in a database, such as, when the information of the task processing node of this subtask of pre-treatment.Certainly, task splits the information that node can obtain each task processing node in task processing system, as address information, when the number information of pre-treatment subtask, the number information etc. of task processing node.After the information of task processing node changes, task splits this information also corresponding renewal that node obtains.
Described allocation units first 200, for each subtask, are assigned to a described task processing node by this subtask;
When task split cells 100 comprises task acquisition subelement, position calculation subelement and task encapsulation subelement, described allocation units first 200, can be specifically for: to each subtask, the subtask object of this subtask is assigned to a described task processing node.
After subtask object is assigned to task processing node, task processing node just can process subtask according to the information in the object of subtask.
Concrete, subtask type in the object of foundation subtask and the range of transmission of subtask are from the corresponding facility information of data base querying, and select corresponding Push Service, the client device of such as iOS system selects Apple's Push Service, and Android device selects Android Push Service.Task processing node pushes in the process of task periodically can push progress, after processing the subtask of distribution, to task allocation node transmission processing completion notice to task allocation node feedback message in processing messages.
Described notice receiving element 300, for receiving the notification message that the task processing node that has been assigned with this subtask feeds back for this subtask, if described notification message is the refusal processing messages to this subtask, then allocation units 400 again described in triggering; Wherein, described refusal processing messages is task processing node feeds back to described task allocation node described notice receiving element 300 when the quantity determining that it works as the subtask of pre-treatment is not less than predetermined number threshold value;
Described allocation units again 400, for this subtask being assigned to the task processing node of the refusal processing messages do not fed back this subtask, trigger described notice receiving element 300.
Be understandable that, after subtask is assigned to task processing node by task allocation node, if the quantity of task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, task processing node will send refusal processing messages to task allocation node.After task allocation node receives this refusal processing messages, the subtask distributing to this task processing node is distributed to the task processing node of the refusal processing messages do not fed back this subtask.Like this, ensure that on the one hand task processing node when the quantity of the subtask of pre-treatment can not be too many, on the other hand by the sub-distribution again of subtask, also ensure that this subtask can be performed in time.
A kind of task processing system that the embodiment of the present invention provides, achieve the equilibrium of the subtask quantity of task processing node process, both avoided because subtask too much causes the travelling speed of task processing node to reduce, turn avoid the waste causing resource because subtask is very few.
On basis embodiment illustrated in fig. 5, as shown in Figure 6, the another kind of task processing system that the embodiment of the present invention provides, can also comprise: progress obtains unit 500 and task transfers unit 600,
Described progress obtains unit 500, during for being the agreement processing messages to this subtask at described notification message, obtains the process progress msg that described task processing node sends;
Wherein, processing progress msg can be processed complete subtask quantity and subtask mark, untreated complete subtask quantity and subtask mark or the mark of the current subtask just processed.
Described task transfers unit 600, for after the abnormal notice of the process receiving the transmission of described task processing node, according to the process progress msg sending the abnormal task processing node notified of this process, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed, wherein, the abnormal notice of described process is task processing node determining that the speed of its process subtask sends lower than during pre-set velocity threshold value.
Concrete, behind the untreated subtask of task processing node redistributing the abnormal notice of transmission processing, the record of the subtask of process can also be responsible for according to the task processing node in the subtask distribution condition after redistributing subtask more new database.
Be understandable that, due to task processing node numerous and distribution on a different server, therefore when certain server occurs that the machine of delaying or network interruption or the operation of task processing node are made mistakes, the whole subtasks making corresponding task processing node processes are suspended to perform and maybe cannot perform, and then cause the execution of whole waiting task slowly even to perform failure.
Other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node, lower than the abnormal notice of the process sent during pre-set velocity threshold value, process by the speed of task processing node in process subtask that can obtain embodiment illustrated in fig. 6 after this notice of acquisition.Like this, just ensure that the task processing node gone wrong is responsible for the timely execution of the subtask processed, and then also ensure that the timely execution of waiting task.
Corresponding with embodiment of the method shown in Fig. 3, present invention also offers another kind of task processing system.
As shown in Figure 7, the another kind of task processing system that the embodiment of the present invention provides, is applied to task processing node, and described task processing node is connected with task allocation node, this system can comprise: subtask obtains module 001, quantity determination module 002 and message feedback module 003
Described subtask obtains module 001, and for obtaining the subtask that described task allocation node distributes, wherein, this subtask is that described task allocation node obtains after splitting waiting task;
Wherein, task allocation node can also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server.
Concrete, task allocation node, task interface module and task processing node are the ingredient of task processing system, and task processing system can be communicated with external unit by task interface module.Like this, although task processing system comprises multiple different equipment, owing to providing external unified interface, therefore can avoid code redundancy and too be coupled.Certainly, database can also be included in task processing system, with the various data in store tasks processing procedure.
Described quantity determination module 002, for determining whether the quantity of this task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, if so, then triggers described message feedback module 003;
Concrete, if this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, then task processing node just can process this subtask.Concrete, when waiting task is message push task, task processing node can according to the range of transmission of the subtask type in the object of subtask and subtask from the corresponding facility information of data base querying, and select corresponding Push Service, the client device of such as iOS system selects Apple's Push Service, and Android device selects Android Push Service.Task processing node pushes in the process of task periodically can push progress, after processing the subtask of distribution, to task allocation node transmission processing completion notice to task allocation node feedback message in processing messages.
Described message feedback module 003, for the refusal processing messages of described task allocation node feedback to this subtask, with the task processing node making described task allocation node this subtask is assigned to the refusal processing messages do not fed back this subtask.
Be understandable that, after subtask is assigned to task processing node by task allocation node, if the quantity of task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, task processing node will send refusal processing messages to task allocation node.After task allocation node receives this refusal processing messages, the subtask distributing to this task processing node is distributed to the task processing node of the refusal processing messages do not fed back this subtask.Like this, ensure that on the one hand task processing node when the quantity of the subtask of pre-treatment can not be too many, on the other hand by the sub-distribution again of subtask, also ensure that this subtask can be performed in time.
A kind of task processing system that the embodiment of the present invention provides, achieve the equilibrium of the subtask quantity of task processing node process, both avoided because subtask too much causes the travelling speed of task processing node to reduce, turn avoid the waste causing resource because subtask is very few.
On basis embodiment illustrated in fig. 7, as shown in Figure 8, the another kind of task processing system that the embodiment of the present invention provides, can also comprise: acceptance message feedback module 004, progress obtain module 005, progress sending module 006, speed determination module 007 and notice sending module 008
Described acceptance message feedback module 004, for determining that at described quantity determination module 002 this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, to the agreement processing messages of described task allocation node feedback to this subtask;
Described progress obtains module 005, for obtaining the process progress msg of this task processing node Processing tasks;
Wherein, processing progress msg can be processed complete subtask quantity and subtask mark, untreated complete subtask quantity and subtask mark or the mark of the current subtask just processed.
Described progress sending module 006, for being sent to described task allocation node by described process progress msg;
Described speed determination module 007, for determining that whether the speed of this task processing node process subtask is lower than pre-set velocity threshold value, if so, then triggers described notice sending module 008;
Described notice sending module 008, for notifying to described task allocation node transmission processing is abnormal, to make described task allocation node after receiving the abnormal notice of described process, according to the process progress msg that this task processing node sends, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed.
Concrete, task allocation node, behind the untreated subtask of task processing node redistributing the abnormal notice of transmission processing, can also be responsible for the record of the subtask of process according to the task processing node in the subtask distribution condition after redistributing subtask more new database.
Be understandable that, due to task processing node numerous and distribution on a different server, therefore when certain server occurs that the machine of delaying or network interruption or the operation of task processing node are made mistakes, the whole subtasks making corresponding task processing node processes are suspended to perform and maybe cannot perform, and then cause the execution of whole waiting task slowly even to perform failure.
Embodiment illustrated in fig. 8 can the speed of process subtask lower than during pre-set velocity threshold value to the abnormal notice of task allocation node transmission processing, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed by task allocation node.Like this, just ensure that the task processing node gone wrong is responsible for the timely execution of the subtask processed, and then also ensure that the timely execution of waiting task.
It should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
Each embodiment in this instructions all adopts relevant mode to describe, between each embodiment identical similar part mutually see, what each embodiment stressed is the difference with other embodiments.Especially, for system embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (14)
1. a task processing method, is characterized in that, is applied to task allocation node, and described task allocation node is connected with multiple task processing node, and described method comprises:
Obtain waiting task, described waiting task is split as multiple subtask;
To each subtask, be all handled as follows:
This subtask is assigned to a described task processing node;
The notification message that the task processing node that reception has been assigned with this subtask feeds back for this subtask;
If described notification message is the refusal processing messages to this subtask, then this subtask is assigned to the task processing node of the refusal processing messages do not fed back this subtask, the step of the notification message that the task processing node that the described reception of continuation execution has been assigned with this subtask feeds back for this subtask, wherein, described refusal processing messages is that task processing node feeds back to described task allocation node when the quantity determining that it works as the subtask of pre-treatment is not less than predetermined number threshold value.
2. method according to claim 1, is characterized in that, also comprises:
When described notification message is the agreement processing messages to this subtask, obtain the process progress msg that described task processing node sends;
After the abnormal notice of the process receiving the transmission of described task processing node, according to the process progress msg sending the abnormal task processing node notified of this process, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed, wherein, the abnormal notice of described process is task processing node determining that the speed of its process subtask sends lower than during pre-set velocity threshold value.
3. method according to claim 1 and 2, it is characterized in that, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, each task processing node is only arranged in a server, described acquisition waiting task, comprising: obtain the waiting task that described task interface module receives.
4. method according to claim 1 and 2, is characterized in that, described described waiting task is split as multiple subtask, comprising:
According to the granularity threshold value of the subtask of presetting, calculate the reference position of each subtask in described waiting task and the final position of each subtask;
To each subtask: the subtask object reference position of the task identification of described waiting task, this subtask, the final position of this subtask and waiting task parameter information being encapsulated as this subtask;
Describedly this subtask is assigned to a described task processing node, comprises: the subtask object of this subtask is assigned to a described task processing node.
5. a task processing method, is characterized in that, is applied to task processing node, and described task processing node is connected with task allocation node, and described method comprises:
Obtain the subtask that described task allocation node distributes, wherein, this subtask is that described task allocation node obtains after splitting waiting task;
Determine whether the quantity of this task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, if, then to the refusal processing messages of described task allocation node feedback to this subtask, with the task processing node making described task allocation node this subtask is assigned to the refusal processing messages do not fed back this subtask.
6. method according to claim 5, is characterized in that, also comprises:
Determining that this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, to the agreement processing messages of described task allocation node feedback to this subtask;
Obtain the process progress msg of this task processing node Processing tasks;
Described process progress msg is sent to described task allocation node, determine that whether the speed of this task processing node process subtask is lower than pre-set velocity threshold value, if, then to the abnormal notice of described task allocation node transmission processing, to make described task allocation node after receiving the abnormal notice of described process, according to the process progress msg that this task processing node sends, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed.
7. the method according to claim 5 or 6, is characterized in that, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server.
8. a task processing system, is characterized in that, is applied to task allocation node, and described task allocation node is connected with multiple task processing node, and described system comprises: task split cells, first allocation units, notice receiving element and allocation units again,
Described task split cells, for obtaining waiting task, is split as multiple subtask by described waiting task;
Described allocation units first, for each subtask, are assigned to a described task processing node by this subtask;
Described notice receiving element, for receiving the notification message that the task processing node that has been assigned with this subtask feeds back for this subtask, if described notification message is the refusal processing messages to this subtask, then allocation units again described in triggering; Wherein, described refusal processing messages is task processing node feeds back to described task allocation node described notice receiving element when the quantity determining that it works as the subtask of pre-treatment is not less than predetermined number threshold value;
Described allocation units again, for this subtask being assigned to the task processing node of the refusal processing messages do not fed back this subtask, trigger described notice receiving element.
9. system according to claim 8, is characterized in that, also comprises: progress obtains unit and task transfers unit,
Described progress obtains unit, for being the agreement processing messages to this subtask at described notification message, obtains the process progress msg that described task processing node sends;
Described task transfers unit, for after the abnormal notice of the process receiving the transmission of described task processing node, according to the process progress msg sending the abnormal task processing node notified of this process, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed, wherein, the abnormal notice of described process is task processing node determining that the speed of its process subtask sends lower than during pre-set velocity threshold value.
10. system according to claim 8 or claim 9, it is characterized in that, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, each task processing node is only arranged in a server, described task split cells specifically for: obtain described task interface module receive waiting task, described waiting task is split as multiple subtask.
11. systems according to claim 8 or claim 9, it is characterized in that, described task split cells, comprising: task obtains subelement, position calculation subelement and task encapsulation subelement,
Described task obtains subelement, for obtaining waiting task;
Described position calculation subelement, for the granularity threshold value according to the subtask of presetting, calculates the reference position of each subtask in described waiting task and the final position of each subtask;
Described task encapsulation subelement, for each subtask: the subtask object reference position of the task identification of described waiting task, this subtask, the final position of this subtask and waiting task parameter information being encapsulated as this subtask;
Described allocation units first, specifically for: to each subtask, the subtask object of this subtask is assigned to a described task processing node.
12. 1 kinds of task processing systems, is characterized in that, are applied to task processing node, and described task processing node is connected with task allocation node, and described system comprises: subtask obtains module, quantity determination module and message feedback module,
Described subtask obtains module, and for obtaining the subtask that described task allocation node distributes, wherein, this subtask is that described task allocation node obtains after splitting waiting task;
Described quantity determination module, for determining whether the quantity of this task processing node when the subtask of pre-treatment is not less than predetermined number threshold value, if so, then triggers described message feedback module;
Described message feedback module, for the refusal processing messages of described task allocation node feedback to this subtask, with the task processing node making described task allocation node this subtask is assigned to the refusal processing messages do not fed back this subtask.
13. systems according to claim 12, is characterized in that, also comprise: acceptance message feedback module, progress obtain module, progress sending module, speed determination module and notice sending module,
Described acceptance message feedback module, for determining that at described quantity determination module this task processing node is when the quantity of the subtask of pre-treatment is lower than predetermined number threshold value, to the agreement processing messages of described task allocation node feedback to this subtask;
Described progress obtains module, for obtaining the process progress msg of this task processing node Processing tasks;
Described progress sending module, for being sent to described task allocation node by described process progress msg;
Described speed determination module, for determining that whether the speed of this task processing node process subtask is lower than pre-set velocity threshold value, if so, then triggers described notice sending module;
Described notice sending module, for notifying to described task allocation node transmission processing is abnormal, to make described task allocation node after receiving the abnormal notice of described process, according to the process progress msg that this task processing node sends, other task processing nodes that untreated for this task processing node part or all of subtask is assigned to except this task processing node are processed.
14. systems according to claim 12 or 13, is characterized in that, described task allocation node also with task interface model calling, described multiple task processing node is arranged in multiple server, and each task processing node is only arranged in a server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510150111.5A CN104731663B (en) | 2015-03-31 | 2015-03-31 | Task processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510150111.5A CN104731663B (en) | 2015-03-31 | 2015-03-31 | Task processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104731663A true CN104731663A (en) | 2015-06-24 |
| CN104731663B CN104731663B (en) | 2018-04-13 |
Family
ID=53455577
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510150111.5A Active CN104731663B (en) | 2015-03-31 | 2015-03-31 | Task processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104731663B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105516259A (en) * | 2015-11-27 | 2016-04-20 | 北京奇虎科技有限公司 | Information sending method and apparatus |
| CN105511975A (en) * | 2015-11-27 | 2016-04-20 | 北京奇虎科技有限公司 | Exception handling method and device |
| CN105912399A (en) * | 2016-04-05 | 2016-08-31 | 杭州嘉楠耘智信息科技有限公司 | Task processing method, device and system |
| CN106453420A (en) * | 2016-12-08 | 2017-02-22 | 郑州云海信息技术有限公司 | Request processing device and method and terminal |
| CN106528292A (en) * | 2016-10-21 | 2017-03-22 | 杭州嘉楠耘智信息科技有限公司 | Task processing method and device |
| CN106648850A (en) * | 2015-11-02 | 2017-05-10 | 佳能株式会社 | Information processing apparatus and method of controlling the same |
| CN106682872A (en) * | 2016-12-19 | 2017-05-17 | 北京锐安科技有限公司 | Mission distribution method and device |
| CN107153573A (en) * | 2016-03-02 | 2017-09-12 | 阿里巴巴集团控股有限公司 | Distributed task scheduling treating method and apparatus |
| CN108022028A (en) * | 2016-11-01 | 2018-05-11 | 南京途牛科技有限公司 | A kind of method for processing resource and device |
| CN108037968A (en) * | 2017-12-01 | 2018-05-15 | 东软集团股份有限公司 | Display methods, device, storage medium and the electronic equipment of implementation progress |
| CN108270837A (en) * | 2017-01-04 | 2018-07-10 | 北京京东尚科信息技术有限公司 | A kind of distributed task dispatching method and system using slack resources |
| WO2018188498A1 (en) * | 2017-04-12 | 2018-10-18 | 梅特勒-托利多(常州)精密仪器有限公司 | Collaborative weighing and measuring system and metering system |
| CN108958922A (en) * | 2017-05-17 | 2018-12-07 | 北京京东尚科信息技术有限公司 | Method and apparatus for executing task |
| CN109146212A (en) * | 2017-06-16 | 2019-01-04 | 佛山科学技术学院 | Extensive isomorphism method for allocating tasks in crowdsourcing system |
| CN109214132A (en) * | 2018-10-30 | 2019-01-15 | 中国运载火箭技术研究院 | A kind of big Throughput Asynchronous task processing system of non-coupled streaming towards LVC emulation |
| CN109754189A (en) * | 2019-01-07 | 2019-05-14 | 金邦达有限公司 | A kind of distribution method of fabrication task, a kind of acquisition methods, computer installation and the computer readable storage medium of fabrication task |
| CN109753849A (en) * | 2017-11-03 | 2019-05-14 | 杭州海康威视数字技术股份有限公司 | The method and apparatus for handling video analytic tasks |
| CN110532077A (en) * | 2019-08-22 | 2019-12-03 | 腾讯科技（深圳）有限公司 | Task processing method, device and storage medium |
| CN110942244A (en) * | 2019-11-22 | 2020-03-31 | 北京金山云网络技术有限公司 | Work order distribution method and device, electronic equipment and storage medium |
| CN111367647A (en) * | 2020-03-31 | 2020-07-03 | 绿盟科技集团股份有限公司 | Task assignment method and device |
| CN111756833A (en) * | 2020-06-22 | 2020-10-09 | 北京字节跳动网络技术有限公司 | Node processing method and device, electronic equipment and computer readable medium |
| CN109254833B (en) * | 2017-07-12 | 2020-10-09 | 杭州海康威视数字技术股份有限公司 | Picture analysis method, device and system and computer equipment |
| CN113127207A (en) * | 2021-04-30 | 2021-07-16 | 平安国际融资租赁有限公司 | Crowdsourcing task resource allocation method and device, electronic equipment and storage medium |
| WO2021179522A1 (en) * | 2020-03-13 | 2021-09-16 | 平安国际智慧城市科技股份有限公司 | Computing resource allocation system, method, and apparatus, and computer device |
| CN113835862A (en) * | 2021-09-26 | 2021-12-24 | 中国联合网络通信集团有限公司 | Task processing method and device |
| CN114708970A (en) * | 2022-04-11 | 2022-07-05 | 上海铂桐医疗科技有限公司 | Pain comprehensive assessment data processing method and system suitable for big data |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6304866B1 (en) * | 1997-06-27 | 2001-10-16 | International Business Machines Corporation | Aggregate job performance in a multiprocessing system by incremental and on-demand task allocation among multiple concurrently operating threads |
| CN101753461A (en) * | 2010-01-14 | 2010-06-23 | 中国建设银行股份有限公司 | Method for realizing load balance, load balanced server and group system |
| CN102521051A (en) * | 2011-12-05 | 2012-06-27 | 中国联合网络通信集团有限公司 | Task scheduling method, device and system in Map Reduce system applied to nomography |
| CN102541645A (en) * | 2012-01-04 | 2012-07-04 | 北京航空航天大学 | Dynamic adjustment method for node task slot based on node state feedbacks |
| CN103677751A (en) * | 2012-09-06 | 2014-03-26 | 阿里巴巴集团控股有限公司 | Task parallel processing method and device |
| CN103699441A (en) * | 2013-12-05 | 2014-04-02 | 深圳先进技术研究院 | MapReduce report task execution method based on task granularity |
| CN104331520A (en) * | 2014-11-28 | 2015-02-04 | 北京奇艺世纪科技有限公司 | Performance optimization method and device of Hadoop cluster and node state recognition method and device |
| CN104461710A (en) * | 2014-12-12 | 2015-03-25 | 北京国双科技有限公司 | Method and device for processing tasks |
-
2015
- 2015-03-31 CN CN201510150111.5A patent/CN104731663B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6304866B1 (en) * | 1997-06-27 | 2001-10-16 | International Business Machines Corporation | Aggregate job performance in a multiprocessing system by incremental and on-demand task allocation among multiple concurrently operating threads |
| CN101753461A (en) * | 2010-01-14 | 2010-06-23 | 中国建设银行股份有限公司 | Method for realizing load balance, load balanced server and group system |
| CN102521051A (en) * | 2011-12-05 | 2012-06-27 | 中国联合网络通信集团有限公司 | Task scheduling method, device and system in Map Reduce system applied to nomography |
| CN102541645A (en) * | 2012-01-04 | 2012-07-04 | 北京航空航天大学 | Dynamic adjustment method for node task slot based on node state feedbacks |
| CN103677751A (en) * | 2012-09-06 | 2014-03-26 | 阿里巴巴集团控股有限公司 | Task parallel processing method and device |
| CN103699441A (en) * | 2013-12-05 | 2014-04-02 | 深圳先进技术研究院 | MapReduce report task execution method based on task granularity |
| CN104331520A (en) * | 2014-11-28 | 2015-02-04 | 北京奇艺世纪科技有限公司 | Performance optimization method and device of Hadoop cluster and node state recognition method and device |
| CN104461710A (en) * | 2014-12-12 | 2015-03-25 | 北京国双科技有限公司 | Method and device for processing tasks |
Cited By (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106648850A (en) * | 2015-11-02 | 2017-05-10 | 佳能株式会社 | Information processing apparatus and method of controlling the same |
| CN105511975A (en) * | 2015-11-27 | 2016-04-20 | 北京奇虎科技有限公司 | Exception handling method and device |
| CN105511975B (en) * | 2015-11-27 | 2019-06-04 | 北京奇虎科技有限公司 | A kind of abnormality eliminating method and device |
| CN105516259B (en) * | 2015-11-27 | 2019-06-04 | 北京奇虎科技有限公司 | A kind of method for sending information and device |
| CN105516259A (en) * | 2015-11-27 | 2016-04-20 | 北京奇虎科技有限公司 | Information sending method and apparatus |
| CN107153573A (en) * | 2016-03-02 | 2017-09-12 | 阿里巴巴集团控股有限公司 | Distributed task scheduling treating method and apparatus |
| CN105912399B (en) * | 2016-04-05 | 2020-02-07 | 杭州嘉楠耘智信息科技有限公司 | Task processing method, device and system |
| CN105912399A (en) * | 2016-04-05 | 2016-08-31 | 杭州嘉楠耘智信息科技有限公司 | Task processing method, device and system |
| CN106528292A (en) * | 2016-10-21 | 2017-03-22 | 杭州嘉楠耘智信息科技有限公司 | Task processing method and device |
| CN106528292B (en) * | 2016-10-21 | 2022-04-22 | 上海嘉楠捷思信息技术有限公司 | Task processing method and device |
| CN108022028A (en) * | 2016-11-01 | 2018-05-11 | 南京途牛科技有限公司 | A kind of method for processing resource and device |
| CN108022028B (en) * | 2016-11-01 | 2021-02-26 | 南京途牛科技有限公司 | Resource processing method and device |
| CN106453420A (en) * | 2016-12-08 | 2017-02-22 | 郑州云海信息技术有限公司 | Request processing device and method and terminal |
| CN106682872A (en) * | 2016-12-19 | 2017-05-17 | 北京锐安科技有限公司 | Mission distribution method and device |
| CN108270837A (en) * | 2017-01-04 | 2018-07-10 | 北京京东尚科信息技术有限公司 | A kind of distributed task dispatching method and system using slack resources |
| CN108270837B (en) * | 2017-01-04 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Distributed task scheduling method and system using idle resources |
| WO2018188498A1 (en) * | 2017-04-12 | 2018-10-18 | 梅特勒-托利多(常州)精密仪器有限公司 | Collaborative weighing and measuring system and metering system |
| US11378441B2 (en) | 2017-04-12 | 2022-07-05 | Mettler-Toledo (Changzhou) Precision Instruments Co., Ltd. | Collaborative weighing and measuring system and metering system |
| CN108958922A (en) * | 2017-05-17 | 2018-12-07 | 北京京东尚科信息技术有限公司 | Method and apparatus for executing task |
| CN108958922B (en) * | 2017-05-17 | 2022-01-07 | 北京京东尚科信息技术有限公司 | Method and device for executing task |
| CN109146212A (en) * | 2017-06-16 | 2019-01-04 | 佛山科学技术学院 | Extensive isomorphism method for allocating tasks in crowdsourcing system |
| CN109254833B (en) * | 2017-07-12 | 2020-10-09 | 杭州海康威视数字技术股份有限公司 | Picture analysis method, device and system and computer equipment |
| CN109753849A (en) * | 2017-11-03 | 2019-05-14 | 杭州海康威视数字技术股份有限公司 | The method and apparatus for handling video analytic tasks |
| CN108037968A (en) * | 2017-12-01 | 2018-05-15 | 东软集团股份有限公司 | Display methods, device, storage medium and the electronic equipment of implementation progress |
| CN109214132A (en) * | 2018-10-30 | 2019-01-15 | 中国运载火箭技术研究院 | A kind of big Throughput Asynchronous task processing system of non-coupled streaming towards LVC emulation |
| CN109214132B (en) * | 2018-10-30 | 2023-06-30 | 中国运载火箭技术研究院 | LVC simulation-oriented uncoupled streaming type large-flux asynchronous task processing system |
| CN109754189A (en) * | 2019-01-07 | 2019-05-14 | 金邦达有限公司 | A kind of distribution method of fabrication task, a kind of acquisition methods, computer installation and the computer readable storage medium of fabrication task |
| CN110532077A (en) * | 2019-08-22 | 2019-12-03 | 腾讯科技（深圳）有限公司 | Task processing method, device and storage medium |
| CN110532077B (en) * | 2019-08-22 | 2021-12-07 | 腾讯科技（深圳）有限公司 | Task processing method and device and storage medium |
| CN110942244A (en) * | 2019-11-22 | 2020-03-31 | 北京金山云网络技术有限公司 | Work order distribution method and device, electronic equipment and storage medium |
| WO2021179522A1 (en) * | 2020-03-13 | 2021-09-16 | 平安国际智慧城市科技股份有限公司 | Computing resource allocation system, method, and apparatus, and computer device |
| CN111367647B (en) * | 2020-03-31 | 2024-06-11 | 绿盟科技集团股份有限公司 | Task assignment method and device |
| CN111367647A (en) * | 2020-03-31 | 2020-07-03 | 绿盟科技集团股份有限公司 | Task assignment method and device |
| CN111756833A (en) * | 2020-06-22 | 2020-10-09 | 北京字节跳动网络技术有限公司 | Node processing method and device, electronic equipment and computer readable medium |
| CN111756833B (en) * | 2020-06-22 | 2023-04-28 | 抖音视界有限公司 | Node processing method, node processing device, electronic equipment and computer readable medium |
| CN113127207A (en) * | 2021-04-30 | 2021-07-16 | 平安国际融资租赁有限公司 | Crowdsourcing task resource allocation method and device, electronic equipment and storage medium |
| CN113127207B (en) * | 2021-04-30 | 2024-04-02 | 平安国际融资租赁有限公司 | Crowd-sourced task resource allocation method and device, electronic equipment and storage medium |
| CN113835862B (en) * | 2021-09-26 | 2023-07-07 | 中国联合网络通信集团有限公司 | Task processing method and device |
| CN113835862A (en) * | 2021-09-26 | 2021-12-24 | 中国联合网络通信集团有限公司 | Task processing method and device |
| CN114708970B (en) * | 2022-04-11 | 2023-05-16 | 上海铂桐医疗科技有限公司 | Pain comprehensive evaluation data processing method and system suitable for big data |
| CN114708970A (en) * | 2022-04-11 | 2022-07-05 | 上海铂桐医疗科技有限公司 | Pain comprehensive assessment data processing method and system suitable for big data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104731663B (en) | 2018-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731663A (en) | Task processing method and system | |
| CN102377686B (en) | Message subscription system, method and device | |
| CN104253850A (en) | Distributed task scheduling method and system | |
| CN104657212A (en) | Task scheduling method and system | |
| CN102457906A (en) | Load balancing control method and system of message queues | |
| EP3401785A1 (en) | Method and apparatus for managing resources | |
| US20160344582A1 (en) | Call home cluster | |
| CN101951411A (en) | Cloud scheduling system and method and multistage cloud scheduling system | |
| CN109040178A (en) | Configuration information transmitting method and device | |
| CN105847139A (en) | Data transmission method, apparatus and system | |
| CN104699542A (en) | Task processing method and system | |
| CN111507643A (en) | Work order distribution method and device, electronic equipment and storage medium | |
| CN103929441A (en) | Task allocation method and device | |
| CN103150241A (en) | System and method for monitoring and managing status of multi-server | |
| JP2018511209A5 (en) | ||
| CN104268007A (en) | Distributed event request scheduling method and system | |
| US10216593B2 (en) | Distributed processing system for use in application migration | |
| CN112910937A (en) | Object scheduling method and device in container cluster, server and container cluster | |
| CN112817751A (en) | Computing resource management method and device, storage medium and electronic device | |
| CN104618162A (en) | Management method, device and system of system docking | |
| CN105207856A (en) | Load balancing system and method based on SDN virtual switch | |
| CN111209098A (en) | Intelligent rendering scheduling method, server, management node and storage medium | |
| CN102571595B (en) | Route forwarding information synchronizing method and device of stack system | |
| WO2017121457A1 (en) | A collaboration system and a method for operating the collaboration system | |
| CN104184823A (en) | Automatic task scheduling method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |