CN106407002B - Data processing task executes method and apparatus - Google Patents
Data processing task executes method and apparatus Download PDFInfo
- Publication number
- CN106407002B CN106407002B CN201610702453.8A CN201610702453A CN106407002B CN 106407002 B CN106407002 B CN 106407002B CN 201610702453 A CN201610702453 A CN 201610702453A CN 106407002 B CN106407002 B CN 106407002B
- Authority
- CN
- China
- Prior art keywords
- task
- server
- execute
- request
- execute server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
Abstract
The present invention relates to a kind of data processing tasks to execute method and apparatus, the method includes：Receive the task notice distribution that Distributor is sent；According to task notice distribution task execution request is sent to sequence server；Execute server ranking results are obtained from sequence server, execute server ranking results after receiving the task execution that each execute server is sent and asking, are requested to generate by sequence server according to task execution；It determines sorting position of the local execute server in server orders result, judges sorting position whether within the scope of predetermined order；When within the scope of judging sorting position in predetermined order, then obtains data processing task from Distributor and execute.Data processing task provided by the invention executes method and apparatus, avoids the case where data processing task is repeated by multiple execute servers, the data processing resources consumed when executing data processing task to save.
Description
Technical field
The present invention relates to technical field of data processing, and method and apparatus are executed more particularly to a kind of data processing task.
Background technology
In technical field of data processing, when handling data, generally require to establish data processing task, and will establish
Data processing task be sent to execute server, execute server gets data processing task and executes.
However, in traditional data processing field, more execute servers are provided with, executing service monitoring when more arrives
When having data processing task generation, data processing task can be all obtained, and execute the data processing task got, more in this way
Execute server is all executing data processing task, and a data processing task can be caused to be held by what more execute servers repeated
Row so that expend excessive resource when a data processing task, cause the waste of data processing resources.
Invention content
Based on this, it is necessary to for the problem of the wasting of resources, providing in data processing task implementation procedure at a kind of data
Manage task executing method and device.
A kind of data processing task execution method, is applied to execute server, the method includes：
Receive the task notice distribution that Distributor is sent；
According to the task notice distribution task execution request is sent to sequence server；
Execute server ranking results are obtained from the sequence server, the execute server ranking results are by the row
Sequence server requests to generate after receiving the task execution request that each execute server is sent according to the task execution；
It determines sorting position of the local execute server in the server orders result, judges the sorting position
Whether within the scope of predetermined order；When within the scope of judging the sorting position in predetermined order, serviced from the distribution
Device obtains the data processing task and executes.
It is described in one of the embodiments, to be asked to sequence server transmission task execution according to the task notice distribution
After asking, further include：
The ballot request that the sequence server is initiated is received, the ballot request executes data processing task for choosing
Execute server；
Vote information is requested to generate according to the ballot；
The vote information is sent to the sequence server, makes the sequence server according to each execution received
The vote information that server returns generates execute server ranking results.
It is described in one of the embodiments, to be asked to sequence server transmission task execution according to the task notice distribution
After asking, further include：
It receives the sequence server and sends resource utilization acquisition request；
Request extraction resource utilization is obtained according to the resource utilization, the resource utilization extracted is back to institute
Sequence server is stated, so that the sequence server is generated according to the resource utilization that each execute server received returns and executes
Server orders result.
Row of the determining local execute server in the server orders result in one of the embodiments,
Tagmeme is set, and judges the sorting position whether within the scope of predetermined order, including：
First execute server mark is come in extraction execute server ranking results；
The execute server extracted is identified and is compared with self identification；
If the execute server mark extracted is consistent with the self identification, local execute server is judged
Sorting position within the scope of predetermined order.
It is described in one of the embodiments, to obtain the data processing task from the Distributor and execute, it wraps
It includes：
It is sent to the Distributor and carries the task acquisition request that execute server identifies；
Data processing task is received, the data processing task is that the Distributor is tied according to execute server sequence
What fruit returned after passing through to the execute server identity verification.
Above-mentioned data processing task executes method, after the task notice distribution for receiving Distributor transmission, according to
Task notice distribution sends task execution request to sequence server, and sequence server is sent out according to each execute server received
The task execution request sent, which is ranked up execute server, generates execute server ranking results.Execute server takes from sequence
Business device obtains execute server ranking results, is determining local execute server default according to execute server ranking results
When within sequencing horizon, obtains data processing task from Distributor and execute.In this way, passing through execute server ranking results
Quantity with the execute server for executing data processing task permission is controlled, multiple execute servers is avoided and is connecing
When receiving task notice distribution, while the case where data processing task causes data congestion is obtained from Distributor, also avoided
The case where data processing task is repeated by multiple execute servers is disappeared when executing data processing task to save
The data processing resources of consumption.
A kind of data processing task executive device, is applied to execute server, and described device includes：
Notice distribution receiving module, the task notice distribution for receiving Distributor transmission；
Request sending module is executed, is asked for sending task execution to sequence server according to the task notice distribution
It asks；
Ranking results acquisition module, for obtaining execute server ranking results, the execution from the sequence server
Server orders result by the sequence server after receiving the task execution request that each execute server is sent, according to institute
Task execution is stated to request to generate；
Sorting position judgment module, for determining sequence of the local execute server in the server orders result
Whether position judges the sorting position within the scope of predetermined order；
Data task acquisition module, when within the scope of judging the sorting position in predetermined order, from described point
Hair server obtains the data processing task and executes.
Described device further includes in one of the embodiments,：
Ballot request receiving module, the ballot request initiated for receiving the sequence server, the ballot request use
In the execute server for choosing execution data processing task；
Vote information generation module, for requesting to generate vote information according to the ballot；
Vote information sending module makes the sequence take for the vote information to be sent to the sequence server
Business device generates execute server ranking results according to the vote information that each execute server received returns.
Described device further includes in one of the embodiments,：
Request receiving module is obtained, resource utilization acquisition request is sent for receiving the sequence server；
Resource utilization returns to module, for obtaining request extraction resource utilization according to the resource utilization, will carry
The resource utilization got is back to the sequence server, makes the sequence server according to each execute server received
The resource utilization of return generates execute server ranking results.
The sorting position judgment module includes in one of the embodiments,：
Marker extraction module, for extracting the execute server mark for coming first in execute server ranking results；
Comparing module being identified, being compared with self identification for identifying the execute server extracted；
Sort determining module, if consistent with the self identification for the execute server mark extracted, sentences
The sorting position of fixed local execute server is within the scope of predetermined order.
The data task acquisition module includes in one of the embodiments,：
Task requests sending module is obtained for carrying the task that execute server identifies to Distributor transmission
Take request；
Data task receiving module, for receiving data processing task, the data processing task services for the distribution
What device returned after being passed through to the execute server identity verification according to execute server ranking results.
Above-mentioned data processing task executive device, after the task notice distribution for receiving Distributor transmission, according to
Task notice distribution sends task execution request to sequence server, and sequence server is sent out according to each execute server received
The task execution request sent, which is ranked up execute server, generates execute server ranking results.Execute server takes from sequence
Business device obtains execute server ranking results, is determining local execute server default according to execute server ranking results
When within sequencing horizon, obtains data processing task from Distributor and execute.In this way, passing through execute server ranking results
Quantity with the execute server for executing data processing task permission is controlled, multiple execute servers is avoided and is connecing
When receiving task notice distribution, while the case where data processing task causes data congestion is obtained from Distributor, also avoided
The case where data processing task is repeated by multiple execute servers is disappeared when executing data processing task to save
The data processing resources of consumption.
Description of the drawings
Fig. 1 is that data processing task executes systematic difference environment map in one embodiment；
Fig. 2 is the flow diagram that data processing task executes method in one embodiment；
Fig. 3 is that flow the step of generating execute server ranking results according to vote information in one embodiment is illustrated
Figure；
Fig. 4 is that flow the step of generating execute server ranking result according to resource utilization in one embodiment is illustrated
Figure；
Fig. 5 is to determine the step of executing data processing task permission according to execute server ranking results in one embodiment
Flow diagram；
Fig. 6 is the structure diagram of data processing task executive device in one embodiment；
Fig. 7 is the structure diagram of data processing task executive device in another embodiment；
Fig. 8 is the structure diagram of data processing task executive device in another embodiment；
Fig. 9 is the structure diagram of sorting position judgment module in one embodiment；
Figure 10 is the structure diagram of data task acquisition module in one embodiment.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Fig. 1 is that data processing task executes systematic difference environment map in one embodiment, and data processing task executes system
System includes execute server 110, Distributor 120 and sequence server 130.Execute server 110 passes through network and distribution
Server 120 connects, and execute server 110 is connect by network with sequence server 130, wherein execute server 110, distribution
Server 120 and sequence server 130 can be specifically multiple, and Distributor 120 and sequence server 130 can be integrated
In same server.
As shown in Fig. 2, in one embodiment, providing a kind of data processing task execution method, the present embodiment is with the party
Method is particularly applicable in Fig. 1 data processing tasks and executes in the execute server 110 of system for example, execute server 110
Upper operation has data processing task to execute program, and data processing task processing routine is for implementing data processing task processing side
Method, data processing task processing method specifically include the following contents：
S202 receives the task notice distribution that Distributor is sent.
Specifically, after Distributor 120 receives the data processing task that terminal is sent, data processing task is obtained
Task identification generates task notice distribution according to task identification, task notice distribution is sent to each execute server, specifically may be used
Task notice distribution is sent to each execute server 110 in the form of broadcast.Data processing task can also be to distribute
Server 120 receives the task creation order of terminal transmission, creates data processing task according to task creation order, and be wound
The data processing task built generates task identification.
S204 sends task execution request according to task notice distribution to sequence server.
Specifically, execute server 110 after the task notice distribution for receiving the transmission of Distributor 120, appoint by extraction
The task identification being engaged in notice distribution generates task execution request according to task identification, and the task execution of generation is asked to send out
It send to sequence server 130.
S206 obtains execute server ranking results from sequence server, and execute server ranking results are serviced by sequence
Device requests to generate after receiving each execute server and sending task execution request according to task execution.
Specifically, for sequence server 130 in the task execution request for receiving the transmission of execute server 110, record is every
The receiving time of a task execution request, the execute server mark in extraction task execution request, appoints according to each of record
Business executes the receiving time of request to being ranked up from the execute server mark in task execution, according to receiving time to executing
Server identification is ranked up to obtain execute server ranking results, and sequence server 130 extracts appointing in task execution request
Business mark, by the storage corresponding with task identification of execute server ranking results, each task identification corresponds to an execute server
Ranking results.Execute server 110 sends the ranking results acquisition request for carrying task identification, sequence clothes to sequence server
After business device 130 receives ranking results acquisition request, extraction ranking results obtain task identification in request, lookup task identification pair
The execute server ranking results answered, the execute server ranking results found are back to by sequence server 130 executes clothes
Business device 110.
S208 determines sorting position of the local execute server in server orders result, judges that sorting position is
It is no within the scope of predetermined order.
Specifically, execute server 110 receive sequence server 130 return execute server ranking results after,
The sorting position that self identification is searched in execute server ranking results, according to the sorting position and predetermined order of self identification
Position range compares, if the sorting position of self identification is within predetermined order position range, it is determined that has and executes data
The permission of processing task；If the sorting position of self identification is not within predetermined order position range, it is determined that without holding
The permission of row data processing task.
When within the scope of judging sorting position in predetermined order, data processing task is obtained from Distributor by S210
And it executes.
Specifically, execute server 110 is after determining the permission for having and executing data processing task, to Distributor
120, which send task, obtains request, and it includes task identification that task, which obtains request,.Distributor 120 is receiving the service of execution
After the task that device 110 is sent obtains request, extraction task obtains the task identification in request, at task identification searching data
The data processing task found is sent to execute server 110 by reason task.
In one embodiment, in execute server 110 after Distributor 120 gets data processing task, then
Distributor 120 locks the data processing task, when Distributor 120 obtains the data processing task receiving
When obtaining request, then refuse acquisition request；It is specifically as follows the corresponding task identification addition locking mark of the data processing task
Note.
In one embodiment, S210 specifically includes the following contents：Execute server is carried to Distributor transmission
The task of mark obtains request；Data processing task is received, data processing task is that Distributor is arranged according to execute server
What sequence result returned after passing through to execute server identity verification.
Specifically, execute server 110 is sent to Distributor 120 carries the task acquisition that execute server identifies
Request.Distributor 120 obtains execute server ranking results from sequence server 130, and Distributor 120 is receiving
After being sent to execute server 110 for task obtains request, the execute server mark in task requests is extracted, according to executing clothes
Business device ranking results determine the sorting position of execute server mark, and to verify, execute server mark is corresponding to execute service
Whether device 110 has the permission for executing data processing task, and after being verified, the task identification in request is obtained according to task
Corresponding data processing task is searched, the data processing task found, which is back to execute server mark, corresponding executes clothes
Business device 110.
In the present embodiment, receive Distributor transmission task notice distribution after, according to task notice distribution to
The server that sorts sends task execution request, and sequence server is asked according to the task execution that each execute server received is sent
It asks to be ranked up execute server and generates execute server ranking results.Execute server executes clothes from sequence server acquisition
Business device ranking results, when determining the permission for having and executing data processing task according to execute server ranking results, from distribution
Server obtains data processing task and executes.In this way, executing data processing times to having by execute server ranking results
The quantity of the execute server for permission of being engaged in is controlled, and avoids multiple execute servers when receiving task notice distribution,
The case where data processing task causes data congestion is obtained from Distributor simultaneously, it is multiple to also avoid data processing task
The case where execute server repeats, the data processing resources consumed when executing data processing task to save.
As shown in figure 3, further including in one embodiment, after S204 specifically generating execute server according to vote information
The step of ranking results, the step specifically include the following contents：
S302, receives the ballot request that sequence server is initiated, and ballot request executes data processing task for choosing
Execute server.
Specifically, sequence server 130 extracts task after receiving the task execution request that each execute server is sent
The execute server mark in request is executed, ballot request, ballot are generated according to the multiple execute servers mark mentioned
Request executes the execute server 110 of data processing task for choosing.
S304 requests to generate vote information according to ballot.
Specifically, execute server 110 is after receiving ballot request, multiple execute servers in extraction ballot request
Mark chooses an execute server mark, according to the execute server of selection from the multiple execute servers mark extracted
Mark is used as vote information.
In one embodiment, execute server 110 is after receiving ballot request, from multiple execute servers of storage
An execute server mark is chosen in mark, and vote information is used as according to the execute server of selection mark.
Vote information is sent to sequence server by S306, makes sequence server according to each execute server received
The vote information of return generates execute server ranking results.
Specifically, vote information is sent to sequence server 130 by execute server 110 after generating vote information.Row
Sequence server 130 extracts the execute server mark in vote information after receiving the vote information that each execute server is sent
Know, count the poll of each execute server mark, is ranked up to obtain according to the poll execute server of statistics mark and executes clothes
Business device ranking results.It specifically can from high to low be ranked up, can also be ranked up from low to high according to poll.
In the present embodiment, after receiving the ballot request that all sequence servers are sent, ballot letter is requested to generate according to ballot
Breath, sequence server is sent to by vote information, the ballot for making sequence server be returned according to each execute server received
Information is ranked up to obtain execute server ranking results to execute server mark, is determined according to execute server and executes data
The execute server of processing task avoids data processing task from being performed a plurality of times, to waste data processing resources.
As shown in figure 4, in one embodiment, S204 further includes specifically generating execute server row according to resource utilization
The step of name result, which specifically includes the following contents：
S402 receives sequence server and sends resource utilization acquisition request.
Specifically, sequence server 130 is after receiving the task execution request that each execute server is sent, to each execution
Server sends resource utilization and obtains request, and resource utilization obtains the utilization of resources of the request for obtaining each execute server
Rate.
S404 obtains request extraction resource utilization according to resource utilization, the resource utilization extracted is back to
Sort server, and sequence server is made to generate execute server according to the resource utilization that each execute server received returns
Ranking results.
Specifically, execute server 110 obtains resource utilization parameters, root after receiving resource utilization and obtaining request
According to resource utilization parameters computing resource utilization rate, resource utilization is sent to sequence server 130.Sequence server 130 is connecing
After receiving the resource utilization that each execute server returns, resource utilization is compared, and according to comparison result to resource
Utilization rate corresponding execute server mark is ranked up, can be according to resource utilization from low to high or from high to low suitable
Ordered pair execute server mark is ranked up to obtain execute server ranking results.
In the present embodiment, the resource utilization sent according to sequence server obtains request return resource utilization, makes row
Sequence server is ranked up execute server mark according to resource utilization and generates execute server ranking results, according to execution
The resource utilization of server determines that the lower execute server of resource utilization executes data processing task, improves at data
The efficiency of reason task.
As shown in figure 5, in one embodiment, S208 is specifically included determines execution number according to execute server ranking results
The step of according to processing task right, which specifically includes the following contents：
S502, extract execute server ranking results in come first execute server mark.
Specifically, execute server 110 is after receiving execute server ranking results, from execute server ranking results
Middle extraction comes first execute server mark.Execute server ranking results can identify gained according to execute server
Poll number arranged from high to low, it is number of votes obtained highest execute server mark to come first；Can also be by
The resource utilization that corresponding execute server is identified according to execute server is from low to high ranked up execute server mark,
Come first be the lower execute server of resource utilization execute server mark.
The execute server extracted is identified and is compared with self identification by S504.
Specifically, execute server 110 is extracting the execute server for coming first from execute server ranking results
After mark, the execute server extracted is identified and is compared with self identification.Self identification, which is that execute server 110 is corresponding, to be held
Row server identification.
S506 judges local execute server if the execute server mark extracted is consistent with self identification
Sorting position is within the scope of predetermined order.
Specifically, execute server 110 by the execute server extracted mark with self identification compare when, if by
It compares, the execute server mark extracted is consistent with self identification, indicates that there is execute server 110 execution data processing to appoint
The permission of business, then execute server 110 obtain and data processing task and execute from Distributor.
In this city embodiment, first execute server mark is come from execute server ranking results, will come the
One execute server mark is compared with self identification, determines whether there is execution data processing task according to comparison result
Permission, this avoid all execute servers all go execute data processing task, cause data processing resources waste feelings
Condition.
As shown in fig. 6, in one embodiment, providing a kind of data processing task executive device 600, which specifically wraps
It includes：Notice distribution receiving module 602, execution request sending module 604, ranking results acquisition module 606, sorting position judge mould
Block 608 and data task acquisition module 610.
Notice distribution receiving module 602, the task notice distribution for receiving Distributor transmission.
Request sending module 604 is executed, for sending task execution request to sequence server according to task notice distribution.
Ranking results acquisition module 606, for obtaining execute server ranking results, execute server from sequence server
Ranking results after receiving the task execution request that each execute server is sent, are asked by sequence server according to task execution
It generates.
Sorting position judgment module 608, for determining sequence of the local execute server in server orders result
Whether position judges sorting position within the scope of predetermined order.
Data task acquisition module 610, when within the scope of judging the sorting position in predetermined order, from distribution
Server obtains data processing task and executes.
In the present embodiment, receive Distributor transmission task notice distribution after, according to task notice distribution to
The server that sorts sends task execution request, and sequence server is asked according to the task execution that each execute server received is sent
It asks to be ranked up execute server and generates execute server ranking results.Execute server executes clothes from sequence server acquisition
Business device ranking results are judging the sorting position of local execute server in predetermined order according to execute server ranking results
Within the scope of when, obtain and data processing task and execute from Distributor.In this way, by execute server ranking results to tool
There is the quantity for the execute server for executing data processing task permission to be controlled, avoids multiple execute servers and receiving
When task notice distribution, while the case where data processing task causes data congestion is obtained from Distributor, also avoids counting
The case where being repeated by multiple execute servers according to processing task is consumed when executing data processing task to save
Data processing resources.
As shown in fig. 7, in one embodiment, data processing task executive device 600 further includes specifically：Ballot request connects
Receive module 612, vote information generation module 614 and vote information sending module 616.
Ballot request receiving module 612, the ballot request initiated for receiving sequence server, request of voting is for choosing
Execute the execute server of data processing task.
Vote information generation module 614, for requesting to generate vote information according to ballot.
Vote information sending module 616 makes sequence server according to connecing for vote information to be sent to sequence server
The vote information that each execute server received returns generates execute server ranking results.
In the present embodiment, after receiving the ballot request that all sequence servers are sent, ballot letter is requested to generate according to ballot
Breath, sequence server is sent to by vote information, the ballot for making sequence server be returned according to each execute server received
Information is ranked up to obtain execute server ranking results to execute server mark, is determined according to execute server and executes data
The execute server of processing task avoids data processing task from being performed a plurality of times, to waste data processing resources.
As shown in figure 8, in one embodiment, data processing task executive device 600 further includes specifically：Request is obtained to connect
It receives module 618 and resource utilization returns to module 620.
Request receiving module 618 is obtained, request is obtained for receiving sequence server transmission resource utilization.
Resource utilization returns to module 620, for obtaining request extraction resource utilization according to resource utilization, will extract
To resource utilization be back to sequence server, the resource for making sequence server be returned according to each execute server for receiving
Utilization rate generates execute server ranking results.
In the present embodiment, the resource utilization sent according to sequence server obtains request return resource utilization, makes row
Sequence server is ranked up execute server mark according to resource utilization and generates execute server ranking results, according to execution
The resource utilization of server determines whether to execute data processing task, improves the efficiency of data processing task.
As shown in figure 9, in one embodiment, sorting position judgment module 608 specifically includes：Marker extraction module
608a, mark comparing module 608b and sequence determining module 608c.
Marker extraction module 608a, for extracting the execute server mark for coming first in execute server ranking results
Know.
Comparing module 608b being identified, being compared with self identification for identifying the execute server extracted.
Sort determining module 608c, if the execute server mark for extracting is consistent with self identification, judges this
The sorting position of the execute server on ground is within the scope of predetermined order.
In the present embodiment, first execute server mark is come from execute server ranking results, will come first
Execute server mark be compared with self identification, according to comparison result judgement local execute server sorting position
Within the scope of predetermined order, the permission for having and executing data processing task is determined, this avoid all execute servers all
The case where going to execute data processing task, data processing resources is caused to waste.
As shown in Figure 10, in one embodiment, data task acquisition module 610 further includes specifically：Task requests are sent
Module 610a and data task receiving module 610b.
Task requests sending module 610a is obtained for carrying the task that execute server identifies to Distributor transmission
Take request.
Data task receiving module 610b, for receiving data processing task, data processing task is Distributor root
It is returned after passing through to execute server identity verification according to execute server ranking results.
In the present embodiment, when Distributor receives task and obtains request, according to execute server ranking results pair
Task obtains the execute server mark in request and is verified, to ensure the data safety in Distributor, without additional
Verification information is set.
Each technical characteristic of embodiment described above can be combined arbitrarily, to keep description succinct, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, it is all considered to be the range of this specification record.
Several embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the protection of the present invention
Range.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (10)
1. a kind of data processing task executes method, it is applied to execute server, which is characterized in that the method includes：
Receive the task notice distribution that Distributor is sent；
Task identification in extraction task notice distribution generates task execution request according to the task identification, and by generation
Task execution request is sent to sequence server；
The ranking results acquisition request for carrying the task identification is sent to the sequence server, receives the sequence service
The execute server ranking results that device returns, the execute server ranking results are the sequence server according to the sequence
As a result obtain what the task identification in request was found；The execute server ranking results are being received by the sequence server
After the task execution request sent to each execute server, requested to generate according to the task execution；
It determines sorting position of the local execute server in the server orders result, whether judges the sorting position
Within the scope of predetermined order；
When within the scope of judging the sorting position in predetermined order, sends task to Distributor and obtain request, task
It includes task identification to obtain request, receives the task identification that the Distributor is obtained according to the task in request and inquires
The data processing task arrived and execution；In the execute server data processing task is got from the Distributor
Afterwards, then the Distributor locks the data processing task.
2. according to the method described in claim 1, it is characterized in that, task identification in the extraction task notice distribution, root
Task execution request is generated according to the task identification, and the task execution of generation is asked after being sent to sequence server, also
Including：
The ballot request that the sequence server is initiated is received, the ballot request executes holding for data processing task for choosing
Row server；
Vote information is requested to generate according to the ballot；
The vote information is sent to the sequence server, the sequence server is made respectively to execute service according to what is received
The vote information that device returns generates execute server ranking results.
3. according to the method described in claim 1, it is characterized in that, task identification in the extraction task notice distribution, root
Task execution request is generated according to the task identification, and the task execution of generation is asked after being sent to sequence server, also
Including：
It receives the sequence server and sends resource utilization acquisition request；
Request extraction resource utilization is obtained according to the resource utilization, the resource utilization extracted is back to the row
Sequence server makes the resource utilization generation that the sequence server is returned according to each execute server received execute service
Device ranking results.
4. according to the method described in claim 1, it is characterized in that, the determining local execute server is in the server
Sorting position in ranking results judges the sorting position whether within the scope of predetermined order, including：
First execute server mark is come in extraction execute server ranking results；
The execute server extracted is identified and is compared with self identification；
If the execute server mark extracted is consistent with the self identification, the row of local execute server is judged
Tagmeme is set within the scope of predetermined order.
5. according to the method described in claim 1, it is characterized in that, it is described to Distributor send task obtain request, appoint
It includes task identification that business, which obtains request, receives the Distributor and is looked into according to the task identification in task acquisition request
The data processing task ask and execution, including：
It is sent to the Distributor and carries the task acquisition request that execute server identifies；
Data processing task is received, the data processing task is the Distributor according to execute server ranking results pair
What the execute server identity verification returned after passing through.
6. a kind of data processing task executive device, it is applied to execute server, which is characterized in that described device includes：
Notice distribution receiving module, the task notice distribution for receiving Distributor transmission；
Request sending module is executed, for extracting the task identification in task notice distribution, is generated and is appointed according to the task identification
Business executes request, and the request of the task execution of generation is sent to sequence server；
Ranking results acquisition module, for sending the ranking results acquisition for carrying the task identification to the sequence server
Request receives the execute server ranking results that the sequence server returns, and the execute server ranking results are described
Sequence server obtains what the task identification in request was found according to the ranking results；The execute server ranking results
By the sequence server after receiving the task execution request that each execute server is sent, asked according to the task execution
It generates；
Sorting position judgment module, for determining sequence position of the local execute server in the server orders result
It sets, judges the sorting position whether within the scope of predetermined order；
Data task acquisition module obtains request for sending task to Distributor, and it includes task that task, which obtains request,
Mark receives the Distributor and obtains the data processing task that inquires of task identification in request simultaneously according to the task
It executes；In the execute server after the Distributor gets the data processing task, then the distribution service
Device locks the data processing task.
7. device according to claim 6, which is characterized in that described device further includes：
Ballot request receiving module, the ballot request initiated for receiving the sequence server, the ballot request is for selecting
Take the execute server for executing data processing task；
Vote information generation module, for requesting to generate vote information according to the ballot；
Vote information sending module makes the sequence server for the vote information to be sent to the sequence server
Execute server ranking results are generated according to the vote information that each execute server received returns.
8. device according to claim 6, which is characterized in that described device further includes：
Request receiving module is obtained, resource utilization acquisition request is sent for receiving the sequence server；
Resource utilization returns to module, for obtaining request extraction resource utilization according to the resource utilization, will extract
Resource utilization be back to the sequence server, make it is described sequence server according to receive each execute server return
Resource utilization generate execute server ranking results.
9. device according to claim 6, which is characterized in that the sorting position judgment module includes：
Marker extraction module, for extracting the execute server mark for coming first in execute server ranking results；
Comparing module being identified, being compared with self identification for identifying the execute server extracted；
Sort determining module, if consistent with the self identification for the execute server mark extracted, judges this
The sorting position of the execute server on ground is within the scope of predetermined order.
10. device according to claim 6, which is characterized in that the data task acquisition module includes：
Task requests sending module is asked for carrying the task acquisition that execute server identifies to Distributor transmission
It asks；
Data task receiving module, for receiving data processing task, the data processing task is the Distributor root
It is returned after passing through to the execute server identity verification according to execute server ranking results.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610702453.8A CN106407002B (en) | 2016-08-22 | 2016-08-22 | Data processing task executes method and apparatus |
| PCT/CN2017/079649 WO2018036168A1 (en) | 2016-08-22 | 2017-04-07 | Method and device for executing data processing task, execution server, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610702453.8A CN106407002B (en) | 2016-08-22 | 2016-08-22 | Data processing task executes method and apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106407002A CN106407002A (en) | 2017-02-15 |
| CN106407002B true CN106407002B (en) | 2018-07-13 |
Family
ID=58004231
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610702453.8A Active CN106407002B (en) | 2016-08-22 | 2016-08-22 | Data processing task executes method and apparatus |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106407002B (en) |
| WO (1) | WO2018036168A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407002B (en) * | 2016-08-22 | 2018-07-13 | 平安科技（深圳）有限公司 | Data processing task executes method and apparatus |
| CN109582451A (en) * | 2018-11-21 | 2019-04-05 | 金色熊猫有限公司 | Method for scheduling task, system, equipment and readable medium |
| CN109582723B (en) * | 2018-11-30 | 2021-08-17 | 深圳市思迪信息技术股份有限公司 | Distributed ETL data acquisition method and device |
| CN110888925B (en) * | 2019-10-11 | 2022-06-17 | 广州大气候农业科技有限公司 | Data loading and distributing method and device and storage medium |
| CN113452753B (en) * | 2021-05-21 | 2022-09-30 | 北京奇艺世纪科技有限公司 | Data distribution method, device, equipment and storage medium |
| CN113901008B (en) * | 2021-11-10 | 2022-09-27 | 上海意略明数字科技股份有限公司 | Data processing method and device, storage medium and computing equipment |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101132393B (en) * | 2006-08-25 | 2010-11-17 | 郑州威科姆科技股份有限公司 | Stream media service dynamic load method |
| US8224825B2 (en) * | 2010-05-31 | 2012-07-17 | Microsoft Corporation | Graph-processing techniques for a MapReduce engine |
| CN104023042B (en) * | 2013-03-01 | 2017-05-24 | 清华大学 | Cloud platform resource scheduling method |
| CN103580922B (en) * | 2013-11-08 | 2016-08-17 | 国家电网公司 | A kind of powerline network application server overload controlling method based on hybrid optimization |
| CN104038540B (en) * | 2014-06-03 | 2017-03-22 | 山东乾云启创信息科技股份有限公司 | Method and system for automatically selecting application proxy server |
| CN104618492B (en) * | 2015-02-11 | 2018-02-06 | 北京金和软件股份有限公司 | A kind of data handling system based on multiple servers |
| CN105100280B (en) * | 2015-08-31 | 2019-09-13 | 广州酷狗计算机科技有限公司 | Method for allocating tasks and device |
| CN106407002B (en) * | 2016-08-22 | 2018-07-13 | 平安科技（深圳）有限公司 | Data processing task executes method and apparatus |
-
2016
- 2016-08-22 CN CN201610702453.8A patent/CN106407002B/en active Active
-
2017
- 2017-04-07 WO PCT/CN2017/079649 patent/WO2018036168A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN106407002A (en) | 2017-02-15 |
| WO2018036168A1 (en) | 2018-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106407002B (en) | Data processing task executes method and apparatus | |
| CN108268372B (en) | Mock test processing method and device, storage medium and computer equipment | |
| CN110267214A (en) | A kind of note transmission method, server and storage medium | |
| CN109995859A (en) | A kind of dispatching method, dispatch server and computer readable storage medium | |
| CN108256706B (en) | Task allocation method and device | |
| CN103391206B (en) | A kind of method for scheduling task and device thereof | |
| US8572621B2 (en) | Selection of server for relocation of application program based on largest number of algorithms with identical output using selected server resource criteria | |
| US10284561B2 (en) | Method and server for providing image captcha | |
| CN108399101A (en) | The methods, devices and systems of scheduling of resource | |
| CN106407244A (en) | Multi-database-based data query method, system and apparatus | |
| CN108616553B (en) | Method and device for resource scheduling of cloud computing resource pool | |
| CN110362473A (en) | Test optimization method and device, storage medium, the terminal of environment | |
| CN110737818A (en) | Network release data processing method and device, computer equipment and storage medium | |
| CN111416727A (en) | VNF uploading instantiation method and device | |
| CN116319777A (en) | Intelligent gateway service processing method based on edge calculation | |
| CN109067645B (en) | Network element equipment connected with NFV virtual security gateway | |
| CN109286617B (en) | Data processing method and related equipment | |
| CN106713163A (en) | Method and apparatus for deploying server load | |
| CN109242391A (en) | A kind of cargo recognition methods and device | |
| CN111949411A (en) | Resource allocation method, device, computer equipment and computer readable storage medium | |
| CN112084021A (en) | Interface configuration method, device and equipment of education system and readable storage medium | |
| CN115239450A (en) | Financial data processing method and device, computer equipment and storage medium | |
| CN113411236A (en) | Quality difference router detection method, quality difference router detection device, quality difference router detection equipment and storage medium | |
| CN109412898A (en) | Characteristic library generating method and device and corresponding flow method for sorting and device | |
| CN112508527A (en) | Service processing method, device and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |