WO2018036168A1 - Method and device for executing data processing task, execution server, and storage medium - Google Patents

Method and device for executing data processing task, execution server, and storage medium Download PDF

Info

Publication number
WO2018036168A1
WO2018036168A1 PCT/CN2017/079649 CN2017079649W WO2018036168A1 WO 2018036168 A1 WO2018036168 A1 WO 2018036168A1 CN 2017079649 W CN2017079649 W CN 2017079649W WO 2018036168 A1 WO2018036168 A1 WO 2018036168A1
Authority
WO
WIPO (PCT)
Prior art keywords
server
sorting
execution
task
execution server
Prior art date
Application number
PCT/CN2017/079649
Other languages
French (fr)
Chinese (zh)
Inventor
吴亮平
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2018036168A1 publication Critical patent/WO2018036168A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/503Resource availability

Definitions

  • the present application relates to the field of computer application technologies, and in particular, to a data processing task execution method, apparatus, execution server, and storage medium.
  • a plurality of execution servers are provided.
  • multiple execution services monitor the generation of data processing tasks, the data processing tasks are acquired, and the acquired data processing tasks are executed, so that multiple executions are performed.
  • the server is performing data processing tasks, which causes a data processing task to be repeatedly executed by multiple execution servers, which causes a data processing task to consume too much resources, resulting in waste of data processing resources.
  • a data processing task execution method is provided.
  • a data processing task execution method includes:
  • the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
  • the data processing task is acquired from the distribution server and executed.
  • a data processing task execution device includes:
  • a distribution notification receiving module configured to receive a task distribution notification sent by the distribution server
  • a request sending module configured to send a task execution request to the sorting server according to the task distribution notification
  • a sorting result obtaining module configured to obtain an execution server sorting result from the sorting server, where the sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
  • a sorting position determining module configured to determine a sorting position of the execution server in the sorting result of the execution server, and determine whether the sorting position is within a preset sorting range
  • a data task obtaining module configured to acquire the data processing task from the distribution server and execute when determining that the sorting position is within a preset sorting range.
  • An execution server comprising a memory and a processor, wherein the memory stores computer executable instructions that, when executed by the processor, cause the processor to perform the following steps:
  • the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
  • the data processing task is acquired from the distribution server and executed.
  • One or more non-volatile storage media storing computer-executable instructions, when executed by one or more processors, cause the one or more processors to perform the following steps:
  • the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
  • the data processing task is acquired from the distribution server and executed.
  • FIG. 1 is an application environment diagram of a data processing task execution system in an embodiment
  • FIG. 2 is a functional block diagram of an execution server in a data processing task execution system in an embodiment
  • FIG. 3 is a schematic flow chart of a method for executing a data processing task in an embodiment
  • FIG. 4 is a schematic flowchart of a step of generating an execution server sorting result according to voting information in an embodiment
  • FIG. 5 is a schematic flowchart of a step of generating an execution server ranking result according to resource utilization in an embodiment
  • FIG. 6 is a flow chart showing the steps of determining the permission to execute a data processing task according to the execution server sorting result in one embodiment
  • FIG. 7 is a functional block diagram of a data processing task execution apparatus in an embodiment
  • FIG. 8 is a functional block diagram of a data processing task execution apparatus in another embodiment
  • FIG. 9 is a functional block diagram of a data processing task execution apparatus in still another embodiment.
  • FIG. 10 is a functional block diagram of a sort position determining module in an embodiment
  • Figure 11 is a functional block diagram of a data task acquisition module in one embodiment.
  • the data processing task execution system includes an execution server 110, a distribution server 120, and a sorting server 130.
  • the execution server 110 is connected to the distribution server 120 through a network, and the execution server 110 is connected to the sorting server 130 through a network, wherein the execution server 110, the distribution server 120, and the sorting server 130 may specifically be plural, and the distribution server 120 and the sorting server 130 may be integrated. On the same server.
  • the execution server 110 includes a processor, a non-volatile storage medium, an internal memory, and a network interface connected by a system bus.
  • the processor is used to provide computing and control capabilities to support the operation of the entire execution server 110.
  • the non-volatile storage medium of the execution server 110 stores operating system and computer executable instructions.
  • the computer executable instructions are executable by a processor to implement a data processing task execution method as provided by the following embodiments.
  • the internal memory in the execution server 120 provides a cached operating environment for operating systems and computer executable instructions in a non-volatile storage medium.
  • the network interface is used for network communication with the distribution server 120 and the sorting server 130. It can be understood that the execution server 110 can be implemented by a separate server or a server cluster composed of a plurality of servers.
  • FIG. 2 is only a partial functional module diagram related to the solution of the present application, and does not constitute a limitation on the application server and the execution server thereon, and the specific execution server may include More or fewer components than shown in Figure 2, or some components are combined, or have different component arrangements.
  • a data processing task execution method is provided.
  • the method is specifically applied to the execution server 110 of the data processing task execution system of FIG. 1 to illustrate that the execution is performed on the server 110.
  • a data processing task execution program a data processing task processing program is used to implement a data processing task processing method, and the data processing task processing method specifically includes the following contents:
  • the distribution server 120 acquires the task identifier of the data processing task, generates a task distribution notification according to the task identifier, and sends the task distribution notification to each execution server, where the task can be specifically broadcasted.
  • the distribution notification is sent to each execution server 110.
  • the data processing task may also be that the distribution server 120 receives the task creation command sent by the terminal, creates a data processing task according to the task creation command, and generates a task identifier for the created data processing task.
  • the execution server 110 extracts the task identifier in the task distribution notification, generates a task execution request according to the task identifier, and sends the generated task execution request to the sorting server 130.
  • the execution server sorting result is generated by the sorting server after receiving the task execution request by each execution server, according to the task execution request.
  • the sorting server 130 when receiving the task execution request sent by the execution server 110, the sorting server 130 records the receiving time of each task execution request, extracts the execution server identifier in the task execution request, and performs the receiving time of each request according to the recorded task. Sorting the execution server identifiers in the task execution, sorting the execution server identifiers according to the receiving time to obtain the execution server sorting result, the sorting server 130 extracting the task identifiers in the task execution request, and storing the execution server sorting results and the task identifiers correspondingly, Each task ID corresponds to an execution server sort result.
  • the execution server 110 sends a sort result acquisition request carrying the task identifier to the sorting server.
  • the sorting server 130 After receiving the sort result obtaining request, the sorting server 130 extracts the task identifier in the sort result obtaining request, and searches the execution server sorting result corresponding to the task identifier, and the sorting server 130 The found execution server sort result is returned to the execution server 110.
  • the execution server 110 searches for the sorting position of the self-identification in the execution server sorting result, and compares the sorting position according to the self-identification with the preset sorting position range, if the self-identification If the sorting position is within the preset sorting position range, it is determined that the right to execute the data processing task is determined; if the sorting position of the self-identification is not within the preset sorting position range, it is determined that the right to execute the data processing task is not performed.
  • the data processing task is acquired from the distribution server and executed.
  • the execution server 110 sends a task acquisition request to the distribution server 120, where the task acquisition request includes the task identifier.
  • the distribution server 120 extracts the task identifier in the task acquisition request, searches the data processing task according to the task identifier, and sends the found data processing task to the execution server 110.
  • the distribution server 120 locks the data processing task, and when the distribution server 120 receives the acquisition request to acquire the data processing task, The acquisition request is rejected; specifically, a lock flag may be added for the task identifier corresponding to the data processing task.
  • the S310 specifically includes: sending a task acquisition request carrying the execution server identifier to the distribution server; receiving the data processing task, and the data processing task is: the distribution server returns the execution server identifier according to the execution server sorting result. of.
  • the execution server 110 transmits a task acquisition request carrying the execution server identifier to the distribution server 120.
  • the distribution server 120 obtains the execution server ranking result from the sorting server 130.
  • the distribution server 120 extracts the execution server identifier in the task request, and determines the sorting of the execution server identifier according to the execution server sorting result. a location, thereby verifying whether the execution server 110 corresponding to the execution server identifier has the right to execute the data processing task, and after the verification is passed, searching for the corresponding data processing task according to the task identifier in the task acquisition request, and returning the found data processing task to
  • the execution server 110 corresponding to the server identifier is executed.
  • the task distribution request is sent to the sorting server according to the task distribution notification, and the sorting server sorts and executes the execution server according to the received task execution request sent by each execution server.
  • Server sort results The execution server obtains the execution server sort result from the sort server, and obtains the data processing task from the distribution server and executes when determining the right to execute the data processing task according to the execution server sort result.
  • the number of execution servers having the permission to execute the data processing task is controlled, thereby avoiding the situation in which the plurality of execution servers acquire the task distribution notification and simultaneously acquire the data processing task from the distribution server, causing data congestion. It also avoids situations where data processing tasks are repeatedly executed by multiple execution servers, thereby saving data processing resources consumed when performing data processing tasks.
  • the method further includes the step of generating a server ranking result according to the voting information, where the step specifically includes the following content:
  • S402. Receive a voting request initiated by the sorting server, where the voting request is used to select an execution server that performs a data processing task.
  • the sorting server 130 extracts the execution server identifier in the task execution request, generates a voting request according to the obtained multiple execution server identifiers, and uses the voting request to select the execution data.
  • the execution server 110 of the processing task After receiving the task execution request sent by each execution server, the sorting server 130 extracts the execution server identifier in the task execution request, generates a voting request according to the obtained multiple execution server identifiers, and uses the voting request to select the execution data.
  • the execution server 110 of the processing task is Specifically, after receiving the task execution request sent by each execution server, the sorting server 130 extracts the execution server identifier in the task execution request, generates a voting request according to the obtained multiple execution server identifiers, and uses the voting request to select the execution data.
  • the execution server 110 of the processing task After receiving the task execution request sent by each execution server, the sorting server 130 extracts the execution server identifier in the task execution request, generates a voting request according to the obtained multiple execution server identifiers, and uses
  • the execution server 110 extracts multiple execution server identifiers in the voting request, selects one execution server identifier from the extracted multiple execution server identifiers, and uses the selected execution server identifier as the voting information.
  • the execution server 110 after receiving the voting request, selects an execution server identifier from the stored plurality of execution server identifiers, and uses the selected execution server identifier as the voting information.
  • the execution server 110 transmits the voting information to the sorting server 130 after generating the voting information.
  • the sorting server 130 extracts the execution server identifier in the voting information, counts the number of votes of each execution server identifier, and performs server sorting according to the counted number of votes to obtain the execution server sorting result. Specifically, it can be sorted according to the number of votes from high to low, and can also be sorted from low to high.
  • the voting information is generated according to the voting request, and the voting information is sent to the sorting server, so that the sorting server performs the execution of the server identifier according to the received voting information returned by each executing server.
  • S504 specifically includes the step of generating a server ranking result according to resource utilization, and the step specifically includes the following:
  • the receiving sorting server sends a resource utilization obtaining request.
  • the sorting server 130 after receiving the task execution request sent by each execution server, the sorting server 130 sends a resource utilization acquisition request to each execution server, and the resource utilization acquisition request is used to acquire the resource utilization rate of each execution server.
  • S504 Extract resource utilization according to the resource utilization acquisition request, return the extracted resource utilization to the sorting server, and cause the sorting server to generate an execution server sorting result according to the received resource utilization returned by each execution server.
  • the execution server 110 acquires the resource utilization parameter, calculates the resource utilization rate according to the resource utilization parameter, and sends the resource utilization rate to the sorting server 130.
  • the sorting server 130 compares the resource utilization rates, and sorts the execution server identifiers corresponding to the resource utilization according to the comparison result, which may be according to the resource utilization rate from low to high or by The high-to-low order sorts the execution server IDs to get the execution server sort results.
  • the resource utilization rate is returned according to the resource utilization acquisition request sent by the sorting server, so that the sorting server sorts the execution server identifier according to the resource utilization rate to generate an execution server sorting result, and determines the resource utilization rate according to the resource utilization rate of the execution server.
  • Lower execution servers perform data processing tasks, increasing the efficiency of data processing tasks.
  • S308 specifically includes the step of determining the permission to execute the data processing task according to the execution server sorting result, and the step specifically includes the following content:
  • the execution server 110 extracts the first execution server identifier from the execution server sort result.
  • the execution server sorting result may be arranged according to the number of votes obtained by the execution server identifier from high to low, and the first is the execution server identifier with the highest number of votes; or may be the resource utilization rate of the execution server corresponding to the execution server identifier.
  • the execution server identifier is sorted from low to high, and the execution server identifier of the execution server with the lower resource utilization rate ranked first.
  • the execution server 110 compares the extracted execution server identifier with the self identifier after extracting the first execution server identifier from the execution server sort result.
  • the self identification is an execution server identifier corresponding to the execution server 110.
  • the execution server 110 compares the extracted execution server identifier with the self identifier, if the comparison, the extracted execution server identifier is consistent with the self identifier, indicating that the execution server 110 has the permission to execute the data processing task, The execution server 110 acquires a data processing task from the distribution server and executes it.
  • the execution server identifier ranked first in the execution server sorting result compares the execution server identifier ranked first with the self identifier, and determines whether the user has the permission to execute the data processing task according to the comparison result. This avoids all the execution servers performing data processing tasks, resulting in wasted data processing resources.
  • a data processing task execution apparatus 700 is provided.
  • the apparatus specifically includes: a distribution notification receiving module 702, an execution request sending module 704, a sorting result obtaining module 706, and a sorting position determining module 708. And data task acquisition module 710.
  • the distribution notification receiving module 702 is configured to receive a task distribution notification sent by the distribution server.
  • the execution request sending module 704 is configured to send a task execution request to the sorting server according to the task distribution notification.
  • the sort result obtaining module 706 is configured to obtain an execution server sorting result from the sorting server, and the execution server sorting result is generated by the sorting server according to the task execution request after receiving the task execution request sent by each execution server.
  • the sorting position determining module 708 is configured to determine a sorting position of the execution server in the server sorting result, and determine whether the sorting position is within a preset sorting range.
  • the data task obtaining module 710 is configured to acquire a data processing task from the distribution server and execute when determining that the sorting position is within a preset sorting range.
  • the task distribution request is sent to the sorting server according to the task distribution notification, and the sorting server sorts and executes the execution server according to the received task execution request sent by each execution server.
  • Server sort results The execution server obtains the execution server sort result from the sorting server, and obtains the data processing task from the distribution server and executes when determining that the sorting position of the execution server is within the preset sorting range according to the execution server sorting result.
  • the number of execution servers having the permission to execute the data processing task is controlled, thereby avoiding the situation in which the plurality of execution servers acquire the task distribution notification and simultaneously acquire the data processing task from the distribution server, causing data congestion. It also avoids situations where data processing tasks are repeatedly executed by multiple execution servers, thereby saving data processing resources consumed when performing data processing tasks.
  • the data processing task execution apparatus 700 specifically includes: a voting request receiving module 712, a voting information generating module 714, and a voting information sending module 716.
  • the voting request receiving module 712 is configured to receive a voting request initiated by the sorting server, and the voting request is used to select an execution server that performs a data processing task.
  • the voting information generating module 714 is configured to generate voting information according to the voting request.
  • the voting information sending module 716 is configured to send the voting information to the sorting server, and cause the sorting server to generate an execution server sorting result according to the received voting information returned by each execution server.
  • the voting information is generated according to the voting request, and the voting information is sent to the sorting server, so that the sorting server performs the execution of the server identifier according to the received voting information returned by each executing server.
  • the data processing task execution apparatus 700 specifically includes an acquisition request receiving module 718 and a resource utilization returning module 720.
  • the obtaining request receiving module 718 is configured to receive the sorting server to send a resource utilization obtaining request.
  • the resource utilization returning module 720 is configured to extract the resource utilization rate according to the resource utilization acquisition request, and return the extracted resource utilization rate to the sorting server, so that the sorting server generates an execution server according to the received resource utilization rate returned by each execution server. Sort results.
  • the resource utilization rate is returned according to the resource utilization acquisition request sent by the sorting server, so that the sorting server sorts the execution server identifier according to the resource utilization rate to generate an execution server sorting result, and determines whether the execution can be performed according to the resource utilization rate of the execution server.
  • Data processing tasks increase the efficiency of data processing tasks.
  • the sorting position determining module 708 specifically includes an identifier extracting module 708a, an identifier matching module 708b, and a sorting determining module 708c.
  • the identifier extraction module 708a is configured to extract the execution server identifier ranked first in the execution server sort result.
  • the identifier matching module 708b is configured to compare the extracted execution server identifier with the own identifier.
  • the order determining module 708c is configured to determine that the sorting position of the execution server is within a preset sorting range if the extracted execution server identifier is consistent with the self identifier.
  • the execution server identifier ranked first in the execution server sorting result is compared with the first execution server identifier and the self identifier, and the ranking position of the execution server is determined according to the comparison result.
  • the ranking position of the execution server is determined according to the comparison result.
  • the data task obtaining module 710 specifically includes: a task request sending module 710a and a data task receiving module 710b.
  • the task request sending module 710a is configured to send a task acquisition request carrying the execution server identifier to the distribution server.
  • the data task receiving module 710b is configured to receive a data processing task, and the data processing task is returned by the distribution server after the execution server identification is verified according to the execution server sorting result.
  • the execution server identifier in the task acquisition request is verified according to the execution server sorting result to ensure data security in the distribution server, and no additional verification information is needed.
  • the various modules in the data processing task execution apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof.
  • the network interface may be an Ethernet or a wireless network card.
  • Each of the above modules may be embedded in a hardware form or independent of a processor in the server, or may be stored in a memory of the server in a software form, so that the processor invokes the operations corresponding to the above modules.
  • the processor can be a central processing unit (CPU), a microprocessor, a microcontroller, or the like.
  • the storage medium may be a magnetic disk, an optical disk, or a read-only storage memory (Read-Only) Memory, ROM) or Random Access Memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A method for executing a data processing task comprises: receiving a task distribution notification sent by a distribution server; sending, to a sorting server, and according to the task distribution notification, a task execution request; acquiring, from the sorting server, a sorting result of execution servers, the sorting result of the execution servers being generated by the sorting server according to task execution requests received from the respective execution servers; ascertaining a sort position of a current execution server in the sorting result of the execution servers, and determining whether the sort position is within a preset range; and if so, acquiring, from the distribution server, a data processing task, and executing the same.

Description

数据处理任务执行方法、装置、执行服务器和存储介质Data processing task execution method, device, execution server, and storage medium
本申请要求于 2016 年 8 月 22 日提交中国专利局、申请号为 201610702453.8 、发明名称为'数据处理任务执行方法和装置'的中国专利申请的优先权,其全部内容通过引用结合在本申请中。  This application is submitted to the Chinese Patent Office on August 22, 2016, and the application number is 201610702453.8. The title of the invention is the priority of the Chinese Patent Application for the 'Data Processing Task Execution Method and Apparatus', the entire contents of which are hereby incorporated by reference.
【技术领域】[Technical Field]
本申请涉及计算机应用技术领域,尤其涉及一种数据处理任务执行方法、装置、执行服务器和存储介质。The present application relates to the field of computer application technologies, and in particular, to a data processing task execution method, apparatus, execution server, and storage medium.
【背景技术】【Background technique】
在数据处理技术领域,对数据进行处理时,往往需要建立数据处理任务,并将建立的数据处理任务发送至执行服务器,执行服务器获取到数据处理任务并执行。In the field of data processing technology, when processing data, it is often necessary to establish a data processing task, and send the established data processing task to the execution server, and the execution server acquires the data processing task and executes it.
然而,在传统的数据处理领域中,设置有多台执行服务器,当多台执行服务监测到有数据处理任务生成时,都会获取数据处理任务,并执行获取到的数据处理任务,这样多台执行服务器都在执行数据处理任务,会导致一个数据处理任务被多台执行服务器重复的执行,使得一个数据处理任务时耗费过多的资源,造成了数据处理资源的浪费。However, in the traditional data processing field, a plurality of execution servers are provided. When multiple execution services monitor the generation of data processing tasks, the data processing tasks are acquired, and the acquired data processing tasks are executed, so that multiple executions are performed. The server is performing data processing tasks, which causes a data processing task to be repeatedly executed by multiple execution servers, which causes a data processing task to consume too much resources, resulting in waste of data processing resources.
【发明内容】 [Summary of the Invention]
根据本申请公开的各种实施例,提供一种数据处理任务执行方法、装置、执行服务器和存储介质。According to various embodiments disclosed herein, a data processing task execution method, apparatus, execution server, and storage medium are provided.
一种数据处理任务执行方法,包括:A data processing task execution method includes:
接收分发服务器发送的任务分发通知;Receiving a task distribution notification sent by the distribution server;
根据所述任务分发通知向排序服务器发送任务执行请求;Sending a task execution request to the sorting server according to the task distribution notification;
从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;Obtaining an execution server sorting result from the sorting server, the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及Determining a sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range; and
在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
一种数据处理任务执行装置,包括:A data processing task execution device includes:
分发通知接收模块,用于接收分发服务器发送的任务分发通知;a distribution notification receiving module, configured to receive a task distribution notification sent by the distribution server;
执行请求发送模块,用于根据所述任务分发通知向排序服务器发送任务执行请求;And executing a request sending module, configured to send a task execution request to the sorting server according to the task distribution notification;
排序结果获取模块,用于从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;a sorting result obtaining module, configured to obtain an execution server sorting result from the sorting server, where the sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
排序位置判断模块,用于确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及a sorting position determining module, configured to determine a sorting position of the execution server in the sorting result of the execution server, and determine whether the sorting position is within a preset sorting range; and
数据任务获取模块,用于在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。And a data task obtaining module, configured to acquire the data processing task from the distribution server and execute when determining that the sorting position is within a preset sorting range.
一种执行服务器,包括存储器和处理器,所述存储器中存储有计算机可执行指令,所述计算机可执行指令被所述处理器执行时,使得所述处理器执行以下步骤:An execution server comprising a memory and a processor, wherein the memory stores computer executable instructions that, when executed by the processor, cause the processor to perform the following steps:
接收分发服务器发送的任务分发通知;Receiving a task distribution notification sent by the distribution server;
根据所述任务分发通知向排序服务器发送任务执行请求;Sending a task execution request to the sorting server according to the task distribution notification;
从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;Obtaining an execution server sorting result from the sorting server, the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及Determining a sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range; and
在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
一个或多个存储有计算机可执行指令的非易失性存储介质,所述计算机可执行指令被一个或多个处理器执行时,使得所述一个或多个处理器执行以下步骤:One or more non-volatile storage media storing computer-executable instructions, when executed by one or more processors, cause the one or more processors to perform the following steps:
接收分发服务器发送的任务分发通知;Receiving a task distribution notification sent by the distribution server;
根据所述任务分发通知向排序服务器发送任务执行请求;Sending a task execution request to the sorting server according to the task distribution notification;
从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;Obtaining an execution server sorting result from the sorting server, the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及Determining a sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range; and
在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
本申请的一个或多个实施例的细节在下面的附图和描述中提出。本申请的其它特征、目的和优点将从说明书、附图以及权利要求书变得明显。Details of one or more embodiments of the present application are set forth in the accompanying drawings and description below. Other features, objects, and advantages of the invention will be apparent from the description and appended claims.
【附图说明】[Description of the Drawings]
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present application, and other drawings can be obtained according to the drawings without any creative work for those skilled in the art.
图1为一个实施例中数据处理任务执行系统的应用环境图;1 is an application environment diagram of a data processing task execution system in an embodiment;
图2为一个实施例中数据处理任务执行系统中执行服务器的功能模块图;2 is a functional block diagram of an execution server in a data processing task execution system in an embodiment;
图3为一个实施例中数据处理任务执行方法的流程示意图;3 is a schematic flow chart of a method for executing a data processing task in an embodiment;
图4为一个实施例中根据投票信息生成执行服务器排序结果的步骤的流程示意图;4 is a schematic flowchart of a step of generating an execution server sorting result according to voting information in an embodiment;
图5为一个实施例中根据资源利用率生成执行服务器排名结果的步骤的流程示意图;FIG. 5 is a schematic flowchart of a step of generating an execution server ranking result according to resource utilization in an embodiment; FIG.
图6为一个实施例中根据执行服务器排序结果确定执行数据处理任务权限的步骤的流程示意图;6 is a flow chart showing the steps of determining the permission to execute a data processing task according to the execution server sorting result in one embodiment;
图7为一个实施例中数据处理任务执行装置的功能模块图;7 is a functional block diagram of a data processing task execution apparatus in an embodiment;
图8为另一个实施例中数据处理任务执行装置的功能模块图;8 is a functional block diagram of a data processing task execution apparatus in another embodiment;
图9为又一个实施例中数据处理任务执行装置的功能模块图;FIG. 9 is a functional block diagram of a data processing task execution apparatus in still another embodiment; FIG.
图10为一个实施例中排序位置判断模块的功能模块图;10 is a functional block diagram of a sort position determining module in an embodiment;
图11为一个实施例中数据任务获取模块的功能模块图。Figure 11 is a functional block diagram of a data task acquisition module in one embodiment.
【具体实施方式】 【detailed description】
体现本申请特征与优点的典型实施方式将在以下的说明中详细叙述。应理解的是本申请能够在不同的实施方式上具有各种的变化,其皆不脱离本申请的范围,且其中的说明及图示在本质上是当作说明之用,而非用以限制本申请。Exemplary embodiments embodying the features and advantages of the present application will be described in detail in the following description. It should be understood that the present invention is capable of various modifications in the various embodiments, and This application.
图1为一个实施例中数据处理任务执行系统的应用环境图,数据处理任务执行系统包括执行服务器110、分发服务器120和排序服务器130。执行服务器110通过网络与分发服务器120连接,执行服务器110通过网络与排序服务器130连接,其中执行服务器110、分发服务器120和排序服务器130具体可以是多个,分发服务器120和排序服务器130可以为集成于同一服务器。1 is an application environment diagram of a data processing task execution system in an embodiment. The data processing task execution system includes an execution server 110, a distribution server 120, and a sorting server 130. The execution server 110 is connected to the distribution server 120 through a network, and the execution server 110 is connected to the sorting server 130 through a network, wherein the execution server 110, the distribution server 120, and the sorting server 130 may specifically be plural, and the distribution server 120 and the sorting server 130 may be integrated. On the same server.
图2为一个实施例中图1数据处理任务执行系统中的执行服务器110的功能模块图。如图2所示,执行服务器110包括通过系统总线连接的处理器、非易失性存储介质、内存储器和网络接口。该处理器用于提供计算和控制能力,支撑整个执行服务器110的运行。执行服务器110的非易失性存储介质存储有操作系统和计算机可执行指令。该计算机可执行指令可被处理器执行以实现以下各实施例所提供的一种数据处理任务执行方法。执行服务器120中的内存储器为非易失性存储介质中的操作系统和计算机可执行指令提供高速缓存的运行环境。网络接口用于与分发服务器120和排序服务器130进行网络通信。可以理解,执行服务器110可以用独立的服务器或者多个服务器组成的服务器集群来实现。2 is a functional block diagram of the execution server 110 in the data processing task execution system of FIG. 1 in one embodiment. As shown in FIG. 2, the execution server 110 includes a processor, a non-volatile storage medium, an internal memory, and a network interface connected by a system bus. The processor is used to provide computing and control capabilities to support the operation of the entire execution server 110. The non-volatile storage medium of the execution server 110 stores operating system and computer executable instructions. The computer executable instructions are executable by a processor to implement a data processing task execution method as provided by the following embodiments. The internal memory in the execution server 120 provides a cached operating environment for operating systems and computer executable instructions in a non-volatile storage medium. The network interface is used for network communication with the distribution server 120 and the sorting server 130. It can be understood that the execution server 110 can be implemented by a separate server or a server cluster composed of a plurality of servers.
本领域技术人员可以理解,图2中示出的结构,仅仅是与本申请方案相关的部分功能模块图,并不构成对本申请方案所应用与其上的执行服务器的限定,具体的执行服务器可以包括比图2中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。It will be understood by those skilled in the art that the structure shown in FIG. 2 is only a partial functional module diagram related to the solution of the present application, and does not constitute a limitation on the application server and the execution server thereon, and the specific execution server may include More or fewer components than shown in Figure 2, or some components are combined, or have different component arrangements.
如图3所示,在一个实施例中,提供一种数据处理任务执行方法,本实施例以该方法具体应用在图1数据处理任务执行系统的执行服务器110上来举例说明,执行服务器110上运行有数据处理任务执行程序,数据处理任务处理程序用于实施数据处理任务处理方法,数据处理任务处理方法具体包括以下内容:As shown in FIG. 3, in one embodiment, a data processing task execution method is provided. In this embodiment, the method is specifically applied to the execution server 110 of the data processing task execution system of FIG. 1 to illustrate that the execution is performed on the server 110. There is a data processing task execution program, a data processing task processing program is used to implement a data processing task processing method, and the data processing task processing method specifically includes the following contents:
S302,接收分发服务器发送的任务分发通知。S302. Receive a task distribution notification sent by the distribution server.
具体地,分发服务器120接收到终端发送的数据处理任务后,获取数据处理任务的任务标识,根据任务标识生成任务分发通知,将任务分发通知发送至各执行服务器,具体可以以广播的形式将任务分发通知发送至各执行服务器110。数据处理任务也可以是在分发服务器120接收到终端发送的任务创建命令,根据任务创建命令创建数据处理任务,并为创建的数据处理任务生成任务标识。Specifically, after receiving the data processing task sent by the terminal, the distribution server 120 acquires the task identifier of the data processing task, generates a task distribution notification according to the task identifier, and sends the task distribution notification to each execution server, where the task can be specifically broadcasted. The distribution notification is sent to each execution server 110. The data processing task may also be that the distribution server 120 receives the task creation command sent by the terminal, creates a data processing task according to the task creation command, and generates a task identifier for the created data processing task.
S304,根据任务分发通知向排序服务器发送任务执行请求。S304. Send a task execution request to the sorting server according to the task distribution notification.
具体地,执行服务器110在接收到分发服务器120发送的任务分发通知后,提取任务分发通知中的任务标识,根据任务标识生成任务执行请求,并将生成的任务执行请求发送至排序服务器130。Specifically, after receiving the task distribution notification sent by the distribution server 120, the execution server 110 extracts the task identifier in the task distribution notification, generates a task execution request according to the task identifier, and sends the generated task execution request to the sorting server 130.
S306,从排序服务器获取执行服务器排序结果,执行服务器排序结果由排序服务器在接收到各执行服务器发送任务执行请求后,根据任务执行请求生成。S306. Acquire an execution server sorting result from the sorting server. The execution server sorting result is generated by the sorting server after receiving the task execution request by each execution server, according to the task execution request.
具体地,排序服务器130在接收到执行服务器110发送的任务执行请求时,记录每个任务执行请求的接收时间,提取任务执行请求中的执行服务器标识,根据记录的每个任务执行请求的接收时间对从任务执行中的执行服务器标识进行排序,按照接收时间对执行服务器标识进行排序得到执行服务器排序结果,排序服务器130提取任务执行请求中的任务标识,将执行服务器排序结果与任务标识对应存储,每个任务标识对应一个执行服务器排序结果。执行服务器110向排序服务器发送携带有任务标识的排序结果获取请求,排序服务器130接收到排序结果获取请求后,提取排序结果获取请求中任务标识,查找任务标识对应的执行服务器排序结果,排序服务器130将查找到的执行服务器排序结果返回至执行服务器110。Specifically, when receiving the task execution request sent by the execution server 110, the sorting server 130 records the receiving time of each task execution request, extracts the execution server identifier in the task execution request, and performs the receiving time of each request according to the recorded task. Sorting the execution server identifiers in the task execution, sorting the execution server identifiers according to the receiving time to obtain the execution server sorting result, the sorting server 130 extracting the task identifiers in the task execution request, and storing the execution server sorting results and the task identifiers correspondingly, Each task ID corresponds to an execution server sort result. The execution server 110 sends a sort result acquisition request carrying the task identifier to the sorting server. After receiving the sort result obtaining request, the sorting server 130 extracts the task identifier in the sort result obtaining request, and searches the execution server sorting result corresponding to the task identifier, and the sorting server 130 The found execution server sort result is returned to the execution server 110.
S308,确定本执行服务器在执行服务器排序结果中的排序位置,判断排序位置是否在预设排序范围之内。S308. Determine a sorting position of the execution server in executing the server sorting result, and determine whether the sorting position is within a preset sorting range.
具体地,执行服务器110在接收到排序服务器130返回的执行服务器排序结果后,在执行服务器排序结果中查找自身标识的排序位置,根据自身标识的排序位置与预设排序位置范围比较,如果自身标识的排序位置在预设排序位置范围之内,则确定具有执行数据处理任务的权限;如果自身标识的排序位置不在预设排序位置范围之内,则确定不具有执行数据处理任务的权限。Specifically, after receiving the execution server sorting result returned by the sorting server 130, the execution server 110 searches for the sorting position of the self-identification in the execution server sorting result, and compares the sorting position according to the self-identification with the preset sorting position range, if the self-identification If the sorting position is within the preset sorting position range, it is determined that the right to execute the data processing task is determined; if the sorting position of the self-identification is not within the preset sorting position range, it is determined that the right to execute the data processing task is not performed.
S310,在判定排序位置在预设排序范围之内时,从分发服务器获取数据处理任务并执行。S310. When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
具体地,执行服务器110在确定具有执行数据处理任务的权限后,向分发服务器120发送任务获取请求,任务获取请求中包括任务标识。分发服务器120在接收到执行服务器110发送的任务获取请求后,提取任务获取请求中的任务标识,根据任务标识查找数据处理任务,将查找到的数据处理任务发送至执行服务器110。Specifically, after determining that the user 110 has the right to execute the data processing task, the execution server 110 sends a task acquisition request to the distribution server 120, where the task acquisition request includes the task identifier. After receiving the task acquisition request sent by the execution server 110, the distribution server 120 extracts the task identifier in the task acquisition request, searches the data processing task according to the task identifier, and sends the found data processing task to the execution server 110.
在一个实施例中,在执行服务器110从分发服务器120获取到数据处理任务后,则分发服务器120将该数据处理任务锁定,当分发服务器120在接收到获取该数据处理任务的获取请求时,则拒绝该获取请求;具体可以为该数据处理任务对应的任务标识添加锁定标记。In one embodiment, after the execution server 110 acquires the data processing task from the distribution server 120, the distribution server 120 locks the data processing task, and when the distribution server 120 receives the acquisition request to acquire the data processing task, The acquisition request is rejected; specifically, a lock flag may be added for the task identifier corresponding to the data processing task.
在一个实施例中,S310具体包括以下内容:向分发服务器发送携带有执行服务器标识的任务获取请求;接收数据处理任务,数据处理任务为分发服务器根据执行服务器排序结果对执行服务器标识验证通过后返回的。In an embodiment, the S310 specifically includes: sending a task acquisition request carrying the execution server identifier to the distribution server; receiving the data processing task, and the data processing task is: the distribution server returns the execution server identifier according to the execution server sorting result. of.
具体地,执行服务器110向分发服务器120发送携带有执行服务器标识的任务获取请求。分发服务器120从排序服务器130获取了执行服务器排序结果,分发服务器120在接收到执行服务器110发送的任务获取请求后,提取任务请求中的执行服务器标识,根据执行服务器排序结果确定执行服务器标识的排序位置,从而验证执行服务器标识对应的执行服务器110是否具有执行数据处理任务的权限,在验证通过后,根据任务获取请求中的任务标识查找对应的数据处理任务,将查找到的数据处理任务返回至执行服务器标识对应的执行服务器110。Specifically, the execution server 110 transmits a task acquisition request carrying the execution server identifier to the distribution server 120. The distribution server 120 obtains the execution server ranking result from the sorting server 130. After receiving the task acquisition request sent by the execution server 110, the distribution server 120 extracts the execution server identifier in the task request, and determines the sorting of the execution server identifier according to the execution server sorting result. a location, thereby verifying whether the execution server 110 corresponding to the execution server identifier has the right to execute the data processing task, and after the verification is passed, searching for the corresponding data processing task according to the task identifier in the task acquisition request, and returning the found data processing task to The execution server 110 corresponding to the server identifier is executed.
本实施例中,在接收到分发服务器发送的任务分发通知后,根据任务分发通知向排序服务器发送任务执行请求,排序服务器根据接收到的各执行服务器发送的任务执行请求对执行服务器进行排序生成执行服务器排序结果。执行服务器从排序服务器获取执行服务器排序结果,在根据执行服务器排序结果确定具有执行数据处理任务的权限时,从分发服务器获取数据处理任务并执行。这样,通过执行服务器排序结果对具有执行数据处理任务权限的执行服务器的数量进行控制,避免了多个执行服务器在接收到任务分发通知时,同时从分发服务器获取数据处理任务造成数据拥塞的情况,也避免了数据处理任务被多个执行服务器重复执行的情况,从而节省了执行数据处理任务时所消耗的数据处理资源。In this embodiment, after receiving the task distribution notification sent by the distribution server, the task distribution request is sent to the sorting server according to the task distribution notification, and the sorting server sorts and executes the execution server according to the received task execution request sent by each execution server. Server sort results. The execution server obtains the execution server sort result from the sort server, and obtains the data processing task from the distribution server and executes when determining the right to execute the data processing task according to the execution server sort result. In this way, by executing the server sorting result, the number of execution servers having the permission to execute the data processing task is controlled, thereby avoiding the situation in which the plurality of execution servers acquire the task distribution notification and simultaneously acquire the data processing task from the distribution server, causing data congestion. It also avoids situations where data processing tasks are repeatedly executed by multiple execution servers, thereby saving data processing resources consumed when performing data processing tasks.
如图4所示,在一个实施例中,S304之后具体还包括根据投票信息生成执行服务器排序结果的步骤,该步骤具体包括以下内容:As shown in FIG. 4, in an embodiment, after S304, the method further includes the step of generating a server ranking result according to the voting information, where the step specifically includes the following content:
S402,接收排序服务器发起的投票请求,投票请求用于选取执行数据处理任务的执行服务器。S402. Receive a voting request initiated by the sorting server, where the voting request is used to select an execution server that performs a data processing task.
具体地,排序服务器130在接收到各执行服务器发送的任务执行请求后,提取任务执行请求中的执行服务器标识,根据提到得到的多个执行服务器标识生成投票请求,投票请求用于选取执行数据处理任务的执行服务器110。Specifically, after receiving the task execution request sent by each execution server, the sorting server 130 extracts the execution server identifier in the task execution request, generates a voting request according to the obtained multiple execution server identifiers, and uses the voting request to select the execution data. The execution server 110 of the processing task.
S404,根据投票请求生成投票信息。S404. Generate voting information according to the voting request.
具体地,执行服务器110在接收到投票请求后,提取投票请求中的多个执行服务器标识,从提取到的多个执行服务器标识选取一个执行服务器标识,根据选取的执行服务器标识作为投票信息。Specifically, after receiving the voting request, the execution server 110 extracts multiple execution server identifiers in the voting request, selects one execution server identifier from the extracted multiple execution server identifiers, and uses the selected execution server identifier as the voting information.
在一个实施例中,执行服务器110在接收到投票请求后,从存储的多个执行服务器标识中选取一个执行服务器标识,根据选取的执行服务器标识作为投票信息。In one embodiment, after receiving the voting request, the execution server 110 selects an execution server identifier from the stored plurality of execution server identifiers, and uses the selected execution server identifier as the voting information.
S406,将投票信息发送至排序服务器,使排序服务器根据接收到的各执行服务器返回的投票信息生成执行服务器排序结果。S406. Send the voting information to the sorting server, and cause the sorting server to generate an execution server sorting result according to the received voting information returned by each execution server.
具体地,执行服务器110在生成投票信息后,将投票信息发送至排序服务器130。排序服务器130在接收到各执行服务器发送的投票信息后,提取投票信息中的执行服务器标识,统计各执行服务器标识的票数,根据统计的票数执行服务器标识进行排序得到执行服务器排序结果。具体可以按照票数由高到低进行排序,还可以由低到高进行排序。Specifically, the execution server 110 transmits the voting information to the sorting server 130 after generating the voting information. After receiving the voting information sent by each execution server, the sorting server 130 extracts the execution server identifier in the voting information, counts the number of votes of each execution server identifier, and performs server sorting according to the counted number of votes to obtain the execution server sorting result. Specifically, it can be sorted according to the number of votes from high to low, and can also be sorted from low to high.
本实施例中,在接收都排序服务器发送的投票请求后,根据投票请求生成投票信息,将投票信息发送至排序服务器,使排序服务器根据接收到的各执行服务器返回的投票信息对执行服务器标识进行排序得到执行服务器排序结果,根据执行服务器确定执行数据处理任务的执行服务器,避免数据处理任务被多次执行,从而浪费数据处理资源。In this embodiment, after receiving the voting request sent by the ranking server, the voting information is generated according to the voting request, and the voting information is sent to the sorting server, so that the sorting server performs the execution of the server identifier according to the received voting information returned by each executing server. Sorting results in an execution server sorting result, and an execution server that performs a data processing task is determined according to the execution server, thereby preventing the data processing task from being executed multiple times, thereby wasting data processing resources.
如图5所示,在一个实施例中,S504具体还包括根据资源利用率生成执行服务器排名结果的步骤,该步骤具体包括以下内容:As shown in FIG. 5, in an embodiment, S504 specifically includes the step of generating a server ranking result according to resource utilization, and the step specifically includes the following:
S502,接收排序服务器发送资源利用率获取请求。S502. The receiving sorting server sends a resource utilization obtaining request.
具体地,排序服务器130在接收到各执行服务器发送的任务执行请求后,向各执行服务器发送资源利用率获取请求,资源利用率获取请求用于获取各执行服务器的资源利用率。Specifically, after receiving the task execution request sent by each execution server, the sorting server 130 sends a resource utilization acquisition request to each execution server, and the resource utilization acquisition request is used to acquire the resource utilization rate of each execution server.
S504,根据资源利用率获取请求提取资源利用率,将提取到的资源利用率返回至排序服务器,使排序服务器根据接收到的各执行服务器返回的资源利用率生成执行服务器排序结果。S504: Extract resource utilization according to the resource utilization acquisition request, return the extracted resource utilization to the sorting server, and cause the sorting server to generate an execution server sorting result according to the received resource utilization returned by each execution server.
具体地,执行服务器110在接收到资源利用率获取请求后,获取资源利用参数,根据资源利用参数计算资源利用率,资源利用率发送至排序服务器130。排序服务器130在接收到各执行服务器返回的资源利用率后,将资源利用率进行比较,并根据比较结果对资源利用率对应的执行服务器标识进行排序,可以按照资源利用率由低到高或者由高到低的顺序对执行服务器标识进行排序得到执行服务器排序结果。Specifically, after receiving the resource utilization acquisition request, the execution server 110 acquires the resource utilization parameter, calculates the resource utilization rate according to the resource utilization parameter, and sends the resource utilization rate to the sorting server 130. After receiving the resource utilization returned by each execution server, the sorting server 130 compares the resource utilization rates, and sorts the execution server identifiers corresponding to the resource utilization according to the comparison result, which may be according to the resource utilization rate from low to high or by The high-to-low order sorts the execution server IDs to get the execution server sort results.
本实施例中,根据排序服务器发送的资源利用率获取请求返回资源利用率,使排序服务器根据资源利用率对执行服务器标识进行排序生成执行服务器排序结果,根据执行服务器的资源利用率确定资源利用率较低的执行服务器执行数据处理任务,提高了数据处理任务的效率。In this embodiment, the resource utilization rate is returned according to the resource utilization acquisition request sent by the sorting server, so that the sorting server sorts the execution server identifier according to the resource utilization rate to generate an execution server sorting result, and determines the resource utilization rate according to the resource utilization rate of the execution server. Lower execution servers perform data processing tasks, increasing the efficiency of data processing tasks.
如图6所示,在一个实施例中,S308具体包括根据执行服务器排序结果确定执行数据处理任务权限的步骤,该步骤具体包括以下内容:As shown in FIG. 6, in an embodiment, S308 specifically includes the step of determining the permission to execute the data processing task according to the execution server sorting result, and the step specifically includes the following content:
S602,提取执行服务器排序结果中排在第一的执行服务器标识。S602. Extract an execution server identifier ranked first in the execution server sort result.
具体地,执行服务器110在接收到执行服务器排序结果后,从执行服务器排序结果中提取排在第一的执行服务器标识。执行服务器排序结果可以是根据执行服务器标识所得票数的多少由高到低进行排列,排在第一的为得票数最高的执行服务器标识;也可以是按照执行服务器标识对应的执行服务器的资源利用率由低到高对执行服务器标识进行排序,排在第一的为资源利用率较低的执行服务器的执行服务器标识。Specifically, after receiving the execution server sort result, the execution server 110 extracts the first execution server identifier from the execution server sort result. The execution server sorting result may be arranged according to the number of votes obtained by the execution server identifier from high to low, and the first is the execution server identifier with the highest number of votes; or may be the resource utilization rate of the execution server corresponding to the execution server identifier. The execution server identifier is sorted from low to high, and the execution server identifier of the execution server with the lower resource utilization rate ranked first.
S604,将提取到的执行服务器标识与自身标识进行比对。S604. Compare the extracted execution server identifier with the self identifier.
具体地,执行服务器110在从执行服务器排序结果中提取排在第一的执行服务器标识后,将提取到的执行服务器标识与自身标识比对。自身标识为执行服务器110对应的执行服务器标识。Specifically, the execution server 110 compares the extracted execution server identifier with the self identifier after extracting the first execution server identifier from the execution server sort result. The self identification is an execution server identifier corresponding to the execution server 110.
S606,若提取到的执行服务器标识与自身标识一致,则判定本执行服务器的排序位置在预设排序范围之内。S606. If the extracted execution server identifier is consistent with the self identifier, determine that the sorting position of the execution server is within a preset sorting range.
具体地,执行服务器110在将提取到的执行服务器标识与自身标识比对时,若经过比对,提取到的执行服务器标识与自身标识一致,表示执行服务器110具有执行数据处理任务的权限,则执行服务器110从分发服务器获取数据处理任务并执行。Specifically, when the execution server 110 compares the extracted execution server identifier with the self identifier, if the comparison, the extracted execution server identifier is consistent with the self identifier, indicating that the execution server 110 has the permission to execute the data processing task, The execution server 110 acquires a data processing task from the distribution server and executes it.
本市实施例中,从执行服务器排序结果中排在第一的执行服务器标识,将排在第一的执行服务器标识与自身标识进行比对,根据比对结果确定是否具有执行数据处理任务的权限,这样避免了所有执行服务器都去执行数据处理任务,造成数据处理资源浪费的情况。In the embodiment of the present invention, the execution server identifier ranked first in the execution server sorting result compares the execution server identifier ranked first with the self identifier, and determines whether the user has the permission to execute the data processing task according to the comparison result. This avoids all the execution servers performing data processing tasks, resulting in wasted data processing resources.
如图7所示,在一个实施例中,提供一种数据处理任务执行装置700,该装置具体包括:分发通知接收模块702、执行请求发送模块704、排序结果获取模块706、排序位置判断模块708和数据任务获取模块710。As shown in FIG. 7, in one embodiment, a data processing task execution apparatus 700 is provided. The apparatus specifically includes: a distribution notification receiving module 702, an execution request sending module 704, a sorting result obtaining module 706, and a sorting position determining module 708. And data task acquisition module 710.
分发通知接收模块702,用于接收分发服务器发送的任务分发通知。The distribution notification receiving module 702 is configured to receive a task distribution notification sent by the distribution server.
执行请求发送模块704,用于根据任务分发通知向排序服务器发送任务执行请求。The execution request sending module 704 is configured to send a task execution request to the sorting server according to the task distribution notification.
排序结果获取模块706,用于从排序服务器获取执行服务器排序结果,执行服务器排序结果由排序服务器在接收到各执行服务器发送的任务执行请求后,根据任务执行请求生成。The sort result obtaining module 706 is configured to obtain an execution server sorting result from the sorting server, and the execution server sorting result is generated by the sorting server according to the task execution request after receiving the task execution request sent by each execution server.
排序位置判断模块708,用于确定本执行服务器在服务器排序结果中的排序位置,判断排序位置是否在预设排序范围之内。The sorting position determining module 708 is configured to determine a sorting position of the execution server in the server sorting result, and determine whether the sorting position is within a preset sorting range.
数据任务获取模块710,用于在判定所述排序位置在预设排序范围之内时,从分发服务器获取数据处理任务并执行。The data task obtaining module 710 is configured to acquire a data processing task from the distribution server and execute when determining that the sorting position is within a preset sorting range.
本实施例中,在接收到分发服务器发送的任务分发通知后,根据任务分发通知向排序服务器发送任务执行请求,排序服务器根据接收到的各执行服务器发送的任务执行请求对执行服务器进行排序生成执行服务器排序结果。执行服务器从排序服务器获取执行服务器排序结果,在根据执行服务器排序结果判定本执行服务器的排序位置在预设排序范围之内时,从分发服务器获取数据处理任务并执行。这样,通过执行服务器排序结果对具有执行数据处理任务权限的执行服务器的数量进行控制,避免了多个执行服务器在接收到任务分发通知时,同时从分发服务器获取数据处理任务造成数据拥塞的情况,也避免了数据处理任务被多个执行服务器重复执行的情况,从而节省了执行数据处理任务时所消耗的数据处理资源。In this embodiment, after receiving the task distribution notification sent by the distribution server, the task distribution request is sent to the sorting server according to the task distribution notification, and the sorting server sorts and executes the execution server according to the received task execution request sent by each execution server. Server sort results. The execution server obtains the execution server sort result from the sorting server, and obtains the data processing task from the distribution server and executes when determining that the sorting position of the execution server is within the preset sorting range according to the execution server sorting result. In this way, by executing the server sorting result, the number of execution servers having the permission to execute the data processing task is controlled, thereby avoiding the situation in which the plurality of execution servers acquire the task distribution notification and simultaneously acquire the data processing task from the distribution server, causing data congestion. It also avoids situations where data processing tasks are repeatedly executed by multiple execution servers, thereby saving data processing resources consumed when performing data processing tasks.
如图8所示,在一个实施例中,数据处理任务执行装置700具体还包括:投票请求接收模块712、投票信息生成模块714和投票信息发送模块716。As shown in FIG. 8, in one embodiment, the data processing task execution apparatus 700 specifically includes: a voting request receiving module 712, a voting information generating module 714, and a voting information sending module 716.
投票请求接收模块712,用于接收排序服务器发起的投票请求,投票请求用于选取执行数据处理任务的执行服务器。The voting request receiving module 712 is configured to receive a voting request initiated by the sorting server, and the voting request is used to select an execution server that performs a data processing task.
投票信息生成模块714,用于根据投票请求生成投票信息。The voting information generating module 714 is configured to generate voting information according to the voting request.
投票信息发送模块716,用于将投票信息发送至排序服务器,使排序服务器根据接收到的各执行服务器返回的投票信息生成执行服务器排序结果。The voting information sending module 716 is configured to send the voting information to the sorting server, and cause the sorting server to generate an execution server sorting result according to the received voting information returned by each execution server.
本实施例中,在接收都排序服务器发送的投票请求后,根据投票请求生成投票信息,将投票信息发送至排序服务器,使排序服务器根据接收到的各执行服务器返回的投票信息对执行服务器标识进行排序得到执行服务器排序结果,根据执行服务器确定执行数据处理任务的执行服务器,避免数据处理任务被多次执行,从而浪费数据处理资源。In this embodiment, after receiving the voting request sent by the ranking server, the voting information is generated according to the voting request, and the voting information is sent to the sorting server, so that the sorting server performs the execution of the server identifier according to the received voting information returned by each executing server. Sorting results in an execution server sorting result, and an execution server that performs a data processing task is determined according to the execution server, thereby preventing the data processing task from being executed multiple times, thereby wasting data processing resources.
如图9所示,在一个实施例中,数据处理任务执行装置700具体还包括:获取请求接收模块718和资源利用率返回模块720。As shown in FIG. 9, in one embodiment, the data processing task execution apparatus 700 specifically includes an acquisition request receiving module 718 and a resource utilization returning module 720.
获取请求接收模块718,用于接收排序服务器发送资源利用率获取请求。The obtaining request receiving module 718 is configured to receive the sorting server to send a resource utilization obtaining request.
资源利用率返回模块720,用于根据资源利用率获取请求提取资源利用率,将提取到的资源利用率返回至排序服务器,使排序服务器根据接收到的各执行服务器返回的资源利用率生成执行服务器排序结果。The resource utilization returning module 720 is configured to extract the resource utilization rate according to the resource utilization acquisition request, and return the extracted resource utilization rate to the sorting server, so that the sorting server generates an execution server according to the received resource utilization rate returned by each execution server. Sort results.
本实施例中,根据排序服务器发送的资源利用率获取请求返回资源利用率,使排序服务器根据资源利用率对执行服务器标识进行排序生成执行服务器排序结果,根据执行服务器的资源利用率确定是否可以执行数据处理任务,提高了数据处理任务的效率。In this embodiment, the resource utilization rate is returned according to the resource utilization acquisition request sent by the sorting server, so that the sorting server sorts the execution server identifier according to the resource utilization rate to generate an execution server sorting result, and determines whether the execution can be performed according to the resource utilization rate of the execution server. Data processing tasks increase the efficiency of data processing tasks.
如图10所示,在一个实施例中,排序位置判断模块708具体包括:标识提取模块708a、标识比对模块708b和排序确定模块708c。As shown in FIG. 10, in an embodiment, the sorting position determining module 708 specifically includes an identifier extracting module 708a, an identifier matching module 708b, and a sorting determining module 708c.
标识提取模块708a,用于提取执行服务器排序结果中排在第一的执行服务器标识。The identifier extraction module 708a is configured to extract the execution server identifier ranked first in the execution server sort result.
标识比对模块708b,用于将提取到的执行服务器标识与自身标识进行比对。The identifier matching module 708b is configured to compare the extracted execution server identifier with the own identifier.
排序确定模块708c,用于若提取到的执行服务器标识与自身标识一致,则判定本执行服务器的排序位置在预设排序范围之内。The order determining module 708c is configured to determine that the sorting position of the execution server is within a preset sorting range if the extracted execution server identifier is consistent with the self identifier.
本实施例中,从执行服务器排序结果中排在第一的执行服务器标识,将排在第一的执行服务器标识与自身标识进行比对,根据比对结果判定本执行服务器的排序位置在预设排序范围之内,确定具有执行数据处理任务的权限,这样避免了所有执行服务器都去执行数据处理任务,造成数据处理资源浪费的情况。In this embodiment, the execution server identifier ranked first in the execution server sorting result is compared with the first execution server identifier and the self identifier, and the ranking position of the execution server is determined according to the comparison result. Within the sorting range, it is determined that the user has the right to perform data processing tasks, thus avoiding the situation that all execution servers perform data processing tasks, resulting in wasted data processing resources.
如图11所示,在一个实施例中,数据任务获取模块710具体还包括:任务请求发送模块710a和数据任务接收模块710b。As shown in FIG. 11, in one embodiment, the data task obtaining module 710 specifically includes: a task request sending module 710a and a data task receiving module 710b.
任务请求发送模块710a,用于向分发服务器发送携带有执行服务器标识的任务获取请求。The task request sending module 710a is configured to send a task acquisition request carrying the execution server identifier to the distribution server.
数据任务接收模块710b,用于接收数据处理任务,数据处理任务为分发服务器根据执行服务器排序结果对执行服务器标识验证通过后返回的。The data task receiving module 710b is configured to receive a data processing task, and the data processing task is returned by the distribution server after the execution server identification is verified according to the execution server sorting result.
本实施例中,在分发服务器接收到任务获取请求时,根据执行服务器排序结果对任务获取请求中的执行服务器标识进行验证,以保证分发服务器中的数据安全,无需额外设置验证信息。In this embodiment, when the distribution server receives the task acquisition request, the execution server identifier in the task acquisition request is verified according to the execution server sorting result to ensure data security in the distribution server, and no additional verification information is needed.
上述数据处理任务执行装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。其中,网络接口可以是以太网或无线网卡等。上述各模块可以硬件形式内嵌于或独立于服务器中的处理器中,也可以以软件形式存储于服务器的存储器中,以便处理器调用执行以上各个模块对应的操作。该处理器可以为中央处理单元(CPU)、微处理器、单片机等。The various modules in the data processing task execution apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The network interface may be an Ethernet or a wireless network card. Each of the above modules may be embedded in a hardware form or independent of a processor in the server, or may be stored in a memory of the server in a software form, so that the processor invokes the operations corresponding to the above modules. The processor can be a central processing unit (CPU), a microprocessor, a microcontroller, or the like.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, or a read-only storage memory (Read-Only) Memory, ROM) or Random Access Memory (RAM).
上述内容,仅为本申请的较佳实施例,并非用于限制本申请的实施方案,本领域普通技术人员根据本申请的主要构思和精神,可以十分方便地进行相应的变通或修改,故本申请的保护范围应以权利要求书所要求的保护范围为准。The above is only the preferred embodiment of the present application, and is not intended to limit the embodiments of the present application. Those skilled in the art can make corresponding modifications or modifications in accordance with the main concepts and spirit of the present application. The scope of protection of the application shall be subject to the scope of protection required by the claims.

Claims (20)

  1. 一种数据处理任务执行方法,包括:A data processing task execution method includes:
    接收分发服务器发送的任务分发通知;Receiving a task distribution notification sent by the distribution server;
    根据所述任务分发通知向排序服务器发送任务执行请求;Sending a task execution request to the sorting server according to the task distribution notification;
    从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;Obtaining an execution server sorting result from the sorting server, the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
    确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及Determining a sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range; and
    在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
  2. 根据权利要求1所述的方法,其特征在于,所述根据所述任务分发通知向排序服务器发送任务执行请求之后,所述方法还包括:The method according to claim 1, wherein after the sending the task execution request to the sorting server according to the task distribution notification, the method further comprises:
    接收所述排序服务器发起的投票请求,所述投票请求用于选取执行数据处理任务的执行服务器;Receiving a voting request initiated by the sorting server, where the voting request is used to select an execution server that performs a data processing task;
    根据所述投票请求生成投票信息;及Generating voting information according to the voting request; and
    将所述投票信息发送至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的投票信息生成执行服务器排序结果。The voting information is sent to the sorting server, so that the sorting server generates an execution server sorting result according to the received voting information returned by each execution server.
  3. 根据权利要求1所述的方法,其特征在于,所述根据所述任务分发通知向排序服务器发送任务执行请求之后,所述方法还包括:The method according to claim 1, wherein after the sending the task execution request to the sorting server according to the task distribution notification, the method further comprises:
    接收所述排序服务器发送资源利用率获取请求;及Receiving, by the sorting server, a resource utilization acquisition request; and
    根据所述资源利用率获取请求提取资源利用率,将提取到的资源利用率返回至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的资源利用率生成执行服务器排序结果。The resource utilization is extracted according to the resource utilization acquisition request, and the extracted resource utilization is returned to the sorting server, so that the sorting server generates an execution server sorting result according to the received resource utilization returned by each execution server.
  4. 根据权利要求1所述的方法,其特征在于,所述确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内,包括:The method according to claim 1, wherein the determining the sorting position of the execution server in the sorting result of the execution server, and determining whether the sorting position is within a preset sorting range comprises:
    提取执行服务器排序结果中排在第一的执行服务器标识;Extracting the execution server ID ranked first in the execution server sort result;
    将提取到的执行服务器标识与自身标识进行比对;及Comparing the extracted execution server identifier with its own identity; and
    若所述提取到的执行服务器标识与所述自身标识一致,则判定本执行服务器的排序位置在预设排序范围之内。If the extracted execution server identifier is consistent with the self identifier, it is determined that the sorting position of the execution server is within a preset sorting range.
  5. 根据权利要求1所述的方法,其特征在于,所述从所述分发服务器获取所述数据处理任务并执行,包括:The method according to claim 1, wherein the obtaining the data processing task from the distribution server and executing comprises:
    向所述分发服务器发送携带有执行服务器标识的任务获取请求;及Sending a task acquisition request carrying an execution server identifier to the distribution server; and
    接收数据处理任务,所述数据处理任务为所述分发服务器根据执行服务器排序结果对所述执行服务器标识验证通过后返回的。Receiving a data processing task, the data processing task being returned by the distribution server after verifying that the execution server identifier is verified according to the execution server sort result.
  6. 一种数据处理任务执行装置,包括:A data processing task execution device includes:
    分发通知接收模块,用于接收分发服务器发送的任务分发通知;a distribution notification receiving module, configured to receive a task distribution notification sent by the distribution server;
    执行请求发送模块,用于根据所述任务分发通知向排序服务器发送任务执行请求;And executing a request sending module, configured to send a task execution request to the sorting server according to the task distribution notification;
    排序结果获取模块,用于从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;a sorting result obtaining module, configured to obtain an execution server sorting result from the sorting server, where the sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
    排序位置判断模块,用于确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及a sorting position determining module, configured to determine a sorting position of the execution server in the sorting result of the execution server, and determine whether the sorting position is within a preset sorting range; and
    数据任务获取模块,用于在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。And a data task obtaining module, configured to acquire the data processing task from the distribution server and execute when determining that the sorting position is within a preset sorting range.
  7. 根据权利要求6所述的装置,其特征在于,还包括:The device according to claim 6, further comprising:
    投票请求接收模块,用于接收所述排序服务器发起的投票请求,所述投票请求用于选取执行数据处理任务的执行服务器;a voting request receiving module, configured to receive a voting request initiated by the sorting server, where the voting request is used to select an execution server that performs a data processing task;
    投票信息生成模块,用于根据所述投票请求生成投票信息;及a voting information generating module, configured to generate voting information according to the voting request; and
    投票信息发送模块,用于将所述投票信息发送至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的投票信息生成执行服务器排序结果。The voting information sending module is configured to send the voting information to the sorting server, so that the sorting server generates an execution server sorting result according to the received voting information returned by each execution server.
  8. 根据权利要求6所述的装置,其特征在于,还包括:The device according to claim 6, further comprising:
    获取请求接收模块,用于接收所述排序服务器发送资源利用率获取请求;及Obtaining a request receiving module, configured to receive the sorting server to send a resource utilization obtaining request; and
    资源利用率返回模块,用于根据所述资源利用率获取请求提取资源利用率,将提取到的资源利用率返回至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的资源利用率生成执行服务器排序结果。a resource utilization returning module, configured to extract resource utilization according to the resource utilization acquisition request, and return the extracted resource utilization to the sorting server, so that the sorting server returns the resources according to the received execution servers. The utilization generates an execution server sort result.
  9. 根据权利要求6所述的装置,其特征在于,所述排序位置判断模块包括:The apparatus according to claim 6, wherein the sorting position determining module comprises:
    标识提取模块,用于提取执行服务器排序结果中排在第一的执行服务器标识;An identifier extraction module, configured to extract an execution server identifier ranked first in the execution server sort result;
    标识比对模块,用于将提取到的执行服务器标识与自身标识进行比对;及An identifier matching module, configured to compare the extracted execution server identifier with the own identifier; and
    排序确定模块,用于若所述提取到的执行服务器标识与所述自身标识一致,则判定本执行服务器的排序位置在预设排序范围之内。The order determining module is configured to determine that the sorting position of the execution server is within a preset sorting range if the extracted execution server identifier is consistent with the self identifier.
  10. 根据权利要求6所述的装置,其特征在于,所述数据任务获取模块包括:The device according to claim 6, wherein the data task acquisition module comprises:
    任务请求发送模块,用于向所述分发服务器发送携带有执行服务器标识的任务获取请求;及a task request sending module, configured to send, to the distribution server, a task acquisition request carrying an execution server identifier; and
    数据任务接收模块,用于接收数据处理任务,所述数据处理任务为所述分发服务器根据执行服务器排序结果对所述执行服务器标识验证通过后返回的。The data task receiving module is configured to receive a data processing task, where the data processing task is returned after the verification server passes the verification of the execution server identifier according to the execution server sorting result.
  11. 一种执行服务器,包括存储器和处理器,所述存储器中存储有计算机可执行指令,所述计算机可执行指令被所述处理器执行时,使得所述处理器执行以下步骤:An execution server comprising a memory and a processor, wherein the memory stores computer executable instructions that, when executed by the processor, cause the processor to perform the following steps:
    接收分发服务器发送的任务分发通知;Receiving a task distribution notification sent by the distribution server;
    根据所述任务分发通知向排序服务器发送任务执行请求;Sending a task execution request to the sorting server according to the task distribution notification;
    从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;Obtaining an execution server sorting result from the sorting server, the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
    确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及Determining a sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range; and
    在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
  12. 根据权利要求11所述的执行服务器,其特征在于,所述根据所述任务分发通知向排序服务器发送任务执行请求之后,所述计算机可执行指令被所述处理器执行时,还使得所述处理器执行以下步骤:The execution server according to claim 11, wherein said processing is further performed when said computer executable instructions are executed by said processor after said task distribution request is sent to said sorting server according to said task distribution notification Perform the following steps:
    接收所述排序服务器发起的投票请求,所述投票请求用于选取执行数据处理任务的执行服务器;Receiving a voting request initiated by the sorting server, where the voting request is used to select an execution server that performs a data processing task;
    根据所述投票请求生成投票信息;及Generating voting information according to the voting request; and
    将所述投票信息发送至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的投票信息生成执行服务器排序结果。The voting information is sent to the sorting server, so that the sorting server generates an execution server sorting result according to the received voting information returned by each execution server.
  13. 根据权利要求11所述的执行服务器,其特征在于,所述根据所述任务分发通知向排序服务器发送任务执行请求之后,所述计算机可执行指令被所述处理器执行时,还使得所述处理器执行以下步骤:The execution server according to claim 11, wherein said processing is further performed when said computer executable instructions are executed by said processor after said task distribution request is sent to said sorting server according to said task distribution notification Perform the following steps:
    接收所述排序服务器发送资源利用率获取请求;及Receiving, by the sorting server, a resource utilization acquisition request; and
    根据所述资源利用率获取请求提取资源利用率,将提取到的资源利用率返回至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的资源利用率生成执行服务器排序结果。The resource utilization is extracted according to the resource utilization acquisition request, and the extracted resource utilization is returned to the sorting server, so that the sorting server generates an execution server sorting result according to the received resource utilization returned by each execution server.
  14. 根据权利要求11所述的执行服务器,其特征在于,所述确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内,包括:The execution server according to claim 11, wherein the determining the sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range comprises:
    提取执行服务器排序结果中排在第一的执行服务器标识;Extracting the execution server ID ranked first in the execution server sort result;
    将提取到的执行服务器标识与自身标识进行比对;及Comparing the extracted execution server identifier with its own identity; and
    若所述提取到的执行服务器标识与所述自身标识一致,则判定本执行服务器的排序位置在预设排序范围之内。If the extracted execution server identifier is consistent with the self identifier, it is determined that the sorting position of the execution server is within a preset sorting range.
  15. 根据权利要求11所述的执行服务器,其特征在于,所述从所述分发服务器获取所述数据处理任务并执行,包括:The execution server according to claim 11, wherein the obtaining the data processing task from the distribution server and executing comprises:
    向所述分发服务器发送携带有执行服务器标识的任务获取请求;及Sending a task acquisition request carrying an execution server identifier to the distribution server; and
    接收数据处理任务,所述数据处理任务为所述分发服务器根据执行服务器排序结果对所述执行服务器标识验证通过后返回的。Receiving a data processing task, the data processing task being returned by the distribution server after verifying that the execution server identifier is verified according to the execution server sort result.
  16. 一个或多个存储有计算机可执行指令的非易失性存储介质,所述计算机可执行指令被一个或多个处理器执行时,使得所述一个或多个处理器执行以下步骤:One or more non-volatile storage media storing computer-executable instructions, when executed by one or more processors, cause the one or more processors to perform the following steps:
    接收分发服务器发送的任务分发通知;Receiving a task distribution notification sent by the distribution server;
    根据所述任务分发通知向排序服务器发送任务执行请求;Sending a task execution request to the sorting server according to the task distribution notification;
    从所述排序服务器获取执行服务器排序结果,所述执行服务器排序结果由所述排序服务器在接收到各执行服务器发送的任务执行请求后,根据所述任务执行请求生成;Obtaining an execution server sorting result from the sorting server, the execution server sorting result is generated by the sorting server after receiving the task execution request sent by each execution server, according to the task execution request;
    确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内;及Determining a sorting position of the execution server in the execution server sorting result, and determining whether the sorting position is within a preset sorting range; and
    在判定所述排序位置在预设排序范围之内时,从所述分发服务器获取所述数据处理任务并执行。When it is determined that the sorting position is within a preset sorting range, the data processing task is acquired from the distribution server and executed.
  17. 根据权利要求16所述的非易失性存储介质,其特征在于,所述根据所述任务分发通知向排序服务器发送任务执行请求之后,所述计算机可执行指令被一个或多个处理器执行时,还使得所述一个或多个处理器执行以下步骤:The nonvolatile storage medium according to claim 16, wherein said computer executable instructions are executed by one or more processors after said task distribution request is sent to said sorting server according to said task distribution notification And causing the one or more processors to perform the following steps:
    接收所述排序服务器发起的投票请求,所述投票请求用于选取执行数据处理任务的执行服务器;Receiving a voting request initiated by the sorting server, where the voting request is used to select an execution server that performs a data processing task;
    根据所述投票请求生成投票信息;及Generating voting information according to the voting request; and
    将所述投票信息发送至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的投票信息生成执行服务器排序结果。The voting information is sent to the sorting server, so that the sorting server generates an execution server sorting result according to the received voting information returned by each execution server.
  18. 根据权利要求16所述的非易失性存储介质,其特征在于,所述根据所述任务分发通知向排序服务器发送任务执行请求之后,所述计算机可执行指令被一个或多个处理器执行时,还使得所述一个或多个处理器执行以下步骤:The nonvolatile storage medium according to claim 16, wherein said computer executable instructions are executed by one or more processors after said task distribution request is sent to said sorting server according to said task distribution notification And causing the one or more processors to perform the following steps:
    接收所述排序服务器发送资源利用率获取请求;及Receiving, by the sorting server, a resource utilization acquisition request; and
    根据所述资源利用率获取请求提取资源利用率,将提取到的资源利用率返回至所述排序服务器,使所述排序服务器根据接收到的各执行服务器返回的资源利用率生成执行服务器排序结果。The resource utilization is extracted according to the resource utilization acquisition request, and the extracted resource utilization is returned to the sorting server, so that the sorting server generates an execution server sorting result according to the received resource utilization returned by each execution server.
  19. 根据权利要求16所述的非易失性存储介质,其特征在于,所述确定本执行服务器在所述执行服务器排序结果中的排序位置,判断所述排序位置是否在预设排序范围之内,包括:The non-volatile storage medium according to claim 16, wherein the determining a sorting position of the execution server in the execution server sorting result, determining whether the sorting position is within a preset sorting range, include:
    提取执行服务器排序结果中排在第一的执行服务器标识;Extracting the execution server ID ranked first in the execution server sort result;
    将提取到的执行服务器标识与自身标识进行比对;及Comparing the extracted execution server identifier with its own identity; and
    若所述提取到的执行服务器标识与所述自身标识一致,则判定本执行服务器的排序位置在预设排序范围之内。If the extracted execution server identifier is consistent with the self identifier, it is determined that the sorting position of the execution server is within a preset sorting range.
  20. 根据权利要求16所述的非易失性存储介质,其特征在于,所述从所述分发服务器获取所述数据处理任务并执行,包括:The non-volatile storage medium according to claim 16, wherein the obtaining the data processing task from the distribution server and executing comprises:
    向所述分发服务器发送携带有执行服务器标识的任务获取请求;及Sending a task acquisition request carrying an execution server identifier to the distribution server; and
    接收数据处理任务,所述数据处理任务为所述分发服务器根据执行服务器排序结果对所述执行服务器标识验证通过后返回的。Receiving a data processing task, the data processing task being returned by the distribution server after verifying that the execution server identifier is verified according to the execution server sort result.
PCT/CN2017/079649 2016-08-22 2017-04-07 Method and device for executing data processing task, execution server, and storage medium WO2018036168A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610702453.8 2016-08-22
CN201610702453.8A CN106407002B (en) 2016-08-22 2016-08-22 Data processing task executes method and apparatus

Publications (1)

Publication Number Publication Date
WO2018036168A1 true WO2018036168A1 (en) 2018-03-01

Family

ID=58004231

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/079649 WO2018036168A1 (en) 2016-08-22 2017-04-07 Method and device for executing data processing task, execution server, and storage medium

Country Status (2)

Country Link
CN (1) CN106407002B (en)
WO (1) WO2018036168A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113901008A (en) * 2021-11-10 2022-01-07 上海意略明数字科技股份有限公司 Data processing method and device, storage medium and computing equipment
CN114860346A (en) * 2022-06-02 2022-08-05 北京百度网讯科技有限公司 Management method of modeling task and operation method of modeling task

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106407002B (en) * 2016-08-22 2018-07-13 平安科技(深圳)有限公司 Data processing task executes method and apparatus
CN110009320B (en) * 2018-01-04 2024-04-16 财付通支付科技有限公司 Resource conversion method, device, system, storage medium and computer equipment
CN109582451A (en) * 2018-11-21 2019-04-05 金色熊猫有限公司 Method for scheduling task, system, equipment and readable medium
CN109582723B (en) * 2018-11-30 2021-08-17 深圳市思迪信息技术股份有限公司 Distributed ETL data acquisition method and device
CN110888925B (en) * 2019-10-11 2022-06-17 广州大气候农业科技有限公司 Data loading and distributing method and device and storage medium
CN113452753B (en) * 2021-05-21 2022-09-30 北京奇艺世纪科技有限公司 Data distribution method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101132393A (en) * 2006-08-25 2008-02-27 郑州威科姆电子科技有限公司 Stream media service dynamic load method
US8224825B2 (en) * 2010-05-31 2012-07-17 Microsoft Corporation Graph-processing techniques for a MapReduce engine
CN103580922A (en) * 2013-11-08 2014-02-12 国家电网公司 Overload control method for electric power communication network application server based on hybrid optimization
CN104038540A (en) * 2014-06-03 2014-09-10 山东乾云启创信息科技有限公司 Method and system for automatically selecting application proxy server
CN106407002A (en) * 2016-08-22 2017-02-15 平安科技(深圳)有限公司 Data processing task execution method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104023042B (en) * 2013-03-01 2017-05-24 清华大学 Cloud platform resource scheduling method
CN104618492B (en) * 2015-02-11 2018-02-06 北京金和软件股份有限公司 A kind of data handling system based on multiple servers
CN105100280B (en) * 2015-08-31 2019-09-13 广州酷狗计算机科技有限公司 Method for allocating tasks and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101132393A (en) * 2006-08-25 2008-02-27 郑州威科姆电子科技有限公司 Stream media service dynamic load method
US8224825B2 (en) * 2010-05-31 2012-07-17 Microsoft Corporation Graph-processing techniques for a MapReduce engine
CN103580922A (en) * 2013-11-08 2014-02-12 国家电网公司 Overload control method for electric power communication network application server based on hybrid optimization
CN104038540A (en) * 2014-06-03 2014-09-10 山东乾云启创信息科技有限公司 Method and system for automatically selecting application proxy server
CN106407002A (en) * 2016-08-22 2017-02-15 平安科技(深圳)有限公司 Data processing task execution method and device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113901008A (en) * 2021-11-10 2022-01-07 上海意略明数字科技股份有限公司 Data processing method and device, storage medium and computing equipment
CN113901008B (en) * 2021-11-10 2022-09-27 上海意略明数字科技股份有限公司 Data processing method and device, storage medium and computing equipment
CN114860346A (en) * 2022-06-02 2022-08-05 北京百度网讯科技有限公司 Management method of modeling task and operation method of modeling task
CN114860346B (en) * 2022-06-02 2024-06-04 北京百度网讯科技有限公司 Modeling task management method and modeling task operation method

Also Published As

Publication number Publication date
CN106407002A (en) 2017-02-15
CN106407002B (en) 2018-07-13

Similar Documents

Publication Publication Date Title
WO2018036168A1 (en) Method and device for executing data processing task, execution server, and storage medium
WO2018036167A1 (en) Test task executor assignment method, device, server and storage medium
WO2016190476A1 (en) Method for managing encryption key for cloud service and apparatus thereof
WO2018014580A1 (en) Data interface test method and apparatus, and server and storage medium
WO2020224246A1 (en) Block chain-based data management method and apparatus, device and storage medium
WO2018103315A1 (en) Monitoring data processing method, apparatus, server and storage equipment
WO2018161479A1 (en) Blockchain cluster processing system and method, computer device and storage medium
WO2021003975A1 (en) Gateway interface test method, terminal device, storage medium and apparatus
WO2018149083A1 (en) Service data transfer method and device, storage medium, and terminal
WO2020224249A1 (en) Blockchain-based transaction processing method, device and apparatus, and storage medium
WO2020253116A1 (en) Batch data execution method, device, storage medium, and member host in cluster
WO2018014582A1 (en) Insurance policy data processing method, device, servicer and storage medium
WO2016169410A1 (en) Login method and device, server and login system
WO2018090544A1 (en) Method and device for detecting dos/ddos attack, server, and storage medium
WO2020220413A1 (en) Zero knowledge proving method and system for personal information, and storage medium
WO2014101023A1 (en) Method and device for preventing service illegal access
WO2018233037A1 (en) Database integration testing method, device, server, and storage medium
WO2018035929A1 (en) Method and apparatus for processing verification code
WO2020186773A1 (en) Call request monitoring method, device, apparatus, and storage medium
WO2021072881A1 (en) Object storage-based request processing method, apparatus and device, and storage medium
WO2017054444A1 (en) System login method, server, system, and network attached storage device
WO2020224251A1 (en) Block chain transaction processing method, device, apparatus and storage medium
WO2012099330A2 (en) System and method for issuing an authentication key for authenticating a user in a cpns environment
WO2020119115A1 (en) Data verification method, device, apparatus, and storage medium
EP2589179A2 (en) Apparatus and method for controlling access to multiple services

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17842593

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27.06.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17842593

Country of ref document: EP

Kind code of ref document: A1