CN108062243A - Generation method, task executing method and the device of executive plan - Google Patents

Generation method, task executing method and the device of executive plan Download PDF

Info

Publication number
CN108062243A
CN108062243A CN201610980192.6A CN201610980192A CN108062243A CN 108062243 A CN108062243 A CN 108062243A CN 201610980192 A CN201610980192 A CN 201610980192A CN 108062243 A CN108062243 A CN 108062243A
Authority
CN
China
Prior art keywords
task
calculate node
node
executive plan
service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610980192.6A
Other languages
Chinese (zh)
Other versions
CN108062243B (en
Inventor
周明耀
浦世亮
周胜凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201610980192.6A priority Critical patent/CN108062243B/en
Publication of CN108062243A publication Critical patent/CN108062243A/en
Application granted granted Critical
Publication of CN108062243B publication Critical patent/CN108062243B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues

Abstract

This application discloses a kind of generation method of executive plan, including：Determine the attribute information of task；According to the attribute information, the calculate node to match with the attribute information is determined, as the first calculate node for performing the task；According to the mark of first calculate node, the first executive plan of the task is generated；First executive plan includes the mark of first calculate node.A kind of generating means of executive plan and a kind of task executing method and device is also disclosed in the application.

Description

Generation method, task executing method and the device of executive plan
Technical field
This application involves field of computer technology more particularly to a kind of generation method of executive plan, task executing methods And device.
Background technology
In field of computer technology, computing device (such as server or terminal) performs task, often according to setting What the executive plan put carried out.In the cloud service (Cloud Serving) for especially performing task in multi-node collaboration, to protect The smooth execution of card task just sets executive plan with greater need for before execution task.
Wherein, task, being can be by the groundwork member that computing device is completed, and task, which frequently includes, to be handled by program One or more instructions.Executive plan is for defining how the scheme of execution task.In executive plan, use is generally comprised In mark of calculate node of the task of execution etc..Calculate node mentioned here can be some computing device or meter Device clusters are calculated, can also be application running on the computing device.
In correlation technique, in order to be directed to different task using matched executive plan, it can generally set and cure and correspond to The executive plan of different task type.So-called curing, refer to once executive plan setting completed, then unless program staff is again right Executive plan is configured, and otherwise executive plan will not generally change.
By the way of executive plan is cured, cause always to perform task according to cured executive plan, so as to flexibly Property is relatively low.
The content of the invention
The embodiment of the present application provides a kind of generation method of executive plan, for solving to perform using curing in correlation technique The mode of plan, the problem of leading to not flexible approach task.
The embodiment of the present application also provides a kind of generating means of executive plan, for solving to hold using curing in correlation technique The mode of row plan, the problem of leading to not flexible approach task.
The embodiment of the present application also provides a kind of task executing method and device.
The embodiment of the present application uses following technical proposals：
A kind of generation method of executive plan, including：
Determine the attribute information of task；
According to the attribute information, the calculate node to match with the attribute information is determined, as the execution task The first calculate node；
According to the mark of first calculate node, the first executive plan of the task is generated；Described first performs meter It draws, includes the mark of first calculate node.
Optionally, according to the attribute information, the first calculate node to match with the attribute information is determined, as holding First calculate node of the row task, including：
According to the attribute information and the occupation condition of the first calculate node, determine and the attribute information phase Matching, and occupation condition meets the first calculate node of default resource occupation requirement, first as the execution task Calculate node.
Optionally, after generating first executive plan, the method further includes：
By first executive plan and the task, the first calculate node for performing the task is sent to, so that The first calculate node of the task is performed according to first executive plan, performs the task.
Optionally, by first executive plan and the task, it is sent to the first calculate node for performing the task Afterwards, the method further includes：
It receives and performs the node failure notification message that the first calculate node of the task is sent；
Based on the node failure notification message, the second executive plan is generated according to the attribute information；
Second executive plan includes the mark for the second calculate node for performing the task.
Optionally, first executive plan, also comprising at least one of following information：
The type of the task；
Complete the type of the required by task service；
Each first calculate node provides the order of service；
The corresponding task of the task completes recipient's information of result；
The unique mark of the task；
The index information of the mark of the first calculate node of the task will currently be performed.
Optionally, the method is applied to distributed computing system；Then
The method further includes：
After generation calculate node is switched to the event of abnormal operating state in the distributed computing system, update is The log-on message of calculate node in the distributed computing system of storage；The log-on message, including the distributed meter The mark of each calculate node in normal operating conditions in calculation system；
The calculate node updated log-on message being synchronized in the distributed computing system.
A kind of task executing method, applied to the calculate node in distributed computing system, the described method includes：
Receive the first executive plan and task；First executive plan includes the mark of first calculate node；Institute The first calculate node is stated, including calculate node being determined according to the attribute information, matching with the attribute information；
According to first executive plan, the task is performed.
Optionally, according to first executive plan, the task is performed, including：
Based on the service type locally provided, judge locally whether to possess and appoint according to performing first executive plan The ability of business；
When the determination result is yes, according to first executive plan, the task is performed.
Optionally, after performing the task, the method further includes：
It judges whether to receive service result and recipient's node in normal operating conditions；The service As a result, the implementing result obtained after the task is performed according to first executive plan for local；
If judging to be not present to receive the service result and recipient's node in normal operating conditions, To dispatch server sending node fault notification message, so that the dispatch server is given birth to according to the attribute information of the task Into the second executive plan.
Optionally, judge whether to receive service result and recipient's node in normal operating conditions, bag It includes：
By parsing first executive plan, the mark of the expected recipient's node for receiving the service result is determined；
Judge the local log-on message for whether preserving the expected recipient's node for receiving the service result；If it protects There is the log-on message of the expected recipient's node for receiving the service result, then judges exist to receive service knot Fruit and recipient's node in normal operating conditions；Otherwise, it is determined that it is not present to receive service result and in normal Recipient's node of working condition；
Wherein, the log-on message locally preserved, including calculate node locally stored, in normal operating conditions Information.
Optionally, the method is applied to the calculate node in distributed computing system；Then
The method further includes：
When the log-on message of calculate node in the distributed computing system changes, pass through the dispatch service Device obtains the log-on message after variation, and according to the log-on message after variation, updates the log-on message locally preserved.
Optionally, after performing the task, the method further includes：
By service result, first executive plan and the task, recipient's node is sent to；
The service result performs the implementing result obtained after the task to be local according to first executive plan.
Optionally, first calculate node, specifically includes：It is accounted for according to the resource of the attribute information and calculate node It is being determined with situation, match with the attribute information, and occupation condition meets the calculating of default resource occupation requirement Node；Then
The method further includes：
By local resource service condition, the dispatch server being sent in the distributed system.
A kind of generating means of executive plan, including：
Information determination unit, for determining the attribute information of task；
Node determination unit, for according to the attribute information, determining the calculate node to match with the attribute information, As the first calculate node for performing the task；
Plan generation unit, for the mark according to first calculate node, generate the task first performs meter It draws；First executive plan includes the mark of first calculate node.
Optionally, node determination unit is used for：
According to the attribute information and the occupation condition of the first calculate node, determine and the attribute information phase Matching, and occupation condition meets the first calculate node of default resource occupation requirement, first as the execution task Calculate node.
Optionally, described device further includes：
Transmitting element, for after plan generation unit generates first executive plan, by first executive plan With the task, the first calculate node for performing the task is sent to, so that performing the first calculate node of the task According to first executive plan, the task is performed.
Optionally, described device further includes：
Message reception units, for by first executive plan and the task, being sent in transmitting element and performing institute After the first calculate node for stating task, receive and perform the node failure notification message that the first calculate node of the task is sent；
The plan generation unit is additionally operable to the node failure notification message received based on message reception units, Second executive plan is generated according to the attribute information；
Second executive plan includes the mark for the second calculate node for performing the task.
Optionally, first executive plan, also comprising at least one of following information：
The type of the task；
Complete the type of the required by task service；
Each first calculate node provides the order of service；
The corresponding task of the task completes recipient's information of result；
The unique mark of the task；
The index information of the mark of the first calculate node of the task will currently be performed.
Optionally, described device is applied to distributed computing system；Then
Described device further includes：
Synchronization unit is switched to abnormal operating state for calculate node to occur in the distributed computing system After event, the log-on message of the calculate node in the distributed computing system locally preserved is updated；The log-on message, bag Include the mark of each calculate node in normal operating conditions in the distributed computing system；By the updated registration letter Breath is synchronized to the calculate node in the distributed computing system.
A kind of task execution device, including：
Receiving unit, for receiving the first executive plan and task；First executive plan is calculated comprising described first The mark of node；First calculate node, including it is being determined according to the attribute information, match with the attribute information Calculate node；
Execution unit, for according to first executive plan, performing the task.
Optionally, execution unit is used for：
Based on the service type locally provided, judge locally whether to possess and appoint according to performing first executive plan The ability of business；
When the determination result is yes, according to first executive plan, the task is performed.
Optionally, described device further includes：
Message sending unit, for after execution unit performs the task, judging whether to receive service knot Fruit and recipient's node in normal operating conditions；The service result performs to be local according to first executive plan The implementing result obtained after the task；
If judging to be not present to receive the service result and recipient's node in normal operating conditions, To dispatch server sending node fault notification message, so that the dispatch server is given birth to according to the attribute information of the task Into the second executive plan.
Optionally, the message sending unit, is used for：
By parsing first executive plan, the mark of the expected recipient's node for receiving the service result is determined；
Judge the local log-on message for whether preserving the expected recipient's node for receiving the service result；If it protects There is the log-on message of the expected recipient's node for receiving the service result, then judges exist to receive the service As a result and in normal operating conditions recipient's node；Otherwise, it is determined that it is not present to receive the service result and locate In recipient's node of normal operating conditions；
Wherein, the log-on message locally preserved is to include calculate node locally stored, in normal operating conditions Information.
Optionally, described device is applied to the calculate node in distributed computing system；Then
Described device further includes：
Updating block when changing for the log-on message of the calculate node in the distributed computing system, leads to It crosses the dispatch server and obtains the log-on message after variation, and according to the log-on message after variation, update the note locally preserved Volume information.
Optionally, described device further includes：
Plan transmitting element, for after execution unit performs the task, service result, described first to be performed meter Draw and the task, be sent to recipient's node；
The service result performs the implementing result obtained after the task to be local according to first executive plan.
Optionally, described device is applied to the calculate node in distributed computing system；First calculate node, specifically Including：It is being determined according to the occupation condition of the attribute information and calculate node, match with the attribute information, And occupation condition meets the calculate node of default resource occupation requirement；Then
Described device further includes：
Resource situation transmitting element, for by local resource service condition, the tune being sent in the distributed system Spend server.
Above-mentioned at least one technical solution that the embodiment of the present application uses can reach following advantageous effect：
Due to that can determine the calculate node to match with the attribute information according to the attribute information of task, as holding First calculate node of the row task, and according to the mark of first calculate node, generate the task first performs Plan, it thus provides a kind of mode that executive plan is generated according to the attribute information of task, which is not required to cure and performed Plan, the problem of so as to solve in correlation technique by the way of executive plan is cured, lead to not flexible approach task.
Description of the drawings
Attached drawing described herein is used for providing further understanding of the present application, forms the part of the application, this Shen Schematic description and description please does not form the improper restriction to the application for explaining the application.In the accompanying drawings：
Fig. 1 a are a kind of realization flow diagram of the generation method of executive plan provided by the embodiments of the present application；
Fig. 1 b are the schematic diagram of a distributed computing system provided by the embodiments of the present application；
Fig. 1 c are the schematic diagram that three calculate nodes enumerated in the embodiment of the present application are performed in unison with task；
Fig. 2 is a kind of specific implementation flow diagram of task executing method provided by the embodiments of the present application；
Fig. 3 a are the implement scene figure of the embodiment of the present application 2；
Fig. 3 b be perform chain it is possible that several different grown forms schematic diagram；
Fig. 3 c are how to perform the schematic diagram of task according to executive plan after executive plan generates；
Fig. 4 is a kind of concrete structure schematic diagram of the generating means of executive plan provided by the embodiments of the present application；
Fig. 5 is a kind of concrete structure schematic diagram of task execution device provided by the embodiments of the present application.
Specific embodiment
To make the purpose, technical scheme and advantage of the application clearer, below in conjunction with the application specific embodiment and Technical scheme is clearly and completely described in corresponding attached drawing.Obviously, described embodiment is only the application one Section Example, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art are not doing Go out all other embodiments obtained under the premise of creative work, shall fall in the protection scope of this application.
Below in conjunction with attached drawing, the technical solution that each embodiment of the application provides is described in detail.
Embodiment 1
To solve the problem of in correlation technique to lead to not flexible approach task by the way of executive plan is cured, this Apply for that embodiment provides a kind of generation method of executive plan.
The executive agent of the generation method of executive plan provided by the embodiments of the present application can be some computing device, such as It is computing device being used to implement in the distributed computing system of cloud service, etc..Using the executive agent as Distributed Calculation Exemplified by some computing device of system, in the embodiment of the present application, which can play generation executive plan, management point The effects that log-on message of other computing devices in cloth computing system, it can be described as dispatch server.Wherein, it is described to calculate section Point can be computing device or computing device cluster, can also be application running on the computing device.
The executive agent does not form the restriction to the application, and for ease of description, the embodiment of the present application is to hold Row main body is illustrated exemplified by the dispatch server in distributed computing system.
The specific implementation flow chart of this method as shown in Figure 1a, comprises the following steps：
Step 11, dispatch server determines the attribute information of task；
Task mentioned here is pending task.
Task can be performed by client (Client) request distributed computing system.
Fig. 1 b are referred to, Fig. 1 b show the schematic diagram of a distributed computing system provided by the embodiments of the present application.It should System includes dispatch server and several calculate nodes of connection is established with dispatch server.Client is needing to perform certain During business, task can be sent to dispatch server, distributed computing system to be asked to perform the task.Task is alternatively referred to as appointed Business performs request, is that can frequently include can be handled by program one by the groundwork member that computing device is completed, task Or multiple instruction.For task as trigger condition, the calculate node that can trigger the task of receiving performs corresponding operation.
In task in addition to it can include instruction, the attribute information of the task can also be included.
If it is the processing completed to specifying data (such as image data or voice data) in addition, the execution purpose of task, Then client can send the specified data in the task of transmission toward contact.
When including the attribute information of task in task, after dispatch server receives task, by being solved to task Analysis, it may be determined that the attribute information of the task.
Task often has different types, expected execution moment or priority etc..Different types of task, for example can have Video coding task, picture recognition task, audio search task, etc.；Possess different expected the performing the moment of the tasks, such as There can be task, the task of " 9 points of execution at night " of " 12 noon execution ", etc.；Possess the task of different priorities, such as Can there are the task of " high priority " and the task of " low priority ", etc..
In the embodiment of the present application, the attribute information can include but is not limited to type, expection performs the moment and preferential At least one of attribute informations such as grade.
Step 12, dispatch server determines the calculating to match with the attribute information of task according to the attribute information of task Node, the calculate node as the task of execution；
Example as shown in Figure 1 b is continued to use, which calculate node dispatch server can determine whether out after task is received by To perform the task.
Task is performed since what kind of calculate node the attribute information of task corresponds to this using, can generally be played decisive It influences, for example, Video coding task, generally may be employed and be capable of providing the calculate node of Video coding service to perform；" noon The task of 12 points of execution ", may be employed the more idle calculate node of 12 noon to perform；The task of " high priority ", can With using performance, in contrast relatively better calculate node performs --- therefore, in the embodiment of the present application, according to task Attribute information, come the calculate node of the calculate node that determines to match with attribute information as execution task.
Include type, expected priority for performing moment and task of task of task etc. with the attribute information of task below Exemplified by least one of attribute information, to how to determine according to the attribute information of task the calculate node of execution task, carry out It is discussed in detail：
1st, when the attribute information of task is the type of task, the calculate node with the type matching of task, including：It carries The service of confession can be with the calculate node of the type matching of task.For example, energy generally may be employed in Video coding task The calculate node of Video coding service is enough provided to perform, that is, the task of this type of Video coding, with being capable of providing video The calculate node of encoding service matches.Certainly, if assuming Video coding mission requirements " video pre-filtering " and " to pretreatment Rear video carries out Video coding " two-part service, then, the calculate node of this two parts service is provided respectively, be with The calculate node that the task of this type of Video coding matches.
In the embodiment of the present application, in order to determine the calculate node with the type matching of task, dispatch server can be When calculate node is registered to dispatch server (or on other opportunitys), the mark for the calculate node that calculate node reports is obtained The service that knowledge, IP (Internet Protocol, the Internet protocol) addresses of calculate node and calculate node are capable of providing Information (generally service type identification).
The mark of calculate node, can be set in advance in calculate node, the symbol for uniquely indicating calculate node, For example the mark of calculate node can be specifically arranged in calculate node by program designer, so that calculate node obtains the mark Know and be sent to dispatch server；The service that calculate node is capable of providing refers to the operation that calculate node can be performed.Than Such as, if calculate node is able to carry out recognition of face operation, then, " performing recognition of face operation " is exactly that calculate node is capable of providing Service, which can be represented with unique mark (such as service type identification)；For another example, if calculate node is able to carry out Video encoding operations, then, " execution video encoding operations " are exactly the service that calculate node is capable of providing, which can also use It is unique to identify (such as service type identification) to represent.The service type identification of different types of service can be set in advance in In calculate node, for example service type identification can be specifically arranged in calculate node by program designer, to calculate section Point obtains the mark and is sent to dispatch server.
For dispatch server, the above-mentioned data and dispatch server that are sent based on calculate node are built in advance The mapping of " service type identification " of the service that vertical different " task type marks " as shown in Table 1 is asked with realizing required by task Relation (the first mapping relations), server can further set up " service type identification " as shown in Table 1 with being capable of providing The mapping relations (the second mapping relations) of the respective mark of each calculate node of respective service and, it is established that calculate node is each From mark and IP address mapping relations (the 3rd mapping relations).
Wherein, task type mark and the mapping relations of service type identification, can be set in advance in dispatch server In.For example, can be arranged on by program designer in dispatch server.
Table 1：
Based on the mapping relations shown in table 1, dispatch server is in the task type for the knowing client request execution of the task It after mark, can be identified according to task type, by way of inquiring about the first mapping relations, determined corresponding with the type of task Service type identification；And then by inquiring about the second mapping relations, it may be determined that corresponding with the service type identification determined The mark of calculate node.Due to providing the calculate node of same services in distributed computing system, more than one might have.Such as In table 1, calculate node corresponding with service type " a " provides calculate node of the type for the service of " a ", including：00、01、 02nd, 03 this four.So, dispatch server is by inquiring about after the second mapping relations determine this four calculate nodes, can be with At least one calculate node is chosen from this four calculate nodes, the calculate node as the task of execution.
In the embodiment of the present application, dispatch server can be according to the current occupation condition of this four calculate nodes, base In the principle of load balancing, to choose calculate node.Occupation condition mentioned here, for example, can be CPU usage and/ Memory usage etc..If occupation condition is CPU usage, use the example above, it is assumed that 00,01,02,03 this four calculate nodes Current CPU usage is respectively 50%, 60%, 70%, 80%, then, it is minimum that dispatch server can choose CPU usage 00 this calculate node, as perform task calculate node.
Dispatch server can calculate section in the occupation condition for the calculate node for choosing calculate node when institute foundation Point is reported to dispatch server.
2nd, when the attribute information of task is the expected execution moment of task, the calculating section with the type matching of task Point, including：It is relatively idle at the expected execution moment, so as to there is the calculating that sufficient computing resource provides service Node.As an example it is assumed that each calculate node of distributed computing system, can provide identical service, then, scheduling Server can be registered to after the expected execution moment (such as " 12 noon execution ") for determining to go out on missions according to calculate node The information of idle period residing for (or on other opportunitys) transmission, calculate node, determines 12 noon during dispatch server Compare idle calculate node, the calculate node as the task of execution.The calculate node for the execution task determined, can be in office When the expected execution moment of business arrives, task is just performed.
In the embodiment of the present application, dispatch server, can also for ease of the information of idle period residing for inquiry calculate node Establish mapping relations as shown in Table 1.The process of establishing of mapping relations refer to above, and details are not described herein again.
3rd, when the attribute information of task is the priority of task, the calculate node with the type matching of task, including： Performance in contrast relatively better calculate node.As an example it is assumed that each calculate node of distributed computing system, it can Enough provide identical service, it is assumed that the priority of client to the task that dispatch server is sent is " high priority ", then, it adjusts Spending server can (or on other opportunitys) transmission, calculate node when being registered to dispatch server according to calculate node Hardware configuration information, determine the best calculate node of performance, as perform task calculate node.Usually, hardware configuration Higher, performance is better；Hardware configuration is lower, and performance is poorer.
In the embodiment of the present application, dispatch server can also be established as shown in table 1 for ease of inquiring about the performance of calculate node Mapping relations.The process of establishing of mapping relations refer to above, and details are not described herein again.
4th, when the attribute information of task includes the type of task, expected at least two attributes performed in moment and priority During information, dispatch server can determine to believe at least two attribute from the calculate node in distributed computing system The matched calculate node of breath, the calculate node as the task of execution.
No matter as the attribute information of the definite foundation of the calculate node of execution task what is, in the embodiment of the present application, Dispatch server can be according to the current occupation condition of the calculate node for combining the task that is able to carry out, based on load balancing Principle, to choose calculate node of the calculate node as execution task, influenced to avoid indivedual calculate node overloads The stability of distributed computing system.
Dispatch server is in the calculate node for determining to match with the attribute information of task, the calculating as the task of execution After node, following step 13 is further performed.For ease of description, it will determine what is matched with the attribute information of task hereinafter Calculate node is known as the first calculate node.
Step 13, for dispatch server according to the mark of the first calculate node, the executive plan for generating task is (rear to claim first to hold Row plan).
In the embodiment of the present application, the first executive plan of generation, can be character string form.In order to enable first calculates Node according to the first executive plan perform task, after the first executive plan extended meeting transferred between the first calculate node.
Hereinafter, situation is divided to illustrate which information the first executive plan may include.
1st, in some cases, there are one the first calculate nodes determined, and, the first calculate node only provides a certain Kind service.First calculate node can be completed by providing the service, task.It so, can be only in the first executive plan Include the mark of the first calculate node.
The mark of first calculate node mentioned here, generally the data receiver address for the first calculate node of characterization The mark of (such as IP address).Specifically, can be exactly that the IP address of the first calculate node calculates in itself or with first The unique mark of the IP address maps mutually of node, as shown in table 1.
When mark only comprising first calculate node in the first executive plan, dispatch server can subsequently pass through The first executive plan is parsed, the mark of the first calculate node wherein included is determined, and then according to the mark, determines the first meter The IP address of operator node；Then, task is sent to first calculate node and performed by dispatch server according to the IP address.
It is when completing the processing to specifying data (such as image data or voice data), to adjust when the execution purpose of task Spending server can also be by the specified data sending to the first calculate node.
2nd, in some cases, the first calculate node determined has multiple.So, since certain first calculate node provides The service result obtained after service, it is possible to can as the input of another first calculate node, therefore, in the first executive plan, In addition to the mark comprising each first calculate node, the order that each first calculate node provides service can also be included.Wherein, should It sequentially, such as can putting in order come table by the mark of each first calculate node included in the first calculate node mark sequence Sign.First calculate node mentioned here identifies sequence, refers to the sequence formed by the mark arrangement of the first calculate node.First The mark of calculate node puts in order, and the sequence consensus of service are provided with the first calculate node.For example, the first calculate node mark Know sequence { 00,11,12 }, represent that the order that the first calculate node provides service is：First provided by 00；It is provided again by 11；Finally It is to be provided by 12.First calculate node is by parsing the first executive plan, it may be determined that goes out such order.
Based on such first executive plan, certain described first calculate node can be determined next according to the order A calculate node that service is provided, and according to the mark of next calculate node for providing service, by the service result, described First executive plan and task are sent to next calculate node for providing service, so that next calculating for providing service Node performs task according to the service result and first executive plan.
By provide service first calculate node exemplified by, the calculate node get self by provide service obtain After service result, the server results, the first executive plan and task can be sent to next calculating section for providing service Point, so that next calculate node for providing service performs task according to the service result and the first executive plan.Work as task Execution purpose, be when completing the processing to specifying data (such as image data or voice data), dispatch server can be with Give the specified data sending to first calculate node.The obtained service result of first calculate node, can Can be exactly that the specified data are carried out with the handling result obtained after certain processing.
For the generating mode of such first executive plan, dispatch server is determining the first of execution task After calculate node, it can determine that the first calculate node provides service according to the priority offer order for the service for completing required by task Order；The order of service according to the first calculate node is provided and the mark of the first calculate node, generation first perform meter It draws.
The priority offer that dispatch server can pre-save the service needed for the type and different task of different task is suitable The mapping relations (rear to claim the 4th mapping relations) of sequence.Dispatch server is after the task of client request execution is received, a side Face, dispatch server can be identified according to the task type of the task, by inquiring about mapping relations as shown in Table 1, determined The mark of first calculate node；On the other hand, can be identified according to the task type of the task, it is as shown in Table 1 by inquiring about Mapping relations determine the priority offer order with the service of task type mark maps mutually, so that it is determined that going out the first calculating Node provides the order of service.
If there is task completion, it is not required that service must provide in a certain order, then, first perform It can not include the order that the first calculate node provides service in the works.
3rd, in some cases, the first calculate node determined have it is multiple, and, in the first different calculate nodes, until Rare the first calculate node of part can provide a variety of services.So, section is calculated to make it possible to provide the first of a variety of services Point determines what kind of service should be provided in the task of execution, and in the first executive plan, section is calculated except that can include each first Outside the mark of point, the service type identification for completing the required by task service can also be included.
Based on such first executive plan, the first calculate node, can be according to after the first executive plan is received The service type identification of the service of the completion required by task included in one executive plan, provides corresponding service.For ease of first Calculate node, which accurately determines out, oneself should provide what kind of service, in the first executive plan, can set up service class Type identifies and provides the mapping relations of the mark of the first calculate node of respective type service.
For the generating mode of such first executive plan, by taking each mapping relations shown in table 1 as an example, scheduling clothes Device be engaged in after the type according to task, the first calculate node that execution task is determined by inquiry table 1, it can be according to the first meter The mark and task type of operator node identify corresponding service type identification, mark of the generation comprising the first calculate node and Complete the first executive plan of the service type identification of required by task service.
4th, in some cases, in the first executive plan, in addition to including the mark of the first calculate node, can also include At least one of in following information：
The type of task；
The corresponding task of task completes recipient's information of result；
The unique mark of task；
The index information of the mark of the first calculate node of task will currently be performed.
Wherein, the type of task, for the first calculate node to be caused to know, currently performed is what kind of task. In a kind of embodiment, the first calculate node, which may can be directed to different types of task and provide, has same services type identification Service.
For example, the first calculate node can be directed to " video processing duties " and " audio processing task ", provide with identical The service of " the filtering out noise data " of service type identification, however, " filtering out noise data " corresponding to " video processing duties " Service source code, it is often different from the source code of the service of " filtering out noise data " corresponding to " audio processing task ". Under such a scenario, if the first calculate node pre-save the type (such as task type mark) of different tasks with it is corresponding Service source code mapping relations, then the first calculate node can be according to the task type mark included in the first executive plan Know, determine according to the first executive plan should provide how type service namely what kind of source code should be run.
For another example, the effect of the type of task can be equivalent to service type identification, so that the first calculate node can According to the type (such as task type mark) of including in the first executive plan for task, determine provide what kind of clothes Business.
The corresponding task of task completes recipient's information of result, for provide the last of service according to executive plan After one the first calculate node is informed in task, it should complete task as a result, which recipient be sent to.It is referred to herein Recipient's information, for example can be an IP address.
The unique mark of task, can " input when certain first calculate node is in the task of execution, be at least two other In the case of the output of first calculate node ", play a role.Such as, it is assumed that the input of the first calculate node 02 (claiming 02 afterwards) removes Comprising the first executive plan that the first calculate node 00 (claiming 00 afterwards) and the first calculate node 01 (claiming 01 afterwards) are sent respectively with Task (being assumed to be task A) outside, also provides the service result generated after the service needed for completion task A respectively comprising 00 and 01. So, if assume 02 provide completion task A needed for service when, it is necessary to receiving and the relevant clothes of same executive plan Business result merges, then, 02 can be according to being included in the first executive plan that 00 and 01 are sent respectively for task only One mark determines that 00 and 01 service result sent respectively corresponds to same executive plan, so as to 00 and 01 point The service result not sent merges.Certainly, the unique mark of task can also play a role under other scenes, this Shen Please embodiment other described scenes are not limited.
The index information of the mark of the first calculate node of task will be currently performed, will be referred to for from the first executive plan In in the mark of the first calculate node that includes, determine will currently to perform the mark of the first calculate node of task according to According to.Index information, similar to the effect of " pointer variable ".If for example, assume that included in the first executive plan first calculates section The mark of point forms the first calculate node mark sequence { 00,11,12 }, then, corresponding index information represents the sequence if 1 The 1st element, i.e., 00 in row；After corresponding 1st element of the index information is read, index information is changed to 2.Rope Fuse breath is 2, represents the 2nd element, i.e., 11 in the sequence；After 2 elements are read, index information is changed to 3.Afterwards Continuous situation, can with and so on.
Hereinafter, some optional embodiments of scheme provided by the embodiments of the present application are introduced.
Dispatch server is after by performing step 13 the first executive plan of generation, it is possible to further which first is performed Plan and task, are sent to the first calculate node, so that the first calculate node performs task according to the first executive plan.
It has been previously mentioned, the first executive plan, can exist in the form of character string.For the first calculate node Speech, after the first executive plan and task is received, can parse the first executive plan of character string forms, determine The information included in first executive plan.
Such as, it is assumed that the information included in the first executive plan includes：The mark of each first calculate node is with completing task The mapping relations of the service type identification of required service and each first calculate node provide the order of service.So, with first Exemplified by calculate node includes as illustrated in figure 1 c 00,01 and 02, the operation that those first calculate nodes perform respectively can be as follows It is described：
00 as first provide complete required by task service the first calculate node, receive the first executive plan and After task, which is parsed；Obtain following 1~analysis results of analysis result 3：
Analysis result 1：The mark of each first calculate node includes：00、01、02；
Analysis result 2：The mapping of service type identification of the mark of each first calculate node with completing required by task service Relation, as shown in table 2；
Table 2：
The mark of first calculate node Service type identification
00 a
01 b
02 c
Analysis result 3：Each first calculate node provides the order of service, is followed successively by 00,01,02.
Operations described below is performed based on above-mentioned analysis result 2,00：
00 provides the service that type is a；
00 after corresponding service result (rear to claim service result 1) is generated, according to above-mentioned analysis result 1 and analysis result 3, Service result 1, the first executive plan and task are sent to 01.
The aforesaid operations performed for 00 are explained as follows：
If task is " face is identified from video image "；Service type identification is the service of a, is specifically included to " video The noise of image is filtered out ".So, 00 the service that type is a is provided, can specifically included：00 pair of video image, makes an uproar Sound filters out.The video image after noise is filtered out, is service result 1.Video image mentioned here is equivalent to described above Specify data.The video image can be sent to dispatch server by client, then be transmitted to 00 by dispatch server； It is local that 00 can be pre-stored in.
00, according to above-mentioned analysis result 1 and analysis result 3, the service result 1, the first executive plan and task is sent To 01, can specifically include：00 from the log-on message for the calculate node that itself is preserved, and inquires about 01 corresponding IP address, and root According to the IP address, the service result 1, the first executive plan and task are sent to 01.
The log-on message of calculate node mentioned here can be the meter from dispatch server into distributed computing system Operator node synchronization.In the log-on message of calculate node, the mark of calculate node and the mapping relations of IP address can be included. After generation calculate node is switched to the event of abnormal operating state in distributed computing system, dispatch server can update local The log-on message of calculate node in the distributed computing system of preservation；Then, dispatch server is by updated log-on message The calculate node being synchronized in distributed computing system, so that the preservation of each calculate node is all newest log-on message.
Wherein, log-on message, the mark of each calculate node including being in normal operating conditions in distributed computing system. After generation calculate node is switched to the event of abnormal operating state in distributed computing system, dispatch server can update this The log-on message for the calculate node that ground preserves, is primarily referred to as the calculating section that dispatch server will be currently at abnormal operating state The log-on message of point, is deleted from the log-on message locally preserved, so that updated log-on message, including being in normal work Make the mark of each calculate node of state, the mark without including each calculate node in abnormal operating state.
Continue to introduce the operation performed by calculate node 01 and 02 below.
For 01,01 after the first executive plan, task and the implementing result 1 of 00 transmission is received, to this first Executive plan is parsed；Obtain above-mentioned 1~analysis result of analysis result 3.
The service that type is b is provided based on above-mentioned analysis result 2,01；It generates corresponding service result and (claims service result afterwards 2) after, 01, according to above-mentioned analysis result 1 and analysis result 3, by service result 2, the first executive plan and task, is sent to 02.
Continue to use the example above, it is assumed that task is " identifying face from video image "；Type is the service of b, is specifically included " characteristics of image is extracted from video image ".So, 01 the service that type is b is provided, can specifically included：01 from service result In 1, characteristics of image is extracted.The characteristics of image extracted is service result 2.
For 02,02 after the first executive plan, task and the implementing result 2 of 01 transmission is received, to this first Executive plan is parsed；Obtain above-mentioned 1~analysis result of analysis result 3.
The service that type is c is provided based on above-mentioned analysis result 2,02；It generates corresponding service result and (claims service result afterwards 3)。
Continue to use the example above, it is assumed that task is " identifying face from video image "；Type is the service of c, is specifically included " judge whether the characteristics of image extracted from video image matches with face characteristic, and export judging result ".So, 02 carry For the service that type is c, can specifically include：02 judges whether service result 2 matches with face characteristic, and exports judgement knot Fruit.The judging result of output is service result 3.
More than, describe the realization process of executive plan generation method provided by the embodiments of the present application.By using the party Method, due to that according to the attribute information of task the calculate node to match with the attribute information can be determined as described in execution First calculate node of task, and according to the mark of first calculate node, the first executive plan of the task is generated, because This, provides a kind of mode that executive plan is generated according to the attribute information of task.Meter is performed compared to curing in correlation technique The mode drawn is compared, and the first calculate node of the application can neatly be chosen to obtain, according to actual needs so as to solve phase In the technology of pass by the way of executive plan is cured, the problem of leading to not flexible approach task.
Using scheme provided by the embodiments of the present application, dispatch server can according to dispatch server and calculate node it Between heartbeat connection, monitor calculate node state scene under, if monitoring certain calculate node is in abnormal operating state (such as Heartbeat connection disconnection between the calculate node and dispatch server etc.), then when generating executive plan, it is in it is avoided that choosing The calculate node of abnormal operating state chooses other calculate nodes in normal condition as the first calculate node As the first calculate node, the possibility that tasks carrying fails can be so reduced.
Further to reduce the possibility of tasks carrying failure, in the embodiment of the present application, dispatch server can also receive The node failure notification message that first calculate node of execution task is sent；Based on node failure notification message, dispatch server The flow as shown in Figure 1a may be employed, regenerate the executive plan (the second executive plan can be claimed) for task.Wherein, The content of second executive plan and the first executive plan and effect are similar, and related introduction may refer to above, no longer superfluous herein It states.The mark of the calculate node for the second executive plan of execution included in second executive plan, can be described as the second calculating section The mark of point；The calculate node for the second executive plan of execution that dispatch server is determined, can be described as the second calculate node.
Task and the second executive plan can be sent to by the second executive plan based on generation, subsequently, dispatch server Second calculate node performs.
Above-mentioned node failure notification message is illustrated below：
Precedent is continued to use, 00 after service result 1 is obtained, and before 01 sends the service result 1, can be counted by inquiring about The log-on message of operator node judges currently to whether there is 01 log-on message.Due in the embodiment of the present application, if dispatch service After device monitors the calculate node in abnormal operating state (such as breaking down), (or cancellation) non-normal working can be deleted Updated log-on message is simultaneously synchronized to other calculate nodes by the log-on message of the calculate node of state, then, if 00 passes through The log-on message of calculate node is inquired about, finds the log-on message there is currently no 01, then can be determined that 01 in non-normal working State, so as to generate node failure notification message and be sent to dispatch server.It wherein, can in the node failure notification message With the unique mark comprising task, to know dispatch server, failure has occurred in the corresponding calculate node of which task. In addition, in the node failure notification message, 01 mark can also be included, is held accordingly so that dispatch server is capable of determining that Row plan is which calculate node failure to perform failure because of.
More than, from the angle of dispatch server, describe a kind of executive plan generation method provided by the embodiments of the present application Specific implementation process.
Hereinafter, by from the angle of calculate node, a kind of tasks carrying for same inventive concept with the above method is introduced Method.
The specific implementation flow chart of the task executing method, as shown in Fig. 2, comprising the following steps：
Step 21, calculate node receives executive plan and task；
Calculate node mentioned here can be some computing device or computing device cluster, can also be meter Calculate the application program run in equipment.
The executive plan can be the first executive plan generated using flow as shown in Figure 1a or also may be used To be executive plan that dispatch server regenerates, such as second executive plan.
The task, being can be by the groundwork member that calculate node is completed, and task, which frequently includes, to be handled by program One or more instructions.
Step 22, calculate node performs the task according to executive plan.The task is performed, can specifically be included：It carries For completing the service of required by task.For example, the service class that calculate node can determine to include in executive plan according to executive plan Type identifies (or task type mark), then, according to service type identification (or task type mark), can provide and service class Type identifies (or task type mark) corresponding service.
The specific implementation of step 22, may refer to above in an example for calculate node 00,01,02 how The introduction of service is provided according to executive plan.
Hereinafter, some optional embodiments of step 22 are introduced：
Calculate node may determine that calculate node (namely local) in itself, if possesses and is held according to first executive plan The ability of the row task；
When the determination result is yes, task is performed according to executive plan；It is no in judging result, then can not performs step 22 but terminate flow.
In the embodiment of the present application, when including the type for completing required by task service in executive plan, calculate node judges It is local whether to possess the ability that task is performed according to executive plan, can specifically it include：
Calculate node determines to complete the type of required by task service by parsing executive plan；
Calculate node judges the local service for whether being capable of providing the type determined；
If judging the local service for being capable of providing the type determined, judge locally possess the ability；
If judging the local service that can not provide the type determined, judge locally do not possess the ability.
For example, by taking calculate node 00 as illustrated in figure 1 c as an example, if task is " face is identified from video image ", and the Mapping relations as shown in Table 2 are included in one executive plan, then, 00 may determine that the local type that whether is capable of providing for " a " Service.Judge the local ability for possessing and task being performed according to the first executive plan if being capable of providing, 00；Otherwise, 00 judges It is local not possess the ability that task is performed according to the first executive plan.
Optionally, it is contemplated that be likely to occur calculate node failure and cause the situation of tasks carrying failure, held in step 22 After row, the task executing method provided by the embodiments of the present application can further include step：
Calculate node judges whether to receive service result and recipient's node in normal operating conditions； The service result is that result of calculation is local according to the implementing result obtained after executive plan execution task, is equivalent to institute above The service result said.
If judge to be not present to receive service result and recipient's node in normal operating conditions, to tune Server sending node fault notification message is spent, so that dispatch server is regenerated according to the attribute information of task performs meter It draws (such as the second executive plan of generation).
In one embodiment, calculate node judges whether to receive service result and in normal work Recipient's node of state, can specifically include：
By parsing executive plan, the mark of the expected recipient's node for receiving implementing result is determined；Whether judge local Preserve the log-on message of the expected recipient's node for receiving implementing result；If preserve the expected recipient for receiving implementing result The log-on message of node then judges exist to receive service result and recipient's node in normal operating conditions；It is no Then, judge to be not present to receive service result and recipient's node in normal operating conditions.Wherein, locally preserve Log-on message includes the information of calculate node locally stored, in normal operating conditions.Calculate node can will dispatch The synchronizing information for each calculate node in normal operating conditions that server is got is to locally.
For example, continue to use previously described example, 00 can by parsing executive plan, obtain the analysis result 1~ Analysis result 3.According to analysis result 3, it may be determined that go out the mark of the expected recipient's node for receiving the service result 1, For 01.So, 00 may determine that preservation calculate node log-on message in whether there is 01 log-on message.If in the presence of, Judge that presence can normally receive the 01 of implementing result；If being not present, judge that there is no can normally receive implementing result 01。
As it was noted above, in distributed computing system, when the log-on message of calculate node changes, after variation Log-on message can be synchronized to each calculate node by dispatch server, so that each calculate node is believed according to the registration after variation The log-on message that breath update locally preserves.
The above are the citing introductions to task executing method provided by the embodiments of the present application.
It should be noted that in correlation technique by the way of executive plan is cured, due to always by fixed several meters Operator node come cooperate perform fixed type task, each calculate node should provide what kind of service be also it is cured, therefore, nothing Executive plan need to be transferred between different calculate nodes.And use the generation side of executive plan provided by the embodiments of the present application Method, due to using which calculate node come perform task can carry certain randomness, it is therefore possible to use calculate node it Between transfer executive plan mode so that participate in execution task each calculate node, can understand：For received task, What kind of executive plan should be specifically used；And calculate node is in itself during execution task, it should what kind of be played the part of Role, i.e. what kind of service should be provided；Etc..
Embodiment 2
Present invention design is described based on previous embodiment 1 in detail, for the ease of being better understood from the application's Technical characteristic, means and effect, below to the application provide executive plan generation method and task executing method furtherly It is bright, so as to form another embodiment of the application.
As shown in Figure 3a, it is the implement scene figure of the embodiment of the present application 2.
In the scene shown in Fig. 3 a, client (client) and high in the clouds are included.
The client can refer to the computing device of entity；Alternatively, it can refer to application on the computing device is installed Program.In the embodiment of the present application 2, client is a side of request execution task (task).
The high in the clouds is made of several calculate nodes.Single calculate node can be single computing device；It is alternatively, single The computing device cluster that calculate node can be made of at least two computational devices.In the embodiment of the present application 2, high in the clouds is to hold One side of row task.
In a typical configuration, computing device includes one or more central processing unit (Central Processing Unit, CPU), input/output interface, network interface and memory.For example, computer, smart mobile phone, intelligent family Equipment or intelligent automobile etc. are occupied, can be considered as computing device.
In the scene as shown in Figure 3a, the task that client request performs may pass through different calculating sections Point, which carries out different processing, to be completed.The mode of assembly line may be employed in different calculate nodes, participates in the execution of task in turn, The work of task pipeline formula is completed so as to cooperate with.
By taking the task is to handle relevant task (abbreviation video task) with video as an example, appoint to complete the video Business, may perform pretreatment, frame analysis, post processing, storage, retrieval, excavate and etc..Wherein, pretreatment includes obtaining code Flow data；Frame analysis includes analyzing and processing the bit stream data got；Post processing is included to the code stream after analyzing and processing Data such as are combined or delete at the processing；Storage includes storing the handling result that post processing obtains；Retrieval includes root The handling result of storage is retrieved according to keyword；Excavating includes excavating handling result, and processing is hidden in obtain As a result the useful information in.
Each step in those steps is equivalent to the service completed required by task and provided described in embodiment 1.Often A step may be performed by different calculate nodes respectively.
In distributed computing system, it might have multiple calculate nodes and identical service be provided, in the embodiment of the present application, The load balancing principle that can be referred to according to embodiment 1 selectes calculate node to hold from the calculate node for providing same services Row corresponding steps.
It, can be by being arranged at such as the dispatch server in the high in the clouds in Fig. 3 a, to complete to calculate section in the embodiment of the present application Point is selected.Specifically, which can be according to the current resource situation of the type and calculate node of task, dynamic An executive plan is generated, to reach maximum execution performance.
The executive plan of generation can include but are not limited to following some parameters：
NodeIDs：Calculate node ID arrays.Calculate node ID arrays are made of the mark (NodeID) of calculate node Set.Calculate node, it may be possible to single computing device, it is also possible to computing device cluster.
Index：The index of current calculate node.Index, is the equal of a pointer, which is directed toward in NodeIDs and protects The NodeID deposited.Which NodeID indexes is directed to, and it is the calculate node that should currently provide service to illustrate the NodeID.The calculating After node provides service, update index, so that index is directed toward the next NodeID preserved in NodeIDs.
TaskId：Task ID.Task ID is for uniquely expression task.
TaskType：Task type identifies.Task type identify, for enable participate in execution task calculate node Determine that itself participates in the type of performing for task.Different types of task, it is possible to the service of corresponding same type, in this feelings Under condition, calculate node can be according to TaskType, to judge calculate node itself should provide service for what kind of task.
ServiceType：Service type array.Service type array is the set being made of service type identification.Service Each service type identification in type array is corresponding in turn to the mark of the calculate node in NodeIDs one by one.In NodeIDs The mark of calculate node correspond to service type identification in service type array, the mark of calculate node and service type mark This mapping relations known, what kind of service should be provided in the task of execution by showing calculate node.
DestinationInfo：Destination information.Destination refers to the recipient of the final implementing result of task.Purpose Ground information, can include the type of the recipient, IP address and port (Port) numbers etc..Wherein, recipient mentioned here Type, for example can be, but not limited to include：Using (Applicaiton, APP), high in the clouds, database or data warehouse, etc..
In the embodiment of the present application, the dispatch server in high in the clouds is after the task of client transmission is received, according to this The attribute information of being included in business for task can determine what is matched with attribute information in the way of described in embodiment 1 Calculate node, the calculate node as the task of execution.Further, dispatch server can be according to letters such as the marks of calculate node Breath, generation include the executive plan of above-mentioned each parameter.
Specifically, dispatch server may be employed following manner and determine above-mentioned each parameter：
According to the mark for the calculate node as the task of execution determined, NodeIDs is generated；
The pointer for being directed toward NodeIDs is created, as index Index；
For the task that client request performs, generation uniquely represents the TaskId of the task；
From task, the type TaskType of task is obtained；
By being parsed to task, the service that completion task needs provide is determined, and according to the inhomogeneity pre-established The service of type and the mapping relations of service type identification determine the service type identification for the service that completion task needs provide, into And ServiceType is generated according to definite service type identification；
From task, obtain DestinationInfo, alternatively, using it is pre-set acquiescence destination information as DestinationInfo。
More than determining after each parameter, the executive plan for including each parameter can be generated according to each parameter.Specifically, each ginseng Number can exist with character string forms.By each parameter combination together, that is, character string first place is connected, combination knot is obtained Fruit is as executive plan.
It should be noted that in practical application scene, following problem may be related to：
1st, problem one：Different tasks may need calculate node to provide different services, and how calculate node judges certainly Which kind of service body should provide
Where the reason for including TaskType and ServiceType here it is executive plan.
Specifically, TaskType may include video processing generic task mark, picture processing generic task mark and audio Handle generic task mark, etc.；ServiceType may then include speech analysis class service identifiers, data retrieval class service mark Knowledge, data mining class service identifiers and image identification class service identifiers, etc..Calculate node is capable of providing appointing for what classification The service of what classification under business, can be sent to scheduling when being registered to dispatch server by calculate node by corresponding information Server.
When including TaskType and ServiceType in executive plan, the calculate node of execution task, Ke Yigen are participated in According to TaskType and ServiceType, to judge that calculate node itself is to be provided, what kind of required by task is asked What kind of service.
2nd, problem two：Between the different calculate nodes for participating in execution task, mutual specific location how is known, thus into The accurate task of row and the transmission of executive plan
As it was noted above, in order to ensure the security in high in the clouds, executive plan is with will not generally including the IP of calculate node Location, but IP address is replaced with the mark (ID) of calculate node.
The mark of calculate node when can be that calculate node is registered to dispatch server, be reported to dispatch server.
However, since calculate node is after offer finishes service, often according to executive plan, by executive plan, task With the service result of generation, another calculate node is sent to.In this case, as sender clearing node, it is necessary to Know the IP address of the calculate node as recipient namely, it is necessary to know that the mapping of the mark and IP address of calculate node is closed System.
In the embodiment of the present application 3, zookeeper can be utilized, realizes that data are synchronous with calculate node in dispatch server.
Wherein, zookeeper is the distributed application program coordination service of an open source code, is the Chubby of Google One realization increased income is the significant components of Hadoop and Hbase.It is one and provides Consistency service for distributed system Software, the function of providing include：Configuring maintenance, domain name service, distributed synchronization, group service etc..
In the embodiment of the present application, zookeeper can be utilized to realize distributed synchronization.Specifically, calculate node is being supervised Measure dispatch server preservation calculate node log-on message change after, can by dispatch server preserve registration believe Breath is synchronous local in calculate node.Wherein, log-on message mentioned here, including mark and IP address.In addition, it can include The service type identification for the service being capable of providing.
3rd, problem three：It performs chain and might have different shape, how to ensure that the calculate node for participating in execution task is transferred and appoint The accuracy of business, executive plan and service result
Wherein, chain is performed, is made of execution node and execution route.Wherein, the single calculate node of execution task is participated in, It is equivalent to the individual node performed on chain；The transmission path of the service result of the calculate node generation of execution task is participated in, quite In the execution route that execution chain includes.
As shown in Figure 3b, for perform chain it is possible that several different grown forms schematic diagram.From Fig. 3 b, The grown form for performing chain generally comprises：Branch, merging, annular and flowing water type.
This 4 kinds of grown forms are come definite according to specific business demand.Specifically, if video handles generic task It is required that final handling result is stored on multiple data memory nodes, then it is branch to perform chain accordingly；When video processing Image identification in generic task is subdivided into recognition of face and vehicle identification, and, it is desirable that it is carried out respectively by different calculate nodes Recognition of face and vehicle identification, and by the image of pending recognition of face and the image of pending vehicle identification, input to respectively The different calculate node, then, the corresponding chain that performs is branch；It is finished when mission requirements difference calculate node provides respectively After service, the service result that different calculate nodes generate respectively is uniformly handled, then performs chain accordingly to merge.
It, can (calculate node be suitable according to the mark of calculate node after the calculate node for performing task is determined In perform chain on individual node) and calculate node perform task sequencing (according to this sequentially can determine service knot The transmission path of fruit is equivalent to and performs the execution route that includes of chain), represent to perform chain using dendrogram etc., and by the tree A part of the shape figure as executive plan.Wherein, the node of dendrogram, corresponding to the mark of calculate node；And the tree of dendrogram Stem portion, then corresponding to the transmission path.The calculate node of executive plan is received by parsing dendrogram, it may be determined that go out Perform chain.
4th, problem four：When the calculate node for participating in execution task is moved out of distributed computing system or breaks down, How this is handled
It is assumed that the offer of calculate node 1 is finished after servicing, it is necessary to which the service result of generation is sent to calculate node 2.So And calculate node 2 has been removed from the distributed computing system or calculate node 2 where calculate node 1 and dispatch server Currently break down, then, calculate node 1 can send fault notification message to dispatch server, to trigger dispatch server Regenerate executive plan.
In the embodiment of the present application, dispatch server can be connected according to the heartbeat between dispatch server and calculate node 2, Whether monitoring calculate node 2 breaks down.If dispatch server monitors calculate node 2 and breaks down, dispatch server is deleted Except the log-on message of calculate node 2, and handling result is synchronized to each meter not broken down in distributed computing system Operator node, so as to which calculate node 1 can just know that failure has occurred in calculate node 2.
Below in conjunction with Figure of description 3c, illustrate in one embodiment, after executive plan generates, how root Task is performed according to executive plan.
It should be noted that before executive plan is generated, following step can be performed：
1st, each calculate node in distributed computing system to dispatch server by way of sending registration request, note Volume arrives dispatch server；
Wherein, the log-on message of the calculate node comprising request registration in registration request.
Mark (NodeID), IP address and the calculate node that the log-on message of calculate node includes calculate node are capable of providing The service type identification of service etc..
2nd, each calculate node obtains the log-on message of all calculate nodes of dispatch server preservation respectively；
3rd, each calculate node monitors dispatch server in real time, when the log-on message hair for finding that dispatch server preserves After now changing, immediately according to the log-on message after variation, the log-on message that calculate node locally preserves is updated；
4th, each calculate node periodically (such as with 10 minutes for the cycle) reports each calculate node itself to dispatch server Resource service condition.
By performing 1~step 4 of above-mentioned steps, dispatch server can know the log-on message and money of each calculate node Source service condition, subsequently to generate executive plan according to those information.Specifically, can according to the attribute information of task and The log-on message of calculate node is determined to the calculate node of execution task.Assuming that it is able to carry out in the calculate node of task, energy The calculate node of enough offer same services has multiple, then, it can be further according to the money for the calculate node for providing same services Calculate node of the calculate node as execution task is chosen from the calculate node that same services are provided using request in source.
After the calculate node of execution task is determined, executive plan is generated.How executive plan is generated, may refer to reality The associated description in example 1 and embodiment 2 is applied, details are not described herein again.
After executive plan generates, Fig. 3 c are referred to, following step may be employed and perform task：
Step 31：The executive plan of generation is parsed, determines currently perform the mark of the first calculate node of the task The index information of knowledge, so as to determine the mark of corresponding calculate node according to the index information；
It should be noted that the equipment parsed for the first time to the executive plan of generation, is usually dispatch server；It is adjusting After executive plan is sent to calculate node by degree server, executive plan is parsed by calculate node.
Step 32：According to the log-on message locally preserved, inquiry whether there is in the mark phase for the calculate node determined Corresponding IP address；If not inquiring the IP address, fault notification message is sent to dispatch server, to trigger dispatch service Think highly of newly-generated executive plan；If inquiring the IP address, step 33 is performed；
Step 33：According to the IP address inquired, executive plan and task are sent to corresponding calculate of the IP address and saved Point；
Certainly, if the executive agent of step 31~step 33 is calculate node, in step 33, this can also be performed The service result that main body obtains is sent to the corresponding calculate node of the IP address inquired.
Step 34：After calculate node receives executive plan and task, determine to calculate current need by parsing executive plan The service to be provided, and judge locally whether be capable of providing the service；If it is not, then send a notification message to dispatch server, with Triggering dispatch server regenerates executive plan；If so, perform step 35；
Step 35：Calculate node provides service, after service provides, updates the index of current calculate node, and then holds Row step 31.
It should be noted that the index of the current calculate node of update mentioned here, refers to the rope of current calculate node The direction drawn is updated to point to be located at another calculating after the mark for providing the calculate node for finishing service in NodeIDs The mark of node.
The said program provided using the embodiment of the present application 3, can bring following advantageous effects：
The service logic that cloud service is realized is provided according to the form of executive plan；
It can be according to the occupation condition and task type of calculate node come dynamic generation executive plan, realization flexibly generation Executive plan when choosing calculate node of the smaller calculate node of resources occupation rate as execution task, can to generate Executive plan reach higher execution efficiency；
Tasks carrying process has certain fault-tolerance, can be regenerated when calculate node breaks down and perform meter It draws, so as to ensure that the possibility that Mission Success performs is larger；
It can support different execution chain forms；
Compared with being not carried out planning, come so as to dispatch calculate node after calculate node provides service to clothes For the mode that business result is handled, this programme performs task according to executive plan, can be to avoid frequent scheduling calculate node. So as to which in the case where execution chain is long, tasks carrying efficiency can be significantly improved using this programme.
Embodiment 3
For solve the problems, such as in correlation technique using cure executive plan by the way of flexibility it is relatively low, for such as Fig. 1 a The generation method of shown executive plan, the embodiment of the present application 3 provide a kind of generating means of executive plan.The device it is specific Structure diagram is as shown in figure 4, including information determination unit 41, node determination unit 42 and plan generation unit 43.It is right below Each functional unit that the device includes describes in detail：
Information determination unit 41, for determining the attribute information of task；
Node determination unit 42 for the attribute information determined according to information determination unit 41, determines and the attribute The calculate node of information match, as the first calculate node for performing the task；
Plan generation unit 43, for the mark for first calculate node determined according to node determination unit 42, Generate the first executive plan of the task.First executive plan includes the mark of first calculate node.
To ensure the load equilibrium of distributed computing system, node determination unit 42 specifically can be used for：According to first The attribute information that the occupation condition and information determination unit 41 of calculate node are determined determines and the attribute information Match, and occupation condition meets the first calculate node of default resource occupation requirement, as performing the of the task One calculate node.
In one embodiment, for the first calculate node is caused to perform task according to the first executive plan, the application is real Transmitting element can also be included by applying the device of example offer.The transmitting element, for being held in plan generation unit 43 generation first After row plan, by the first executive plan and task, the first calculate node of execution task is sent to, so that the of the task of execution One calculate node performs task according to the first executive plan.
In one embodiment, it is the possibility of reduction tasks carrying failure, the device provided by the embodiments of the present application It can also include message reception units.The message reception units, for by the first executive plan and task, being sent in transmitting element After the first calculate node of the task of execution, the node failure notification message that the first calculate node of execution task is sent is received.
When the device further includes message reception units, plan generation unit 43, be additionally operable to connect based on message reception units The node failure notification message received generates the second executive plan according to attribute information.Wherein, the second executive plan, comprising holding The mark of second calculate node of row task.
In one embodiment, above-mentioned attribute information, including following at least one：
Type, expected execution moment, priority.
In one embodiment, first executive plan, also comprising at least one of following information：
The type of task；
Complete the type of required by task service；
Each first calculate node provides the order of service；
The corresponding task of task completes recipient's information of result；
The unique mark of task；
The index information of the mark of the first calculate node of the task will currently be performed.
In one embodiment, the device provided by the embodiments of the present application can be applied to distributed computing system. Under such circumstances, which can also include synchronization unit.The synchronization unit, specifically in distributed computing system When the log-on message of calculate node changes, the calculating section that the log-on message after variation is synchronized in distributed computing system Point.
Using the generating means of above-mentioned executive plan provided by the embodiments of the present application, due to can be believed according to the attribute of task Breath determines the calculate node to match with the attribute information, as the first calculate node for performing the task, and according to institute The mark of the first calculate node is stated, generates the first executive plan of the task, it thus provides a kind of attribute according to task Information generates the mode of executive plan, avoids the curing of executive plan, solves the curing used in correlation technique and perform meter The problem of mode flexibility drawn is relatively low.
The generating means of the executive plan provided by the embodiments of the present application, the tune that can be contained in distributed computing system Spend server.
For the inventive concept identical with task executing method as shown in Figure 2, the embodiment of the present application 3 provides a kind of task Executive device.The concrete structure schematic diagram of the device is as shown in figure 5, including receiving unit 51 and execution unit 52.In detail below Introduce each functional unit that the device includes.
Receiving unit 51, for receiving the first executive plan and task；
Execution unit 52, for according to the first executive plan, performing the task.
In one embodiment, execution unit 52 specifically can be used for：Based on the service type locally provided, judge It is local whether to possess the ability that the task is performed according to the first executive plan；When the determination result is yes, performed according to first Plan, performs the task.
In one embodiment, execution unit specifically can be used for：
When first executive plan includes completing the type of the required by task service, held by parsing described first Row plan determines to complete the type of the required by task service；
Judge the local service for whether being capable of providing the type；
If judging the local service for being capable of providing the type, judge locally possess the ability；
If judging the local service that can not provide the type, judge locally do not possess the ability.
In one embodiment, in order to improve Mission Success execution probability, the task provided by the embodiments of the present application Executive device can also include：
Message sending unit, for after execution unit 52 performs the task, judging whether to receive service As a result and in normal operating conditions recipient's node；The service result is held to be local according to first executive plan The implementing result obtained after the row task；
If judge to be not present to receive service result and recipient's node in normal operating conditions, to tune Server sending node fault notification message is spent, so that the dispatch server is according to the attribute information of task generation the Two executive plans.
In one embodiment, the message sending unit, specifically can be used for：
By parsing first executive plan, the mark of the expected recipient's node for receiving the service result is determined；
Judge the local log-on message for whether preserving the expected recipient's node for receiving the service result；If it protects There is the log-on message of the expected recipient's node for receiving the service result, then judges exist to receive service knot Fruit and recipient's node in normal operating conditions；Otherwise, it is determined that it is not present to receive service result and in normal Recipient's node of working condition.
In one embodiment, which can be applied to the calculate node in distributed computing system.Such In the case of, which can also include updating block.The updating block, for the calculate node in distributed computing system When log-on message changes, according to the log-on message after variation, the log-on message locally preserved is updated.
In one embodiment, which can also include：
Plan transmitting element, for after execution unit 52 performs the task, service result, described first to be performed meter Draw and the task, be sent to recipient's node.Wherein, the service result, to be local according to first executive plan Perform the implementing result obtained after the task.
In one embodiment, when the device is applied to the calculate node in distributed computing system, the device is also It can include resource situation transmitting element.The resource situation transmitting element, for by the resource service condition of calculate node local, The dispatch server being sent in distributed system.
Task execution device provided by the embodiments of the present application can be realized according to according to execution provided by the embodiments of the present application The executive plan of plan generation schemes generation, successfully performs task.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program Product.Therefore, the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware can be used in the application Apply the form of example.Moreover, the computer for wherein including computer usable program code in one or more can be used in the application The computer program production that usable storage medium is implemented on (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) The form of product.
The application is with reference to the flow according to the method for the embodiment of the present application, equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided The processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices is generated for real The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted Series of operation steps is performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in a box or multiple boxes.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net Network interface and memory.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moves State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only memory (CD-ROM), Digital versatile disc (DVD) or other optical storages, magnetic tape cassette, the storage of tape magnetic rigid disk or other magnetic storage apparatus Or any other non-transmission medium, the information that can be accessed by a computing device available for storage.It defines, calculates according to herein Machine readable medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant are intended to nonexcludability Comprising so that process, method, commodity or equipment including a series of elements are not only including those elements, but also wrap Include other elements that are not explicitly listed or further include for this process, method, commodity or equipment it is intrinsic will Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including element Also there are other identical elements in process, method, commodity or equipment.
It these are only embodiments herein, be not limited to the application.To those skilled in the art, The application can have various modifications and variations.All any modifications made within spirit herein and principle, equivalent substitution, Improve etc., it should be included within the scope of claims hereof.

Claims (26)

1. a kind of generation method of executive plan, which is characterized in that including：
Determine the attribute information of task；
According to the attribute information, the calculate node to match with the attribute information is determined, as performing the of the task One calculate node；
According to the mark of first calculate node, the first executive plan of the task is generated；First executive plan, bag Mark containing first calculate node.
2. the method as described in claim 1, which is characterized in that according to the attribute information, determine and the attribute information phase Matched first calculate node, as the first calculate node for performing the task, including：
According to the attribute information and the occupation condition of the first calculate node, determine to match with the attribute information, And occupation condition meets the first calculate node of default resource occupation requirement, and section is calculated as perform the task first Point.
3. the method as described in claim 1, which is characterized in that after generation first executive plan, the method further includes：
By first executive plan and the task, the first calculate node for performing the task is sent to, so that performing First calculate node of the task performs the task according to first executive plan.
4. method as claimed in claim 3, which is characterized in that by first executive plan and the task, be sent to and hold After first calculate node of the row task, the method further includes：
It receives and performs the node failure notification message that the first calculate node of the task is sent；
Based on the node failure notification message, the second executive plan is generated according to the attribute information；
Second executive plan includes the mark for the second calculate node for performing the task.
5. the method as described in any claim of Claims 1 to 4, which is characterized in that first executive plan, also comprising following At least one of information：
The type of the task；
Complete the type of the required by task service；
Each first calculate node provides the order of service；
The corresponding task of the task completes recipient's information of result；
The unique mark of the task；
The index information of the mark of the first calculate node of the task will currently be performed.
6. the method as described in any claim of Claims 1 to 4, which is characterized in that the method is applied to Distributed Calculation system System；Then
The method further includes：
After generation calculate node is switched to the event of abnormal operating state in the distributed computing system, update has stored The distributed computing system in calculate node log-on message；The log-on message, including the Distributed Calculation system The mark of each calculate node in normal operating conditions in system；
The calculate node updated log-on message being synchronized in the distributed computing system.
A kind of 7. task executing method, applied to the calculate node in distributed computing system, which is characterized in that the method bag It includes：
Receive the first executive plan and task；First executive plan includes the mark of first calculate node；Described One calculate node, including calculate node being determined according to the attribute information, matching with the attribute information；
According to first executive plan, the task is performed.
8. task executing method as claimed in claim 7, which is characterized in that according to first executive plan, described in execution Task, including：
Based on the service type locally provided, judge locally whether possess according to first executive plan execution task Ability；
When the determination result is yes, according to first executive plan, the task is performed.
9. task executing method as claimed in claim 8, which is characterized in that after performing the task, the method further includes：
It judges whether to receive service result and recipient's node in normal operating conditions；The service result, The implementing result obtained after the task is performed according to first executive plan for local；
If judge to be not present to receive the service result and recipient's node in normal operating conditions, to tune Server sending node fault notification message is spent, so that the dispatch server is according to the attribute information of task generation the Two executive plans.
10. task executing method as claimed in claim 9, which is characterized in that judge whether to receive service result, And recipient's node in normal operating conditions, including：
By parsing first executive plan, the mark of the expected recipient's node for receiving the service result is determined；
Judge the local log-on message for whether preserving the expected recipient's node for receiving the service result；If it preserves The log-on message of the expected recipient's node for receiving the service result, then judge to exist to receive service result and Recipient's node in normal operating conditions；Otherwise, it is determined that there is no work normally shape for receiving service result and being in Recipient's node of state；
Wherein, the log-on message locally preserved includes the letter of calculate node locally stored, in normal operating conditions Breath.
11. task executing method as claimed in claim 10, which is characterized in that the method is applied to distributed computing system In calculate node；Then
The method further includes：
When the log-on message of calculate node in the distributed computing system changes, obtained by the dispatch server The log-on message after variation is taken, and according to the log-on message after variation, updates the log-on message locally preserved.
12. the method for claim 7, which is characterized in that after performing the task, the method further includes：
By service result, first executive plan and the task, recipient's node is sent to；
The service result performs the implementing result obtained after the task to be local according to first executive plan.
13. the method for claim 7, which is characterized in that first calculate node specifically includes：According to the category It is that the occupation condition of property information and calculate node is determined, match with the attribute information, and occupation condition Meet the calculate node of default resource occupation requirement；Then
The method further includes：
By local resource service condition, the dispatch server being sent in the distributed system.
14. a kind of generating means of executive plan, which is characterized in that including：
Information determination unit, for determining the attribute information of task；
Node determination unit, for according to the attribute information, determining the calculate node to match with the attribute information, as Perform the first calculate node of the task；
Plan generation unit, for the mark according to first calculate node, generate the first executive plan of the task；Institute The first executive plan is stated, includes the mark of first calculate node.
15. device as claimed in claim 14, which is characterized in that node determination unit is used for：
According to the attribute information and the occupation condition of the first calculate node, determine to match with the attribute information, And occupation condition meets the first calculate node of default resource occupation requirement, and section is calculated as perform the task first Point.
16. device as claimed in claim 14, which is characterized in that described device further includes：
Transmitting element, for after plan generation unit generates first executive plan, by first executive plan and institute State task, be sent to the first calculate node for performing the task so that perform the first calculate node of the task according to First executive plan, performs the task.
17. device as claimed in claim 16, which is characterized in that described device further includes：
Message reception units, for by first executive plan and the task, being sent in transmitting element, execution is described to appoint After first calculate node of business, receive and perform the node failure notification message that the first calculate node of the task is sent；
The plan generation unit is additionally operable to the node failure notification message received based on message reception units, according to The attribute information generates the second executive plan；
Second executive plan includes the mark for the second calculate node for performing the task.
18. the device as described in any claim of claim 14~17, which is characterized in that first executive plan also includes At least one of following information：
The type of the task；
Complete the type of the required by task service；
Each first calculate node provides the order of service；
The corresponding task of the task completes recipient's information of result；
The unique mark of the task；
The index information of the mark of the first calculate node of the task will currently be performed.
19. the device as described in any claim of claim 14~17, which is characterized in that described device is applied to Distributed Calculation System；Then
Described device further includes：
Synchronization unit, for the event that calculate node is switched to abnormal operating state to occur in the distributed computing system Afterwards, the log-on message of the calculate node in the distributed computing system that update locally preserves；The log-on message, including institute State the mark of each calculate node in normal operating conditions in distributed computing system；The updated log-on message is same It walks to the calculate node in the distributed computing system.
20. a kind of task execution device, which is characterized in that including：
Receiving unit, for receiving the first executive plan and task；First executive plan includes first calculate node Mark；First calculate node, including meter being determined according to the attribute information, matching with the attribute information Operator node；
Execution unit, for according to first executive plan, performing the task.
21. task execution device as claimed in claim 20, which is characterized in that execution unit is used for：
Based on the service type locally provided, judge locally whether possess according to first executive plan execution task Ability；
When the determination result is yes, according to first executive plan, the task is performed.
22. task execution device as claimed in claim 20, which is characterized in that described device further includes：
Message sending unit, for after execution unit performs the task, judge whether to receive service result and Recipient's node in normal operating conditions；The service result, to be local according to performing first executive plan The implementing result obtained after task；
If judge to be not present to receive the service result and recipient's node in normal operating conditions, to tune Server sending node fault notification message is spent, so that the dispatch server is according to the attribute information of task generation the Two executive plans.
23. task execution device as claimed in claim 22, which is characterized in that the message sending unit is used for：
By parsing first executive plan, the mark of the expected recipient's node for receiving the service result is determined；
Judge the local log-on message for whether preserving the expected recipient's node for receiving the service result；If it preserves The log-on message of the expected recipient's node for receiving the service result then judges exist to receive the service knot Fruit and recipient's node in normal operating conditions；Otherwise, it is determined that it is not present to receive the service result and be in Recipient's node of normal operating conditions；
Wherein, the log-on message locally preserved includes the letter of calculate node locally stored, in normal operating conditions Breath.
24. task execution device as claimed in claim 23, which is characterized in that described device is applied to distributed computing system In calculate node；Then
Described device further includes：
Updating block when changing for the log-on message of the calculate node in the distributed computing system, passes through institute It states dispatch server and obtains the log-on message after variation, and according to the log-on message after variation, update the registration letter locally preserved Breath.
25. device as claimed in claim 20, which is characterized in that described device further includes：
Plan transmitting element, for after execution unit performs the task, by service result, first executive plan, with And the task, it is sent to recipient's node；
The service result performs the implementing result obtained after the task to be local according to first executive plan.
26. device as claimed in claim 20, which is characterized in that described device is applied to the calculating in distributed computing system Node；First calculate node, specifically includes：It is determined according to the occupation condition of the attribute information and calculate node It is going out, match with the attribute information, and occupation condition meets the calculate node of default resource occupation requirement；Then
Described device further includes：
Resource situation transmitting element, for by local resource service condition, the scheduling being sent in the distributed system to take Business device.
CN201610980192.6A 2016-11-08 2016-11-08 Execution plan generation method, task execution method and device Active CN108062243B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610980192.6A CN108062243B (en) 2016-11-08 2016-11-08 Execution plan generation method, task execution method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610980192.6A CN108062243B (en) 2016-11-08 2016-11-08 Execution plan generation method, task execution method and device

Publications (2)

Publication Number Publication Date
CN108062243A true CN108062243A (en) 2018-05-22
CN108062243B CN108062243B (en) 2022-01-04

Family

ID=62136680

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610980192.6A Active CN108062243B (en) 2016-11-08 2016-11-08 Execution plan generation method, task execution method and device

Country Status (1)

Country Link
CN (1) CN108062243B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109240823A (en) * 2018-08-10 2019-01-18 北京小蓦机器人技术有限公司 The method, apparatus and readable storage medium storing program for executing of multiterminal linkage processing task
CN109656685A (en) * 2018-12-14 2019-04-19 深圳市网心科技有限公司 Container resource regulating method and system, server and computer readable storage medium
CN109656699A (en) * 2018-12-14 2019-04-19 平安医疗健康管理股份有限公司 Distributed computing method, device, system, equipment and readable storage medium storing program for executing
CN110163250A (en) * 2019-04-10 2019-08-23 阿里巴巴集团控股有限公司 Image desensitization process system, method and device based on distributed scheduling
CN111342986A (en) * 2018-12-19 2020-06-26 杭州海康威视系统技术有限公司 Distributed node management method and device, distributed system and storage medium
CN111522630A (en) * 2020-04-30 2020-08-11 北京江融信科技有限公司 Method and system for executing planned tasks based on batch dispatching center
CN113485765A (en) * 2021-07-07 2021-10-08 上海顺舟智能科技股份有限公司 Control strategy configuration method, device, equipment and medium for intelligent equipment of Internet of things
CN114205842A (en) * 2021-11-03 2022-03-18 深圳市九洲电器有限公司 Device cooperation synchronization method, system, device, terminal device and storage medium
WO2022198853A1 (en) * 2021-03-22 2022-09-29 北京市商汤科技开发有限公司 Task scheduling method and apparatus, electronic device, storage medium, and program product

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2275062T3 (en) * 2002-05-03 2007-06-01 Thales STITCHING ORDERING PROCEDURE FOR A MULTIFUNCTION RADAR, A SONAR OR FOR A LEADER.
CN102567086A (en) * 2010-12-30 2012-07-11 中国移动通信集团公司 Task scheduling method, equipment and system
CN103870317A (en) * 2012-12-10 2014-06-18 中兴通讯股份有限公司 Task scheduling method and system in cloud computing
CN104239141A (en) * 2014-09-05 2014-12-24 北京邮电大学 Task optimized-scheduling method in data center on basis of critical paths of workflow
CN104461752A (en) * 2014-11-21 2015-03-25 浙江宇视科技有限公司 Two-level fault-tolerant multimedia distributed task processing method
CN105049268A (en) * 2015-08-28 2015-11-11 东方网力科技股份有限公司 Distributed computing resource allocation system and task processing method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2275062T3 (en) * 2002-05-03 2007-06-01 Thales STITCHING ORDERING PROCEDURE FOR A MULTIFUNCTION RADAR, A SONAR OR FOR A LEADER.
CN102567086A (en) * 2010-12-30 2012-07-11 中国移动通信集团公司 Task scheduling method, equipment and system
CN103870317A (en) * 2012-12-10 2014-06-18 中兴通讯股份有限公司 Task scheduling method and system in cloud computing
CN104239141A (en) * 2014-09-05 2014-12-24 北京邮电大学 Task optimized-scheduling method in data center on basis of critical paths of workflow
CN104461752A (en) * 2014-11-21 2015-03-25 浙江宇视科技有限公司 Two-level fault-tolerant multimedia distributed task processing method
CN105049268A (en) * 2015-08-28 2015-11-11 东方网力科技股份有限公司 Distributed computing resource allocation system and task processing method

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109240823A (en) * 2018-08-10 2019-01-18 北京小蓦机器人技术有限公司 The method, apparatus and readable storage medium storing program for executing of multiterminal linkage processing task
CN109656685A (en) * 2018-12-14 2019-04-19 深圳市网心科技有限公司 Container resource regulating method and system, server and computer readable storage medium
CN109656699A (en) * 2018-12-14 2019-04-19 平安医疗健康管理股份有限公司 Distributed computing method, device, system, equipment and readable storage medium storing program for executing
WO2020119060A1 (en) * 2018-12-14 2020-06-18 深圳市网心科技有限公司 Method and system for scheduling container resources, server, and computer readable storage medium
CN111342986B (en) * 2018-12-19 2022-09-16 杭州海康威视系统技术有限公司 Distributed node management method and device, distributed system and storage medium
CN111342986A (en) * 2018-12-19 2020-06-26 杭州海康威视系统技术有限公司 Distributed node management method and device, distributed system and storage medium
CN110163250A (en) * 2019-04-10 2019-08-23 阿里巴巴集团控股有限公司 Image desensitization process system, method and device based on distributed scheduling
CN110163250B (en) * 2019-04-10 2023-10-24 创新先进技术有限公司 Image desensitization processing system, method and device based on distributed scheduling
CN111522630A (en) * 2020-04-30 2020-08-11 北京江融信科技有限公司 Method and system for executing planned tasks based on batch dispatching center
CN111522630B (en) * 2020-04-30 2021-04-06 北京江融信科技有限公司 Method and system for executing planned tasks based on batch dispatching center
WO2022198853A1 (en) * 2021-03-22 2022-09-29 北京市商汤科技开发有限公司 Task scheduling method and apparatus, electronic device, storage medium, and program product
CN113485765A (en) * 2021-07-07 2021-10-08 上海顺舟智能科技股份有限公司 Control strategy configuration method, device, equipment and medium for intelligent equipment of Internet of things
CN113485765B (en) * 2021-07-07 2023-09-22 上海顺舟智能科技股份有限公司 Control strategy configuration method, device, equipment and medium of intelligent equipment of Internet of things
CN114205842A (en) * 2021-11-03 2022-03-18 深圳市九洲电器有限公司 Device cooperation synchronization method, system, device, terminal device and storage medium
CN114205842B (en) * 2021-11-03 2024-02-02 深圳市九洲电器有限公司 Device cooperation synchronization method, system, device, terminal device and storage medium

Also Published As

Publication number Publication date
CN108062243B (en) 2022-01-04

Similar Documents

Publication Publication Date Title
CN108062243A (en) Generation method, task executing method and the device of executive plan
US9992082B2 (en) Classifier based graph rendering for visualization of a telecommunications network topology
CN107193894B (en) Data processing method, individual identification method and related device
EP2932693B1 (en) Exchange of server status and client information through headers for request management and load balancing
CN109146490A (en) block generation method, device and system
CN104486236B (en) The method and routing device of load balancing
CN108733508A (en) Method and system for controlling data backup
CN114039858B (en) Computing network resource fusion method, device, equipment and storage medium
CN104346365A (en) Device and method for determining specific service associated logs
FR3001849A1 (en) METHOD FOR ROUTING DATA, COMPUTER PROGRAM, NETWORK CONTROLLER AND ASSOCIATED NETWORKS
CN106878363A (en) A kind of information processing method, apparatus and system
CN109857524B (en) Stream computing method, device, equipment and computer readable storage medium
CN107423942A (en) A kind of method and device of work flow
CN106375360A (en) Method, device and system for updating graph data
CN110278255A (en) A kind of method and device of the Internet of Things IOT communication between devices based on block chain
CN109039959A (en) A kind of the consistency judgment method and relevant apparatus of SDN network rule
CN113095825B (en) Asset management method and device based on block chain and electronic equipment
CN108880896A (en) A kind of program gray scale dissemination method and device based on mainframe
CN111951112A (en) Intelligent contract execution method based on block chain, terminal equipment and storage medium
CN113672776B (en) Fault analysis method and device
CN112801665B (en) Cross-chain transaction method and system based on server relay
Amarasinghe et al. Aggregation-based discovery for virtual network environments
CN110855541B (en) Ring splitting method and device for ring network equipment
CN110019456A (en) Data lead-in method, device and system
CN103970860B (en) Method, device and system for processing data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant