CN108710532A - Across dependence implementation method, device, equipment and the storage medium of dispatching platform - Google Patents
Across dependence implementation method, device, equipment and the storage medium of dispatching platform Download PDFInfo
- Publication number
- CN108710532A CN108710532A CN201810486735.8A CN201810486735A CN108710532A CN 108710532 A CN108710532 A CN 108710532A CN 201810486735 A CN201810486735 A CN 201810486735A CN 108710532 A CN108710532 A CN 108710532A
- Authority
- CN
- China
- Prior art keywords
- scheduler task
- platform
- dispatching platform
- mark
- dispatching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a kind of dependence implementation method, device, equipment and storage mediums across dispatching platform, wherein the method includes：First dispatching platform obtains the first scheduler task mark；First dispatching platform searches the second scheduler task mark corresponding with the first scheduler task mark in the first allocation list；First dispatching platform utilizes cross-platform script, the log sheet of the second dispatching platform of poll to run successful logo file with the presence or absence of the second scheduler task corresponding with the second scheduler task mark；If there is the second scheduler task corresponding with the second scheduler task mark in the log sheet of the second dispatching platform runs successful logo file, first dispatching platform executes the first scheduler task corresponding with the first scheduler task mark.The above method is easy-to-look-up and monitoring and scheduling task run is as a result, realize the dependence of task between dispatching platform.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of dependence implementation method across dispatching platform, device, set
Standby and storage medium.
Background technology
Big data task run type is various at present, and is run on different dispatching platforms, since different dispatching platforms are appointed
The mode run of being engaged in and rule are different, can not directly carry out the dependence of data, to which effectively rigorous data flow can not be formed,
Developer can only be relied on by periodically going to realize, be susceptible to the problems such as data are imperfect and the stand-by period is long.
For example, there are one project A, appointed to dispatch using OOZIE (OOZIE is a server based on workflow engine)
Business, there are hadoop HIVE, (Hadoop, Hadoop Distributed File System, abbreviation HDFS, are one to data
Distributed system architecture, Hive are a kind of data warehouse schema of the foundation in Hadoop file system, and to being stored in
Data in HDFS are analyzed and are managed) in table；Another there are one project B, and using linkdo, (linkdo is a kind of distribution
Formula task scheduling platform) hadoop tasks are dispatched, the data of project B tasks want the life of the data in dependent file A in HIVE tables
At.If not forming dependence, can only go to realize by way of being staggered and executing the time, for example, 5 points of races of task of A projects, it is contemplated that
1-3 hour has executed, and is executed after 8 points then the task of B projects can only be just arranged.
Because the run time of task has fluctuation daily, completed if 1 hour of A project tasks, then B projects because
It is executed at 8 points to be provided with, two hours will be waited for more；Or B projects task execution when, the task of A projects
Data do not generate also completely.
Invention content
Based on this, it is necessary to which for the problem that the prior art is be easy to cause, Runtime is tediously long, and corrupt data provides
A kind of dependence implementation method, device, equipment and storage medium across dispatching platform.
A kind of dependence implementation method across dispatching platform, the dependence implementation method include：
First dispatching platform obtains the first scheduler task mark；
First dispatching platform is searched corresponding with the first scheduler task mark second in the first allocation list and is adjusted
Spend task identification, wherein the execution that first scheduler task identifies corresponding first scheduler task is adjusted dependent on described second
Spend the execution of corresponding second scheduler task of task identification；
First dispatching platform utilizes cross-platform script, the log sheet of the second dispatching platform of poll whether there is with
Second scheduler task identifies corresponding second scheduler task and runs successful logo file；
If there is the second scheduler task corresponding with the second scheduler task mark in the log sheet of the second dispatching platform
Successful logo file is run, then first dispatching platform executes the first scheduling corresponding with the first scheduler task mark
Task.
The method further includes in one of the embodiments,：
If there is no the second scheduling corresponding with the second scheduler task mark to appoint in the log sheet of the second dispatching platform
Business runs successful logo file, then first calling platform calls the monitoring programme of the second platform to check that described second adjusts
Degree task executes progress.
In one of the embodiments, first dispatching platform and the second dispatching platform be Oozie, Linkdo,
Any one of Control-M, XXL-JOB or TivoliWorkloadScheduler platform.
The cross-platform script is Python, Perl, Ruby, PHP, Lua or Java in one of the embodiments,
In any script.
A kind of dependence realization device across dispatching platform, the realization device include：
Acquisition module obtains the first scheduler task mark for the first dispatching platform；
Searching module is searched in the first allocation list for first dispatching platform and is identified with first scheduler task
Corresponding second scheduler task mark, wherein what first scheduler task identified corresponding first scheduler task executes dependence
The execution of corresponding second scheduler task is identified in second scheduler task；
Poller module utilizes cross-platform script, the day of the second dispatching platform of poll for first dispatching platform
Will table runs successful logo file with the presence or absence of the second scheduler task corresponding with the second scheduler task mark；
Execution module, if corresponding with the second scheduler task mark for existing in the log sheet of the second dispatching platform
Second scheduler task runs successful logo file, then first dispatching platform executes and first scheduler task mark pair
The first scheduler task answered.
The cross-platform dependence realization device further includes monitoring module in one of the embodiments, if being used for second
There is no the second scheduler task corresponding with the second scheduler task mark operations successfully to mark in the log sheet of dispatching platform
Will file, then first calling platform call the monitoring programme of the second platform with check the execution of second scheduler task into
Exhibition.
In one of the embodiments, first dispatching platform and second dispatching platform be Oozie, Linkdo,
Any one of Control-M, XXL-JOB or TivoliWorkloadScheduler platform.
The cross-platform script is Python, Perl, Ruby, PHP, Lua or Java in one of the embodiments,
In any script.
A kind of computer equipment, including memory and processor are stored with computer-readable instruction in the memory, institute
When stating computer-readable instruction and being executed by the processor so that the processor executes the step of above-mentioned implementation method.
A kind of storage medium being stored with computer-readable instruction, the computer-readable instruction are handled by one or more
When device executes so that one or more processors execute the step of above-mentioned implementation method.
Above-mentioned dependence implementation method, device, equipment and storage medium across dispatching platform is obtained by the first dispatching platform
First scheduler task identifies, and first dispatching platform is searched corresponding with the first scheduler task mark in the first allocation list
The second scheduler task mark, wherein first scheduler task identify corresponding first scheduler task execution depend on institute
The execution that the second scheduler task identifies corresponding second scheduler task is stated, first dispatching platform utilizes cross-platform script language
The log sheet of speech, the second dispatching platform of poll is transported with the presence or absence of the second scheduler task corresponding with the second scheduler task mark
The successful logo file of row, if existing and the second scheduler task mark corresponding second in the log sheet of the second dispatching platform
Scheduler task runs successful logo file, then first dispatching platform executes corresponding with the first scheduler task mark
First scheduler task to be adjusted if there is no corresponding with the second scheduler task mark second in the log sheet of the second dispatching platform
The successful logo file of task run is spent, then first calling platform calls the monitoring programme of the second platform to check described the
Two scheduler tasks execute progress, realize the dependence between dispatching platform, and the data for avoiding timing dependence appearance are imperfect,
Realize the fusion perforation between dispatching platform.
Description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit are common for this field
Technical staff will become clear.Attached drawing only for the purpose of illustrating preferred embodiments, and is not considered as to the present invention
Limitation.
Fig. 1 is the flow chart of the dependence implementation method across dispatching platform in one embodiment；
Fig. 2 is the structure diagram of the dependence realization device across dispatching platform in one embodiment；
Fig. 3 is the internal structure block diagram of one embodiment Computer equipment.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.It is to be further understood that is used in the specification of the present invention arranges
It refers to there are the feature, integer, step, operation, element and/or component, but it is not excluded that presence or addition to take leave " comprising "
Other one or more features, integer, step, operation, element, component and/or their group.
As a preferable embodiment, as shown in Figure 1, a kind of dependence implementation method across dispatching platform, the dependence is real
Now method includes：
Step S101, the first dispatching platform obtain the first scheduler task mark；First dispatching platform is flat for distributed scheduling
Platform can be any one of Oozie, Linkdo, Control-M, XXL-JOB, TivoliWorkloadScheduler flat
Platform；Wherein,
Distributed task dispatching platform XXL-JOB is an Open Framework, dispatches kernel based on the Quartz that increases income, scheduling is appointed
Business is an entirety, cannot edit the flow chart of one big task, and tracks the execution state of each node.Multiple tasks it
Between, dependence can not be configured, run successively, for example upstream task is signaled to Downstream Jobs.The Tivoli of IBM
Workload Scheduler can correspond to the cron under Unix, but it enhances the function of much being dispatched for enterprise, such as may be used
To handle scheduling based on dependence and event-driven, zone can be managed etc..Cron is merely capable of taking in separate unit
It is dispatched based on the time on business device, and TWS can replace cron, is handled with abundanter function with the background program of oneself
Job scheduling arrangement.Oozie is a workflow engine server, is appointed for running hadoop map/reduce and hive etc.
Business workflow.Control-M installs Enterprise Manager and server, in quilt on the server using C/S model
Agent is installed on control host, agent can submit the job stream defined by Control-M on host, and return to operation knot
Fruit.Can then monitor the operating condition of all batch jobs comprehensively on Enterprise Manager, can there are many side
Formula controls service condition and the process intervention of JOB.
First scheduler task mark can be default for uniquely distinguishing scheduler task pending on the first dispatching platform
The letter of rule, the combining characters string of number and underscore.In the present embodiment, the first dispatching platform obtains the first scheduler task
Specific implementation step can be：First dispatching platform scans working as each task successively in pre-set scheduler task table
Preceding state obtains preparation state or the corresponding scheduler task of ready state if current state is preparation state or ready state
Mark.Wherein, scheduler task title, scheduler task mark, the scheduler tasks such as scheduler task state are provided in scheduler task table
Information；Scheduler task state is used to characterize the current state of scheduler task, including prepares state/ready state and completion status.
It is understood that in the present embodiment, scheduler task information individually stores.
In other embodiments, scheduler task information can be with the non-scheduling tasks information (i.e. first of the first dispatching platform
Dispatching platform oneself is executed without by calling other platforms to realize the mission bit stream executed) it is stored in same task list
In, then, the specific implementation step that the first dispatching platform obtains the first scheduler task can be：First dispatching platform is set in advance
It is successively read the task type of each task in the task list set, if task type is scheduler task, obtains the scheduling and appoints
The current state of business obtains preparation state or the corresponding tune of ready state if current state is preparation state or ready state
Spend task identification.
Step S102, first dispatching platform are searched corresponding with the first scheduler task mark in the first allocation list
The second scheduler task mark, wherein first scheduler task identify corresponding first scheduler task execution depend on institute
State the execution that the second scheduler task identifies corresponding second scheduler task；
Second calling platform corresponds to the first dispatching platform, and with the first dispatching platform using the called of different frames
Platform, such as the first dispatching platform is using the platform of XXL-JOB frames, then the second calling platform can be used
The platform of any one of Oozie, Linkdo, Control-M or TivoliWorkloadScheduler frame；Second scheduling
Platform identification for uniquely distinguishing pending scheduler task on the second dispatching platform, equally can be preset rules letter,
The combining characters string of number and underscore；First allocation list is arranged in the first dispatching platform, and is stored with the first dispatching platform and appoints
Mapping relations between business mark and the second platform task identification, wherein corresponding first scheduling of the first scheduler task mark is appointed
The execution of business identifies the execution of corresponding second scheduler task dependent on the second scheduler task, i.e. the second dispatching platform mark corresponds to
The second scheduler task successful execution after, the first dispatching platform identifies corresponding first scheduler task and is just performed.
Following table is that example is arranged in the field of the first allocation list in one embodiment, and in the present embodiment, the first dispatching platform is adopted
The platform of XXL-JOB frames, the second calling platform using Oozie frames platform, wherein field oozie_
Task_name is the first scheduler task mark, and field task_name is the second scheduler task mark：
Table 1
Step S103, first dispatching platform utilize cross-platform script, the log sheet of the second dispatching platform of poll
Successful logo file is run with the presence or absence of the second scheduler task corresponding with the second scheduler task mark；
Log sheet is set in advance on the second dispatching platform, for receiving the second scheduler task operation successfully mark text
Part.After second dispatching platform executes the second scheduler task, a logo file can be generated according to the operating condition of scheduler task, and
The logo file is deposited in created log sheet.
Following table is the example of log sheet in one embodiment, wherein RUN-DATA is operation number
According to OOZIE-TASK-NAME is OOZIE task names, and TASK-NAME is task names, and CHECK-TIME is inspection
Look into the time.
Table 2
In the present embodiment, a cross-platform script is called by the crontab of LINUX, can from Python, Perl,
It is chosen any one kind of them in Ruby, PHP, Lua, Java as cross-platform script, by the crontab functions of LINUX, every one point
The primary selected cross-platform script of clock triggering, the cross-platform script were adjusted every one minute first using its detection function
Spending platform utilizes cross-platform script, the log sheet of the second dispatching platform of poll to whether there is and the second scheduler task mark
Know corresponding second scheduler task and run successful logo file, if in the presence of with the second scheduler task mark corresponding second
Scheduler task runs successful logo file and the virtual task in dispatching platform is then set to completion status.
Step S104, if existing and the second scheduler task mark corresponding second in the log sheet of the second dispatching platform
Scheduler task runs successful logo file, then first dispatching platform executes corresponding with the first scheduler task mark
First scheduler task.
In the present embodiment, adjusted if having corresponding with the second scheduler task mark second in the log sheet of the second dispatching platform
The successful logo file of task run is spent, then the first dispatching platform executes the first scheduling corresponding with the first scheduler task mark and appoints
Business.First dispatching platform is masters, and the second dispatching platform is passive side.First dispatching platform initiates inquiry, and inquiry second is adjusted
Spend platform in mark, if mark completes, the task that the first dispatching platform will trigger himself brings into operation, reach according to
Bad purpose.The mark can arrange, and can be some file with having time and task label can also be in database
Certain field.
In one embodiment, if being not present in the log sheet of the second dispatching platform and second scheduler task mark pair
The second scheduler task for answering runs successful logo file, then first calling platform call the monitoring programme of the second platform with
That checks second scheduler task executes progress.
In the present embodiment, if being not present and the second scheduler task mark corresponding second in the log sheet of the second dispatching platform
Scheduler task runs successful logo file, then the first calling platform calls the monitoring programme of the second platform to check described second
Scheduler task executes progress.Task on platform is wanted to behave, and needs the mark for first going to check this platform relied on,
Mark produces, that just runs, if mark does not generate, it is necessary to spend two minutes and continue checking for.
In one embodiment, first dispatching platform and the second dispatching platform are Oozie, Linkdo, Control-
M, any one of XXL-JOB or TivoliWorkloadScheduler platform.
First dispatching platform and the second dispatching platform, can from Oozie, Linkdo, Control-M, XXL-JOB,
A kind of platform is selected for a post in Tivoli Workload Scheduler as the second dispatching platform, which should be with
First dispatching platform cannot be identical.Oozie is a workflow engine server, for run hadoop map/reduce and
The tasks workflow such as hive, while Oozie or java web program, operate in java servlet containers, such as
In tomcat, multiple action can be constituted the mode operation of a DAG figure by Oozie using action as base unit.
Control-M installs Enterprise Manager and server on the server using C/S model, pacifies on controlled host
Agent is filled, agent can submit the job stream defined by Control-M on host, and return to operation result.
The operating condition of all batch jobs can be then monitored above Enterprise Manager comprehensively, can be controlled there are many mode
The service condition of JOB and process intervention.Distributed task dispatching platform XXL-JOB is an Open Framework, based on increasing income
Quartz dispatches kernel, and scheduler task is an entirety, cannot edit the flow chart of one big task, and tracks each node
Execution state.Between multiple tasks, dependence can not be configured, run successively, for example upstream task is signaled to Downstream Jobs.
Tivoli Workload Scheduler are a task scheduling software for belonging to IBM, can correspond to the cron under Unix, but
It enhances the function of much being dispatched for enterprise, such as can handle scheduling based on dependence and event-driven, can be right
Zone management etc..Cron is merely capable of on single server dispatching based on the time, and TWS can replace cron, uses
The background program of oneself handles job scheduling arrangement with abundanter function.
In one embodiment, cross-platform script is any in Python, Perl, Ruby, PHP, Lua or Java
Script.
Script is to use a kind of specific descriptive language, according to the executable file that certain format is write, again
Referred to as macro or autoexec.Script can usually be called and executed temporarily by application program.Script has quickly exploitation,
Communication function is very powerful between the program assembly that efficient execution, explanation rather than Complied executing and other Languages are write.Its
In, any script can be realized across tune in common script Python, Perl, Ruby, PHP, Lua or Java
Spend the communication of platform.
As shown in Fig. 2, in one embodiment, providing a kind of dependence realization device across dispatching platform, which realizes
Device includes：
Acquisition module obtains the first scheduler task mark for the first dispatching platform；
Searching module is searched in the first allocation list for first dispatching platform and is identified with first scheduler task
Corresponding second scheduler task mark, wherein what first scheduler task identified corresponding first scheduler task executes dependence
The execution of corresponding second scheduler task is identified in second scheduler task；
Poller module utilizes cross-platform script, the day of the second dispatching platform of poll for first dispatching platform
Will table runs successful logo file with the presence or absence of the second scheduler task corresponding with the second scheduler task mark；
Execution module, if corresponding with the second scheduler task mark for existing in the log sheet of the second dispatching platform
Second scheduler task runs successful logo file, then first dispatching platform executes and first scheduler task mark pair
The first scheduler task answered.
In one embodiment, the cross-platform dependence realization device further includes monitoring module, if for the second scheduling
There is no the second scheduler task corresponding with the second scheduler task mark operation, successfully mark is literary in the log sheet of platform
Part, then first calling platform call the monitoring programme of the second platform and execute progress with check second scheduler task.
In one embodiment, state the first dispatching platform and second dispatching platform be Oozie, Linkdo,
Any one of Control-M, XXL-JOB or TivoliWorkloadScheduler platform.
In one embodiment, the cross-platform script is to appoint in Python, Perl, Ruby, PHP, Lua or Java
A kind of script.
In one embodiment, as shown in Figure 3, it is proposed that a kind of computer equipment, the computer equipment include passing through to be
Processor, non-volatile memory medium, memory and the network interface of bus of uniting connection.Wherein, the computer equipment is non-easy
The property lost storage medium is stored with operating system, database and computer-readable instruction, and control information sequence can be stored in database
Row when the computer-readable instruction is executed by processor, may make processor to realize inquiry, download and verify electronic invoice.It should
The processor of computer equipment supports the operation of entire computer equipment for providing calculating and control ability.The computer is set
It can be stored with computer-readable instruction in standby memory, when which is executed by processor, may make processing
Device executes following steps：
First dispatching platform obtains the first scheduler task mark；
First dispatching platform is searched corresponding with the first scheduler task mark second in the first allocation list and is adjusted
Spend task identification, wherein the execution that first scheduler task identifies corresponding first scheduler task is adjusted dependent on described second
Spend the execution of corresponding second scheduler task of task identification；
First dispatching platform utilizes cross-platform script, the log sheet of the second dispatching platform of poll whether there is with
Second scheduler task identifies corresponding second scheduler task and runs successful logo file；
If there is the second scheduler task corresponding with the second scheduler task mark in the log sheet of the second dispatching platform
Successful logo file is run, then first dispatching platform executes the first scheduling corresponding with the first scheduler task mark
Task.
In one embodiment, the method further includes：If there is no with described the in the log sheet of the second dispatching platform
Two scheduler tasks identify corresponding second scheduler task and run successful logo file, then first calling platform calls second
The monitoring programme of platform executes progress with check second scheduler task.
In one embodiment, first scheduler task and the second scheduler task are carried out by detecting virtual task state
Control, the virtual task are not correspond to actual operation program, only prepare and complete two states, the virtual task quilt
It uniformly resets to preparation state and waits for operation.
In one embodiment, first dispatching platform and the second dispatching platform are Oozie, Linkdo, Control-
M, any one of XXL-JOB or TivoliWorkloadScheduler platform.
In one embodiment, the cross-platform script is to appoint in Python, Perl, Ruby, PHP, Lua or Java
A kind of script.
In one embodiment it is proposed that a kind of storage medium being stored with computer-readable instruction, this is computer-readable
When instruction is executed by one or more processors so that one or more processors execute following steps：
First dispatching platform obtains the first scheduler task mark；
First dispatching platform is searched corresponding with the first scheduler task mark second in the first allocation list and is adjusted
Spend task identification, wherein the execution that first scheduler task identifies corresponding first scheduler task is adjusted dependent on described second
Spend the execution of corresponding second scheduler task of task identification；
First dispatching platform utilizes cross-platform script, the log sheet of the second dispatching platform of poll whether there is with
Second scheduler task identifies corresponding second scheduler task and runs successful logo file；
If there is the second scheduler task corresponding with the second scheduler task mark in the log sheet of the second dispatching platform
Successful logo file is run, then first dispatching platform executes the first scheduling corresponding with the first scheduler task mark
Task.
In one embodiment, the method further includes：If there is no with described the in the log sheet of the second dispatching platform
Two scheduler tasks identify corresponding second scheduler task and run successful logo file, then first calling platform calls second
The monitoring programme of platform executes progress with check second scheduler task.
In one embodiment, first dispatching platform and the second dispatching platform are Oozie, Linkdo, Control-
M, any one of XXL-JOB or TivoliWorkloadScheduler platform.
In one embodiment, the cross-platform script is to appoint in Python, Perl, Ruby, PHP, Lua or Java
A kind of script.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium may include：Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random
Access Memory), disk or CD etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, to keep description succinct, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, it is all considered to be the range of this specification record.
Some exemplary embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but
It cannot be construed as a limitation to the scope of the present invention.It should be pointed out that for the ordinary skill people of this field
For member, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the present invention's
Protection domain.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (10)
1. a kind of dependence implementation method across dispatching platform, which is characterized in that include the following steps：
First dispatching platform obtains the first scheduler task mark；
First dispatching platform is searched the second scheduling corresponding with the first scheduler task mark in the first allocation list and is appointed
Business mark, wherein the execution that first scheduler task identifies corresponding first scheduler task is appointed dependent on second scheduling
Business identifies the execution of corresponding second scheduler task；
First dispatching platform utilizes cross-platform script, the log sheet of the second dispatching platform of poll whether there is with it is described
Second scheduler task identifies corresponding second scheduler task and runs successful logo file；
If having the second scheduler task corresponding with the second scheduler task mark in the log sheet of the second dispatching platform to run
Successful logo file, then the first dispatching platform execution the first scheduling corresponding with the first scheduler task mark are appointed
Business.
2. the dependence implementation method according to claim 1 across dispatching platform, which is characterized in that the method further includes：
If there is no the second scheduler tasks corresponding with the second scheduler task mark to transport in the log sheet of the second dispatching platform
The successful logo file of row, then the monitoring programme of the second platform of the first calling platform calling is to check that second scheduling is appointed
Business executes progress.
3. the dependence implementation method according to claim 1 across dispatching platform, which is characterized in that first dispatching platform
It is in Oozie, Linkdo, Control-M, XXL-JOB or TivoliWorkloadScheduler with second dispatching platform
Any platform.
4. the dependence implementation method according to claim 1 across dispatching platform, which is characterized in that the cross-platform script language
Speech is any script in Python, Perl, Ruby, PHP, Lua or Java.
5. a kind of dependence realization device across dispatching platform, which is characterized in that the cross-platform dependence realization device includes：
Acquisition module obtains the first scheduler task mark for the first dispatching platform；
Searching module is searched for first dispatching platform in the first allocation list corresponding with the first scheduler task mark
The second scheduler task mark, wherein first scheduler task identify corresponding first scheduler task execution depend on institute
State the execution that the second scheduler task identifies corresponding second scheduler task；
Poller module utilizes cross-platform script, the log sheet of the second dispatching platform of poll for first dispatching platform
Successful logo file is run with the presence or absence of the second scheduler task corresponding with the second scheduler task mark；
Execution module, if for existing and the second scheduler task mark corresponding second in the log sheet of the second dispatching platform
Scheduler task runs successful logo file, then first dispatching platform executes corresponding with the first scheduler task mark
First scheduler task.
6. the dependence realization device according to claim 5 across dispatching platform, which is characterized in that the cross-platform dependence
Realization device further includes monitoring module, if for being not present and the second scheduler task mark in the log sheet of the second dispatching platform
Know corresponding second scheduler task and run successful logo file, then first calling platform calls the monitoring journey of the second platform
Sequence executes progress with check second scheduler task.
7. the dependence realization device according to claim 5 across dispatching platform, which is characterized in that first dispatching platform
It is in Oozie, Linkdo, Control-M, XXL-JOB or TivoliWorkloadScheduler with second dispatching platform
Any platform.
8. the dependence realization device according to claim 5 across dispatching platform, which is characterized in that the cross-platform script language
Speech is any script in Python, Perl, Ruby, PHP, Lua or Java.
9. a kind of computer equipment, which is characterized in that including memory and processor, being stored with computer in the memory can
Reading instruction, when the computer-readable instruction is executed by the processor so that the processor executes such as Claims 1-4
Any one of the method the step of.
10. a kind of storage medium being stored with computer-readable instruction, which is characterized in that the computer-readable instruction is by one
Or multiple processors are when executing so that one or more processors execute the step such as any one of claim 1 to 5 the method
Suddenly.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810486735.8A CN108710532B (en) | 2018-05-21 | 2018-05-21 | Dependency realization method, device, equipment and storage medium of cross-dispatching platform |
| PCT/CN2018/104708 WO2019223182A1 (en) | 2018-05-21 | 2018-09-08 | Cross-scheduling platform dependency implementation method and apparatus, device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810486735.8A CN108710532B (en) | 2018-05-21 | 2018-05-21 | Dependency realization method, device, equipment and storage medium of cross-dispatching platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108710532A true CN108710532A (en) | 2018-10-26 |
| CN108710532B CN108710532B (en) | 2023-05-30 |
Family
ID=63868322
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810486735.8A Active CN108710532B (en) | 2018-05-21 | 2018-05-21 | Dependency realization method, device, equipment and storage medium of cross-dispatching platform |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108710532B (en) |
| WO (1) | WO2019223182A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209893A (en) * | 2019-04-23 | 2019-09-06 | 北京奇艺世纪科技有限公司 | Task creating method, system and storage medium |
| CN110442392A (en) * | 2019-07-16 | 2019-11-12 | 新华三大数据技术有限公司 | A kind of packet partition method, device, electronic equipment and storage medium |
| CN110490451A (en) * | 2019-08-15 | 2019-11-22 | 中国平安财产保险股份有限公司 | Task data management-control method, device and computer equipment based on hadoop |
| CN110688101A (en) * | 2019-09-26 | 2020-01-14 | 山东浪潮通软信息科技有限公司 | Method and system for realizing distributed scheduling task based on XXL-JOB |
| CN111414264A (en) * | 2020-03-20 | 2020-07-14 | 北京奇艺世纪科技有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN111475272A (en) * | 2020-04-07 | 2020-07-31 | 四川虹美智能科技有限公司 | Method and device for controlling Java Web application timing task and task scheduling platform |
| CN111679899A (en) * | 2020-06-09 | 2020-09-18 | 微医云(杭州)控股有限公司 | Task scheduling method, device, platform equipment and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111984390A (en) * | 2020-08-31 | 2020-11-24 | 平安医疗健康管理股份有限公司 | Task scheduling method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107016480A (en) * | 2016-01-28 | 2017-08-04 | 五八同城信息技术有限公司 | Method for scheduling task, apparatus and system |
| CN107016479A (en) * | 2016-01-28 | 2017-08-04 | 五八同城信息技术有限公司 | Task scheduling and managing method, apparatus and system |
| CN107483649A (en) * | 2017-10-12 | 2017-12-15 | 福建富士通信息软件有限公司 | A kind of cross-platform log collection method based on Kaa services |
| CN107870807A (en) * | 2016-09-26 | 2018-04-03 | 平安科技（深圳）有限公司 | A kind of cross-platform method for scheduling task and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096687B (en) * | 2009-12-14 | 2013-08-07 | 阿里巴巴集团控股有限公司 | Method and platform for scheduling tasks |
| US9652294B2 (en) * | 2013-11-25 | 2017-05-16 | International Business Machines Corporation | Cross-platform workload processing |
-
2018
- 2018-05-21 CN CN201810486735.8A patent/CN108710532B/en active Active
- 2018-09-08 WO PCT/CN2018/104708 patent/WO2019223182A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107016480A (en) * | 2016-01-28 | 2017-08-04 | 五八同城信息技术有限公司 | Method for scheduling task, apparatus and system |
| CN107016479A (en) * | 2016-01-28 | 2017-08-04 | 五八同城信息技术有限公司 | Task scheduling and managing method, apparatus and system |
| CN107870807A (en) * | 2016-09-26 | 2018-04-03 | 平安科技（深圳）有限公司 | A kind of cross-platform method for scheduling task and device |
| CN107483649A (en) * | 2017-10-12 | 2017-12-15 | 福建富士通信息软件有限公司 | A kind of cross-platform log collection method based on Kaa services |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209893A (en) * | 2019-04-23 | 2019-09-06 | 北京奇艺世纪科技有限公司 | Task creating method, system and storage medium |
| CN110442392A (en) * | 2019-07-16 | 2019-11-12 | 新华三大数据技术有限公司 | A kind of packet partition method, device, electronic equipment and storage medium |
| CN110442392B (en) * | 2019-07-16 | 2022-08-09 | 新华三大数据技术有限公司 | Packet isolation method and device, electronic equipment and storage medium |
| CN110490451A (en) * | 2019-08-15 | 2019-11-22 | 中国平安财产保险股份有限公司 | Task data management-control method, device and computer equipment based on hadoop |
| CN110688101A (en) * | 2019-09-26 | 2020-01-14 | 山东浪潮通软信息科技有限公司 | Method and system for realizing distributed scheduling task based on XXL-JOB |
| CN111414264A (en) * | 2020-03-20 | 2020-07-14 | 北京奇艺世纪科技有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN111475272A (en) * | 2020-04-07 | 2020-07-31 | 四川虹美智能科技有限公司 | Method and device for controlling Java Web application timing task and task scheduling platform |
| CN111679899A (en) * | 2020-06-09 | 2020-09-18 | 微医云(杭州)控股有限公司 | Task scheduling method, device, platform equipment and storage medium |
| CN111679899B (en) * | 2020-06-09 | 2023-05-23 | 微医云(杭州)控股有限公司 | Task scheduling method, device, platform equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019223182A1 (en) | 2019-11-28 |
| CN108710532B (en) | 2023-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108710532A (en) | Across dependence implementation method, device, equipment and the storage medium of dispatching platform | |
| CN108304714B (en) | Access management system, access management robot promotion system, and access management method | |
| US11449379B2 (en) | Root cause and predictive analyses for technical issues of a computing environment | |
| US11494291B2 (en) | System and computer-implemented method for analyzing test automation workflow of robotic process automation (RPA) | |
| US10938678B2 (en) | Automation plan generation and ticket classification for automated ticket resolution | |
| Mirakhorli et al. | A tactic-centric approach for automating traceability of quality concerns | |
| US11327749B2 (en) | System and method for generating documentation for microservice based applications | |
| CN107016480B (en) | Task scheduling method, device and system | |
| US8327360B2 (en) | Migration of process instances | |
| CN108491254A (en) | A kind of dispatching method and device of data warehouse | |
| CN113569987A (en) | Model training method and device | |
| US20200042310A1 (en) | Automated software package deployment | |
| Vysotska et al. | Automated monitoring of changes in web resources | |
| CN106407219B (en) | Crawling method and device for webpage links | |
| Mahato et al. | Load balanced scheduling and reliability modeling of grid transaction processing system using colored Petri nets | |
| BR102021002596A2 (en) | DYNAMICALLY ALLOCATED CLOUD OPERATORS MANAGEMENT SYSTEM AND METHOD FOR IT | |
| KR101596257B1 (en) | System and method for developing of service based on software product line | |
| US11068487B2 (en) | Event-stream searching using compiled rule patterns | |
| Paradkar | Mastering non-functional requirements | |
| Dhakate et al. | Distributed cloud monitoring using Docker as next generation container virtualization technology | |
| US11290325B1 (en) | System and method for change reconciliation in information technology systems | |
| US20110289041A1 (en) | Systems and methods for managing assignment templates | |
| JP2019040600A (en) | Determination of task automation using natural language processing | |
| CN115147031B (en) | Clearing workflow execution method, device, equipment and medium | |
| US20200348926A1 (en) | System and method for automating environment management of one or more software applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |