CN107577527A - Task generation and scheduling method and device - Google Patents
Task generation and scheduling method and device Download PDFInfo
- Publication number
- CN107577527A CN107577527A CN201710765905.1A CN201710765905A CN107577527A CN 107577527 A CN107577527 A CN 107577527A CN 201710765905 A CN201710765905 A CN 201710765905A CN 107577527 A CN107577527 A CN 107577527A
- Authority
- CN
- China
- Prior art keywords
- task
- goal task
- engineering
- goal
- public
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The embodiment of the invention provides a task generating method, a task scheduling method and a task generating device, wherein the task generating method comprises the following steps: by acquiring a public project, wherein the public project is as follows: engineering for realizing the common functions among tasks; acquiring a target task project for realizing a target task, wherein the target task project comprises the following steps: a project generated according to the function of the target task which is not included in the public project; and generating the target task according to the public engineering and the target task engineering. According to the technical scheme provided by the invention, the program codes of the common functions among the tasks are uniformly stored in the public engineering, so that the program codes of the common function parts do not need to be repeatedly written in the task generating process, the public engineering can be directly obtained, the task generating process is simplified, and the workload is reduced.
Description
Technical field
The present invention relates to big data technical field, more particularly to task generation, dispatching method and device.
Background technology
With the development of big data technology, Internet firm not only needs to be grasped huge data message, and with greater need for
There is the ability that specialized process is carried out to data message.So, can also be to task even if the task of data processing is on the increase
Effectively manage, dispatch and perform.
At present, it is based on workflow task scheduler oozie to carry out task scheduling mode the most frequently used during task scheduling
Task scheduling mode, oozie can support to run polytype task, before to each task scheduling, oozie need into
The corresponding parameter configuration of row, the mode of parameter configuration are:The task is joined by shell script corresponding to each task
Number configuration.In view of the foregoing, need to be that each task generates a shell script.If there is 20 tasks to be scheduled in oozie,
So need to develop 20 shell scripts, with for 20 tasks are configured and run respectively.
Although task scheduling can be realized using aforesaid way,, it is necessary to generate each before task scheduling is carried out
The corresponding shell script of task, and between shell script in may have identical program code, for example, each script journey
The program code for being configured to task run environment and task attribute can be related in sequence.Due to shell script and task
Between be one-to-one, so, even if identical program code be present, for shell script corresponding to each task,
It is also required to repeat to write.So, in the task of generation, the phenomenon that program code is write in repetition be present, cause task generating process
Cumbersome, the problem of workload is big.
The content of the invention
The purpose of the embodiment of the present invention is to provide task generation, dispatching method and device, to solve task generating process
The problem of program code is write in middle repetition, so as to simplify task generating process, reduce workload.Concrete technical scheme is as follows:
In a first aspect, the embodiments of the invention provide a kind of task creating method, methods described includes:
Public work is obtained, wherein, the public work is:For realizing public functional engineering between task;
The goal task engineering for realizing goal task is obtained, wherein, the goal task engineering is:According to the public affairs
The engineering of the function generation for the goal task that engineering does not include altogether;
The goal task is generated according to the public work and the goal task engineering.
Alternatively, the public work includes common parameter configuration file;
After the step of acquisition public work, in addition to:
The parameter of the common parameter configuration file is configured according to the mission requirements of the goal task.
Alternatively, the goal task engineering includes special parameter configuration file;
After the step of goal task engineering obtained for realizing goal task described, in addition to:
The parameter of the special parameter configuration file is configured according to the mission requirements of the goal task.
Alternatively, methods described also includes:
Obtain the task of having moved that local device is moved to from source device;
Local path is revised as in the source device path of the common parameter configuration file of the task of having moved, by described in
It is revised as local path in the source device path of the special parameter configuration file of migration task.
Second aspect, the embodiments of the invention provide a kind of method for scheduling task, methods described includes:
Obtain the dispatch command for regulation goal task;
According to the call instruction, it is determined that the goal task engineering for realizing the goal task;
By calling the goal task engineering, public work is called to carry out parameter configuration to the goal task, wherein,
The public work is:For realizing public functional engineering between task;
Parameter configuration is carried out to the goal task by the goal task engineering;
Run scheduling of goal task engineering and the public work realization to the goal task.
Alternatively, it is described by calling the goal task engineering, call public work to join the goal task
The step of number configuration, including:
By calling the goal task engineering, public work is called, to cause the public work in such a way
Configure the common parameter of the goal task:
The public work reads common parameter configuration file under preset path;
According to the parameter information recorded in the common parameter configuration file, the common parameter of the goal task is configured.
Alternatively, described the step of parameter configuration is carried out to the goal task by the goal task engineering, including:
At least one of following parameter of the goal task is configured by the goal task engineering:
Task number of retries, task retry interval duration, task starts time point, the executive mode, described of task
The task names of goal task, the tasks carrying type of the goal task, the task trigger condition of the goal task.
Alternatively, the operation goal task engineering and public work realize the step of the scheduling to the goal task
Suddenly, including:
The goal task engineering is run, whether appointing for the goal task is met by the goal task engineering detecting
Business trigger condition;
If satisfied, performing the function that the goal task engineering includes, and exist in the goal task engineering and be directed to institute
When stating the calling demand of public work, the public work is called by the goal task engineering, realizes and the target is appointed
The scheduling of business.
Alternatively, the task trigger condition that the goal task whether is met by the goal task engineering detecting
The step of after, in addition to:
When the goal task engineering detecting is unsatisfactory for the task trigger condition of the goal task, obstruction etc. is performed
Treat, the number of retries that the obstruction waits is preset times.
Alternatively, after described the step of performing obstruction wait, in addition to:
After the obstruction for performing the preset times waits, when the goal task engineering detecting is unsatisfactory for the target
During the task trigger condition of task, alert.
The third aspect, the embodiments of the invention provide a kind of task generating device, described device includes:
First acquisition module, for obtaining public work, wherein, the public work is:It is publicly-owned between task for realizing
The engineering of function;
Second acquisition module, for obtaining the goal task engineering for being used for realizing goal task, wherein, the goal task
Engineering is:The engineering of the function generation for the goal task not included according to the public work;
Generation module, for generating the goal task according to the public work and the goal task engineering.
Alternatively, the public work includes common parameter configuration file;
Described device also includes:
First configuration module, the ginseng for the mission requirements according to the goal task to the common parameter configuration file
Number is configured.
Alternatively, the goal task engineering includes special parameter configuration file;
Described device also includes:
Second configuration module, the ginseng for the mission requirements according to the goal task to the special parameter configuration file
Number is configured.
Alternatively, described device also includes:
3rd acquisition module, the task of having moved of local device is moved to from source device for obtaining;
Modified module, for the source device path of the common parameter configuration file of the task of having moved to be revised as into local
Path, local path is revised as in the source device path of the special parameter configuration file of the task of having moved.
Fourth aspect, the embodiments of the invention provide a kind of task scheduling apparatus, described device includes:
4th acquisition module, for obtaining the dispatch command for regulation goal task;
Determining module, for according to the call instruction, it is determined that the goal task engineering for realizing the goal task;
Calling module, for by calling the goal task engineering, calling public work to carry out the goal task
Parameter configuration, wherein, the public work is:For realizing public functional engineering between task;
3rd configuration module, for carrying out parameter configuration to the goal task by the goal task engineering;
Module is run, for running scheduling of goal task engineering and the public work realization to the goal task.
Alternatively, the calling module includes:
Submodule is called, for by calling the goal task engineering, public work being called, to cause the public work
Journey configures the common parameter of the goal task in such a way:
Reading submodule, common parameter configuration file is read under preset path for the public work;
Submodule is configured, for according to the parameter information recorded in the common parameter configuration file, configuring the target
The common parameter of task.
Alternatively, the 3rd configuration module is specifically used for:
At least one of following parameter of the goal task is configured by the goal task engineering:
Task number of retries, task retry interval duration, task starts time point, the executive mode, described of task
The task names of goal task, the tasks carrying type of the goal task, the task trigger condition of the goal task.
Alternatively, the operation module includes:
Submodule is run, for running the goal task engineering, whether is met by the goal task engineering detecting
The task trigger condition of the goal task;
Implementation sub-module, when meeting the task trigger condition of the goal task for the operation submodule detection, hold
The function that the row goal task engineering includes, and needed in the goal task engineering in the presence of the calling for the public work
When asking, the public work is called by the goal task engineering, realizes the scheduling to the goal task.
Alternatively, the operation module also includes:
Execution module is waited, the task trigger condition of the goal task is unsatisfactory for for the operation submodule detection
When, perform obstruction and wait, the number of retries that the obstruction waits is preset times.
Alternatively, the motion module also includes:
Alarm submodule, after the obstruction for performing the preset times for the wait execution module waits, the fortune
When the detection of row submodule is unsatisfactory for the task trigger condition of the goal task, send a warning.
5th aspect, the embodiments of the invention provide a kind of electronic equipment, including processor, communication interface, memory and
Communication bus, wherein, processor, communication interface, memory completes mutual communication by communication bus;
Memory, for depositing computer program;
Processor, during for performing the program deposited on memory, realize any of the above-described task creating method step
Suddenly.
6th aspect, the embodiments of the invention provide a kind of computer-readable recording medium, the computer-readable storage
Dielectric memory contains computer program, and the computer program realizes any of the above-described task generation side when being executed by processor
Method step.
7th aspect, the embodiments of the invention provide a kind of electronic equipment, including processor, communication interface, memory and
Communication bus, wherein, processor, communication interface, memory completes mutual communication by communication bus;
Memory, for depositing computer program;
Processor, during for performing the program deposited on memory, realize any of the above-described method for scheduling task step
Suddenly.
Eighth aspect, the embodiments of the invention provide a kind of computer-readable recording medium, the computer-readable storage
Dielectric memory contains computer program, and the computer program realizes any of the above-described task scheduling side when being executed by processor
Method step.
In scheme provided in an embodiment of the present invention, by obtaining public work, wherein, the public work is:For reality
Public functional engineering between current task;The goal task engineering for realizing goal task is obtained, wherein, the goal task work
Cheng Wei:The engineering of the function generation for the goal task not included according to the public work;According to the public work and
The goal task engineering generates the goal task., will be publicly-owned between task by technical scheme provided in an embodiment of the present invention
The program code of function is uniformly stored in public work, so, does not have to repeat in task generating process to write publicly-owned work(
The program code of energy part, directly obtains public work, simplifies the generating process of task, and reduce workload.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of flow chart of task creating method provided in an embodiment of the present invention;
Fig. 2 is another flow chart of task creating method provided in an embodiment of the present invention;
Fig. 3 is a kind of flow chart of method for scheduling task provided in an embodiment of the present invention;
Fig. 4 is another flow chart of method for scheduling task provided in an embodiment of the present invention;
Fig. 5 is a kind of structural representation of task generating device provided in an embodiment of the present invention;
Fig. 6 is another structural representation of task generating device provided in an embodiment of the present invention;
Fig. 7 is a kind of structural representation of task scheduling apparatus provided in an embodiment of the present invention;
Fig. 8 is another structural representation of task scheduling apparatus provided in an embodiment of the present invention;
Fig. 9 is a kind of structural representation of a kind of electronic equipment provided in an embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
In order that obtaining in task generating process, the program code of publicly-owned funtion part, Jin Erjian are write without repeating
The generating process of change task, and reduce workload.The embodiment of the present invention provides task generation, dispatching method and device.
Task creating method provided in an embodiment of the present invention is introduced first below.
Task creating method provided in an embodiment of the present invention can apply to server, can also be applied to terminal device.
As shown in figure 1, task creating method provided in an embodiment of the present invention, comprises the following steps:
S101, obtain public work.
Public work is:For realizing public functional engineering between task, publicly-owned function can be that each task is both needed to use
Function, or, the function that each task can be used.Therefore, public work is towards multiple tasks, is available for multiple tasks
The engineering of calling.
Alternatively, publicly-owned function can include:The function that is configured to publicly-owned parameter, it is embodied as task and assigns same value
Function, realize the publicly-owned functional module such as function etc. that reported an error to the monitoring function during task run, the task of realization.Wherein, show
Example ground, publicly-owned parameter can be configuration parameter, task attribute parameter of task environment etc., and publicly-owned functional module can be:Realize
The function of same value is assigned for task, realizes the function etc. that reported an error to the monitoring function during task run, the task of realization.
In the embodiment of the present invention, as long as the function of being regarded to be used by multiple tasks may be considered publicly-owned work(
Can, realizing the program code of the function can be stored in public work, in case needing to realize that the task of the function is adjusted at any time
With.
In the first embodiment, public work includes common parameter configuration file, and the common parameter configuration file is used for
The corresponding common parameter of each task is configured.
Wherein, common parameter can be located in same common parameter configuration file, can also be:Each common parameter point
In common parameter configuration file that Wei Yu be not different, i.e. each common parameter is one-to-one corresponding with common parameter configuration file
Relation.
, can be with the mission requirements according to goal task to common parameter configuration file after public work is got
Parameter is configured.In the case where common parameter is located in different common parameter configuration files respectively, common parameter is matched somebody with somebody
The parameter for putting file is configured, and can be only in the common parameter configuration file needed for goal task.Work as public work
In included all common parameter configuration files be needed for goal task, then, to all public ginsengs in public work
The parameter of number configuration file is configured;It is needed for goal task when there was only part common parameter configuration file in public work
, then, only the parameter of the part common parameter configuration file is configured.
Illustratively, the common parameter configuration file included in public work has:Ambient parameter configuration file and property parameters
Configuration file, wherein, ambient parameter configuration file is specially common-property.conf, and property parameters configuration file is specific
For common-udp.conf.For goal task, it is both needed to configure ambient parameter and property parameters, therefore, in mesh
In mark task generating process, it is necessary to be configured respectively to ambient parameter configuration file and property parameters after public work is obtained
The parameter of file is configured.
S102, obtain the goal task engineering for realizing goal task.
Goal task engineering is:The engineering of the function generation for the goal task not included according to public work, i.e. target is appointed
In the implementation of the repertoire of business, publicly-owned function therein is realized by public work, remaining institute is functional by target
Task Project Realization.It can be understood as:The function of being realized in goal task engineering only for the function needed for goal task,
It is function specific to the goal task.
For example, task names are specific to each task, the title of the goal task is carried out in goal task engineering
Configuration;Task trigger condition is for each task and different, also, for same task in different application environments
Under, the task trigger condition of the goal task is configured in goal task engineering.
Therefore, goal task engineering is effective only for goal task, only could be to this in regulation goal task
Goal task engineering is called, and goal task engineering and goal task are one-to-one relation.
In second of embodiment, goal task engineering includes special parameter configuration file, the special parameter configuration file
For being configured to the corresponding special parameter of the goal task, wherein, special parameter is the ginseng for being only applicable to the goal task
Number, and do not have universal applicability.
Wherein, special parameter can be located in same special parameter configuration file, can also be:Each special parameter point
In special parameter configuration file that Wei Yu be not different, i.e. each special parameter is one-to-one corresponding with special parameter configuration file
Relation.
, can be with the mission requirements according to goal task after acquisition is used to realize the goal task engineering of goal task
The parameter of special parameter configuration file is configured.Included special parameter configuration file can be equal in goal task engineering
It is the configuration file needed for goal task, then, the parameter of special parameter configuration file is set in goal task engineering
Put.It is, of course, understood that in the case where special parameter is located in different special parameter configuration files respectively, in mesh
Set special parameter configuration file can be all configuration files in goal task engineering in mark task engineering, can be with
It is part special parameter configuration file of the goal task under the present circumstances corresponding to required partial parameters.
Illustratively, the special parameter configuration file in goal task engineering can be:Scheduler.conf and
Joblist.conf, wherein, configuration file Scheduler.conf can be to task number of retries, when retrying interval of task
The special parameters such as the executive mode of long, the startup time point of task and task are configured, and configuration file joblist.conf can
To be configured to special parameters such as task names, tasks carrying type and task trigger conditions.
Alternatively, Scheduler.conf and joblist.conf can be generated respectively in goal task engineering, certainly,
It can not limited herein with self-defined setting in the type of the configuration file generated needed for goal task engineering.
Wherein, tasks carrying type can be the type of computation model, and computation model can be distributed computing platform
Spark, data warehouse base frame Hive, distributed computing platform MapperReducer, local computing Local.
S103, the goal task is generated according to the public work and the goal task engineering.
Publicly-owned function is realized by public work, the goal task not included by goal task Project Realization public work its
His function, both are combined, then can realize the repertoire of goal task.Thus, by public work and goal task work
Journey can generate goal task.
In scheme provided in an embodiment of the present invention, by obtaining public work, wherein, public work is:Appoint for realizing
Public functional engineering between business;The goal task engineering for realizing goal task is obtained, wherein, goal task engineering is:Root
The engineering of the function generation for the goal task not included according to public work;According to public work and goal task engineering generation target
Task.By technical scheme provided in an embodiment of the present invention, public functional program code between task is uniformly stored in public
In engineering, so, do not have to repeat the program code for writing publicly-owned funtion part in task generating process, directly obtain public
Engineering, simplifies the generating process of task, and reduces workload.
The migration of task is completed for convenience and faster, and then save the time cost of task immigration, this hair
Bright embodiment also provides another implementation of task creating method.
On the basis of above-mentioned Fig. 1, as shown in Fig. 2 task creating method provided in an embodiment of the present invention, can also include
Following steps:
S201, obtain the task of having moved that local device is moved to from source device.
Wherein, source device refers to the equipment that migration task is stored before migration, when task is migrated, be by
The public work and task engineering of the task are migrated together.It is alternatively possible to it is by the public work of task and task work
Journey is copied to local from source device, and so, just task is migrated, meanwhile, local machine can also obtain appointing for the migration
Business.
S202, local path is revised as in the source device path of the common parameter configuration file of the task of having moved, will
It is revised as local path in the source device path of the special parameter configuration file of the task of having moved.
The common parameter configuration file stored in public work, and store special parameter in goal task engineering and match somebody with somebody
File is put, is provided with corresponding store path, when being called to goal task, to be called according to store path
Corresponding configuration file, and then carry out corresponding parameter configuration.
After task immigration is carried out, each corresponding path also needs to make and repaiied accordingly for configuration file in the task
Change, will the source device path of each configuration file be revised as local path.Specifically, common parameter in public work is configured into text
Local path is revised as in the source device path of part, and the source device path of special parameter configuration file in goal task engineering is changed
For local path.
It should be noted that the path changed in the present embodiment is the root path that each engineering relies on, that is, need what is changed
Source device path and amended local path are the root path that each engineering relies on.
In addition, being had moved task and after being modified to respective paths in acquisition, the task of having moved applies ring
Border also becomes local device from source device, therefore, it is necessary to the ambient parameter configuration in the public work for task of being had moved to this is literary
Parameter in part is modified, to adapt to the application environment of current local device.
In a kind of embodiment, path can be uniformly stored in a database, when needing to obtain configuration file, from
The path corresponding to the configuration file is obtained in the database.And when task immigration, can also be directly in database
Change path.So, not only facilitate and be advantageous to be managed collectively.
Illustratively, when goal task is migrated, wherein, the database in the goal task for store path is
CrontabVar, ambient parameter configuration file are stored under the conf/ catalogues in public work, and the target is obtained in local device
After task, the root path relied on each path stored in database crontabVar is modified, also, in public work
In conf/ catalogues under, the parameter in ambient parameter configuration file is changed accordingly.So, task is just completed
Migration.
By scheme provided in an embodiment of the present invention, when task migrates, it is only necessary to which corresponding each engineering is relied on
Root path is modified, and is more convenient and is faster completed migration, and then saves the time cost of task immigration.
Under conditions of task based access control has generated, realize that what public functional public work between task can want with supply and demand appoints
It to be engaged in any calling, each task only needs to generate each self-corresponding task engineering, so, simplifies the generating process of task, and
Reduce workload.
Method for scheduling task provided in an embodiment of the present invention is introduced first below.
Method for scheduling task provided in an embodiment of the present invention can apply to server, can also be applied to terminal device.
As shown in figure 3, method for scheduling task provided in an embodiment of the present invention, comprises the following steps:
S301, obtain the dispatch command for regulation goal task.
Different tasks can realize different functions, or, even realizing identical function, but different timess
Business is different in the implementation procedure for realizing function.So, can be determined according to the purpose of current application environment and task
Being called for task.
S302, according to the call instruction, it is determined that the goal task engineering for realizing the goal task.
Task can include public work and task engineering, wherein, public work is to realize public functional engineering, can be with
Supply and demand will realize the public any task call of functional, and therefore, public work and task are one-to-many relations;Task engineering
It is the engineering for realizing other functions of not including in public work, and other functions are the functions that the task needs to realize,
It is to be understood that the function of the task Project Realization is the specific function of task institute, therefore, task engineering and task are one by one
Corresponding relation.
Dispatch command determines the goal task of required scheduling, and goal task is corresponding with goal task engineering, thus, can
To determine to realize the goal task engineering of goal task.
S303, by calling the goal task engineering, public work is called to carry out parameter configuration to the goal task.
Wherein, public work is:For realizing public functional engineering between task.When being scheduled to goal task,
Invocation target task engineering first, public work is called by the goal task engineering, so as to run the public work, so that it is right
The goal task carries out the configuration of common parameter.
In a kind of embodiment, when running public work, public work can call read under preset path it is public
Parameter configuration files, wherein, preset path can be pre-set in task generating process.
Alternatively, a kind of implementation of preset path, path can be uniformly stored in number in task generating process
According in storehouse, so, when public work reads common parameter configuration file under preset path, public work calls storage road first
The database in footpath, and then path corresponding to each common parameter configuration file is got in the database.
Record has parameter information in common parameter configuration file, and the parameter information is that the corresponding parameter of goal task is entered
The specifying information of row configuration, for example, the parameter information recorded in ambient parameter configuration file is ambient parameter information, property parameters
What is recorded in configuration file is the information of goal task attribute.
After common parameter configuration file is got, the parameter letter recorded in the common parameter configuration file can be read
Cease, and the parameter information read is allocated to the common parameter of corresponding goal task.
S304, parameter configuration is carried out to the goal task by the goal task engineering.
After the configuration of common parameter of public work completion goal task is called by goal task engineering, target is appointed
Journey of working is continued to run with, and parameter configuration is carried out to goal task, wherein, goal task is configured by goal task engineering
Parameter be for the specific parameter of goal task institute.
The parameter configured by goal task engineering to goal task can include polytype, such as:Task weight
Examination number, task retry interval duration, task start time point, the executive mode of task, the task names of goal task,
The tasks carrying type of goal task, task trigger condition of goal task etc..Certainly, target is appointed by goal task engineering
The parameter for being engaged in being configured can include at least one of three of the above parameter, not limit herein.
Wherein, the executive mode of task can be performed parallel, can also be serial execution.
Wherein, the tasks carrying type of goal task can be classified from the angle of computation model, can specifically be divided
For:Distributed computing platform Spark, data warehouse base frame Hive, distributed computing platform MapperReducer, local
Computing Local.Goal task has set the computation model for performing the goal task in generating process in goal task engineering,
When carrying out goal task scheduling, the computation model of setting is directly invoked by goal task engineering.
Wherein, the task trigger condition of goal task can be in the form of task trigger, now, goal task engineering
It is that task trigger is configured.
Illustratively, task number of retries is arranged to 2, then invocation target task engineering carries out parameter configuration to goal task
When, the task number of retries of goal task is configured to 2, represented in the goal task in the process of running, if operation failure can
Using the number retried as 2 times;The parameter information at the startup time point of task is arranged to 12:00, then invocation target task engineering pair
When goal task carries out parameter configuration, the task start time point of goal task is configured to 12:00, represent that the goal task exists
Daily 12:00 moment startup optimization.
In addition, work as the first parameter for being stored with public work and goal task engineering and being configured to the first parameter
Configuration file, also, when calling public work to carry out parameter configuration to goal task, according in first parameter configuration files
The parameter information of record, first parameter is configured.Match somebody with somebody carrying out parameter to goal task by goal task engineering
When putting, according to the parameter information recorded in first parameter configuration files, goal task engineering is matched somebody with somebody to first parameter
Put.So, before the parameter information that goal task engineering is configured to first parameter can cover public work to this first
The parameter information that parameter is configured.The parameter information for the first parameter that goal task calls in the process of running is also that target is appointed
The parameter information that journey of working is configured to first parameter.
S305, run scheduling of goal task engineering and the public work realization to the goal task.
Goal task includes goal task engineering and public work, completes configuration of the public work to common parameter, with
And after configuration of the goal task engineering to the special parameter of the goal task, the goal task can be run, so as to realize this
The function of goal task.
In scheme provided in an embodiment of the present invention, goal task is carried out respectively by public work and goal task engineering
Parameter configuration, and then realize the scheduling to goal task.Under conditions of having been generated based on goal task, public affairs between task are realized
The task that functional public work can be wanted with supply and demand is arbitrarily called, and goal task only needs to generate corresponding goal task engineering
And call, so, simplify the generating process of task, and reduce workload.
In order to simplify the generating process of task, reduce workload, the embodiment of the present invention also provides the another of method for scheduling task
One implementation.
As shown in figure 4, method for scheduling task provided in an embodiment of the present invention, comprises the following steps:
S401, obtain the dispatch command for regulation goal task.
S402, according to the call instruction, it is determined that the goal task engineering for realizing the goal task.
S403, by calling the goal task engineering, public work is called to carry out parameter configuration to the goal task.
S404, parameter configuration is carried out to the goal task by the goal task engineering.
In the present embodiment, S401 to S404 is identical with the S301 to S304 of above-described embodiment, will not be described here
S405, the goal task engineering is run, whether meet that the target is appointed by the goal task engineering detecting
The task trigger condition of business, if satisfied, performing step S406.
After the parameter configuration of goal task is completed, whether meet that task triggers bar by goal task engineering detecting
Part, wherein, task trigger condition can be that SQL is realized.
Illustratively, in goal task generating process, a self-defined function in public work, the function is when called
For checking each parameter that the goal task configures, check whether each parameter meets corresponding requirement.If all parameters
It is satisfied by each self-corresponding when requiring, function output preset value;If have parameter be unsatisfactory for corresponding to when requiring, the function is defeated
The other values gone out beyond the preset value.Wherein, preset value can be the self-defined setting in defined function, for example, this is default
Value can be 0, then, when there is parameter to be unsatisfactory for corresponding require, function output is non-zero.
S406, the function that the goal task engineering includes is performed, and existed in the goal task engineering for described
During the calling demand of public work, the public work is called by the goal task engineering, realized to the goal task
Scheduling.
When meeting the task trigger condition of goal task by goal task engineering detecting, then the goal task is run,
The function that i.e. performance objective task engineering includes.Certainly, when goal task requirement of engineering calls public work, mesh can be passed through
Mark task engineering calls public work, and then realizes the scheduling to goal task.
In one embodiment, when the task trigger condition that goal task is unsatisfactory for by goal task engineering detecting
When, obstruction can be performed and waited.Wherein, the number of retries for blocking wait can be default, and the time waited per secondary stricture can
With the self-defined setting in goal task generating process, for example, obstruction wait can be arranged to 10 minutes * 10 times, i.e., it is every
Secondary stricture carries out one-time detection again after waiting, if being unsatisfactory for continuing executing with obstruction wait, can so perform 10 secondary strictures etc.
Treat, wait every time when a length of 10 minutes.
On the basis of above-mentioned embodiment, in another embodiment, waited in the obstruction for performing the preset times
When afterwards, and by goal task engineering detecting being unsatisfactory for the task trigger condition of goal task, can with alert, with
Goal task is reminded to be unsatisfactory for task trigger condition, it is impossible to continue executing with.The mode of warning message can have it is a variety of, such as:Sound
Sound remind, word remind, wherein word remind includes pop-up prompting, also, alarm advice method can be short message, mail,
At least one of advice methods such as wechat.Certainly, the species of warning message and advice method can with self-defined setting, and
And species and advice method can be one or more kinds of, not limit herein.
Certainly, for warning message, task trigger condition can be not only directed to, can also be in Parameter Configuration process to ginseng
Several checkings, if authentication failed, alert;Can also be in goal task running, if operation exception occurs
Or during operation failure, alert.It is above-mentioned to be configured in goal task generating process.
In scheme provided in an embodiment of the present invention, goal task is carried out respectively by public work and goal task engineering
Parameter configuration, and then realize the scheduling to goal task.Under conditions of having been generated based on goal task, public affairs between task are realized
The task that functional public work can be wanted with supply and demand is arbitrarily called, and goal task only needs to generate corresponding goal task engineering
And call, so, simplify the generating process of task, and reduce workload.
With reference to above-mentioned task creating method embodiment, the embodiment of the present invention also provides a kind of task generating device, such as Fig. 5 institutes
Show, the task generating device includes:
First acquisition module 510, for obtaining public work, wherein, the public work is:It is public between task for realizing
Functional engineering;
Second acquisition module 520, for obtaining the goal task engineering for being used for realizing goal task, wherein, the target
Task engineering is:The engineering of the function generation for the goal task not included according to the public work;
Generation module 530, for generating the goal task according to the public work and the goal task engineering.
Alternatively, in the first embodiment, public work includes common parameter configuration file;
The task generating device also includes:
First configuration module, the ginseng for the mission requirements according to the goal task to the common parameter configuration file
Number is configured.
Alternatively, in second of embodiment, the goal task engineering includes special parameter configuration file;
The task generating device also includes:
Second configuration module, the ginseng for the mission requirements according to the goal task to the special parameter configuration file
Number is configured.
In scheme provided in an embodiment of the present invention, by obtaining public work, wherein, public work is:Appoint for realizing
Public functional engineering between business;The goal task engineering for realizing goal task is obtained, wherein, goal task engineering is:Root
The engineering of the function generation for the goal task not included according to public work;According to public work and goal task engineering generation target
Task.By technical scheme provided in an embodiment of the present invention, public functional program code between task is uniformly stored in public
In engineering, so, do not have to repeat the program code for writing publicly-owned funtion part in task generating process, directly obtain public
Engineering, simplifies the generating process of task, and reduces workload.
On the basis of above-mentioned second of embodiment, as shown in fig. 6, task generating device can also include:
3rd acquisition module 540, the task of having moved of local device is moved to from source device for obtaining;
Modified module 550, for the source device path of the common parameter configuration file of the task of having moved to be revised as
Local path, local path is revised as in the source device path of the special parameter configuration file of the task of having moved.
By in scheme provided in an embodiment of the present invention, when task migrates, it is only necessary to corresponding all engineerings according to
Bad root path is modified, and is more convenient and is faster completed migration, and then saves the time cost of task immigration.
For the embodiment, because it is substantially similar to above-mentioned task generation embodiment, so describing simpler
Single, the part that embodiment is generated referring to above-mentioned task illustrates.
With reference to above-mentioned method for scheduling task embodiment, the embodiment of the present invention also provides a kind of task scheduling apparatus, such as Fig. 7 institutes
Show, the task scheduling apparatus includes:
4th acquisition module 710, for obtaining the dispatch command for regulation goal task;
Determining module 720, for according to the call instruction, it is determined that the goal task work for realizing the goal task
Journey;
Calling module 730, for by calling the goal task engineering, calling public work to enter the goal task
Row parameter configuration, wherein, the public work is:For realizing public functional engineering between task;
3rd configuration module 740, for carrying out parameter configuration to the goal task by the goal task engineering;
Module 750 is run, for running tune of goal task engineering and the public work realization to the goal task
Degree.
Alternatively, in a kind of embodiment, the calling module 730 includes:
Submodule is called, for by calling the goal task engineering, public work being called, to cause the public work
Journey configures the common parameter of the goal task in such a way:
Reading submodule, common parameter configuration file is read under preset path for the public work;
Submodule is configured, for according to the parameter information recorded in the common parameter configuration file, configuring the target
The common parameter of task.
Alternatively, in a kind of embodiment, the 3rd configuration module 740 is specifically used for:
At least one of following parameter of the goal task is configured by the goal task engineering:
Task number of retries, task retry interval duration, task starts time point, the executive mode, described of task
The task names of goal task, the tasks carrying type of the goal task, the task trigger condition of the goal task.
In scheme provided in an embodiment of the present invention, goal task is carried out respectively by public work and goal task engineering
Parameter configuration, and then realize the scheduling to goal task.Under conditions of having been generated based on goal task, public affairs between task are realized
The task that functional public work can be wanted with supply and demand is arbitrarily called, and goal task only needs to generate corresponding goal task engineering
And call, so, simplify the generating process of task, and reduce workload.
On the basis of Fig. 7, as shown in figure 8, operation module 750 can include:
Submodule 751 is run, it is whether full by the goal task engineering detecting for running the goal task engineering
The task trigger condition of the foot goal task;
Implementation sub-module 752, when meeting the task trigger condition of the goal task for the operation submodule detection,
The function that the goal task engineering includes is performed, and the calling for the public work be present in the goal task engineering
During demand, the public work is called by the goal task engineering, realizes the scheduling to the goal task.
Alternatively, in a kind of embodiment, operation module 750 can also include:
Execution module is waited, the task trigger condition of the goal task is unsatisfactory for for the operation submodule detection
When, perform obstruction and wait, the number of retries that the obstruction waits is preset times.
Alternatively, in a kind of embodiment, operation module 750 can also include:
Alarm submodule, after the obstruction for performing the preset times for the wait execution module waits, the fortune
When the detection of row submodule is unsatisfactory for the task trigger condition of the goal task, send a warning.
In scheme provided in an embodiment of the present invention, goal task is carried out respectively by public work and goal task engineering
Parameter configuration, and then realize the scheduling to goal task.Under conditions of having been generated based on goal task, public affairs between task are realized
The task that functional public work can be wanted with supply and demand is arbitrarily called, and goal task only needs to generate corresponding goal task engineering
And call, so, simplify the generating process of task, and reduce workload.
For the embodiment, because it is substantially similar to above-mentioned method for scheduling task embodiment, so description ground ratio
It is relatively simple, illustrate referring to the part of above-mentioned task scheduling embodiment.
The embodiment of the present invention provides a kind of electronic equipment, as shown in figure 9, including processor 910, communication interface 920, storage
Device 930 and communication bus 940, wherein, processor 910, communication interface 920, memory 930 pass through communication bus 940 complete phase
Communication between mutually,
Memory 930, for depositing computer program;
Processor 910, during for performing the program deposited on memory 930, realize following steps:
Public work is obtained, wherein, the public work is:For realizing public functional engineering between task;
The goal task engineering for realizing goal task is obtained, wherein, the goal task engineering is:According to the public affairs
The engineering of the function generation for the goal task that engineering does not include altogether;
The goal task is generated according to the public work and the goal task engineering.
By technical scheme provided in an embodiment of the present invention, public functional program code between task is uniformly stored in public affairs
Altogether in engineering, so, do not have to repeat the program code for writing publicly-owned funtion part in task generating process, directly obtain public
Engineering altogether, simplifies the generating process of task, and reduce workload.
Certainly, the embodiment of the present invention, which provides a kind of electronic equipment, can also realize other realities of above-mentioned task creating method
Mode is applied, the part that embodiment is generated referring to above-mentioned task illustrates, will not be described here.
The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component
Interconnect, PCI) bus or EISA (Extended Industry Standard
Architecture, EISA) bus etc..The communication bus can be divided into address bus, data/address bus, controlling bus etc..For just
Only represented in expression, figure with a thick line, it is not intended that an only bus or a type of bus.
The communication that communication interface is used between above-mentioned electronic equipment and other equipment.
Memory can include random access memory (Random Access Memory, RAM), can also include non-easy
The property lost memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory may be used also
To be at least one storage device for being located remotely from aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
CPU), network processing unit (Network Processor, NP) etc.;It can also be digital signal processor (Digital Signal
Processing, DSP), it is application specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other PLDs, discrete
Door or transistor logic, discrete hardware components.
The present invention also provides a kind of computer-readable recording medium, and the computer-readable recording medium internal memory contains calculating
Machine program, the computer program realize any task creating method in above-described embodiment when being executed by processor.
The embodiment of the present invention also provides a kind of electronic equipment, including processor, communication interface, memory and communication bus,
Wherein, processor, communication interface, memory complete mutual communication by communication bus,
Memory, for depositing computer program;
Processor, during for performing the program deposited on memory, realize following steps:
Obtain the dispatch command for regulation goal task;
According to the call instruction, it is determined that the goal task engineering for realizing the goal task;
By calling the goal task engineering, public work is called to carry out parameter configuration to the goal task, wherein,
The public work is:For realizing public functional engineering between task;
Parameter configuration is carried out to the goal task by the goal task engineering;
Run scheduling of goal task engineering and the public work realization to the goal task.
In scheme provided in an embodiment of the present invention, goal task is carried out respectively by public work and goal task engineering
Parameter configuration, and then realize the scheduling to goal task.Under conditions of having been generated based on goal task, public affairs between task are realized
The task that functional public work can be wanted with supply and demand is arbitrarily called, and goal task only needs to generate corresponding goal task engineering
And call, so, simplify the generating process of task, and reduce workload.
Certainly, a kind of electronic equipment provided in an embodiment of the present invention can also realize other of above-mentioned method for scheduling task
Embodiment, illustrate referring to the part of above-mentioned task scheduling embodiment, will not be described here.
The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component
Interconnect, PCI) bus or EISA (Extended Industry Standard
Architecture, EISA) bus etc..The communication bus can be divided into address bus, data/address bus, controlling bus etc..For just
Only represented in expression, figure with a thick line, it is not intended that an only bus or a type of bus.
The communication that communication interface is used between above-mentioned electronic equipment and other equipment.
Memory can include random access memory (Random Access Memory, RAM), can also include non-easy
The property lost memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory may be used also
To be at least one storage device for being located remotely from aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
CPU), network processing unit (Network Processor, NP) etc.;It can also be digital signal processor (Digital Signal
Processing, DSP), it is application specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other PLDs, discrete
Door or transistor logic, discrete hardware components.
The present invention also provides a kind of computer-readable recording medium, and the computer-readable recording medium internal memory contains calculating
Machine program, the computer program realize any method for scheduling task in above-described embodiment when being executed by processor.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation make a distinction with another entity or operation, and not necessarily require or imply and deposited between these entities or operation
In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Nonexcludability includes, so that process, method, article or equipment including a series of elements not only will including those
Element, but also the other element including being not expressly set out, or it is this process, method, article or equipment also to include
Intrinsic key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that
Other identical element also be present in process, method, article or equipment including the key element.
Each embodiment in this specification is described by the way of related, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.It is real especially for device
For applying example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent substitution and improvements made within the spirit and principles in the present invention etc., are all contained in protection scope of the present invention
It is interior.
Claims (10)
1. a kind of task creating method, it is characterised in that methods described includes:
Public work is obtained, wherein, the public work is:For realizing public functional engineering between task;
The goal task engineering for realizing goal task is obtained, wherein, the goal task engineering is:According to the public work
The engineering of the function generation for the goal task that journey does not include;
The goal task is generated according to the public work and the goal task engineering.
2. according to the method for claim 1, it is characterised in that the public work includes common parameter configuration file;
After the step of acquisition public work, in addition to:
The parameter of the common parameter configuration file is configured according to the mission requirements of the goal task.
3. according to the method for claim 2, it is characterised in that the goal task engineering includes special parameter configuration text
Part;
After the step of goal task engineering obtained for realizing goal task described, in addition to:
The parameter of the special parameter configuration file is configured according to the mission requirements of the goal task.
4. according to the method for claim 3, it is characterised in that methods described also includes:
Obtain the task of having moved that local device is moved to from source device;
Local path is revised as in the source device path of the common parameter configuration file of the task of having moved, had moved described
It is revised as local path in the source device path of the special parameter configuration file of task.
5. a kind of method for scheduling task, it is characterised in that methods described includes:
Obtain the dispatch command for regulation goal task;
According to the call instruction, it is determined that the goal task engineering for realizing the goal task;
By calling the goal task engineering, public work is called to carry out parameter configuration to the goal task, wherein, it is described
Public work is:For realizing public functional engineering between task;
Parameter configuration is carried out to the goal task by the goal task engineering;
Run scheduling of goal task engineering and the public work realization to the goal task.
6. according to the method for claim 5, it is characterised in that it is described by calling the goal task engineering, call public
The step of engineering carries out parameter configuration to the goal task altogether, including:
By calling the goal task engineering, public work is called, to cause the public work to configure in such a way
The common parameter of the goal task:
The public work reads common parameter configuration file under preset path;
According to the parameter information recorded in the common parameter configuration file, the common parameter of the goal task is configured.
7. according to the method any one of claim 5-6, it is characterised in that described to pass through the goal task engineering pair
The goal task is carried out the step of parameter configuration, including:
At least one of following parameter of the goal task is configured by the goal task engineering:
Task number of retries, retrying for task are spaced duration, the startup time point of task, the executive mode of task, the target
The task names of task, the tasks carrying type of the goal task, the task trigger condition of the goal task.
8. according to the method for claim 7, it is characterised in that described to run goal task engineering and the public work reality
The step of now scheduling to the goal task, including:
The goal task engineering is run, whether meets that the task of the goal task is touched by the goal task engineering detecting
Clockwork spring part;
If satisfied, performing the function that the goal task engineering includes, and exist in the goal task engineering and be directed to the public affairs
Altogether during the calling demand of engineering, the public work is called by the goal task engineering, realized to the goal task
Scheduling.
9. a kind of task generating device, it is characterised in that described device includes:
First acquisition module, for obtaining public work, wherein, the public work is:For realizing publicly-owned function between task
Engineering;
Second acquisition module, for obtaining the goal task engineering for being used for realizing goal task, wherein, the goal task engineering
For:The engineering of the function generation for the goal task not included according to the public work;
Generation module, for generating the goal task according to the public work and the goal task engineering.
10. a kind of task scheduling apparatus, it is characterised in that described device includes:
4th acquisition module, for obtaining the dispatch command for regulation goal task;
Determining module, for according to the call instruction, it is determined that the goal task engineering for realizing the goal task;
Calling module, for by calling the goal task engineering, calling public work to carry out parameter to the goal task
Configuration, wherein, the public work is:For realizing public functional engineering between task;
3rd configuration module, for carrying out parameter configuration to the goal task by the goal task engineering;
Module is run, for running scheduling of goal task engineering and the public work realization to the goal task.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710765905.1A CN107577527B (en) | 2017-08-30 | 2017-08-30 | Task generation and scheduling method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710765905.1A CN107577527B (en) | 2017-08-30 | 2017-08-30 | Task generation and scheduling method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107577527A true CN107577527A (en) | 2018-01-12 |
CN107577527B CN107577527B (en) | 2020-10-30 |
Family
ID=61030583
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710765905.1A Active CN107577527B (en) | 2017-08-30 | 2017-08-30 | Task generation and scheduling method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107577527B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108399132A (en) * | 2018-03-21 | 2018-08-14 | 腾讯科技(深圳)有限公司 | A kind of scheduling tests method, apparatus and storage medium |
CN109558687A (en) * | 2018-12-06 | 2019-04-02 | 广东浪潮大数据研究有限公司 | A kind of data processing method, system and associated component |
CN110428453A (en) * | 2019-07-30 | 2019-11-08 | 深圳云天励飞技术有限公司 | Data processing method, device, data processing equipment and storage medium |
CN112965794B (en) * | 2021-02-19 | 2024-03-22 | 西安智周深鉴信息科技集团有限公司 | Algorithm calling method, electronic equipment and storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070083411A1 (en) * | 2005-03-25 | 2007-04-12 | Yosef Alberton | Schedule coordinates method for project scheduling |
CN101335763A (en) * | 2007-06-28 | 2008-12-31 | 中兴通讯股份有限公司 | Data educing and transmitting method in intelligent network system |
US8321257B2 (en) * | 2008-05-16 | 2012-11-27 | Ricoh Company, Ltd. | Managing project schedule data using separate current and historical task schedule data |
US8983902B2 (en) * | 2010-12-10 | 2015-03-17 | Sap Se | Transparent caching of configuration data |
CN104484204A (en) * | 2014-12-12 | 2015-04-01 | 北京国双科技有限公司 | Method and device for task running |
CN105867993A (en) * | 2016-03-29 | 2016-08-17 | 乐视控股(北京)有限公司 | Software product compiling method and device |
US9525643B2 (en) * | 2010-09-17 | 2016-12-20 | Microsoft Technology Licensing, Llc | Using templates to configure cloud resources |
CN106843992A (en) * | 2016-12-22 | 2017-06-13 | 武汉斗鱼网络科技有限公司 | Data managing method and device |
-
2017
- 2017-08-30 CN CN201710765905.1A patent/CN107577527B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070083411A1 (en) * | 2005-03-25 | 2007-04-12 | Yosef Alberton | Schedule coordinates method for project scheduling |
CN101335763A (en) * | 2007-06-28 | 2008-12-31 | 中兴通讯股份有限公司 | Data educing and transmitting method in intelligent network system |
US8321257B2 (en) * | 2008-05-16 | 2012-11-27 | Ricoh Company, Ltd. | Managing project schedule data using separate current and historical task schedule data |
US9525643B2 (en) * | 2010-09-17 | 2016-12-20 | Microsoft Technology Licensing, Llc | Using templates to configure cloud resources |
US8983902B2 (en) * | 2010-12-10 | 2015-03-17 | Sap Se | Transparent caching of configuration data |
CN104484204A (en) * | 2014-12-12 | 2015-04-01 | 北京国双科技有限公司 | Method and device for task running |
CN105867993A (en) * | 2016-03-29 | 2016-08-17 | 乐视控股(北京)有限公司 | Software product compiling method and device |
CN106843992A (en) * | 2016-12-22 | 2017-06-13 | 武汉斗鱼网络科技有限公司 | Data managing method and device |
Non-Patent Citations (4)
Title |
---|
STACK OVERFLOW: "Oozie common property_configration for multiple workflows", 《HTTPS://STACKOVERFLOW.COM/QUESTIONS/32657895/OOZIE-COMMON-PROPERTY-CONFIGRATION-FOR-MULTIPLE-WORKFLOWS》 * |
TUTORIALS POINT: "apache oozie quick guide", 《HTTPS://WWW.TUTORIALSPOINT.COM/APACHE_OOZIE/APACHE_OOZIE_QUICK_GUIDE.HTM》 * |
TUTORIALS POINT: "apache oozie tutorial", 《HTTPS://WWW.TUTORIALSPOINT.COM/APACHE_OOZIE/APACHE_OOZIE_TUTORIAL.PDF》 * |
风生水起: "Oozie简介", 《HTTPS://WWW.CNBLOGS.COM/END/ARCHIVE/2013/01/31/2887230.HTML》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108399132A (en) * | 2018-03-21 | 2018-08-14 | 腾讯科技(深圳)有限公司 | A kind of scheduling tests method, apparatus and storage medium |
CN108399132B (en) * | 2018-03-21 | 2021-01-08 | 腾讯科技(深圳)有限公司 | Scheduling test method, device and storage medium |
CN109558687A (en) * | 2018-12-06 | 2019-04-02 | 广东浪潮大数据研究有限公司 | A kind of data processing method, system and associated component |
CN110428453A (en) * | 2019-07-30 | 2019-11-08 | 深圳云天励飞技术有限公司 | Data processing method, device, data processing equipment and storage medium |
CN112965794B (en) * | 2021-02-19 | 2024-03-22 | 西安智周深鉴信息科技集团有限公司 | Algorithm calling method, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN107577527B (en) | 2020-10-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190392617A1 (en) | Visual workflow model | |
JP2005293578A (en) | Test case inheritance controlled via attribute | |
US9092278B2 (en) | Determining the processing order of a plurality of events | |
CN108345511A (en) | A kind of application data verification method, device and electronic equipment | |
CN107577527A (en) | Task generation and scheduling method and device | |
US11900173B2 (en) | Container runtime optimization | |
US20150046906A1 (en) | Test planning with order coverage requirements | |
US20120297390A1 (en) | Creation of flexible workflows using artifacts | |
Zamboni | Learning CFEngine 3: Automated system administration for sites of any size | |
EP3413149B1 (en) | Field device commissioning system and field device commissioning method | |
CN112242920A (en) | Cloud platform deployment method, device and node | |
US10452371B2 (en) | Automating enablement state inputs to workflows in z/OSMF | |
US20110066566A1 (en) | Conceptual representation of business processes for cross-domain mapping | |
US20170300403A1 (en) | Recordation of user interface events for script generation | |
CN109614271A (en) | Control method, device, equipment and the storage medium of multiple company-data consistency | |
CN108279923A (en) | Program tenant management method and system can be read and deposit medium | |
US9916155B2 (en) | Projects browser for development environments | |
CN111435306A (en) | Code management method and device | |
CN109960503A (en) | Components Development method and device based on Django frame | |
US11562105B2 (en) | System and method for module engineering with sequence libraries | |
US20140365989A1 (en) | Information product builder, production and delivery system | |
JP2020155102A (en) | Method and system for creating engineering data for industrial control system | |
US11245744B1 (en) | Asynchronous distributed modular function calling | |
CN109684191A (en) | Using packet construction method, device, equipment and readable storage medium storing program for executing | |
Van der Bank | A modular framework for the effective development of web-based applications |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |