CN108804241A - Cross-platform method for scheduling task, system, computer equipment and storage medium - Google Patents
Cross-platform method for scheduling task, system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN108804241A CN108804241A CN201810487527.XA CN201810487527A CN108804241A CN 108804241 A CN108804241 A CN 108804241A CN 201810487527 A CN201810487527 A CN 201810487527A CN 108804241 A CN108804241 A CN 108804241A
- Authority
- CN
- China
- Prior art keywords
- oracle
- odi
- essbase
- parameter
- ssh
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Abstract
The present invention relates to cross-platform method for scheduling task, system, computer equipment and storage medium, the method includes：The parameter information of collocation task scheduling, and stored into dispatching platform database；SSH in dispatching platform server is converted into the SSH in ORACLE ODI or ESSBASE servers using it after deployment execution template, to execute task scheduling；The mission bit stream of schedulable condition is served in crawl and the parameter information is spliced into executable scheduler task, and execute scheduler task using the SSH in ORACLE ODI or ESSBASE servers, carry out cross-platform task scheduling, so that the entire various types of tasks of project can form complete rely on and flow and data processing stream, the exploitation manpower relied in scheduling and cross-platform tool is greatly saved, greatly facilitates batch operation and Mission Monitor of the operation maintenance personnel to entire data flow.
Description
Technical field
The present invention relates to task scheduling technique fields, are set more particularly to cross-platform method for scheduling task, system, computer
Standby and storage medium.
Background technology
ORACLE ODI (Oracle Data Integrator) are the tools of the data integration class of Oracle, are to use E-
Data pick-up/data conversion tools that the theory of LT designs.ESSBASE is the multi-dimensional database of BI softwares hyperion,
Different from the relational database on ordinary meaning, ESSBASE divides data according to " block ", and each data can define difference
Dimension.Existing only a kind of dispatching method and device based on HIVE tasks, are related to the tune to ORACLE ODI and ESSBASE
Degree method, though this method is the dispatching method of ORACLE ODI, this kind of method still remains many drawbacks, specifically such as
Under：
1, existing tool in the industry is only the dispatching method that ORACLE ODI or ESSBASE is implemented separately, unspecial work
Tool is enough to realize the dispatching method cross-platform, across tool of ORACLE ODI and ESSBASE tasks；
2, existing to realize that the dispatching method of ORACLE ODI or ESSBASE cannot achieve and existing big data SQOOP tasks
It is relied on HIVE tasks；
3, it is existing realize the dispatching method of ORACLE ODI or ESSBASE can not also be formed it is intuitive, be easy to dispose and manage
Partial data processing stream.
Therefore, it is based on the above situation, is badly in need of cross-platform method for scheduling task, system, computer equipment and storage medium, with
It solves the above problems.
Invention content
Based on this, it is necessary to for when carrying out cross-platform task scheduling, cannot achieve ORACLE ODI or ESSBASE
Task scheduling, can not also be formed it is intuitive, be easy to a series of problems, such as partial data processing stream disposed and managed, provide cross-platform
Method for scheduling task, system, computer equipment and storage medium.
A kind of cross-platform method for scheduling task, the cross-platform method for scheduling task, is as follows：
S1：It configures ORACLE ODI or ESSBASE and carries out the parameter information of task scheduling, and the parameter information is stored
Into dispatching platform database；
S2：It disposes after ORACLE ODI or ESSBASE execute template and utilizes the ORACLE ODI or ESSBASE execution moulds
SSH in dispatching platform server is converted into the SSH in ORACLE ODI or ESSBASE servers by plate, to execute ORACLE
Task scheduling in ODI or ESSBASE servers；
S3：Mission bit stream and the parameter information splicing of ORACLE ODI or ESSBASE schedulable conditions are served in crawl
At executable ORACLE ODI or ESSBASE scheduler tasks, and utilize the SSH in ORACLE ODI or ESSBASE servers
ORACLE ODI or ESSBASE scheduler tasks are executed, cross-platform task scheduling is carried out.
In one embodiment, the step S1 includes：
S101：Oracle database, and the ginseng of setting ORACLE ODI or ESSBASE wherein are set on dispatching platform
Number template table and parameter routing table, the parameter routing table are the historical records that basis is stored in the oracle database,
The table generated in such a way that parameter corresponds to a record, the parameter routing table include each parameter how many
The acquisition approach of information under a parameter item and each parameter item；
S102：The parameter name that selected ORACLE ODI or ESSBASE tasks are needed when being scheduled, and according to described
Parameter routing table is configured, the corresponding parameter item of the title that gets parms；
S103：According to the parameter routing table, the parameter information under the parameter item is configured.
In one embodiment, the step S2 includes：
S201：Database table is set in dispatching platform database, SSH account informations are stored in the database table,
Dispatching platform server reads SSH account informations from the database table, and SSH is helped to log on in dispatching platform server；
S202：Python programs are installed in dispatching platform, and carry out writing ORACLE ODI using the python programs
Or ESSBASE execution modules, SSH log on to ORACLE ODI after dispatching platform server using SSH Secure Shell or
The program of ESSBASE execution modules is uploaded in dispatching platform server, completes ORACLE ODI or ESSBASE execution modules
Deployment；
S203：The SSH logged on in dispatching platform server is converted using ORACLE ODI or ESSBASE execution module
At the SSH in ORACLE ODI or ESSBASE servers.
In one embodiment, the step S3 includes：
S301：The deployment of ORACLE ODI or the ESSBASE task schedulings of preset format type is filled on dispatching platform
Document；
S302：The deployment document is directed on web interface by dispatching platform, and will be in the deployment document of importing
In information storage to dispatching platform repository；
S303：Dispatching platform server is matched by the continuous polling dispatching platform of ORACLE ODI or ESSBASE execution modules
Library is set, the mission bit stream of ORACLE ODI or ESSBASE schedulable conditions is served in crawl, and is obtained from dispatching platform database
Meet the parameter information of ORACLE ODI or ESSBASE schedulable conditions, ORACLE ODI or ESSBASE execution module can will be described
Mission bit stream and parameter information are spliced into executable ORACLE ODI or ESSBASE scheduler tasks, using ORACLE ODI or
SSH in ESSBASE servers executes ORACLE ODI or ESSBASE scheduler tasks.
Based on the same technical idea, the present invention also provides a kind of cross-platform task scheduling system, the cross-platform scheduling
System includes dispensing unit, deployment unit and execution unit；
The dispensing unit, carries out the parameter information of task scheduling for configuring ORACLE ODI or ESSBASE, and by institute
Parameter information is stated to store into dispatching platform database；
The deployment unit utilizes the ORACLE ODI for disposing after ORACLE ODI or ESSBASE execute template
Or ESSBASE executes template and the SSH in dispatching platform server is converted into ORACLE ODI or ESSBASE servers
SSH, to execute the task scheduling in ORACLE ODI or ESSBASE servers；
The execution unit, for capturing the mission bit stream and the institute that serve ORACLE ODI or ESSBASE schedulable conditions
It states parameter information and is spliced into executable ORACLE ODI or ESSBASE scheduler tasks, and utilize ORACLE ODI or ESSBASE
SSH in server executes ORACLE ODI or ESSBASE scheduler tasks, carries out cross-platform task scheduling.
In one embodiment, the dispensing unit include setup module, the module that gets parms and configuration parameter information
Module；
The setup module, for oracle database, and setting ORACLE ODI wherein to be arranged on dispatching platform
Or the parameterized template table and parameter routing table of ESSBASE, the parameter routing table are that basis is stored in the oracle database
In historical record, the table generated in such a way that parameter corresponds to a record, the parameter routing table includes
The acquisition approach of information under each how many parameter item of parameter and each parameter item；
The module that gets parms is needed when being scheduled for selecting ORACLE ODI or ESSBASE tasks
Parameter name, and configured according to the parameter routing table, the corresponding parameter item of the title that gets parms；
The configuration parameter information module, for according to the parameter routing table, configuring the letter of the parameter under the parameter item
Breath.
In one embodiment, the deployment unit includes login module, deployment execution module module and conversion module；
The login module is stored with for database table to be arranged in dispatching platform database in the database table
SSH account informations, dispatching platform server read SSH account informations from the database table, help SSH to log on to scheduling flat
In platform server；
The deployment execution module, for dispatching platform install python programs, and using the python programs into
Row writes ORACLE ODI or ESSBASE execution modules, and SSH utilizes SSH Secure after logging on to dispatching platform server
The program of ORACLE ODI or ESSBASE execution modules is uploaded in dispatching platform server by Shell, completes ORACLE ODI
Or the deployment of ESSBASE execution modules；
The conversion module, for dispatching platform service will to be logged on to using ORACLE ODI or ESSBASE execution module
SSH in device is converted into the SSH in ORACLE ODI or ESSBASE servers.
In one embodiment, the execution unit includes filling in module, import preserving module and executing scheduler task mould
Block；
Described to fill in module, ORACLE ODI or ESSBASE for filling in preset format type on dispatching platform appoint
The deployment document of business scheduling；
The deployment document is directed into web interface for passing through dispatching platform, and will led by the importing preserving module
In information storage to dispatching platform repository in the deployment document entered；
The execution scheduler task module executes mould for dispatching platform server by ORACLE ODI or ESSBASE
The mission bit streams of ORACLE ODI or ESSBASE schedulable conditions is served in block continuous polling dispatching platform configuration library, crawl, and from
Obtained in dispatching platform database and meet the parameter informations of ORACLE ODI or ESSBASE schedulable conditions, ORACLE ODI or
The mission bit stream and parameter information can be spliced into executable ORACLE ODI or ESSBASE tune by ESSBASE execution modules
Degree task executes ORACLE ODI or ESSBASE scheduler tasks using the SSH in ORACLE ODI or ESSBASE servers.
Based on the same technical idea, described the present invention also provides a kind of computer equipment, including memory and processor
Computer-readable instruction is stored in memory, when the computer-readable instruction is executed by the processor so that the place
Manage the step of device executes above-mentioned cross-platform method for scheduling task.
Based on the same technical idea, the present invention also provides a kind of storage medium being stored with computer-readable instruction, institutes
When stating computer-readable instruction and being executed by one or more processors so that one or more processors are executed as above-mentioned cross-platform
The step of method for scheduling task.
Above-mentioned cross-platform method for scheduling task, system, computer equipment and storage medium, by dispatching platform database
Middle arrange parameter template table and parameter routing table, according to the parameterized template table and parameter routing table, configure ORACLE ODI or
ESSBASE carries out the parameter information of task scheduling, and the parameter information is stored into dispatching platform database；It is flat in scheduling
Database table is set in platform database, reads SSH account informations using dispatching platform server, side SSH logs on to dispatching platform
In server, python programs are installed on dispatching platform, carry out writing ORACLE ODI or ESSBASE execution moulds using it
Block, then dispose after ORACLE ODI or ESSBASE execute template and be converted into the SSH in dispatching platform server using it
SSH in ORACLE ODI or ESSBASE servers, to execute the task scheduling in ORACLE ODI or ESSBASE servers；
Dispatching platform server passes through ORACLE ODI or ESSBASE execution modules continuous polling dispatching platform configuration library, crawl service
In the mission bit stream of ORACLE ODI or ESSBASE schedulable conditions, and is obtained from dispatching platform database and meet ORACLE
The parameter information of ODI or ESSBASE schedulable conditions, ORACLE ODI or ESSBASE execution module can by the mission bit stream and
Parameter information is spliced into executable ORACLE ODI or ESSBASE scheduler tasks, is serviced using ORACLE ODI or ESSBASE
SSH in device executes ORACLE ODI or ESSBASE scheduler tasks so that the entire various types of tasks of project can have been formed
The exploitation manpower relied in scheduling and cross-platform tool is greatly saved, greatly side in whole dependence stream and data processing stream
Just batch operation and Mission Monitor of the operation maintenance personnel to entire data flow.
Description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit are common for this field
Technical staff will become clear.Attached drawing only for the purpose of illustrating preferred embodiments, and is not considered as to the present invention
Limitation.
Fig. 1 is a kind of flow chart of cross-platform method for scheduling task in one embodiment of the invention；
Fig. 2 is the flow chart that parameter information is configured in one embodiment of the invention；
Fig. 3 is the flow chart that execution module is disposed in one embodiment of the invention；
Fig. 4 is the flow chart that scheduler task is executed in one embodiment of the invention；
Fig. 5 is a kind of schematic diagram of cross-platform task scheduling system in one embodiment of the invention；
Fig. 6 is the schematic diagram that parameter information is configured in one embodiment of the invention；
Fig. 7 is the schematic diagram that execution module is disposed in one embodiment of the invention；
Fig. 8 is the schematic diagram that scheduler task is executed in one embodiment of the invention.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.It is to be further understood that is used in the specification of the present invention arranges
It refers to there are the feature, integer, step, operation, element and/or component, but it is not excluded that presence or addition to take leave " comprising "
Other one or more features, integer, step, operation, element, component and/or their group.
As shown in Figure 1, the present invention provides a kind of cross-platform method for scheduling task, the cross-platform method for scheduling task can
To include the following steps：
Step S1：Configure the parameter information that ORACLE ODI or ESSBASE carries out task scheduling, and by the parameter information
It stores into dispatching platform database；
Step S2：Deployment ORACLE ODI or ESSBASE are held after executing template using the ORACLE ODI or ESSBASE
SSH in dispatching platform server is converted into the SSH in ORACLE ODI or ESSBASE servers by row template, to execute
Task scheduling in ORACLE ODI or ESSBASE servers；
Step S3：The mission bit stream of ORACLE ODI or ESSBASE schedulable conditions and the parameter information are served in crawl
Executable ORACLE ODI or ESSBASE scheduler tasks are spliced into, and using in ORACLE ODI or ESSBASE servers
SSH executes ORACLE ODI or ESSBASE scheduler tasks, carries out cross-platform task scheduling.
Dispatching platform in the present embodiment can select ZooKeeper.ZooKeeper is an open, open-source
The distributed application program coordination service of code, is mono- realization increased income of Chubby of Google, is the weight of Hadoop and Hbase
Want component.ZooKeeper is the software that Consistency service is provided for Distributed Application, and the function that can be provided includes configuration
Maintenance, domain name service, distributed synchronization, group service etc., can realize the error-prone key service of packaged complexity, will be simple
The system of easy-to-use interface and performance efficiency, function-stable is supplied to user.
Dispatching platform database is set on ZooKeeper dispatching platforms, preserves the configuration of ORACLE ODI or ESSBASE
Information, disposes ORACLE ODI or ESSBASE execution module and will convert SSH, and ORACLE ODI are dispatched using SSH to realize
Or ESSBASE tasks provide stable running environment.
Dispatching platform database can select oracle database in the present embodiment.Oracle database be at present in the world
The relational database relational system to maintain the leading position, system portability is good, easy to use, function is strong, is suitable for all kinds of
Large, medium and small, microcomputer environment.
ORACLE ODI or the ESSBASE parameter informations that configuration is completed are stored into oracle database, can be ensured
The stability of ORACLE ODI or ESSBASE parameter informations, and can adapt to the preservation of the parameter information of different reserves.It is utilizing
When ORACLE ODI or ESSBASE execution modules are captured, required ORACLE ODI or ESSBASE ginsengs can be quickly positioned
Number information.
Dispatching platform server in the present embodiment can select Linux server.Linux server is a kind of use
The network server of linux system is used for business processing application, such as network and system management, data base administration and Web service
Deng being a kind of server for having high-performance and increasing income property.Linux server has splendid system stability, safety, by
In using multi-user operating system, therefore the flexibility having had and scalability, no matter processor or machine architecture can be very
The receiving in resource is carried out well.Software in Linux server be it is free, thus Linux server in application and development more
It can be cost-effective.Most of customer service can carry out more free exploitation with linux system to business.
The mode of above-mentioned realization ORACLE ODI or ESSBASE scheduler tasks so that the various types of tasks of entire project
Complete dependence stream and data processing stream can be formed, the exploit person in scheduling and the dependence of cross-platform tool is greatly saved
Power greatly facilitates batch operation and Mission Monitor of the operation maintenance personnel to entire data flow.
Fig. 2 is the flow chart that parameter information is configured in one embodiment of the invention, as shown in Fig. 2, in step sl, passing through
Parameterized template table and parameter configuration ORACLE ODI or ESSBASE carry out the parameter information of task scheduling, the present embodiment
In, step S1 may include S101-S103：
Step S101：Oracle database, and setting ORACLE ODI or ESSBASE wherein are set on dispatching platform
Parameterized template table and parameter routing table, the parameter routing table be according to be stored in the oracle database history note
Record, the table generated in such a way that a parameter corresponds to a record；As shown in table 1 below, when generating parameterized template table
According to task titles in the oracle database are stored in, the historical record of the parameters such as date, time type is joined using one
Number corresponds to the mode that one records and the parameterized template table generated；
Table 1
The parameter routing table include under its how many parameter item of each parameter and each parameter item information obtain
Take path, the parameter routing table as shown in table 2 below；
Table 2
Step S102：The number of parameters and parameter that selected ORACLE ODI or ESSBASE tasks are needed when being scheduled
Title, and configured according to the parameter routing table, the corresponding parameter item of the title that gets parms；For example, the parameter name
For " date ", then in the parameterized template table shown in above-mentioned table 1, " date " parameter item " inc_time " will be positioned as；
Step S103：According to the parameter routing table, the parameter information under the parameter item is configured；For example, parameter item is
" inc_time ", the parameter routing table shown according to above-mentioned table 2, you can according to " inc_time ", you can know " inc_
Time " includes two project categories, respectively " inc_start " and " inc_end ".
Above by configuration ORACLE ODI or ESSBASE parameter informations, for be spliced into executable ORACLE ODI or
ESSBASE scheduler tasks provide preparatory condition.
Fig. 3 is the flow chart that execution module is disposed in one embodiment of the invention, as shown in figure 3, in step s 2, reading
SSH is logged on to dispatching platform server by SSH account informations, its progress is utilized after python programs are installed on dispatching platform
ORACLE ODI or ESSBASE execution modules are write, and dispose ORACLE ODI or ESSBASE execution modules, recycle institute
It states ORACLE ODI or ESSBASE execution module and the SSH in dispatching platform is converted into ORACLE ODI or ESSBASE servers
In SSH.In this implementation, step S2 may include S201-S203；
Step S201：Database table is set in dispatching platform database, SSH accounts letter is stored in the database table
Breath, dispatching platform server read SSH account informations from the database table, and SSH is helped to log on to dispatching platform server
In；
In one embodiment, the SSH account informations include ORACLE ODI or ESSBASE server ips information, use
Family information and encrypted message, wherein the database table is as shown in table 3 below：
| Server_name | Varchar2(100) | Server name |
| Server_ip | Varchar2(100) | Server ip |
| Server_user | Varchar2(100) | User |
| Server_pwd | Varchar2(64) | Password |
Table 3
Dispatching platform server is read out according to the information shown in above-mentioned table 3, according to " Server_name " reading pair
It is flat to read scheduling according to " Server_ip ", " Server_user " and " Server_pwd " for the dispatching platform server name answered
The IP information of platform server, account information and encrypted message.
Step S202：Python programs are installed in dispatching platform, and carry out writing ORACLE using the python programs
ODI or ESSBASE execution modules, SSH utilize SSH Secure Shell by ORACLE after logging on to dispatching platform server
The program of ODI or ESSBASE execution modules is uploaded in dispatching platform server, is completed ORACLE ODI or ESSBASE and is executed
The deployment of module；
Python programs in the present embodiment are pure free softwares, and source code and interpreter CPython follow CPL associations
View, the grammer simple and clear used.Python has abundant and powerful library, the various modules that can make other language
(especially C/C++) is easily bound up very much.Python programs are installed on dispatching platform, the program can be utilized quick
Easily write ORACLE ODI or ESSBASE execution modules.
Step S203：The SSH in dispatching platform server will be logged on to using ORACLE ODI or ESSBASE execution module
The SSH being converted into ORACLE ODI or ESSBASE servers.
ORACLE ODI or ESSBASE execution module in the present embodiment is realized by the base class of succession dispatching platform
The work(such as the execution of ORACLE ODI or ESSBASE tasks, abnormal return, log recording, error log extraction, record log item number
Can, while can realize the SSH SSH in dispatching platform server being converted into ORACLE ODI or ESSBASE servers,
Realize the docking of ORACLE ODI and ESSBASE scheduler tasks.
It is converted into ORACLE ODI or ESSBASE servers above by by the SSH in dispatching platform server
SSH carries out ORACLE ODI or ESSBASE task schedulings for next step and provides execution unit.
Fig. 4 is the flow chart that scheduler task is executed in one embodiment of the invention, as shown in figure 4, in step s3, passing through
Executable ORACLE ODI or ESSBASE scheduler tasks are spliced into, using in ORACLE ODI or ESSBASE servers
SSH executes the scheduler task of ORACLE ODI or ESSBASE.In the present embodiment, step S3 includes S301-S303；
Step S301：ORACLE ODI or the ESSBASE task schedulings of preset format type are filled on dispatching platform
Dispose document.
Step S302：The deployment document is directed on web interface by dispatching platform, and by the deployment document of importing
In information storage to dispatching platform repository in.
Deployment document in the present embodiment is the deployment document by filling in EXCEL types, record ORACLE ODI or
The information such as the corresponding server name of ESSBASE tasks, Program path, scheduling time, scheduling frequency.Deployment document is being filled in
At later, you can import on web interface, imported in the form of a web page.
Step S303：Dispatching platform server is flat by the continuous polling dispatching of ORACLE ODI or ESSBASE execution modules
The mission bit stream of ORACLE ODI or ESSBASE schedulable conditions is served in platform repository, crawl, and from dispatching platform database
The parameter information for meeting ORACLE ODI or ESSBASE schedulable conditions is obtained, ORACLE ODI or ESSBASE execution module can incite somebody to action
The mission bit stream and parameter information are spliced into executable ORACLE ODI or ESSBASE scheduler tasks, utilize ORACLE
SSH in ODI or ESSBASE servers executes ORACLE ODI or ESSBASE scheduler tasks.
SSH in above-mentioned calling ORACLE ODI or ESSBASE servers executes ORACLE ODI or ESSBASE scheduling and appoints
The cross-platform task scheduling of pragmatic existing ORACLE ODI and ESSBASE tasks.
Based on the same technical idea, the embodiment of the present invention additionally provides a kind of cross-platform task scheduling system, such as Fig. 5 institutes
Show, the cross-platform task scheduling system includes dispensing unit, deployment unit and execution unit；
The dispensing unit, carries out the parameter information of task scheduling for configuring ORACLE ODI or ESSBASE, and by institute
Parameter information is stated to store into dispatching platform database；
The deployment unit is taken dispatching platform using it after ORACLE ODI or ESSBASE execution templates for disposing
SSH in business device is converted into the SSH in ORACLE ODI or ESSBASE servers, to execute ORACLE ODI or ESSBASE clothes
The task scheduling being engaged in device；
The execution unit, for capturing the mission bit stream and the institute that serve ORACLE ODI or ESSBASE schedulable conditions
It states parameter information and is spliced into executable ORACLE ODI or ESSBASE scheduler tasks, and utilize ORACLE ODI or ESSBASE
SSH in server executes ORACLE ODI or ESSBASE scheduler tasks, carries out cross-platform task scheduling.
Fig. 6 is the schematic diagram that parameter information is configured in one embodiment of the invention, as shown in fig. 6, the dispensing unit packet
Include setup module, the module that gets parms and configuration parameter information module；
The setup module, for oracle database, and setting ORACLE ODI wherein to be arranged on dispatching platform
Or the parameterized template table and parameter routing table of ESSBASE, the parameter routing table are that basis is stored in the oracle database
In historical record, the table generated in such a way that parameter corresponds to a record, the parameter routing table includes
The acquisition approach of information under each its how many parameter item of parameter and each parameter item；
The module that gets parms is needed when being scheduled for selecting ORACLE ODI or ESSBASE tasks
Number of parameters and parameter name, and configured according to the parameter routing table, the corresponding parameter item of the title that gets parms；
The configuration parameter information module, for according to the parameter routing table, configuring the letter of the parameter under the parameter item
Breath.
Fig. 7 is the schematic diagram that execution module is disposed in one embodiment of the invention, as shown in fig. 7, the deployment unit packet
Include login module, deployment execution module and conversion module；
The login module is stored with for database table to be arranged in dispatching platform database in the database table
SSH account informations, dispatching platform server read SSH account informations from the database table, help SSH to log on to scheduling flat
In platform server；
The deployment execution module, for dispatching platform install python programs, and using the python programs into
Row writes ORACLE ODI or ESSBASE execution modules, and SSH utilizes SSH Secure after logging on to dispatching platform server
The program of ORACLE ODI or ESSBASE execution modules is uploaded in dispatching platform server by Shell, completes ORACLE ODI
Or the deployment of ESSBASE execution modules；
The conversion module, for dispatching platform service will to be logged on to using ORACLE ODI or ESSBASE execution module
SSH in device is converted into the SSH in ORACLE ODI or ESSBASE servers.
Fig. 8 is the schematic diagram that scheduler task is executed in one embodiment of the invention, as shown in figure 8, the execution unit packet
It includes and fills in module, import preserving module and execute scheduler task module；
Described to fill in module, ORACLE ODI or ESSBASE for filling in preset format type on dispatching platform appoint
The deployment document of business scheduling；
The deployment document is directed into web interface for passing through dispatching platform, and will led by the importing preserving module
In information storage to dispatching platform repository in the deployment document entered；
The execution scheduler task module executes mould for dispatching platform server by ORACLE ODI or ESSBASE
The mission bit streams of ORACLE ODI or ESSBASE schedulable conditions is served in block continuous polling dispatching platform configuration library, crawl, and from
Obtained in dispatching platform database and meet the parameter informations of ORACLE ODI or ESSBASE schedulable conditions, ORACLE ODI or
The mission bit stream and parameter information can be spliced into executable ORACLE ODI or ESSBASE tune by ESSBASE execution modules
Degree task executes ORACLE ODI or ESSBASE scheduler tasks using the SSH in ORACLE ODI or ESSBASE servers.
Based on the same technical idea, the present invention proposes a kind of computer equipment, and the computer equipment includes storage
Device, processor and it is stored in the computer-readable instruction that can be run on the memory and on the processor, the processing
Device realizes following steps when executing the computer-readable instruction：By in dispatching platform database arrange parameter template table and
Parameter routing table, according to the parameterized template table and parameter routing table, configuration ORACLE ODI or ESSBASE carry out task scheduling
Parameter information, and the parameter information is stored into dispatching platform database；Data are set in dispatching platform database
Library table reads SSH account informations using dispatching platform server, and side SSH is logged on in dispatching platform server, in dispatching platform
Upper installation python programs carry out writing ORACLE ODI or ESSBASE execution modules using it, then dispose ORACLE ODI or
SSH in dispatching platform server is converted into ORACLE ODI or ESSBASE servers using it after ESSBASE execution templates
In SSH, to execute the task scheduling in ORACLE ODI or ESSBASE servers；Dispatching platform server passes through ORACLE
ORACLE ODI or ESSBASE scheduling is served in ODI or ESSBASE execution modules continuous polling dispatching platform configuration library, crawl
The mission bit stream of condition, and the parameter for meeting ORACLE ODI or ESSBASE schedulable conditions is obtained from dispatching platform database
The mission bit stream and parameter information can be spliced into executable by information, ORACLE ODI or ESSBASE execution module
ORACLE ODI or ESSBASE scheduler tasks execute ORACLE using the SSH in ORACLE ODI or ESSBASE servers
ODI or ESSBASE scheduler tasks.
The present invention also provides a kind of storage medium being stored with computer-readable instruction, institutes based on the same technical idea
When stating computer-readable instruction and being executed by one or more processors so that one or more processors execute following steps：It is logical
Arrange parameter template table and parameter routing table in dispatching platform database are crossed, is route according to the parameterized template table and parameter
Table, configuration ORACLE ODI or ESSBASE carry out the parameter information of task scheduling, and the parameter information is stored to scheduling and is put down
In platform database；Database table is set in dispatching platform database, SSH account informations are read using dispatching platform server,
Side SSH is logged on in dispatching platform server, and python programs are installed on dispatching platform, carry out writing ORACLE using it
ODI or ESSBASE execution modules, then dispose after ORACLE ODI or ESSBASE execute template and serviced dispatching platform using it
SSH in device is converted into the SSH in ORACLE ODI or ESSBASE servers, to execute ORACLE ODI or ESSBASE services
Task scheduling in device；Dispatching platform server passes through the continuous polling dispatching platform of ORACLE ODI or ESSBASE execution modules
The mission bit stream of ORACLE ODI or ESSBASE schedulable conditions is served in repository, crawl, and is obtained from dispatching platform database
Take the parameter information for meeting ORACLE ODI or ESSBASE schedulable conditions, ORACLE ODI or ESSBASE execution module can be by institute
It states mission bit stream and parameter information is spliced into executable ORACLE ODI or ESSBASE scheduler tasks, utilize ORACLE ODI
Or the SSH in ESSBASE servers executes ORACLE ODI or ESSBASE scheduler tasks.
One of ordinary skill in the art will appreciate that realizing all or part of flow in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, which can be stored in a computer-readable storage and be situated between
In matter, the program is when being executed, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, storage medium above-mentioned can be
The non-volatile memory mediums such as magnetic disc, CD, read-only memory (Read-Only Memory, ROM) or random storage note
Recall body (Random Access Memory, RAM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, to keep description succinct, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, it is all considered to be the range of this specification record.
Several embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
Cannot the limitation to the scope of the claims of the present invention therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect range.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (10)
1. a kind of cross-platform method for scheduling task, which is characterized in that the dispatching method includes：
S1：It configures ORACLE ODI or ESSBASE and carries out the parameter information of task scheduling, and the parameter information is stored to tune
It spends in platform database；
S2：Disposing will using the ORACLE ODI or ESSBASE execution templates after ORACLE ODI or ESSBASE execute template
SSH in dispatching platform server is converted into the SSH in ORACLE ODI or ESSBASE servers, to execute ORACLE ODI
Or the task scheduling in ESSBASE servers；
S3：Crawl serve ORACLE ODI or ESSBASE schedulable conditions mission bit stream and the parameter information be spliced into can
ORACLE ODI or the ESSBASE scheduler tasks of execution, and executed using the SSH in ORACLE ODI or ESSBASE servers
ORACLE ODI or ESSBASE scheduler tasks, carry out cross-platform task scheduling.
2. a kind of cross-platform method for scheduling task according to claim 1, which is characterized in that the step S1 includes：
S101：Oracle database, and the parameter mould of setting ORACLE ODI or ESSBASE wherein are set on dispatching platform
Plate table and parameter routing table, the parameter routing table are used according to the historical record being stored in the oracle database
One parameter corresponds to the mode that one records and the table generated, and the parameter routing table includes how many ginseng of each parameter
The acquisition approach of information under several and each parameter item；
S102：The parameter name that selected ORACLE ODI or ESSBASE tasks are needed when being scheduled, and according to the parameter
Routing table is configured, the corresponding parameter item of the title that gets parms；
S103：According to the parameter routing table, the parameter information under the parameter item is configured.
3. a kind of cross-platform method for scheduling task according to claim 1, which is characterized in that the step S2 includes：
S201：Database table is set in dispatching platform database, SSH account informations are stored in the database table, is dispatched
Platform Server reads SSH account informations from the database table, and SSH is helped to log on in dispatching platform server；
S202：Python programs are installed in dispatching platform, and using the python programs write ORACLE ODI or
ESSBASE execution modules, SSH log on to ORACLE ODI after dispatching platform server using SSH Secure Shell or
The program of ESSBASE execution modules is uploaded in dispatching platform server, completes ORACLE ODI or ESSBASE execution modules
Deployment；
S203：The SSH logged on in dispatching platform server is converted into using ORACLE ODI or ESSBASE execution module
SSH in ORACLE ODI or ESSBASE servers.
4. a kind of cross-platform method for scheduling task according to claim 1, which is characterized in that the step S3 includes：
S301：The deployment document of ORACLE ODI or the ESSBASE task schedulings of preset format type is filled on dispatching platform；
S302：The deployment document is directed on web interface by dispatching platform, and by importing deployment document in information
It stores into dispatching platform repository；
S303：Dispatching platform server by ORACLE ODI or ESSBASE execution modules continuous polling dispatching platform configuration library,
The mission bit stream of ORACLE ODI or ESSBASE schedulable conditions is served in crawl, and is obtained and met from dispatching platform database
The parameter information of ORACLE ODI or ESSBASE schedulable conditions, ORACLE ODI or ESSBASE execution module can be by the tasks
Information and parameter information are spliced into executable ORACLE ODI or ESSBASE scheduler tasks, using ORACLE ODI or
SSH in ESSBASE servers executes ORACLE ODI or ESSBASE scheduler tasks.
5. a kind of cross-platform task scheduling system, which is characterized in that the scheduling system includes dispensing unit, deployment unit and holds
Row unit；
The dispensing unit, carries out the parameter information of task scheduling for configuring ORACLE ODI or ESSBASE, and by the ginseng
In number information storage to dispatching platform database；
The deployment unit, for dispose ORACLE ODI or ESSBASE execute after template using the ORACLE ODI or
ESSBASE executes template and the SSH in dispatching platform server is converted into the SSH in ORACLE ODI or ESSBASE servers,
To execute the task scheduling in ORACLE ODI or ESSBASE servers；
The execution unit, for capturing the mission bit stream for serving ORACLE ODI or ESSBASE schedulable conditions and the ginseng
Number information is spliced into executable ORACLE ODI or ESSBASE scheduler tasks, and is serviced using ORACLE ODI or ESSBASE
SSH in device executes ORACLE ODI or ESSBASE scheduler tasks, carries out cross-platform task scheduling.
6. a kind of cross-platform task scheduling system according to claim 5, which is characterized in that the dispensing unit includes setting
Set module, the module that gets parms and configuration parameter information module；
The setup module, for being arranged oracle database on dispatching platform, and be arranged wherein ORACLE ODI or
The parameterized template table and parameter routing table of ESSBASE, the parameter routing table are that basis is stored in the oracle database
Historical record, the table generated in such a way that parameter corresponds to a record, the parameter routing table includes every
The acquisition approach of information under how many parameter item of a parameter and each parameter item；
The module that gets parms, the parameter needed for selecting ORACLE ODI or ESSBASE tasks when being scheduled
Title, and configured according to the parameter routing table, the corresponding parameter item of the title that gets parms；
The configuration parameter information module, for according to the parameter routing table, configuring the parameter information under the parameter item.
7. a kind of cross-platform task scheduling system according to claim 5, which is characterized in that the deployment unit includes stepping on
Record module, deployment execution module module and conversion module；
The login module is stored with SSH accounts for database table to be arranged in dispatching platform database in the database table
Number information, dispatching platform server read SSH account informations from the database table, and SSH is helped to log on to dispatching platform clothes
It is engaged in device；
The deployment execution module for installing python programs in dispatching platform, and is compiled using the python programs
ORACLE ODI or ESSBASE execution modules are write, SSH will using SSH Secure Shell after logging on to dispatching platform server
The program of ORACLE ODI or ESSBASE execution modules is uploaded in dispatching platform server, complete ORACLE ODI or
The deployment of ESSBASE execution modules；
The conversion module, for that will be logged on in dispatching platform server using ORACLE ODI or ESSBASE execution module
SSH be converted into the SSH in ORACLE ODI or ESSBASE servers.
8. a kind of cross-platform task scheduling system according to claim 5, which is characterized in that the execution unit includes filling out
Writing module imports preserving module and executes scheduler task module；
It is described to fill in module, ORACLE ODI or ESSBASE the task tune for filling in preset format type on dispatching platform
The deployment document of degree；
The deployment document is directed into web interface by the importing preserving module for passing through dispatching platform, and by importing
It disposes in the information storage to dispatching platform repository in document；
The execution scheduler task module, for dispatching platform server by ORACLE ODI or ESSBASE execution module not
The mission bit stream of ORACLE ODI or ESSBASE schedulable conditions is served in disconnected polling dispatching platform configuration library, crawl, and from scheduling
The parameter information for meeting ORACLE ODI or ESSBASE schedulable conditions, ORACLE ODI or ESSBASE are obtained in platform database
The mission bit stream and parameter information can be spliced into executable ORACLE ODI or ESSBASE scheduler tasks by execution module,
ORACLE ODI or ESSBASE scheduler tasks are executed using the SSH in ORACLE ODI or ESSBASE servers.
9. a kind of computer equipment, including memory and processor, it is stored with computer-readable instruction in the memory, it is described
When computer-readable instruction is executed by the processor so that the processor executes such as any one of claims 1 to 4 right
It is required that the step of described cross-platform method for scheduling task.
10. a kind of storage medium being stored with computer-readable instruction, the computer-readable instruction is handled by one or more
When device executes so that one or more processors execute cross-platform as described in any one of Claims 1-4 claim
The step of method for scheduling task.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810487527.XA CN108804241B (en) | 2018-05-21 | 2018-05-21 | Cross-platform task scheduling method, system, computer equipment and storage medium |
| PCT/CN2018/104702 WO2019223178A1 (en) | 2018-05-21 | 2018-09-08 | Cross-platform task scheduling method and system, computer device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810487527.XA CN108804241B (en) | 2018-05-21 | 2018-05-21 | Cross-platform task scheduling method, system, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108804241A true CN108804241A (en) | 2018-11-13 |
| CN108804241B CN108804241B (en) | 2023-06-02 |
Family
ID=64091215
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810487527.XA Active CN108804241B (en) | 2018-05-21 | 2018-05-21 | Cross-platform task scheduling method, system, computer equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108804241B (en) |
| WO (1) | WO2019223178A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110428453A (en) * | 2019-07-30 | 2019-11-08 | 深圳云天励飞技术有限公司 | Data processing method, device, data processing equipment and storage medium |
| CN111651429A (en) * | 2020-05-26 | 2020-09-11 | 中国平安财产保险股份有限公司 | Big data scheduling parameter management method and device and distributed platform |
| CN113553569A (en) * | 2021-07-06 | 2021-10-26 | 猪八戒股份有限公司 | Single sign-on method, system and terminal of Syngnathus system based on proxy server |
| CN114780216A (en) * | 2022-04-18 | 2022-07-22 | 湖南长银五八消费金融股份有限公司 | Task scheduling method and device, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120221623A1 (en) * | 2011-02-28 | 2012-08-30 | Verizon Patent And Licensing Inc. | Method and system for integrating data from multiple sources |
| CN102918530A (en) * | 2010-05-27 | 2013-02-06 | 甲骨文国际公司 | Data mart automation |
| CN105119757A (en) * | 2015-09-14 | 2015-12-02 | 沈文策 | Method and system for operation and maintenance automation of enterprise servers |
| CN106302778A (en) * | 2016-08-25 | 2017-01-04 | 广东亿迅科技有限公司 | A kind of distributed flow process automotive engine system |
| CN107870807A (en) * | 2016-09-26 | 2018-04-03 | 平安科技（深圳）有限公司 | A kind of cross-platform method for scheduling task and device |
| CN107908465A (en) * | 2017-10-19 | 2018-04-13 | 深圳索信达数据技术股份有限公司 | The method for scheduling task of big data platform |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108037973B (en) * | 2017-12-20 | 2021-11-16 | 苏州优圣美智能系统有限公司 | Data flow modeling and processing system interacting with data processing tool |
-
2018
- 2018-05-21 CN CN201810487527.XA patent/CN108804241B/en active Active
- 2018-09-08 WO PCT/CN2018/104702 patent/WO2019223178A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102918530A (en) * | 2010-05-27 | 2013-02-06 | 甲骨文国际公司 | Data mart automation |
| US20120221623A1 (en) * | 2011-02-28 | 2012-08-30 | Verizon Patent And Licensing Inc. | Method and system for integrating data from multiple sources |
| CN105119757A (en) * | 2015-09-14 | 2015-12-02 | 沈文策 | Method and system for operation and maintenance automation of enterprise servers |
| CN106302778A (en) * | 2016-08-25 | 2017-01-04 | 广东亿迅科技有限公司 | A kind of distributed flow process automotive engine system |
| CN107870807A (en) * | 2016-09-26 | 2018-04-03 | 平安科技（深圳）有限公司 | A kind of cross-platform method for scheduling task and device |
| CN107908465A (en) * | 2017-10-19 | 2018-04-13 | 深圳索信达数据技术股份有限公司 | The method for scheduling task of big data platform |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110428453A (en) * | 2019-07-30 | 2019-11-08 | 深圳云天励飞技术有限公司 | Data processing method, device, data processing equipment and storage medium |
| CN110428453B (en) * | 2019-07-30 | 2020-12-15 | 深圳云天励飞技术有限公司 | Data processing method, data processing device, data processing equipment and storage medium |
| CN111651429A (en) * | 2020-05-26 | 2020-09-11 | 中国平安财产保险股份有限公司 | Big data scheduling parameter management method and device and distributed platform |
| CN111651429B (en) * | 2020-05-26 | 2023-10-24 | 中国平安财产保险股份有限公司 | Big data scheduling parameter management method, device and distributed platform |
| CN113553569A (en) * | 2021-07-06 | 2021-10-26 | 猪八戒股份有限公司 | Single sign-on method, system and terminal of Syngnathus system based on proxy server |
| CN114780216A (en) * | 2022-04-18 | 2022-07-22 | 湖南长银五八消费金融股份有限公司 | Task scheduling method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019223178A1 (en) | 2019-11-28 |
| CN108804241B (en) | 2023-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105608203B (en) | A kind of Internet of Things log processing method and device based on Hadoop platform | |
| CN107958057B (en) | Code generation method and device for data migration in heterogeneous database | |
| US10353913B2 (en) | Automating extract, transform, and load job testing | |
| CN108804241A (en) | Cross-platform method for scheduling task, system, computer equipment and storage medium | |
| CN102999537B (en) | System and method for data migration | |
| CN105843182B (en) | A kind of power scheduling accident prediction system and method based on OMS | |
| CA3050220A1 (en) | Systems and methods for data storage and processing | |
| CN1945530B (en) | Arranging system and method for module having dependence | |
| CN112835560A (en) | WEB multi-terminal low-code intelligent software development platform | |
| US20110264754A1 (en) | Browser based application development framework | |
| US20140137073A1 (en) | End to end modular information technology system | |
| CN105574082A (en) | Storm based stream processing method and system | |
| US8914809B1 (en) | Message broker system and method | |
| Sivaraman et al. | High performance and fault tolerant distributed file system for big data storage and processing using hadoop | |
| CN109871309A (en) | A kind of charge system test cases generation method and system | |
| Mateus-Coelho et al. | Serverless service architectures and security minimals | |
| CN109255587B (en) | Collaborative processing method and device for working data | |
| CN113805853A (en) | Software product development system based on industrial internet | |
| CN109710667A (en) | A kind of shared realization method and system of the multisource data fusion based on big data platform | |
| US11748495B2 (en) | Systems and methods for data usage monitoring in multi-tenancy enabled HADOOP clusters | |
| US10951540B1 (en) | Capture and execution of provider network tasks | |
| CN116010475A (en) | Industrial big data platform system with intelligent supervision | |
| CN111048164A (en) | Medical big data long-term storage system | |
| US9569516B2 (en) | Method and device for executing an enterprise process | |
| CN107832352A (en) | Daily record automatic processing method, device, storage medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |