CN112445600A - Method and system for issuing offline data processing task - Google Patents
Method and system for issuing offline data processing task Download PDFInfo
- Publication number
- CN112445600A CN112445600A CN202011473566.8A CN202011473566A CN112445600A CN 112445600 A CN112445600 A CN 112445600A CN 202011473566 A CN202011473566 A CN 202011473566A CN 112445600 A CN112445600 A CN 112445600A
- Authority
- CN
- China
- Prior art keywords
- data processing
- offline data
- processing task
- task
- offline
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 155
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000004590 computer program Methods 0.000 claims description 8
- 239000008280 blood Substances 0.000 claims description 4
- 210000004369 blood Anatomy 0.000 claims description 4
- 238000007689 inspection Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 7
- 230000000875 corresponding effect Effects 0.000 description 5
- 230000001419 dependent effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an offline data processing task issuing method, which comprises the steps of acquiring the latest code of each offline data processing task from a code review center Gerrit according to the updating operation of the offline data processing task of a user, editing the latest code, configuring each offline data processing task, setting the state of each configured offline data processing task as a state to be issued, sending the offline data processing task in the state to be issued to a task scheduling center by using a scheduling engine for issuing, supporting the dependency relationship among script offline data processing, the dependency relationship among script offline data processing and the cross-workflow dependency relationship, and improving the efficiency and the applicability according to the strong execution scene of the dependency relationship. In addition, the invention also discloses an off-line data processing task issuing system.
Description
Technical Field
The invention relates to the technical field of computers, in particular to an offline data processing task issuing method and system.
Background
In recent years, the vehicle rental business is promoted by the mobile internet, users grow rapidly, and orders increase rapidly. Under the background, a large amount of data is accumulated in main service scenes of time-sharing lease, daily lease, whole lease and the like of each automobile sharing platform, and meanwhile, a leading data system in the lease industry is preliminarily constructed, but various problems in the aspects of task management, data management and the like exist, and particularly a series of problems in the aspects of offline data processing task management and release exist.
Currently, the main scheme of offline multi-bin task management is as follows:
the method comprises the steps that an IDE integrated development environment is used for developing off-line data processing tasks (hereinafter referred to as tasks for short), the tasks are mainly divided into SQL-type tasks or script-type tasks so as to clean and logically process data, task codes are submitted to a code review center Gerrit, a task scheduling center pulls the latest tasks from the code review center Gerrit within a fixed time (generally 0:30 minutes in the morning), the task scheduling center calculates task dependency relations and submits the latest tasks to a data calculation cluster according to task scheduling time, and the tasks are operated in batches.
The current solution has the following problems:
(1) the current task scheduling center can only pull the latest task at a fixed time point, the current temporary data processing scene cannot be supported, the task is not released in time, and the process is not flexible;
(2) the current task scheduling center uses an open source scheduling system, which is not friendly to developers and has high cost, and task management operations such as task scheduling setting, task offline, execution, number compensation and the like are completely dependent on developers, so that the developers cannot operate by themselves, and the efficiency is low;
(3) only supporting the dependency relationship among sql type tasks, not supporting the dependency relationship among script type tasks and the dependency relationship among cross-workflow tasks, cannot support complex task dependency relationships, and is low in efficiency because cross-workflow tasks need to be checked one by one. Meanwhile, when problems occur, strong execution of cross-workflow is not supported, the workflow is clicked one by one to re-run the tasks, and the efficiency is low.
Disclosure of Invention
Aiming at the defects in the prior art, the embodiment of the invention provides an offline data processing task issuing method and system.
In a first aspect, a method for issuing an offline data processing task according to an embodiment of the present invention includes the following steps:
according to the updating operation of the offline data processing tasks of the user, acquiring the latest code of each offline data processing task from a code review center Gerrit;
editing the latest codes, configuring each offline data processing task and setting the state of each configured offline data processing task as a state to be issued;
and sending the offline data processing task in the state to be issued to a task scheduling center for issuing by using a scheduling engine.
Preferably, the issuing, by using the scheduling engine, the offline data processing task in the to-be-issued state to the task scheduling center includes:
analyzing SQL sentences corresponding to the offline data processing tasks in the state to be issued;
determining a source data table and a target data table associated with the offline data processing task according to the SQL statement;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the source data table and the target data table.
Preferably, the issuing, by using the scheduling engine, the offline data processing task in the to-be-issued state to the task scheduling center includes:
determining a source data table and a target data table associated with the offline data processing task of the script type according to the source data table parameter and the target data table parameter in the execution parameters;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the source data table and the target data table.
Preferably, determining the offline data processing task having a dependency relationship with the offline data processing task according to the source data table and the target data table includes:
determining the type of the offline data processing task and the blood relationship between the offline data processing task and other offline data processing tasks according to the source data table and the target data table;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the types of the offline data processing tasks and the bloody border relationship between the offline data processing tasks and other offline data processing tasks.
Preferably, editing the latest code, and configuring each offline data processing task includes:
and setting an identification for the offline data processing task needing to be enforced.
In a first aspect, an offline data processing task issuing system provided in an embodiment of the present invention includes the following modules:
the acquisition module is used for acquiring the latest code of each offline data processing task from the code inspection tool Gerrit according to the updating operation of the offline data processing task of the user;
the configuration module is used for editing the latest codes, configuring each offline data processing task and setting the state of each configured offline data processing task as a state to be issued;
and the release module is used for releasing the offline data processing task in the state to be released to the task scheduling center by using the scheduling engine.
The method and the system for issuing the offline data processing task have the following beneficial effects that:
(1) an offline data processing task can be acquired from a code inspection tool Gerrit at any time;
(2) the method supports developers to independently release the offline data processing task at any time and independently perform other management operations of the task;
(3) supporting the dependency relationship between script off-line data processing;
(4) for a single task, supporting cross-workflow dependency relationships and supporting strong execution scenarios according to the dependency relationships.
Detailed Description
The present invention will be described in detail with reference to the following embodiments.
The method for issuing the offline data processing task provided by the embodiment of the invention comprises the following steps:
s101, according to the updating operation of the offline data processing tasks of the user, obtaining the latest codes of all the offline data processing tasks from a code review center Gerrit.
The plurality of offline data processing tasks form a workflow, and the workflow is formed by different tasks for establishing a dependency relationship. Each offline data processing task generates an operation record called as an offline data processing task instance after being executed, and records detailed information of the current offline data processing task operation, wherein the detailed information comprises operation starting time, end time, operation state, operation log, operation consumed resources and the like.
As a specific embodiment, after the developer develops the offline data processing task and submits the offline data processing task to the code review center Gerrit, the developer clicks an update task list button under the pivot offline data processing task management module, and the action triggers the code review center Gerrit to automatically pull the latest code data to the pivot system and display the latest code data to the developer.
S102, editing the latest codes, configuring each offline data processing task and setting the configured state of each offline data processing task as a to-be-issued state.
And S103, sending the offline data processing task in the state to be issued to a task scheduling center for issuing by using a scheduling engine.
Management operations such as offline, scheduling time setting, complement and the like of the offline data processing tasks are performed by clicking corresponding buttons in the system by data developers, and the task management service is cooperated with the scheduling engine to perform corresponding action processing, so that complete self-service of offline data processing task management is realized.
Optionally, the issuing, by using the scheduling engine, the offline data processing task in the to-be-issued state to the task scheduling center includes:
analyzing SQL sentences corresponding to the offline data processing tasks in the state to be issued;
determining a source data table and a target data table associated with the offline data processing task according to the SQL statement;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the source data table and the target data table.
The dependency relationship comprises a strong dependency relationship and a weak dependency relationship, and one offline data processing task can establish different dependency relationships with a plurality of offline data processing tasks. If the offline data processing task A strongly depends on the offline data processing task B, the offline data processing task A is executed after the offline data processing task B is executed once and is normally finished; if offline data processing task a is weakly dependent on offline data processing task B, then offline data processing task a may be run as long as the running status of offline data processing task B is confirmed to be successful (offline data processing task B may have been executed once by being strongly dependent by other tasks).
Optionally, the issuing, by using the scheduling engine, the offline data processing task in the to-be-issued state to the task scheduling center includes:
determining a source data table and a target data table associated with the offline data processing task of the script type according to the source data table parameter and the target data table parameter in the execution parameters;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the source data table and the target data table.
Optionally, determining, according to the source data table and the target data table, an offline data processing task having a dependency relationship with the offline data processing task includes:
determining the type of the offline data processing task and the blood relationship between the offline data processing task and other offline data processing tasks according to the source data table and the target data table;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the types of the offline data processing tasks and the blood relationship between the offline data processing tasks and other offline data processing tasks.
Optionally, editing the latest code, and configuring each offline data processing task includes:
and setting an identification for the offline data processing task needing to be enforced.
As a specific embodiment, when a developer needs to enforce an offline data processing task across workflows, by configuring an identifier for the offline data processing task, whether all tasks need to be enforced, if the identifier is True, whether the offline data processing task is successfully executed or not, according to the dependency relationship of the offline data processing task, the offline data processing task and the offline data processing task having a dependency relationship with the offline data processing task are executed again, and if the identifier is False, only the offline data processing task that has failed to be executed last time is executed again.
According to the offline data processing task issuing method provided by the embodiment of the invention, according to the updating operation of the offline data processing task of a user, the latest code of each offline data processing task is acquired from a code review center Gerrit, the latest code is edited, each offline data processing task is configured, the state of each configured offline data processing task is set to be an issued state, the offline data processing task in the issued state is sent to a task scheduling center by using a scheduling engine to be issued, the dependency relationship among script offline data processing and the cross-workflow dependency relationship are supported, and the efficiency and the applicability are improved according to the strong execution scene of the dependency relationship.
In a second aspect, the system for issuing an offline data processing task provided in the embodiment of the present invention includes the following modules:
the acquisition module is used for acquiring the latest code of each offline data processing task from the code inspection tool Gerrit according to the updating operation of the offline data processing task of the user;
the configuration module is used for editing the latest codes, configuring each offline data processing task and setting the state of each configured offline data processing task as a state to be issued;
and the release module is used for releasing the offline data processing task in the state to be released to the task scheduling center by using the scheduling engine.
It will be appreciated that the relevant features of the method and apparatus described above are referred to one another. In addition, "first", "second", and the like in the above embodiments are for distinguishing the embodiments, and do not represent merits of the embodiments.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In addition, the memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
It should be noted that the above-mentioned embodiments do not limit the present invention in any way, and all technical solutions obtained by using equivalent alternatives or equivalent variations fall within the protection scope of the present invention.
Claims (8)
1. An offline data processing task issuing method is characterized by comprising the following steps:
according to the updating operation of the offline data processing tasks of the user, acquiring the latest code of each offline data processing task from a code review center Gerrit;
editing the latest codes, configuring each offline data processing task and setting the state of each configured offline data processing task as a state to be issued;
and sending the offline data processing task in the state to be issued to a task scheduling center for issuing by using a scheduling engine.
2. The method of claim 1, wherein the step of issuing the to-be-issued offline data processing task to the task scheduling center by using the scheduling engine comprises:
analyzing SQL sentences corresponding to the offline data processing tasks in the state to be issued;
determining a source data table and a target data table associated with the offline data processing task according to the SQL statement;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the source data table and the target data table.
3. The method of claim 1, wherein the step of issuing the to-be-issued offline data processing task to the task scheduling center by using the scheduling engine comprises:
determining a source data table and a target data table associated with the offline data processing task of the script type according to the source data table parameter and the target data table parameter in the execution parameters;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the source data table and the target data table.
4. The method of claim 2 or 3, wherein determining the offline data processing task that has a dependency relationship with the offline data processing task according to the source data table and the target data table comprises:
determining the type of the offline data processing task and the blood relationship between the offline data processing task and other offline data processing tasks according to the source data table and the target data table;
and determining the offline data processing tasks with the dependency relationship with the offline data processing tasks according to the types of the offline data processing tasks and the bloody border relationship between the offline data processing tasks and other offline data processing tasks.
5. The method of claim 1, wherein editing the latest code to configure each offline data processing task comprises:
and setting an identification for the offline data processing task needing to be enforced.
6. An offline data processing task publication system, comprising:
the acquisition module is used for acquiring the latest code of each offline data processing task from the code inspection tool Gerrit according to the updating operation of the offline data processing task of the user;
the configuration module is used for editing the latest codes, configuring each offline data processing task and setting the state of each configured offline data processing task as a state to be issued;
and the release module is used for releasing the offline data processing task in the state to be released to the task scheduling center by using the scheduling engine.
7. A computer program product, characterized in that the computer program product comprises a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to perform the method according to any one of claims 1-5.
8. A non-transitory computer-readable storage medium storing computer instructions that cause a computer to perform the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011473566.8A CN112445600A (en) | 2020-12-15 | 2020-12-15 | Method and system for issuing offline data processing task |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011473566.8A CN112445600A (en) | 2020-12-15 | 2020-12-15 | Method and system for issuing offline data processing task |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112445600A true CN112445600A (en) | 2021-03-05 |
Family
ID=74740026
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011473566.8A Pending CN112445600A (en) | 2020-12-15 | 2020-12-15 | Method and system for issuing offline data processing task |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112445600A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113867844A (en) * | 2021-10-09 | 2021-12-31 | 中邮科通信技术股份有限公司 | Offline data storage and calculation method based on time slice intelligent inspection control |
| CN114064230A (en) * | 2021-10-08 | 2022-02-18 | 南京苏宁电子信息技术有限公司 | Method and device for scheduling offline tasks, computer equipment and storage medium |
| CN117076141A (en) * | 2023-10-17 | 2023-11-17 | 深圳迅策科技有限公司 | High-applicability off-line data processing task issuing method and system |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160034267A1 (en) * | 2014-08-01 | 2016-02-04 | Sap Se | Lightweight application deployment |
| CN105589874A (en) * | 2014-10-22 | 2016-05-18 | 阿里巴巴集团控股有限公司 | ETL task dependence relationship detecting method and device and ETL tool |
| CN107608774A (en) * | 2017-09-08 | 2018-01-19 | 新智云数据服务有限公司 | A kind of method for scheduling task, device, equipment and storage medium |
| CN108182111A (en) * | 2018-01-23 | 2018-06-19 | 百度在线网络技术（北京）有限公司 | Task scheduling system, method and apparatus |
| CN108345497A (en) * | 2018-01-17 | 2018-07-31 | 千寻位置网络有限公司 | GNSS positions execution method and system, the positioning device of simulation offline |
| CN108959564A (en) * | 2018-07-04 | 2018-12-07 | 玖富金科控股集团有限责任公司 | Data warehouse metadata management method, readable storage medium storing program for executing and computer equipment |
| CN108984284A (en) * | 2018-06-26 | 2018-12-11 | 杭州比智科技有限公司 | DAG method for scheduling task and device based on off-line calculation platform |
| CN109445929A (en) * | 2018-11-16 | 2019-03-08 | 杭州数澜科技有限公司 | A kind of method and system of scheduler task |
| CN109725906A (en) * | 2018-12-30 | 2019-05-07 | 上海创功通讯技术有限公司 | A kind of code compiling method and corresponding continuous integration system |
| CN110895484A (en) * | 2018-09-12 | 2020-03-20 | 北京奇虎科技有限公司 | Task scheduling method and device |
| CN110941446A (en) * | 2019-11-06 | 2020-03-31 | 苏宁云计算有限公司 | Version release method and device based on multi-environment offline task |
| CN111523851A (en) * | 2020-03-06 | 2020-08-11 | 北京三快在线科技有限公司 | Task management and processing method, merchant information management method, system and equipment |
| CN111666326A (en) * | 2020-05-29 | 2020-09-15 | 中国工商银行股份有限公司 | ETL scheduling method and device |
| CN111752920A (en) * | 2020-06-22 | 2020-10-09 | 杭州数澜科技有限公司 | Method, system, and storage medium for managing metadata |
-
2020
- 2020-12-15 CN CN202011473566.8A patent/CN112445600A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160034267A1 (en) * | 2014-08-01 | 2016-02-04 | Sap Se | Lightweight application deployment |
| CN105589874A (en) * | 2014-10-22 | 2016-05-18 | 阿里巴巴集团控股有限公司 | ETL task dependence relationship detecting method and device and ETL tool |
| CN107608774A (en) * | 2017-09-08 | 2018-01-19 | 新智云数据服务有限公司 | A kind of method for scheduling task, device, equipment and storage medium |
| CN108345497A (en) * | 2018-01-17 | 2018-07-31 | 千寻位置网络有限公司 | GNSS positions execution method and system, the positioning device of simulation offline |
| CN108182111A (en) * | 2018-01-23 | 2018-06-19 | 百度在线网络技术（北京）有限公司 | Task scheduling system, method and apparatus |
| CN108984284A (en) * | 2018-06-26 | 2018-12-11 | 杭州比智科技有限公司 | DAG method for scheduling task and device based on off-line calculation platform |
| CN108959564A (en) * | 2018-07-04 | 2018-12-07 | 玖富金科控股集团有限责任公司 | Data warehouse metadata management method, readable storage medium storing program for executing and computer equipment |
| CN110895484A (en) * | 2018-09-12 | 2020-03-20 | 北京奇虎科技有限公司 | Task scheduling method and device |
| CN109445929A (en) * | 2018-11-16 | 2019-03-08 | 杭州数澜科技有限公司 | A kind of method and system of scheduler task |
| CN109725906A (en) * | 2018-12-30 | 2019-05-07 | 上海创功通讯技术有限公司 | A kind of code compiling method and corresponding continuous integration system |
| CN110941446A (en) * | 2019-11-06 | 2020-03-31 | 苏宁云计算有限公司 | Version release method and device based on multi-environment offline task |
| CN111523851A (en) * | 2020-03-06 | 2020-08-11 | 北京三快在线科技有限公司 | Task management and processing method, merchant information management method, system and equipment |
| CN111666326A (en) * | 2020-05-29 | 2020-09-15 | 中国工商银行股份有限公司 | ETL scheduling method and device |
| CN111752920A (en) * | 2020-06-22 | 2020-10-09 | 杭州数澜科技有限公司 | Method, system, and storage medium for managing metadata |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114064230A (en) * | 2021-10-08 | 2022-02-18 | 南京苏宁电子信息技术有限公司 | Method and device for scheduling offline tasks, computer equipment and storage medium |
| CN113867844A (en) * | 2021-10-09 | 2021-12-31 | 中邮科通信技术股份有限公司 | Offline data storage and calculation method based on time slice intelligent inspection control |
| CN117076141A (en) * | 2023-10-17 | 2023-11-17 | 深圳迅策科技有限公司 | High-applicability off-line data processing task issuing method and system |
| CN117076141B (en) * | 2023-10-17 | 2024-01-26 | 深圳迅策科技有限公司 | High-applicability off-line data processing task issuing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112445600A (en) | Method and system for issuing offline data processing task | |
| US7844570B2 (en) | Database generation systems and methods | |
| CN111190924A (en) | Cross-domain data query method and device | |
| US9542226B2 (en) | Operating programs on a computer cluster | |
| US11704114B2 (en) | Data structures for managing configuration versions of cloud-based applications | |
| US11966732B2 (en) | Data structures for managing configuration versions of cloud-based applications | |
| CN110244951B (en) | Application publishing method and device | |
| CN116302064A (en) | Integrated code analysis method, integrated code analysis device, electronic equipment and storage medium | |
| CN109977317B (en) | Data query method and device | |
| CN117785212A (en) | Import dependent package and third party library clipping optimization method, device, medium and equipment | |
| CN115328524A (en) | Patch merging method and device, computer equipment and storage medium | |
| CN110837446A (en) | Equipment management method and device applied to embedded system, medium and embedded equipment | |
| CN112667259A (en) | SDN controller version upgrading method, device and medium | |
| CN110928941A (en) | Data fragment extraction method and device | |
| CN116701356A (en) | Data migration method, device, terminal equipment and storage medium | |
| CN108897873B (en) | Method and device for generating job file, storage medium and processor | |
| CN112580915A (en) | Project milestone determination method and device, storage medium and electronic equipment | |
| CN111475167B (en) | Shell script dependency relation extraction method based on HQL statement | |
| CN112596783A (en) | Code automatic merging method and device, computer equipment and storage medium | |
| CN109299125B (en) | Database updating method and device | |
| CN112860542A (en) | UI automation test method | |
| CN106055322A (en) | Flow scheduling method and device | |
| CN111538491A (en) | Data event processing method, device, equipment and storage medium | |
| CN115951893B (en) | Method, system, equipment and storage medium for acquiring semiconductor processing script | |
| CN116016158B (en) | Hybrid cloud aPaaS platform deployment method, device, equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |