CN112882807A - Breakpoint re-running batch processing system and method - Google Patents
Breakpoint re-running batch processing system and method Download PDFInfo
- Publication number
- CN112882807A CN112882807A CN202110151985.8A CN202110151985A CN112882807A CN 112882807 A CN112882807 A CN 112882807A CN 202110151985 A CN202110151985 A CN 202110151985A CN 112882807 A CN112882807 A CN 112882807A
- Authority
- CN
- China
- Prior art keywords
- batch processing
- module
- early warning
- batch
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 111
- 230000002159 abnormal effect Effects 0.000 claims abstract description 78
- 238000012544 monitoring process Methods 0.000 claims abstract description 40
- 238000003672 processing method Methods 0.000 claims abstract description 6
- 238000004891 communication Methods 0.000 claims abstract description 5
- 230000003993 interaction Effects 0.000 claims abstract description 5
- 238000013515 script Methods 0.000 claims description 9
- 230000005856 abnormality Effects 0.000 claims description 5
- 238000010923 batch production Methods 0.000 description 10
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a breakpoint re-running batch processing system and a breakpoint re-running batch processing method, wherein the system comprises: the system comprises a scheduling execution container, a batch processing module, a routing module, a monitoring module, an early warning module and an abnormal field recording module; the scheduling execution container organizes and coordinates communication, interaction and scheduling among the batch processing module, the routing module, the monitoring module, the early warning module and the abnormal field recording module; the batch processing module is used for executing the processing of the service scene in the batch processing process; the routing module is used for controlling the execution sequence and exception handling of the service scenes in the batch processing process; the monitoring module is used for monitoring the running state of the batch processing process; when the batch processing process is detected to be abnormal, the abnormal field recording module records the current data processing point, judges the early warning level and sends out early warning notice through the early warning module, and after the abnormal processing is finished, the scheduling execution container is started from the current data processing to continue the batch processing process. The invention avoids the rerun and shortens the time for processing the batch processing exception.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a breakpoint re-running batch processing system and method.
Background
The batch processing operation is an indispensable part of an enterprise business system, and the batch processing can be terminated after all tasks are required to be executed after the batch processing is started, or the batch processing process is abnormally interrupted. Therefore, when batch processing is performed in the existing banks and financial companies, corresponding personnel need to be arranged to be on duty, and the abnormity occurring in the batch processing process is processed in time, so that the continuous operation of the batch processing task is ensured.
However, in the prior art, after a batch processing process consumes a lot of time to process data, an exception is generated midway, and after an abnormal batch unit is solved, the same time needs to be consumed to rerun a task, so that the execution time of the batch processing process is prolonged, the user experience is influenced, and even key events such as whether a bank or a financial company can be operated in time are influenced.
Disclosure of Invention
In view of the above, it is desirable to provide a breakpoint re-running batch processing system and method.
A breakpoint re-run batch processing system, comprising: the system comprises a scheduling execution container, a batch processing module, a routing module, a monitoring module, an early warning module and an abnormal field recording module; the scheduling execution container is used for starting inlets of a batch processing process and a batch processing program, is used for initializing a database connection pool and batch processing parameters, is stored in a memory, and organizes and coordinates communication, interaction and scheduling among the batch processing module, the routing module, the monitoring module, the early warning module and the abnormal field recording module; the batch processing module is used for executing the processing of the service scene in the batch processing process; the routing module is used for controlling the execution sequence and exception handling of the service scenes in the batch processing process; the monitoring module is used for monitoring the running state of the batch processing process; the early warning module is used for judging an early warning level according to the abnormity and sending out an early warning notice when the monitoring module detects that the batch processing process is abnormal; the abnormal field recording module is used for recording a current data processing point when the monitoring module detects that the batch processing process is abnormal, and sending the current data processing point to the scheduling execution container after the abnormal processing is finished, wherein the scheduling execution container is started from the current data processing point to continue the batch processing process.
In one embodiment, the batch module is implemented by Java, linux shell script, or database sql script.
In one embodiment, the batch processing module comprises a front batch processing unit, a batch processing middle unit and a rear batch processing unit; the pre-batch processing unit, the batch processing middle unit and the post-batch processing unit are respectively configured with corresponding rules, the rules are stored through an xml file, and the scheduling execution container reads the xml file to realize batch processing configuration; and the routing module controls the preposed batch processing unit, the batch processing middle unit and the postposition batch processing unit to sequentially process the batch processing progress.
In one embodiment, the monitoring module is further configured to receive a notification when the scheduling execution container schedules batch processing, when batch scheduling is completed, or when batch processing is abnormal, monitor and record the batch processing process, collect a CPU and memory usage rate of a current operating environment of the batch processing process, and expose an interface for querying a batch processing state, where the interface is used to query an execution condition of the batch processing process.
In one embodiment, the method further comprises the following steps: and the webpage front end is used for accessing the interface for inquiring the batch processing state, acquiring the execution condition of the batch processing process and judging the reason of the abnormity according to the current running environment CPU and the memory utilization rate of the batch processing process.
In one embodiment, the method further comprises the following steps: and the log module is used for collecting logs during the running of the batch processing process and collecting and generating a batch processing report.
In one embodiment, the early warning module is configured with an early warning level, early warning times, an early warning interval and an early warning mode, wherein the early warning level is provided with a primary level, a middle level and a high level; the early warning times are used for sending early warning notifications again according to the set early warning intervals after detecting that the sent early warning notifications are not closed; the early warning modes comprise short message early warning and mail early warning.
A breakpoint re-running batch processing method comprises the following steps: starting a batch processing process and a batch processing program by scheduling the execution container; processing the service scene in the batch processing process according to a batch processing module, and controlling the execution sequence and exception processing of the service scene processing through a routing module; monitoring the running state of the batch processing process according to a monitoring module; if the running state of the batch processing process is abnormal, recording the current data processing point through an abnormal field recording module, judging the abnormal level through an early warning module, and sending out an early warning notice according to the abnormal level; and after the exception processing is finished, starting the scheduling execution container from the current data processing point, and continuing to perform the batch processing process.
In one embodiment, if there is an exception in the running state of the batch processing process, the method further includes: when the monitoring module detects that an abnormal batch unit exists in the batch processing process, the next batch processing unit is processed according to the control of the routing module, and a primary early warning notice is sent out through an early warning module; when a plurality of abnormal batch units exist in the batch processing process, the abnormal batch units are called again through the scheduling actuator, if the abnormal batch units are restarted, the batch processing process is continuously executed, and a middle-level early warning notice is sent out through the early warning module; if the calling times of the abnormal batch units all exceed the threshold value and the abnormal batch processing units still have starting failure, the batch processing process is terminated, and a high-level early warning notice is sent out through the early warning module.
Compared with the prior art, the invention has the advantages and beneficial effects that: the invention can judge the early warning level according to the abnormity when the batch processing progress is abnormal, send out early warning notice, record the current data processing point, start from the current data processing point after the abnormity processing is finished, and continue the batch processing progress, thereby avoiding the rerun of the batch processing progress and reducing the time spent after the batch processing abnormity.
Drawings
FIG. 1 is a block diagram of a breakpoint re-run batch processing system in one embodiment;
FIG. 2 is a flowchart illustrating a breakpoint re-run batch processing method according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings by way of specific embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, there is provided a breakpoint re-running batch processing system 10, including: the system comprises a scheduling execution container 11, a batch processing module 12, a routing module 13, a monitoring module 14, an early warning module 15 and an abnormal field recording module 16; the scheduling execution container 11 is a starting inlet of a batch processing process and a batch processing program, is used for initializing a database connection pool and batch processing parameters, storing the batch processing parameters in a memory, and organizing and coordinating communication, interaction and scheduling among the batch processing module 12, the routing module 13, the monitoring module 14, the early warning module 15 and the abnormal field recording module 16; the batch processing module 12 is configured to perform processing of a service scenario in a batch processing process; the routing module 13 is used for controlling the execution sequence, exception handling and retry times of the service scenes in the batch processing process; the monitoring module 14 is used for monitoring the running state of the batch processing process; the early warning module 15 is configured to, when the monitoring module 14 detects that the batch processing process is abnormal, determine an early warning level according to the abnormality and send an early warning notification; the abnormal field recording module 16 is configured to record a current data processing point when the monitoring module 14 detects that the batch processing process is abnormal, and send the current data processing point to the scheduling execution container 11 after the abnormal processing is completed, where the scheduling execution container 11 is started from the current data processing point to continue the batch processing process.
In the embodiment, the dispatching execution container 11 organizes and coordinates the communication, interaction and dispatching among the batch processing module 12, the routing module 13, the monitoring module 14, the early warning module 15 and the abnormal field recording module 16; processing the service scene in the batch processing process through the batch processing module 12; the routing module 13 controls the execution sequence, exception handling and retry times of the service scenes in the batch processing process; the monitoring module 14 monitors the running state of the batch process; when the monitoring module 14 detects that the batch processing process is abnormal, the abnormal field recording module 16 records the current data processing point, the early warning module 15 judges the early warning level according to the abnormality and sends out an early warning notice, after the abnormal processing is completed, the scheduling execution container 11 is started from the current data processing point, the batch processing process is continued, the rerun after the abnormal batch processing can be avoided, the time spent on the abnormal batch processing is reduced, the processing speed is increased, the physical examination of a user is improved, and the timely business of an enterprise is ensured.
The batch processing module 12 may be implemented by Java, linux shell script, or database sql script.
Wherein, the batch processing module 12 is provided with a front batch processing unit, a batch processing middle unit and a rear batch processing unit; the preposed batch processing unit, the batch processing middle unit and the postposition batch processing unit are respectively configured with corresponding rules, the rules are stored through xml files, and the scheduling execution container 11 reads the xml files to realize batch processing configuration; the routing module 13 controls the preposed batch processing unit, the batch processing middle unit and the postposition batch processing unit to process the batch processing process in sequence.
Specifically, the batch processing module 12 is responsible for processing a specific service scene, and subdivides the service scene into three time points before batch processing, during batch processing, and after batch processing, and the service scene realized at each time point can be developed according to the actual requirements of developers and realized by Java, linux shell scripts, or database sql scripts.
In particular, the rules are stored via xml files, so that the xml files can be modified directly via the back-end or via an exposed http interface at the front-end web page.
The batch processing module 12 is further configured to generate a file, and specifically includes: detecting whether redundant data exists in a current file or not; if the redundant data exists, deleting the redundant data to obtain a first file; and uploading the first file to an ftp database for storage.
Specifically, for example, when an accounting file needs to be generated in batch processing at night of a certain bank, before the batch processing, redundant data needs to be detected, and the redundant data is deleted through an sql script; in batch processing, generating an accounting file from the data file with the redundant data deleted by java; after batch processing, the accounting files are uploaded to an ftp server through java for storage.
The routing module 13 is configured to control the execution sequence and execution time of the batch unit, and further, when the batch unit is abnormal, may control the number of times that the calling and executing container 11 restarts the abnormal batch unit, and whether to continue executing the next batch unit after the abnormality.
Specifically, if an abnormal batch unit exists in the batch processing process, after the batch processing process is interrupted, the routing module 13 may control to continue executing the next batch unit, or control to stop the batch processing process, and the batch processing process may be restarted through manual intervention before continuing to operate; and when no human intervention exists, the scheduling executor 11 recalls the abnormal batch unit, and if the calling times exceed the configurable running times and the abnormal batch unit is not started, the batch processing process is terminated.
The monitoring module 14 is further configured to receive a notification when the scheduling executor 11 schedules batch processing, when the batch processing is scheduled to be completed, or when the batch processing is abnormal, monitor and record a batch processing process, collect a current operating environment CPU and a memory usage rate of the batch processing process, and expose an interface for querying a batch processing state, so as to query a batch processing execution condition.
Specifically, the monitoring module 14 is configured to record a state of the scheduling process, and the scheduling execution container 11 needs to notify the monitoring module 14 when the scheduling process is performed, the scheduling process is completed, and the scheduling process is abnormal, so as to monitor and record a batch process; and meanwhile, collecting the CPU and the memory utilization rate of the current operating environment, and externally exposing an interface for inquiring the batch processing state for inquiring the execution condition of the batch processing process.
Wherein, still include: and the webpage front end is used for accessing an interface for inquiring the batch processing state, acquiring the execution condition of the batch processing process and judging the reason of the abnormal condition according to the CPU (Central processing Unit) and the memory utilization rate of the current operation environment of the batch processing process.
Specifically, the front end of the webpage can acquire the current batch execution condition by accessing an interface for inquiring the batch state, display the batch execution condition, and display the current running environment CPU and the memory utilization rate of the batch process, so that the reason for the occurrence of the abnormality is judged, and a manager can conveniently perform corresponding processing.
Wherein, still include: and the log module is used for collecting logs during the running of the batch processing process and collecting and generating a batch processing report.
Specifically, the log module can record the running condition of the batch processing process within a period of time, acquire a batch processing report, and send the batch processing report to a manager according to a preset time interval, so that the manager can check the batch processing report conveniently.
The early warning module 15 is configured with early warning levels, early warning times, early warning intervals and early warning modes, wherein the early warning levels comprise a primary level, a middle level and a high level; the early warning times are used for sending the early warning notice again according to the set early warning interval after detecting that the sent early warning notice is not closed; the early warning modes comprise short message early warning and mail early warning.
Specifically, the administrator can make a corresponding coping strategy according to the early warning level, and the early warning notification may include abnormal batch unit information of the batch processing process, the current operating environment CPU and the memory usage rate, and the like
In one embodiment, as shown in fig. 2, there is provided a breakpoint re-running batch processing method, including the steps of:
in step S201, a batch process and a batch program are started by scheduling the execution container.
Step S202, according to the batch processing module, the service scene processing in the batch processing process is carried out, and the execution sequence and the exception handling of the service scene processing are controlled through the routing module.
And step S203, monitoring the running state of the batch processing process according to the monitoring module.
And S204, if the running state of the batch processing process is abnormal, recording the current data processing point through the abnormal field recording module, judging the early warning level through the early warning module, and sending out an early warning notice according to the early warning level.
And step S205, after the exception handling is finished, starting the scheduling execution container from the current data processing point, and continuing the batch processing process.
In this embodiment, a batch process batch processing program is started by scheduling an execution container, service scene processing in a batch process is performed according to a batch processing module, execution sequence and exception handling of the service scene processing are controlled by a routing module, an operation state of the batch process is monitored by a monitoring module, when an exception exists in the operation state of the batch process, a current data processing point is recorded by an exception field recording module, an early warning level is judged according to an early warning module, and an early warning notification is sent according to the early warning level, so that rerun after the exception of the batch process is avoided, time spent on the exception handling of the batch process is reduced, processing speed is increased, physical examination of a user is improved, and timely business operation of an enterprise is ensured.
When the running state of the batch processing process is abnormal, the method further comprises the following steps: when the monitoring module detects that an abnormal batch processing unit exists in the batch processing process, the next batch processing unit is processed according to the control of the routing module, and a primary early warning notice is sent out through the early warning module; when a plurality of abnormal batch processing units exist in the batch processing process, calling the abnormal batch processing units again through the scheduling actuator, if the abnormal batch processing units are all restarted, continuing to execute the batch processing process, and sending a middle-level early warning notice through the early warning module; if the calling times of the plurality of abnormal batch units all exceed the threshold value and the abnormal batch units still have starting failure, the batch processing process is terminated, and a high-level early warning notice is sent out through the early warning module.
Specifically, after the batch processing process is terminated when the calling times of a plurality of abnormal batch units all exceed a threshold value and the abnormal batch units still have abnormal starting failures, the abnormal processing is completed through a manager, and then the abnormal batch processing process is started from the current data processing point recorded by the abnormal field recording module and is continuously carried out, so that the rerun is avoided, and the execution time of the batch processing in abnormal conditions is shortened.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
It will be apparent to those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be centralized on a single computing device or distributed across a network of computing devices, and optionally they may be implemented in program code executable by a computing device, such that they may be stored on a computer storage medium (ROM/RAM, magnetic disks, optical disks) and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The foregoing is a more detailed description of the present invention that is presented in conjunction with specific embodiments, and the practice of the invention is not to be considered limited to those descriptions. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (9)
1. A breakpoint re-run batch processing system, comprising:
the system comprises a scheduling execution container, a batch processing module, a routing module, a monitoring module, an early warning module and an abnormal field recording module;
the scheduling execution container is used for starting inlets of a batch processing process and a batch processing program, is used for initializing a database connection pool and batch processing parameters, is stored in a memory, and organizes and coordinates communication, interaction and scheduling among the batch processing module, the routing module, the monitoring module, the early warning module and the abnormal field recording module;
the batch processing module is used for executing the processing of the service scene in the batch processing process;
the routing module is used for controlling the execution sequence and exception handling of the service scenes in the batch processing process;
the monitoring module is used for monitoring the running state of the batch processing process;
the early warning module is used for judging an early warning level according to the abnormity and sending out an early warning notice when the monitoring module detects that the batch processing process is abnormal;
the abnormal field recording module is used for recording a current data processing point when the monitoring module detects that the batch processing process is abnormal, and sending the current data processing point to the scheduling execution container after the abnormal processing is finished, wherein the scheduling execution container is started from the current data processing point to continue the batch processing process.
2. The breakpoint re-running batch processing system of claim 1, wherein the batch processing module is implemented by Java, linux shell script or database sql script.
3. The breakpoint re-running batch processing system according to claim 1, wherein the batch processing module comprises a front batch processing unit, a batch processing unit and a rear batch processing unit; the pre-batch processing unit, the batch processing middle unit and the post-batch processing unit are respectively configured with corresponding rules, the rules are stored through an xml file, and the scheduling execution container reads the xml file to realize batch processing configuration; and the routing module controls the preposed batch processing unit, the batch processing middle unit and the postposition batch processing unit to sequentially process the batch processing progress.
4. The breakpoint re-running batch processing system according to claim 1, wherein the monitoring module is further configured to receive a notification when the scheduling execution container schedules batch processing, when batch scheduling is completed, and when batch processing is abnormal, monitor and record the batch processing process, collect a current operating environment CPU and a memory usage rate of the batch processing process, and expose an interface for querying a batch processing state, so as to query an execution condition of the batch processing process.
5. The breakpoint re-run batch processing system of claim 4, further comprising: and the webpage front end is used for accessing the interface for inquiring the batch processing state, acquiring the execution condition of the batch processing process and judging the reason of the abnormity according to the current running environment CPU and the memory utilization rate of the batch processing process.
6. The breakpoint re-run batch processing system of claim 1, further comprising: and the log module is used for collecting logs during the running of the batch processing process and collecting and generating a batch processing report.
7. The batch processing system for the re-running of the breakpoint as claimed in claim 1, wherein the early warning module is configured with an early warning level, early warning times, an early warning interval and an early warning mode, and the early warning level is provided with three levels of a primary level, a middle level and a high level; the early warning times are used for sending early warning notifications again according to the set early warning intervals after detecting that the sent early warning notifications are not closed; the early warning modes comprise short message early warning and mail early warning.
8. A breakpoint re-running batch processing method is characterized by comprising the following steps:
starting a batch processing process and a batch processing program by scheduling the execution container;
processing the service scene in the batch processing process according to a batch processing module, and controlling the execution sequence and exception processing of the service scene processing through a routing module;
monitoring the running state of the batch processing process according to a monitoring module;
if the running state of the batch processing process is abnormal, recording the current data processing point through an abnormal field recording module, judging the abnormal level through an early warning module, and sending out an early warning notice according to the abnormal level;
and after the exception processing is finished, starting the scheduling execution container from the current data processing point, and continuing to perform the batch processing process.
9. The batch processing method for breakpoint re-running according to claim 8, wherein if there is an abnormality in the running state of the batch processing process, further comprising:
when the monitoring module detects that an abnormal batch unit exists in the batch processing process, the next batch processing unit is processed according to the control of the routing module, and a primary early warning notice is sent out through an early warning module;
when a plurality of abnormal batch units exist in the batch processing process, the abnormal batch units are called again through the scheduling actuator, if the abnormal batch units are restarted, the batch processing process is continuously executed, and a middle-level early warning notice is sent out through the early warning module;
if the calling times of the abnormal batch units all exceed the threshold value and the abnormal batch processing units still have starting failure, the batch processing process is terminated, and a high-level early warning notice is sent out through the early warning module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110151985.8A CN112882807A (en) | 2021-02-04 | 2021-02-04 | Breakpoint re-running batch processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110151985.8A CN112882807A (en) | 2021-02-04 | 2021-02-04 | Breakpoint re-running batch processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112882807A true CN112882807A (en) | 2021-06-01 |
Family
ID=76057114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110151985.8A Pending CN112882807A (en) | 2021-02-04 | 2021-02-04 | Breakpoint re-running batch processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112882807A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101788908A (en) * | 2010-01-26 | 2010-07-28 | 浪潮(山东)电子信息有限公司 | Batch data processing method supporting breakpoint reget |
| CN103793309A (en) * | 2012-10-29 | 2014-05-14 | 中国移动通信集团浙江有限公司 | Method and device for early warning of batch services |
| CN109379400A (en) * | 2018-09-04 | 2019-02-22 | 中国建设银行股份有限公司 | Batch jobs dispatch deal system, method, apparatus and storage medium |
| WO2019091217A1 (en) * | 2017-11-10 | 2019-05-16 | 华为技术有限公司 | Script debugging method and device, and computer storage medium |
| CN110866834A (en) * | 2019-10-12 | 2020-03-06 | 中国平安财产保险股份有限公司 | Batch processing program execution method and system |
-
2021
- 2021-02-04 CN CN202110151985.8A patent/CN112882807A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101788908A (en) * | 2010-01-26 | 2010-07-28 | 浪潮(山东)电子信息有限公司 | Batch data processing method supporting breakpoint reget |
| CN103793309A (en) * | 2012-10-29 | 2014-05-14 | 中国移动通信集团浙江有限公司 | Method and device for early warning of batch services |
| WO2019091217A1 (en) * | 2017-11-10 | 2019-05-16 | 华为技术有限公司 | Script debugging method and device, and computer storage medium |
| CN109379400A (en) * | 2018-09-04 | 2019-02-22 | 中国建设银行股份有限公司 | Batch jobs dispatch deal system, method, apparatus and storage medium |
| CN110866834A (en) * | 2019-10-12 | 2020-03-06 | 中国平安财产保险股份有限公司 | Batch processing program execution method and system |
Non-Patent Citations (2)
| Title |
|---|
| RU ZHANG: "An Empirical Study on Program Failures of Deep Learning Jobs", 《IEEE》 * |
| 李代伟: "基于Java的通用批处理作业系统的设计与实现", 《软件工程师》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111818159B (en) | Management method, device, equipment and storage medium of data processing node | |
| US8516499B2 (en) | Assistance in performing action responsive to detected event | |
| EP2523115A1 (en) | Operation management device, operation management method, and program storage medium | |
| CN109271602B (en) | Deep learning model publishing method and device | |
| CN111324423B (en) | Method and device for monitoring processes in container, storage medium and computer equipment | |
| US9348685B2 (en) | Intermediate database management layer | |
| US8694835B2 (en) | System health monitoring | |
| CN114328102A (en) | Equipment state monitoring method, device, equipment and computer readable storage medium | |
| JP2008527547A (en) | System, method and software for distributed loading of databases | |
| CN108255661A (en) | A kind of method and system for realizing Hadoop cluster monitorings | |
| CN114968272A (en) | Algorithm operation method, device, equipment and storage medium | |
| CN114676019A (en) | Method, device, equipment and storage medium for monitoring state of central processing unit | |
| CN109460311A (en) | The management method and device of firmware abnormality | |
| CN117151669A (en) | Reminding method and device based on workflow engine execution time and electronic equipment | |
| CN112882807A (en) | Breakpoint re-running batch processing system and method | |
| CN111897626A (en) | Cloud computing scene-oriented virtual machine high-reliability system and implementation method | |
| CN108874626B (en) | System monitoring method and device | |
| CN116149932A (en) | Method and device for detecting software system state and electronic equipment | |
| CN115686831A (en) | Task processing method and device based on distributed system, equipment and medium | |
| CN115454718A (en) | Automatic database backup file validity detection method | |
| CN114911578A (en) | Storage system monitoring and fault collecting method and device, terminal and storage medium | |
| US20170316035A1 (en) | Rule-governed entitlement data structure change notifications | |
| CN112969151A (en) | Short message monitoring method, device and equipment | |
| CN113468029A (en) | Log management method and device, electronic equipment and readable storage medium | |
| CN110597603A (en) | Scheduling method and system of distributed scheduling tasks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |