CN108509515A - A kind of method and system of monitoring data library batch processing - Google Patents
A kind of method and system of monitoring data library batch processing Download PDFInfo
- Publication number
- CN108509515A CN108509515A CN201810193601.7A CN201810193601A CN108509515A CN 108509515 A CN108509515 A CN 108509515A CN 201810193601 A CN201810193601 A CN 201810193601A CN 108509515 A CN108509515 A CN 108509515A
- Authority
- CN
- China
- Prior art keywords
- program
- task
- batch
- storing process
- monitoring data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/105—Human resources
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Operations Research (AREA)
- Economics (AREA)
- Marketing (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Stored Programmes (AREA)
Abstract
The present invention relates to a kind of method and system of monitoring data library batch processing, the method includes：Selection needs the storing process that batch executes, and configures Chinese and program description for the storing process, and specify module and priority scheduling categories for program；The program for selecting each scheduling to need in management and running；At the beginning of selecting task management, the plan type of task shut-in time and task；It checks the daily record of batch storing process, can realize monitoring and the configuration batch storing process at interface in this way.And the execution state of storing process can be distinguished using clearly color in interface.When running the needs personalization adjustment of number process, the direct easy configuration of mode at interface can also be used.
Description
Technical field
The present invention relates to technical field of data processing, method more particularly to a kind of batch processing of monitoring data library and are
System.
Background technology
Currently, enterprise performance evaluation data need to count, it is necessary to which the operation for relying on database batch storing process is being held
When these batch storing process of row（Hereinafter referred to as " run number "）, unstable, Network Abnormal, other systems can be issued because of server
The reasons such as incomplete, the interface document mistake of interface document cause to run number failure.At so can maintenance personnel quickly navigate to batch
The case where reason executes：Error reason, error coordinates etc., and can quickly re-execute and run the workload that number will determine maintenance personnel
And the difficulty safeguarded.However, the race number of existing performance appraisal system, all only storage each stored in the database
The sequencing of journey, there is no the monitoring at interface and configuration means, storing process execution can only pass through SQL when where reporting an error
Sentence inquires the log sheet of database, and the mode at interface can not be used to distinguish the execution shape of storing process using clearly color
State.When running the needs personalization adjustment of number process, modification table data in database table can only be gone, and the side at interface cannot be used
The direct easy configuration of formula.Thus, being badly in need of research and development one kind in industry being capable of interfaceization monitoring and configuration database batch storing process
Technology.
Invention content
In order to overcome the race number of existing performance appraisal system of the existing technology, all only storage is every in the database
The sequencing of a storing process, there is no the deficiencies of the monitoring at interface and configuration means, and the present invention provides a kind of monitoring
The method and system of database batch processing.
The technical solution adopted by the present invention to solve the technical problems is：
A kind of method of monitoring data library batch processing, including：Selection needs the storing process that batch executes, and is the storing process
Chinese and program description are configured, and module and priority scheduling categories are specified for program；Each scheduling is selected to need in management and running
The program wanted；At the beginning of selecting task management, the plan type of task shut-in time and task；Check batch storing process
Daily record.
Preferably, include the step of the program of each scheduling needs of selection in management and running：According to the elder generation between program
Program is arranged in dispatch list by sequence afterwards.
Preferably, the plan type of the task includes daily or disposable；If the plan type of the task is every
It executes the corresponding scheduling of the task, and incoming scheduled date variable then daily since initial time；If the task
Plan type is disposable, then the plan can be only executed once.
Preferably, further include after selection needs the step of storing process of batch execution：Select frequency mark, wherein
Frequency mark includes：Daily, monthly, every season, it is annual, per ten days.
Preferably, further include after selection needs the step of storing process of batch execution：Setting program needs when executing
Integer types input parameter, the parameter it is entitled：I_TJRQ.
A kind of system of monitoring data library batch processing, including：Program management module, dispatching management module, task management mould
Block and race a few days will check module；Described program management module, the storing process for selecting that batch is needed to execute are deposited to be described
Process configuration Chinese and program description are stored up, and module and priority scheduling categories are specified for program；The dispatching management module, is used for
The program for selecting each scheduling to need in management and running；The task management module, at the beginning of selecting task management
Between, the plan type of task shut-in time and task；The race a few days will checks module, the day for checking batch storing process
Will.
Preferably, the dispatching management module is additionally operable to that program is arranged in scheduling according to the sequencing between program
In list.
Preferably, the plan type of the task includes daily or disposable；If the plan type of the task is every
It executes the corresponding scheduling of the task, and incoming scheduled date variable then daily since initial time；If the task
Plan type is disposable, then the plan can be only executed once.
Preferably, described program management module is additionally operable to selection frequency mark, wherein frequency mark includes：Daily, often
The moon, every season, it is annual, per ten days.
Preferably, described program management module is additionally operable to the input ginseng of the Integer types needed when setting program executes
Number, the parameter it is entitled：I_TJRQ.
The beneficial effects of the invention are as follows：The method of the monitoring data library batch processing of the present invention needs batch to execute by selecting
Storing process, configure Chinese and program description for the storing process, and module and priority scheduling categories are specified for program；
The program for selecting each scheduling to need in management and running；At the beginning of selecting task management, task shut-in time and task
Plan type；It checks the daily record of batch storing process, can realize monitoring and the configuration batch storing process at interface in this way.
Description of the drawings
Present invention will be further explained below with reference to the attached drawings and examples.
Fig. 1 is the schematic flow chart of the method for the monitoring data library batch processing of an embodiment.
Fig. 2 is the schematic flow chart of the method for the monitoring data library batch processing of another embodiment.
Fig. 3 is the schematic diagram of the system of the monitoring data library batch processing of an embodiment.
Specific implementation mode
In conjunction with the accompanying drawings, the present invention is further explained in detail.These attached drawings are simplified schematic diagram, only with
Illustration illustrates the basic structure of the present invention, therefore it only shows the composition relevant to the invention.
Referring to Fig. 1, a kind of method of monitoring data library batch processing, including：
S11, selection need the storing process that batch executes, and configure Chinese and program description for the storing process, and be
Program specifies module and priority scheduling categories；
The present embodiment is applied in performance appraisal system.
Step S11 further includes：Select frequency mark, wherein frequency mark includes：Daily, monthly, it is every season, annual, every
Ten days.Such as：It is executed on the day of monthly representing the end of month every month.
The input parameter of Integer types needed when program executes is set, the parameter it is entitled：I_TJRQ.If
The parameter needed when program executes is set, storing process is required for relying on Data Date.Storing process can have multiple input parameter,
It system automatically generated and is configured in load store process title, such as：Class of service input parameter is deposit data, it is only necessary to
" 01 " is inputted in input parameter position, a upper program for program is finally set, the sequencing between program when running number is set,
Referring specifically to Fig. 2:
S21, configurator essential information；
S22 forms program library；
S23 increases scheduling newly；
S24, planned automatic execution；Step S25 or step S29 can be executed.
S25, it is automatic to execute；
S29 is manually performed；
S26 refreshes dispatch state；
Whether S27, scheduling succeed；If so, thening follow the steps S28.If it is not, thening follow the steps S30.
S28 terminates scheduling；
S30, if continue to dispatch；If it is not, thening follow the steps S28.If so, thening follow the steps S29.
S12, the program for selecting each scheduling to need in management and running；Step S12 includes：According to the priority between program
Program is arranged in dispatch list by sequence.Specifically, existed with 5 program proper alignments of every row according to the sequencing between program
In dispatch list.Scheduling can start according to task periodic refreshing, while can also manually perform, and JAVA is used in implementation procedure
The main entrance for executing scheduling is called, system table-scheduler program in reading database will be recycled in the entry program, and dispatch code name pair
The Procedure Word answered is passed to each program using race phase a few days and executes, in implementation procedure, can pass through four kinds of face on interface successively
Color finds out that the state of the program, each program can change the status word in program log sheet after the completion of execution clearly
Section, every 10 seconds JAVA timers can refresh the state at interface：Grey expression is not carried out, green indicates that execution passes through, blue indicates
It is carrying out, red expression execution mistake, when occurring red program in scheduling, scheduling meeting termination execution at once is used in combination and " is gone out
It is wrong " prompt.
It when scheduling " error ", can be continued by way of manually performing scheduling, select red program, may be selected " from
This program starts to execute ", then input the Data Date of execution, you can continue to execute scheduling.
Whole process is that JAVA is initiated, database executes, the process of timer dispaly state.
S13, at the beginning of selecting task management, the plan type of task shut-in time and task；Wherein, the task
Plan type include daily or disposable；
If the plan type of the task is daily, daily since initial time, the corresponding scheduling of the task is executed, and pass
Enter scheduled date variable；
If the plan type of the task is disposable, which can only be executed once.
S14 checks the daily record of batch storing process.It needs to check that each program executes the daily record generated during running number
When, it can be by running the displaying of a few days will look facility.
The system of the monitoring data library batch processing of the present invention is deposited by the storing process for selecting that batch is needed to execute to be described
Process configuration Chinese and program description are stored up, and module and priority scheduling categories are specified for program；It is selected in management and running each
Dispatch the program needed；At the beginning of selecting task management, the plan type of task shut-in time and task；Check that batch is deposited
The daily record of storage process can realize monitoring and the configuration batch storing process at interface in this way.And it can be used in interface
Clearly color distinguishes the execution state of storing process.When running the needs personalization adjustment of number process, interface can also be used
The direct easy configuration of mode.
Referring to Fig. 3, a kind of system of monitoring data library batch processing, including：Program management module 11, dispatching management module
12, task management module 13 and race a few days will check module 14；Described program management module 11 needs batch to execute for selecting
Storing process, configure Chinese and program description for the storing process, and module and priority scheduling categories are specified for program；Institute
Dispatching management module 12 is stated, the program for selecting each scheduling to need in management and running；The task management module 13 is used
At the beginning of selecting task management, the plan type of task shut-in time and task；The race a few days will checks module 14,
Daily record for checking batch storing process.
In the present embodiment, the dispatching management module 12 is additionally operable to arrange program according to the sequencing between program
In dispatch list.
Include daily or disposable in the plan type of the present embodiment, the task；If the plan type of the task
To be daily, then daily since initial time, the corresponding scheduling of the task, and incoming scheduled date variable are executed；If described
The plan type of business is disposable, then the plan can be only executed once.
In the present embodiment, described program management module 11 is additionally operable to selection frequency mark, wherein frequency mark includes：Often
Day, monthly, every season, it is annual, per ten days.
In the present embodiment, described program management module 11 is additionally operable to the Integer types needed when setting program executes
Input parameter, the parameter it is entitled：I_TJRQ.
The system of the monitoring data library batch processing of this programme is by including：Program management module, dispatching management module, task
Management module and race a few days will check module；Described program management module, the storing process for selecting that batch is needed to execute are
The storing process configuration Chinese and program description, and specify module and priority scheduling categories for program；The management and running mould
Block, the program for selecting each scheduling to need in management and running；The task management module, for selecting task management
The plan type of time started, task shut-in time and task；The race a few days will checks module, for checking that batch stored
The daily record of journey can realize monitoring and the configuration batch storing process at interface in this way.
It is enlightenment with above-mentioned desirable embodiment according to the present invention, through the above description, relevant staff is complete
Various changes and amendments can be carried out without departing from the scope of the technological thought of the present invention' entirely.The technology of this invention
Property range is not limited to the contents of the specification, it is necessary to determine its technical scope according to right.
Claims (10)
1. a kind of method of monitoring data library batch processing, which is characterized in that including：
Selection needs the storing process that batch executes, and configures Chinese and program description for the storing process, and be program
Specified module and priority scheduling categories；
The program for selecting each scheduling to need in management and running；
At the beginning of selecting task management, the plan type of task shut-in time and task；
Check the daily record of batch storing process.
2. the method for monitoring data library according to claim 1 batch processing, which is characterized in that selected in management and running every
It is a scheduling need program the step of include：
Program is arranged in dispatch list according to the sequencing between program.
3. the method for monitoring data library according to claim 1 batch processing, which is characterized in that the plan type of the task
Including daily or disposable；
If the plan type of the task is daily, daily since initial time, the corresponding scheduling of the task is executed, and pass
Enter scheduled date variable；
If the plan type of the task is disposable, which can only be executed once.
4. the method for monitoring data library according to claim 1 batch processing, which is characterized in that selection needs batch to execute
Further include after the step of storing process：
Select frequency mark, wherein frequency mark includes：Daily, monthly, every season, it is annual, per ten days.
5. the method for monitoring data library according to claim 1 batch processing, which is characterized in that selection needs batch to execute
Further include after the step of storing process：
The input parameter of Integer types needed when program executes is set, the parameter it is entitled：I_TJRQ.
6. a kind of system of monitoring data library batch processing, which is characterized in that including：Program management module, is appointed at dispatching management module
Business management module and race a few days will check module；
Described program management module, the storing process for selecting that batch is needed to execute configure Chinese name for the storing process
Title and program description, and specify module and priority scheduling categories for program；
The dispatching management module, the program for selecting each scheduling to need in management and running；
The task management module, for selecting task management at the beginning of, the plan type of task shut-in time and task；
The race a few days will checks module, the daily record for checking batch storing process.
7. the system of monitoring data library according to claim 6 batch processing, which is characterized in that the dispatching management module,
It is additionally operable to that program is arranged in dispatch list according to the sequencing between program.
8. the system of monitoring data library according to claim 6 batch processing, which is characterized in that the plan type of the task
Including daily or disposable；
If the plan type of the task is daily, daily since initial time, the corresponding scheduling of the task is executed, and pass
Enter scheduled date variable；
If the plan type of the task is disposable, which can only be executed once.
9. the system of monitoring data library according to claim 6 batch processing, which is characterized in that described program management module,
It is additionally operable to selection frequency mark, wherein frequency mark includes：Daily, monthly, every season, it is annual, per ten days.
10. the system of monitoring data library according to claim 6 batch processing, which is characterized in that described program management module,
Be additionally operable to the input parameter of Integer types needed when setting program executes, the parameter it is entitled：I_TJRQ.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810193601.7A CN108509515A (en) | 2018-03-09 | 2018-03-09 | A kind of method and system of monitoring data library batch processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810193601.7A CN108509515A (en) | 2018-03-09 | 2018-03-09 | A kind of method and system of monitoring data library batch processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108509515A true CN108509515A (en) | 2018-09-07 |
Family
ID=63377378
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810193601.7A Pending CN108509515A (en) | 2018-03-09 | 2018-03-09 | A kind of method and system of monitoring data library batch processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108509515A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109885384A (en) * | 2018-12-13 | 2019-06-14 | 平安壹钱包电子商务有限公司 | Task concurrency optimization method, apparatus, computer equipment and storage medium |
| CN111581243A (en) * | 2020-04-30 | 2020-08-25 | 北京江融信科技有限公司 | Batch processing task execution method and system based on batch database |
| CN113220666A (en) * | 2021-05-24 | 2021-08-06 | 中国工商银行股份有限公司 | Method, device and system for replaying batch processing logs after database migration |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110173619A1 (en) * | 2005-10-11 | 2011-07-14 | Eric Ian Fish | Apparatus and method for optimized application of batched data to a database |
| CN202084026U (en) * | 2011-06-10 | 2011-12-21 | 中国工商银行股份有限公司 | Data monitoring system for batch operations of host |
| CN104407919A (en) * | 2014-12-15 | 2015-03-11 | 浪潮软件股份有限公司 | Data processing task scheduling system and method |
| CN104793994A (en) * | 2015-04-27 | 2015-07-22 | 中国农业银行股份有限公司 | Batch job processing method, device and system |
| CN105468499A (en) * | 2014-09-04 | 2016-04-06 | 中芯国际集成电路制造(上海)有限公司 | System and method for managing scheduler |
-
2018
- 2018-03-09 CN CN201810193601.7A patent/CN108509515A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110173619A1 (en) * | 2005-10-11 | 2011-07-14 | Eric Ian Fish | Apparatus and method for optimized application of batched data to a database |
| CN202084026U (en) * | 2011-06-10 | 2011-12-21 | 中国工商银行股份有限公司 | Data monitoring system for batch operations of host |
| CN105468499A (en) * | 2014-09-04 | 2016-04-06 | 中芯国际集成电路制造(上海)有限公司 | System and method for managing scheduler |
| CN104407919A (en) * | 2014-12-15 | 2015-03-11 | 浪潮软件股份有限公司 | Data processing task scheduling system and method |
| CN104793994A (en) * | 2015-04-27 | 2015-07-22 | 中国农业银行股份有限公司 | Batch job processing method, device and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109885384A (en) * | 2018-12-13 | 2019-06-14 | 平安壹钱包电子商务有限公司 | Task concurrency optimization method, apparatus, computer equipment and storage medium |
| CN111581243A (en) * | 2020-04-30 | 2020-08-25 | 北京江融信科技有限公司 | Batch processing task execution method and system based on batch database |
| CN113220666A (en) * | 2021-05-24 | 2021-08-06 | 中国工商银行股份有限公司 | Method, device and system for replaying batch processing logs after database migration |
| CN113220666B (en) * | 2021-05-24 | 2024-03-08 | 中国工商银行股份有限公司 | Batch processing log playback method, device and system after database migration |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105487924B (en) | A kind of batch processing control method and device | |
| CN108509515A (en) | A kind of method and system of monitoring data library batch processing | |
| CN101411123B (en) | Method, system and computer program for the centralized system management on endpoints of a distributed data processing system | |
| CN103197960B (en) | Dispatching method and system for batch job system | |
| CN111125444A (en) | Big data task scheduling management method, device, equipment and storage medium | |
| US7562351B2 (en) | Postprocessing office method and system | |
| CN105677465B (en) | The data processing method and device of batch processing are run applied to bank | |
| CN101685452B (en) | Data warehouse scheduling method and scheduling system | |
| CN110619014A (en) | ETL-based data extraction method | |
| CN116050797A (en) | Automatic scheduling method and related equipment | |
| CN114840248A (en) | System gray level publishing method based on enterprise level distributed application service | |
| CN110287006A (en) | A kind of data dispatching method and system | |
| CN113485814A (en) | Batch task scheduling method and device | |
| CN116226092B (en) | Database updating method and device | |
| CN102096857B (en) | Collaboration method and device for data processing process | |
| CN109116818B (en) | Real-time data dump method and device during SCADA system upgrade | |
| US20040215666A1 (en) | Method and device for establishing synchronized recovery log points | |
| JPH10301799A (en) | System for applying test program | |
| CN103182838A (en) | Method and device for automatically monitoring newspaper production processes | |
| CN117472530B (en) | Centralized management-based data intelligent scheduling method and system | |
| CN113361902A (en) | High-efficiency regulation and control intelligent production scheduling system | |
| CN112559641A (en) | Processing method and device of pull chain table, readable storage medium and electronic equipment | |
| US20070094186A1 (en) | Modular SQL rule-based management of job process flow | |
| CN112817808A (en) | Computer cluster maintenance task management method and system | |
| CN112799794A (en) | Big data scheduling method, device and system and storage device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180907 |
|
| RJ01 | Rejection of invention patent application after publication |