CN110362419B - Data processing method and device applied to centralized multi-time zone system - Google Patents

Data processing method and device applied to centralized multi-time zone system Download PDF

Info

Publication number
CN110362419B
CN110362419B CN201910665507.1A CN201910665507A CN110362419B CN 110362419 B CN110362419 B CN 110362419B CN 201910665507 A CN201910665507 A CN 201910665507A CN 110362419 B CN110362419 B CN 110362419B
Authority
CN
China
Prior art keywords
job
batch
time zone
running
breakpoint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910665507.1A
Other languages
Chinese (zh)
Other versions
CN110362419A (en
Inventor
孙雨辰
梁惠华
庞良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN201910665507.1A priority Critical patent/CN110362419B/en
Publication of CN110362419A publication Critical patent/CN110362419A/en
Application granted granted Critical
Publication of CN110362419B publication Critical patent/CN110362419B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0715Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a system implementing multitasking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0745Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in an input/output transactions management context
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0793Remedial or corrective actions

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The disclosure provides a data processing method, device, system and medium applied to a centralized multi-time zone system. The data processing method applied to the centralized multi-time zone system comprises the following steps: in response to detecting that a first batch operation running in the centralized multi-time zone system is stopped, determining a breakpoint of the first batch operation; submitting the first batch operation; and continuing to process the first batch of jobs from the breakpoint. The method and the device can continue to process the first batch of jobs from the breakpoint after the first batch of jobs are stopped, so that the recovery rate of the first batch of jobs in the centralized multi-time zone system can be improved.

Description

Data processing method and device applied to centralized multi-time zone system
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data processing method and apparatus applied to a centralized multi-time-zone system.
Background
In order to meet the international development strategy goal of banks, each bank successively develops its own overseas business processing system, and since overseas branches belong to different time zones, the overseas system is inevitably a multi-time zone business processing system, each time zone must complete respective day time, day time and day end processing, and the operating environments of the overseas business processing systems of each bank are different. The centralized multi-time zone system completes the business processing of each time zone through a set of systems running in a data center.
The centralized multi-time zone service processing system realizes that multi-time zone service processing is supported in a set of logic system, batch jobs in different time zones are distributed in the 24-hour range of the time zone in which the system is located, and after the batch jobs in the multi-time zone system are subjected to shutdown (including planned shutdown and unplanned shutdown conditions), the system is recovered again, and the batch jobs in the shutdown period can be recovered to be normal only by additionally processing due to the inheritance relationship of services before and after the system is recovered. The lack of a solution for quickly recovering batch services for a centralized multi-time zone service processing system in a bank system results in slower recovery of batch operations for the centralized multi-time zone service processing system in the system, and influences quick recovery service after shutdown of the batch operations of banks in and out of the country.
Disclosure of Invention
In view of this, the present disclosure provides a data processing method and apparatus applied to a centralized multi-time zone system, which can quickly recover batch operations that are down.
One aspect of the present disclosure provides a data processing method applied to a centralized multi-time zone system. The method includes, in response to detecting that a first batch job running in the centralized multi-time zone system is down, determining a breakpoint of the first batch job, submitting the first batch job, and continuing processing the first batch job from the breakpoint.
Optionally, the breakpoint comprises a first job in the first batch job whose running status is running when the first batch job is stopped. The resuming processing of the first batch of jobs from the breakpoint includes reprocessing the first job and processing other jobs subsequent to the first job.
Optionally, the method further includes recording an automatic replenishment registration table of the first batch of jobs while the first batch of jobs are running, where the automatic replenishment registration table is used to record running states of each job in the first batch of jobs, and the running states include one of non-running, and running end. The determining the breakpoint of the first batch job includes determining the breakpoint based on the running state in the automatic resubmission registry.
Optionally, the automatic supplementary submission registration table is further configured to record running time zone information of each job, the continuing to process the first batch of jobs from the breakpoint includes determining a job type of each job in the first job and the other jobs based on the running time zone information of each job, the job type includes one of a day-to-day job, a day-to-end job, and a day-to-day job, and processing each job based on the job type of each job.
Optionally, the operation time zone information includes an offset amount of a day-to-day time of the time zone in which each job is located with respect to a zero point of a predetermined area, and an offset amount of a day-to-day time of the time zone in which each job is located with respect to the day-to-day time.
Optionally, the processing the each job based on the job type of the each job comprises: checking an operation state of a preceding job, wherein the preceding job is a job immediately preceding a second job to be executed; if the running state of the previous job is running end and the previous job does not belong to daily cutting job, running the second job, and recording the running state of the second job as running in the automatic supplementary submission registry; after a predetermined time, determining whether the second job is finished; and if the second job is finished, recording the running state of the second job as the running end in the automatic supplementary submission registry.
Optionally, the processing each job based on the job type of each job further comprises: if the operation of the previous operation is finished and the previous operation belongs to the daily cutting operation, triggering the operation of the daily ending operation associated with the daily cutting operation; and after the operation of the day end operation is finished, operating the second operation.
In another aspect of the present disclosure, a data processing apparatus applied to a centralized multi-time zone system is provided. The system comprises a job group submission error processing module, a job group submission module and a breakpoint re-submission module. The operation group submission error processing module is used for responding to the detection that a first batch operation running in the centralized multi-time zone system stops, and determining a breakpoint of the first batch operation. The job group submitting module is used for submitting the first batch of jobs. And the breakpoint re-extracting module is used for continuously processing the first batch of operation from the breakpoint.
Optionally, the apparatus further comprises a registry recording module. The registry recording module is used for recording an automatic supplementary registration registry of the first batch jobs while the first batch jobs are running, the automatic supplementary registration registry is used for recording running states of all jobs in the first batch jobs, and the running states include one of non-running, running and running ending. The breakpoint re-extracting module is further used for determining the breakpoint based on the running state in the automatic re-extracting registry.
In another aspect of the present disclosure, a data processing system for use in a centralized multi-time zone system is provided. The system includes a memory and a processor. The memory has stored thereon computer-executable instructions. The processor executes the instructions to implement the method as described above.
In another aspect of the present disclosure, a computer-readable storage medium is provided, having executable instructions stored thereon, which when executed by a processor, cause the processor to perform the method as described above.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
FIG. 1 schematically shows a description of the operation status of batch jobs in each time zone of a centralized multi-time zone system;
fig. 2 schematically shows a block diagram of a data processing device applied to a centralized multi-time zone system according to an embodiment of the present disclosure;
FIG. 3 schematically shows a flow chart of a data processing method applied to a centralized multi-time zone system according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a flow chart of a data processing method applied to a centralized multi-time zone system according to another embodiment of the present disclosure;
FIG. 5 schematically illustrates a flow chart of a method of continuing processing of the first batch job from a breakpoint in the method of FIG. 4;
FIG. 6 is a flow chart that schematically illustrates a method of processing each job based on its job type in the method of FIG. 5;
FIG. 7 schematically shows a block diagram of a data processing apparatus applied to a centralized multi-time zone system according to another embodiment of the present disclosure;
FIG. 8 schematically illustrates a flow chart of a data processing method performed by the apparatus shown in FIG. 7;
FIG. 9 schematically illustrates a flow chart of a method performed by the breakpoint rerun module in the apparatus illustrated in FIG. 7;
FIG. 10 is a flow chart schematically illustrating a method performed by the Job group submission module in the apparatus shown in FIG. 7;
FIG. 11 is a flow chart that schematically illustrates a method performed by a submit job group operation monitoring module in the apparatus shown in FIG. 7;
FIG. 12 schematically illustrates a flow chart of a method performed by the registry record module in the apparatus shown in FIG. 7; and
FIG. 13 shows schematically a block diagram of a data processing system applied in a centralized multi-time zone system according to yet another embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that these descriptions are illustrative only and are not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B, and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B, and C" would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.). Where a convention analogous to "at least one of A, B, or C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B, or C" would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.).
The embodiment of the disclosure provides a data processing method, a device, a system and a medium applied to a centralized multi-time zone system. The data processing method applied to the centralized multi-time zone system comprises the following steps: in response to detecting that a first batch operation running in the centralized multi-time zone system is stopped, determining a breakpoint of the first batch operation; submitting the first batch operation; and continuing to process the first batch of jobs from the breakpoint. The method, the device, the system and the medium of the embodiment of the disclosure can continue to process the first batch operation from the breakpoint after the first batch operation is stopped, so that the recovery rate of the first batch operation in the centralized multi-time-zone system can be improved.
The embodiments of the present disclosure provide an efficient and safe data processing method, apparatus, system and medium applied to a centralized multi-time-zone system, which can automatically calculate batch operations missed by the system in each time zone during shutdown under a scenario that the system needs to be restored after the shutdown of the batch operations in the centralized multi-time-zone system, detect breakpoints of the batch operations according to preset countermeasures, automatically submit the batch operations, and then continue to process the batch operations from the breakpoints, thereby achieving the purpose of improving processing efficiency without manual intervention, and solving the problem that the batch cannot be quickly restored after the shutdown of the centralized multi-time-zone system.
Fig. 1 schematically shows a description of the operation status of batch jobs in each time zone of the centralized multi-time zone system.
As shown in fig. 1, assume that the time zone where beijing is located is the reference time zone, the offset of time zone 1 with respect to beijing time zero is 0, the offset of time zone 2 with respect to beijing time zero is 1 hour, the offset of time zone 3 with respect to beijing time zero is 2 hours, and so on. According to the embodiment of the invention, the running time zone information of each time zone relative to the reference time zone can be set in the centralized multi-time zone system. The running time zone information may include an offset amount of a time-to-day of the time zone in which each of the jobs is located with respect to a zero point of a predetermined area, and an offset amount of a time-to-day of the time zone in which each of the jobs is located with respect to the time-to-day. For example, the running time zone information recording for each time zone can be realized by two parameter tables (parameter table a and parameter table B), respectively.
The parameter table a sets the offset of the time of day-to-day in each time zone with respect to the zero point of the beijing time, as shown in fig. 1, the offset of time zone 1 with respect to the zero point of the beijing time is 0, the offset of time zone 2 with respect to the zero point of the beijing time is 1 hour, the offset of time zone 3 with respect to the zero point of the beijing time is 2 hours, and so on. For example, parameter table a content settings are exemplified as follows (to name only two time zones):
50 07 0100
51 08 0200
wherein: 50. reference numeral 51 denotes a lot number, 07 and 08 denote time zone numbers, and 0000 and 0100 denote offset times of the time of day cutting from the time zero of Beijing.
The parameter table B sets the offset of each daytime time of each time zone from the daily time cut of the present time zone. Parameter table B content setting examples are as follows (two job groups to name only):
ONBCACBS$00DADD 0900
ONBCACBS$05DADD 0930
wherein: ONBCACBS $00DADD is the job group name, the identification number in the job scheduling system, and 0900 is the offset time of the job group from the time of day.
The submission time of the jobs running in each time zone relative to Beijing time can be calculated through the parameter tables A and B, then when a batch job running in a certain time zone in the centralized multi-time-zone system has a breakpoint, the job type of the first job is determined to be a day-to-day job, a day-to-day job or a day-to-day job according to the parameter tables A and B corresponding to the jobs (such as the first job) at the breakpoint, the first job is reprocessed according to the job type of the first job, and then other jobs after the first job is processed are processed continuously.
Fig. 2 schematically shows a block diagram of a data processing apparatus 200 applied to a centralized multi-time zone system according to an embodiment of the present disclosure.
As shown in FIG. 2, the apparatus 200 may include a job group submission error handling module 210, a job group submission module 220, and a breakpoint resubmission module 230.
Specifically, the workgroup submission error processing module 210 is configured to determine a breakpoint of a first batch job running in the centralized multi-time-zone system in response to detecting that the first batch job is down. Job group submission module 220 is configured to submit the first batch of jobs. Breakpoint resubmission module 230 is configured to continue processing the first batch of jobs from the breakpoint.
According to another embodiment of the present disclosure, the apparatus 200 may further include a registry recording module 240. The registry recording module 240 is configured to record an automatic replenishment registry of the first batch job while the first batch job is running, where the automatic replenishment registry is configured to record running states of each job in the first batch job, and the running states include one of non-running, and running end. Furthermore, the breakpoint re-extraction module 230 is further configured to determine the breakpoint based on the running status in the automatic re-extraction registry.
An example of a data structure for an automatic supplementary filing registry is shown in table 1:
TABLE 1
Figure BDA0002139051020000071
With reference to fig. 1, although the daily time cutting of each time zone of the multi-time zone system is the zero point of the local time, the daily time cutting of each time zone is not the zero point when the time zone falls on the system running time zone, and it is the key of the present invention to detect the missed submitted job in the time zone during the shutdown period of the batch job in a certain time zone. For clarity, the differences between the centralized multi-time zone system and the single time zone service system will be described. Taking the batch processing of the single time zone business processing system as an example, the system needs to perform the daily final batch processing after the business of each day is finished, and the daily final batch processing needs to confirm the end of the business of the day and the start of the next business day. And a plurality of time zones of the centralized multi-time zone system, the zero point of each time zone is located at different time of the time zone operated by the centralized system, and the corresponding distribution of the time and the final day batch is more scattered. Thus, by recording the automatic resubmission registry of each batch job while it is running. In this way, the running condition of each batch job is recorded, and the fact that each batch job belongs to the end-of-day job, the daytime job or the day-to-day job can be inquired and obtained according to the running condition.
In this way, each time the apparatus 200 is triggered, it first checks whether the job to be processed by the automatic resubmission registry is a breakpoint resubmission (for example, a job whose running state is marked as "2-running"). If yes, the job to be processed is indicated to be a breakpoint, and the batch job is continuously processed from the breakpoint. If not (e.g., the run status flag is "1-not run"). The automatic replenishment registry of the job to be run is emptied and initialized according to the contents of the parameter tables a, B of the batch job.
The initialization principle is that the queues are divided into a plurality of queues according to time zones, and each queue is arranged according to the ascending order of the trigger time. Taking the contents of the parameter tables a and B above as an example, the parameter table a has two batches, and the running queue mentioned later is two, the daily cutting time of 50 batches is 1 hour relative to the beijing time, and the offset time plus the time of a specific job group is the actual running time of the job group, for example, the actual running time of the job group ONBCACBS $00DADD is 9 point +1 hour =10 point, and the actual running time of the job group ONBCACBS $05DADD is 9 point 30 +1 hour =10 point 30 point, then the previous entry of the job group ONBCACBS $05DADD points to ONBCACBS 00dadd, and the previous entry of ONBCACBS $00dadd does not have previous entry.
Fig. 3 schematically shows a flow chart of a data processing method applied to a centralized multi-time zone system according to an embodiment of the present disclosure.
As shown in fig. 3, the data processing method applied to the centralized multi-time zone system according to the embodiment of the present disclosure includes operations S310 to S330.
First, in operation S310, the task group submission error processing module 210 determines a breakpoint of a first batch task running in the centralized multi-time zone system in response to detecting that the first batch task is down.
Then, in operation S320, the job group submission module 220 automatically submits the first batch of jobs.
Next, in operation S330, the breakpoint refetching module 230 may continue processing the first batch job from the breakpoint. Specifically, the breakpoint comprises a first job whose running status is running in the first batch job at the time the first batch job is stopped (e.g., the running status is marked as "2-running" in table 1). Thus, operation S330 may specifically be to first reprocess the first job and then process other jobs subsequent to the first job.
In this way, according to the method of the embodiment of the disclosure, under the scene that the system needs to be restored after the batch service in the centralized multi-time zone system is shut down, the batch job which is omitted to be processed by the system in each time zone during the shutdown period can be automatically calculated, the breakpoint of the batch job is detected according to the preset corresponding measures, the batch job is automatically submitted, and then the batch job is continuously processed from the breakpoint, so that the purposes of no manual intervention and improvement of the processing efficiency are achieved, and the problem that the batch cannot be quickly restored after the centralized multi-time zone system is shut down is solved.
Fig. 4 schematically shows a flow chart of a data processing method applied to a centralized multi-time zone system according to another embodiment of the present disclosure.
As shown in fig. 4, according to another embodiment of the present disclosure, the data processing method applied to the centralized multi-time zone system includes operations S410, S311, and S320 to S330. Operation S311 is a specific example of operation S310.
First, in operation S410, the registry recording module 240 records an automatic re-submission registry of the first batch job while the first batch job runs, where the automatic re-submission registry is used to record running states of each job in the first batch job, and the running states include one of non-running, and running end.
Then, in operation S311, the job group submission error processing module 210 determines a breakpoint based on the running status in the automatic re-submission registry in response to detecting that the first batch of jobs running in the centralized multi-time zone system are stopped.
Operation S320 is then performed by the job group submission module 220, and then operation S330 is performed by the breakpoint resubmission module 230.
In this way, the running condition of each batch job is recorded through the automatic supplementary submission registry, on one hand, each batch job can be inquired and obtained according to the running condition, and belongs to day-end jobs, day-time jobs or day-to-day jobs, on the other hand, breakpoints can be determined according to the running state of each job in the batch jobs, and the batch jobs which are convenient to stop can be recovered quickly.
Fig. 5 schematically shows a flowchart of a method of continuing processing of the first batch job from the breakpoint at operation S330 in the method of fig. 4.
As shown in fig. 5, operation S330 may further include operation S501 and operation S502 according to an embodiment of the present disclosure.
According to the embodiment of the present disclosure, the automatic supplementary registration table is further used for recording the running time zone information of each job, for example, the time information recorded by STARTTIME and suttime in table 1. The running time zone information may include an offset amount (in the form of data in the parameter table a) of the time-of-day of the time zone in which each job is located with respect to the zero point of a predetermined area; and the offset of the daytime time of the time zone in which each job is positioned relative to the suncut time (such as the data form in the parameter table B).
In operation S501, a job type of each of the first job and the other jobs is determined based on the run time zone information of the respective jobs, the job type including one of a day-to-day job, a day-to-end job, and a day job.
Then, the each job is processed based on the job type of the each job in operation S502. One specific implementation can be seen in the schematic of fig. 6.
Fig. 6 schematically shows a flowchart of an example method in which operation S502 processes each job based on the job type of said each job in the method of fig. 5.
As shown in fig. 6, operation S502 may further include operations S601 to S606 according to an embodiment of the present disclosure.
First, in operation S601, the running status of a preceding job, which is a job immediately preceding a second job to be run, is checked.
Then, in operation S602, the breakpoint re-lifting module 230 determines whether the running state of the previous job is finished and the previous job does not belong to a japanese cut job. If the previous job has an operation status of operation end and does not belong to the japanese cut job, operation S604 may be performed. If the previous job runs to the end and the previous job belongs to the japanese cut job, operation S603 is performed, and then operation S604 is performed after operation S603.
Wherein, in operation S603, the operation of the end-of-day job associated with the day-cut job is triggered. Or in operation S604, the second job is executed, and the running status of the second job is recorded as running in the automatic supplementary submission registry.
Then, in operation S605, after a predetermined time, it is determined whether the second job run ends.
And in operation S606, if the second job is finished running, recording the running status of the second job as running end in the automatic supplementary registration table.
Methods and apparatus according to embodiments of the present disclosure are described in further detail below in conjunction with another specific example of fig. 7-12.
Fig. 7 schematically shows a block diagram of a data processing arrangement 700 applied to a centralized multi-time zone system according to another embodiment of the present disclosure.
As shown in fig. 7, the apparatus 700 includes a registry initializing means 710 and a job group submitting means 720.
The registry initialization apparatus 710 further comprises a registry recording module 240 and a breakpoint re-promotion module 230. The registry recording module 240 and the breakpoint re-promotion module 230 are connected to each other.
The registry recording module 240 is used for initializing the automatic supplementary-submitting registry according to the preset parameter table and processing errors of the initialization part of the automatic supplementary-submitting registry.
The breakpoint re-extraction module 230 is configured to determine a current batch breakpoint according to the state of the automatic re-extraction registry after being started, and continue processing from the breakpoint.
The job group submission means 720 further includes a job group submission module 220, a job group operation monitoring module 250, and a job group submission error handling module 210. Wherein, the job group submission module 220, the job group operation monitoring module 250, and the job group submission error handling module 210 are connected to each other.
The job group submission module 220 is configured to submit job groups in parallel in different time zones and control the precedence relationship of the job groups in the same time zone.
The job group operation monitoring module 250 is used for monitoring the operation state of the breakpoint batch job after the breakpoint batch job is submitted.
The workgroup submission error handling module 210 is used to handle when a workgroup load error, workgroup run error, or operation error occurs.
To facilitate understanding of the technical solutions of the embodiments of the present disclosure, fig. 8 schematically illustrates a flowchart of a data processing method performed by using the apparatus 700 illustrated in fig. 7. It will be understood by those skilled in the art that the embodiments described below are merely examples, and the embodiments of the present disclosure are not limited thereto.
As shown in fig. 8, the data processing method performed by the apparatus 700 shown in fig. 7 may include operations S801 to S807.
Firstly, in operation S801, after the registry recording module 240 is triggered, the validity of the input parameters is checked, whether the parameter tables a and B are empty is checked, and the user has a mistake to exit (i.e. operation S807);
next, in operation S802, after the breakpoint re-lifting module 230 is triggered, it first checks whether the batch job re-lifting is a breakpoint, and if so, enters operation S230. If not, operation S803 is entered.
Then, in operation S803, the job type of the stopped batch job is detected based on the run time zone information in the automatic replenishment registration table of the stopped batch job.
Then, in operation S804, after the rerun tool is triggered, the current processing time point and the running status of each batch are obtained from the automatic rerun registry, different job groups of a certain batch in the registry may have multiple running statuses RUNSTAT (1-not running, 2-in running, 3-running completed), and the running status of the batch can be determined accordingly, the maximum STARTTIME (running completed) of all job groups with status 3 (running completed), the maximum STARTTIME (running) of all job groups with status 2, the minimum STARTTIME (running not) of all job groups with status 1 are obtained, and the running status of the whole batch can be determined according to the running status of each job group of the batch.
Then in operation S805: the job group operation is automatically submitted. Specifically, the running state of the previous job group of the second job to be run is checked. If the preceding work group is finished running and the preceding work group is not the daily cutting work group, the present work group is run, and the running state is registered as 2 (running). After delaying one minute, it is judged whether the operation is finished, and if the operation is finished, the operation state is registered as 3 (finished), and the operation start time suttime is registered. If the former operation group is a daily cutting operation group, an operator is prompted to trigger the daily end batch on the console, whether the scanning is finished at the end of the day or not is judged every minute, and the operation group is operated after the scanning is finished.
Thereafter, in operation S806, when the next STARTTIME of all lots is greater than the current system time and the operator answers "C", it is determined that the resubmission is all over.
To facilitate understanding of the technical solutions of the embodiments of the present disclosure, fig. 9 schematically illustrates a flowchart of a method performed by the breakpoint re-lifting module 230 in the apparatus 700 illustrated in fig. 7. It will be understood by those skilled in the art that the embodiments described below are merely examples, and the embodiments of the present disclosure are not limited thereto.
As shown in fig. 9, the method performed by the breakpoint re-lifting module 230 may include operations S901 to S906B.
In operation S901, a job group "running state" field in the automatic resubmission registry is scanned.
In operation S902, if the running status is not running, it is forwarded to the job group submission module 220 (operation S903A). If the running status is running, the job group running status is acquired from the job scheduling system running queue (operation S903B).
In operation S904, the current running status of the job group is obtained from the job scheduling system running queue, and it is determined whether the running of the job group is finished. After the operation is finished, the operation proceeds to operation S905
In operation S905, the workgroup operation monitoring module 250 monitors whether an error occurs in the operation process. If not, go to operation S906A; if so, operation S906B is entered. Wherein, in operation S906A: and normally finishing, and setting the running state of the operation group to be 3-run in the automatic supplementary submission registry. And in operation S906B, the transfer job group submission error processing module 210 processes.
To facilitate understanding of the technical solutions of the embodiments of the present disclosure, fig. 10 schematically illustrates a flowchart of a method performed by the job group submission module 220 in the apparatus 700 illustrated in fig. 7. It will be understood by those skilled in the art that the embodiments described below are merely examples, and the embodiments of the present disclosure are not limited thereto.
As shown in fig. 10, the job group submission module 220 may perform operations S1001 through S1005.
In operation S1001, a "running status" field of a job group in the automatic supplementary registration table is scanned, a previous job group is scanned for an unexecuted job group, and if the previous job group is unexecuted or running, the previous job group is waited for 1 minute and is rescanned.
In operation S1002, if the previous job group running status is completed (i.e., 3-run end), the job group is submitted and the job group running monitoring module 250 is entered.
In operation S1003, obtaining a current running status of the job group from the job scheduling system running queue, determining whether the running of the job group is finished, and if the running of the job group is not finished, continuing to obtain the running status of the job group from the job scheduling system queue; if the job group is not running or is in running, operation S1001 is performed while waiting for 1 minute (operation S1006) in return.
In operation S1004, it is determined whether the operation is in error. If the error occurs, the error processing module is transferred for processing. If there is no error, operation S1005 is entered.
In operation S1005, the operation ends normally, and the running status of the job group is set to 3-run in the automatic resubmission registry.
To facilitate understanding of the technical solutions of the embodiments of the present disclosure, fig. 11 schematically illustrates a flowchart of a method performed by the operation monitoring module 250 of the job group in the apparatus 700 illustrated in fig. 7. It will be understood by those skilled in the art that the embodiments described below are merely examples, and the embodiments of the present disclosure are not limited thereto.
As shown in fig. 11, the job group operation monitoring module 250 may perform operations S1102 to S1104.
In operation S1102, a job scheduling system run queue is scanned, from which a run status of a submitted job group is obtained.
In operation S1103, if the running status is not finished, the job scheduling system is re-visited to acquire the running status at an interval of 30 seconds (i.e., operation S1102).
In operation S1104, if the execution status is ended, the job group execution end information is returned to the caller.
To facilitate understanding of the technical solution of the embodiments of the present disclosure, fig. 12 schematically illustrates a flowchart of a method performed by the registry recording module 240 in the apparatus 700 illustrated in fig. 7. It will be understood by those skilled in the art that the embodiments described below are merely examples, and the embodiments of the present disclosure are not limited thereto.
As shown in fig. 12, the registry recording module 240 may perform operations S1201 to S1204.
In operation S1201, it is determined whether a breakpoint re-fetch is performed. If so, the break point re-fetch module processes (operation S1206). If not, operation S1203 is entered.
In operation S1203, the automatic supplementary registration table is cleared.
In operation S1204, the parameter tables a and B are scanned and their running times in the system running time zone are calculated.
In operation S1205, the automatic resubmission registry is registered, and each job group running state is set to not run.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be implemented at least partly as a computer program module, which when executed, may perform a corresponding function.
For example, any of the job group submission error processing module 210, the job group submission module 220, the breakpoint re-submission module 230, the registry recording module 240, and the job group operation monitoring module 250 may be combined in one module to be implemented, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the job group submission error processing module 210, the job group submission module 220, the breakpoint re-submission module 230, the registry recording module 240, and the job group operation monitoring module 250 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware, and firmware, or in any suitable combination of any of them. Alternatively, at least one of the job group submission error handling module 210, the job group submission module 220, the breakpoint restatement module 230, the registry record module 240, and the job group operation monitoring module 250 may be implemented at least in part as a computer program module that, when executed, may perform a corresponding function.
Fig. 13 schematically shows a block diagram of a data processing system 1300 applied to a centralized multi-time zone system according to yet another embodiment of the present disclosure. The data processing system 1300 shown in FIG. 13 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present disclosure.
As shown in fig. 13, a data processing system 1300 according to an embodiment of the present disclosure includes a processor 1301 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1302 or a program loaded from a storage section 1308 into a Random Access Memory (RAM) 1303. The processor 1301 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or related chip sets and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 1301 may also include onboard memory for caching purposes. Processor 1301 may include a single processing unit or multiple processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
In the RAM 1303, various programs and data necessary for the operation of the system 1300 are stored. The processor 1301, the ROM 1302, and the RAM 1303 are connected to each other via a bus 1304. The processor 1301 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 1302 and/or the RAM 1303. Note that the programs may also be stored in one or more memories other than the ROM 1302 and RAM 1303. The processor 1301 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
In accordance with an embodiment of the present disclosure, system 1300 may also include an input/output (I/O) interface 1305, which is also connected to bus 1304. The system 1300 may also include one or more of the following components connected to the I/O interface 1305: an input portion 1306 including a keyboard, a mouse, and the like; an output portion 1307 including a signal such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 1308 including a hard disk and the like; and a communication section 1309 including a network interface card such as a LAN card, a modem, or the like. The communication section 1309 performs communication processing via a network such as the internet. The drive 1310 is also connected to the I/O interface 1305 as needed. A removable medium 1311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1310 as necessary, so that a computer program read out therefrom is mounted into the storage portion 1308 as necessary.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via communications component 1309 and/or installed from removable media 1311. The computer program, when executed by the processor 1301, performs the functions defined in the system of the embodiments of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include one or more memories other than the ROM 1302 and/or the RAM 1303 and/or the ROM 1302 and the RAM 1303 described above.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It will be appreciated by those skilled in the art that various combinations and/or combinations of the features recited in the various embodiments of the disclosure and/or the claims may be made even if such combinations or combinations are not explicitly recited in the disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments of the present disclosure and/or the claims may be made without departing from the spirit and teachings of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims (9)

1. A data processing method applied to a centralized multi-time zone system comprises the following steps:
recording an automatic replenishment registration table of a first batch job while the first batch job runs, wherein the automatic replenishment registration table records the running state and running time zone information of each job; the operation time zone information includes: the offset amount of the day-to-day time of the time zone in which each job is located with respect to the zero point of the predetermined area, and the offset amount of the day-to-day time of each job with respect to the time zone in which the job is located;
in response to detecting that a first batch operation running in the centralized multi-time zone system is stopped, determining a breakpoint of the first batch operation; wherein the breakpoint comprises a first operation in the first batch operation when the first batch operation is stopped;
submitting the first batch operation; and
continuing to process the first batch job from the breakpoint comprises: determining a submission time of each job with respect to the predetermined region among the first job and other jobs subsequent to the first job based on the run time zone information of each job, and determining a job type of each job according to the submission time; and processing each job based on its job type; wherein the job type includes one of a daily cutting job, a daily ending job, and a daytime job.
2. The method of claim 1, wherein the resuming processing of the first batch job from the breakpoint comprises:
reprocessing the first job; and
processing other jobs subsequent to the first job.
3. The method of claim 2, wherein the operational state comprises one of not operational, and end of operational;
the determining the breakpoint of the first batch of jobs comprises: and determining the breakpoint based on the running state in the automatic supplementary submission registry.
4. The method of claim 1, wherein said processing said each job based on a job type of said each job comprises:
checking an operation state of a preceding job, wherein the preceding job is a job immediately preceding a second job to be executed;
if the running state of the previous job is running end and the previous job does not belong to daily cutting job, running the second job, and recording the running state of the second job as running in the automatic supplementary submission registry;
after a predetermined time, determining whether the second job is finished running; and
and if the second operation is finished, recording the running state of the second operation as the running end in the automatic supplementary submission registry.
5. The method of claim 4, wherein said processing said each job based on a job type of said each job further comprises:
if the operation of the previous operation is finished and the previous operation belongs to the daily cutting operation, triggering the operation of the daily ending operation associated with the daily cutting operation; and
and after the operation of the day end operation is finished, operating the second operation.
6. A data processing apparatus for use in a centralized multi-time zone system, comprising:
the system comprises a registration form recording module, a registration form updating module and a time zone updating module, wherein the registration form recording module is used for recording an automatic replenishment registration form of a first batch job while the first batch job runs, and the automatic replenishment registration form records the running state and the running time zone information of each job; the operation time zone information includes: the offset amount of the day-to-day time of the time zone in which each job is located with respect to the zero point of the predetermined area, and the offset amount of the day-to-day time of each job with respect to the time zone in which the job is located;
the operation group submission error processing module is used for responding to the detection that the first batch operation running in the centralized multi-time zone system stops working and determining a breakpoint of the first batch operation; wherein the breakpoint comprises a first operation in the first batch operation when the first batch operation is stopped;
the job group submitting module is used for submitting the first batch jobs; and
a breakpoint resubmission module, configured to continue processing the first batch of jobs from the breakpoint, including: determining a submission time of each job with respect to the predetermined region among the first job and other jobs subsequent to the first job based on the run time zone information of each job, and determining a job type of each job according to the submission time; and processing each job based on its job type; wherein the job type includes one of a daily cutting job, a daily ending job, and a daytime job.
7. The apparatus of claim 6, wherein:
the breakpoint re-extraction module is further configured to determine the breakpoint based on the running state in the automatic re-extraction registry, where the running state includes one of non-running, and running end.
8. A data processing system for use in a centralized multi-time zone system, comprising:
a memory having computer-executable instructions stored thereon; and
a processor executing the instructions to implement the method according to any one of claims 1 to 5.
9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 5.
CN201910665507.1A 2019-07-22 2019-07-22 Data processing method and device applied to centralized multi-time zone system Active CN110362419B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910665507.1A CN110362419B (en) 2019-07-22 2019-07-22 Data processing method and device applied to centralized multi-time zone system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910665507.1A CN110362419B (en) 2019-07-22 2019-07-22 Data processing method and device applied to centralized multi-time zone system

Publications (2)

Publication Number Publication Date
CN110362419A CN110362419A (en) 2019-10-22
CN110362419B true CN110362419B (en) 2023-04-07

Family

ID=68221326

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910665507.1A Active CN110362419B (en) 2019-07-22 2019-07-22 Data processing method and device applied to centralized multi-time zone system

Country Status (1)

Country Link
CN (1) CN110362419B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111078268B (en) * 2019-12-20 2023-06-06 中国建设银行股份有限公司 Bank system business processing method, device, equipment and storage medium
CN113205329A (en) * 2021-06-09 2021-08-03 中国银行股份有限公司 Timing day-cutting method and device based on distributed payment platform system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101256662A (en) * 2008-03-11 2008-09-03 中国工商银行股份有限公司 Processing system and method for implementing multiple time zone continuous service
CN104317960A (en) * 2014-11-14 2015-01-28 中国建设银行股份有限公司 Method and device for processing batch job

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5176558B2 (en) * 2008-01-17 2013-04-03 富士通株式会社 Distributed processing program, distributed processing apparatus, and distributed processing method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101256662A (en) * 2008-03-11 2008-09-03 中国工商银行股份有限公司 Processing system and method for implementing multiple time zone continuous service
CN104317960A (en) * 2014-11-14 2015-01-28 中国建设银行股份有限公司 Method and device for processing batch job

Also Published As

Publication number Publication date
CN110362419A (en) 2019-10-22

Similar Documents

Publication Publication Date Title
CN110362419B (en) Data processing method and device applied to centralized multi-time zone system
US8316373B2 (en) Concurrent data processing and electronic bookkeeping
CN112015713B (en) Database task processing method and device, electronic equipment and readable medium
EP3096279A1 (en) Resource transfer system
CN111198748A (en) Automatic approval method for business document process, electronic equipment, storage medium and system
CN108519920B (en) Scheduling retry method and device
US20180107396A1 (en) Tracking ownership of memory in a data processing system through use of a memory monitor
US20090158294A1 (en) Dynamic critical-path recalculation facility
CN111191925A (en) Data processing method, device, equipment and storage medium
CN112541810A (en) Risk handling method and device for business data and computer readable storage medium
CN112669151A (en) Method and equipment for processing multi-system cooperative service
JP2006215713A (en) Preceding work instruction and its cancellation method in workflow system
JP2020194433A (en) Vehicle management device, vehicle management program, and vehicle management method
JP7003328B2 (en) Identifier switching device, identifier switching program and identifier switching method
CN114285894B (en) Travel platform task processing method, device, equipment and medium
CN111028053B (en) Order processing method and device, electronic equipment and storage medium
RU2510528C2 (en) Request processing system, request processing method and computer-readable medium having request processing instructions
CN112712406A (en) Order processing method, device, equipment and computer readable storage medium
JP5277847B2 (en) Work management device, work management program
CN113867912A (en) Method and device for executing task, electronic equipment and readable storage medium
JP2878124B2 (en) Exclusive execution control method
CN114138564A (en) Fault processing method, processing device, electronic equipment and readable storage medium
CN117687899A (en) Automatic test method, device, terminal equipment and storage medium
CN118115232A (en) Order processing method, device and equipment
CN117592754A (en) Business data batch running method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant