CN104077362A - Online mass data processing system and method - Google Patents
Online mass data processing system and method Download PDFInfo
- Publication number
- CN104077362A CN104077362A CN201410252863.8A CN201410252863A CN104077362A CN 104077362 A CN104077362 A CN 104077362A CN 201410252863 A CN201410252863 A CN 201410252863A CN 104077362 A CN104077362 A CN 104077362A
- Authority
- CN
- China
- Prior art keywords
- service
- module
- transaction
- processing
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Development Economics (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Software Systems (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides an online mass data processing system and method. The system comprises a service registering and publishing module, a service dispatching module, a transaction multiplexing processing module and a service management module, wherein the service registering and publishing module is used for registering and supplying control parameter information for online mass processing service; the service dispatching module is used for processing the user data according to the control parameter information provided by the service registering and publishing module as well as generating the processing result; the transaction multiplexing processing module is used for setting multiplexing programs for online transaction and mass transaction by the code pre-compiling method and supplying to a mass transaction public communication area for initializing; the service management module is used for receiving the processing result generated by the service dispatching module and monitoring and managing the processing result. With the adoption of the online mass data processing system and method, the mass service processing process of a bank under the online state can be improved, the working efficiency of online mass bank service processing can be raised, the waste of system resource and labor intensity can be avoided, and the possibility of error and the time of waiting of a customer can be decreased.
Description
Technical field
The present invention relates to data processing field, in particular to a kind of online batch execution data system and method.
Background technology
In banking is processed, often there will be need to bank main on line state under carry out a large amount of repeat business service conditions (for example: batch processing deposit, withdraw the money, transfer accounts and the banking such as account inquiries), but, in current bank main system, on line state and batch processing business operate in respectively in different environment, cannot carry out multiplexing simultaneously, cause in the face of need to bank main on line state under the situation of re-treatment batch service, also re-treatment item by item, this processing mode not only needs to take for a long time on-line transaction resource, and transaction processing the limited time is interval in system day in the whole processing time in batches, practicality is poor.Cause thus the business processing efficiency of bank low, system resource and personnel labour's waste, and increased and repeat the possibility of makeing mistakes in transacting business process and client's stand-by period.
In the face of the competitive pressure being growing more intense, existing business processing efficiency is difficult to the batch service request of reply bank, be badly in need of to improve the in-line processing work efficiency of banking in batches, avoid system resource and personnel labour's waste, and reduce the possibility of makeing mistakes and client's stand-by period.
Summary of the invention
The object of the present invention is to provide a kind of system and method for online batch execution data, can realize online and concurrent multiplexing batch execution data, improve the in-line processing work efficiency of banking in batches, avoid system resource and personnel labour's waste, and reduce the possibility make mistakes and client's stand-by period.
On the one hand, the invention provides a kind of system of online batch execution data, described system comprises:
Service registry release module, for registering and provide control parameter information to online batch processing service;
Service dispatch module, for the described control parameter information providing according to described service registry release module, processes and generates result to user data;
Transaction multiplexing process module, the multiplexing program that on-line transaction is set and concludes the business in batches for the mode by precompile code, and the public communication district's initialization of concluding the business is in batches provided; And
Service management module, the described result generating for receiving described service dispatch module, and described result is carried out to monitoring management.
On the other hand, the invention provides a kind of method of online batch execution data, described method comprises:
S1, user registers online batch processing service by registration release module;
S2, user sends online batch processing requests to service dispatch module;
S3, described service dispatch module processes and generates result to user data, wherein, in the described process that user data is processed, need call transaction multiplexing process module and the multiplexing program of on-line transaction and transaction is in batches set and the public communication district's initialization of concluding the business is in batches provided;
S4, service management module receives and reads described result, and described result is carried out to monitoring management.
By adopting technical solution of the present invention, can realize online and concurrent multiplexing batch execution data, improve the flow process of batch processing business under the current on line state of bank, improve the in-line processing work efficiency of banking in batches, avoid system resource and personnel labour's waste, and reduce the possibility make mistakes and client's stand-by period.
Accompanying drawing explanation
Fig. 1 is the structural representation of the system of a kind of online batch execution data of the present invention;
Fig. 2 is the structural representation of service registry release module 100 described in system of the present invention;
Fig. 3 is the structural representation of service calling module 200 described in system of the present invention;
Fig. 4 is the structural representation of multiplexing process module 300 of concluding the business described in system of the present invention;
Fig. 5 is the structural representation of service management module 400 described in system of the present invention;
Fig. 6 is the process flow diagram of the method for a kind of online batch execution data of the present invention;
Fig. 7 is the process flow diagram of step S33 in the method for the invention.
Embodiment
For making object, technical scheme and the advantage of embodiments of the invention clearer, below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 is the structural representation of the system of a kind of online batch execution data of the present invention.Referring to Fig. 1, this device comprises:
Service registry release module 100, for registering and provide control parameter information to online batch processing service.The common data structures that the online batch processing service of this module definition (BSP service) is used and the common component that these data structures of operation are provided.
Service dispatch module 200, for the described control parameter information providing according to described service registry release module 100, processes and generates result to user data.This module is the nucleus module of described system, for user data is carried out to online batch processing.
Transaction multiplexing process module 300, the multiplexing program that on-line transaction is set and concludes the business in batches for the mode by precompile code, and the public communication district's initialization of concluding the business is in batches provided.This module is compiled as online, two versions of batch by a set of in-line procedures, and version is served for online batch processing in batches, and the program of two versions is used identical communication interface, and the public communication district function of initializing of concluding the business is in batches provided.
Service management module 400, the described result generating for receiving described service dispatch module 200, and described result is carried out to monitoring management.This module, after receiving the return message of online batch processing service dispatch module, provides ruuning situation monitoring, mistake processing, the continuous function of running of breakpoint.
Fig. 2 is the structural representation of service registry release module 100 described in system of the present invention.Referring to Fig. 2, this module comprises:
Registration release module 201, for registering and provide control parameter information to described online batch processing service.Wherein, need the parameter of registration to comprise: before the on-line transaction code of BSP service multiplexing, BSP/in/last handling process, BSP service errorlevel etc.
BSP controls the structure explanation that parameter sees table the BSP parameter control table SCTBSPC in the BSP service registry shown in 1 and release management:
Table 1
Data definition package module 202, for defining and operate encapsulation to the transaction data common structure of described online batch processing service.Wherein, BSP transaction data table, for depositing the pending transaction data of particular B SP service, is generally the corresponding BSP transaction data table of every class BSP service.Because the class of business that each online bulk service is processed is different, there is BSP transaction data table separately in capital, for convenience of unified, process, extract a public data structure SCROBDTL, the structure of all BSP transaction data tables must be consistent with this common data structures, and based on one group of public operation of this construction packages (increase/delete/change/look into), when deal with data, first the data of each BSP transaction data table are read in SCROBDTL, then call the processing of the data of having concluded the business in batches.Shown in table 2 structure of SCROBDTL, referring to as follows:
Table 2
In the process of batch processing, monitor for the convenience of the user BSP result and technically realize that breakpoint is continuous to be run, need to record the total stroke count for the treatment of state, executive logging, the failure/successful stroke count of process before, during and after BSP, the batch of user's input is controlled parameter, therefore, need to increase BSP state control table SCTBBTL and increase the increasing of this control table/delete/change/look into operation encapsulation.Shown in table 3 organization definition of SCTBBTL, referring to as follows:
Table 3
Fig. 3 is the structural representation of service calling module 200 described in system of the present invention.Referring to Fig. 3, described service calling module 200 comprises:
Service starts module 201, for starting described online batch processing service.BSP service startup is divided into 2 steps:
First, BSP service operation state initialization: operation first if, BSP service code, lot type, the batch number of sending into according to on-line transaction reads BSP service registry information, in BSP running status control table SCTBBTL, write a record, this BSP service is carried out to initialization, comprise: submitting a most end LSN last time of Start Date, start time, Close Date, end time, BSP to, successfully processing stroke count, failed stroke count is zero, and before, during and after initialization BSP, the treatment state of process is set to Pending.Again submit if (continuous race) to, the service code of sending into according to on-line transaction, lot type and batch number read corresponding BSP running state information from SCTBBTL, the completion status of process before, during and after judgement BSP, passes to step 2 by uncompleted process step (state of process step is ' Error ', ' Pending ' or space) and carries out batch jobs assembling;
Then, the operation of BSP service processing is assembled and is submitted to: the BSP process of obtaining according to previous step, BSP parameter, assembled JCL file, in the following example shown in:
It should be noted that, before BSP/in/rear process takes from BSP control information table.The process that only enrollment status is " Pending " or " Error " or space in SCTBBTL just can appear in assembled JCL file, if certain process is successful execution, job step corresponding to this process there will not be in the job file generating when repeating to submit to, as: if success (the process step state in SCTBBTL is Finish) of process GEN_PROC before BSP, assembled procedure segment is as follows:
Process in // EXEC PROC=BSP
// IF(RC<8)THEN
Process after // EXEC PROC=BSP
// ENDIF
The API SPOOLWRITE that calling CICS provides writes assembled JCL the SPOOL file of JES2, and it is pending that batch jobs are committed to JES2 etc., the finishing dealing with of online part.
Service processing module 202, for moving the processing procedure of described online batch processing service.This module is for the treatment of BSP service process, BSP service processing process is divided into 3 processes before, during and after BSP, before BSP, process is responsible for pending Data Segmentation to become the single transaction data of energy independent processing in business, and data are write in BSP transaction data table, in BSP, process is responsible for calling batch processing service single business datum is processed, after BSP, process is responsible for result to feed back, as goes out form prompting user.
Fig. 4 is the structural representation of multiplexing process module 300 of concluding the business described in system of the present invention, and described transaction multiplexing process module 300 comprises:
Transaction Multiplexing module 301, the multiplexing program that on-line transaction is set and concludes the business in batches for the mode by precompile code;
Transaction initiation module 302, for providing the public communication district's initialization of concluding the business in batches.
Described transaction Multiplexing module 301, by precompile instruction, is realized the multiplexing of program version, and developer only need develop a set of program, can compile out online, two parts of different executable codes of batch.Precompile instruction to realize principle as follows: precompile operation arranges compiling type parameter: ONL (online) and BAT (in batches), program is when precompile, use respectively each compiling of ONL and BAT parameter once, wherein ONL parameter converts program to the source code of online version, and BAT parameter converts program to the in batches source code of version; Program, through precompile, can be used the COBOL compiler of standard by online, to become executable code with the compilation of source code of batch version respectively.
1. precompile instruction encapsulates the call method of program by " EXEC IBS CALL " order:
1) if precompiler type parameter is appointed as ONL, precompiler result is:
CALL program name USING DFHEIBLK communication district
2) if precompiler type parameter is appointed as BAT, precompiler result is:
CALL program name USING communication district
3) for the precompile type of ONL, precompile instruction, in routine call, adds that the data structure DFHEIBLK of CICS definition is as first parameter in communication district automatically.
2. precompile instruction is printed and is encapsulated daily record by " TRC " order
TRC log content
1) for the precompile type of ONL, precompile instruction, when TRC is changed, converts thereof into the order of writing the interim storage queue of CICS (TSQ):
2) for the precompile type of BAT, precompile instruction, when TRC is changed, converts thereof into DISPLAY statement:
DISPLAY log content
// * log content can output to * in the SYSOUT file of batch jobs //
The present invention has realized the Service control attribute of the multiplexing on-line transaction of concluding the business in batches and input, outgoing message.Completely multiplexing for realizing, this discovery has realized the completely multiplexing of following two communication plot structures:
1. on-line transaction and the public communication plot structure of concluding the business are in batches multiplexing
1). when the transaction of banking system moves, capital is a public memory field of transaction application in system, the entry program of transaction and the program of subsequent calls can share this memory field as exchanges data, and the public communication district that typically concludes the business comprises: the parts such as return message district of system data and time, the transaction when version of message interface, message protocol, transaction code, attribute information that transaction is relevant, type of transaction, class of business, transaction teller, transaction terminal, transaction.The mode that the present invention adopts on-line transaction to generate public communication district generates the public communication district of transaction in batches.
2). distinguish for the convenience of the user transaction and on-line transaction in batches, when generating the public communication district of transaction in batches, teller is set to system teller, type of transaction is transaction in batches, transaction terminal is set to special value, as " BSP00001 ", to be different from on-line transaction, remainder is all with online consistent.
2. on-line transaction and in batches transaction input, outgoing message structure are multiplexing
For any one transaction, there is a set of transaction to control parameter, control the entry program of given transaction in parameter, the I/O message COPYBOOK of transaction, system is resolved incoming message according to the COPYBOOK of parameter appointment, and is sent to entry program and processes.For realizing online and in batches completely multiplexing, the present invention makes control aspect following 4:
1). when data being write to BSP transaction data table, specify the batch transaction code of calling identical with on-line transaction code; When bulk service starts, will read transaction according to transaction code and control parameter, and obtain the I/O message structure of transaction, and resolve I/O message with this;
2). in assembling, in batches during the incoming message of transaction, use with on-line transaction and input the data structure that COPYBOOK is the same, to guarantee incoming message that this is concluded the business in batches and in full accord when online;
3). transaction and on-line transaction are used identical transaction code in batches, share a set of transaction and control parameter, comprise the COPYBOOK of input, outgoing message;
4). precompile instruction is when being compiled into batch program by in-line procedures, and the transaction interface of in-line procedures and batch program is identical.
Fig. 5 is the structural representation of service management module 400 described in system of the present invention.Referring to Fig. 5, described service management module 400 comprises:
Mis-classification processing module 401, the described result generating for receiving described service dispatch module 200, and described result is carried out to monitoring management, the error result in described result is classified and processed.This module is the sensitivity to service error according to user, can be determined in process sheet transaction generation application error, to end in BSP or continuous business is processed by user.For realizing, different wrong classification are processed, errorlevel are divided into 3 classes (each error message code must correspondence wherein a class):
The first kind: W class-prompting category information, do not affect the execution of transaction, only, as prompting user, do not affect the processing of transaction;
Equations of The Second Kind: E class-application class mistake, as not enough in account balance, amount is abnormal etc., current trading suspension, but do not affect the processing with batch other transaction;
The 3rd class: S class-system-level errors, be generally database extremely or other system mistake, All Activity is processed and is all ended.
User can be by safeguarding that BSP controls the errorlevel that parameter list SCTBSPC field ERROR_FLG arranges BSP flexibly, and this field has two value E and S.Wherein, E represents if when BSP single transaction runs into application class mistake or system-level errors, in whole BSP the processing of process with regard to abort until error and solution just can heavily run; S represents only in generation systems staging error, just to end processing in batches, and application class mistake does not affect the continuation of BSP service to be carried out, and therefore, for preventing from omitting related service, needs wrong form and monitoring function prompting user.
Wherein, BSP service processes to wrong classification the three kinds of situations that are also divided into:
1.BSP main control logic reports an error: if BSP service has moved or the relevant information of BSP service is unregistered in BSP control table SCTBSPC, BSP service is directly returned, and transaction is not processed, and other mistakes are all to report an error to return, whole BSP service processing failure.
The forward and backward process of 2.BSP is processed and is reported an error: with BSP main control logic, report an error, directly report an error and return.
In 3.BSP, process single transaction processing reports an error: the value for the ERROR_FLG in BSP Service controll parameter S CTBSPC is processed respectively as follows:
1) application layer mistake (be set to Error in SCTBSPC, transaction run into E class or the equal throw exception of S class mistake, abort process) if:
A. the rollback Rollback that concludes the business, the operation of doing before rollback (but before comprising normal process the data of not submitting to);
B. upgrading process treatment state in the BSP in BSP service state table SCTBBTL is Error
C. the recording processing state upgrading in BSP transaction data table is Error;
D. submit the modification COMMIT making to, program directly exits, and finishes the processing of BSP.
2) system-level errors (being set to System in SCTBSPC) if: wherein, the application class mistake if transaction is dished out:
A.BSP serves the on-line transaction rollback of current operation;
B. the treatment state that upgrades respective record in BSP transaction data table is Error, and subsidiary error message is described;
C. upgrade and submit database to;
D. continue other data in treatments B SP transaction data table.
In addition, if transaction jettison system staging error, the on-line transaction of the current operation wrong System Error that directly dishes out, exchange makes an amendment Rollback, and in whole BSP, process is processed and is directly exited, and program exception is ended.
3) normal if, the result of revising current record is Normal, continues to process next record record.
Operation monitoring module 402, for reading the running status of described online batch processing service, inquires about described result.User initiates after BSP service processing, and transaction is in backstage asynchronous operation in batches, and result can not return to on-line transaction, and therefore the monitoring mechanism of batch transaction processing situation and result must be provided.The present invention realizes the monitoring mechanism of the batch transaction of online initiation in the following manner:
1. initiate after on-line transaction, on-line transaction picture returns to corresponding " SERV CODE (service code) ", " AP TYPE (lot type) ", " AP BATNO (batch sequence number) ", and user can preserve this transaction picture in order to the result of inquiry batch processing;
2. user's input is in inquiry transaction input " SERV CODE ", " AP TYPE " provided by the invention, " AP BATNO " inquiry batch processing result;
3. according to " SERV CODE ", " AP TYPE ", " AP BATNO " inquiry BSP treatment state table SCTBBTL, obtain the ruuning situation of process before, during and after batch processing BSP;
4. when needs are inquired about BSP single transaction processing situation:
1) according to " SERV CODE " inquiry BSP parametrization, control (SCTBSPC) table, obtain corresponding BSP transaction data table, processing components and transaction code;
2) according to " SERV CODE ", " AP TYPE ", " AP BATNO ", in BSP transaction data table, inquire about the information such as the treatment state of concluding the business, return message, incoming message, outgoing message.
5., if user inquires about transaction message detail, carry out following steps:
1) according to transaction code inquiry transaction, control parameter list, obtain this corresponding input of concluding the business, the COPYBOOK of outgoing message;
2) use input COPYBOOK to resolve incoming message, use output COPYBOOK outgoing message to be resolved and showed user.
It should be noted that, operation monitoring module 402 is nonessential module.If user does not need the result of real-time query BSP service, can, by a day whole report query, also can not use this module.If user need to enable the continuous module 403 of running of BSP breakpoint, this module must be enabled.
The continuous module 403 of running of breakpoint, in the situation that abnormal interruption occurs in described online batch processing service, proceeds the processing of transaction data from the position of described abnormal interruption.3 processes before, during and after BSP processing procedure is generally divided into likely make a mistake and cause batch processing abort in the processing of each process, and realize, breakpoint is continuous to be run, and the present invention will do differentiated treatment to following two kinds of situations:
The continuous race of breakpoint in each stage of 1.BSP
1) when BSP starts to process, process corresponding to each stage of BSP is first initialized as to Pending (waiting pending) state, whenever normally completing a process, revising corresponding state is Finish (finishing dealing with), if certain process is processed, make mistakes, this status of processes is set to Error (processing abnormal).
2) after the online submission BSP service of user, system can be informed user this time service code, lot type and the batch number of BSP after in-line processing partly completes, and user will inquire about the ruuning situation of BSP accordingly;
3) when finding that BSP processes when abnormal, user can submit to again according to the service code providing, lot type and batch number.System will check this BSP service each status of processes in SCTBBTL, if find certain process, normally carry out (state is Finish), in the JCL operation generating, do not comprise this process step, if the state of discovery procedure is Error or Pending or does not carry out, this job step is write in the JCL file of generation, this step can re-execute.
In 2.BSP service, the breakpoint of process is continuous runs
1) by parametrization, configure the stroke count of submitting transaction to can be set, BSP can realize segmentation and submit to, after single transaction is submitted to, the state of revising the pending record of corresponding BSP is NORMAL or ERROR, and the value of upgrading LS_BAT_NO in SCTBBTL is for submitting the sub-sequence number that record is corresponding to;
2) in BSP service, process occurs after mistake, the state of revising error log in the pending record sheet of BSP is ERROR, if ERROR_FLG is set to System in BSP Service controll parameter S CTBSPC, BSP continues down to carry out, Error, ends the processing of whole BSP service if;
3) user can inquire about the disposition of process detail record in BSP service by monitoring trading, if find mistake, can repeat to submit to after misdata to be repaired;
4) user is online while repeating to submit to, and during assembled JCL job file, in this BSP service of program checkout SCTBBTL, status of processes is ERROR, process in this BSP is write in assembled JCL file;
5) when process starts to process untreated record the in the pending record sheet of BSP in BSP service, can check the LS_BAT_NO registering in BSP Service controll parameter S CTBBTL, then directly from next beginning of LS_BAT_NO, process one by one pending record.
It should be noted that, the continuous race of breakpoint module 403 is nonessential module.User can be by the transaction of operation monitoring module 402 query processing failures, and then manual follow-up is processed.
Fig. 6 is the process flow diagram of the method for a kind of online batch execution data of the present invention.Referring to Fig. 6, described method comprises:
S1, user registers online batch processing service by registration release module, and log-on message comprises: the on-line transaction information that BSP service is used, the tables of data information that BSP service is used are, the data process of BSP service be thanks, BSP errorlevel information etc.Online batch processing service for each type all only needs registration once, reusable.
S2, user sends online batch processing requests to service dispatch module, and user can input lot type and the batch number of the online batch processing service that needs execution by on-line transaction, initiate online batch processing requests.
S3, described service dispatch module processes and generates result to user data, wherein, in the described process that user data is processed, need call transaction multiplexing process module and the multiplexing program of on-line transaction and transaction is in batches set and the public communication district's initialization of concluding the business is in batches provided.
S4, service management module receives and reads described result, and described result is carried out to monitoring management.
Wherein, described step S3 can further include:
S31, described service dispatch module is received after described online batch processing requests, calls described registration release module and reads control parameter information, described control parameter information can be with reference to the above argument structure explanation of table 1.
S32, described service dispatch module starts described online batch processing service (BSP service).The startup of BSP service is divided into 2 steps: first, BSP service operation state initialization: operation first if, the BSP service code of sending into according to on-line transaction, lot type, batch number reads BSP service registry information, in BSP running status control table SCTBBTL, write a record, this BSP service is carried out to initialization, comprise: Start Date, start time, Close Date, end time, submitted a most end LSN last time of BSP to, stroke count is processed in success, failure stroke count is zero, the treatment state of initialization BSP service process is set to Pending, again submit if (continuous race) to, the service code of sending into according to on-line transaction, lot type and batch number read corresponding BSP running state information from SCTBBTL, the completion status of judgement BSP service process, passes to BSP service request steps by uncompleted process step (state of process step is ' Error ', ' Pending ' or space) and carries out batch jobs assembling, then, the operation of BSP service processing is assembled and is submitted to.
S33, the processing procedure of the described online batch processing service of described service dispatch module operation, wherein, described processing procedure need be called transaction multiplexing process module, the multiplexing program of on-line transaction and transaction is in batches set and the public communication district's initialization of concluding the business is in batches provided.Referring to Fig. 7, described step S33 further comprises the steps:
S331, process before BSP service processing: the single transaction data that pending described user data is split into energy independent processing, this process is carried out pre-service as the preparation process of processing procedure to pending data upload main frame, and single transaction data is write to BSP transaction SCTBBTL tables of data production BSP transaction data, if data write successfully, front process status is set to Finish; If data write failure, front process status is set to Error, mistake is returned in operation, and in follow-up BSP service processing, after process and BSP service processing, process will no longer be carried out.
S332, process in BSP service processing: call described transaction multiplexing process module and complete the conclude the business initialization in public communication district of described batch, call precompiler batch program result is processed and generated to described single transaction data.In renewal BSP service processing, the start time of process and the running status of BSP service are Pending, submit the current operation of all modifications to database to, and call transaction in batches and carry out following steps by pen processing transaction data:
Data behaviour package assembling LS_BAT_NO position from SCTBBTL of A. calling SCTBSPC appointment starts to read successively BSP transaction data;
If B. this transaction is treated (stateful transaction is Error or Normal), continues next record and process;
C. generate the public communication district of transaction in batches, comprise the information such as Transaction Identification Number, exchange hour, trade date, transaction terminal;
D. the incoming message district to the on-line transaction (RUN_CMP_NAME) of appointment in BSP Service controll parameter S CTBSPC by this BSP transaction data assignment;
E. call transaction in batches and carry out the processing of this transaction;
If F. this transaction normal termination, the treatment state that upgrades this BSP transaction data is Normal;
If G. this transaction makes a mistake, need to carry out rollback, and the treatment state that upgrades this transaction after rollback is Error.If the errorlevel of BSP service is S, and there is not other mistake of S level in this transaction, continues the processing of next record transaction; If the errorlevel of BSP is E, whole BSP processes and ends, and upgrading status of processes in this BSP is Error, and the state that upgrades current treatments B SP transaction data is Error;
If the record in BSP transaction data table is all finished dealing with, finish this batch processing, upgrading in whole SCTBBTL tables of data status of processes in this BSP is Finish, otherwise, continue to process next record transaction.
S333, process after BSP service processing: obtain described result and generate result form.This process, as the subsequent step of BSP service processing, is processed result, as goes out form prompting user, to facilitate user's processing of following up.
In addition, in the process flow diagram shown in Fig. 6, described step S4 also further comprises the steps:
S41, receives the described result that described service dispatch module generates, and described result is carried out to monitoring management, and the error result in described result is classified and processed; Or
S42, reads the running status of described online batch processing service, inquires about described result;
S43, in the situation that abnormal interruption occurs in described online batch processing service, proceeds the processing of transaction data from the position of described abnormal interruption.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode of software combined with hardware platform, can certainly all by hardware, implement.Understanding based on such, what technical scheme of the present invention contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out the method described in some part of each embodiment of the present invention or embodiment.
Above disclosed is only the preferred embodiments of the present invention; certainly can not limit protection scope of the present invention with this; therefore the equivalent variations of according to the instruction of the claims in the present invention, above-described embodiment being done, still belongs in the scope that the claims in the present invention contain.
Claims (10)
1. a system for online batch execution data, is characterized in that, described system comprises:
Service registry release module, for registering and provide control parameter information to online batch processing service;
Service dispatch module, for the described control parameter information providing according to described service registry release module, processes and generates result to user data;
Transaction multiplexing process module, the multiplexing program that on-line transaction is set and concludes the business in batches for the mode by precompile code, and the public communication district's initialization of concluding the business is in batches provided; And
Service management module, the described result generating for receiving and read described service dispatch module, and described result is carried out to monitoring management.
2. system as claimed in claim 1, is characterized in that, described service registry release module comprises:
Registration release module, for registering and provide control parameter information to described online batch processing service;
Data definition package module, for defining and operate encapsulation to the transaction data common structure of described online batch processing service.
3. system as claimed in claim 1, is characterized in that, described service calling module comprises:
Service starts module, for starting described online batch processing service;
Service processing module, for moving the processing procedure of described online batch processing service.
4. system as claimed in claim 1, is characterized in that, described transaction multiplexing process module also comprises:
Transaction Multiplexing module, the multiplexing program that on-line transaction is set and concludes the business in batches for the mode by precompile code;
Transaction initiation module, for providing the initialization in the public communication district that concludes the business in batches.
5. system as claimed in claim 1, is characterized in that, described service management module also comprises:
Mis-classification processing module, the described result generating for receiving described service dispatch module, and described result is carried out to monitoring management, the error result in described result is classified and processed.
6. system as claimed in claim 5, is characterized in that, described service management module also comprises:
Operation monitoring module, for reading the running status of described online batch processing service, inquires about described result;
The continuous module of running of breakpoint, in the situation that abnormal interruption occurs in described online batch processing service, proceeds the processing of transaction data from the position of described abnormal interruption.
7. a method for online batch execution data, is characterized in that, described method comprises the steps:
S1, user registers online batch processing service by registration release module;
S2, user sends online batch processing requests to service dispatch module;
S3, described service dispatch module processes and generates result to user data, wherein, in the described process that user data is processed, need call transaction multiplexing process module and the multiplexing program of on-line transaction and transaction is in batches set and the public communication district's initialization of concluding the business is in batches provided;
S4, service management module receives and reads described result, and described result is carried out to monitoring management.
8. method as claimed in claim 7, is characterized in that, described step S3 also comprises the steps:
S31, described service dispatch module is received after described online batch processing requests, calls described registration release module and reads control parameter information;
S32, described service dispatch module starts described online batch processing service;
S33, the processing procedure of the described online batch processing service of described service dispatch module operation, wherein, described processing procedure need be called transaction multiplexing process module, the multiplexing program of on-line transaction and transaction is in batches set and the public communication district's initialization of concluding the business is in batches provided.
9. method as claimed in claim 8, is characterized in that, described step S33 also comprises the steps:
S331, process before service processing: the single transaction data that pending described user data is split into energy independent processing;
S332, process in service processing: call described transaction multiplexing process module and complete the conclude the business initialization in public communication district of described batch, call precompiler batch program result is processed and generated to described single transaction data;
S333, process after service processing: obtain described result and generate result form.
10. method as claimed in claim 7, is characterized in that, described step S4 also comprises the steps:
S41, receives the described result that described service dispatch module generates, and described result is carried out to monitoring management, and the error result in described result is classified and processed; Or
S42, reads the running status of described online batch processing service, inquires about described result;
S43, in the situation that abnormal interruption occurs in described online batch processing service, proceeds the processing of transaction data from the position of described abnormal interruption.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410252863.8A CN104077362A (en) | 2014-06-09 | 2014-06-09 | Online mass data processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410252863.8A CN104077362A (en) | 2014-06-09 | 2014-06-09 | Online mass data processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104077362A true CN104077362A (en) | 2014-10-01 |
Family
ID=51598616
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410252863.8A Pending CN104077362A (en) | 2014-06-09 | 2014-06-09 | Online mass data processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104077362A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317660A (en) * | 2014-11-18 | 2015-01-28 | 中国建设银行股份有限公司 | Bank parameter managing system |
| CN105487924A (en) * | 2015-11-30 | 2016-04-13 | 中国建设银行股份有限公司 | Batch processing controlling method and device |
| CN106204263A (en) * | 2016-06-30 | 2016-12-07 | 中国农业银行股份有限公司 | Transaction progress control method and device |
| CN106293510A (en) * | 2016-07-21 | 2017-01-04 | 中国农业银行股份有限公司 | A kind of data sharing method towards MVS and system |
| CN107437222A (en) * | 2017-08-03 | 2017-12-05 | 中国银行股份有限公司 | The processing method and system of online business data based on bank counter front end |
| CN107679140A (en) * | 2017-09-25 | 2018-02-09 | 中国银行股份有限公司 | Document handling method and system |
| CN107909359A (en) * | 2017-11-21 | 2018-04-13 | 中国银行股份有限公司 | Batch calls the data processing method and device of on-line transaction common process mechanism |
| CN107943584A (en) * | 2017-11-15 | 2018-04-20 | 中国银行股份有限公司 | The processing method and processing device of batch transaction request |
| CN108765140A (en) * | 2018-06-20 | 2018-11-06 | 中国银行股份有限公司 | Batch service abnormality monitoring method and the first electronic equipment |
| CN110381106A (en) * | 2019-05-09 | 2019-10-25 | 中国银行股份有限公司 | A kind of job processing method and device |
| CN111984303A (en) * | 2020-08-20 | 2020-11-24 | 中国建设银行股份有限公司 | Transaction data processing method, device, equipment and storage medium |
| CN112131305A (en) * | 2020-06-19 | 2020-12-25 | 中信银行股份有限公司 | Account processing system |
| CN113313595A (en) * | 2021-06-25 | 2021-08-27 | 中国农业银行股份有限公司 | Transaction processing method, device, storage medium and product |
| CN114745442A (en) * | 2022-04-13 | 2022-07-12 | 中国银行股份有限公司 | On-line batch processing system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1710555A (en) * | 2004-06-18 | 2005-12-21 | 中国建设银行股份有限公司 | On-line processing system and method based on network |
| CN101000562A (en) * | 2006-12-30 | 2007-07-18 | 中国建设银行股份有限公司 | Method and device for executing batch processing job |
| CN101625749A (en) * | 2009-08-18 | 2010-01-13 | 交通银行股份有限公司 | Method, server and system for on-line batching data |
-
2014
- 2014-06-09 CN CN201410252863.8A patent/CN104077362A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1710555A (en) * | 2004-06-18 | 2005-12-21 | 中国建设银行股份有限公司 | On-line processing system and method based on network |
| CN101000562A (en) * | 2006-12-30 | 2007-07-18 | 中国建设银行股份有限公司 | Method and device for executing batch processing job |
| CN101625749A (en) * | 2009-08-18 | 2010-01-13 | 交通银行股份有限公司 | Method, server and system for on-line batching data |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317660B (en) * | 2014-11-18 | 2017-12-12 | 中国建设银行股份有限公司 | A kind of bank's parameter management system |
| CN104317660A (en) * | 2014-11-18 | 2015-01-28 | 中国建设银行股份有限公司 | Bank parameter managing system |
| CN105487924B (en) * | 2015-11-30 | 2018-12-14 | 中国建设银行股份有限公司 | A kind of batch processing control method and device |
| CN105487924A (en) * | 2015-11-30 | 2016-04-13 | 中国建设银行股份有限公司 | Batch processing controlling method and device |
| CN106204263B (en) * | 2016-06-30 | 2019-09-24 | 中国农业银行股份有限公司 | Transaction progress control method and device |
| CN106204263A (en) * | 2016-06-30 | 2016-12-07 | 中国农业银行股份有限公司 | Transaction progress control method and device |
| CN106293510A (en) * | 2016-07-21 | 2017-01-04 | 中国农业银行股份有限公司 | A kind of data sharing method towards MVS and system |
| CN106293510B (en) * | 2016-07-21 | 2019-06-18 | 中国农业银行股份有限公司 | A kind of data sharing method and system towards multiple virtual storage systems |
| CN107437222A (en) * | 2017-08-03 | 2017-12-05 | 中国银行股份有限公司 | The processing method and system of online business data based on bank counter front end |
| CN107679140A (en) * | 2017-09-25 | 2018-02-09 | 中国银行股份有限公司 | Document handling method and system |
| CN107679140B (en) * | 2017-09-25 | 2019-11-12 | 中国银行股份有限公司 | Document handling method and system |
| CN107943584A (en) * | 2017-11-15 | 2018-04-20 | 中国银行股份有限公司 | The processing method and processing device of batch transaction request |
| CN107909359A (en) * | 2017-11-21 | 2018-04-13 | 中国银行股份有限公司 | Batch calls the data processing method and device of on-line transaction common process mechanism |
| CN107909359B (en) * | 2017-11-21 | 2021-12-07 | 中国银行股份有限公司 | Data processing method and device for calling online transaction public processing mechanism in batch |
| CN108765140A (en) * | 2018-06-20 | 2018-11-06 | 中国银行股份有限公司 | Batch service abnormality monitoring method and the first electronic equipment |
| CN110381106A (en) * | 2019-05-09 | 2019-10-25 | 中国银行股份有限公司 | A kind of job processing method and device |
| CN112131305A (en) * | 2020-06-19 | 2020-12-25 | 中信银行股份有限公司 | Account processing system |
| CN111984303A (en) * | 2020-08-20 | 2020-11-24 | 中国建设银行股份有限公司 | Transaction data processing method, device, equipment and storage medium |
| CN113313595A (en) * | 2021-06-25 | 2021-08-27 | 中国农业银行股份有限公司 | Transaction processing method, device, storage medium and product |
| CN114745442A (en) * | 2022-04-13 | 2022-07-12 | 中国银行股份有限公司 | On-line batch processing system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104077362A (en) | Online mass data processing system and method | |
| US7472379B2 (en) | Flexible navigation of a workflow graph | |
| US5530848A (en) | System and method for implementing an interface between an external process and transaction processing system | |
| US5893128A (en) | Distributed work flow management | |
| CN110806933B (en) | Batch task processing method, device, equipment and storage medium | |
| US7895094B2 (en) | Global account reconciliation tool | |
| US20130145371A1 (en) | Batch processing of business objects | |
| US20070156487A1 (en) | Object model on workflow | |
| CN101577718B (en) | Multi-ebanking adaptive system | |
| JPH10124371A (en) | Method and system for transaction processing | |
| WO2013059797A1 (en) | Service based information technology platform | |
| CN111399897A (en) | Application issuing method and system based on kubernets | |
| WO2020000720A1 (en) | Server, packet processing method, program, and computer-readable storage medium | |
| US20080244064A1 (en) | Verifying method for implementing management software | |
| US20120030223A1 (en) | Extensibility of business process and application logic | |
| WO2019149032A1 (en) | Distributed transaction processing method and device | |
| CN109064311A (en) | Batch based on online mode is withholdd processing method and processing device | |
| KR100659971B1 (en) | System for aborting web services automatically and method of the same | |
| CN107038025B (en) | SOA architecture-based system calling method and device | |
| US9047144B2 (en) | System and method for providing Quality-of-Services in a multi-event processing environment | |
| CN112596871A (en) | Service processing method and device | |
| CN111459748A (en) | Operation and maintenance control method, system and device based on command control and storage medium | |
| CN103631594A (en) | Asynchronous scheduling method and asynchronous scheduling system for general flow | |
| US8495040B2 (en) | Systems and methods for providing an automated validity check of transactional data postings | |
| CN113298513A (en) | Method and system for processing payment request |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20141001 |