CN104407922A

CN104407922A - Asynchronous batch-processing dispatching method and system

Info

Publication number: CN104407922A
Application number: CN201410594848.1A
Authority: CN
Inventors: 伍辉; 吴泽童; 罗新仁; 周小伟
Original assignee: China Construction Bank Corp
Current assignee: China Construction Bank Corp
Priority date: 2014-10-29
Filing date: 2014-10-29
Publication date: 2015-03-11
Anticipated expiration: 2034-10-29
Also published as: CN104407922B

Abstract

The embodiment of the invention discloses an asynchronous batch-processing dispatching method, which comprises the following steps of receiving a batch-processing business request, and statistically calculating the transaction-processing data volume of batch-processing business; judging whether the transaction-processing data volume is greater than a data threshold value or not; if so, then analyzing the business type of asynchronous batch-processing business; when the asynchronous batch-processing business is analyzed as a real-time dispatching task according to the business type, carrying out real-time dispatching processing on the asynchronous batch-processing business; when the asynchronous batch-processing business is analyzed as an asynchronous dispatching task according to the business type, carrying out asynchronous dispatching processing on the asynchronous batch-processing business. By adopting the asynchronous batch-processing dispatching method, uniform batch-processing business developing frameworks are provided and are easy for developing extension, operation and maintenance, monitoring and exception processing, so that the batch-processing dispatching flexibility is improved; in addition, distribution processing is carried out according to different business types, and different business types can correspond to different task-processing ponds, so that the utilization rate of resources is effectively improved.

Description

A kind of asynchronous batch processing dispatching method and system

Technical field

The present invention relates to technical field of data processing, particularly relate to a kind of asynchronous batch processing dispatching method and system.

Background technology

Along with the fast development of banking, class of business, number of services also constantly increase thereupon, and core application system will face a large amount of batch processing services.Usually, user can be triggered in real time by terminal or electronic channel etc. and complete various financial business, as deposit at bank, withdraw the money, transfer accounts, inquiry into balance, common reserve fund collect, this kind of batch processing transaction processing time is short, the business datum occurred can enter host data base immediately, and the data of the above-mentioned business of data handling system batch processing are online batch processing services; Another asynchronous batch processing services, its business datum is to be processed and process, and transaction data amount is large, the processing time is long, as refund, bank settle interests, generate various accounting statements etc. automatically.

Current existing batch processing dispatching method, background system needs to carry out judging as on-line transaction process or asynchronous batch processing according to the size of business processing amount, and asynchronous batch processing and on-line transaction process disconnect completely, lack the management to online batch processing task, and asynchronous batch processing is all according to the pre-set batch processing logic of user, certain regular time section carry out batch processing scheduling of seeking unity of action, lack the dirigibility of scheduling.

Summary of the invention

Embodiment of the present invention technical matters to be solved is, a kind of asynchronous batch processing dispatching method and system are provided, unified batch processing services Development Framework is provided, be easy to exploitation expansion, O&M, monitoring and abnormality processing, solve the problem that batch processing in prior art lacks dispatching flexibility, carry out distribution processor according to different service types in addition, the task treatment pond that different types of service can be corresponding different, effectively improves resource utilization.

In order to solve the problems of the technologies described above, embodiment of the present invention first aspect discloses a kind of asynchronous batch processing dispatching method, comprises

Receive batch processing services request, the transaction data amount of batch processing services described in statistical computation;

Judge whether described transaction data amount is greater than data gate limit value, if yes, then analyze the type of service of described asynchronous batch processing services;

When analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, Real-Time Scheduling process is carried out to described asynchronous batch processing services; When analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, asynchronous schedule process is carried out to described asynchronous batch processing services.

Embodiment of the present invention second aspect discloses a kind of asynchronous batch processing dispatching system, comprises

Receiver module, receives batch processing services request;

Computing module, for the transaction data amount of batch processing services described in statistical computation;

Judge module, for judging whether the described transaction data amount that described computing module calculates is greater than data gate limit value;

Asynchronous analysis module, for when described judge module exports as being, analyzes the type of service of described asynchronous batch processing services;

Real-Time Scheduling module, for when to analyze described asynchronous batch processing services be Real-Time Scheduling task to described asynchronous analysis module according to type of service, carries out Real-Time Scheduling process to described asynchronous batch processing services;

Asynchronous schedule module, for when to analyze described asynchronous batch processing services be asynchronous schedule task to asynchronous analysis module according to type of service, carries out asynchronous schedule process to described asynchronous batch processing services.

Implement the embodiment of the present invention, there is following beneficial effect:

By providing unified batch service Development Framework, be easy to exploitation expansion, O&M, monitoring and abnormality processing; Carry out distribution processor according to different task kind, the task treatment pond that different task kinds can be corresponding different, effectively improves resource utilization; The batch processing task time period is controlled, for the batch processing task that some are not high to requirement of real-time, by definition precontract task, task is placed on the operation of system idles period, there is the right to use of maximum resource peak period at real-time deal with safeguards system, for the batch service that some requirement of real times are higher, the control of time period can not be allowed by this, carry out Real-Time Scheduling.

Accompanying drawing explanation

In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

Fig. 1 is the schematic flow sheet of the asynchronous batch processing dispatching method that the embodiment of the present invention provides;

Fig. 2 is the schematic flow sheet of another embodiment of asynchronous batch processing dispatching method provided by the invention;

Fig. 3-1 is the schematic flow sheet of the Real-Time Scheduling task of the asynchronous batch processing dispatching method that the embodiment of the present invention provides;

Fig. 3-2 is schematic flow sheets of the asynchronous schedule task of the asynchronous batch processing dispatching method that the embodiment of the present invention provides;

Fig. 4 is the schematic flow sheet of the real-time scheduling method of the asynchronous batch processing dispatching method that the embodiment of the present invention provides;

Fig. 5 is the schematic flow sheet of the asynchronous schedule method of the asynchronous batch processing dispatching method that the embodiment of the present invention provides;

Fig. 6 is the schematic flow sheet of the appointment scheduling method of the asynchronous batch processing dispatching method that the embodiment of the present invention provides;

Fig. 7 is the asynchronous batch processing dispatching system schematic diagram that the embodiment of the present invention provides;

Fig. 8 is the batch processing dispatching system schematic diagram that the embodiment of the present invention provides;

Fig. 9 is the Real-Time Scheduling module diagram that the embodiment of the present invention provides;

Figure 10 is the asynchronous schedule module diagram that the embodiment of the present invention provides;

Figure 11 is the precontract task module diagram that the embodiment of the present invention provides.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

It should be noted that, the term used in embodiments of the present invention is only for the object describing specific embodiment, and not intended to be limiting the present invention." one ", " described " and " being somebody's turn to do " of the singulative used in the embodiment of the present invention and appended claims is also intended to comprise most form, unless context clearly represents other implications.It is also understood that term "and/or" used herein refer to and comprise one or more project of listing be associated any or all may combine.

See Fig. 1, be the schematic flow sheet of the asynchronous batch processing dispatching method that the embodiment of the present invention provides, the method comprises:

Step S100: receive batch processing services request, the transaction data amount of batch processing services described in statistical computation;

Particularly, receiving the request of batch processing services, can be the batch processing services that front-end equipment transmits, and also can be the batch processing services receiving other system transmission, also can be the online transaction triggered in real time by terminal or various electronic channel, carry out the process of various financial affairs;

Batch processing services including but not limited to various withhold pay, common reserve fund collects, converge pay, account is settled interests, register process, day the statement of account, produce various form, batch documents business, large message transmissions business, insurance company declaration form accepts, premium is continuously paid, Claims Resolution etc.;

The business characteristic of batch processing is: the business datum of (1) service request process is batch (many) business datum; (2) data source of business processing is not only single transaction data message, is likely data file.

Step S102: when judging that result that whether described transaction data amount be greater than data gate limit value is for being, then analyze the type of service of described asynchronous batch processing services;

Particularly, data gate limit value can be arranged according to one of following condition or mutual independent assortment: the type etc. processing the equipment performance of described batch processing services, the complexity of described batch processing services, the data volume of described batch processing services or described batch processing services, compares judgement by described transaction data amount and described data gate limit value.

When described transaction data amount is greater than described data gate limit value, registering described batch processing services is asynchronous batch processing services, and the trade context of described batch processing services is saved in database, and training in rotation scheduled for executing is carried out in asynchronous task scheduling master control by the time; The type of service of asynchronous batch processing is settled interests including but not limited to account, register, day the statement of account, common reserve fund converges and pays, produces various form, batch documents business, large message transmissions business etc.

Step S104: when analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, Real-Time Scheduling process is carried out to described asynchronous batch processing services; When analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, asynchronous schedule process is carried out to described asynchronous batch processing services;

Particularly, can pre-set register, produce the business such as various forms is Real-Time Scheduling task, can pre-set that account is settled interests, day the statement of account, common reserve fund converge pay, batch documents business, large message transmissions business etc. are asynchronous schedule task; The type of service of asynchronous batch processing services described in analytical procedure S102 is register when type of service or produce various form or other Real-Time Scheduling task types pre-set, then registering described asynchronous batch processing services is Real-Time Scheduling task; Described asynchronous batch processing transaction simulation, mainly for the business that business processing amount is fewer, can be become on-line transaction, support returning results of online wait asynchronous process by Real-Time Scheduling task; The type of service of asynchronous batch processing services described in analytical procedure S102, when type of service be account settle interests or day the statement of account or common reserve fund converge and pay or asynchronous schedule task type that other pre-set, then registering described asynchronous batch processing services is asynchronous schedule task; Described asynchronous batch processing services, mainly for the larger business of business processing amount, is stored in internal memory by asynchronous schedule task, and wait task scheduling primary control program carries out training in rotation inquiry and performs.

In addition, the process data volume of asynchronous batch processing services may be larger, processes meeting consuming time longer, and when processing, adopt asynchronous service processing mode, namely initiator gets out data and namely returns after trigger business process, and latency services process does not always terminate.

See Fig. 2, be the schematic flow sheet of another embodiment of asynchronous batch processing dispatching method provided by the invention, the method comprises:

Step S200: receive batch processing services request, the transaction data amount of batch processing services described in statistical computation;

Step S202: judge whether described transaction data amount is greater than data gate limit value;

Step S204: the type of service analyzing described asynchronous batch processing services;

Particularly, when step S202 judges that result that whether described transaction data amount be greater than data gate limit value is for being, registering described batch processing services is asynchronous batch processing services, the trade context of described batch processing services is saved in database, and training in rotation scheduled for executing is carried out in asynchronous task scheduling master control by the time; The type of service of asynchronous batch processing is settled interests including but not limited to account, register, day the statement of account, common reserve fund converges and pays, produces various form, batch documents business, large message transmissions business etc.

Step S206: when analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, Real-Time Scheduling process is carried out to described asynchronous batch processing services; When analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, asynchronous schedule process is carried out to described asynchronous batch processing services;

Particularly, can pre-set register, produce the business such as various forms is Real-Time Scheduling task, can pre-set that account is settled interests, day the statement of account, common reserve fund converge pay, batch documents business, large message transmissions business etc. are asynchronous schedule task; The type of service of asynchronous batch processing services described in analytical procedure S204 is register when type of service or produce various form or other Real-Time Scheduling task types pre-set, then registering described asynchronous batch processing services is Real-Time Scheduling task; Described asynchronous batch processing transaction simulation, mainly for the business that business processing amount is fewer, can be become on-line transaction, support returning results of online wait asynchronous process by Real-Time Scheduling task; The type of service of asynchronous batch processing services described in analytical procedure S204, when type of service be account settle interests or day the statement of account or common reserve fund converge and pay or asynchronous schedule task type that other pre-set, then registering described asynchronous batch processing services is asynchronous schedule task; Described asynchronous batch processing services, mainly for the larger business of business processing amount, is stored in internal memory by asynchronous schedule task, and wait task scheduling primary control program carries out training in rotation inquiry and performs.

Step S208: online batch processing is carried out to described batch processing services;

Particularly, when step S202 judges that the result whether described transaction data amount is greater than data gate limit value is no, registering described batch processing services is online batch processing services, online batch mode is adopted to carry out data processing to described online batch processing services, namely online batch processing corresponding to scheduled for executing is carried out by the service registration information of on-line transaction, the online batch processing services processing time is shorter, supports synchronously to return.

See Fig. 3-1, it is the schematic flow sheet of the Real-Time Scheduling task of the asynchronous batch processing dispatching method that the embodiment of the present invention provides, intelligible, in the step S206 described in Fig. 2, when analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, after carrying out Real-Time Scheduling process to described asynchronous batch processing services, the method comprises:

Step S300: when carrying out Real-Time Scheduling process to described asynchronous batch processing services, creates corresponding Real-Time Scheduling task;

Particularly, when according to type of service, to analyze described asynchronous batch processing services be Real-Time Scheduling task to step S206 in Fig. 2, Real-Time Scheduling process is carried out to described asynchronous batch processing services, before to the process of described asynchronous batch processing services Real-Time Scheduling, create the corresponding Real-Time Scheduling task of described asynchronous batch processing services.

Step S302: judge whether Real-Time Scheduling task pool is fully loaded with;

Particularly, create the corresponding Real-Time Scheduling task of described asynchronous batch processing services in step S300, then by before described Real-Time Scheduling task matching to Real-Time Scheduling task pool, judge whether described Real-Time Scheduling task pool is fully loaded with.

Step S304: Real-Time Scheduling task described in refusal scheduled for executing;

Particularly, when step S302 judges that result that whether Real-Time Scheduling task pool be fully loaded with is for being, then directly refuse this Real-Time Scheduling task of scheduled for executing, and retrieval system busy-message.

Step S306: by described Real-Time Scheduling task matching to corresponding Real-Time Scheduling task pool;

Particularly, when step S302 judges that the result whether Real-Time Scheduling task pool is fully loaded with is no, then by this Real-Time Scheduling task matching to corresponding Real-Time Scheduling task pool, wait for scheduled for executing.

See Fig. 3-2, it is the schematic flow sheet of the asynchronous schedule task of the asynchronous batch processing dispatching method that the embodiment of the present invention provides, intelligible, in the step S206 described in Fig. 2, when analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, after carrying out asynchronous schedule process to described asynchronous batch processing services, the method comprises:

Step 308, when carrying out asynchronous schedule process to described asynchronous batch processing services, creates corresponding asynchronous schedule task;

Particularly, when according to type of service, to analyze described asynchronous batch processing services be asynchronous schedule task to step S206, asynchronous schedule process is carried out to described asynchronous batch processing services, before to the process of described asynchronous batch processing services asynchronous schedule, create the corresponding asynchronous schedule task of described asynchronous batch processing services.

Create described asynchronous batch processing services first to need to define asynchronous schedule task, described asynchronous schedule task definition is managing reserved task, precontract task can be saved in asynchronous schedule task definition table; Asynchronous schedule task generation scheduling master control can generate according to the data in task definition table executes the task.In addition, to the asynchronous schedule task defining production, can be managed by asynchronous schedule task registration class, after namely being completed by database table registration asynchronous task, carry out scheduling and perform asynchronous task immediately.

Asynchronous schedule task registration process is specific as follows: call corresponding doAddTask method (wherein doAddTask method is for adding asynchronous task) according to each asynchronous schedule task type, can asynchronous schedule task data sheet in the past and parameter list write task relevant information; Then doExecTask method (for adding and performing asynchronous task) can be called for the task of needing at once to perform, state can be first that executory mission bit stream inserts mission bit stream table and parameter list by the method, and can by corresponding task performer (TaskHandler) directly this task of scheduled for executing.

Will be understood that, above-mentioned asynchronous schedule task registration process is only as a kind of possible embodiment, and the step of the asynchronous schedule task registration process in the embodiment of the present invention can also be other implementation except above-mentioned embodiment, does not limit herein.

Step S310: judge whether asynchronous schedule task pool is fully loaded with;

Particularly, create the corresponding asynchronous schedule task of described asynchronous batch processing services in step S308, then by before described asynchronous schedule task matching to asynchronous schedule task pool, judge whether asynchronous schedule task pool is fully loaded with.

Step S312: refusal process or by initiation thread process or ignore process;

Asynchronous schedule task pool manages a thread pool and waiting list, when step S310 judges that result that whether asynchronous schedule task pool be fully loaded with is for being, the described asynchronous schedule task of refusal process, described asynchronous schedule task is kept at and waits in linear queue, wait for asynchronous task pond no longer full load, this asynchronous batch processing task is stored in asynchronous schedule task pool, waits for scheduled for executing; Or process described asynchronous schedule task by initiating thread, described asynchronous batch processing task is not stored in asynchronous schedule task pool and waits for next scheduled for executing, but is directly processed by the initiation thread queue of initiating scheduled for executing; Or ignore the described asynchronous schedule task of process, ignore described asynchronous batch processing task, abandon process.

Step S314: by described asynchronous schedule task matching to corresponding asynchronous schedule task pool;

Particularly, when step S310 judges that the result whether asynchronous schedule task pool is fully loaded with is no, then by this asynchronous schedule task matching to corresponding asynchronous schedule task pool, wait for scheduled for executing.

See Fig. 4, be the schematic flow sheet of the real-time scheduling method of the asynchronous batch processing dispatching method that the embodiment of the present invention provides, the method comprises:

Step S400: receive batch processing services request, the transaction data amount of batch processing services described in statistical computation;

Step S402: when judging that result that whether described transaction data amount is greater than data gate limit value is for being, then analyze the type of service of described asynchronous batch processing services;

Step S404: when analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, Real-Time Scheduling process is carried out to described asynchronous batch processing services;

Particularly, the type of service of asynchronous batch processing services described in analytical procedure S402, when analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, Real-Time Scheduling process is carried out to described asynchronous batch processing services, described Real-Time Scheduling task including but not limited to register, produce various forms etc.; Real-Time Scheduling task, mainly for the business that business processing amount is fewer, supports returning results of online wait asynchronous process, described asynchronous batch processing transaction simulation can be become on-line transaction.

Step S406: create corresponding Real-Time Scheduling task;

Particularly, when according to type of service, to analyze described asynchronous batch processing services be Real-Time Scheduling task to step S404, Real-Time Scheduling process is carried out to described asynchronous batch processing services, before to the process of described asynchronous batch processing services Real-Time Scheduling, create the corresponding Real-Time Scheduling task of described asynchronous batch processing services.

Create described asynchronous batch processing services first to define Real-Time Scheduling task, described Real-Time Scheduling task definition is managing reserved task, precontract task can be saved in Real-Time Scheduling task definition table; Real-Time Scheduling task generation scheduling master control can generate according to the data in Real-Time Scheduling task definition table executes the task.In addition, to the Real-Time Scheduling asynchronous task defining production, managed by Real-Time Scheduling task registration class, after namely being completed by database table registration Real-Time Scheduling task, carry out scheduling and perform Real-Time Scheduling task immediately.

Real-Time Scheduling task registration process is specific as follows: can call corresponding doAddTask method (wherein doAddTask method is for adding asynchronous task) according to each Real-Time Scheduling task type, can Real-Time Scheduling task data sheet in the past and parameter list write task relevant information; Then doExecTask method (for adding and performing asynchronous task) can be called for the task of needing at once to perform, state can be first that executory mission bit stream is inserted in mission bit stream table and parameter list by the method, and can by corresponding task performer (TaskHandler) directly this task of scheduled for executing.

Will be understood that, above-mentioned Real-Time Scheduling task registration process is only as a kind of possible embodiment, and the step of the Real-Time Scheduling task registration process in the embodiment of the present invention can also be other implementation except above-mentioned embodiment, does not limit herein.

Step S408: judge whether Real-Time Scheduling task pool is fully loaded with;

Particularly, create the corresponding Real-Time Scheduling task of described asynchronous batch processing services in step S406, then by before described Real-Time Scheduling task matching to Real-Time Scheduling task pool, judge whether described Real-Time Scheduling task pool is fully loaded with.

Step S410: this Real-Time Scheduling task of refusal scheduled for executing;

Particularly, when step S408 judges that result that whether Real-Time Scheduling task pool be fully loaded with is for being, then directly refuse this Real-Time Scheduling task of scheduled for executing, and retrieval system busy-message.

Step S412: by described Real-Time Scheduling task matching to corresponding Real-Time Scheduling task pool;

Particularly, when step S408 judges that the result whether Real-Time Scheduling task pool is fully loaded with is no, then by this Real-Time Scheduling task matching to corresponding Real-Time Scheduling task pool, wait for scheduled for executing.

Step S414: priority level setting is carried out to described Real-Time Scheduling task;

Particularly, according to the type of service of the Real-Time Scheduling task in described Real-Time Scheduling task pool, priority level setting is carried out, such as, the priority level of setting register is set as one-level, and the priority level of producing various form is set as secondary, and one-level priority is higher than secondary priority.

Step S416: according to priority, the Real-Time Scheduling task that scheduled for executing priority level is high;

Particularly, the Real-Time Scheduling task be assigned to Real-Time Scheduling task pool from step S412 carries out scheduled for executing, during scheduled for executing, according to the height of the priority level of Real-Time Scheduling task, the Real-Time Scheduling task that priority scheduling priority level is high, such as, when comprising register in Real-Time Scheduling task pool and generating various form, priority scheduling register business, after waiting scheduling register business, then scheduled for executing generates various form business.

Real-Time Scheduling mission bit stream can be kept in mission bit stream table and parameter list, can pass through task performer (TaskHandler) directly Real-Time Scheduling task described in scheduled for executing.If need to cancel performing of task in addition can call doCancelTask method (during for cancelling task, the Taskid executed the task need be inputted), but performing of task can not be cancelled.

Step S418: wait for returning results of described Real-Time Scheduling task, sends task result to client;

Particularly, doExecTaskWithResult method can wait for the result of Real-Time Scheduling task in real time, may be used for adding and perform Real-Time Scheduling task and wait for and return results, the wait timeout time is defaulted as 30 seconds, also can proceed to according to parameter in addition and perform another Real-Time Scheduling task.If call the success of doExecTaskWithResult method, so return the result of Real-Time Scheduling task, if call time-out, run-time exception message of dishing out.

The business processing amount of the described described Real-Time Scheduling task be assigned in Real-Time Scheduling task pool is generally fewer, processing time is also relatively short, when processing the described Real-Time Scheduling task in Real-Time Scheduling task pool, returning results of tasks carrying can be waited in on-line transaction, even if on-line transaction time-out, also can not affect the execution of predecessor's business.After the process of described Real-Time Scheduling task terminates, the processing result information of described batch processing services can be sent to client by message center; Described object information is including but not limited to the node number of receipt message, and relevant organization user's information etc.; Described client is including but not limited to Notified body or designated user etc.

See Fig. 5, be the schematic flow sheet of the asynchronous schedule method of the asynchronous batch processing dispatching method that the embodiment of the present invention provides, the method comprises:

Step S500: receive batch processing services request, the transaction data amount of batch processing services described in statistical computation;

Step S502: when judging that result that whether described transaction data amount is greater than data gate limit value is for being, then analyze the type of service of described asynchronous batch processing services;

Step S504: when analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, asynchronous schedule process is carried out to described asynchronous batch processing services;

Particularly, the type of service of asynchronous batch processing services described in analytical procedure S502, when analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, asynchronous schedule process is carried out to described asynchronous batch processing services, described asynchronous schedule task is settled interests including but not limited to account, day the statement of account, common reserve fund converge pay, batch documents business, large message transmissions business etc.; Described asynchronous batch processing services, mainly for the larger business of business processing amount, can be stored in internal memory by asynchronous schedule task, and wait task scheduling primary control program carries out training in rotation inquiry and performs.

Step S506: create corresponding asynchronous schedule task;

Particularly, when according to type of service, to analyze described asynchronous batch processing services be asynchronous schedule task to step S504, asynchronous schedule process is carried out to described asynchronous batch processing services, before to the process of described asynchronous batch processing services asynchronous schedule, create the corresponding asynchronous schedule task of described asynchronous batch processing services.

Create described asynchronous batch processing services first to need to define asynchronous schedule task, described asynchronous schedule task definition is managing reserved task, is saved in by precontract task in asynchronous schedule task definition table; Asynchronous schedule task generation scheduling master control can generate according to the data in task definition table executes the task.In addition, to the asynchronous schedule task defining production, managed by asynchronous schedule task registration class, after namely being completed by database table registration asynchronous task, carry out scheduling and perform asynchronous task immediately.

Asynchronous schedule task registration process is specific as follows: can call corresponding doAddTask method (wherein doAddTask method is for adding asynchronous task) according to each asynchronous schedule task type, can asynchronous schedule task data sheet in the past and parameter list write task relevant information; Then doExecTask method (for adding and performing asynchronous task) can be called for the task of needing at once to perform, state can be first that executory mission bit stream inserts mission bit stream table and parameter list by the method, and can by corresponding task performer (TaskHandler) directly this task of scheduled for executing.

Step S508: judge whether asynchronous schedule task pool is fully loaded with;

Particularly, create the corresponding asynchronous schedule task of described asynchronous batch processing services in step S506, then by before described asynchronous schedule task matching to asynchronous schedule task pool, judge whether described asynchronous schedule task pool is fully loaded with.

Step S510: the described asynchronous schedule task of refusal process, or process described asynchronous schedule task by initiating thread, or ignore the described asynchronous schedule task of process;

Particularly, when step S508 judges that result that whether asynchronous schedule task pool be fully loaded with is for being, then take following processing mode: directly this asynchronous schedule task of refusal scheduled for executing, or process described asynchronous schedule task by initiating thread, or ignore the described asynchronous schedule task of process; Asynchronous schedule task pool manages a thread pool and waiting list, when asynchronous schedule task pool full load, the directly described asynchronous schedule task of refusal process, described asynchronous schedule task is kept at and waits in linear queue, wait for asynchronous task pond no longer full load, this asynchronous batch processing task is stored in asynchronous schedule task pool, waits for next scheduled for executing; Or process described asynchronous schedule task by initiating thread, described asynchronous batch processing task is not stored in asynchronous schedule task pool and waits for follow-up scheduled for executing, but is directly processed by the initiation thread queue of initiating scheduled for executing; Or ignore the described asynchronous schedule task of process, ignore described asynchronous batch processing task, abandon process.

Step S512: by described asynchronous schedule task matching to corresponding asynchronous schedule task pool;

Particularly, when step S508 judges that the result whether asynchronous schedule task pool is fully loaded with is no, then by this asynchronous schedule task matching to corresponding asynchronous schedule task pool, wait for scheduled for executing.

Step S514: priority level setting is carried out to described asynchronous schedule task;

Particularly, according to the type of service of the asynchronous schedule task in described asynchronous schedule task pool, carry out priority level setting, such as, asynchronous schedule task is settled interests including but not limited to account, day the statement of account, common reserve fund converge pay, large message transmissions business etc., the priority level that setting account is settled interests is one-level, the priority level of the setting day statement of account is secondary, it is three grades that setting common reserve fund converges the priority level of paying, the priority level setting large message transmissions business is level Four, one-level priority is the highest, and level Four priority is minimum.

Will be understood that, above-mentioned priority level assignment procedure is only as a kind of possible embodiment, and the priority level assignment procedure in the embodiment of the present invention can also be other implementations except above-mentioned embodiment, does not limit herein.

Step S516: data slicer process is carried out to described asynchronous schedule task, obtains the slice of data of asynchronous schedule task;

Particularly, described in scheduled for executing during asynchronous schedule task, provide data slicer treatment mechanism in enormous quantities, described asynchronous batch processing services data are carried out data slicer process, obtain slice of data, provide and the concurrent processing that multithreading criticizes task is carried out to described slice of data.

Data slicer and task scheduling logic have nothing to do, and are mainly slicing treatment in enormous quantities in batch Mission Operations and provide specification and support.Data slicer mechanism can comprise: data slicer logic interfacing (IChunkHandler<T>), data slicer Processing Interface (IChunk) and a batch data processing logic BaseChunkJob.Wherein, the IChunkHandler<T> object that batch data processing logic BaseChunkJob imports into according to user, circulation obtains and processes a section of batch data; Recording processing interface (IChunkHandler<T>) is responsible for obtaining current pending data slicer from data source; Data slicer Processing Interface (IChunk) is responsible for the processing logic providing certain data slicer.In addition, batch data processing logic BaseChunkJob is the entrance class of batch data slicing treatment, and BaseChunkJob depends on the acquisition of IChunkHandler<T> object implementatio8 to data slicer; Recording processing interface IChunkHandler<T> needs developer to realize 3 method: hasNextChunk (), nextChunk () and close () method, be specially: hasNextChunk () returns boolean value, judge whether data source is disposed; NextChunk () returns next pending data slicer; Close () is for closing the resource such as data source, file after batch processing.IChunk comprises method: handleData (), handleData () method is responsible for the logic realizing processing the data of a section.

Will be understood that, above-mentioned data slicer setting procedure is only as a kind of possible embodiment, and the data slicer process in the embodiment of the present invention can also be other implementations except above-mentioned embodiment, does not limit herein.

Step S518: according to priority, asynchronous schedule task described in scheduled for executing, and perform described slice of data;

Particularly, asynchronous schedule mission bit stream can be kept in mission bit stream table and parameter list, can pass through task performer (TaskHandler) directly asynchronous schedule task described in scheduled for executing; Portable Batch System function can be realized by Portable Batch System device (TaskDispatch) in addition, to the asynchronous schedule mission bit stream in timing Query Database, type, the positioning service mode of service can be obtained, and then carry out scheduled for executing.

Portable Batch System device (TaskDispatch) first can according to pre-set priority level, poll asynchronous schedule assignment database table, relevant parameter is extracted according in the asynchronous schedule mission bit stream stated in asynchronous schedule mission bit stream table and parameter list, find corresponding local service, and require to carry out conversion map according to the parameter type in service registration information, run in the asynchronous schedule task pool configured, the asynchronous task high to priority level carries out priority scheduling execution.Such as, asynchronous schedule task is settled interests including but not limited to account, day the statement of account, common reserve fund converge pay, large message transmissions business etc., the priority level that setting account is settled interests is one-level, the priority level of the setting day statement of account is secondary, it is three grades that setting common reserve fund converges the priority level of paying, and the priority level setting large message transmissions business is level Four.During scheduling, priority scheduling performs account and to settle interests business, then scheduled for executing day statement of account business, subsequently scheduled for executing common reserve fund converges and pays business, and the business finally treating other types is all after scheduled for executing, the larger message transmissions business of scheduled for executing.

Task performer (TaskHandler) carries out unified management to needing the task of asynchronous execution and performs, and supports serial and executed in parallel two kinds of patterns.Adopt thread pool management to perform asynchronous task, limit concurrent thread quantity, tasks carrying queue reaches some and then takes corresponding implementation strategy (refusal performs process or carries out performing process in former thread); If need in addition to cancel performing of task, call doCancelTask method (during for cancelling task, the Task id executed the task need be inputted), but performing of task can not be cancelled.When task performer (TaskHandler) is executed the task, by the slice of data of the described asynchronous schedule task that step S516 obtains, carry out serial and/or concurrence performance process.

Will be understood that, the assignment procedure of above-mentioned Portable Batch System device and device of executing the task is only as a kind of possible embodiment, the assignment procedure of the Portable Batch System device in the embodiment of the present invention and device of executing the task can also be other implementations except above-mentioned embodiment, does not limit herein.

Step S520: wait for returning results of described asynchronous schedule task, sends task result to client;

Particularly, the processing result information of batch processing services described in step S518 can be sent to client by message center; Described object information is including but not limited to the node number of receipt message, and relevant organization user's information etc.; Described client is including but not limited to Notified body or designated user etc.

See Fig. 6, be the schematic flow sheet of the appointment scheduling method of the asynchronous batch processing dispatching method that the embodiment of the present invention provides, the method comprises:

Step S600: receive batch processing services request, the transaction data amount of batch processing services described in statistical computation;

Step S602: when judging that result that whether described transaction data amount is greater than data gate limit value is for being, then analyze the type of service of described asynchronous batch processing services;

Step S604: when analyze described asynchronous batch processing services according to type of service be precontract task, according to scheduling time, lexical analysis is carried out to described precontract task;

Particularly, the type of service of asynchronous batch processing services described in analytical procedure S602, when analyze described asynchronous batch processing services according to type of service be precontract task, carries out lexical analysis to described precontract task according to scheduling time; Described precontract task including but not limited to common reserve fund converge business of paying, large message transmissions business, day the statement of account etc.; According to the dispatch deal of batch processing time period, described precontract task can be divided into periodic task and timing to execute the task.

Step S606: when described precontract task being divided into periodic task according to scheduling time, scheduling time inter setting is carried out to described periodic task;

Particularly, when described precontract task being divided into periodic task according to scheduling time in step S604, scheduling time inter setting is carried out to described periodic task; Described periodic task converges including but not limited to common reserve fund pays business etc.; The described time interval can be set as time interval of 5min or 1h or other any duration.

Step S608: periodicity training in rotation scheduled for executing is carried out to described asynchronous batch processing services described scheduling time inter of being separated by;

Particularly, according to the time interval set in step S606, described in interval, scheduling time inter carries out periodicity training in rotation scheduled for executing to described precontract task, such as, carry out the remittance of training in rotation scheduled for executing common reserve fund every 5min and pay business, or carry out the remittance of training in rotation scheduled for executing common reserve fund every 1h and pay business, or the time interval of other durations of setting carries out training in rotation scheduled for executing precontract task.

Step S610: when being divided into timing to execute the task described precontract task according to scheduling time, executes the task to described timing and carries out scheduling permission time period setting;

Particularly, when being divided into timing to execute the task described precontract task according to scheduling time in step S604, described timing being executed the task and carries out the setting of permission time period; Described timing execute the task including but not limited to large message transmissions business, day the statement of account etc.; The described permission time period can be set as (14:00-15:00) or (20:00-22:00) or other any permission time period.

Step S612: within the described permission time period, scheduled service is carried out to described asynchronous batch processing and performs process;

Particularly, the time period is allowed according to scheduling set in step S610, within the described permission time period, timer-triggered scheduler execution is carried out to described precontract task, such as, in (14:00-16:00) time period, Real-Time Scheduling process is carried out to message transmissions business, or in the time period, Real-Time Scheduling process etc. is carried out to day statement of account business at (20:00-22:00).

Step S614: send task result to client;

Particularly, the processing result information of batch processing services described in step S608 or step S612 can be sent to client by message center; Described object information is including but not limited to the node number of receipt message, and relevant organization user's information etc.; Described client is including but not limited to Notified body or designated user etc.

See Fig. 7, it is the asynchronous batch processing dispatching system schematic diagram that the embodiment of the present invention provides, wherein, as shown in Figure 7, this asynchronous batch processing dispatching system 70 comprises: receiver module 700, computing module 702, judge module 704, asynchronous analysis module 706, Real-Time Scheduling module 708, asynchronous schedule module 710, wherein

Receiver module 700 is for receiving the request of batch processing services, it can be the batch processing services that front-end equipment transmits, also can be the batch processing services receiving other system transmission, also can be the online transaction triggered in real time by terminal or various electronic channel, carry out the process of various financial affairs; Batch processing services including but not limited to various withhold pay, common reserve fund collects, converge pay, account is settled interests, register process, day the statement of account, produce various form, batch documents business, large message transmissions business, insurance company declaration form accepts, premium is continuously paid, Claims Resolution etc.;

The business characteristic of batch processing is: the business datum of (1) service request process is batch (many) business datum; (2) data source of business processing is not only single transaction data message, is likely data file;

The transaction data amount of the described batch processing services that computing module 702 receives for statistical computation receiver module 700, the transaction data amount of described batch processing services comprises the complexity of described batch processing services, the data volume of described batch processing services or the type etc. of described batch processing services;

Whether judge module 704 is greater than data gate limit value for the described transaction data amount judging described computing module 702 and calculate; Described data gate limit value can be arranged according to one of following condition or mutual independent assortment: the type etc. processing the equipment performance of described batch processing services, the complexity of described batch processing services, the data volume of described batch processing services or described batch processing services, compares judgement by described transaction data amount and described data gate limit value;

Asynchronous analysis module 706, for when described judge module 704 exports as being, analyzes the type of service of described asynchronous batch processing services; The type of described batch processing services including but not limited to various withhold pay, common reserve fund collects, converge pay, account is settled interests, register process, day the statement of account, produce various form, batch documents business, large message transmissions business, insurance company declaration form accepts, premium is continuously paid, Claims Resolution etc.;

Real-Time Scheduling module 708, for when to analyze described asynchronous batch processing services be Real-Time Scheduling task to described asynchronous analysis module 706 according to type of service, carries out Real-Time Scheduling process to described asynchronous batch processing services;

Asynchronous schedule module 710, for when to analyze described asynchronous batch processing services be asynchronous schedule task to asynchronous analysis module 706 according to type of service, carries out asynchronous schedule process to described asynchronous batch processing services.

See Fig. 8, it is the batch processing dispatching system schematic diagram that the embodiment of the present invention provides, wherein, as shown in Figure 8, batch processing dispatching system 80 comprises: receiver module 800, computing module 802, judge module 804, asynchronous analysis module 806, in-line processing module 808, Real-Time Scheduling module 810, asynchronous schedule module 812, precontract task module 814, preferential administration module 816, message push module 818, wherein

Receiver module 800 is for receiving the request of batch processing services, it can be the batch processing services that front-end equipment transmits, also can be the batch processing services receiving other system transmission, also can be the online transaction triggered in real time by terminal or various electronic channel, carry out the process of various financial affairs; Batch processing services including but not limited to various withhold pay, common reserve fund collects, converge pay, account is settled interests, register process, day the statement of account, produce various form, batch documents business, large message transmissions business, insurance company declaration form accepts, premium is continuously paid, Claims Resolution etc.;

The transaction data amount of the described batch processing services that computing module 802 receives for statistical computation receiver module 800, the transaction data amount of described batch processing services comprises the complexity of described batch processing services, the data volume of described batch processing services or the type etc. of described batch processing services;

Whether judge module 804 is greater than data gate limit value for the described transaction data amount judging described computing module 802 and calculate; Described data gate limit value can be arranged according to one of following condition or mutual independent assortment: the type etc. processing the equipment performance of described batch processing services, the complexity of described batch processing services, the data volume of described batch processing services or described batch processing services, compares judgement by described transaction data amount and described data gate limit value;

Asynchronous analysis module 806, for when described judge module 804 exports as being, analyzes the type of service of described asynchronous batch processing services; The type of described batch processing services including but not limited to various withhold pay, common reserve fund collects, converge pay, account is settled interests, register process, day the statement of account, produce various form, batch documents business, large message transmissions business, insurance company declaration form accepts, premium is continuously paid, Claims Resolution etc.;

In-line processing module 808, for exporting as time no when described judge module 804, carries out on-line transaction process to described asynchronous batch processing services, and the described asynchronous batch processing services that in-line processing module 808 processes is online batch processing services; The transaction data amount of online batch processing services is generally smaller, and the processing time is also relatively short; Online batch processing services, to requirement of real-time is higher in the daytime, is supported to wait for that on-line transaction returns results.The online business that on-line transaction module 808 processes including but not limited to various withhold pay, the declaration form of insurance company accepts, premium is continuously paid, Claims Resolution etc.;

The business characteristic of online batch processing services is: the business datum of (1) service request process is batch (many) business datum; (2) data source of business processing is not only single transaction data message, is likely data file;

Real-Time Scheduling module 810, when to analyze described asynchronous batch processing services be Real-Time Scheduling task to described asynchronous analysis module 806 according to type of service, carries out Real-Time Scheduling process to described asynchronous batch processing services; Analyze the type of service of asynchronous batch processing services described in asynchronous analysis module 806, when analyze described asynchronous batch processing services according to type of service be Real-Time Scheduling task, Real-Time Scheduling process is carried out to described asynchronous batch processing services, described Real-Time Scheduling task including but not limited to register, produce various forms etc.; Real-Time Scheduling task, mainly for the business that business processing amount is fewer, can support returning results of online wait asynchronous process, described asynchronous batch processing transaction simulation can be become on-line transaction;

Asynchronous schedule module 812, for when to analyze described asynchronous batch processing services be asynchronous schedule task to asynchronous analysis module 806 according to type of service, carries out asynchronous schedule process to described asynchronous batch processing services; Analyze the type of service of asynchronous batch processing services described in asynchronous analysis module 806, when analyze described asynchronous batch processing services according to type of service be asynchronous schedule task, asynchronous schedule process is carried out to described asynchronous batch processing services, described asynchronous schedule task is settled interests including but not limited to account, day the statement of account, common reserve fund converge pay, batch documents business, large message transmissions business etc.; Described asynchronous batch processing services, mainly for the larger business of business processing amount, can be stored in internal memory by asynchronous schedule task, can carry out training in rotation inquiry and perform by wait task scheduling primary control program;

Precontract task module 814, for when to analyze described asynchronous batch processing services be precontract task to asynchronous analysis module 806 according to type of service, carries out precontract task process to described asynchronous batch processing services; Task, according to scheduling time, can be divided into periodic task and timing to execute the task by precontract task; Performance period property task, need carry out scheduling time inter setting to described periodic task, can carry out periodicity training in rotation scheduled for executing to described asynchronous batch processing services described scheduling time inter of being separated by; When execution timing is executed the task, need execute the task to described timing and carry out scheduling permission time period setting, scheduled service can be carried out to described asynchronous batch processing within the described permission time period and perform process;

Preferential administration module 816 is for when described Real-Time Scheduling module 810 is carried out Real-Time Scheduling process to described asynchronous batch processing services or carries out asynchronous schedule process when described asynchronous schedule module 812 to described asynchronous batch processing services, according to type of service and/or the service needed of described asynchronous batch processing services, priority level setting can be carried out to described asynchronous batch processing services;

Message push module 818 is for after carrying out Real-Time Scheduling process and terminating or to carry out after asynchronous schedule process terminates to described asynchronous batch processing services in described asynchronous schedule module 812 to described asynchronous batch processing services in described Real-Time Scheduling module 810, or described asynchronous batch processing services carried out after asynchronous schedule process terminates in described precontract task module 814, can by asynchronous message queue to client push task result.

See Fig. 9, it is the Real-Time Scheduling module diagram that the embodiment of the present invention provides, wherein, as shown in Figure 9, Real-Time Scheduling module 810 comprises: real-time task creating unit 8100, real-time task pool unit 8102, in real time main control unit 8104, in real time fully loaded unit 8106, data slicer unit 8108, Data Concurrent unit 8110, wherein

Real-time task creating unit 8100, for creating corresponding Real-Time Scheduling task according to described asynchronous batch processing services; Create described asynchronous batch processing services first to need to define Real-Time Scheduling task, described Real-Time Scheduling task definition is managing reserved task, is saved in by precontract task in Real-Time Scheduling task definition table; Real-Time Scheduling task generation scheduling master control can generate according to the data in Real-Time Scheduling task definition table executes the task.In addition, to the Real-Time Scheduling asynchronous task defining production, managed by Real-Time Scheduling task registration class, after namely being completed by database table registration Real-Time Scheduling task, carry out scheduling and perform Real-Time Scheduling task immediately;

Real-Time Scheduling task registration process is specific as follows: can call corresponding doAddTask method (wherein doAddTask method is for adding asynchronous task) according to each Real-Time Scheduling task type, can Real-Time Scheduling task data sheet in the past and parameter list write task relevant information; Then doExecTask method (for adding and performing asynchronous task) can be called for the task of needing at once to perform, state can be first that executory mission bit stream is inserted in mission bit stream table and parameter list by the method, and can by corresponding task performer (TaskHandler) directly this task of scheduled for executing;

Real-time task pool unit 8102, for the described Real-Time Scheduling task matching that described real-time task creating unit 8100 created to corresponding Real-Time Scheduling task pool;

Real-time main control unit 8104, carries out Real-Time Scheduling process for the described Real-Time Scheduling task be assigned to by real-time task pool unit 8102 in described Real-Time Scheduling task pool, and the result of described asynchronous batch processing services is returned in real time;

Fully loaded unit 8106 in real time, for judging whether the Real-Time Scheduling task pool described in real-time task pool unit 8102 is fully loaded with, when judging that Real-Time Scheduling task pool is fully loaded with, then refuses Real-Time Scheduling task described in scheduled for executing;

Data slicer unit 8108, for the data of described asynchronous batch processing services are carried out data slicer process, obtains the slice of data of described asynchronous batch processing services;

Data slicer and task scheduling logic have nothing to do, and are mainly slicing treatment in enormous quantities in batch Mission Operations and provide specification and support.Data slicer mechanism can comprise: data slicer logic interfacing (IChunkHandler<T>), data slicer Processing Interface (IChunk) and a batch data processing logic BaseChunkJob.Wherein, the IChunkHandler<T> object that batch data processing logic BaseChunkJob imports into according to user, circulation obtains and processes a section of batch data; Recording processing interface (IChunkHandler<T>) is responsible for obtaining current pending data slicer from data source; Data slicer Processing Interface (IChunk) is responsible for the processing logic providing certain data slicer.In addition, batch data processing logic BaseChunkJob is the entrance class of batch data slicing treatment, and BaseChunkJob depends on the acquisition of IChunkHandler<T> object implementatio8 to data slicer; Recording processing interface IChunkHandler<T> needs developer to realize 3 method: hasNextChunk (), nextChunk () and close () method, be specially: hasNextChunk () returns boolean value, judge whether data source is disposed; NextChunk () returns next pending data slicer; Close () is for closing the resource such as data source, file after batch processing.IChunk comprises method: handleData (), handleData () method is responsible for the logic realizing processing the data of a section;

Data Concurrent unit 8110, the described slice of data for obtaining described data slicer unit carries out the concurrent processing that multithreading criticizes task.

See Figure 10, it is the asynchronous schedule module diagram that the embodiment of the present invention provides, wherein, as shown in Figure 10, asynchronous schedule module 812 comprises: asynchronous task creating unit 8120, asynchronous task pool unit 8122, asynchronous main control unit 8124, asynchronous fully loaded unit 8126, data slicer unit 8128, Data Concurrent unit 81210, wherein

Asynchronous task creating unit 8120, for creating corresponding asynchronous schedule task according to described asynchronous batch processing services; Create described asynchronous batch processing services first to need to define asynchronous schedule task, described asynchronous schedule task definition is managing reserved task, is saved in by precontract task in asynchronous schedule task definition table; Asynchronous schedule task generation scheduling master control can generate according to the data in task definition table executes the task.In addition, to the asynchronous schedule task defining production, managed by asynchronous schedule task registration class, after namely being completed by database table registration asynchronous task, carry out scheduling and perform asynchronous task immediately.

Asynchronous task pool unit 8122, for the described Real-Time Scheduling task matching that described asynchronous task creating unit 8120 created to corresponding Real-Time Scheduling task pool;

Asynchronous main control unit 8124, carries out asynchronous schedule process for the described asynchronous schedule task be assigned to by asynchronous task pool unit 8122 in described asynchronous schedule task pool, and the result of described asynchronous batch processing services is returned;

Asynchronous fully loaded unit 8126, for judging whether asynchronous schedule task pool is fully loaded with,

When judging that asynchronous schedule task pool is fully loaded with, then take following processing mode: directly this asynchronous schedule task of refusal scheduled for executing, or process described asynchronous schedule task by initiating thread, or ignore the described asynchronous schedule task of process; Asynchronous schedule task pool manages a thread pool and waiting list, when asynchronous schedule task pool full load, the directly described asynchronous schedule task of refusal process, described asynchronous schedule task is kept at and waits in linear queue, wait for asynchronous task pond no longer full load, this asynchronous batch processing task is stored in asynchronous schedule task pool, waits for next scheduled for executing; Or process described asynchronous schedule task by initiating thread, described asynchronous batch processing task is not stored in asynchronous schedule task pool and waits for follow-up scheduled for executing, but is directly processed by the initiation thread queue of initiating scheduled for executing; Or ignore the described asynchronous schedule task of process, ignore described asynchronous batch processing task, abandon process;

Data slicer unit 8128, for the data of described asynchronous batch processing services are carried out data slicer process, obtains the slice of data of described asynchronous batch processing services;

Data Concurrent unit 81210, the described slice of data for obtaining described data slicer unit carries out the concurrent processing that multithreading criticizes task.

See Figure 11, be the precontract task module diagram that the embodiment of the present invention provides, wherein, as shown in figure 11, precontract task module 814 comprises: periodic task unit 8140, timed task unit 8142, wherein

Periodic task unit 8140, for performance period property task, first needs to carry out scheduling time inter setting to described periodic task, carries out periodicity training in rotation scheduled for executing to described asynchronous batch processing services described scheduling time inter of being separated by; Described periodic task converges including but not limited to common reserve fund pays business etc.; The described time interval can be set as time interval of 5min or 1h or other any duration.According to the time interval set by periodic task unit 8140, described in interval, scheduling time inter carries out periodicity training in rotation scheduled for executing to described precontract task, such as, carry out the remittance of training in rotation scheduled for executing common reserve fund every 5min and pay business, or carry out the remittance of training in rotation scheduled for executing common reserve fund every 1h and pay business, or the time interval of other durations of setting carries out training in rotation scheduled for executing precontract task.

Timed task unit 8142, executes the task for performing timing, and first needing executes the task to described timing carries out scheduling permission time period setting, carries out scheduled service perform process to described asynchronous batch processing within the described permission time period; Described timing execute the task including but not limited to large message transmissions business, day the statement of account etc.; The described permission time period can be set as (14:00-15:00) or (20:00-22:00) or other any permission time period.Scheduling set by timed task unit 8142 allows the time period, within the described permission time period, timer-triggered scheduler execution is carried out to described precontract task, such as, in (14:00-16:00) time period, Real-Time Scheduling process is carried out to message transmissions business, or in the time period, Real-Time Scheduling process etc. is carried out to day statement of account business at (20:00-22:00).

In sum, by implementing the embodiment of the present invention, provide a kind of asynchronous batch processing dispatching method and system, the embodiment of the present invention has following beneficial effect further:

1, the invention provides a kind of asynchronous batch processing dispatching method, by providing unified batch service Development Framework, encapsulation common logic, formulates development specifications, the processing mode of unified online business and batch processing services, is easy to exploitation expansion, O&M, monitoring and abnormality processing;

2, according to the difference of type of service, asynchronous batch processing dispatching system carries out distribution processor to dissimilar business, and the task treatment pond that different task kinds can be corresponding different, effectively improves resource utilization;

3, realize batch processing and carry out time period control, configured by parametrization, for the batch processing task that some are not high to requirement of real-time, by definition precontract task, task is placed on the operation of system idles period, has the right to use of maximum resource with safeguards system at real-time deal peak period; For the batch service that some requirement of real times are higher, the control of time period can not be allowed by this, carry out Real-Time Scheduling.

4, data slicer mechanism is provided, supports the burst process to batch service data, and provide concurrence performance process to the fragment data of business, accelerate the speed of batch service process;

5, provide unified Asynchronous Invocation, task is accepted and is separated with batch processing, realize task process by asynchronous mechanism after task accepts, reduce taking system resource; Support that the online of task asynchronous process returns wait, can support online and mutual conversion that is asynchronous process simultaneously.

One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, this program, when performing, can comprise the flow process of the embodiment as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-Only Memory, ROM) or random store-memory body (Random Access Memory, RAM) etc.

Above disclosedly be only a kind of preferred embodiment of the present invention, certainly the interest field of the present invention can not be limited with this, one of ordinary skill in the art will appreciate that all or part of flow process realizing above-described embodiment, and according to the equivalent variations that the claims in the present invention are done, still belong to the scope that invention is contained.

Claims

1. an asynchronous batch processing dispatching method, is characterized in that, comprising:

2. the method for claim 1, is characterized in that, describedly judges described transaction data amount also comprises after whether being greater than data gate limit value:

If NO, then online batch processing is carried out to described batch processing services.

3. the method for claim 1, is characterized in that, described data gate limit value is arranged according to following at least one condition:

Process the kind of the equipment performance of described batch processing services, the complexity of described batch processing services, the data volume of described batch processing services or described batch processing services.

4. the method for claim 1, is characterized in that, describedly carries out Real-Time Scheduling process to described asynchronous batch processing services and comprises:

Corresponding Real-Time Scheduling task is created according to described asynchronous batch processing services;

By described Real-Time Scheduling task matching to corresponding Real-Time Scheduling task pool;

The described described Real-Time Scheduling task being assigned to described Real-Time Scheduling task pool is carried out Real-Time Scheduling process, and the result of described asynchronous batch processing services is returned in real time.

5. the method as described in claim 1 or 4, is characterized in that, describedly carries out Real-Time Scheduling process to described asynchronous batch processing services and comprises:

When judging that Real-Time Scheduling task pool is fully loaded with, then refuse Real-Time Scheduling task described in scheduled for executing.

6. the method for claim 1, is characterized in that, describedly carries out asynchronous schedule process to described asynchronous batch processing services and comprises:

Corresponding asynchronous schedule task is created according to described asynchronous batch processing services;

By described asynchronous schedule task matching to corresponding asynchronous schedule task pool;

The described described asynchronous schedule task being assigned to described asynchronous schedule task pool is carried out asynchronous schedule process, and the result of described asynchronous batch processing services is returned.

7. the method as described in claim 1 or 6, is characterized in that, describedly carries out asynchronous schedule process to described asynchronous batch processing services and comprises:

When judging that asynchronous schedule task pool is fully loaded with, then the described asynchronous schedule task of refusal process, or process described asynchronous schedule task by initiating thread, or ignore the described asynchronous schedule task of process.

8. the method for claim 1, is characterized in that, describedly carries out Real-Time Scheduling process to described asynchronous batch processing services or carries out asynchronous schedule process to described asynchronous batch processing services, comprising:

The data of described asynchronous batch processing services are carried out data slicer process, obtains the slice of data of described asynchronous batch processing services;

The concurrent processing that multithreading criticizes task is carried out to described slice of data.

9. the method for claim 1, is characterized in that, method also comprises:

According to type of service and/or the service needed of described asynchronous batch processing services, priority level setting is carried out to described asynchronous batch processing services;

Describedly carry out Real-Time Scheduling process or carry out asynchronous schedule process to described asynchronous batch processing services comprising to described asynchronous batch processing services:

According to the priority level of described setting, preferentially high to priority level asynchronous batch processing services carries out dispatch deal.

10. the method for claim 1, is characterized in that, method also comprises:

When analyze described asynchronous batch processing services according to type of service be precontract task, precontract task process is carried out to described asynchronous batch processing services;

Describedly precontract task process carried out to described asynchronous batch processing services comprise:

When according to scheduling time described precontract task being divided into periodic task, scheduling time inter setting is carried out to described periodic task, periodicity training in rotation scheduled for executing is carried out to described asynchronous batch processing services described scheduling time inter of being separated by;

When being divided into timing to execute the task described precontract task according to scheduling time, described timing being executed the task and carries out scheduling permission time period setting, within the described permission time period, scheduled service being carried out to described asynchronous batch processing and performs process.

11. the method for claim 1, is characterized in that, method also comprises:

Described described asynchronous batch processing services carried out Real-Time Scheduling process terminate after or described asynchronous batch processing services carried out after asynchronous schedule process terminates, by asynchronous message queue to client push task result.

12. 1 kinds of asynchronous batch processing dispatching systems, is characterized in that, comprising:

Receiver module, receives batch processing services request;

13. systems as claimed in claim 12, it is characterized in that, system also comprises:

In-line processing module, for exporting as time no when described judge module, carries out online batch processing to described batch processing services.

14. systems as claimed in claim 12, it is characterized in that, described data gate limit value is arranged according to following at least one condition:

Process the kind etc. of the equipment performance of described batch processing services, the complexity of described batch processing services, the data volume of described batch processing services or described batch processing services.

15. systems as claimed in claim 12, it is characterized in that, described Real-Time Scheduling module comprises:

Real-time task creating unit, for creating corresponding Real-Time Scheduling task according to described asynchronous batch processing services;

Real-time task pool unit, for the described Real-Time Scheduling task matching that described real-time task creating unit created to corresponding Real-Time Scheduling task pool;

Real-time main control unit, for the described Real-Time Scheduling task be assigned in described Real-Time Scheduling task pool is carried out Real-Time Scheduling process, and returns in real time by the result of described asynchronous batch processing services.

16. systems as described in claim 12 or 15, it is characterized in that, described Real-Time Scheduling module comprises:

Fully loaded unit in real time, for when judging that Real-Time Scheduling task pool is fully loaded with, then refuses Real-Time Scheduling task described in scheduled for executing.

17. systems as claimed in claim 12, it is characterized in that, described asynchronous schedule module comprises:

Asynchronous task creating unit, for creating corresponding asynchronous schedule task according to described asynchronous batch processing services;

Asynchronous task pool unit, for the described asynchronous schedule task matching that described asynchronous task creating unit created to corresponding asynchronous schedule task pool;

Asynchronous main control unit, for the described asynchronous schedule task be assigned in described asynchronous schedule task pool is carried out asynchronous schedule process, and returns the result of described asynchronous batch processing services.

18. systems as described in claim 12 or 17, it is characterized in that, described asynchronous schedule module also comprises:

Asynchronous fully loaded unit, for when judging that asynchronous schedule task pool is fully loaded with, then refuses the described asynchronous schedule task of process, or processes described asynchronous schedule task by initiating thread, or ignores the described asynchronous schedule task of process.

19. systems as claimed in claim 12, is characterized in that, described Real-Time Scheduling module or described asynchronous schedule module comprise:

Data slicer unit, for the data of described asynchronous batch processing services are carried out data slicer process, obtains the slice of data of described asynchronous batch processing services;

Data Concurrent unit, the described slice of data for obtaining described data slicer unit carries out the concurrent processing that multithreading criticizes task.

20. systems as claimed in claim 12, it is characterized in that, system also comprises:

Priority management module, for when described Real-Time Scheduling module is carried out Real-Time Scheduling process to described asynchronous batch processing services or carries out asynchronous schedule process when described asynchronous schedule module to described asynchronous batch processing services, according to type of service and/or the service needed of described asynchronous batch processing services, priority level setting is carried out to described asynchronous batch processing services;

Described Real-Time Scheduling module is carried out Real-Time Scheduling process or described asynchronous schedule module to described asynchronous batch processing services and is carried out asynchronous schedule process to described asynchronous batch processing services and comprise:

According to the priority level of described priority management module setting, preferentially high to priority level asynchronous batch processing services carries out dispatch deal.

21. systems as claimed in claim 12, it is characterized in that, system also comprises:

Precontract task module, for when to analyze described asynchronous batch processing services be precontract task to asynchronous analysis module according to type of service, carries out precontract task process to described asynchronous batch processing services;

Described precontract task module comprises:

Periodic task unit, for when described precontract task to be divided into periodic task by described precontract task module according to scheduling time, scheduling time inter setting is carried out to described periodic task, periodicity training in rotation scheduled for executing is carried out to described asynchronous batch processing services described scheduling time inter of being separated by;

Timed task unit, for when described precontract task is divided into timing to execute the task according to scheduling time by described precontract task module, described timing is executed the task and carries out scheduling permission time period setting, within the described permission time period, scheduled service is carried out to described asynchronous batch processing and performs process.

22. systems as claimed in claim 12, it is characterized in that, system also comprises:

Message push module, for in described Real-Time Scheduling module described asynchronous batch processing services carried out Real-Time Scheduling process terminate after or described asynchronous batch processing services carried out after asynchronous schedule process terminates, by asynchronous message queue to client push task result in described asynchronous schedule module.