CN104407922B

CN104407922B - A kind of asynchronous batch processing dispatching method and system

Info

Publication number: CN104407922B
Application number: CN201410594848.1A
Authority: CN
Inventors: 伍辉; 吴泽童; 罗新仁; 周小伟
Original assignee: China Construction Bank Corp
Current assignee: China Construction Bank Corp
Priority date: 2014-10-29
Filing date: 2014-10-29
Publication date: 2019-03-01
Anticipated expiration: 2034-10-29
Also published as: CN104407922A

Abstract

The embodiment of the invention discloses asynchronous batch processing dispatching methods, comprising: receives batch processing services request, statistics calculates the transaction data amount of the batch processing services；When judging whether the transaction data amount is greater than data gate limit value, if it has, then the type of service of the analysis asynchronous batch processing services；When to analyze the asynchronous batch processing services be Real-Time Scheduling task according to type of service, Real-Time Scheduling processing is carried out to the asynchronous batch processing services；When to analyze the asynchronous batch processing services be asynchronous schedule task according to type of service, asynchronous schedule processing is carried out to the asynchronous batch processing services.Using the present invention, unified batch processing services Development Framework is provided, is easy to develop extension, O&M, monitoring and abnormality processing, improves the flexibility of batch processing scheduling；It is distributed processing according further to different service types, different types of service can correspond to different task processing ponds, effectively increase resource utilization.

Description

A kind of asynchronous batch processing dispatching method and system

Technical field

The present invention relates to technical field of data processing more particularly to a kind of asynchronous batch processing dispatching method and systems.

Background technique

With the fast development of banking, type of business, number of services are also continuously increased therewith, and core application system will Face a large amount of batch processing services.In general, user can be triggered in real time by terminal or electronic channel etc. and complete various gold Melt business, such as deposit at bank, withdraw the money, transfer accounts, inquiry into balance, common reserve fund collect, this kind of batch processing trading processing time is short, The business datum of generation can immediately enter host data base, and the data of the above-mentioned business of data processing system batch processing are online batch Processing business；Another asynchronous batch processing services, business datum is to be processed and handles, and transaction data amount is big, handles the time It is long, such as refund, bank settle interests, generate various accounting statements automatically.

Current existing batch processing dispatching method, background system need to carry out judgement conduct according to the size of business processing amount On-line transaction processing or asynchronous batch processing, and asynchronous batch processing and on-line transaction processing disconnect completely, lack at online batch The management of reason task, and asynchronous batch processing is all the batch processing logic pre-set according to user, when some is fixed Between section seek unity of action batch processing scheduling, lack the flexibility of scheduling.

Summary of the invention

The technical problem to be solved by the embodiment of the invention is that a kind of asynchronous batch processing dispatching method and system are provided, Unified batch processing services Development Framework is provided, is easy to develop extension, O&M, monitoring and abnormality processing, solves the prior art The problem of middle batch processing lacks dispatching flexibility, is distributed processing, different types of service according further to different service types Different task processing ponds can be corresponded to, resource utilization is effectively increased.

In order to solve the above-mentioned technical problem, first aspect of the embodiment of the present invention discloses a kind of asynchronous batch processing dispatching party Method, including

Batch processing services request is received, statistics calculates the transaction data amount of the batch processing services；

Judge whether the transaction data amount is greater than data gate limit value, if it has, then the analysis asynchronous batch processing The type of service of business；

When according to type of service analyze the asynchronous batch processing services be Real-Time Scheduling task when, at described asynchronous batch Reason business carries out Real-Time Scheduling processing；It is asynchronous schedule task when analyzing the asynchronous batch processing services according to type of service When, asynchronous schedule processing is carried out to the asynchronous batch processing services.

Second aspect of the embodiment of the present invention discloses a kind of asynchronous batch processing scheduling system, including

Receiving module receives batch processing services request；

Computing module, for counting the transaction data amount for calculating the batch processing services；

Whether judgment module, the transaction data amount for judging that the computing module calculates are greater than data threshold Value；

Asynchronous analysis module, for analyzing the industry of the asynchronous batch processing services when judgment module output is is Service type；

Real-Time Scheduling module, for analyzing the asynchronous batch processing industry according to type of service when the asynchronous analysis module When business is Real-Time Scheduling task, Real-Time Scheduling processing is carried out to the asynchronous batch processing services；

Asynchronous schedule module, for being when asynchronous analysis module analyzes the asynchronous batch processing services according to type of service When asynchronous schedule task, asynchronous schedule processing is carried out to the asynchronous batch processing services.

The implementation of the embodiments of the present invention has the following beneficial effects:

By providing unified batch service Development Framework, it is easy to develop extension, O&M, monitoring and abnormality processing；According to Different task type is distributed processing, and different task types can correspond to different task processing ponds, effectively increase money Source utilization rate；The batch processing task period is controllable, and the batch processing task not high for some pairs of requirement of real-time passes through definition Task is placed on the operation of system idle period, has maximum resource in real-time deal peak period with safeguards system by precontract task The right to use, batch service higher for some requirement of real time can not be allowed the control of period by this, be adjusted in real time Degree.

Detailed description of the invention

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.

Fig. 1 is the flow diagram of asynchronous batch processing dispatching method provided in an embodiment of the present invention；

Fig. 2 is the flow diagram of another embodiment of asynchronous batch processing dispatching method provided by the invention；

Fig. 3-1 is the process signal of the Real-Time Scheduling task of asynchronous batch processing dispatching method provided in an embodiment of the present invention Figure；

Fig. 3-2 is the process signal of the asynchronous schedule task of asynchronous batch processing dispatching method provided in an embodiment of the present invention Figure；

Fig. 4 is the flow diagram of the real-time scheduling method of asynchronous batch processing dispatching method provided in an embodiment of the present invention；

Fig. 5 is the flow diagram of the asynchronous schedule method of asynchronous batch processing dispatching method provided in an embodiment of the present invention；

Fig. 6 is the flow diagram of the appointment scheduling method of asynchronous batch processing dispatching method provided in an embodiment of the present invention；

Fig. 7 is asynchronous batch processing scheduling system schematic provided in an embodiment of the present invention；

Fig. 8 is batch processing scheduling system schematic provided in an embodiment of the present invention；

Fig. 9 is Real-Time Scheduling module diagram provided in an embodiment of the present invention；

Figure 10 is asynchronous schedule module diagram provided in an embodiment of the present invention；

Figure 11 is precontract task module diagram provided in an embodiment of the present invention.

Specific embodiment

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.

It should be noted that the term used in embodiments of the present invention is only merely for the mesh of description specific embodiment , it is not intended to limit the invention." the one of the embodiment of the present invention and singular used in the attached claims Kind ", " described " and "the" are also intended to including most forms, unless the context clearly indicates other meaning.It is also understood that this Term "and/or" used herein refers to and includes one or more associated any or all possible group for listing project It closes.

It is the flow diagram of asynchronous batch processing dispatching method provided in an embodiment of the present invention, this method packet referring to Fig. 1 It includes:

Step S100: receiving batch processing services request, and statistics calculates the transaction data amount of the batch processing services；

Specifically, the request for receiving batch processing services can be the batch processing services of headend equipment transmission, be also possible to connect The batch processing services for receiving other systems transmission, are also possible to the online transaction triggered in real time by terminal or various electronic channels, To complete the processing of various financial affairs；

Batch processing services including but not limited to it is various withhold pay, common reserve fund collects, remittance is paid, account is settled interests, register is handled, Day statement of account, the various reports of production, batch documents business, big message transmissions business, insurance company declaration form accept, premium it is continuous pay, Claims Resolution etc.；

The business characteristic of batch processing are as follows: the business datum of (1) service request processing is batch (more) business datum； (2) data source of business processing is not only single transaction data message, it may be possible to data file.

Step S102: it when judging whether the transaction data amount is greater than the result of data gate limit value to be, then analyzes The type of service of the asynchronous batch processing services；

Specifically, data gate limit value can be configured according to one of the following conditions or mutual independent assortment: processing institute State the equipment performance of batch processing services, the complexity of the batch processing services, the data volume of the batch processing services or described batch The transaction data amount is compared judgement with the data gate limit value by the type etc. of processing business.

When the transaction data amount is greater than the data gate limit value, registering the batch processing services is at asynchronous batch The trade context of the batch processing services is saved in database by reason business, until asynchronous task scheduling master control carries out training in rotation Scheduling executes；The type of service of asynchronous batch processing is settled interests including but not limited to account, the remittance of register, the day statement of account, common reserve fund pays, gives birth to Produce various reports, batch documents business, big message transmissions business etc..

Step S104: when according to type of service analyze the asynchronous batch processing services be Real-Time Scheduling task when, to institute It states asynchronous batch processing services and carries out Real-Time Scheduling processing；It is asynchronous when analyzing the asynchronous batch processing services according to type of service When scheduler task, asynchronous schedule processing is carried out to the asynchronous batch processing services；

Specifically, can preset the business such as register, the various reports of production is Real-Time Scheduling task, can be set in advance Set that account is settled interests, the remittance of the day statement of account, common reserve fund is paid, batch documents business, big message transmissions business etc. are asynchronous schedule task；Analysis The type of service of asynchronous batch processing services described in step S102, when type of service be register or the various reports of production or Other pre-set Real-Time Scheduling task types, then registering the asynchronous batch processing services is Real-Time Scheduling task；It adjusts in real time The degree task business fewer primarily directed to business processing amount, can be by the asynchronous batch processing transaction simulation at online friendship Easily, returning the result for online waiting asynchronous process is supported；The type of service of asynchronous batch processing services described in analytical procedure S102, When type of service is that account is settled interests or the day statement of account or common reserve fund remittance are paid or other pre-set asynchronous schedule task class Type, then registering the asynchronous batch processing services is asynchronous schedule task；Asynchronous schedule task is larger mainly for business processing amount Business, the asynchronous batch processing services are stored in memory, wait task schedule primary control program carry out training in rotation inquiry simultaneously hold Row.

In addition, the processing data volume of asynchronous batch processing services may be bigger, handling time-consuming can be longer, in processing, Using asynchronous service processing mode, i.e. initiator gets out data and triggers i.e. return after business processing, do not wait always Business processing terminates.

Referring to fig. 2, be asynchronous batch processing dispatching method provided by the invention another embodiment flow diagram, the party Method includes:

Step S200: receiving batch processing services request, and statistics calculates the transaction data amount of the batch processing services；

Step S202: judge whether the transaction data amount is greater than data gate limit value；

Specifically, data gate limit value can be configured according to one of the following conditions or mutual independent assortment: processing institute State the equipment performance of batch processing services, the complexity of the batch processing services, the data volume or described of the batch processing services The transaction data amount is compared judgement with the data gate limit value by the type etc. of batch processing services.

Step S204: the type of service of the analysis asynchronous batch processing services；

Specifically, when the step S202 result for judging whether the transaction data amount is greater than data gate limit value is yes When, registering the batch processing services is asynchronous batch processing services, and the trade context of the batch processing services is saved in data Library is executed until asynchronous task scheduling master control carries out training in rotation scheduling；The type of service of asynchronous batch processing is including but not limited to account It settles interests, the remittance of register, the day statement of account, common reserve fund pays, produces various reports, batch documents business, big message transmissions business etc..

Step S206: when according to type of service analyze the asynchronous batch processing services be Real-Time Scheduling task when, to institute It states asynchronous batch processing services and carries out Real-Time Scheduling processing；It is asynchronous when analyzing the asynchronous batch processing services according to type of service When scheduler task, asynchronous schedule processing is carried out to the asynchronous batch processing services；

Specifically, can preset the business such as register, the various reports of production is Real-Time Scheduling task, can be set in advance Set that account is settled interests, the remittance of the day statement of account, common reserve fund is paid, batch documents business, big message transmissions business etc. are asynchronous schedule task；Analysis The type of service of asynchronous batch processing services described in step S204, when type of service be register or the various reports of production or Other pre-set Real-Time Scheduling task types, then registering the asynchronous batch processing services is Real-Time Scheduling task；It adjusts in real time The degree task business fewer primarily directed to business processing amount, can be by the asynchronous batch processing transaction simulation at online friendship Easily, returning the result for online waiting asynchronous process is supported；The type of service of asynchronous batch processing services described in analytical procedure S204, When type of service is that account is settled interests or the day statement of account or common reserve fund remittance are paid or other pre-set asynchronous schedule task class Type, then registering the asynchronous batch processing services is asynchronous schedule task；Asynchronous schedule task is larger mainly for business processing amount Business, the asynchronous batch processing services are stored in memory, wait task schedule primary control program carry out training in rotation inquiry simultaneously hold Row.

Step S208: online batch processing is carried out to the batch processing services；

Specifically, when the step S202 result for judging whether the transaction data amount is greater than data gate limit value is no When, registering the batch processing services is online batch processing services, using online batch mode to the online batch processing services Data processing is carried out, i.e., is scheduled by the service registration information of on-line transaction and executes corresponding online batch processing, online batch The processing business processing time is shorter, supports synchronous return.

It is the process of the Real-Time Scheduling task of asynchronous batch processing dispatching method provided in an embodiment of the present invention referring to Fig. 3-1 Schematic diagram, it will be appreciated that, in the step S206 described in Fig. 2, when analyzing the asynchronous batch processing services according to type of service When for Real-Time Scheduling task, after carrying out Real-Time Scheduling processing to the asynchronous batch processing services, this method comprises:

Step S300: it when carrying out Real-Time Scheduling processing to the asynchronous batch processing services, creates corresponding Real-Time Scheduling and appoints Business；

It specifically, is Real-Time Scheduling when step S206 analyzes the asynchronous batch processing services according to type of service in Fig. 2 When task, Real-Time Scheduling processing is carried out to the asynchronous batch processing services, to the asynchronous batch processing services Real-Time Scheduling Before reason, the asynchronous corresponding Real-Time Scheduling task of batch processing services is created.

Step S302: judge whether Real-Time Scheduling task pool is fully loaded with；

Specifically, the asynchronous corresponding Real-Time Scheduling task of batch processing services is created in step S300, it then will be described Real-Time Scheduling task is assigned to before Real-Time Scheduling task pool, judges whether the Real-Time Scheduling task pool is fully loaded with.

Step S304: refusal scheduling executes the Real-Time Scheduling task；

Specifically, when step S302 judges result that whether Real-Time Scheduling task pool is fully loaded with to be, then directly refusal is adjusted Degree executes this Real-Time Scheduling task, and return system busy-message.

Step S306: the Real-Time Scheduling task is assigned to corresponding Real-Time Scheduling task pool；

Specifically, when step S302 judge the result whether Real-Time Scheduling task pool is fully loaded with for it is no when, then by this in real time Scheduler task is assigned to corresponding Real-Time Scheduling task pool, and scheduling is waited to execute.

It is the process of the asynchronous schedule task of asynchronous batch processing dispatching method provided in an embodiment of the present invention referring to Fig. 3-2 Schematic diagram, it will be appreciated that, in the step S206 described in Fig. 2, when analyzing the asynchronous batch processing services according to type of service When for asynchronous schedule task, after carrying out asynchronous schedule processing to the asynchronous batch processing services, this method comprises:

Step 308, it when carrying out asynchronous schedule processing to the asynchronous batch processing services, creates corresponding asynchronous schedule and appoints Business；

It specifically, is asynchronous schedule task when step S206 analyzes the asynchronous batch processing services according to type of service When, asynchronous schedule processing is carried out to the asynchronous batch processing services, it is being handled to the asynchronous batch processing services asynchronous schedule Before, create the asynchronous corresponding asynchronous schedule task of batch processing services.

It creates the asynchronous batch processing services to be defined firstly the need of to asynchronous schedule task, the asynchronous schedule task Definition is managing reserved task, precontract task can be saved in asynchronous schedule task definition table；Asynchronous schedule task generates Scheduling master control can generate execution task according to the data in task definition table.In addition, to the asynchronous schedule of defined production Task can be managed by asynchronous schedule task registration class, i.e., after the completion of registering asynchronous task by database table, carry out It dispatches and is immediately performed asynchronous task.

Asynchronous schedule task registration process is specific as follows: being called according to each asynchronous schedule task type corresponding DoAddTask method (wherein doAddTask method is for adding asynchronous task), can be toward asynchronous schedule task data sheet and ginseng Task relevant information is written in number table；Then doExecTask method can be called (for adding the needing to execute at once of the task Adduction executes asynchronous task), state first can be inserted into mission bit stream table and parameter list for mission bit stream in execution by this method, and It can directly be dispatched by corresponding task performer (TaskHandler) and execute the task.

It will be appreciated that above-mentioned asynchronous schedule task registration process is only used as a kind of possible embodiment, the present invention is real The step of applying the asynchronous schedule task registration process in example can also be other implementations other than above embodiment, herein Without limitation.

Step S310: judge whether asynchronous schedule task pool is fully loaded with；

Specifically, the asynchronous corresponding asynchronous schedule task of batch processing services is created in step S308, it then will be described Asynchronous schedule task is assigned to before asynchronous schedule task pool, judges whether asynchronous schedule task pool is fully loaded with.

Step S312: refusal processing by initiation thread process or ignores processing；

Asynchronous schedule task pool manages a thread pool and waiting list, when step S310 judges that asynchronous schedule task pool is No fully loaded result is when being, refusal handles the asynchronous schedule task, and it is linear that the asynchronous schedule task is stored in waiting In queue, asynchronous task pond no longer full load is waited, this asynchronous batch processing task is stored in asynchronous schedule task pool, etc. It is executed wait dispatch；Or the asynchronous schedule task is handled by initiating thread, the asynchronous batch processing task is not stored It waits scheduling next time to execute in asynchronous schedule task pool, but is carried out directly by initiating the initiation thread queue that scheduling executes Reason；Or ignore the processing asynchronous schedule task, ignore the asynchronous batch processing task, abandons processing.

Step S314: the asynchronous schedule task is assigned to corresponding asynchronous schedule task pool；

Specifically, when step S310 judge the result whether asynchronous schedule task pool is fully loaded with for it is no when, then it is this is asynchronous Scheduler task is assigned to corresponding asynchronous schedule task pool, and scheduling is waited to execute.

It referring to fig. 4, is that the process of real-time scheduling method of asynchronous batch processing dispatching method provided in an embodiment of the present invention is shown It is intended to, this method comprises:

Step S400: receiving batch processing services request, and statistics calculates the transaction data amount of the batch processing services；

Step S402: when judging whether the transaction data amount is greater than the result of data gate limit value to be, then divide Analyse the type of service of the asynchronous batch processing services；

Step S404: when according to type of service analyze the asynchronous batch processing services be Real-Time Scheduling task when, to institute It states asynchronous batch processing services and carries out Real-Time Scheduling processing；

Specifically, the type of service of asynchronous batch processing services described in analytical procedure S402, is analyzed when according to type of service When the asynchronous batch processing services are Real-Time Scheduling task out, Real-Time Scheduling processing, institute are carried out to the asynchronous batch processing services Real-Time Scheduling task is stated including but not limited to register, the various reports of production etc.；Real-Time Scheduling task primarily directed to business at Reason measures fewer business, supports returning the result for online waiting asynchronous process, can be by the asynchronous batch processing transaction simulation At on-line transaction.

Step S406: corresponding Real-Time Scheduling task is created；

It specifically, is Real-Time Scheduling task when step S404 analyzes the asynchronous batch processing services according to type of service When, Real-Time Scheduling processing is carried out to the asynchronous batch processing services, it is being handled to the asynchronous batch processing services Real-Time Scheduling Before, create the asynchronous corresponding Real-Time Scheduling task of batch processing services.

Real-Time Scheduling task can be defined first by creating the asynchronous batch processing services, the Real-Time Scheduling task Definition is managing reserved task, precontract task can be saved in Real-Time Scheduling task definition table；Real-Time Scheduling task generates Scheduling master control can generate execution task according to the data in Real-Time Scheduling task definition table.In addition, to defined production Real-Time Scheduling asynchronous task is managed by Real-Time Scheduling task registration class, i.e., registers Real-Time Scheduling by database table and appoint After the completion of business, it is scheduled and is immediately performed Real-Time Scheduling task.

Real-Time Scheduling task registration process is specific as follows: can be called according to each Real-Time Scheduling task type corresponding DoAddTask method (wherein doAddTask method is for adding asynchronous task), can be toward Real-Time Scheduling task data sheet and ginseng Task relevant information is written in number table；Then doExecTask method can be called (for adding the needing to execute at once of the task Adduction executes asynchronous task), state can be first that mission bit stream in execution is inserted into mission bit stream table and parameter list by this method In, and can directly be dispatched by corresponding task performer (TaskHandler) and execute the task.

It will be appreciated that above-mentioned Real-Time Scheduling task registration process is only used as a kind of possible embodiment, the present invention is real The step of applying the Real-Time Scheduling task registration process in example can also be other implementations other than above embodiment, herein Without limitation.

Step S408: judge whether Real-Time Scheduling task pool is fully loaded with；

Specifically, the asynchronous corresponding Real-Time Scheduling task of batch processing services is created in step S406, it then will be described Real-Time Scheduling task is assigned to before Real-Time Scheduling task pool, judges whether the Real-Time Scheduling task pool is fully loaded with.

Step S410: refusal scheduling executes this Real-Time Scheduling task；

Specifically, when step S408 judges result that whether Real-Time Scheduling task pool is fully loaded with to be, then directly refusal is adjusted Degree executes this Real-Time Scheduling task, and return system busy-message.

Step S412: the Real-Time Scheduling task is assigned to corresponding Real-Time Scheduling task pool；

Specifically, when step S408 judge the result whether Real-Time Scheduling task pool is fully loaded with for it is no when, then by this in real time Scheduler task is assigned to corresponding Real-Time Scheduling task pool, and scheduling is waited to execute.

Step S414: priority level setting is carried out to the Real-Time Scheduling task；

Specifically, according to the type of service of the Real-Time Scheduling task in the Real-Time Scheduling task pool, priority level is carried out The priority level for producing various reports is set as second level for example, the priority level of setting register is set as level-one by setting, Level-one priority is higher than second level priority.

Step S416: according to priority, the not high Real-Time Scheduling task of execution priority is dispatched；

Specifically, the Real-Time Scheduling task being assigned in Real-Time Scheduling task pool from step S412 is scheduled execution, adjusts When degree executes, according to the height of the priority level of Real-Time Scheduling task, the high Real-Time Scheduling task of priority scheduling priority level, example Such as, when including register in Real-Time Scheduling task pool and generating various reports, priority scheduling registers book business, and scheduling is waited to register After book business, then dispatches execution and generate various report business.

Real-Time Scheduling mission bit stream can be stored in mission bit stream table and parameter list, can pass through task performer (TaskHandler) directly scheduling executes the Real-Time Scheduling task.It in addition can be with if necessary to cancel being carrying out for task It calls doCancelTask method (when for cancelling task, the Taskid of execution task need to be inputted), but what is be carrying out appoints Business not can be carried out cancellation.

Step S418: waiting returning the result for the Real-Time Scheduling task, sends task processing result to client；

Specifically, doExecTaskWithResult method can wait the processing result of Real-Time Scheduling task in real time, can To return the result for adding and executing Real-Time Scheduling task and wait, time-out time is waited to be defaulted as 30 seconds, it in addition can also be with It is transferred to according to parameter and executes another Real-Time Scheduling task.If calling the success of doExecTaskWithResult method, The processing result for returning to Real-Time Scheduling task, run-time exception message of dishing out if calling time-out.

The business processing amount of the Real-Time Scheduling task being assigned in Real-Time Scheduling task pool is generally fewer, place The reason time is also relatively short, can be medium in on-line transaction when handling the Real-Time Scheduling task in Real-Time Scheduling task pool To returning the result for task execution, even if on-line transaction is overtime, the execution of predecessor's business will not be influenced.When the Real-Time Scheduling The processing result information of the batch processing services can be sent to client by message center by task after treatment；Institute Result information is stated including but not limited to the node number and relevant organization user's information etc. for receiving message；The client packet Contain but be not limited to Notified body or designated user etc..

It is that the process of the asynchronous schedule method of asynchronous batch processing dispatching method provided in an embodiment of the present invention is shown referring to Fig. 5 It is intended to, this method comprises:

Step S500: receiving batch processing services request, and statistics calculates the transaction data amount of the batch processing services；

Step S502: when judging whether the transaction data amount is greater than the result of data gate limit value to be, then divide Analyse the type of service of the asynchronous batch processing services；

Step S504: when according to type of service analyze the asynchronous batch processing services be asynchronous schedule task when, to institute It states asynchronous batch processing services and carries out asynchronous schedule processing；

Specifically, the type of service of asynchronous batch processing services described in analytical procedure S502, is analyzed when according to type of service When the asynchronous batch processing services are asynchronous schedule task out, asynchronous schedule processing, institute are carried out to the asynchronous batch processing services State asynchronous schedule task settle interests including but not limited to account, the day statement of account, common reserve fund remittance pay, batch documents business, big message transmissions Business etc.；Asynchronous schedule task can store the asynchronous batch processing services mainly for the biggish business of business processing amount In memory, waits task schedule primary control program to carry out training in rotation inquiry and execute.

Step S506: corresponding asynchronous schedule task is created；

It specifically, is asynchronous schedule task when step S504 analyzes the asynchronous batch processing services according to type of service When, asynchronous schedule processing is carried out to the asynchronous batch processing services, it is being handled to the asynchronous batch processing services asynchronous schedule Before, create the asynchronous corresponding asynchronous schedule task of batch processing services.

It creates the asynchronous batch processing services to be defined firstly the need of to asynchronous schedule task, the asynchronous schedule task Definition is managing reserved task, and precontract task is saved in asynchronous schedule task definition table；Asynchronous schedule task generates scheduling Master control can generate execution task according to the data in task definition table.In addition, to the asynchronous schedule task of defined production, It is managed by asynchronous schedule task registration class, i.e., after the completion of registering asynchronous task by database table, is scheduled and exists side by side Execute asynchronous task.

Asynchronous schedule task registration process is specific as follows: can be called according to each asynchronous schedule task type corresponding DoAddTask method (wherein doAddTask method is for adding asynchronous task), can be toward asynchronous schedule task data sheet and ginseng Task relevant information is written in number table；Then doExecTask method can be called (for adding the needing to execute at once of the task Adduction executes asynchronous task), state first can be inserted into mission bit stream table and parameter list for mission bit stream in execution by this method, and It can directly be dispatched by corresponding task performer (TaskHandler) and execute the task.

Step S508: judge whether asynchronous schedule task pool is fully loaded with；

Specifically, the asynchronous corresponding asynchronous schedule task of batch processing services is created in step S506, it then will be described Asynchronous schedule task is assigned to before asynchronous schedule task pool, judges whether the asynchronous schedule task pool is fully loaded with.

Step S510: refusal handles the asynchronous schedule task, or handles the asynchronous schedule by initiating thread Task, or ignore the processing asynchronous schedule task；

Specifically, when step S508 judges result that whether asynchronous schedule task pool is fully loaded with to be, then following place is taken Reason mode: directly refusal scheduling executes this asynchronous schedule task, or is appointed by initiating thread to handle the asynchronous schedule Business, or ignore the processing asynchronous schedule task；Asynchronous schedule task pool manages a thread pool and waiting list, when asynchronous Scheduler task pond full load, directly refusal handle the asynchronous schedule task, and the asynchronous schedule task is stored in waiting line Property queue in, wait asynchronous task pond no longer full load, this asynchronous batch processing task be stored in asynchronous schedule task pool, Scheduling next time is waited to execute；Or the asynchronous schedule task is handled by initiating thread, the asynchronous batch processing task is not Being stored in asynchronous schedule task pool waits subsequent scheduling to execute, but is carried out by the initiation thread queue that initiation scheduling executes straight Connect processing；Or ignore the processing asynchronous schedule task, ignore the asynchronous batch processing task, abandons processing.

Step S512: the asynchronous schedule task is assigned to corresponding asynchronous schedule task pool；

Specifically, when step S508 judge the result whether asynchronous schedule task pool is fully loaded with for it is no when, then it is this is asynchronous Scheduler task is assigned to corresponding asynchronous schedule task pool, and scheduling is waited to execute.

Step S514: priority level setting is carried out to the asynchronous schedule task；

Specifically, according to the type of service of the asynchronous schedule task in the asynchronous schedule task pool, priority level is carried out Setting, for example, asynchronous schedule task is settled interests including but not limited to account, the remittance of the day statement of account, common reserve fund is paid, big message transmissions business Deng setting priority level that account is settled interests as level-one, set the priority level of the day statement of account as second level, setting common reserve fund remittance is paid excellent First rank is three-level, sets the priority level of big message transmissions business as level Four, level-one highest priority, level Four priority is most It is low.

It will be appreciated that above-mentioned priority level setting process is only used as a kind of possible embodiment, the embodiment of the present invention In priority level setting process in addition to above embodiment other than can also be other implementations, herein without limitation.

Step S516: data slicer processing is carried out to the asynchronous schedule task, obtains the number of slices of asynchronous schedule task According to；

Specifically, when scheduling executes the asynchronous schedule task, high-volume data slicer treatment mechanism is provided, it will be described different It walks batch processing services data and carries out data slicer processing, obtain slice of data, provide and multithreading batch is carried out to the slice of data The concurrent processing of task.

Data slicer is unrelated with task schedule logic, predominantly criticize in Mission Operations high-volume slicing treatment provide specification and It supports.Data slicer mechanism may include: data slicer logic interfacing (IChunkHandler<T>), data slicer Processing Interface (IChunk) and a batch data handles logic BaseChunkJob.Wherein, batch data handles logic BaseChunkJob IChunkHandler<T>object being passed to according to user, circulation obtain and handle a slice of batch data；Record processing Interface (IChunkHandler<T>) is responsible for obtaining currently pending data slicer from data source；Data slicer Processing Interface (IChunk) it is responsible for providing the processing logic of certain data slicer.In addition, batch data processing logic BaseChunkJob is batch The entrance class of data slicer processing, BaseChunkJob obtain data slicer dependent on IChunkHandler<T>object implementatio8 It takes；Record Processing Interface IChunkHandler<T>needs developer to realize 3 methods: hasNextChunk (), NextChunk () and close () method, specifically: hasNextChunk () returns to boolean value, whether judges data source It is disposed；NextChunk () returns to next pending data slice；Close () is used to close data after batch processing The resources such as source, file.IChunk includes method: handleData (), and handleData () method, which is responsible for realizing, is sliced one The logic that is handled of data.

It will be appreciated that above-mentioned data slicer setting procedure is only used as a kind of possible embodiment, the embodiment of the present invention In data slicer process other than above embodiment can also be other implementations, herein without limitation.

Step S518: according to priority, scheduling executes the asynchronous schedule task, and executes the slice of data；

Specifically, asynchronous schedule mission bit stream can be stored in mission bit stream table and parameter list, can be held by task Row device (TaskHandler), which is directly dispatched, executes the asynchronous schedule task；In addition it can pass through Portable Batch System device (TaskDispatch) it realizes Portable Batch System function, the asynchronous schedule mission bit stream in database can be inquired timing, Type, the positioning service mode of service are obtained, and then is scheduled execution.

Portable Batch System device (TaskDispatch) first can be according to pre-set priority level, and poll is asynchronous Scheduler task database table is extracted according in the asynchronous schedule mission bit stream and parameter list stated in asynchronous schedule mission bit stream table Relevant parameter finds corresponding local service, and is required to carry out conversion map according to the parameter type in service registration information, It is run in configured asynchronous schedule task pool, the asynchronous task high to priority level carries out priority scheduling execution.For example, Asynchronous schedule task settles interests including but not limited to account, the remittance of the day statement of account, common reserve fund is paid, big message transmissions business etc., sets account The priority level settled interests is level-one, set the priority level of the day statement of account as second level, sets the common reserve fund priority level paid of remittance as three Grade, sets the priority level of big message transmissions business as level Four.Priority scheduling executes account and settles interests business when scheduling, then dispatches Execution day statement of account business, subsequently scheduling executes common reserve fund remittance and pays business, finally all dispatches and has executed to other kinds of business Bi Hou, then dispatch and execute big message transmissions business.

Task performer (TaskHandler) supports string to needing the task of asynchronous execution to be managed collectively and executed Capable and parallel execution both of which.Asynchronous task is executed using thread pool management, limits concurrent thread quantity, task execution queue Reach certain amount and then take corresponding implementation strategy (refusal executes processing or carries out execution processing in former thread)；In addition such as Fruit needs to cancel being carrying out for task and doCancelTask method is then called (when for cancelling task, need to input execution task Task id), but being carrying out for task not can be carried out cancellation.When task performer (TaskHandler) executes task, By the slice of data of the step S516 asynchronous schedule task obtained, carries out serial and/or concurrently execute processing.

It will be appreciated that the setting process of above-mentioned Portable Batch System device and execution task device is only used as a kind of possible reality Mode is applied, the setting process of the Portable Batch System device in the embodiment of the present invention and execution task device is other than above embodiment It can also be other implementations, herein without limitation.

Step S520: waiting returning the result for the asynchronous schedule task, sends task processing result to client；

Specifically, the processing result information of batch processing services described in step S518 can be sent to by message center Client；The result information is including but not limited to the node number and relevant organization user's information etc. for receiving message；It is described Client is including but not limited to Notified body or designated user etc..

It is that the process of the appointment scheduling method of asynchronous batch processing dispatching method provided in an embodiment of the present invention is shown referring to Fig. 6 It is intended to, this method comprises:

Step S600: receiving batch processing services request, and statistics calculates the transaction data amount of the batch processing services；

Step S602: when judging whether the transaction data amount is greater than the result of data gate limit value to be, then divide Analyse the type of service of the asynchronous batch processing services；

Step S604: when according to type of service analyze the asynchronous batch processing services be precontract task when, to described pre- About task is scheduled analysis according to scheduling time；

Specifically, the type of service of asynchronous batch processing services described in analytical procedure S602, is analyzed when according to type of service When the asynchronous batch processing services are precontract task out, analysis is scheduled according to scheduling time to the precontract task；It is described Precontract task pays business, big message transmissions business, day statement of account etc. including but not limited to common reserve fund remittance；According to the batch processing period The precontract task can be divided into periodic task and timing execution task by dispatch deal.

Step S606: when the precontract task is divided into periodic task according to scheduling time, to the periodic task It is scheduled time interval setting；

Specifically, when the precontract task is divided into periodic task according to scheduling time in step S604, to described Periodic task is scheduled time interval setting；The periodic task pays business etc. including but not limited to common reserve fund remittance；Institute Stating time interval can be set as the time interval of 5min or 1h or other any durations.

Step S608: the periodical training in rotation scheduling of the scheduling time inter progress is separated by the asynchronous batch processing services and is held Row；

Specifically, according to time interval set in step S606, the scheduling time inter is being spaced to described pre- About task carries out periodical training in rotation scheduling execution, for example, executing common reserve fund remittance every 5min progress training in rotation scheduling pays business, or Training in rotation scheduling execution common reserve fund remittance is carried out every 1h and pays business, or the time interval of other durations set carries out training in rotation scheduling Execute precontract task.

Step S610: when the precontract task is divided into timing execution task according to scheduling time, the timing is executed Task, which is scheduled, allows the period to be arranged；

Specifically, when the precontract task is divided into timing execution task according to scheduling time in step S604, to institute Timing execution task is stated to carry out that the period is allowed to be arranged；The timing execute task including but not limited to big message transmissions business, Day statement of account etc.；It is either (20:00-22:00) or other any that the permission period can be set as (14:00-15:00) Allow the period.

Step S612: business is timed within the permission period to the asynchronous batch processing and executes processing；

Specifically, the period is allowed according to scheduling set in step S610, to described within the permission period Precontract task is timed scheduling and executes, for example, carrying out Real-Time Scheduling to message transmissions business in (14:00-16:00) period Processing, or Real-Time Scheduling processing etc. is carried out to day statement of account business within (20:00-22:00) period.

Step S614: task processing result is sent to client；

It specifically, can be by disappearing by the processing result information of batch processing services described in step S608 or step S612 Breath center is sent to client；The result information is used including but not limited to the node number and relevant mechanism for receiving message Family information etc.；The client is including but not limited to Notified body or designated user etc..

It is asynchronous batch processing scheduling system schematic provided in an embodiment of the present invention referring to Fig. 7, wherein as shown in fig. 7, The asynchronous batch processing scheduling system 70 includes: receiving module 700, computing module 702, judgment module 704, asynchronous analysis module 706, Real-Time Scheduling module 708, asynchronous schedule module 710, wherein

Receiving module 700 is used to receive the request of batch processing services, can be the batch processing services of headend equipment transmission, It can be the batch processing services for receiving other systems transmission, be also possible to the connection triggered in real time by terminal or various electronic channels Machine affairs, to complete the processing of various financial affairs；Batch processing services including but not limited to it is various withhold pay, common reserve fund collect, Remittance is paid, account is settled interests, register is handled, the day statement of account, the various reports of production, batch documents business, big message transmissions business, insurance The declaration form of company, which is accepted, premium is continuous pays, settles a claim；

The business characteristic of batch processing are as follows: the business datum of (1) service request processing is batch (more) business datum； (2) data source of business processing is not only single transaction data message, it may be possible to data file；

Computing module 702 is used to count the transaction data for calculating the received batch processing services of receiving module 700 Amount, the transaction data amount of the batch processing services include the complexity of the batch processing services, the batch processing services Data volume or the type of the batch processing services etc.；

Whether the transaction data amount that judgment module 704 is used to judge that the computing module 702 calculates is greater than number According to threshold value；The data gate limit value can be according to one of the following conditions or mutually independent assortment is configured: described in processing At the equipment performance of batch processing services, the complexity of the batch processing services, the data volume of the batch processing services or described batch The transaction data amount is compared judgement with the data gate limit value by the type etc. of reason business；

Asynchronous analysis module 706 is used to analyze the asynchronous batch processing services when the judgment module 704 output is is Type of service；The type of the batch processing services including but not limited to it is various withhold pay, common reserve fund collects, remittance is paid, account knot Breath, register processing, the day statement of account, the various reports of production, batch documents business, big message transmissions business, insurance company declaration form It accepts, premium is continuous pays, settles a claim；

Real-Time Scheduling module 708 is used to analyze described asynchronous batch according to type of service when the asynchronous analysis module 706 When processing business is Real-Time Scheduling task, Real-Time Scheduling processing is carried out to the asynchronous batch processing services；

Asynchronous schedule module 710 is used to analyze the asynchronous batch processing according to type of service when asynchronous analysis module 706 When business is asynchronous schedule task, asynchronous schedule processing is carried out to the asynchronous batch processing services.

It is batch processing scheduling system schematic provided in an embodiment of the present invention, wherein as shown in figure 8, at criticizing referring to Fig. 8 Managing scheduling system 80 includes: receiving module 800, computing module 802, judgment module 804, asynchronous analysis module 806, online process Module 808, Real-Time Scheduling module 810, asynchronous schedule module 812, precontract task module 814, preferential management module 816, message Pushing module 818, wherein

Receiving module 800 is used to receive the request of batch processing services, can be the batch processing services of headend equipment transmission, It can be the batch processing services for receiving other systems transmission, be also possible to the connection triggered in real time by terminal or various electronic channels Machine affairs, to complete the processing of various financial affairs；Batch processing services including but not limited to it is various withhold pay, common reserve fund collect, Remittance is paid, account is settled interests, register is handled, the day statement of account, the various reports of production, batch documents business, big message transmissions business, insurance The declaration form of company, which is accepted, premium is continuous pays, settles a claim；

Computing module 802 is used to count the transaction data for calculating the received batch processing services of receiving module 800 Amount, the transaction data amount of the batch processing services include the complexity of the batch processing services, the batch processing services Data volume or the type of the batch processing services etc.；

Whether the transaction data amount that judgment module 804 is used to judge that the computing module 802 calculates is greater than number According to threshold value；The data gate limit value can be according to one of the following conditions or mutually independent assortment is configured: described in processing At the equipment performance of batch processing services, the complexity of the batch processing services, the data volume of the batch processing services or described batch The transaction data amount is compared judgement with the data gate limit value by the type etc. of reason business；

Asynchronous analysis module 806 is used to analyze the asynchronous batch processing services when the judgment module 804 output is is Type of service；The type of the batch processing services including but not limited to it is various withhold pay, common reserve fund collects, remittance is paid, account knot Breath, register processing, the day statement of account, the various reports of production, batch documents business, big message transmissions business, insurance company declaration form It accepts, premium is continuous pays, settles a claim；

Online process module 808 be used for when the judgment module 804 output be it is no when, to the asynchronous batch processing services into The asynchronous batch processing services of the processing of row on-line transaction, the processing of online process module 808 are online batch processing services；It is online The transaction data amount of batch processing services is generally smaller, and the processing time is also relatively short；Online batch processing services are to real-time in the daytime Property it is more demanding, support wait on-line transaction return the result.On-line transaction module 808 processing online business including but not limited to It is various withhold pay, the declaration form of insurance company is accepted, premium is continuous pays, settles a claim；

The business characteristic of online batch processing services are as follows: the business datum of (1) service request processing is batch (more) Business datum；(2) data source of business processing is not only single transaction data message, it may be possible to data file；

Real-Time Scheduling module 810 analyzes the asynchronous batch processing according to type of service when the asynchronous analysis module 806 When business is Real-Time Scheduling task, Real-Time Scheduling processing is carried out to the asynchronous batch processing services；Analyze asynchronous analysis module 806 Described in asynchronous batch processing services type of service, when according to type of service analyze the asynchronous batch processing services be in real time adjust When degree task, Real-Time Scheduling processing carried out to the asynchronous batch processing services, the Real-Time Scheduling task is including but not limited to stepping on Remember book, the various reports of production etc.；The Real-Time Scheduling task business fewer primarily directed to business processing amount, can support online Returning the result for asynchronous process is waited, it can be by the asynchronous batch processing transaction simulation at on-line transaction；

Asynchronous schedule module 812 is used to analyze the asynchronous batch processing according to type of service when asynchronous analysis module 806 When business is asynchronous schedule task, asynchronous schedule processing is carried out to the asynchronous batch processing services；Analyze asynchronous analysis module 806 Described in asynchronous batch processing services type of service, when according to type of service analyze the asynchronous batch processing services be asynchronous tune When degree task, asynchronous schedule processing is carried out to the asynchronous batch processing services, the asynchronous schedule task is including but not limited to account Family settles interests, the remittance of the day statement of account, common reserve fund is paid, batch documents business, big message transmissions business etc.；Asynchronous schedule task is mainly for industry The business biggish business for the treatment of capacity, the asynchronous batch processing services can be stored in memory, can wait task schedule master control Program carries out training in rotation inquiry and executes；

Precontract task module 814 is used to analyze the asynchronous batch processing according to type of service when asynchronous analysis module 806 When business is precontract task, precontract task processing is carried out to the asynchronous batch processing services；Precontract task, can according to scheduling time Task is divided into periodic task and timing execution task；Periodic task is executed, the periodic task need to be adjusted Time interval setting is spent, the asynchronous batch processing services can be separated by with the scheduling time inter and carry out periodical training in rotation scheduling It executes；When executing timing execution task, need to the timing be executed task and is scheduled allows the period to be arranged, can be to described Asynchronous batch processing is timed business within the permission period and executes processing；

Preferential management module 816 is used to carry out the asynchronous batch processing services when the Real-Time Scheduling module 810 real-time Dispatch deal or when the asynchronous schedule module 812 carries out asynchronous schedule processing to the asynchronous batch processing services, according to The type of service and/or business of the asynchronous batch processing services need, and can carry out priority to the asynchronous batch processing services It does not set；

Message pushing module 818 is used to carry out the asynchronous batch processing services in the Real-Time Scheduling module 810 real-time Asynchronous schedule processing knot is carried out to the asynchronous batch processing services after dispatch deal or in the asynchronous schedule module 812 Shu Hou, or carry out asynchronous schedule after treatment to the asynchronous batch processing services in the precontract task module 814, can be with By asynchronous message queue to client push task processing result.

It is Real-Time Scheduling module diagram provided in an embodiment of the present invention referring to Fig. 9, wherein as shown in figure 9, adjusting in real time Degree module 810 includes: real-time task creating unit 8100, real-time task pool unit 8102, real-time main control unit 8104, expires in real time Carrier unit 8106, data slicer unit 8108, Data Concurrent unit 8110, wherein

Real-time task creating unit 8100 is appointed for creating corresponding Real-Time Scheduling according to the asynchronous batch processing services Business；It creates the asynchronous batch processing services to be defined firstly the need of to Real-Time Scheduling task, the Real-Time Scheduling task definition It is managing reserved task, precontract task is saved in Real-Time Scheduling task definition table；Real-Time Scheduling task generates scheduling master control Execution task can be generated according to the data in Real-Time Scheduling task definition table.In addition, to the Real-Time Scheduling of defined production Asynchronous task is managed by Real-Time Scheduling task registration class, i.e., after the completion of registering Real-Time Scheduling task by database table, It is scheduled and is immediately performed Real-Time Scheduling task；

Real-Time Scheduling task registration process is specific as follows: can be called according to each Real-Time Scheduling task type corresponding DoAddTask method (wherein doAddTask method is for adding asynchronous task), can be toward Real-Time Scheduling task data sheet and ginseng Task relevant information is written in number table；Then doExecTask method can be called (for adding the needing to execute at once of the task Adduction executes asynchronous task), state can be first that mission bit stream in execution is inserted into mission bit stream table and parameter list by this method In, and can directly be dispatched by corresponding task performer (TaskHandler) and execute the task；

Real-time task pool unit 8102, the Real-Time Scheduling for creating the real-time task creating unit 8100 are appointed Business is assigned to corresponding Real-Time Scheduling task pool；

Real-time main control unit 8104, for real-time task pool unit 8102 to be assigned in the Real-Time Scheduling task pool The Real-Time Scheduling task carries out Real-Time Scheduling processing, and the processing result of the asynchronous batch processing services is returned in real time It returns；

Fully loaded unit 8106 in real time, for whether judging Real-Time Scheduling task pool described in real-time task pool unit 8102 It is fully loaded, when judging that Real-Time Scheduling task pool is fully loaded, then refuses scheduling and execute the Real-Time Scheduling task；

Data slicer unit 8108 is obtained for the data of the asynchronous batch processing services to be carried out data slicer processing The slice of data of the asynchronous batch processing services；

Data slicer is unrelated with task schedule logic, predominantly criticize in Mission Operations high-volume slicing treatment provide specification and It supports.Data slicer mechanism may include: data slicer logic interfacing (IChunkHandler<T>), data slicer Processing Interface (IChunk) and a batch data handles logic BaseChunkJob.Wherein, batch data handles logic BaseChunkJob IChunkHandler<T>object being passed to according to user, circulation obtain and handle a slice of batch data；Record processing Interface (IChunkHandler<T>) is responsible for obtaining currently pending data slicer from data source；Data slicer Processing Interface (IChunk) it is responsible for providing the processing logic of certain data slicer.In addition, batch data processing logic BaseChunkJob is batch The entrance class of data slicer processing, BaseChunkJob obtain data slicer dependent on IChunkHandler<T>object implementatio8 It takes；Record Processing Interface IChunkHandler<T>needs developer to realize 3 methods: hasNextChunk (), NextChunk () and close () method, specifically: hasNextChunk () returns to boolean value, whether judges data source It is disposed；NextChunk () returns to next pending data slice；Close () is used to close data after batch processing The resources such as source, file.IChunk includes method: handleData (), and handleData () method, which is responsible for realizing, is sliced one The logic that is handled of data；

Data Concurrent unit 8110, the slice of data for obtaining to the data slicer unit carry out multithreading batch The concurrent processing of task.

It is asynchronous schedule module diagram provided in an embodiment of the present invention referring to Figure 10, wherein as shown in Figure 10, asynchronous Scheduler module 812 includes: asynchronous task creating unit 8120, asynchronous task pool unit 8122, asynchronous main control unit 8124, asynchronous Fully loaded unit 8126, data slicer unit 8128, Data Concurrent unit 81210, wherein

Asynchronous task creating unit 8120 is appointed for creating corresponding asynchronous schedule according to the asynchronous batch processing services Business；It creates the asynchronous batch processing services to be defined firstly the need of to asynchronous schedule task, the asynchronous schedule task definition It is managing reserved task, precontract task is saved in asynchronous schedule task definition table；Asynchronous schedule task generates scheduling master control Execution task can be generated according to the data in task definition table.In addition, passing through to the asynchronous schedule task of defined production Asynchronous schedule task registration class is managed, i.e., after the completion of registering asynchronous task by database table, is scheduled and holds immediately Line asynchronous task.

Asynchronous task pool unit 8122, the Real-Time Scheduling for creating the asynchronous task creating unit 8120 are appointed Business is assigned to corresponding Real-Time Scheduling task pool；

Asynchronous main control unit 8124, for asynchronous task pool unit 8122 to be assigned in the asynchronous schedule task pool The asynchronous schedule task carries out asynchronous schedule processing, and the processing result of the asynchronous batch processing services is returned；

Asynchronous fully loaded unit 8126, for judging whether asynchronous schedule task pool is fully loaded with,

When judging that asynchronous schedule task pool is fully loaded, then take following processing mode: directly it is different to execute this for refusal scheduling Scheduler task is walked, the asynchronous schedule task is perhaps handled by initiating thread or ignores the processing asynchronous schedule and is appointed Business；Asynchronous schedule task pool manages a thread pool and waiting list, when asynchronous schedule task pool full load, direct refusal processing The asynchronous schedule task is stored in and waits in linear queue by the asynchronous schedule task, waits asynchronous task pond no longer full When load, this asynchronous batch processing task is stored in asynchronous schedule task pool, scheduling next time is waited to execute；Or pass through initiation Thread handles the asynchronous schedule task, the asynchronous batch processing task be not stored in asynchronous schedule task pool wait it is subsequent Scheduling executes, but is directly handled by initiating the initiation thread queue that scheduling executes；Or ignore the processing asynchronous tune Degree task ignores the asynchronous batch processing task, abandons processing；

Data slicer unit 8128 is obtained for the data of the asynchronous batch processing services to be carried out data slicer processing The slice of data of the asynchronous batch processing services；

Data Concurrent unit 81210, the slice of data for obtaining to the data slicer unit carry out multithreading The concurrent processing for the task of criticizing.

It is precontract task module diagram provided in an embodiment of the present invention referring to Figure 11, wherein as shown in figure 11, reservation Task module 814 includes: periodic task unit 8140, timed task unit 8142, wherein

Periodic task unit 8140 needs to be scheduled the periodic task first for executing periodic task Time interval setting is separated by the scheduling time inter to the asynchronous batch processing services and carries out periodical training in rotation scheduling execution； The periodic task pays business etc. including but not limited to common reserve fund remittance；The time interval can be set as 5min or 1h or The time interval of the other any durations of person.According to time interval set by periodic task unit 8140, described in interval Scheduling time inter carries out periodical training in rotation scheduling to the precontract task and executes, and holds for example, carrying out training in rotation scheduling every 5min Business is paid in the remittance of row common reserve fund, is perhaps carried out training in rotation scheduling every 1h and is executed other durations that business or setting are paid in common reserve fund remittance Time interval carry out training in rotation scheduling execute precontract task.

Timed task unit 8142 executes task for executing timing, needs to adjust timing execution task first Degree allows the period to be arranged, and is timed business within the permission period to the asynchronous batch processing and executes processing；It is described Timing executes task including but not limited to big message transmissions business, day statement of account etc.；The permission period can be set as (14: 00-15:00) or (20:00-22:00) or other any allow the period.According to set by timed task unit 8142 Scheduling allow the period, within the permissions period to the precontract task be timed scheduling execution, for example, (14: 00-16:00) period carries out Real-Time Scheduling processing to message transmissions business, or to day within (20:00-22:00) period Statement of account business carries out Real-Time Scheduling processing etc..

In conclusion providing a kind of asynchronous batch processing dispatching method and system, the present invention by implementing the embodiment of the present invention Embodiment further has the advantages that

1, the present invention provides a kind of asynchronous batch processing dispatching methods, by providing unified batch service Development Framework, Common logic is encapsulated, development specifications is formulated, the processing mode of unified online business and batch processing services is easy to develop extension, fortune Dimension, monitoring and abnormality processing；

2, according to the difference of type of service, asynchronous batch processing scheduling system is distributed processing to different types of business, Different task types can correspond to different task processing ponds, effectively increase resource utilization；

3, it realizes that batch processing carries out period control, is configured by parametrization, it is not high for some pairs of requirement of real-time Task is placed on the operation of system idle period, with safeguards system in real-time deal by defining precontract task by batch processing task There is the right to use of maximum resource in peak period；Batch service higher for some requirement of real time can not be allowed the time by this The control of section carries out Real-Time Scheduling.

4, data slicer mechanism is provided, supports to handle the fragment of batch service data, and mention the fragment data of business For concurrently executing processing, accelerate the speed of batch service processing；

5, unified Asynchronous Invocation is provided, task is accepted and is separated with batch processing, task passes through after accepting Asynchronous mechanism realizes task processing, reduces the occupancy to system resource；The online of task asynchronous process is supported to return to waiting for simultaneously, It can support online and asynchronous process mutual conversion.

Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..

Above disclosed is only a preferred embodiment of the present invention, cannot limit the power of the present invention with this certainly Sharp range, those skilled in the art can understand all or part of the processes for realizing the above embodiment, and weighs according to the present invention Benefit requires made equivalent variations, still belongs to the scope covered by the invention.

Claims

1. a kind of asynchronous batch processing dispatching method characterized by comprising

Judge whether the transaction data amount is greater than data gate limit value, if it has, then the analysis asynchronous batch processing services Type of service；

When according to type of service analyze the asynchronous batch processing services be Real-Time Scheduling task when, to the asynchronous batch processing industry Business carries out Real-Time Scheduling processing；When according to type of service analyze the asynchronous batch processing services be asynchronous schedule task when, it is right The asynchronous batch processing services carry out asynchronous schedule processing；

If it has not, then registering the batch processing services is online batch processing services, by the service registration information of on-line transaction into Row scheduling executes the online batch processing services.

2. the method as described in claim 1, which is characterized in that the data gate limit value is carried out according at least one of following condition Setting:

Handle the equipment performance of the batch processing services, the complexity of the batch processing services, the data of the batch processing services The type of amount or the batch processing services.

3. the method as described in claim 1, which is characterized in that described to be carried out at Real-Time Scheduling to the asynchronous batch processing services Reason includes:

Corresponding Real-Time Scheduling task is created according to the asynchronous batch processing services；

The Real-Time Scheduling task is assigned to corresponding Real-Time Scheduling task pool；

The Real-Time Scheduling task for being assigned to the Real-Time Scheduling task pool is subjected to Real-Time Scheduling processing, and will be described The processing result of asynchronous batch processing services is returned in real time.

4. method as claimed in claim 1 or 3, which is characterized in that described to be adjusted in real time to the asynchronous batch processing services Degree is handled

When judging that Real-Time Scheduling task pool is fully loaded, then refuses scheduling and execute the Real-Time Scheduling task.

5. the method as described in claim 1, which is characterized in that described to be carried out at asynchronous schedule to the asynchronous batch processing services Reason includes:

Corresponding asynchronous schedule task is created according to the asynchronous batch processing services；

The asynchronous schedule task is assigned to corresponding asynchronous schedule task pool；

The asynchronous schedule task for being assigned to the asynchronous schedule task pool is subjected to asynchronous schedule processing, and will be described The processing result of asynchronous batch processing services is returned.

6. method as claimed in claim 1 or 5, which is characterized in that described to carry out asynchronous tune to the asynchronous batch processing services Degree is handled

When judging that asynchronous schedule task pool is fully loaded, then refuse to handle the asynchronous schedule task, or by initiate thread come The asynchronous schedule task is handled, or ignores the processing asynchronous schedule task.

7. the method as described in claim 1, which is characterized in that described to be carried out at Real-Time Scheduling to the asynchronous batch processing services Reason carries out asynchronous schedule processing to the asynchronous batch processing services, comprising:

The data of the asynchronous batch processing services are subjected to data slicer processing, obtain the number of slices of the asynchronous batch processing services According to；

The concurrent processing of multithreading batch task is carried out to the slice of data.

8. the method as described in claim 1, which is characterized in that method further include:

According to the type of service and/or business needs of the asynchronous batch processing services, the asynchronous batch processing services are carried out excellent First grade setting；

It is described that Real-Time Scheduling processing is carried out to the asynchronous batch processing services or the asynchronous batch processing services are carried out asynchronous Dispatch deal includes:

According to the priority level of the setting, preferentially the asynchronous batch processing services high to priority level are scheduled processing.

9. the method as described in claim 1, which is characterized in that method further include:

When according to type of service analyze the asynchronous batch processing services be precontract task when, to the asynchronous batch processing services into The processing of row precontract task；

It is described to include: to the asynchronous batch processing services progress precontract task processing

When the precontract task is divided into periodic task according to scheduling time, is scheduled to the periodic task time Interval setting is separated by the periodical training in rotation scheduling of the scheduling time inter progress to the asynchronous batch processing services and executes；

When the precontract task is divided into timing execution task according to scheduling time, task is executed to the timing and is scheduled Allow the period to be arranged, business is timed within the permission period to the asynchronous batch processing and executes processing.

10. the method as described in claim 1, which is characterized in that method further include:

Real-Time Scheduling after treatment is carried out to the asynchronous batch processing services or to the asynchronous batch processing services described Asynchronous schedule after treatment is carried out, by asynchronous message queue to client push task processing result.

11. system is dispatched in a kind of asynchronous batch processing characterized by comprising

Receiving module receives batch processing services request；

Whether judgment module, the transaction data amount for judging that the computing module calculates are greater than data gate limit value；

Asynchronous analysis module, for analyzing the service class of the asynchronous batch processing services when judgment module output is is Type；

Real-Time Scheduling module, for being when the asynchronous analysis module analyzes the asynchronous batch processing services according to type of service When Real-Time Scheduling task, Real-Time Scheduling processing is carried out to the asynchronous batch processing services；

Asynchronous schedule module, for being asynchronous when asynchronous analysis module analyzes the asynchronous batch processing services according to type of service When scheduler task, asynchronous schedule processing is carried out to the asynchronous batch processing services；

Online process module, for when judgment module output is no, registering the batch processing services to be online batch processing Business is scheduled by the service registration information of on-line transaction and executes the online batch processing services.

12. system as claimed in claim 11, which is characterized in that the data gate limit value according at least one of following condition into Row setting:

Handle the equipment performance of the batch processing services, the complexity of the batch processing services, the data of the batch processing services Amount or the type of the batch processing services etc..

13. system as claimed in claim 11, which is characterized in that the Real-Time Scheduling module includes:

Real-time task creating unit, for creating corresponding Real-Time Scheduling task according to the asynchronous batch processing services；

Real-time task pool unit, the Real-Time Scheduling task for creating the real-time task creating unit are assigned to accordingly Real-Time Scheduling task pool；

Real-time main control unit, for being adjusted the Real-Time Scheduling task being assigned in the Real-Time Scheduling task pool in real time Degree processing, and the processing result of the asynchronous batch processing services is returned in real time.

14. the system as described in claim 11 or 13, which is characterized in that the Real-Time Scheduling module includes:

It is fully loaded with unit in real time, for when judging that Real-Time Scheduling task pool is fully loaded, then refusing scheduling and executing the Real-Time Scheduling times Business.

15. system as claimed in claim 11, which is characterized in that the asynchronous schedule module includes:

Asynchronous task creating unit, for creating corresponding asynchronous schedule task according to the asynchronous batch processing services；

Asynchronous task pool unit, the asynchronous schedule task for creating the asynchronous task creating unit are assigned to accordingly Asynchronous schedule task pool；

Asynchronous main control unit, the asynchronous schedule task for that will be assigned in the asynchronous schedule task pool carry out asynchronous tune Degree processing, and the processing result of the asynchronous batch processing services is returned.

16. the system as described in claim 11 or 15, which is characterized in that the asynchronous schedule module further include:

Asynchronous fully loaded unit, for when judge that asynchronous schedule task pool is fully loaded, then refusing to handle the asynchronous schedule task, or Person handles the asynchronous schedule task by initiating thread, or ignores the processing asynchronous schedule task.

17. system as claimed in claim 11, which is characterized in that the Real-Time Scheduling module or the asynchronous schedule module packet It includes:

Data slicer unit obtains described asynchronous for the data of the asynchronous batch processing services to be carried out data slicer processing The slice of data of batch processing services；

Data Concurrent unit, the slice of data for being obtained to the data slicer unit carry out multithreading batch task and Hair processing.

18. system as claimed in claim 11, which is characterized in that system further include:

Priority management module, for carrying out Real-Time Scheduling processing to the asynchronous batch processing services when the Real-Time Scheduling module Or when the asynchronous schedule module carries out asynchronous schedule processing to the asynchronous batch processing services, at described asynchronous batch The type of service and/or business of reason business need, and carry out priority level setting to the asynchronous batch processing services；

The Real-Time Scheduling module carries out Real-Time Scheduling processing or the asynchronous schedule module to the asynchronous batch processing services Carrying out asynchronous schedule processing to the asynchronous batch processing services includes:

According to the priority level that the priority management module is set, preferentially the asynchronous batch processing services high to priority level are carried out Dispatch deal.

19. system as claimed in claim 11, which is characterized in that system further include:

Precontract task module, for analyzing the asynchronous batch processing services according to type of service when asynchronous analysis module as reservation When task, precontract task processing is carried out to the asynchronous batch processing services；

The precontract task module includes:

Periodic task unit, for the precontract task to be divided into periodicity according to scheduling time when the precontract task module When task, time interval setting is scheduled to the periodic task, the scheduling is separated by the asynchronous batch processing services Time interval carries out periodical training in rotation scheduling and executes；

Timed task unit, for being executed when the precontract task is divided into timing according to scheduling time by the precontract task module When task, the timing, which is executed task and is scheduled, allows the period to be arranged, to the asynchronous batch processing in the permission Between be timed business in section and execute processing.

20. system as claimed in claim 11, which is characterized in that system further include:

Message pushing module, for carrying out Real-Time Scheduling processing knot to the asynchronous batch processing services in the Real-Time Scheduling module Asynchronous schedule after treatment is carried out to the asynchronous batch processing services after beam or in the asynchronous schedule module, by asynchronous Message queue is to client push task processing result.