CN106375241A - Batch data processing method, front-end system, host and batch data processing system - Google Patents
Batch data processing method, front-end system, host and batch data processing system Download PDFInfo
- Publication number
- CN106375241A CN106375241A CN201610754742.2A CN201610754742A CN106375241A CN 106375241 A CN106375241 A CN 106375241A CN 201610754742 A CN201610754742 A CN 201610754742A CN 106375241 A CN106375241 A CN 106375241A
- Authority
- CN
- China
- Prior art keywords
- transaction
- data
- transaction data
- processing result
- main frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/625—Queue scheduling characterised by scheduling criteria for service slots or service orders
- H04L47/6275—Queue scheduling characterised by scheduling criteria for service slots or service orders based on priority
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/6245—Modifications to standard FIFO or LIFO
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
Abstract
The invention provides a batch data processing method, a front-end system, a host and a batch data processing system. The method comprises the following steps: acquiring transaction data to be processed submitted by a user; sorting the transaction data to be processed according to a processing type of the transaction data to be processed, and extracting transaction data needing to be processed by the host; temporarily storing the transaction data needing to be processed by the host, and meanwhile generating an unprocessed transaction record of which a main key is a user transaction ID (Identity); de-queueing the temporarily-stored transaction data in a first-in first-out way, summarizing the de-queued transaction data and transmitting the summarized transaction data to the host in batches; and acquiring a transaction processing result generated by the host according to the transaction data, updating a state of a corresponding unprocessed transaction record according to the transaction processing result, and meanwhile feeding back the state of the corresponding unprocessed transaction record to the user. Through adoption of the batch data processing method, the front-end system, the host and the batch data processing system, the problem of system bottleneck caused by high transaction concurrence is solved; the network bandwidth pressure is lowered; the data processing efficiency is increased; the stability of the system in the case of data concurrence is improved; and the production security is ensured.
Description
Technical field
The present invention relates to computer data interaction technique field, particularly to a kind of batch data processing method, front end system
System, main frame and batch data processing system.
Background technology
With the high speed development of the Internet, the information system of large enterprise is more and more extensive, the friendship between different application systems
Mutually more and more frequent, Data Concurrent amount is increasing, and the load balancing between each application system is always asking of the continuous concern of enterprise
Topic.Meanwhile, the outburst of concentrating of some period trading volumes is likely to result in the blocking of the data transfer between system, and strong influence produces
The experience of stable and client.For example, the equity fund that stock exchange's closing quotation time point occurs buys and sells peak, railway ticketing system spring
Occur between Yunqi robs ticket, double 11 panic buyings of Taobao, often occurs that instantaneous data concurrency is huge to lead to system overload operation,
Appearance resource is seized and leads to a large amount of transmission datas to block and occur network delay, the phenomenon of data processing failure, cause the user
Certain economic loss, also causes larger negative effect to enterprise simultaneously.Therefore, how effectively solving data volume is concentrated
Data transfer data treatment effeciency during outburst, is increasingly becoming the problem of large enterprise's information system urgent need to resolve.
Content of the invention
For solve above-mentioned technical problem, the invention provides a kind of batch data processing method, front end system, main frame and batch
Amount data handling system.
One aspect of the present invention provides a kind of batch data processing method, and described batch data processing method includes:
Obtain the pending transaction data that user submits to；
Process type according to described pending transaction data sorts to described pending transaction data, extracts and needs
Want the transaction data of host process；
Keep in the described transaction data needing host process, generate the untreated friendship that a major key is customer transaction id simultaneously
Easily record；
Temporary transaction data is fallen out according to the mode of FIFO, and sends out after the transaction data fallen out is collected in batches
Give main frame；
Obtain the trading processing result that described main frame generates according to described transaction data, and according to described trading processing result
Update the state of corresponding untreated transaction record, feed back to user simultaneously.
In one embodiment, keep in the described transaction data needing host process, comprising: by the described host process that needs
Transaction data is ranked wait according to default transaction priority, queue waiting time is exceeded to the friendship of default waiting time
Easily data, by transaction data, according to queue waiting time, order from long to short is fallen in lines.
In one embodiment, described batch data processing method also includes:
When the trading processing result failing to obtain described main frame generation, the pending number of deals being resubmited according to user
According to generation one comprises the to be confirmed of customer transaction id orders and be sent to described main frame；
Receive the trading processing result that described main frame is returned based on described order to be confirmed, and tied according to described trading processing
Fruit updates the state of corresponding untreated transaction record and feeds back to user.
In one embodiment, described batch data processing method also includes:
Periodically obtain the transaction results file that described main frame generates, wherein, described transaction results according to described transaction data
File comprises at least one trading processing result；
According to described transaction results file described untreated transaction record is hooked to and update, will because with described main frame
The doubtful account transaction results that Communications failure leads to feed back to user.
In one embodiment, described batch data processing method also includes:
Obtaining the transaction results file that described main frame generates t+1 day according to described transaction data, wherein, described transaction
Destination file comprises at least one trading processing result, and t is the day of trade of described transaction data；
Inquired about according to the customer transaction id in described untreated transaction record and in described transaction results file, whether there is phase
The trading processing result answered；
If it is not, then the status modifier of described untreated transaction record is to send main frame to fail and feed back to user；
If it is, by the status modifier of described untreated transaction record be processed, and hook to after the completion of will correspond to
Trading processing result be sent to user.
Present invention also offers a kind of batch data processing method, described batch data processing method includes:
Receive and need the transaction data of processing locality, and described transaction data is kept in treating in batch processing queue；
Data characteristic according to described transaction data is classified to the described transaction data treated in batch processing queue；
The transaction data finishing to classifying carries out multiple batches of concurrent processing and logical process, obtains trading processing result simultaneously
Output, and the status indication of described trading processing result is back pass.
In one embodiment, described batch data processing method also includes: the trading processing result of the non-back pass of periodic scanning,
When the accumulated quantity of the described trading processing result of non-back pass reaches predetermined number, by the described trading processing result of non-back pass
Export after collecting, and the status indication of described trading processing result is back pass.
In one embodiment, described batch data processing method also includes: the trading processing result of the non-back pass of periodic scanning,
After reaching the default waiting time upper limit, export after the described trading processing result of non-back pass is collected, and by described transaction
The status indication of result is back pass.
In one embodiment, described batch data processing method also includes: after on the same day day of trade, the business hours terminated, sweeps
Retouch processed transaction data corresponding trading processing result of the described same day day of trade, and generate transaction results file and export.
In one embodiment, described batch data processing method also includes:
Receive the order to be confirmed comprising customer transaction id；
Comprised at the transaction of at least one trading processing result according to the customer transaction id inquiry in described order to be confirmed
Reason file, and the trading processing result related to described customer transaction id is exported.
Another aspect of the present invention additionally provides a kind of front end system, and described front end system includes:
Transaction data acquiring unit, for obtaining the pending transaction data of user's submission；
Transaction data sorting unit, for the process type according to described pending transaction data to described pending transaction
Data is sorted, and extracts the transaction data needing host process；
Buffer unit, for keeping in the described transaction data needing host process, generates a major key simultaneously and hands over for user
The easily untreated transaction record of id；
Transaction data delivery unit, for temporary transaction data is fallen out according to the mode of FIFO, and will fall out
Transaction data collect after be sent to main frame in batches；
Result receiving unit, for receiving the trading processing result that described main frame generates according to described transaction data,
And the state according to the described trading processing result corresponding untreated transaction record of renewal, feed back to user simultaneously.
In one embodiment, described buffer unit includes a monitoring process module, for by the described host process that needs
Transaction data is ranked wait according to default transaction priority, queue waiting time is exceeded to the friendship of default waiting time
Easily data, by transaction data, according to queue waiting time, order from long to short is fallen in lines.
In one embodiment, described front end system also includes:
Order signal generating unit to be confirmed, for when failing to obtain the trading processing result that described main frame generates, according to
The pending transaction data that family is resubmited, generation one comprises the to be confirmed of customer transaction id orders and is sent to described main frame；
First feedback unit, for receiving the trading processing result that described main frame is returned based on described order to be confirmed, and
The state of corresponding untreated transaction record is updated according to described trading processing result and feeds back to user.
In one embodiment, described front end system also includes:
Lock unit, obtains, for regular, the transaction results file that described main frame generates according to described transaction data, wherein,
Described transaction results file comprises at least one trading processing result；
Second feedback unit, for according to described transaction results file described untreated transaction record is hooked to and more
Newly, user will be fed back to because of the doubtful account transaction results unsuccessfully leading to described host communication.
In one embodiment, described front end system also includes:
File obtaining unit, for obtaining the transaction knot generating with described main frame t+1 day according to described transaction data
Fruit file, wherein, described transaction results file comprises at least one trading processing result, and t is the day of trade of described transaction data；
Query unit, for inquiring about described transaction results file according to the customer transaction id in described untreated transaction record
In whether there is corresponding trading processing result；
3rd feedback unit, for when the Query Result of described query unit is no, by described untreated transaction record
Status modifier be send main frame failure, and when described query unit Query Result be when, by described untreated transaction
Record status modifier be processed, and hook to after the completion of corresponding trading processing result is sent to user.
One aspect of the present invention additionally provides a kind of batch data and processes main frame, and described main frame includes:
Data receipt unit, needs the transaction data of processing locality for receiving, and described transaction data is kept in treating
In batch processing queue；
Taxon, for the data characteristic according to described transaction data to the described transaction data treated in batch processing queue
Classified；
Data processing unit, the transaction data for finishing to classifying carries out multiple batches of concurrent processing and logical process,
Obtain trading processing result and export, and the status indication of described trading processing result is back pass.
In one embodiment, described main frame also includes: result back pass unit, for the transaction of the non-back pass of periodic scanning
Result, when the accumulated quantity of the trading processing result of non-back pass reaches predetermined number, at the described transaction of non-back pass
Reason result exports after collecting, and the status indication of described trading processing result is back pass.
In one embodiment, described result back pass unit is additionally operable to: the trading processing result of the non-back pass of periodic scanning,
After reaching the default waiting time upper limit, export after the described trading processing result of non-back pass is collected, and by described transaction
The status indication of result is back pass.
In one embodiment, described main frame also includes: file generating unit, for terminating in the business hours same day day of trade
Afterwards, scan processed transaction data of the described same day day of trade and generate transaction results file and export.
In one embodiment, described main frame also includes:
Order receiving unit to be confirmed, for receiving the order to be confirmed comprising customer transaction id；
Searching unit, for comprising at least one trading processing result according to the transaction id inquiry in described order to be confirmed
Trading processing file, by related to described customer transaction id trading processing result output.
In addition the present invention also provides a kind of batch data processing system, and described batch data processing system includes: described
Front end system and described main frame.
Batch data processing method, front end system, main frame and the batch data processing system being provided using the present invention, in meter
Reasonably organize and design system structure in calculation machine system, by the convenience of front end system receiving data and host process data
High efficiency is effectively combined, and solves the system bottleneck problem that transaction high concurrent amount causes.Front end system receive user data is simultaneously
Sorted and extracted, using queue storage and pipeline schedule mechanism, sent host process after cohersive and integrated data, simultaneously in batches
Main frame, by the multiple batches of interaction times carrying out concurrent processing, decreasing front end system and main frame, reduces the pressure of the network bandwidth
And improve the treatment effeciency of data；Meanwhile, the small lot concurrent processing mode that main frame adopts compares a large amount of single concurrent processing
In hgher efficiency, be not easy to occur data blocking, thus substantially increase the stability when Data Concurrent breaks out for the system it is ensured that
Production safety.
Brief description
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Have technology description in required use accompanying drawing be briefly described it should be apparent that, drawings in the following description be only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, acceptable
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the flow chart of embodiment of the present invention batch data processing method；
Fig. 2 is the flow chart of another embodiment of the present invention batch data processing method；
The flow chart of the batch data processing method for embodiment of the present invention interaction for the Fig. 3；
Fig. 4 is the structural representation of embodiment of the present invention front end system；
Fig. 5 processes the structural representation of main frame for embodiment of the present invention batch data；
Fig. 6 is the structural representation of embodiment of the present invention batch data processing system.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation description is it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of not making creative work
Embodiment, broadly falls into the scope of protection of the invention.
Fig. 1 is the schematic flow sheet of embodiment of the present invention batch data processing method.As shown in figure 1, at this batch data
Reason method mainly comprises the steps that
The pending transaction data that step s10, acquisition user submit to.
Step s11, according to the process type of pending transaction data obtaining, pending transaction data is sorted, carry
Take out the transaction data needing host process.
The transaction data needing host process extracting in step s12, temporary step s11, generates a major key simultaneously
Untreated transaction record for customer transaction id.
Step s13, temporary transaction data is fallen out according to the mode of FIFO, and the transaction data fallen out is collected
It is sent to main frame afterwards in batches.
When being sent to main frame after the transaction data fallen out is collected, it is possible to use universal gateway agreement is to going out columns in batches
According to being packed, it is sent to main frame and is processed.Decrease by the way of a plurality of transaction data transmits and interact with main frame
Number of times, reduce the pressure of the network bandwidth and improve the treatment effeciency of transaction data.
The trading processing result that step s14, acquisition main frame generate according to above-mentioned transaction data, and tied according to this trading processing
Fruit updates the state of corresponding untreated transaction record, feeds back to user simultaneously.
Normally, after obtaining the trading processing result that main frame generates, according to gateway protocol, data need to be resolved to locally
Discernible type, is updated the unification it is ensured that with main frame end data to the state of untreated transaction record.
Using batch data processing method receive user provided in an embodiment of the present invention submit to pending transaction data simultaneously
Sorted and extracted, using queue storage and pipeline schedule mechanism, after cohersive and integrated data, sent host process in batches, reduced
Interaction times with main frame, reduce the pressure of the network bandwidth and improve the treatment effeciency of data.
In one embodiment, after extracting the transaction data needing host process, keeping in step s12 needs host process
Transaction data when accordingly it will usually be desirable to the transaction data of host process is ranked wait according to default transaction priority, right
Exceed the transaction data of default waiting time in queue waiting time, by transaction data according to queue waiting time from long to short
Order is fallen in lines.For example, the transaction data of high priority is first fallen in lines, and the transaction data of low priority is waited in line, pre- for exceeding
If the transaction data of maximum latency, waiting time the longest preferentially falling in lines, when falling out, then the priority according to queue establishment is suitable
Sequence, that is, the principle of first in first out carry out.
Using setting trading processing priority strategy, be batched transaction data process provide more spaces,
Improve Consumer's Experience.
Usually, when network occurs time delay or interrupts even hardware failure, lead to fail successfully to obtain from host side
When taking the trading processing result that it generates, user is needed to resubmit the transaction application comprising pending transaction data, using this
The batch data processing method that inventive embodiments provide, generates one according to the pending transaction data that user resubmits and comprises
The order to be confirmed of customer transaction id, and this order to be confirmed is sent to main frame, actively to initiate trading processing result really
Recognize；Then, the trading processing result that Receiving Host is returned based on described order to be confirmed, and according to described trading processing result more
The state of newly corresponding untreated transaction record simultaneously feeds back to user.
In addition to the trading processing result that Receiving Host generates, can also periodically be obtained using method provided in an embodiment of the present invention
Take the transaction results file (transaction results file comprises at least one trading processing result) that main frame generates according to transaction data, with
Reduce the interaction times with main frame.After the transaction results file acquiring main frame generation, according to this transaction results file pair
Untreated transaction record hooked to, update, if there is the doubtful account transaction results because unsuccessfully leading to host communication, then should
Doubtful account transaction results feed back to user.
Except above-mentioned active is from main frame obtains transaction results file, the method using the embodiment of the present invention can also be in t+
The transaction results file that acquisition main frame on the 1st generates according to transaction data, wherein t is the day of trade of transaction data.Because main frame exists
The same day day of trade would generally process large number of transaction data, so also comprising multiple friendships in transaction results file accordingly
Disposable result.Then, inquired about in above-mentioned transaction results file according to the customer transaction id in untreated transaction record and whether deposit
In trading processing result corresponding with this transaction data.If it does not, explanation fails transaction data is sent at host side
Reason, then feed back to user by the status modifier of corresponding for this transaction data untreated transaction record for sending main frame failure, colleague.
If there is trading processing result corresponding with this transaction data in transaction results file, do not locate corresponding for this transaction data
Reason transaction record status modifier be processed, and hook to after the completion of corresponding trading processing result is sent to user.Can
To be sent to user by lettergram mode it is also possible to be sent to user by short message mode, the present invention is not limited thereto.
Carry out hooking right, effectively solution using the situation that batch data processing method provided in an embodiment of the present invention doubts account to transaction
Interaction data of having determined loss cause inter-system data disunity, data syn-chronization not in time the problems such as.
Fig. 2 is the flow chart of another embodiment of the present invention batch data processing method.As shown in Fig. 2 at this batch data
Reason mainly completes in host side, mainly comprises the steps that
Step s20, receive and need the transaction data of processing locality, and this transaction data is kept in treating batch processing queue.
Usually, after receiving the transaction data needing processing locality, need to be resolved to discernible according to gateway protocol
Data type, stores to treating in batch processing queue simultaneously.
Step s21, according to the data characteristic of transaction data, the described transaction data treated in batch processing queue is classified.
For example according to transaction area, type of transaction, transaction data can be classified, to shorten the process time of transaction data, improve
Treatment effeciency.
Step s22, the transaction data finishing to classifying carry out multiple batches of concurrent processing and logical process, obtain at transaction
Reason result simultaneously exports, and the status indication of described trading processing result is back pass.Back pass herein refers to trading processing
Result exports to the one end sending transaction data.
After obtaining trading processing result, generally trading processing result need to be packaged after packing again according to gateway protocol
Output.
Using batch data processing method provided in an embodiment of the present invention to transaction data and concurrent processing after classifying
Mode, be effectively improved the treatment effeciency of transaction data, solve the system bottleneck of high concurrent amount.
In one embodiment, in order to ensure to export all of trading processing result, lot number provided in an embodiment of the present invention
Also include according to processing method, the trading processing result of the non-back pass of periodic scanning, when the accumulative total of the trading processing result of non-back pass
When amount reaches predetermined number, export after the trading processing result of non-back pass is collected, and the shape by corresponding trading processing result
State is labeled as back pass.
In addition to the mode that the accumulated quantity according to trading processing result exports trading processing result, the embodiment of the present invention is also
Can be according to the mode timing output trading processing result of time, i.e. the trading processing result of the non-back pass of periodic scanning, when reaching
After the default waiting time upper limit, export after the trading processing result of non-back pass is collected, and by corresponding trading processing result
Status indication be back pass.
Usually, the transaction data amount on the same day day of trade is very big, in order to avoid reducing the efficiency processing transaction data, this
Bright embodiment after generally business terminated on the same day day of trade, scans this same day day of trade processed transaction data, and scans
These transaction data corresponding trading processing result exports after generating transaction results file.
In one embodiment, the batch data processing method that the present invention provides also includes: receives and comprises customer transaction id's
Order to be confirmed；According to the customer transaction id inquiry trading processing file in this order to be confirmed, if in transaction results file
When there is trading processing record corresponding with this customer transaction id, this trading processing result is exported.
The embodiment of the present invention compares the in hgher efficiency of a large amount of single concurrent processing using small lot concurrent processing mode, also not
Data blocking easily occurs, thus substantially increasing the stability when Data Concurrent breaks out for the system it is ensured that production safety.
The flow chart of the batch data processing method for embodiment of the present invention interaction for the Fig. 3.As shown in figure 3, the method be
Two ends complete, after obtaining the pending transaction data (step s10) that user submits to, according to the process of pending transaction data
Type sorts to it, extracts and needs the transaction data of host process (step s11) and keep in, and generates a major key simultaneously
Untreated transaction record (step s12) for customer transaction id；Then by temporary transaction data according to FIFO mode
Fall out, and be sent to main frame (step s13) after the transaction data fallen out is collected in batches.Main frame receives the friendship needing processing locality
Easily after data, kept in treating (step s20) in batch processing queue；According to the data characteristic of temporary transaction data pile up into
Row classification (step s21)；The transaction data finishing to classifying carries out multiple batches of concurrent processing and logical process, obtains at transaction
Reason result simultaneously exports, and is back pass (step s22) by the status indication of trading processing result simultaneously.Obtain the transaction that main frame generates
Result, and the state of untreated transaction record accordingly is updated according to trading processing result, and feed back to user's (step in time
Rapid s14).
Using the embodiment of the present invention, the system bottleneck problem that transaction data high concurrent amount causes can be solved, reduce network
The pressure of bandwidth, improves the treatment effeciency of data simultaneously.
Based on the batch data processing method identical inventive concept shown in Fig. 1, the embodiment of the present application additionally provides one
Plant front end system, as described in example below.Principle and batch data process side in Fig. 1 due to this front end system solve problem
Method is similar, and the enforcement of therefore this front end system may refer to the enforcement of the batch data processing method of Fig. 1, no longer superfluous in place of repetition
State.
In another embodiment, present invention also offers a kind of front end system, its structural representation is as shown in figure 4, before this
End system specifically includes that transaction data acquiring unit 11, transaction data sorting unit 12, buffer unit 13, transaction data transmission
Unit 14 and result receiving unit 15.
Transaction data acquiring unit 11 is used for obtaining the pending transaction data of user's submission.Transaction data sorting unit 12
For the process type according to pending transaction data, pending transaction data is sorted, extract and need host process
Transaction data.Buffer unit 13 is used for the temporary transaction data needing host process, and generate a major key is customer transaction simultaneously
The untreated transaction record of id.Transaction data delivery unit 14 is used for going out temporary transaction data according to the mode of FIFO
Row, and it is sent to main frame after the transaction data fallen out is collected in batches.Result receiving unit 15 be used for Receiving Host according to
The trading processing result that transaction data generates, and the shape of corresponding untreated transaction record is updated according to this trading processing result
State, feeds back to user simultaneously.
In one embodiment, the buffer unit 13 in the embodiment of the present invention includes a monitoring process module, for handing over
The transaction data of host process that what easily data acquisition unit 12 sorted out need is ranked wait according to default transaction priority,
Queue waiting time is exceeded to the transaction data of default waiting time, by transaction data according to queue waiting time from long to short
Order fall in lines.
Front end system in the embodiment of the present invention generally also includes an order signal generating unit 16 to be confirmed and feedback unit 17.
Order signal generating unit 16 to be confirmed is used for, when the trading processing result failing to obtain main frame generation, being resubmited according to user
Pending transaction data, generation one comprises the to be confirmed of customer transaction id orders and is sent to main frame.Feedback unit 17 is used for
The trading processing result that Receiving Host is returned based on order to be confirmed, and updated corresponding untreated according to this trading processing result
The state of transaction record, feeds back to user simultaneously.
In one embodiment, the front end system in the embodiment of the present invention also includes a lock unit 18 and feedback unit 19.
Lock unit 18 is used for the transaction results file that regular acquisition main frame generates, wherein, this transaction results file according to transaction data
Comprise at least one trading processing result.Feedback unit 19 is used for according to transaction results file, untreated transaction record being hooked
To and update, user will be fed back to because of the doubtful account transaction results unsuccessfully leading to host communication.
Front end system in the embodiment of the present invention also includes: file obtaining unit 20, query unit 21 and feedback unit 22.
Wherein, file acquisition list 20 is used for obtaining the transaction results file generating with main frame t+1 day according to transaction data, and t is to hand over
The day of trade of easy data.Query unit 21 is used for according to the customer transaction id inquiry transaction results file in untreated transaction record
In whether there is corresponding trading processing result.Feedback unit 22 is used for when the Query Result of query unit 21 is no, will not
The status modifier processing transaction record is to send main frame failure；And when the Query Result of query unit 21 is to be, will be corresponding
Untreated transaction record status modifier be processed, and hook to after the completion of corresponding trading processing result is sent to use
Family.
Using front end system receive user provided in an embodiment of the present invention submit to pending transaction data and sorted
And extraction, using queue storage and pipeline schedule mechanism, after cohersive and integrated data, send host process in batches, decrease and main frame
Interaction times, reduce the pressure of the network bandwidth and improve the treatment effeciency of data.
Based on the batch data processing method identical inventive concept shown in Fig. 2, the embodiment of the present application additionally provides one
Plant batch data and process main frame, as described in example below.Because this batch data processes principle and Fig. 2 of main frame solve problem
Middle batch data processing method is similar, and the enforcement of therefore this batch data process main frame may refer to the batch data process of Fig. 2
The enforcement of method, repeats no more in place of repetition.
Batch data provided in an embodiment of the present invention processes the structural scheme of mechanism of main frame as shown in figure 5, at this batch data
Reason main frame specifically includes that data receipt unit 31, taxon 32 and data processing unit 33.Wherein, data receipt unit 31
Need the transaction data of processing locality for receiving, and this transaction data is kept in treating in batch processing queue.Taxon 32
Classified for the transaction data in batch processing queue is treated according to the data characteristic of transaction data.Data processing unit 33 is used
Carry out multiple batches of concurrent processing and logical process in the transaction data finishing to classifying, obtain trading processing result and export,
Will trading processing result back pass to front end system, the status indication of above-mentioned trading processing result is back pass simultaneously.
Using the mode of main frame provided in an embodiment of the present invention concurrent processing to transaction data and after classifying, effectively
Improve the treatment effeciency of transaction data, solve the system bottleneck of high concurrent amount.
In one embodiment, the batch data process main frame in the embodiment of the present invention also includes result back pass unit
34, for the trading processing result of the non-back pass of periodic scanning, when the accumulated quantity of the trading processing result of non-back pass reach default
During quantity, export after the trading processing result of non-back pass is collected, and the status indication of corresponding trading processing result is
Back pass.
Normally, in addition to the mode that the accumulated quantity according to trading processing result exports trading processing result, process knot
Fruit back pass unit 34 can also be according to the mode timing output trading processing result of time, that is, at the transaction of the non-back pass of periodic scanning
Reason result, after reaching the default waiting time upper limit, exports after the described trading processing result of non-back pass is collected, and by institute
The status indication stating trading processing result is back pass.
In one embodiment, above-mentioned batch data processes main frame and also includes a file generating unit 35, in transaction
After day business hours on the same day terminate, the trading processing result of the scanning same day day of trade processed transaction data, and generate transaction
Destination file exports.
Usually, batch data process main frame provided in an embodiment of the present invention also includes an order receiving unit 36 to be confirmed
And searching unit 37.Wherein, order receiving unit 36 to be confirmed is used for receiving the order to be confirmed comprising customer transaction id.Search
Unit 37 is used for being inquired about according to the transaction id in order to be confirmed and comprises the trading processing file of multiple trading processing results, will be with
The related trading processing result output of customer transaction id in order to be confirmed.
The embodiment of the present invention compares the in hgher efficiency of a large amount of single concurrent processing using small lot concurrent processing mode, also not
Data blocking easily occurs, thus substantially increasing the stability when Data Concurrent breaks out for the system it is ensured that production safety.
Fig. 6 is the structural representation of embodiment of the present invention batch data processing system.As shown in fig. 6, at this batch data
Reason system includes the front end system shown in Fig. 4 and the batch data shown in Fig. 5 processes main frame.Transaction data acquiring unit 11 is responsible for
In the transaction data of terminal typing, front end system starts transaction data sorting unit 12 and the transaction data obtaining is entered collection user
Row sorting, extracts the transaction data needing host process, is simultaneously stored in buffer unit 13, and is transmitted single by transaction data
Unit 14 is responsible for falling out from buffer unit 13 being sent to main frame.Data receipt unit 31 in main frame receives transaction data transmission
The pending transaction data of unit 14 transmission simultaneously completes into column processing, stores and treats in batch processing queue.Taxon 32 basis
Treat that the data type of transaction data in batch processing queue is classified to it, the transaction data to point good class for the data processing unit 33
Obtain trading processing result after carrying out multiple batches of concurrent processing and logical process, and this trading processing result is exported.Process knot
The trading processing result of the non-back pass of fruit back pass unit 34 periodic scanning, reaches the upper limit in accumulative record number to be sent or waiting time
After be sent to front end system, completed the synchronization of transaction data in front end system by result receiving unit 15.File generated list
The trading processing result of transaction data is scanned after the business hours terminate in the day of trade in unit 35, and is generated according to trading processing result and hand over
Easily destination file exports to front end system, by the file obtaining unit 20 synchronous system ensureing front end system and host data again
One.
Monitoring process module in buffer unit 13 will need the transaction data of host process to fall in lines strategy ginseng according to transaction
In number table, default transaction priority is kept in, and generates a untreated transaction record simultaneously, and major key is customer transaction id.Adopt
With the strategy by parameter setting for the trading processing priority, it is that the flexible customization of system provides more spaces, improves user
Experience.
Transaction data delivery unit 14, before the transaction data being temporarily stored in buffer unit 13 is sent to main frame, uses
Universal gateway agreement is packaged to the transaction data fallen out packing, and is sent to main frame, to reduce front end system and main frame in batches
Interaction times, the pressure reducing the network bandwidth and the treatment effeciency that improve batch data processing system.
Data receipt unit 31 after receiving the incoming transaction data of front end system, according to gateway protocol by transaction data
Resolve to the type that main frame can identify, and store and treat in batch processing queue.
The transaction data in batch processing queue is treated in taxon 32 analysis, according to data characteristic (for example conclude the business area, transaction
Type) transaction data to be classified, host side log-on data processing unit 33 carries out multiple batches of to the transaction data of point good class
Concurrent processing, front end system is returned in back pass after simultaneously encapsulating result by gateway protocol.At to transaction data classification
The mode of reason, takes full advantage of the efficient disposal ability of main frame, improves the overall treatment effeciency of batch data processing system.
After result receiving unit 15 receives the trading processing result of main frame back pass, according to gateway protocol by data solution
Analyse the type that can identify for front end system, and update the untreated transaction note in front end system according to this trading processing result
Record, feeds back to user simultaneously.
When network occurs time delay or interrupts even hardware failure, front end system cannot normally receive main frame and return
Trading processing result, user resubmits the transaction comprising transaction data and applies for order signal generating unit 16 to be confirmed, actively
Initiate the confirmation of trading processing result.Order signal generating unit 16 to be confirmed is passed through to obtain customer transaction id and be sent to main frame, by
After order receiving unit 36 to be confirmed receives, searching unit 37 inquiry trading processing destination file simultaneously returns and customer transaction id
Related trading processing result, feedback unit 17 updates the shape of the accordingly untreated transaction record of front end system after completing to confirm
State, feeds back to user simultaneously.
The transaction data of result back pass unit 34 periodic scanning host process, or the result of transaction data,
Carrying out timing or counting when finding the trading processing result of non-back pass, the trading processing result of such as non-back pass reaches necessarily
Quantity or certain time (can according to preset tuning) automatically collect afterwards and are sent to front end system, identify this transaction simultaneously
The state of result is back pass.
Lock unit 18 is used for the regular transaction combing result obtaining host side generation, completes transaction data in front end system
Hook to, update, when occurring concluding the business because of the doubtful account that front end system and host communication unsuccessfully lead to, feedback unit 19 is by this result
Feed back to user.By the pattern of this real-time synchronization can effectively improve that data in front end system updates ageing, also lifted
Customer experience.
After in the day of trade, the business hours terminate, the file generating unit 35 scanning main frame same day of host side completes the friendship processing
Easy data and the trading processing result of each transaction data, generate transaction results file, so that front end system carries out data syn-chronization
Process.
Front end system, in t+1 day startup file acquiring unit 20, obtains the transaction results file that host side generates, to front
It is right that untreated transaction record in end system carries out hooking.The customer transaction id inquiry by untreated transaction record for the query unit 21
Whether there is corresponding trading processing result in transaction results file, if there is no corresponding trading processing result, then start
The status modifier of this untreated transaction record is to send main frame failure by feedback unit 22；If there is corresponding trading processing knot
Really, then the status modifier of untreated for this in front end system transaction record is processed, hook to after the completion of by note or
Trading processing result is fed back to user by the form of mail.
In one embodiment, file obtaining unit 20 can also generate transaction flow Monitoring Data according to Hosts file, is
Embodiment of the present invention batch data processing system tuning provides reference, is downloaded by transaction results full dose, the process of full dose verification
Pattern ensure that the unification of front end system and host data, and the risk interacting between front end system and main frame is reduced further.
Batch data processing system provided in an embodiment of the present invention uses front end system receive user transaction data, and to it
Sorted and extracted, collected using queue storage and Flow-shop mechanism and after transaction data, be sent to main frame, complete by main frame
Become multiple batches of concurrent processing, reduce the interaction times of front end system and main frame, reduce the pressure of the network bandwidth and improve
The treatment effeciency of data.
Present invention utilizes the motility of front end system data access, transaction data is sorted and is extracted, data
Core processing be placed on host side, using the efficient data processing speed of main frame improve data-handling efficiency, reduce data processing
Time, and deploy multiple synchronization device (include active synchronization device and passive and synchronous device) it is ensured that data syn-chronization
Promptness and effectiveness, problem is lost in the transaction solving high concurrent amount data handling system.Further, using the present invention, greatly
Improve greatly overall system performance capacity and data-handling efficiency, reduce the resource consumption of system, reduce enterprise's O＆M and become
This, improve Consumer's Experience, improve overall economic benefit.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the present invention can be using complete hardware embodiment, complete software embodiment or the reality combining software and hardware aspect
Apply the form of example.And, the present invention can be using in one or more computers wherein including computer usable program code
The upper computer program implemented of usable storage medium (including but not limited to disk memory, cd-rom, optical memory etc.) produces
The form of product.
The present invention is the flow process with reference to method according to embodiments of the present invention, equipment (system) and computer program
Figure and/or block diagram are describing.It should be understood that can be by each stream in computer program instructions flowchart and/or block diagram
Flow process in journey and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processor instructing general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device is to produce
A raw machine is so that produced for reality by the instruction of computer or the computing device of other programmable data processing device
The device of the function of specifying in present one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide computer or other programmable data processing device with spy
Determine in the computer-readable memory that mode works so that the instruction generation inclusion being stored in this computer-readable memory refers to
Make the manufacture of device, this command device realize in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or
The function of specifying in multiple square frames.
These computer program instructions also can be loaded in computer or other programmable data processing device so that counting
On calculation machine or other programmable devices, execution series of operation steps to be to produce computer implemented process, thus in computer or
On other programmable devices, the instruction of execution is provided for realizing in one flow process of flow chart or multiple flow process and/or block diagram one
The step of the function of specifying in individual square frame or multiple square frame.
Apply specific embodiment in the present invention principle of the present invention and embodiment are set forth, above example
Explanation be only intended to help and understand the method for the present invention and its core concept；Simultaneously for one of ordinary skill in the art,
According to the thought of the present invention, all will change in specific embodiments and applications, in sum, in this specification
Hold and should not be construed as limitation of the present invention.
Claims (21)
1. a kind of batch data processing method is it is characterised in that described batch data processing method includes:
Obtain the pending transaction data that user submits to；
Process type according to described pending transaction data sorts to described pending transaction data, extracts and needs to lead
The transaction data that machine is processed；
Keep in the described transaction data needing host process, generate the untreated transaction note that a major key is customer transaction id simultaneously
Record；
Temporary transaction data is fallen out according to the mode of FIFO, and is sent to after the transaction data fallen out is collected in batches
Main frame；
Obtain the trading processing result that described main frame generates according to described transaction data, and updated according to described trading processing result
The state of corresponding untreated transaction record, feeds back to user simultaneously.
2. batch data processing method according to claim 1 is it is characterised in that keep in the described friendship needing host process
Easily data, comprising: the described transaction data needing host process is ranked wait according to default transaction priority, for
Queue waiting time exceedes the transaction data of default waiting time, by transaction data according to queue waiting time from long to short suitable
Sequence is fallen in lines.
3. batch data processing method according to claim 1 is it is characterised in that described batch data processing method is also wrapped
Include:
When the trading processing result failing to obtain described main frame generation, the pending transaction data being resubmited according to user,
Generation one comprises the to be confirmed of customer transaction id orders and is sent to described main frame；
Receive the trading processing result that described main frame is returned based on described order to be confirmed, and according to described trading processing result more
The state of newly corresponding untreated transaction record simultaneously feeds back to user.
4. batch data processing method according to claim 1 is it is characterised in that described batch data processing method is also wrapped
Include:
Periodically obtain the transaction results file that described main frame generates, wherein, described transaction results file according to described transaction data
Comprise at least one trading processing result；
According to described transaction results file described untreated transaction record is hooked to and update, will because with described host communication
The doubtful account transaction results unsuccessfully leading to feed back to user.
5. batch data processing method according to claim 1 is it is characterised in that described batch data processing method is also wrapped
Include:
Obtaining the transaction results file that described main frame generates t+1 day according to described transaction data, wherein, described transaction results
File comprises at least one trading processing result, and t is the day of trade of described transaction data；
Inquired about in described transaction results file with the presence or absence of corresponding according to the customer transaction id in described untreated transaction record
Trading processing result；
If it is not, then the status modifier of described untreated transaction record is to send main frame to fail and feed back to user；
If it is, the status modifier of described untreated transaction record is processed, and hook to after the completion of by corresponding friendship
Disposable result is sent to user.
6. a kind of batch data processing method is it is characterised in that described batch data processing method includes:
Receive and need the transaction data of processing locality, and described transaction data is kept in treating in batch processing queue；
Data characteristic according to described transaction data is classified to the described transaction data treated in batch processing queue；
The transaction data finishing to classifying carries out multiple batches of concurrent processing and logical process, obtains trading processing result defeated
Go out, and the status indication of described trading processing result is back pass.
7. batch data processing method according to claim 6 is it is characterised in that described batch data processing method is also wrapped
Include: the trading processing result of the non-back pass of periodic scanning, when the accumulated quantity of the described trading processing result of non-back pass reach default
During quantity, export after the described trading processing result of non-back pass is collected, and the status indication of described trading processing result is
Back pass.
8. batch data processing method according to claim 6 is it is characterised in that described batch data processing method is also wrapped
Include: the trading processing result of the non-back pass of periodic scanning, after reaching the default waiting time upper limit, by the described transaction of non-back pass
Result exports after collecting, and the status indication of described trading processing result is back pass.
9. batch data processing method according to claim 6 is it is characterised in that described batch data processing method is also wrapped
Include: after on the same day day of trade, the business hours terminated, scan at the processed corresponding transaction of transaction data of the described same day day of trade
Reason result, and generate transaction results file and export.
10. batch data processing method according to claim 6 it is characterised in that described batch data processing method also
Including:
Receive the order to be confirmed comprising customer transaction id；
Comprise the trading processing literary composition of at least one trading processing result according to the customer transaction id inquiry in described order to be confirmed
Part, and the trading processing result related to described customer transaction id is exported.
A kind of 11. front end systems are it is characterised in that described front end system includes:
Transaction data acquiring unit, for obtaining the pending transaction data of user's submission；
Transaction data sorting unit, for the process type according to described pending transaction data to described pending transaction data
Sorted, extracted the transaction data needing host process；
Buffer unit, for keeping in the described transaction data needing host process, generate a major key is customer transaction id simultaneously
Untreated transaction record；
Transaction data delivery unit, for falling out temporary transaction data, and by the friendship fallen out according to the mode of FIFO
Easily it is sent to main frame after data summarization in batches；
Result receiving unit, for receiving the trading processing result that described main frame generates according to described transaction data, and root
Update the state of corresponding untreated transaction record according to described trading processing result, feed back to user simultaneously.
12. front end systems according to claim 11 are it is characterised in that described buffer unit includes a monitoring process mould
Block, for the described transaction data needing host process is ranked wait according to default transaction priority, for queuing
Waiting time exceedes the transaction data of default waiting time, and by transaction data, according to queue waiting time, order from long to short enters
Row.
13. front end systems according to claim 11 are it is characterised in that described front end system also includes:
Order signal generating unit to be confirmed, for when failing to obtain the trading processing result that described main frame generates, according to user's weight
The new pending transaction data submitted to, generation one comprises the to be confirmed of customer transaction id orders and is sent to described main frame；
First feedback unit, for receiving the trading processing result that described main frame is returned based on described order to be confirmed, and according to
Described trading processing result updates the state of corresponding untreated transaction record and feeds back to user.
14. front end systems according to claim 11 are it is characterised in that described front end system also includes:
Lock unit, the transaction results file being generated according to described transaction data for the described main frame of regular acquisition, wherein, described
Transaction results file comprises at least one trading processing result；
Second feedback unit, for being hooked to described untreated transaction record to according to described transaction results file and being updated,
User will be fed back to because of the doubtful account transaction results unsuccessfully leading to described host communication.
15. front end systems according to claim 14 are it is characterised in that described front end system also includes:
File obtaining unit, for obtaining the transaction results literary composition generating with described main frame t+1 day according to described transaction data
Part, wherein, described transaction results file comprises at least one trading processing result, and t is the day of trade of described transaction data；
Query unit, for being inquired about in described transaction results file according to the customer transaction id in described untreated transaction record be
No have corresponding trading processing result；
3rd feedback unit, for when the Query Result of described query unit is no, by the shape of described untreated transaction record
State is revised as sending main frame failure, and when the Query Result of described query unit is to be, by described untreated transaction record
Status modifier be processed, and hook to after the completion of corresponding trading processing result is sent to user.
A kind of 16. batch datas process main frame it is characterised in that described main frame includes:
Data receipt unit, for receiving the transaction data needing processing locality, and described transaction data is kept in pending place
In reason queue；
Taxon, is carried out to the described transaction data treated in batch processing queue for the data characteristic according to described transaction data
Classification；
Data processing unit, the transaction data for finishing to classifying carries out multiple batches of concurrent processing and logical process, obtains
Trading processing result simultaneously exports, and the status indication of described trading processing result is back pass.
17. main frames according to claim 16 are it is characterised in that described main frame also includes: result back pass unit, use
In the trading processing result of the non-back pass of periodic scanning, when the accumulated quantity of the trading processing result of non-back pass reaches predetermined number
When, export after the described trading processing result of non-back pass is collected, and the status indication of described trading processing result is to return
Pass.
18. main frames according to claim 17 are it is characterised in that described result back pass unit is additionally operable to: periodically sweep
Retouch the trading processing result of non-back pass, after reaching the default waiting time upper limit, by the described trading processing result of non-back pass
Export after collecting, and the status indication of described trading processing result is back pass.
19. main frames according to claim 16 are it is characterised in that described main frame also includes: file generating unit unit, use
After the business hours terminated on the same day day of trade, scan the trading processing knot of processed transaction data of the described same day day of trade
Really, and generate transaction results file output.
20. main frames according to claim 16 are it is characterised in that described main frame also includes:
Order receiving unit to be confirmed, for receiving the order to be confirmed comprising customer transaction id；
Searching unit, for comprising the friendship of at least one trading processing result according to the transaction id inquiry in described order to be confirmed
Disposable file, by the trading processing result output related to described customer transaction id.
A kind of 21. batch data processing systems are it is characterised in that described batch data processing system includes: claim 11-15
Front end system described in any one and the main frame described in any one of claim 16-20.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610754742.2A CN106375241B (en) | 2016-08-29 | 2016-08-29 | Batch data processing method, front-end system, host and batch data processing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610754742.2A CN106375241B (en) | 2016-08-29 | 2016-08-29 | Batch data processing method, front-end system, host and batch data processing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106375241A true CN106375241A (en) | 2017-02-01 |
| CN106375241B CN106375241B (en) | 2020-03-13 |
Family
ID=57900576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610754742.2A Active CN106375241B (en) | 2016-08-29 | 2016-08-29 | Batch data processing method, front-end system, host and batch data processing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106375241B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107273225A (en) * | 2017-06-16 | 2017-10-20 | 深圳易嘉恩科技有限公司 | High concurrent competition for orders function realizing method based on message queue |
| CN107809480A (en) * | 2017-10-25 | 2018-03-16 | 上海瀚银信息技术有限公司 | One kind transaction commutation system |
| CN107819696A (en) * | 2017-11-22 | 2018-03-20 | 中国银行股份有限公司 | A kind of transaction flow control method and system |
| CN108830715A (en) * | 2018-05-30 | 2018-11-16 | 平安科技（深圳）有限公司 | Disk processing method and system are returned in batch documents part |
| CN108876521A (en) * | 2018-06-04 | 2018-11-23 | 贵州数据宝网络科技有限公司 | A kind of high concurrent data transacting system and method |
| CN109102402A (en) * | 2018-07-26 | 2018-12-28 | 阿里巴巴集团控股有限公司 | A kind of monitoring method of transaction risk, device and system |
| CN109246077A (en) * | 2018-08-01 | 2019-01-18 | 广州唯品会信息科技有限公司 | Distributed concurrent transaction method of calibration, device and computer storage medium |
| CN109583859A (en) * | 2018-10-22 | 2019-04-05 | 中国平安人寿保险股份有限公司 | It trades in batches between multisystem task processing method and system |
| CN110866828A (en) * | 2019-10-15 | 2020-03-06 | 北京海益同展信息科技有限公司 | Method, apparatus, computer device and storage medium for processing blockchain data |
| CN112260952A (en) * | 2020-10-20 | 2021-01-22 | 四川天邑康和通信股份有限公司 | Wifi6 router rapid data access protection method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0446746A (en) * | 1990-06-11 | 1992-02-17 | Oki Electric Ind Co Ltd | Progress control system for batch processing |
| US20060095686A1 (en) * | 2004-10-29 | 2006-05-04 | Miller Wayne E | Management of I/O operations in data storage systems |
| CN101017546A (en) * | 2007-03-12 | 2007-08-15 | 中国建设银行股份有限公司 | Method and device for categorical data batch processing |
| CN101697536A (en) * | 2009-10-16 | 2010-04-21 | 深圳市科陆电子科技股份有限公司 | Method for transmitting mass data in real time by penetrating positive physical isolation device |
| CN101719153A (en) * | 2009-12-09 | 2010-06-02 | 中国工商银行股份有限公司 | Device and method for carrying out transmission processing on massive data files |
| CN102929585A (en) * | 2012-09-25 | 2013-02-13 | 上海证券交易所 | Batch processing method and system supporting multi-master distributed data processing |
| CN105760395A (en) * | 2014-12-18 | 2016-07-13 | 华为技术有限公司 | Data processing method, device and system |
-
2016
- 2016-08-29 CN CN201610754742.2A patent/CN106375241B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0446746A (en) * | 1990-06-11 | 1992-02-17 | Oki Electric Ind Co Ltd | Progress control system for batch processing |
| US20060095686A1 (en) * | 2004-10-29 | 2006-05-04 | Miller Wayne E | Management of I/O operations in data storage systems |
| CN101017546A (en) * | 2007-03-12 | 2007-08-15 | 中国建设银行股份有限公司 | Method and device for categorical data batch processing |
| CN101697536A (en) * | 2009-10-16 | 2010-04-21 | 深圳市科陆电子科技股份有限公司 | Method for transmitting mass data in real time by penetrating positive physical isolation device |
| CN101719153A (en) * | 2009-12-09 | 2010-06-02 | 中国工商银行股份有限公司 | Device and method for carrying out transmission processing on massive data files |
| CN102929585A (en) * | 2012-09-25 | 2013-02-13 | 上海证券交易所 | Batch processing method and system supporting multi-master distributed data processing |
| CN105760395A (en) * | 2014-12-18 | 2016-07-13 | 华为技术有限公司 | Data processing method, device and system |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107273225A (en) * | 2017-06-16 | 2017-10-20 | 深圳易嘉恩科技有限公司 | High concurrent competition for orders function realizing method based on message queue |
| CN107809480A (en) * | 2017-10-25 | 2018-03-16 | 上海瀚银信息技术有限公司 | One kind transaction commutation system |
| CN107819696A (en) * | 2017-11-22 | 2018-03-20 | 中国银行股份有限公司 | A kind of transaction flow control method and system |
| CN108830715A (en) * | 2018-05-30 | 2018-11-16 | 平安科技（深圳）有限公司 | Disk processing method and system are returned in batch documents part |
| CN108876521A (en) * | 2018-06-04 | 2018-11-23 | 贵州数据宝网络科技有限公司 | A kind of high concurrent data transacting system and method |
| CN109102402A (en) * | 2018-07-26 | 2018-12-28 | 阿里巴巴集团控股有限公司 | A kind of monitoring method of transaction risk, device and system |
| CN109246077A (en) * | 2018-08-01 | 2019-01-18 | 广州唯品会信息科技有限公司 | Distributed concurrent transaction method of calibration, device and computer storage medium |
| CN109583859A (en) * | 2018-10-22 | 2019-04-05 | 中国平安人寿保险股份有限公司 | It trades in batches between multisystem task processing method and system |
| CN110866828A (en) * | 2019-10-15 | 2020-03-06 | 北京海益同展信息科技有限公司 | Method, apparatus, computer device and storage medium for processing blockchain data |
| CN112260952A (en) * | 2020-10-20 | 2021-01-22 | 四川天邑康和通信股份有限公司 | Wifi6 router rapid data access protection method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106375241B (en) | 2020-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106375241A (en) | Batch data processing method, front-end system, host and batch data processing system | |
| CN106095585B (en) | Task requests processing method, device and enterprise information system | |
| CN103338252B (en) | Realizing method of distributed database concurrence storage virtual request mechanism | |
| CN105389209A (en) | Asynchronous batch task processing method and system | |
| US8868855B2 (en) | Request management system and method for dynamically managing prioritized requests | |
| CN107124286A (en) | A kind of mass data high speed processing, the system and method for interaction | |
| CN101848203A (en) | In the unloading that procotol is handled, support to connect equipment and the method for setting up | |
| CN1981272A (en) | Apparatus and method for supporting memory management in an offload of network protocol processing | |
| CN105516086B (en) | Method for processing business and device | |
| CN108228363A (en) | A kind of message method and device | |
| CN108881485A (en) | The method for ensureing the high concurrent system response time under big data packet | |
| CN111078436A (en) | Data processing method, device, equipment and storage medium | |
| CN107809480A (en) | One kind transaction commutation system | |
| CN109547162A (en) | Data communications method based on two sets of unidirectional boundaries | |
| CN102821164A (en) | Efficient parallel-distribution type data processing system | |
| CN104821958B (en) | Electricity consumption data packet interactive interface method based on WebService | |
| CN105761039A (en) | Method for processing express delivery information big data | |
| CN110020046A (en) | A kind of data grab method and device | |
| US20070130142A1 (en) | System and method for handling parallel updates of objects requiring time sensitive acknowlegement | |
| CN110928905A (en) | Data processing method and device | |
| US10135944B2 (en) | Processing a unit of work | |
| CN101968815A (en) | Processing method of concurrent requests | |
| CN117633112A (en) | System event processing method, device and storage medium | |
| CN109286573A (en) | Peak clipping system based on distributed token bucket | |
| CN100563264C (en) | Page data transmission method, system and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |