CN105095310B - Data processing method, first server, second server and data processing system - Google Patents
Data processing method, first server, second server and data processing system Download PDFInfo
- Publication number
- CN105095310B CN105095310B CN201410217807.0A CN201410217807A CN105095310B CN 105095310 B CN105095310 B CN 105095310B CN 201410217807 A CN201410217807 A CN 201410217807A CN 105095310 B CN105095310 B CN 105095310B
- Authority
- CN
- China
- Prior art keywords
- data
- tables
- server
- level
- stored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of data processing method, first server, second server and online transaction data processing system, which comprises storage level one data table executes corresponding data manipulation to the level one data table according to business processing flow；According to the relationship between the level one data table and other described tables of data, the data operation information of other tables of data in online transaction data library in addition to the level one data table is generated；Data operation information generated for other tables of data is sent to second server by asynchronous message.Tables of data in online transaction data library can be split and be handled simple and easyly by above scheme, can effectively improve the efficiency of online transaction data processing.
Description
Technical field
This application involves technical field of data processing, more particularly to a kind of data processing method, first server, second
Server and data processing system.
Background technique
Transaction Processing refers to using computer network, and the business processing computer for being distributed in diverse geographic location is set
Standby or network and Service Management Center are connected to the network, unified, real-time in order to can be carried out on any one network node
Business processing activity or customer service.The data processing system data that acquisition process is connected with affairs in real time and shared number
According to the variation in library and the status of other files.Civil aviaton's ordering system and ATM (automatic teller machine) are the examples of data processing system.
Also the means in database point library can be taken in Transaction Processing, to improve the data during Transaction Processing
Processing capacity.It includes vertical division and horizontal division that database point library, which generally comprises database point library, still, database it is vertical
Point library and it is horizontal divide the difficulty in library generally large, be not easy to realize.
Summary of the invention
What the embodiment of the present application solved is to handle online transaction data how simple and easyly.
To solve the above problems, the embodiment of the present application provides a kind of data processing method, comprising:
Level one data table is stored, the level one data table includes guarantee target service normal operating in online transaction data library
Required tables of data and the tables of data for having requirement of real-time；
According to business processing flow, corresponding data manipulation is executed to the level one data table；
According to the relationship between the level one data table and other tables of data, generate in the online transaction data library except institute
State the data operation information of other tables of data except level one data table；
Data operation information generated for other tables of data is sent to second service by asynchronous message
Device is stored with other described tables of data on the second server, and is held according to the asynchronous message to other described tables of data
The corresponding data manipulation of row.
Optionally, the asynchronous message includes reliable asynchronous message.
Optionally, the method also includes: when the data operation information for other tables of data of the generation is logical
When crossing reliable asynchronous message and being sent to second server failure, retries and send the reliable asynchronous message.
Optionally, the method also includes:
Store other tables of data in the online transaction data library in addition to the level one data table；
When executing corresponding data manipulation completion to the data in the level one data table, according to other described tables of data
And the level one data table and between relationship, corresponding data manipulation is executed to other described tables of data；
Compare other the described data stored in the data and the second server of other tables of data stored
Whether the data in table are consistent；
When the data in other described tables of data are consistent with the data of other tables of data described in the second server,
Terminate the data manipulation to other tables of data described in storing together with the level one data table.
Optionally, the method also includes:
Receive the request that requesting party reads data in other tables of data stored in the second server；
Asking for data in other tables of data described in storing in the second server described will be read by asynchronous message
It asks and is sent to the second server；
When the second server is sent the data stored in other requested described tables of data by asynchronous message
When coming over, the data in other described tables of data that the second server sends over are received；
By the received second server send over described in data in other tables of data be sent to requesting party.
The embodiment of the present application also provides a kind of first servers, comprising:
First storage unit is suitable for storage level one data table, and the level one data table includes protecting in online transaction data library
Tables of data needed for card target service normal operating and the tables of data for having requirement of real-time；
First operating unit is suitable for according to business processing flow, to the level-one stored in first storage unit
Tables of data executes corresponding data manipulation；
Generation unit, suitable for generating the online thing according to the relationship between the level one data table and other tables of data
The data operation information of other tables of data described in being engaged in database in addition to the level one data table；
First transmission unit, suitable for believing the generation unit data manipulation generated for other tables of data
Breath is sent to second server by asynchronous message, wherein other described tables of data, and root are stored on the second server
Corresponding data manipulation is executed to other described tables of data according to the asynchronous message.
Optionally, the asynchronous message includes reliable asynchronous message.
Optionally, the first server further include: retry unit, be suitable for working as first transmission unit for the generation
The unit data operation information generated for other tables of data is sent to second server failure by reliable asynchronous message
When, it retries and sends the reliable asynchronous message.
Optionally, the first server further include:
Second storage unit, suitable for storing other numbers in the online transaction data library in addition to the level one data table
According to table；
Second operating unit, other tables of data suitable for being stored to second storage unit execute corresponding data behaviour
Make；
Comparing unit is adapted to compare data in other the described tables of data stored in the second storage unit and described the
Whether the data of other tables of data stored in two servers are consistent；
Terminate unit, suitable in other tables of data described in will be stored in second storage unit data and institute
State other tables of data stored in second server data it is consistent when, terminate for being deposited together with the level one data table
The data manipulation of other tables of data of storage.
Optionally, the first server further include:
First receiving unit reads data in other tables of data stored in the second server suitable for receiving requesting party
Request；
Second transmission unit is suitable for the first receiving unit received reading second service through asynchronous message
The request of data is sent to the second server in other the described tables of data stored in device；
Second receiving unit, suitable for will be deposited in other requested tables of data when the second server by asynchronous message
When the data of storage send over, the data in other tables of data that the second server sends over are received；
Third transmission unit, by second receiving unit other tables of data for sending of the received second server
In data be sent to requesting party.
The embodiment of the present application also provides a kind of second servers, comprising:
Third storage unit, suitable for storing other data in online transaction data library in addition to the level one data table
Table；
Third receiving unit, it is single by being stored transmitted by asynchronous message for the third suitable for receiving first server
The data operation information of other tables of data stored in member；
Third operating unit is suitable for storing the third according to the received asynchronous message of the third receiving unit
Other tables of data that unit is stored execute corresponding data manipulation.
Optionally, the second server further include:
4th receiving unit, suitable for receiving in the reading second server that first server is sent by asynchronous message
The request of data in other tables of data of storage；
First acquisition unit, suitable for according to the 4th receiving unit it is received read second server in store its
The request of data in his tables of data obtains the data of other tables of data stored in the third storage unit；
4th transmission unit, it is described suitable for being sent to the data of other tables of data acquired in the first acquisition unit
First server.
Optionally, the second server further include:
5th receiving unit reads data in other tables of data stored in the second server suitable for receiving requesting party
Request；
Second acquisition unit, suitable for according to the 5th receiving unit it is received read second server in store its
The request of data in his tables of data obtains the data of other tables of data stored in the third storage unit；
5th transmission unit, suitable for the data in other tables of data acquired in the second acquisition unit are sent to institute
State requesting party.
The embodiment of the present application also provides a kind of data processing systems, including above-mentioned first server and the second above-mentioned clothes
Business device, wherein the first server is connected with the second server.
Optionally, the second server is more than one or two.
Compared with prior art, the technical solution of the embodiment of the present application has the advantage that
Above-mentioned scheme, as that will guarantee tables of data and have in online transaction data library needed for target service normal operating
The tables of data of requirement of real-time is stored separately as level one data table and other tables of data, executes a series by first server
According to the read-write operation of table, and by asynchronous message by the data operation information of other tables of data be sent to second server into
Row processing.In this way, the precious resources in first server can be used to ensure the normal operation of target service, and other are counted
Second server is transferred to be handled according to the processing of table, transformation is simple, and can effectively improve the effect of online transaction data processing
Rate.
Further, pass through reliable asynchronous message for its in first server online transaction data library generated due to working as
When the data operation information of his tables of data is sent to second server failure, transmission is retried, it can be ensured that online transaction data library
In the data operation informations of other tables of data be sent on the second server, the reliability of data transmission can be improved.
It further, can be with due to before all transferring to the read-write operation of other tables of data second server to handle
Other tables of data are stored together with level one data table, and execute corresponding data manipulation, in sufficiently verifying second server
Other tables of data in data it is consistent with the data in other tables of data stored together with level one data table after, other are counted
It is all migrated into second server according to the historical data of table, corresponding data is executed to other tables of data by second server and are grasped
Make, risk is low, without shutting down publication, the experience of user can be improved, and ensure that the integrality of online transaction data library data
And reliability.
Detailed description of the invention
Fig. 1 is the flow chart of one of the embodiment of the present application data processing method；
Fig. 2 is the flow chart of another data processing method in the embodiment of the present application；
Fig. 3 is other data stored in acquisition second server in the data processing method in the embodiment of the present application
The flow chart of data in table；
Fig. 4 is the structural schematic diagram of one of the embodiment of the present application first server；
Fig. 5 a is that processing requesting party in one of the embodiment of the present application first server reads in second server and deposits
The structural schematic diagram of other data table datas of storage；
Fig. 5 b is that the processing requesting party in another first server in the embodiment of the present application reads in second server
The structural schematic diagram of other data table datas of storage；
Fig. 6 is the structural schematic diagram of one of the embodiment of the present application second server；
Fig. 6 a is that processing requesting party in one of the embodiment of the present application second server reads in second server and deposits
The structural schematic diagram of data in other tables of data of storage；
Fig. 6 b is that the processing requesting party in another second server in the embodiment of the present application reads in second server
The structural schematic diagram of data in other tables of data of storage；
Fig. 7 is the result schematic diagram of the data processing system in the embodiment of the present application.
Specific embodiment
In the prior art, database point library generally comprises vertical point library and level point library two ways.Wherein, database
Vertical point library generally has to the no interactions when online transaction occurs of the data after guaranteeing to split, and otherwise will will lead to inter-library affairs
It generates.But, it is ensured that the business of script can divide clearly in vertical split database, and not have between the data after division
There is cross-dependence, it will be a difficult thing.
When dividing library using database level, if involved in Transaction Processing generating process when the operation in multiple libraries, needing
Inter-library affairs are handled, this just needs to migrate a large amount of data, if not doing shutdown publication, not only realizes difficulty, there is also very
Big risk.
To solve the above problems, the technical solution that the embodiment of the present application uses is according to numbers different during Transaction Processing
According to demand by the way of being stored separately can effectively solve that business fractionation can not be carried out in the vertical split process of database
The problem of；Meanwhile it will not be introduced into brought inter-library affairs problem in either vertically or horizontally split process, publication is not shut down
Realization is become easy, cost can be effectively reduced, and is easier to realize.
It is understandable to enable the above objects, features, and advantages of the application to become apparent, with reference to the accompanying drawing to the application
Specific embodiment be described in detail.
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and
It is not used in restriction the application.
In a typical configuration of this application, terminal, the equipment of service network and trusted party include one or more
Processor (CPU), input/output interface, network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include non-temporary computer readable media (transitorymedia), such as the data-signal and carrier wave of modulation.
Fig. 1 shows the flow chart of one of the embodiment of the present application data processing method.Data processing as shown in Figure 1
Method may include:
Step S11: storage level one data table.
In specific implementation, the level one data table may include guaranteeing that target service is normally grasped in online transaction data library
Tables of data needed for work and the tables of data for having requirement of real-time.
Step S12: according to business processing flow, the data manipulation to the level one data table is executed.
In specific implementation, since the level one data table includes guaranteeing that target service is normally grasped in online transaction data library
Make required tables of data and there is the tables of data of requirement of real-time to follow the process of business processing when there is online transaction generation, it is right
Data in level one data table can execute corresponding operation.
Step S13: it according to the relationship between the level one data table and other tables of data, generates in online transaction data library
The data operation information of other tables of data described in addition to the level one data table.
In specific implementation, level one data table and other tables of data together form complete online transaction data library, when
When data in level one data table generate variation, according between the data in the data and other tables of data in level one data table
Relationship, the data in other tables of data also change therewith.Therefore, the data operation information stored in other tables of data, Ke Yigen
It is generated according to the relationship between the level one data table and other described tables of data.
Step S14: the data operation information generated for other tables of data is sent to by asynchronous message
Second server, wherein other described tables of data are stored on the second server, and according to the asynchronous message to described
Other tables of data execute corresponding data manipulation.
In specific implementation, since level one data table and other tables of data to be respectively stored in different servers, when
When data in level one data table change, the related data in other tables of data needs to change therewith.In the reality of the application
It applies in example, can will be sent to second server for the data operation information of other tables of data by way of asynchronous message
On.
In specific implementation, in order to ensure the data in other tables of data can be sent to second server, data processing
Method can also include: when the data operation information for other tables of data of the generation is sent out by reliable asynchronous message
It send to when second server failure, retries and send the reliable asynchronous message.
In specific implementation, reliability level can be arranged in the asynchronous message according to the actual needs.For example, can pass through
Reliability level is set in the respective field of asynchronous message, asynchronous message can be divided into reliable asynchronous message and disappeared with generally asynchronous
Breath.Wherein, reliable asynchronous message can be that must be sent to the asynchronous message of second server, and asynchronous message in addition to this is then
It can be set to general asynchronous message.When by reliable asynchronous message by the data for other tables of data of the generation
When operation information is sent to second server failure, it can retry and send the reliable asynchronous message.By the way that failure will be sent
Reliable asynchronous message reattempts to transmission with certain period, the success rate of asynchronous message transmission can be improved, so as to mention
The reliability of high data processing.
Fig. 2 shows the flow charts of another data processing method in the embodiment of the present application.At data as shown in Figure 2
Reason method may include:
Step S21: other tables of data in storage level one data table and online transaction data library in addition to level one data table,
The level one data table includes tables of data needed for guaranteeing target service normal operating in online transaction data library and has real-time
It is required that tables of data.
In specific implementation, can be in conjunction with specific Transaction Processing process, it specifically can be with to analyze level one data table
Including which tables of data.
Below by taking account Transaction Processing process as an example, to be specifically described.Table 1 shows account online transaction
The information of each tables of data in database:
Table 1
Wherein, transferred account service is a target service in account issued transaction.It is transferred accounts 100 yuan with account A to account account B
For, the process (suitably being simplified) of an accounting processing includes:
Initialize transaction controlling information；
Record account solicited message；
Lock account A is simultaneously verified, and is locked account B and is verified；
A account subtracts 100, B account and increases by 100；
Record account detail transition information；
Record account daily variation information；
From above-mentioned analysis it is found that must rely in this target service treatment process of transferring accounts and have to next business processing
The tables of data of influence is to do account transaction controlling table and account information table, wherein makees account transaction controlling table and carries out only to account request
One constraint control can prevent from repeating to do account.Account information table has exclusiveness to the change control of account balance.
Even and if other tables of data in addition to this do not record, and can still guarantee the target in account Transaction Processing
Business --- that transfers accounts is normally carried out.Therefore, in accounting processing business, account transaction controlling table and account information will can be done
Table is as level one data table.
In specific implementation, level one data table set according to Transaction Processing and business processing.
Step S22: according to business processing flow, the data to the table of the level one data table and other data are executed
Operation.
In specific implementation, when there is online transaction generation, according to business processing flow, level one data table can be executed
Corresponding data manipulation.Equally, it is transferred accounts by account A above to account B for 100 yuan, when receiving transfer request, does account
Transaction controlling table carries out constraint control to transfer request.Account information table changes control to account balance.
Meanwhile although even if the data of other tables of data in online transaction data library in addition to level one data table are not remembered
Record, can still guarantee the target service of account --- the normal execution transferred accounts, still, since Transaction Processing is still to it
Data in his tables of data have dependence, therefore, it is also desirable to record the associated data operation information of other tables of data.For example, upper
In the example of transferring accounts stated, the account balance in other tables of data changes detail list, account solicited message record sheet, summarizes book keeping operation table
Corresponding data manipulation can also be needed to be implemented according to business processing flow by changing record sheet with account daily balance.
Step S23: generate online transaction data library in addition to the level one data table described in other tables of data number
According to operation information.
In specific implementation, online transaction number can be generated according to the data relationship of level one data table and other tables of data
According to the data operation information of other tables of data in library in addition to level one data table.
Step S24: the data operation information generated for other tables of data is sent to by asynchronous message
Second server, wherein other described tables of data are stored on the second server, and according to the asynchronous message to described
Other tables of data execute corresponding data manipulation.
In specific implementation, in order to by other tables of data in Transaction Processing database in addition to level one data table
Historical data smoothly carries out migration, determine by asynchronous message be sent on second server for remove level one data table
Except the data operation informations of other tables of data can reliably be sent to second server and be performed before, can will be online
Transaction database is stored on same server and is handled.It at the same time, can will be for its in addition to level one data table
He the data operation information of tables of data is sent to second server by asynchronous message, by second server to wherein being stored
Other tables of data in addition to level one data table perform corresponding processing.In this way it is possible to prevente effectively from being sent when by asynchronous message
On to second server when the data operation information of other tables of data reliably cannot be sent to and be handled, still can be with
The risk of Data Migration generation can be effectively reduced in the integrality for ensuring on-line deta base data.
Step S25: compare the institute stored in data and the second server in other the described tables of data stored
Whether the data for stating other tables of data are consistent.
In specific implementation, in order to the data manipulation of level one data table and the data manipulation of other tables of data are shelled
From can be by comparing storing in the data of other tables of data and the second server that stored together with level one data table
Whether the data of other tables of data are consistent.In this way, can be verified asynchronous message transmission for other data
The data operation information of table can reliably be sent to second server and be performed.In order to verify the data in other tables of data
Consistency, certain period can be set, for example, by day or as unit of the moon by stored together with level one data table other
The consistency of the data in other tables of data stored in data and second server in tables of data is compared.
In specific implementation, other data stored together with level one data table can also be verified by following modes
Whether other tables of data stored on table and second server are consistent: can request to store to second server by asynchronous message
Data in other tables of data wherein, and by subscribe to other tables of data that section service is sent by asynchronous message data and
The data for other tables of data that level one data table stores together are compared, and whether the data to determine the two are with uniformity.
In specific implementation, other numbers for obtaining and storing together with level one data table can also be counted by database administrator
It is whether consistent according to other tables of data stored on table and second server.
Step S26: described in being stored in the data and the second server in other tables of data described in stored
When the data of other tables of data are consistent, terminate and the data of other tables of data stored together with the level one data table are grasped
Make.
In specific implementation, can be by setting compares cycle, for example, being the period with one month, statistics is every time by different
The data of other tables of data that step message is requested to second server whether with other data for being recorded together with level one data table
Whether the data in table are consistent.For example, being stored in the second server by asynchronous message request within one month period
Data of the data in other tables of data recorded together with level one data table of other tables of data when being consistent, can be with
Show to be sent to being reliably sent to the data operation information of other tables of data of second server by asynchronous message
And it is performed.At this point, the data manipulation of other tables of data recorded together with level one data table can be stopped, and other are counted
Second server is sent to according to the mode that the operation of table passes completely through asynchronous message and second server is transferred to carry out accordingly
Processing, in this way can be by the smooth migration of data in other tables of data to second server, it can be ensured that online transaction data
The reliability of processing.
In specific implementation, in order to ensure the reliability of data, the request for reading other tables of data is all being transferred to
Before two server process, can also include the historical data of other tables of data is all migrated into second server, in this way,
It may insure the integrality and reliability of data in other tables of data stored in second server.
In specific implementation, in the treatment process of online transaction, due to removing level one data table in online transaction data library
Except the data of other tables of data be stored in second server, second service can be obtained by the way of as shown in Figure 3
The data in other tables of data stored in device:
Step S31: the request that requesting party reads data in other tables of data stored in the second server is received.
In specific implementation, requesting party can be user, for example, user can request the Day Trading managing detailed catalogue of account.
Step S32: it described will be read by asynchronous message in other tables of data described in being stored in the second server
The request of data is sent to the second server.
In specific implementation, data in other tables of data for being stored are read in second server when receiving requesting party
When request, the request can be sent to second server by asynchronous message.
Step S33: when the second server passes through asynchronous message for the data in other requested described tables of data
When sending over, the data in other described tables of data that the second server sends over are received.
In specific implementation, second server is read in other tables of data after the request of data receiving request, can be with
Requested data are sended over by asynchronous message, at this point, its that the second server sends over can be received
Data in his tables of data.
Step S34: by the received second server send over described in data in other tables of data send
To requesting party.
In specific implementation, when the data for receiving other tables of data that second server is sended over by asynchronous message
Afterwards, the data can be sent to requesting party.
In specific implementation, in order to more easily obtain the data in online transaction data library in other tables of data,
The data of other tables of data in online transaction data library can be directly directly read by second server.
Fig. 4 has shown a kind of first server in the embodiment of the present application, may include that the operation of the first storage unit 42, first is single
Member 41, generation unit 43 and transmission unit 44, wherein the first storage unit 42 respectively with the first operating unit 41, generation unit
43 are connected, meanwhile, generation unit 43 is also connected with transmission unit 44.
First storage unit 42 is suitable for storage level one data table, and the level one data table includes in online transaction data library
Tables of data needed for guaranteeing target service normal operating and the tables of data for having requirement of real-time.
First operating unit 41, is suitable for according to business processing flow, first storage unit 42 is stored described in
Level one data table executes corresponding data manipulation.
Generation unit 43, suitable for according to the first operating unit 41 to the data manipulation result of the level one data table and described
Relationship between level one data table and other tables of data generates in the online transaction data library in addition to the level one data table
Other tables of data data operation information.
Transmission unit 44, suitable for believing the generation unit 43 data manipulation generated for other tables of data
Breath is sent to second server by asynchronous message, wherein other described tables of data, and root are stored on the second server
Corresponding data manipulation is executed to other described tables of data according to the asynchronous message.
In specific implementation, the asynchronous message may include reliable asynchronous message, wherein the reliable asynchronous message can
Think that Transaction Processing must assure that the data for being sent to second server in the process, by transmitted asynchronous message
Reliability level is arranged in corresponding field, can set reliable asynchronous message for transmitted asynchronous message.
In specific implementation, the first server can also include: to retry unit 45, be suitable for working as the transmission unit 44
The generation unit 43 data operation information generated for other tables of data is sent by reliable asynchronous message
To when second server failure, retries and send the reliable asynchronous message.
It refers to shown in Fig. 5 a, in specific implementation, in order to by the data of other tables of data during Transaction Processing
In smooth migration to second server, the first server can also include: the second storage unit 51, the second operating unit
52, comparing unit 53 and terminate unit 54, wherein the second storage unit 51 respectively with the second operating unit 52, comparing unit 53
It is connected, meanwhile, comparing unit 53 is also connected with termination unit 54.Wherein,
Second storage unit 51, suitable for other in the storage online transaction data library in addition to the level one data table
Tables of data.
Second operating unit 52, it is corresponding suitable for being executed to other tables of data stored in second storage unit 51
Data manipulation.
Comparing unit 53, the data being adapted to compare in other the described tables of data stored in the second storage unit 51 and institute
Whether the data for stating other tables of data stored in second server are consistent.
Unit 54 is terminated, suitable for the data in other tables of data described in will be stored in second storage unit 51
When the data of other tables of data described in storing with the second server are consistent, terminate for institute in the second storage unit 51
The data manipulation of other tables of data of storage.
As shown in Figure 5 b, for the data hair for other tables of data that will be stored on the requested second server of requesting party
It send to requesting party, first server can also include that sequentially connected first receiving unit 55 is connected with the second transmission unit 56
It connects, the second receiving unit 57 is connected with third transmission unit 58.Wherein, the first receiving unit 55 is suitable for receiving requesting party and reads
Take the request of data in other tables of data stored in the second server.
Second transmission unit 56, being suitable for will be described in the received reading of first receiving unit 55 by asynchronous message
The request of data is sent to the second server in other the described tables of data stored in second server.
Second receiving unit 57, being suitable for working as the second server will other requested described data by asynchronous message
When the data stored in table send over, the data in other described tables of data that the second server sends over are received.
Third transmission unit 58, by second receiving unit 57 the received second server send described in its
Data in his tables of data are sent to requesting party.
Fig. 6 shows one of the embodiment of the present application second server.Second server as shown in FIG. 6 may include
Third storage unit 61, third receiving unit 62 and third operating unit 63, wherein third operating unit 63 is deposited with third respectively
Storage unit 61, third receiving unit 62 are connected.Wherein,
Third storage unit 61, suitable for storing other data in online transaction data library in addition to the level one data table
Table.
Third receiving unit 62 passes through transmitted by asynchronous message suitable for receiving first server for other described data
The data operation information of table.
Third operating unit 63 is suitable for according to the received asynchronous message of the third receiving unit 62 to the third
The tables of data stored in storage unit 61 executes corresponding data manipulation.
As shown in Figure 6 b, in specific implementation, when requesting party requests wherein institute to second server by first server
When the data of other tables of data of storage, second server can also include being sequentially connected the 4th receiving unit 64, first connect
Acquiring unit 65 and the 4th transmission unit 66.Wherein,
4th receiving unit 64, the reading second server sent suitable for receiving first server by asynchronous message
The request of data in other described tables of data of middle storage.
First acquisition unit 65, suitable for being stored according in the 64 received reading second server of institute of the 4th receiving unit
Other tables of data in data request, obtain the data of other tables of data stored in the third storage unit.
4th transmission unit 66, suitable for being sent to the data of other tables of data acquired in the first acquisition unit 65
The first server.
As shown in Figure 6 a, in specific implementation, when request direction second server requests other data wherein stored
When data in table, second server can also include sequentially connected 5th receiving unit 611,613 and of second acquisition unit
5th transmission unit 612.Wherein,
5th receiving unit 611 is read in other tables of data stored in the second server suitable for receiving requesting party
The request of data.
Second acquisition unit 613, suitable for being deposited according in the 611 received reading second server of institute of the 5th receiving unit
The request of data, obtains the data of other tables of data stored in the third storage unit in other tables of data of storage.
5th transmission unit 612, suitable for sending the data of other tables of data acquired in the second acquisition unit 613
To the requesting party.
Fig. 7 shows one of the embodiment of the present application data processing system.Data processing system as shown in Figure 7, packet
It includes Core server 71 and subscribes to section server 72, wherein Core server 71 is connected with section server 72 is subscribed to.
In specific implementation, the subscription section server 72 according to the needs of Transaction Processing, in the embodiment of the present application
Horizontal dilatation can be carried out, other tables of data in the online transaction data library in addition to level one data table are respectively stored in two
On a above subscription section server 72.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can store in computer readable storage medium, and storage is situated between
Matter may include: ROM, RAM, disk or CD etc..
The method and system of the embodiment of the present application are had been described in detail above, the application is not limited to this.Any
Field technical staff is not departing from spirit and scope, can make various changes or modifications, therefore the guarantor of the application
Shield range should be defined by the scope defined by the claims..
Claims (15)
1. a kind of data processing method characterized by comprising
Level one data table is stored, the level one data table includes guaranteeing needed for target service normal operating in online transaction data library
Tables of data and have the tables of data of requirement of real-time；
According to business processing flow, corresponding data manipulation is executed to the level one data table；
According to the relationship between the level one data table and other tables of data, generate in the online transaction data library except described one
The data operation information of other tables of data except grade tables of data；
Data operation information generated for other tables of data is sent to second server by asynchronous message, institute
It states and is stored with other described tables of data on second server, and other described tables of data are executed accordingly according to the asynchronous message
Data manipulation.
2. data processing method according to claim 1, which is characterized in that the asynchronous message includes that reliable asynchronous disappears
Breath.
3. data processing method according to claim 2, which is characterized in that further include:
When the data operation information for other tables of data of the generation is sent to the second clothes by reliable asynchronous message
When business device failure, retries and send the reliable asynchronous message.
4. data processing method according to claim 1, which is characterized in that further include:
Store other tables of data in the online transaction data library in addition to the level one data table；
When executing corresponding data manipulation completion to the data in the level one data table, according to other described tables of data and institute
State level one data table and between relationship, corresponding data manipulation is executed to other described tables of data；
Compare in other the described tables of data stored in the data and the second server of other tables of data stored
Data it is whether consistent；
When the data in other described tables of data are consistent with the data of other tables of data described in the second server, terminate
Data manipulation to other tables of data described in being stored together with the level one data table.
5. data processing method according to claim 1, which is characterized in that further include:
Receive the request that requesting party reads data in other tables of data stored in the second server；
The request hair of data in other tables of data described in storing in the second server described will be read by asynchronous message
It send to the second server；
When the second server is sended over the data stored in other requested described tables of data by asynchronous message
When, receive the data in other described tables of data that the second server sends over；
By the received second server send over described in data in other tables of data be sent to requesting party.
6. a kind of first server characterized by comprising
First storage unit is suitable for storage level one data table, and the level one data table includes guaranteeing mesh in online transaction data library
Tables of data needed for mark business normal operating and the tables of data for having requirement of real-time；
First operating unit, is suitable for according to business processing flow, executes corresponding data manipulation to the level one data table；
Generation unit, suitable for generating the online transaction number according to the relationship between the level one data table and other tables of data
According in library in addition to the level one data table described in other tables of data data operation information；
First transmission unit, suitable for second will be sent to by asynchronous message for the data operation information of other tables of data
Server, wherein be stored with other described tables of data on the second server, and according to the asynchronous message to it is described other
Tables of data executes corresponding data manipulation.
7. first server according to claim 6, which is characterized in that the asynchronous message includes reliable asynchronous message.
8. first server according to claim 7, which is characterized in that further include:
Unit is retried, suitable for working as first transmission unit for the generation unit data generated for other tables of data
When operation information is sent to second server failure by reliable asynchronous message, retries and send the reliable asynchronous message.
9. first server according to claim 6, which is characterized in that further include:
Second storage unit, suitable for storing other data in the online transaction data library in addition to the level one data table
Table；
Second operating unit, other tables of data suitable for being stored to second storage unit execute corresponding data manipulation；
Comparing unit, the data being adapted to compare in other the described tables of data stored in the second storage unit and second clothes
Whether the data of other tables of data stored in business device are consistent；
Unit is terminated, suitable for the data and described the in other tables of data described in will be stored in second storage unit
When the data of other tables of data stored in two servers are consistent, terminate for storing together with the level one data table
The data manipulation of other tables of data.
10. first server according to claim 6, which is characterized in that further include:
First receiving unit reads asking for data in other tables of data stored in the second server suitable for receiving requesting party
It asks；
Second transmission unit, being suitable for will be in the received reading second server of first receiving unit by asynchronous message
The request of data is sent to the second server in other described tables of data of storage；
Second receiving unit, suitable for will be stored in other requested tables of data when the second server by asynchronous message
When data send over, the data in other tables of data that the second server sends over are received；
Third transmission unit, by second receiving unit in other tables of data for sending of the received second server
Data are sent to requesting party.
11. a kind of second server characterized by comprising
Third storage unit, suitable for storing other tables of data in addition to level one data table in online transaction data library, described one
Grade tables of data includes tables of data needed for guaranteeing target service normal operating in online transaction data library and has requirement of real-time
Tables of data；
Third receiving unit passes through the number transmitted by asynchronous message for other tables of data suitable for receiving first server
According to operation information；
Third operating unit, other tables of data suitable for being stored according to the asynchronous message to the third storage unit execute
Corresponding data manipulation.
12. second server according to claim 11, which is characterized in that further include:
4th receiving unit is stored suitable for receiving in the reading second server that first server is sent by asynchronous message
Other tables of data in data request；
First acquisition unit, suitable for according to the 4th receiving unit it is received read second server in store other number
According to the request of data in table, the data of other tables of data stored in the third storage unit are obtained；
4th transmission unit, suitable for the data of other tables of data acquired in the first acquisition unit are sent to described first
Server.
13. second server according to claim 11, which is characterized in that further include:
5th receiving unit reads asking for data in other tables of data stored in the second server suitable for receiving requesting party
It asks；
Second acquisition unit, suitable for according to the 5th receiving unit it is received read second server in store other number
According to the request of data in table, the data of other tables of data stored in the third storage unit are obtained；
5th transmission unit, suitable for the data in other tables of data acquired in the second acquisition unit are sent to described ask
The side of asking.
14. a kind of data processing system, which is characterized in that including such as described in any item first servers of claim 6-10 and
Such as the described in any item second servers of claim 11-13, wherein the first server is connected with the second server
It connects.
15. data processing system according to claim 14, which is characterized in that the second server is one or two
It is more than platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410217807.0A CN105095310B (en) | 2014-05-20 | 2014-05-20 | Data processing method, first server, second server and data processing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410217807.0A CN105095310B (en) | 2014-05-20 | 2014-05-20 | Data processing method, first server, second server and data processing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105095310A CN105095310A (en) | 2015-11-25 |
| CN105095310B true CN105095310B (en) | 2019-04-09 |
Family
ID=54575760
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410217807.0A Active CN105095310B (en) | 2014-05-20 | 2014-05-20 | Data processing method, first server, second server and data processing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105095310B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106372985B (en) * | 2016-08-30 | 2020-11-06 | 五八同城信息技术有限公司 | Order data processing method and device |
| CN108595121B (en) * | 2018-04-17 | 2021-03-02 | 湖北文理学院 | Data storage method and device |
| CN110046976B (en) * | 2018-11-30 | 2023-08-18 | 创新先进技术有限公司 | Account checking method and device and server |
| CN112019870A (en) * | 2020-08-27 | 2020-12-01 | 北京一起教育信息咨询有限责任公司 | Message classification processing method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101625686A (en) * | 2008-07-08 | 2010-01-13 | 阿里巴巴集团控股有限公司 | Method and system for monitoring data consistency between plurality of databases |
| CN101882161A (en) * | 2010-06-23 | 2010-11-10 | 中国工商银行股份有限公司 | Application level asynchronous task scheduling system and method |
| CN202600778U (en) * | 2012-02-16 | 2012-12-12 | 中国工商银行股份有限公司 | Asynchronous processing system for updating hotlist data |
| CN103218449A (en) * | 2013-04-26 | 2013-07-24 | 中国农业银行股份有限公司 | Report form daytime operation asynchronous processing method and system using same |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040181522A1 (en) * | 2003-01-16 | 2004-09-16 | Jardin Cary A. | Shared memory router system and method for node communication in a distributed system |
-
2014
- 2014-05-20 CN CN201410217807.0A patent/CN105095310B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101625686A (en) * | 2008-07-08 | 2010-01-13 | 阿里巴巴集团控股有限公司 | Method and system for monitoring data consistency between plurality of databases |
| CN101882161A (en) * | 2010-06-23 | 2010-11-10 | 中国工商银行股份有限公司 | Application level asynchronous task scheduling system and method |
| CN202600778U (en) * | 2012-02-16 | 2012-12-12 | 中国工商银行股份有限公司 | Asynchronous processing system for updating hotlist data |
| CN103218449A (en) * | 2013-04-26 | 2013-07-24 | 中国农业银行股份有限公司 | Report form daytime operation asynchronous processing method and system using same |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105095310A (en) | 2015-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9898522B2 (en) | Distributed storage of aggregated data | |
| CN107819861A (en) | Business data processing method, apparatus and system | |
| CN105988862B (en) | Distributed transaction processing method and device | |
| CN105095310B (en) | Data processing method, first server, second server and data processing system | |
| CN105592117B (en) | A kind for the treatment of method and apparatus of transaction message | |
| CN106899648A (en) | A kind of data processing method and equipment | |
| CN110442458A (en) | Scaling calculates cluster | |
| CN105989133B (en) | Transaction methods and device | |
| KR20170097132A (en) | System for efficient processing of transaction requests related to an account in a database | |
| CN105592118B (en) | Synchronous user applies method, system and the server-side of data | |
| CN106899654A (en) | A kind of sequence value generation method, apparatus and system | |
| Xia et al. | Performance and availability modeling of ITSystems with data backup and restore | |
| CN109542352A (en) | Method and apparatus for storing data | |
| CN107295031A (en) | A kind of method of data synchronization and device | |
| CN109672752A (en) | The synchronous method of data and node | |
| WO2020238860A1 (en) | Distributed file batch processing method and apparatus, and readable storage medium | |
| CN104715044B (en) | A kind of distributed system and its data manipulation method | |
| CN111741080B (en) | Network file distribution method and device | |
| CN110413918A (en) | Data transmission method for uplink, device, equipment and storage medium | |
| CN108200151A (en) | ISCSI Target load-balancing methods and device in a kind of distributed memory system | |
| CN108270871A (en) | The file block method for down loading and device of a kind of client | |
| CN107071051A (en) | For ordering the method and apparatus performed | |
| CN107329798A (en) | Method, device and the virtualization system of data duplication | |
| CN116244062A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN113592645B (en) | Data verification method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191209 Address after: P.O. Box 31119, grand exhibition hall, hibiscus street, 802 West Bay Road, Grand Cayman, Cayman Islands Patentee after: Innovative advanced technology Co., Ltd Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Patentee before: Alibaba Group Holding Co., Ltd. |
|
| TR01 | Transfer of patent right |