CN108572991A - Data base processing method, device and storage medium - Google Patents
Data base processing method, device and storage medium Download PDFInfo
- Publication number
- CN108572991A CN108572991A CN201710148886.8A CN201710148886A CN108572991A CN 108572991 A CN108572991 A CN 108572991A CN 201710148886 A CN201710148886 A CN 201710148886A CN 108572991 A CN108572991 A CN 108572991A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- user
- routing iinformation
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/466—Transaction processing
Abstract
This application discloses a kind of data base processing method, device and storage mediums, for data-base cluster, it is single library affairs or inter-library affairs to use and indicate current business transaction types by way of note in service logic, and route service is set, the routing iinformation in new user corresponding data source in the data-base cluster is calculated when new user storage data, routing iinformation is stored in route service, when old user stores data, the routing iinformation of the corresponding data source of the old user is inquired from the route service；Then corresponding data source is found according to the corresponding routing iinformation of active user；The note in Direct Recognition service logic be may then pass through to judge single library affairs or inter-library affairs, and local Transaction Manager and distributed transaction management device is respectively adopted to carry out data storage management.The present invention improves the storage capacity and runnability of database entirety, and has also accomplished good ease for use using upper in configuration.
Description
Technical field
This application involves microcomputer data processing field more particularly to a kind of data base processing method, device and deposit
Storage media.
Background technology
Currently, with the development of internet, the scale of computer data storage is increasing.Especially, with internet
The development of website, the continuous growth of user volume, data volume are also constantly increasing.In current data system, generally use is based on
Single library storage mode of single database (referred to as single library in the present invention) affairs.
If Fig. 1 is a kind of a kind of schematic diagram for dividing table to store data using single library in the prior art.Referring to Fig. 1, data
Store multiple and different tables of data in library, client initiates request of data to corresponding service server, the service server
Data manipulation is carried out from the tables of data that some in database is formulated.
However, in realizing process of the present invention, inventor has found in the prior art, single library in the big business of some amount
Bearing capacity have been unable to meet the development of business, it will usually there are some following：
Data storage problem, separate unit database server storage are limited, cannot meet growing data volume；
Performance issue, the performance of separate unit database server is not enough to support access request in the case of visit capacity is prodigious.
Invention content
In view of this, the main purpose of the embodiment of the present invention be to provide a kind of data processing method of database, device and
Storage medium, to improve the storage capacity and runnability of database.
What the technical solution of an embodiment of the present invention was realized in：
A kind of data base processing method, data-base cluster of this method to contain two data above libraries；This method master
Including：
Current business transaction types are indicated by way of note in service logic；
After receiving data storage request, the user identifier in the data storage request is determined, if it is Adding User, then
The routing iinformation for calculating in the data-base cluster corresponding data source of Adding User, route service is stored in by routing iinformation
In；If it is existing subscriber, then the routing iinformation of the corresponding data source of the user is obtained from the route service；
According to the corresponding routing iinformation of active user, corresponding data source is determined；
The transaction types for judging current business then obtain local Transaction Manager if it is single library affairs, utilize the local
Task manager, by the data storage in the data storage request to data determined by the corresponding routing iinformation of active user
In source；If it is inter-library affairs, then distributed transaction management device is obtained, using the distributed transaction management device, by the data
In data storage to data source determined by the corresponding routing iinformation of active user in storage request.
In a kind of preferred embodiment of the method, this method further comprises：
After receiving data inquiry request, the user identifier in the data inquiry request is determined, from the route service
Obtain the routing iinformation of the corresponding data source of the user；
According to the routing iinformation of the user, corresponding data source is determined；
According to the data inquiry request, data are inquired from the data source.
In a kind of preferred embodiment of the method, this method further comprises：Count designated user's corresponding data source
Data volume, when designated user's corresponding data source data volume be more than threshold value, then further perform the step of：
By in the newly selected data source in the Data Migration to the data-base cluster in designated user's corresponding data source,
And the routing iinformation of the corresponding newly selected data source of the designated user is updated in the route service.
In a kind of preferred embodiment of the method, this method further comprises：Increase in the data-base cluster
New data source increases the routed path information of the new data source in the route service；Data ought be received later
After storage request, determines the user identifier in the data storage request, if it is Adding User, then calculate this and Add User in institute
Routing iinformation is stored in routing clothes by the routing iinformation for stating corresponding data source in the data-base cluster for having increased the source of new data
In business.
In a kind of preferred embodiment of the method, this method further comprises：Determining needs in the data-base cluster
The data source for wanting undercarriage moves to the data source in the data source of the needs undercarriage newly selected in the data-base cluster
In data source, and updates in the route service and described to need the corresponding routing iinformation of the data source of undercarriage；Delete the need
Want the data source of undercarriage.
In a kind of preferred embodiment of the method, the calculating correspondence in the data-base cluster that Adds User
The routing iinformation of data source, specifically includes：
Using the method for Hash calculation to Add User automatically for this, calculate one corresponds to number in the data-base cluster
According to the routing iinformation in source, the routing iinformation includes address, port numbers and the database name of the data source.
A kind of database processing device, the device is for handling the data-base cluster for including two data above libraries, the dress
It sets and includes mainly：
Module is explained, for indicating current business transaction types by way of note in service logic；
First storage processing module, for after receiving data storage request, determining the user in the data storage request
Mark then calculates the routing iinformation in the data-base cluster corresponding data source of Adding User if it is Adding User, will
Routing iinformation is stored in route service；If it is existing subscriber, then the corresponding number of the user is obtained from the route service
According to the routing iinformation in source；
Second storage processing module, for according to the corresponding routing iinformation of active user, determining corresponding data source；
Third stores processing module, and the transaction types for judging current business then obtain local if it is single library affairs
Task manager is corresponded to the data storage in the data storage request to active user using the local Transaction Manager
Routing iinformation determined by data source；If it is inter-library affairs, then distributed transaction management device is obtained, utilizes the distribution
Task manager, by the data storage in the data storage request to data determined by the corresponding routing iinformation of active user
In source.
In a kind of preferred embodiment of the method, described device further comprises：
First enquiry module, for after receiving data inquiry request, determining the user identifier in the data inquiry request,
The routing iinformation of the corresponding data source of the user is obtained from the route service；
Second enquiry module determines corresponding data source for the routing iinformation according to the user；
Third enquiry module, for according to the data inquiry request, data to be inquired from the data source.
In a kind of preferred embodiment of the method, which further comprises：.
Data volume monitoring module, the data volume for counting designated user's corresponding data source, when designated user's corresponding data
The data volume in source is more than threshold value, then further triggers transferring module below：
Transferring module is used for the new choosing in the Data Migration to the data-base cluster in designated user's corresponding data source
In fixed data source, and update in the route service routing iinformation of the corresponding newly selected data source of the designated user.
A kind of computer readable storage medium, is stored thereon with computer program, which realizes when being executed by processor
Step contained by any embodiment of the above method.
Compared with prior art, the embodiment in foregoing invention has the following advantages that or advantageous effect：
The embodiment of the present invention is used to contain the data-base cluster in two data above libraries for the data-base cluster
It is single library affairs or inter-library affairs to indicate current business transaction types by way of note in service logic, and road is arranged
By servicing, the routing letter in new user corresponding data source in the data-base cluster is calculated when new user storage data
Breath, routing iinformation is stored in route service, and when old user stores data, the old user is inquired from the route service
The routing iinformation of corresponding data source；Then corresponding data source is found according to the corresponding routing iinformation of active user；Then may be used
To judge single library affairs or inter-library affairs by the note in Direct Recognition service logic, and local thing is respectively adopted
Business manager and distributed transaction management device carry out data storage management.Since the embodiment of the present invention is to the processing unit of things
Point, tradition point library technology and scheme are improved and have been broken through than before, and single library and inter-library thing are incorporated by way of note
Business to improve the storage capacity and runnability of database entirety, and has also been accomplished well easily in configuration using upper
The property used.
Description of the drawings
Fig. 1 is a kind of a kind of schematic diagram for dividing table to store data using single library in the prior art；
Fig. 2 is a kind of flow diagram of the data base processing method described in a kind of embodiment of the present invention；
Fig. 3 is a kind of flow diagram of the embodiment of storage data of data base processing method of the present invention；
Fig. 4 a show a kind of composition schematic diagram of embodiment of database processing device of the present invention；
Fig. 4 b show the composition schematic diagram of the embodiment of another of database processing device of the present invention；
Fig. 4 c show the composition schematic diagram of the embodiment of another of database processing device of the present invention；
Fig. 5 is the process chart of the data query in a kind of embodiment of data base processing method of the present invention；
Fig. 6 is the process chart that the data volume in a kind of embodiment of data base processing method of the present invention is adjusted；
Fig. 7 is the process chart of the dilatation operation in a kind of embodiment of data base processing method of the present invention；
Fig. 8 is the process chart of the capacity reducing operation in a kind of embodiment of data base processing method of the present invention.
Specific implementation mode
Below in conjunction with the accompanying drawings and specific embodiment the present invention is further described in more detail.
Fig. 2 applies one in data base cluster system for a kind of embodiment of data base processing method of the present invention
Kind schematic diagram.Fig. 3 is a kind of flow diagram of the embodiment of storage data of data base processing method of the present invention.Ginseng
See Fig. 3, a kind of method of embodiment of the present invention is applied to the data-base cluster for including two data above libraries；Further
, include more than one tables of data in any of which database.
Referring to Fig. 2, in a kind of embodiment that database processing of the present invention is put, for storing the processing of data, mainly
Including：
Step 201, indicated by way of note in service logic current business transaction types be single library affairs or
Inter-library affairs.
Step 202, after receiving data storage request, the user identifier in the data storage request is determined, if it is new
Family is added, then calculates the routing iinformation in the data-base cluster corresponding data source of Adding User, routing iinformation is stored
In route service；If it is existing subscriber, then the routing letter of the corresponding data source of the user is obtained from the route service
Breath；
Step 203, according to the corresponding routing iinformation of active user, determine corresponding data source；
Step 204, the transaction types for judging current business then obtain local Transaction Manager if it is single library affairs, profit
It is with the local Transaction Manager, the data storage in the data storage request is true to the corresponding routing iinformation institute of active user
In fixed data source；If it is inter-library affairs, then distributed transaction management device is obtained, it, will using the distributed transaction management device
In data storage to data source determined by the corresponding routing iinformation of active user in the data storage request.
The distributed transaction management device, for example, in JAVA environment for JAVA transaction applications programming interface (JTA,
Java Transaction API).JTA allows application program to execute distributing real time system, can be in two or more networks
It accesses and updates the data on computer resource.
Corresponding with the embodiment of above-mentioned data base processing method, the invention also discloses the implementations of database processing device
Example, the database processing device is for executing the data base processing method.
A kind of composition schematic diagram of embodiment of database processing device of the present invention as shown in Figure 4 a.Referring to
Fig. 4 a, the device are used to handle the data-base cluster for including two data above libraries, the device mainly includes：
Module 401 is explained, is single library for indicating current business transaction types by way of note in service logic
Affairs or inter-library affairs；
First storage processing module 402, for after receiving data storage request, determining the use in the data storage request
Family identifies, and if it is Adding User, then calculates the routing iinformation in the data-base cluster corresponding data source of Adding User,
Routing iinformation is stored in route service；If it is existing subscriber, then it is corresponding that the user is obtained from the route service
The routing iinformation of data source；
Second storage processing module 403, for according to the corresponding routing iinformation of active user, determining corresponding data source；
Third stores processing module 404, and the transaction types for judging current business are then obtained if it is single library affairs
Local Transaction Manager, using the local Transaction Manager, by the data storage in the data storage request to active user
In data source determined by corresponding routing iinformation；If it is inter-library affairs, then distributed transaction management device is obtained (in such as JAVA
JTA), it is using the distributed transaction management device, the data storage in the data storage request is corresponding to active user
In data source determined by routing iinformation.
As shown in figure 3, number can be arranged between the service server and the data-base cluster in the embodiment of the present invention
According to library processing unit 300, which is used to execute the embodiment of the method for the invention.The database
Processing unit 300 can be software package, herein, also be known as the software package to route plug-in unit.
Due to including two or more databases in data-base cluster, the business thing of the service server of request of data is sent out
Service type may be different, and some may relate to single database operation, and some may relate to multiple database manipulations, i.e., inter-library
Operation, therefore it is single library affairs that the embodiment of the present invention indicates current business transaction types in service logic by way of note
Or inter-library affairs.
Such as in JAVA environment, the specific implementation of wherein affairs is based on：
Spring affairs+atomikos+spring note+aspectj are realized.
Accomplished in use with being compatible with well in spring affairs usages by@ShareTransaction notes.
Such as inter-library affairs, mode is explained using following：
@ShareTransaction (propagation=Propagation.REQUIRED, type=" atomik ")
Such as single library affairs, mode is explained using following：
@ShareTransaction (propagation=Propagation.REQUIRED)
Referring to Fig. 2, flow chart when being data storage.In the specific implementation scenario, client according to business demand first
Some service server is accessed, if service server produces data storage request, which can be by the embodiment of the present invention
The routing plug-in unit monitors, i.e., is monitored after receiving data storage request in the described step 202, routing plug-in unit of the invention
It can determine whether the user identifier in the data storage request, judgement Adds User or existing user.If it is Adding User,
Routing iinformation is stored in routing clothes by the routing iinformation for then calculating in the data-base cluster corresponding data source of Adding User
In business；If it is existing subscriber, then the routing iinformation of the corresponding data source of the user is obtained from the route service.
The route service refer to it is a kind of setting routing iinformation service, be specifically present in some or it is more than one
In server, in the cloud storage service that can also be arranged, the specific existing way of the route service does not limit.
In one preferred embodiment of the invention, the calculating this Add User and correspond to number in the data-base cluster
According to the routing iinformation in source, specifically include：It uses the method for Hash calculation to Add User for this and calculates one in the number automatically
According to the routing iinformation in corresponding data source in the cluster of library, the routing iinformation includes address, port numbers and the database of the data source
Name.The data source is exactly the storage of data involved by some user, specifically some database, usually use IP address,
Port numbers and database name identify its routing iinformation.
Later in step 203, routing plug-in unit is according to the corresponding routing iinformation of active user determined by previous step, really
Fixed corresponding data source.Specifically, if it is Adding User, then the routing iinformation is for its calculated place that Adds User
The routing iinformation in corresponding data source in data-base cluster；If it is existing subscriber, then the routing iinformation is the mark according to the user
Know the corresponding routing iinformation inquired from route service.
Later in step 204, routing plug-in unit can obtain the configuration of affairs note from service logic, and judge current industry
The transaction types of business then obtain local Transaction Manager if it is single library affairs, will be described using the local Transaction Manager
In data storage to data source determined by the corresponding routing iinformation of active user in data storage request；If it is inter-library thing
Business, then obtain distributed transaction management device, using the distributed transaction management device, the data in the data storage request deposited
It stores up in data source determined by the corresponding routing iinformation of active user.In addition, if it is determined that without affairs, then it directly will be described
In data storage to data source determined by the corresponding routing iinformation of active user in data storage request.
It is described to store data into corresponding data source, specifically store data into the database specified by data source
In, as the specific tables of data stored, then specific tables of data position is determined according to the regulation in service logic.
List library affairs are simply to send request transaction and end transaction to a database to realize, therefore
Local Transaction Manager may be used, to ensure can to ensure the request transaction and end transaction of separate unit database at one
It is executed in affairs.
The inter-library affairs are request transaction and end transaction between being related to two or more databases, therefore need
Two or more databases are coordinated and managed by distributed transaction management device, so as in two or more nets
It accesses and updates the data on network computer resource.
In a kind of embodiment of the method for the invention, this method can further include the processing stream of data query
Journey.If Fig. 5 is the process chart of the data query in a kind of embodiment of data base processing method of the present invention.Referring to figure
5, this method further comprises：
Step 501, the request according to subscription client can trigger service server and send out data inquiry request, the road
By plug-in unit after receiving the data inquiry request, the user identifier in the data inquiry request is determined, from the route service
Obtain the routing iinformation of the corresponding data source of the user.The routing iinformation includes IP address, port numbers and database-name.
Step 502, the user accessed by previous step routing iinformation, determine the corresponding data of the user
Source, i.e., which of described data-base cluster database.
Step 503, according to the data inquiry request, inquire data from the data source.Refer to from the data source
Corresponding data are read in fixed database, and the data of reading are returned to the client for initiating request by service server.
It is corresponding, in a kind of embodiment of the database processing device, as shown in Figure 4 b, further comprise：
First enquiry module, for after receiving data inquiry request, determining the user identifier in the data inquiry request,
The routing iinformation of the corresponding data source of the user is obtained from the route service；
Second enquiry module determines corresponding data source for the routing iinformation according to the user；
Third enquiry module, for according to the data inquiry request, data to be inquired from the data source.
In a kind of embodiment of the method for the invention, this method can further include the processing of data volume adjusting
Flow.The process chart adjusted for the data volume in a kind of embodiment of data base processing method of the present invention such as Fig. 6.Ginseng
See that Fig. 6, this method further comprise：
Step 601, the data volume in Statistical monitor designated user's corresponding data source；
Step 602 judges whether the data volume in designated user's corresponding data source is more than threshold value.The range of the designated user
It can be set according to business demand, such as can be to the number of the corresponding data source of all users in certain several service logic
Statistic analysis is carried out according to amount.When designated user's corresponding data source data volume be more than threshold value, then further perform the step of
603。
Step 603, will be newly selected in the Data Migration to the data-base cluster in designated user's corresponding data source
In data source, and update in the route service routing iinformation of the corresponding newly selected data source of the designated user.
It is corresponding, in a kind of embodiment of the database processing device, as illustrated in fig. 4 c, further comprise：
Data volume monitoring module is used for the data volume in Statistical monitor designated user's corresponding data source, when designated user corresponds to
The data volume of data source is more than threshold value, then further triggers transferring module below：
Transferring module is used for the new choosing in the Data Migration to the data-base cluster in designated user's corresponding data source
In fixed data source, and update in the route service routing iinformation of the corresponding newly selected data source of the designated user.
Certainly, above-mentioned data volume monitoring module and transferring module can be arranged to the form of software package, and page can not be set
It is set to the form of software package, could be provided as the form of the external service to the data-base cluster.
Since the present invention can count the data volume in designated user's corresponding data source, and corresponding Data Migration is made, because
This can control the Control granularity of Data Migration to user class, so as to realize the control of more precision.In migration
In the process, the migrated users can also be put into blacklist, the user not allowed to carry out write operation in transition process,
Write operation can be carried out after the completion of Data Migration.
In a kind of embodiment of the method for the invention, this method can further include do not cut off database and into
Capable dilatation operation.The processing stream operated for the dilatation in a kind of embodiment of data base processing method of the present invention such as Fig. 7
Cheng Tu.Referring to Fig. 7, this method further comprises：
Step 701 increases new data source in the data-base cluster.
Step 702, the routed path information for increasing the new data source in the route service.
Step 703, later after receiving data storage request, determine the user identifier in the data storage request, such as
Fruit is to Add User, then calculates the corresponding data source in the data-base cluster for having increased the source of new data that Adds User
Routing iinformation, routing iinformation is stored in route service.
By above-mentioned processing, it can increase data source newly in the case of data-base cluster continual service, improve data
The ease for use of dilatation.
In a kind of embodiment of the method for the invention, this method can further include do not cut off database and into
Capable capacity reducing operation.The processing stream operated for the capacity reducing in a kind of embodiment of data base processing method of the present invention such as Fig. 8
Cheng Tu.Referring to Fig. 8, this method further comprises：
Step 801 determines the data source that undercarriage is needed in the data-base cluster.
Step 802, the data source in the data source of the needs undercarriage is moved to it is new selected in the data-base cluster
Data source in.
Step 803 updates in the route service and described needs the corresponding routing iinformation of the data source of undercarriage.
Step 804 deletes the data source for needing undercarriage.
By above-mentioned processing, it can delete data source in the case of data-base cluster continual service, improve data
The ease for use of capacity reducing.
In embodiment of the present invention, dividing library and data transference package by one kind, disclosure satisfy that following business field
The demand of scape：
(1) it is directed to different business scenarios and supports separate unit db transaction and inter-library affairs；
(2) dynamic select of data storage path；
(3) dynamic of data source, which increases, deletes；
(4) fine granularity constantly takes Data Migration；
(5) data volume dynamic regulation.
Embodiment through the invention can solve the business for having strict demand to data accuracy based on database purchase
The problems such as storage dilatation of data present in scene, capacity reducing, flow-rate adjustment, which has made a scheme closed loop, solution
It has determined and has been based on storage and performance issue present in database purchase in the prior art.
In addition, each function module in each embodiment of the present invention can be integrated in a processing unit, it can also
It is that modules physically exist alone, it can also be during two or more modules be integrated in one unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.The work(of each embodiment
Energy module can be located at a terminal or network node, or may be distributed on multiple terminals or network node.
In addition, each embodiment of the present invention can pass through the data processing by data processing equipment such as computer execution
Program is realized.Obviously, data processor constitutes the present invention.In addition, being generally stored inside the data in a storage medium
Processing routine by program by directly reading out storage medium or by installing or copying to data processing equipment by program
It is executed in storage device (such as hard disk and/or memory).Therefore, such storage medium also constitutes the present invention.Storage medium can be with
Use any kind of recording mode, such as paper storage medium (such as paper tape), magnetic storage medium (such as floppy disk, hard disk, flash memory
Deng), optical storage media (such as CD-ROM), magnetic-optical storage medium (such as MO) etc..
Therefore the invention also discloses a kind of readable storage medium storing program for executing, wherein it is stored with computer program, the computer program
For realizing any type embodiment of the above method of the present invention when being executed by processor.
In addition, method and step of the present invention is with data processor in addition to can be realized, can also by hardware Lai
It realizes, for example, can be by logic gate, switch, application-specific integrated circuit (ASIC), programmable logic controller (PLC) and embedded microcontroller
Etc. realizing.Therefore this hardware that the method for the invention may be implemented can also constitute the present invention.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
With within principle, any modification, equivalent substitution, improvement and etc. done should be included within the scope of protection of the invention god.
Claims (10)
1. a kind of data base processing method, which is characterized in that data-base cluster of this method to contain two data above libraries；
This method includes mainly：
Current business transaction types are indicated by way of note in service logic；
After receiving data storage request, the user identifier in the data storage request is determined, if it is Adding User, then calculate
The routing iinformation in the data-base cluster corresponding data source of Adding User, routing iinformation is stored in route service；
If it is existing subscriber, then the routing iinformation of the corresponding data source of the user is obtained from the route service；
According to the corresponding routing iinformation of active user, corresponding data source is determined；
The transaction types for judging current business then obtain local Transaction Manager if it is single library affairs, utilize the local matter
Manager, by the data storage in the data storage request to data source determined by the corresponding routing iinformation of active user
In；If it is inter-library affairs, then distributed transaction management device is obtained, using the distributed transaction management device, the data are deposited
In data storage to data source determined by the corresponding routing iinformation of active user in storage request.
2. according to the method described in claim 1, it is characterized in that, this method further comprises：
After receiving data inquiry request, the user identifier in the data inquiry request is determined, obtained from the route service
The routing iinformation of the corresponding data source of the user；
According to the routing iinformation of the user, corresponding data source is determined；
According to the data inquiry request, data are inquired from the data source.
3. according to the method described in claim 1, it is characterized in that, this method further comprises：Statistics designated user corresponds to number
According to the data volume in source, when the data volume in designated user's corresponding data source is more than threshold value, then further perform the step of：
By in the newly selected data source in the Data Migration to the data-base cluster in designated user's corresponding data source, and
The routing iinformation of the corresponding newly selected data source of the designated user is updated in the route service.
4. according to the method described in claim 1, it is characterized in that, this method further comprises：In the data-base cluster
Increase new data source, increases the routed path information of the new data source in the route service；It ought receive later
After data storage request, the user identifier in the data storage request is determined, if it is Adding User, then calculate this and Add User
The routing iinformation in corresponding data source, road is stored in by routing iinformation in the data-base cluster for having increased the source of new data
In servicing.
5. according to the method described in claim 1, it is characterized in that, this method further comprises：Determine the data-base cluster
Data source in the data source of the needs undercarriage is moved to the new choosing in the data-base cluster by the middle data source for needing undercarriage
In fixed data source, and updates in the route service and described to need the corresponding routing iinformation of the data source of undercarriage；Delete institute
State the data source for needing undercarriage.
6. according to the method described in claim 1, it is characterized in that, the calculating this Add User in the data-base cluster
The routing iinformation in corresponding data source, specifically includes：
It uses the method for Hash calculation to Add User for this and calculates a corresponding data source in the data-base cluster automatically
Routing iinformation, the routing iinformation includes address, port numbers and the database name of the data source.
7. a kind of database processing device, which is characterized in that the device is for handling the database for including two data above libraries
Cluster, the device mainly includes：
Module is explained, for indicating current business transaction types by way of note in service logic；
First storage processing module, for after receiving data storage request, determining the user identifier in the data storage request,
If it is Adding User, then the routing iinformation in the data-base cluster corresponding data source of Adding User is calculated, will be route
Information storage is in route service；If it is existing subscriber, then the corresponding data source of the user is obtained from the route service
Routing iinformation；
Second storage processing module, for according to the corresponding routing iinformation of active user, determining corresponding data source；
Third stores processing module, and the transaction types for judging current business then obtain local matter if it is single library affairs
Manager, using the local Transaction Manager, by the data storage in the data storage request to the corresponding road of active user
In the data source determined by information；If it is inter-library affairs, then distributed transaction management device is obtained, utilizes the distributed transaction
Manager, by the data storage in the data storage request to data source determined by the corresponding routing iinformation of active user
In.
8. device according to claim 7, which is characterized in that described device further comprises：
First enquiry module, for after receiving data inquiry request, determining the user identifier in the data inquiry request, from institute
State the routing iinformation that the corresponding data source of the user is obtained in route service；
Second enquiry module determines corresponding data source for the routing iinformation according to the user；
Third enquiry module, for according to the data inquiry request, data to be inquired from the data source.
9. device according to claim 7, which is characterized in that the device further comprises：.
Data volume monitoring module, the data volume for counting designated user's corresponding data source, when designated user's corresponding data source
Data volume is more than threshold value, then further triggers transferring module below：
Transferring module, for will be newly selected in the Data Migration to the data-base cluster in designated user's corresponding data source
In data source, and update in the route service routing iinformation of the corresponding newly selected data source of the designated user.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Claim 1-6 any one of them method and steps are realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710148886.8A CN108572991A (en) | 2017-03-14 | 2017-03-14 | Data base processing method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710148886.8A CN108572991A (en) | 2017-03-14 | 2017-03-14 | Data base processing method, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108572991A true CN108572991A (en) | 2018-09-25 |
Family
ID=63578434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710148886.8A Pending CN108572991A (en) | 2017-03-14 | 2017-03-14 | Data base processing method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108572991A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134742A (en) * | 2019-04-25 | 2019-08-16 | 上海淇毓信息科技有限公司 | A kind of dynamic global level grouping method, device, system based on financial client |
| CN110750584A (en) * | 2019-09-18 | 2020-02-04 | 苏宁云计算有限公司 | Data management method and system |
| CN111209100A (en) * | 2020-01-03 | 2020-05-29 | 光大兴陇信托有限责任公司 | Service processing and data source determining method |
| CN111522881A (en) * | 2020-04-26 | 2020-08-11 | 北京三快在线科技有限公司 | Service data processing method, device, server and storage medium |
| CN111538605A (en) * | 2020-04-24 | 2020-08-14 | 北京思特奇信息技术股份有限公司 | Distributed data access layer middleware and command execution method and device |
| CN111782721A (en) * | 2020-05-09 | 2020-10-16 | 宁波小遛共享信息科技有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN111858641A (en) * | 2020-07-30 | 2020-10-30 | 中国工商银行股份有限公司 | Transaction processing method and device, electronic equipment and readable storage medium |
| CN111930830A (en) * | 2020-06-22 | 2020-11-13 | 心有灵犀科技股份有限公司 | Distributed transaction data processing method and system based on shared database |
| CN112487089A (en) * | 2020-11-26 | 2021-03-12 | 广州海量数据库技术有限公司 | Distributed storage method and system based on data page routing |
| CN112583864A (en) * | 2019-09-27 | 2021-03-30 | 中国移动通信集团广东有限公司 | Data migration method and device |
| CN112765126A (en) * | 2020-12-31 | 2021-05-07 | 金蝶软件（中国）有限公司 | Database transaction management method and device, computer equipment and storage medium |
| CN113127102A (en) * | 2021-05-18 | 2021-07-16 | 中国农业银行股份有限公司 | Method, device, equipment, storage medium and program for processing service data |
| CN114003644A (en) * | 2021-10-21 | 2022-02-01 | 河南星环众志信息科技有限公司 | Distributed transaction processing method, device, medium and database system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6460043B1 (en) * | 1998-02-04 | 2002-10-01 | Microsoft Corporation | Method and apparatus for operating on data with a conceptual data manipulation language |
| US20070271210A1 (en) * | 2006-05-18 | 2007-11-22 | Sabine Heider | Provision of persistence context to program components |
| CN102567399A (en) * | 2010-12-31 | 2012-07-11 | 北京新媒传信科技有限公司 | Method and device for accessing database |
| CN102760154A (en) * | 2012-05-23 | 2012-10-31 | 上海引跑信息科技有限公司 | Method supporting distributed transaction management in text information retrieval service |
| CN104794249A (en) * | 2015-05-15 | 2015-07-22 | 乐得科技有限公司 | Realization method and realization device of database |
| CN104793988A (en) * | 2014-01-20 | 2015-07-22 | 阿里巴巴集团控股有限公司 | Cross-database distributed transaction implementation method and device |
| CN106033439A (en) * | 2015-03-13 | 2016-10-19 | 阿里巴巴集团控股有限公司 | Method and system for processing distributed transaction |
-
2017
- 2017-03-14 CN CN201710148886.8A patent/CN108572991A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6460043B1 (en) * | 1998-02-04 | 2002-10-01 | Microsoft Corporation | Method and apparatus for operating on data with a conceptual data manipulation language |
| US20070271210A1 (en) * | 2006-05-18 | 2007-11-22 | Sabine Heider | Provision of persistence context to program components |
| CN102567399A (en) * | 2010-12-31 | 2012-07-11 | 北京新媒传信科技有限公司 | Method and device for accessing database |
| CN102760154A (en) * | 2012-05-23 | 2012-10-31 | 上海引跑信息科技有限公司 | Method supporting distributed transaction management in text information retrieval service |
| CN104793988A (en) * | 2014-01-20 | 2015-07-22 | 阿里巴巴集团控股有限公司 | Cross-database distributed transaction implementation method and device |
| CN106033439A (en) * | 2015-03-13 | 2016-10-19 | 阿里巴巴集团控股有限公司 | Method and system for processing distributed transaction |
| CN104794249A (en) * | 2015-05-15 | 2015-07-22 | 乐得科技有限公司 | Realization method and realization device of database |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134742A (en) * | 2019-04-25 | 2019-08-16 | 上海淇毓信息科技有限公司 | A kind of dynamic global level grouping method, device, system based on financial client |
| CN110134742B (en) * | 2019-04-25 | 2023-11-14 | 上海淇毓信息科技有限公司 | Dynamic global level grouping method, device and system based on financial clients |
| CN110750584A (en) * | 2019-09-18 | 2020-02-04 | 苏宁云计算有限公司 | Data management method and system |
| CN110750584B (en) * | 2019-09-18 | 2023-05-05 | 苏宁云计算有限公司 | Data management method and system |
| CN112583864A (en) * | 2019-09-27 | 2021-03-30 | 中国移动通信集团广东有限公司 | Data migration method and device |
| CN111209100A (en) * | 2020-01-03 | 2020-05-29 | 光大兴陇信托有限责任公司 | Service processing and data source determining method |
| CN111538605A (en) * | 2020-04-24 | 2020-08-14 | 北京思特奇信息技术股份有限公司 | Distributed data access layer middleware and command execution method and device |
| CN111522881A (en) * | 2020-04-26 | 2020-08-11 | 北京三快在线科技有限公司 | Service data processing method, device, server and storage medium |
| CN111522881B (en) * | 2020-04-26 | 2023-04-28 | 北京三快在线科技有限公司 | Service data processing method, device, server and storage medium |
| CN111782721B (en) * | 2020-05-09 | 2024-03-01 | 浙江小遛信息科技有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN111782721A (en) * | 2020-05-09 | 2020-10-16 | 宁波小遛共享信息科技有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN111930830A (en) * | 2020-06-22 | 2020-11-13 | 心有灵犀科技股份有限公司 | Distributed transaction data processing method and system based on shared database |
| CN111930830B (en) * | 2020-06-22 | 2024-04-16 | 心有灵犀科技股份有限公司 | Distributed transaction data processing method and system based on shared database |
| CN111858641A (en) * | 2020-07-30 | 2020-10-30 | 中国工商银行股份有限公司 | Transaction processing method and device, electronic equipment and readable storage medium |
| CN112487089A (en) * | 2020-11-26 | 2021-03-12 | 广州海量数据库技术有限公司 | Distributed storage method and system based on data page routing |
| CN112765126A (en) * | 2020-12-31 | 2021-05-07 | 金蝶软件（中国）有限公司 | Database transaction management method and device, computer equipment and storage medium |
| CN113127102A (en) * | 2021-05-18 | 2021-07-16 | 中国农业银行股份有限公司 | Method, device, equipment, storage medium and program for processing service data |
| CN114003644B (en) * | 2021-10-21 | 2022-11-15 | 河南星环众志信息科技有限公司 | Distributed transaction processing method, device, medium and database system |
| CN114003644A (en) * | 2021-10-21 | 2022-02-01 | 河南星环众志信息科技有限公司 | Distributed transaction processing method, device, medium and database system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108572991A (en) | Data base processing method, device and storage medium | |
| US8255420B2 (en) | Distributed storage | |
| US10579272B2 (en) | Workload aware storage platform | |
| KR100974149B1 (en) | Methods, systems and programs for maintaining a namespace of filesets accessible to clients over a network | |
| US9960999B2 (en) | Balanced load execution with locally distributed forwarding information base in information centric networks | |
| US20160292249A1 (en) | Dynamic replica failure detection and healing | |
| CN108319598B (en) | Data caching method, device and system | |
| CN108881348B (en) | Service quality control method and device and storage server | |
| US8706856B2 (en) | Service directory | |
| US11068461B1 (en) | Monitoring key access patterns for nonrelational databases | |
| US10817203B1 (en) | Client-configurable data tiering service | |
| US10579597B1 (en) | Data-tiering service with multiple cold tier quality of service levels | |
| EP3049940B1 (en) | Data caching policy in multiple tenant enterprise resource planning system | |
| US11567930B2 (en) | Adaptive data retrieval with runtime authorization | |
| US11080115B2 (en) | Sampling management of application programming interface (API) requests | |
| US11546307B2 (en) | Method to implement multi-tenant/shared Redis cluster using envoy | |
| US20220374407A1 (en) | Multi-tenant partitioning in a time-series database | |
| US10812543B1 (en) | Managed distribution of data stream contents | |
| CN109873839A (en) | Method, server and the distributed system of data access | |
| CN104021088A (en) | Log storage method and device | |
| CN109271438A (en) | A kind of data bank access method and its system | |
| US11442632B2 (en) | Rebalancing of user accounts among partitions of a storage service | |
| JP5310737B2 (en) | Configuration management apparatus, configuration management program and method | |
| CN105978744A (en) | Resource allocation method, device and system | |
| US11256440B2 (en) | Method and distributed storage system for aggregating statistics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180925 |
|
| RJ01 | Rejection of invention patent application after publication |