CN108241554A - A kind of data service system - Google Patents
A kind of data service system Download PDFInfo
- Publication number
- CN108241554A CN108241554A CN201611209626.9A CN201611209626A CN108241554A CN 108241554 A CN108241554 A CN 108241554A CN 201611209626 A CN201611209626 A CN 201611209626A CN 108241554 A CN108241554 A CN 108241554A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- service
- data center
- resource unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Abstract
The invention discloses a kind of data service systems, the system includes at least two data centers, include at least one database resource unit in each data center at least two data center, disparate databases resource unit in same data center, it is stored with using the different types of data being able to access that, the database resource number of unit that each data center at least two data center includes is identical, and the data type stored is identical.The technical issues of data service that individual data center provides in the prior art cannot undertake various application demands can be solved by the present invention.
Description
Technical field
The present invention relates to data service technology fields, and in particular to a kind of data service system.
Background technology
With becoming increasingly popular for network service, the type of network application is more and more, by network application accessing network equipment
Caused user data visit capacity is increasing.At present, network data is usually stored entirely in a data center, the data
Center often data access amount is excessive or hardware, computer room, network etc. due to and break down, individual data center occurs
Failure can lead to happening for service disruption, therefore provide the system reliability ratio of data service for application by individual data center
It is relatively low.
With the extension of current business scale and the increase of data center's disaster tolerance demand, the data that individual data center provides
Service cannot undertake the demand of various applications.
Invention content
The object of the present invention is to provide a kind of data service system, to solve individual data center offer in the prior art
Data service cannot undertake the technical issues of various application demands.
The purpose of the present invention is what is be achieved through the following technical solutions:
The present invention provides a kind of data service system, including at least two data centers;
Include at least one database resource in each data center at least two data center
Unit, the disparate databases resource unit in same data center are stored with using the different types of data being able to access that, described
The database resource number of unit that each data center at least two data centers includes is identical, and stores
Data type it is identical.By setting at least two data centers in data service system, solve single in the prior art
The technical issues of data service that data center provides cannot undertake various application demands, due at least two data centers
In each data center in include the database resource unit of storage identical data, i.e. at least two data centers can carry
It, can also be by other at least one data centers for identical data service, therefore when one of data center breaks down
Data service is provided for application.
Preferably, it is further included in the data service system for the database resource unit point for storing each categorical data
The database resource backup units not set, for storing the data in corresponding database resource unit.By being taken in data
Database resource backup units in business system are set, can be ensured when database resource unit breaks down, database resource
Backup units can alternate data base resource unit for application data service is provided.
Preferably, it is backed up for the database resource that the database resource unit for storing each categorical data is set respectively single
The quantity of member is one, and each database resource backup units are respectively positioned on the same number at least two data center
According in center.By the way that each database resource backup units are arranged in same data center, convenient for database resource
The centralized management of backup units.
Preferably, at least two data center includes a primary data center, each database resource backup is single
Member is respectively positioned in the primary data center.
Preferably, the database resource unit include database broker (Proxy) cluster, database service cluster and
Data synchronization service cluster;The database Proxy clusters, for realizing read-write point to the data of the database resource unit
From and data point library divide table;The database service cluster, for being provided for the application for accessing the database resource unit
Reading and writing data service;The data synchronization service cluster, for the database resource unit and other database resource units
Between realize data synchronize.
Preferably, the database service cluster includes at least two database service cluster groups, wherein, it is described at least
The structure of each database service cluster group is identical in two database services set groups;The database service cluster group includes
Primary database, standby database and at least two are from database;The primary database is accesses the database resource list
The application of member provides reading and writing data service;The standby database and described at least two from database to access the database
The application of resource unit provides data and reads service;The primary database, the standby database and described at least two are from number
It is completely the same according to the data in library.By the way that the database service cluster is grouped, when data volume is larger, multi-group data is used
Library service cluster can improve the access efficiency of application.
Preferably, the data synchronization service cluster includes primary data synchronization service cluster clothes synchronous with preliminary data
Business cluster.By setting primary data synchronization service cluster and preliminary data synchronous service cluster, in primary data synchronization service
Cluster, the alternative primary data synchronization service cluster work of preliminary data synchronous service cluster, avoids data sync break.
Preferably, global guiding load balancing (Global Server Load are further included in the data service system
Balance, GSLB) server, the GSLB servers, for determining any one number at least two data center
According to center, and it is determined as the database resource that the application provides read-write service in any one data center described in determining
Unit.
Preferably, the GSLB server through database Proxy clusters, any one data center described in determine
In be determined as the database resource unit that the application provides read-write service.
Preferably, the quantity of the data center is three.
Description of the drawings
Fig. 1 is a kind of structure diagram of data service system provided in an embodiment of the present invention;
Fig. 2 is that the data service system after a kind of division by database resource cellular logic provided in an embodiment of the present invention shows
It is intended to;
Fig. 3 is the data service system after another division by database resource cellular logic provided in an embodiment of the present invention
Schematic diagram;
Fig. 4 is a kind of composition structure diagram of database resource unit provided in an embodiment of the present invention;
Fig. 5 is a kind of composition structure diagram of database service cluster provided in an embodiment of the present invention;
Fig. 6 is a kind of composition structure diagram of database service cluster group provided in an embodiment of the present invention;
Fig. 7 provides the signal of data service for a kind of data service system provided in an embodiment of the present invention for different applications
Figure;
Fig. 8 provides showing for data service for another data service system provided in an embodiment of the present invention for different applications
It is intended to.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is retouched in detail
It states, it is clear that described embodiment is only part of the embodiment of the present invention, is not whole embodiments.
Various application demands cannot be undertaken in order to solve the data service that individual data center provides in the prior art
The technical issues of, the embodiment of the present invention provides a kind of data service system.
Below in conjunction with the accompanying drawings, a kind of data service system specific embodiment provided in an embodiment of the present invention is carried out detailed
Explanation.
The embodiment of the present invention provides a kind of data service system, as shown in Figure 1, the system is included at least two data
The heart includes at least one database resource unit in each data center at least two data center,
Disparate databases resource unit in same data center is stored with using the different types of data that is able to access that, it is described at least
The database resource number of unit that each data center in Liang Ge data centers includes is identical, and the number stored
It is identical according to type.By setting at least two data centers in data service system, solves individual data in the prior art
The technical issues of data service that center provides cannot undertake various application demands, due at least two data centers
Include the database resource unit of storage identical data in each data center, i.e. at least two data centers can provide phase
Same data service, therefore when one of data center breaks down, it can also be by other at least one data centers to answer
With offer data service.
In the embodiment of the present invention, at least two data center includes primary data center.One of data center
After primary data center, other at least one data centers are as primary data center from data center.As master data
The data center at center keeps bi-directional data synchronous with other data centers, at least one from the unidirectional number of holding between data center
According to synchronization.
Fig. 2 shows the data service system schematic diagram after a kind of division by database resource cellular logic, such as Fig. 2 institutes
Show, storing the database resource unit of same type data in data service system in different data center can logically draw
It is divided into one group of Database Unit, different groups of numbers can be logically divided by storing the database resource unit of different types of data
According to library unit, the database resource unit in same group of data library unit can provide identical data service for application, different
Database resource unit in group Database Unit provides different data services for application.
Fig. 3 shows another data service system schematic diagram after database resource cellular logic is divided, such as Fig. 3 institutes
Show, the data set respectively for the database resource unit for storing each categorical data are further included in the data service system
Base resource backup units, for storing the data in corresponding database resource unit.What the data service system included
Database resource backup units can logically be divided to the data including storing same type data in different data center
In the Database Unit of base resource unit.By setting database resource backup units in data service system, can ensure
When database resource unit breaks down, database resource backup units can alternate data base resource unit for application provide
Data service.
In the embodiment of the present invention, each database resource backup units are respectively positioned on same at least two data center
In one data center, by the way that each database resource backup units are arranged in same data center, convenient for data
The centralized management of base resource backup units.Preferably, database resource backup units are located in the primary data center, for depositing
It is one to store up the quantity of database resource backup units that the database resource unit of each categorical data is set respectively.Data
Base resource backup units keep one-way data synchronous between the database resource unit with storing identical data, i.e., can only pass through number
According to the data in the data update database resource backup units in base resource unit.
In the embodiment of the present invention, GSLB servers are further included in the data service system, the GSLB servers are used for
Any one data center is determined at least two data center, and in any one data center described in determining
It is determined as the database resource unit that the application provides read-write service.When there is data service system described in application access, institute
It states GSLB servers, can be applied according to current accessed with the distance of data center each in the data service system and often
The load state of a data center, selected as application provide the data center of read-write service.For example, can by away from access application away from
A data center good from nearest and load state provides reading and writing data service for application, also can be by away from access applications distances
Reading and writing data service is provided for application jointly compared with the near and good multiple data centers of load state, is total to when by multiple data centers
When being all using reading and writing data service is provided, a part of reading and writing data service of application can be held by one of data center
Load, the other parts reading and writing data service of application are undertaken by other data centers, are not only reduced in this way by a data
When the heart provides reading and writing data service for application, the load of data center, while accelerate each place using reading and writing data service
Manage speed.
In the embodiment of the present invention, the database resource unit includes database Proxy clusters, database service cluster
With data synchronization service cluster, Fig. 4 shows a kind of composition structure chart of database resource unit, as shown in figure 4, when having using visit
When asking the database resource unit, the GSLB servers determine any one number at least two data center
According to center, and pass through database broker Proxy clusters, be determined as the application in any one data center described in determining
The database resource unit of read-write service is provided.The database Proxy clusters judge to access the database resource unit
Using to read data manipulation or data writing operation, that is, realize the reading and writing data separation to the database resource unit, due to
Data volume is very big in the database resource unit, and in order to improve the efficiency of application access, the database Proxy clusters are by institute
It states data in data type in database resource unit and carries out a point library and divide table.The database Proxy clusters, judge described in access
After the application of database resource unit is reads data manipulation or data writing operation, the database service cluster is accesses institute
The application for stating database resource unit provides reading and writing data service.The data synchronization service cluster obtains the database service
Cluster reads the database journal after data, and database journal is analyzed, so as to fulfill the database resource unit
Data between other database resource units are synchronous.
In the embodiment of the present invention, the database service cluster includes at least two database service cluster groups, and Fig. 5 shows
Go out a kind of composition structure chart of database service cluster, as shown in figure 5, the database service cluster include at least two
The structure of each database service cluster group is identical in database service cluster group, when data volume is larger in database resource unit
When, using the structure of database service cluster grouping, the access efficiency of application can be improved.
In the embodiment of the present invention, the database service cluster group includes primary database, standby database and at least two
It is a that from database, Fig. 6 shows a kind of composition structure chart of database service cluster group, as shown in fig. 6, wherein, the primary number
According to library reading and writing data service, the standby database and described at least two are provided to access the application of the database resource unit
It is a to provide data to access the application of the database resource unit from database and read service, it is the primary database, described standby
It is completely the same from the data in database with database and described at least two, in order to ensure primary database and standby database
And at least two from database data consistency, the two-way same of data is kept between primary database and standby database
Step, primary database at least two from the one-way synchronizations of database holding data, i.e., can only be from primary database at least two
A synchrodata from database, same standby database and at least two is from also keeping the unidirectional same of data between database
Step, the dotted arrow in Fig. 6 represent the primary database, the standby database and described at least two from database it
Between data synchronize flow direction.
Wherein, data synchronization service cluster described in the embodiment of the present invention includes primary data synchronization service cluster and standby
With data synchronization service cluster.By setting primary data synchronization service cluster and preliminary data synchronous service cluster, primary
Data synchronization service cluster, the alternative primary data synchronization service cluster work of preliminary data synchronous service cluster, avoids data
Sync break.
In the embodiment of the present invention, provided separately below when data center's quantity is two, is directed to often in data service system
Class database resource unit sets a database resource backup units and database resource backup units are located at the master data
When in center;With data centric quantity one is set per class database resource unit to be directed in three and data service system
Database resource backup units and when database resource backup units are located in the primary data center, data service system is not
The specific implementation process of data service is provided with application.
Fig. 7 shows that a kind of data service system provides the schematic diagram of data service for different applications, as shown in fig. 7,
The data service system includes Liang Ge data centers, and each data center includes the data of two classes storage different types of data
The database resource cellular logic of same type is divided into one group of Database Unit by base resource unit, and data service system is also
A database resource backup units including being directed to every class database resource unit setting, database resource backup units are located at
GSLB servers are further included in the primary data center, in data service system.It also illustrates in Fig. 7 and is asked to data service system
Service applies A, using B and using C.Wherein, represent that different types of request is applied respectively using A, using B and application C.Example
Such as, when request data being needed to service using A, request instruction is first sent to GSLB servers, GSLB servers are according to specific
Rule by application A request be assigned to one of data center.When the two data centers there are one break down when, will
Service is provided by another data center.When the database resource unit in primary data center breaks down, database resource
Backup units replace the database resource unit in primary data center to provide data service for application.
In the embodiment of the present invention, in order to ensure that data service system provides the reliability of data service, preferably, the number
Quantity according to center is three.
Fig. 8 shows that another data service system provides the schematic diagram of data service for different applications, such as Fig. 8 institutes
Show, the data service system includes three data centers, and each data center includes two classes storage different types of data
The database resource cellular logic of same type is divided into one group of Database Unit, data service system by database resource unit
System is further included for a database resource backup units per the setting of class database resource unit, database resource backup units
GSLB servers are further included in the primary data center, in data service system.It is also illustrated in Fig. 8 to data service system
Ask the application A of service, using B and using C.Wherein, represent that different types of request should respectively using A, using B and application C
With.For example, when request data being needed to service using A, request instruction is first sent to GSLB servers, GSLB servers according to
The request of application A is assigned to one of data center by specific rule.Between these three data centers, primary data center with
Bi-directional data synchronization is carried out from data center, you can to pass through the data update in the database resource unit in primary data center
Data from the database resource unit in data center, can also be by from the database resource unit in data center
Data update primary data center in database resource unit in data.It is synchronized from no data between data center.When three
It, will be by another two data center when a data center from the database resource unit in data center there are one breaking down
Database resource unit provides service.When the database resource unit in primary data center breaks down, master data will be started
Database resource backup units in center provide data service for application, enable the primary data center with intact from data
Center keeps bi-directional data to synchronize.
The embodiment of the present invention provides a kind of data service system, including at least two data centers, at least two number
According at least one database resource unit is included in each data center in center, in same data center not
With database resource unit, it is stored with using the different types of data being able to access that, it is every at least two data center
The database resource number of unit that a data center includes is identical, and the data type stored is identical.By
At least two data centers in data service system are set, solve the data service that individual data center provides in the prior art
The technical issues of various application demands cannot have been undertaken, since each data center at least two data centers includes
There is the database resource unit of storage same data type, i.e. at least two data centers can provide identical data service,
Therefore when one of data center breaks down, data clothes can also be provided for application by other at least one data centers
Business.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
God and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (10)
1. a kind of data service system, which is characterized in that including:
At least two data centers;
Include at least one database resource unit in each data center at least two data center;
Disparate databases resource unit in same data center is stored with using the different types of data being able to access that;
The database resource number of unit phase that each data center at least two data center includes
Together, and the data type of storage is identical.
2. data service system as described in claim 1, which is characterized in that further include to be directed in the data service system and deposit
The database resource backup units that the database resource unit of each categorical data is set respectively are stored up, for storing corresponding data
Data in base resource unit.
3. data service system as claimed in claim 2, which is characterized in that provided for the database for storing each categorical data
The quantity of database resource backup units that source unit is set respectively is one;
Each database resource backup units are respectively positioned in the same data center at least two data center.
4. data service system as claimed in claim 3, which is characterized in that at least two data center includes one
Primary data center;
Each database resource backup units are respectively positioned in the primary data center.
5. data service system as described in claim 1, which is characterized in that the database resource unit includes database
Act on behalf of Proxy clusters, database service cluster and data synchronization service cluster;
The database Proxy clusters, for the data of the database resource unit to be realized with read and write abruption and data point
Table is divided in library;
The database service cluster, for providing reading and writing data service for the application for accessing the database resource unit;
The data synchronization service cluster, for realizing number between the database resource unit and other database resource units
According to synchronization.
6. data service system as claimed in claim 5, which is characterized in that the database service cluster includes at least two
A database services set group, wherein, each database service cluster group in at least two database services cluster group
Structure is identical;
The database service cluster group includes primary database, standby database and at least two from database;
The primary database provides reading and writing data service to access the application of the database resource unit;
The standby database and described at least two provides number from database to access the application of the database resource unit
According to the service of reading;
The primary database, the standby database and described at least two are completely the same from the data in database.
7. data service system as claimed in claim 5, which is characterized in that the data synchronization service cluster includes primary
Data synchronization service cluster and preliminary data synchronous service cluster.
8. data service system as described in claim 1, which is characterized in that further include the overall situation in the data service system and lead
To load balancing service GSLB servers;
The GSLB servers for determining any one data center at least two data center, and are determining
Any one described data center in be determined as the database resource unit that the application provides read-write service.
9. data service system as claimed in claim 8, which is characterized in that the GSLB server through database agency
Proxy clusters are determined as the database money that the application provides read-write service in any one data center described in determining
Source unit.
10. the data service system as described in claim 1~9 is any, which is characterized in that the quantity of the data center is three
It is a.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611209626.9A CN108241554A (en) | 2016-12-23 | 2016-12-23 | A kind of data service system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611209626.9A CN108241554A (en) | 2016-12-23 | 2016-12-23 | A kind of data service system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108241554A true CN108241554A (en) | 2018-07-03 |
Family
ID=62704379
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201611209626.9A Pending CN108241554A (en) | 2016-12-23 | 2016-12-23 | A kind of data service system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108241554A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102158540A (en) * | 2011-02-18 | 2011-08-17 | 广州从兴电子开发有限公司 | System and method for realizing distributed database |
CN103019875A (en) * | 2012-12-19 | 2013-04-03 | 北京世纪家天下科技发展有限公司 | Method and device for realizing double main reconstruction of database |
US9143383B2 (en) * | 2012-11-01 | 2015-09-22 | Miiicasa Taiwan Inc. | Method and system for managing device identification |
CN105224637A (en) * | 2015-09-24 | 2016-01-06 | 珠海许继芝电网自动化有限公司 | A kind of based on PostgreSQL database active and standby/the comprehensive method of cluster application |
CN105262835A (en) * | 2015-10-30 | 2016-01-20 | 北京奇虎科技有限公司 | Data storage method and device of multiple machine rooms |
CN105262633A (en) * | 2015-11-27 | 2016-01-20 | 中国建设银行股份有限公司 | Application-level disaster tolerant method and application-level disaster system |
-
2016
- 2016-12-23 CN CN201611209626.9A patent/CN108241554A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102158540A (en) * | 2011-02-18 | 2011-08-17 | 广州从兴电子开发有限公司 | System and method for realizing distributed database |
US9143383B2 (en) * | 2012-11-01 | 2015-09-22 | Miiicasa Taiwan Inc. | Method and system for managing device identification |
CN103019875A (en) * | 2012-12-19 | 2013-04-03 | 北京世纪家天下科技发展有限公司 | Method and device for realizing double main reconstruction of database |
CN105224637A (en) * | 2015-09-24 | 2016-01-06 | 珠海许继芝电网自动化有限公司 | A kind of based on PostgreSQL database active and standby/the comprehensive method of cluster application |
CN105262835A (en) * | 2015-10-30 | 2016-01-20 | 北京奇虎科技有限公司 | Data storage method and device of multiple machine rooms |
CN105262633A (en) * | 2015-11-27 | 2016-01-20 | 中国建设银行股份有限公司 | Application-level disaster tolerant method and application-level disaster system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9367600B2 (en) | Policy-based storage structure distribution | |
US9246780B2 (en) | System and method for supporting port multiplexing in a server environment | |
US9749445B2 (en) | System and method for updating service information for across-domain messaging in a transactional middleware machine environment | |
CN108183961A (en) | A kind of distributed caching method based on Redis | |
US11068499B2 (en) | Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching | |
US11609914B2 (en) | Policy-based storage structure distribution | |
US20100023564A1 (en) | Synchronous replication for fault tolerance | |
US20120278817A1 (en) | Event distribution pattern for use with a distributed data grid | |
CN103150304A (en) | Cloud database system | |
CN110648178A (en) | Method for increasing kafka consumption capacity | |
US20180052900A1 (en) | Generating database sequences in a replicated database environment | |
CN105635311A (en) | Method for synchronizing resource pool information in cloud management platform | |
CN112199427A (en) | Data processing method and system | |
CN104753987B (en) | A kind of distributed conversation management method and system | |
US11461053B2 (en) | Data storage system with separate interfaces for bulk data ingestion and data access | |
Malkhi et al. | From paxos to corfu: a flash-speed shared log | |
CN109391487A (en) | A kind of configuration update method and system | |
US20130275670A1 (en) | Multiple enhanced catalog sharing (ecs) cache structure for sharing catalogs in a multiprocessor system | |
CN110012050A (en) | Message Processing, storage method, apparatus and system | |
Pankowski | Consistency and availability of Data in replicated NoSQL databases | |
CN108241554A (en) | A kind of data service system | |
CN111400110B (en) | Database access management system | |
US10061607B2 (en) | System and method for providing single group multiple branches based on instance awareness | |
JP2021072087A (en) | Distributed storage remote self-repairing program | |
CN112799835A (en) | Method and system for processing metadata of distributed database system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180703 |
|
WD01 | Invention patent application deemed withdrawn after publication |