CN108241554A - A kind of data service system - Google Patents

A kind of data service system Download PDF

Info

Publication number
CN108241554A
CN108241554A CN201611209626.9A CN201611209626A CN108241554A CN 108241554 A CN108241554 A CN 108241554A CN 201611209626 A CN201611209626 A CN 201611209626A CN 108241554 A CN108241554 A CN 108241554A
Authority
CN
China
Prior art keywords
data
database
service
data center
resource unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611209626.9A
Other languages
Chinese (zh)
Inventor
吴东升
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Excellent Friends Bullock Media Development Co
Original Assignee
Shenzhen Excellent Friends Bullock Media Development Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Excellent Friends Bullock Media Development Co filed Critical Shenzhen Excellent Friends Bullock Media Development Co
Priority to CN201611209626.9A priority Critical patent/CN108241554A/en
Publication of CN108241554A publication Critical patent/CN108241554A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system

Abstract

The invention discloses a kind of data service systems, the system includes at least two data centers, include at least one database resource unit in each data center at least two data center, disparate databases resource unit in same data center, it is stored with using the different types of data being able to access that, the database resource number of unit that each data center at least two data center includes is identical, and the data type stored is identical.The technical issues of data service that individual data center provides in the prior art cannot undertake various application demands can be solved by the present invention.

Description

A kind of data service system
Technical field
The present invention relates to data service technology fields, and in particular to a kind of data service system.
Background technology
With becoming increasingly popular for network service, the type of network application is more and more, by network application accessing network equipment Caused user data visit capacity is increasing.At present, network data is usually stored entirely in a data center, the data Center often data access amount is excessive or hardware, computer room, network etc. due to and break down, individual data center occurs Failure can lead to happening for service disruption, therefore provide the system reliability ratio of data service for application by individual data center It is relatively low.
With the extension of current business scale and the increase of data center's disaster tolerance demand, the data that individual data center provides Service cannot undertake the demand of various applications.
Invention content
The object of the present invention is to provide a kind of data service system, to solve individual data center offer in the prior art Data service cannot undertake the technical issues of various application demands.
The purpose of the present invention is what is be achieved through the following technical solutions:
The present invention provides a kind of data service system, including at least two data centers;
Include at least one database resource in each data center at least two data center Unit, the disparate databases resource unit in same data center are stored with using the different types of data being able to access that, described The database resource number of unit that each data center at least two data centers includes is identical, and stores Data type it is identical.By setting at least two data centers in data service system, solve single in the prior art The technical issues of data service that data center provides cannot undertake various application demands, due at least two data centers In each data center in include the database resource unit of storage identical data, i.e. at least two data centers can carry It, can also be by other at least one data centers for identical data service, therefore when one of data center breaks down Data service is provided for application.
Preferably, it is further included in the data service system for the database resource unit point for storing each categorical data The database resource backup units not set, for storing the data in corresponding database resource unit.By being taken in data Database resource backup units in business system are set, can be ensured when database resource unit breaks down, database resource Backup units can alternate data base resource unit for application data service is provided.
Preferably, it is backed up for the database resource that the database resource unit for storing each categorical data is set respectively single The quantity of member is one, and each database resource backup units are respectively positioned on the same number at least two data center According in center.By the way that each database resource backup units are arranged in same data center, convenient for database resource The centralized management of backup units.
Preferably, at least two data center includes a primary data center, each database resource backup is single Member is respectively positioned in the primary data center.
Preferably, the database resource unit include database broker (Proxy) cluster, database service cluster and Data synchronization service cluster;The database Proxy clusters, for realizing read-write point to the data of the database resource unit From and data point library divide table;The database service cluster, for being provided for the application for accessing the database resource unit Reading and writing data service;The data synchronization service cluster, for the database resource unit and other database resource units Between realize data synchronize.
Preferably, the database service cluster includes at least two database service cluster groups, wherein, it is described at least The structure of each database service cluster group is identical in two database services set groups;The database service cluster group includes Primary database, standby database and at least two are from database;The primary database is accesses the database resource list The application of member provides reading and writing data service;The standby database and described at least two from database to access the database The application of resource unit provides data and reads service;The primary database, the standby database and described at least two are from number It is completely the same according to the data in library.By the way that the database service cluster is grouped, when data volume is larger, multi-group data is used Library service cluster can improve the access efficiency of application.
Preferably, the data synchronization service cluster includes primary data synchronization service cluster clothes synchronous with preliminary data Business cluster.By setting primary data synchronization service cluster and preliminary data synchronous service cluster, in primary data synchronization service Cluster, the alternative primary data synchronization service cluster work of preliminary data synchronous service cluster, avoids data sync break.
Preferably, global guiding load balancing (Global Server Load are further included in the data service system Balance, GSLB) server, the GSLB servers, for determining any one number at least two data center According to center, and it is determined as the database resource that the application provides read-write service in any one data center described in determining Unit.
Preferably, the GSLB server through database Proxy clusters, any one data center described in determine In be determined as the database resource unit that the application provides read-write service.
Preferably, the quantity of the data center is three.
Description of the drawings
Fig. 1 is a kind of structure diagram of data service system provided in an embodiment of the present invention;
Fig. 2 is that the data service system after a kind of division by database resource cellular logic provided in an embodiment of the present invention shows It is intended to;
Fig. 3 is the data service system after another division by database resource cellular logic provided in an embodiment of the present invention Schematic diagram;
Fig. 4 is a kind of composition structure diagram of database resource unit provided in an embodiment of the present invention;
Fig. 5 is a kind of composition structure diagram of database service cluster provided in an embodiment of the present invention;
Fig. 6 is a kind of composition structure diagram of database service cluster group provided in an embodiment of the present invention;
Fig. 7 provides the signal of data service for a kind of data service system provided in an embodiment of the present invention for different applications Figure;
Fig. 8 provides showing for data service for another data service system provided in an embodiment of the present invention for different applications It is intended to.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is retouched in detail It states, it is clear that described embodiment is only part of the embodiment of the present invention, is not whole embodiments.
Various application demands cannot be undertaken in order to solve the data service that individual data center provides in the prior art The technical issues of, the embodiment of the present invention provides a kind of data service system.
Below in conjunction with the accompanying drawings, a kind of data service system specific embodiment provided in an embodiment of the present invention is carried out detailed Explanation.
The embodiment of the present invention provides a kind of data service system, as shown in Figure 1, the system is included at least two data The heart includes at least one database resource unit in each data center at least two data center, Disparate databases resource unit in same data center is stored with using the different types of data that is able to access that, it is described at least The database resource number of unit that each data center in Liang Ge data centers includes is identical, and the number stored It is identical according to type.By setting at least two data centers in data service system, solves individual data in the prior art The technical issues of data service that center provides cannot undertake various application demands, due at least two data centers Include the database resource unit of storage identical data in each data center, i.e. at least two data centers can provide phase Same data service, therefore when one of data center breaks down, it can also be by other at least one data centers to answer With offer data service.
In the embodiment of the present invention, at least two data center includes primary data center.One of data center After primary data center, other at least one data centers are as primary data center from data center.As master data The data center at center keeps bi-directional data synchronous with other data centers, at least one from the unidirectional number of holding between data center According to synchronization.
Fig. 2 shows the data service system schematic diagram after a kind of division by database resource cellular logic, such as Fig. 2 institutes Show, storing the database resource unit of same type data in data service system in different data center can logically draw It is divided into one group of Database Unit, different groups of numbers can be logically divided by storing the database resource unit of different types of data According to library unit, the database resource unit in same group of data library unit can provide identical data service for application, different Database resource unit in group Database Unit provides different data services for application.
Fig. 3 shows another data service system schematic diagram after database resource cellular logic is divided, such as Fig. 3 institutes Show, the data set respectively for the database resource unit for storing each categorical data are further included in the data service system Base resource backup units, for storing the data in corresponding database resource unit.What the data service system included Database resource backup units can logically be divided to the data including storing same type data in different data center In the Database Unit of base resource unit.By setting database resource backup units in data service system, can ensure When database resource unit breaks down, database resource backup units can alternate data base resource unit for application provide Data service.
In the embodiment of the present invention, each database resource backup units are respectively positioned on same at least two data center In one data center, by the way that each database resource backup units are arranged in same data center, convenient for data The centralized management of base resource backup units.Preferably, database resource backup units are located in the primary data center, for depositing It is one to store up the quantity of database resource backup units that the database resource unit of each categorical data is set respectively.Data Base resource backup units keep one-way data synchronous between the database resource unit with storing identical data, i.e., can only pass through number According to the data in the data update database resource backup units in base resource unit.
In the embodiment of the present invention, GSLB servers are further included in the data service system, the GSLB servers are used for Any one data center is determined at least two data center, and in any one data center described in determining It is determined as the database resource unit that the application provides read-write service.When there is data service system described in application access, institute It states GSLB servers, can be applied according to current accessed with the distance of data center each in the data service system and often The load state of a data center, selected as application provide the data center of read-write service.For example, can by away from access application away from A data center good from nearest and load state provides reading and writing data service for application, also can be by away from access applications distances Reading and writing data service is provided for application jointly compared with the near and good multiple data centers of load state, is total to when by multiple data centers When being all using reading and writing data service is provided, a part of reading and writing data service of application can be held by one of data center Load, the other parts reading and writing data service of application are undertaken by other data centers, are not only reduced in this way by a data When the heart provides reading and writing data service for application, the load of data center, while accelerate each place using reading and writing data service Manage speed.
In the embodiment of the present invention, the database resource unit includes database Proxy clusters, database service cluster With data synchronization service cluster, Fig. 4 shows a kind of composition structure chart of database resource unit, as shown in figure 4, when having using visit When asking the database resource unit, the GSLB servers determine any one number at least two data center According to center, and pass through database broker Proxy clusters, be determined as the application in any one data center described in determining The database resource unit of read-write service is provided.The database Proxy clusters judge to access the database resource unit Using to read data manipulation or data writing operation, that is, realize the reading and writing data separation to the database resource unit, due to Data volume is very big in the database resource unit, and in order to improve the efficiency of application access, the database Proxy clusters are by institute It states data in data type in database resource unit and carries out a point library and divide table.The database Proxy clusters, judge described in access After the application of database resource unit is reads data manipulation or data writing operation, the database service cluster is accesses institute The application for stating database resource unit provides reading and writing data service.The data synchronization service cluster obtains the database service Cluster reads the database journal after data, and database journal is analyzed, so as to fulfill the database resource unit Data between other database resource units are synchronous.
In the embodiment of the present invention, the database service cluster includes at least two database service cluster groups, and Fig. 5 shows Go out a kind of composition structure chart of database service cluster, as shown in figure 5, the database service cluster include at least two The structure of each database service cluster group is identical in database service cluster group, when data volume is larger in database resource unit When, using the structure of database service cluster grouping, the access efficiency of application can be improved.
In the embodiment of the present invention, the database service cluster group includes primary database, standby database and at least two It is a that from database, Fig. 6 shows a kind of composition structure chart of database service cluster group, as shown in fig. 6, wherein, the primary number According to library reading and writing data service, the standby database and described at least two are provided to access the application of the database resource unit It is a to provide data to access the application of the database resource unit from database and read service, it is the primary database, described standby It is completely the same from the data in database with database and described at least two, in order to ensure primary database and standby database And at least two from database data consistency, the two-way same of data is kept between primary database and standby database Step, primary database at least two from the one-way synchronizations of database holding data, i.e., can only be from primary database at least two A synchrodata from database, same standby database and at least two is from also keeping the unidirectional same of data between database Step, the dotted arrow in Fig. 6 represent the primary database, the standby database and described at least two from database it Between data synchronize flow direction.
Wherein, data synchronization service cluster described in the embodiment of the present invention includes primary data synchronization service cluster and standby With data synchronization service cluster.By setting primary data synchronization service cluster and preliminary data synchronous service cluster, primary Data synchronization service cluster, the alternative primary data synchronization service cluster work of preliminary data synchronous service cluster, avoids data Sync break.
In the embodiment of the present invention, provided separately below when data center's quantity is two, is directed to often in data service system Class database resource unit sets a database resource backup units and database resource backup units are located at the master data When in center;With data centric quantity one is set per class database resource unit to be directed in three and data service system Database resource backup units and when database resource backup units are located in the primary data center, data service system is not The specific implementation process of data service is provided with application.
Fig. 7 shows that a kind of data service system provides the schematic diagram of data service for different applications, as shown in fig. 7, The data service system includes Liang Ge data centers, and each data center includes the data of two classes storage different types of data The database resource cellular logic of same type is divided into one group of Database Unit by base resource unit, and data service system is also A database resource backup units including being directed to every class database resource unit setting, database resource backup units are located at GSLB servers are further included in the primary data center, in data service system.It also illustrates in Fig. 7 and is asked to data service system Service applies A, using B and using C.Wherein, represent that different types of request is applied respectively using A, using B and application C.Example Such as, when request data being needed to service using A, request instruction is first sent to GSLB servers, GSLB servers are according to specific Rule by application A request be assigned to one of data center.When the two data centers there are one break down when, will Service is provided by another data center.When the database resource unit in primary data center breaks down, database resource Backup units replace the database resource unit in primary data center to provide data service for application.
In the embodiment of the present invention, in order to ensure that data service system provides the reliability of data service, preferably, the number Quantity according to center is three.
Fig. 8 shows that another data service system provides the schematic diagram of data service for different applications, such as Fig. 8 institutes Show, the data service system includes three data centers, and each data center includes two classes storage different types of data The database resource cellular logic of same type is divided into one group of Database Unit, data service system by database resource unit System is further included for a database resource backup units per the setting of class database resource unit, database resource backup units GSLB servers are further included in the primary data center, in data service system.It is also illustrated in Fig. 8 to data service system Ask the application A of service, using B and using C.Wherein, represent that different types of request should respectively using A, using B and application C With.For example, when request data being needed to service using A, request instruction is first sent to GSLB servers, GSLB servers according to The request of application A is assigned to one of data center by specific rule.Between these three data centers, primary data center with Bi-directional data synchronization is carried out from data center, you can to pass through the data update in the database resource unit in primary data center Data from the database resource unit in data center, can also be by from the database resource unit in data center Data update primary data center in database resource unit in data.It is synchronized from no data between data center.When three It, will be by another two data center when a data center from the database resource unit in data center there are one breaking down Database resource unit provides service.When the database resource unit in primary data center breaks down, master data will be started Database resource backup units in center provide data service for application, enable the primary data center with intact from data Center keeps bi-directional data to synchronize.
The embodiment of the present invention provides a kind of data service system, including at least two data centers, at least two number According at least one database resource unit is included in each data center in center, in same data center not With database resource unit, it is stored with using the different types of data being able to access that, it is every at least two data center The database resource number of unit that a data center includes is identical, and the data type stored is identical.By At least two data centers in data service system are set, solve the data service that individual data center provides in the prior art The technical issues of various application demands cannot have been undertaken, since each data center at least two data centers includes There is the database resource unit of storage same data type, i.e. at least two data centers can provide identical data service, Therefore when one of data center breaks down, data clothes can also be provided for application by other at least one data centers Business.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art God and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to include these modifications and variations.

Claims (10)

1. a kind of data service system, which is characterized in that including:
At least two data centers;
Include at least one database resource unit in each data center at least two data center;
Disparate databases resource unit in same data center is stored with using the different types of data being able to access that;
The database resource number of unit phase that each data center at least two data center includes Together, and the data type of storage is identical.
2. data service system as described in claim 1, which is characterized in that further include to be directed in the data service system and deposit The database resource backup units that the database resource unit of each categorical data is set respectively are stored up, for storing corresponding data Data in base resource unit.
3. data service system as claimed in claim 2, which is characterized in that provided for the database for storing each categorical data The quantity of database resource backup units that source unit is set respectively is one;
Each database resource backup units are respectively positioned in the same data center at least two data center.
4. data service system as claimed in claim 3, which is characterized in that at least two data center includes one Primary data center;
Each database resource backup units are respectively positioned in the primary data center.
5. data service system as described in claim 1, which is characterized in that the database resource unit includes database Act on behalf of Proxy clusters, database service cluster and data synchronization service cluster;
The database Proxy clusters, for the data of the database resource unit to be realized with read and write abruption and data point Table is divided in library;
The database service cluster, for providing reading and writing data service for the application for accessing the database resource unit;
The data synchronization service cluster, for realizing number between the database resource unit and other database resource units According to synchronization.
6. data service system as claimed in claim 5, which is characterized in that the database service cluster includes at least two A database services set group, wherein, each database service cluster group in at least two database services cluster group Structure is identical;
The database service cluster group includes primary database, standby database and at least two from database;
The primary database provides reading and writing data service to access the application of the database resource unit;
The standby database and described at least two provides number from database to access the application of the database resource unit According to the service of reading;
The primary database, the standby database and described at least two are completely the same from the data in database.
7. data service system as claimed in claim 5, which is characterized in that the data synchronization service cluster includes primary Data synchronization service cluster and preliminary data synchronous service cluster.
8. data service system as described in claim 1, which is characterized in that further include the overall situation in the data service system and lead To load balancing service GSLB servers;
The GSLB servers for determining any one data center at least two data center, and are determining Any one described data center in be determined as the database resource unit that the application provides read-write service.
9. data service system as claimed in claim 8, which is characterized in that the GSLB server through database agency Proxy clusters are determined as the database money that the application provides read-write service in any one data center described in determining Source unit.
10. the data service system as described in claim 1~9 is any, which is characterized in that the quantity of the data center is three It is a.
CN201611209626.9A 2016-12-23 2016-12-23 A kind of data service system Pending CN108241554A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611209626.9A CN108241554A (en) 2016-12-23 2016-12-23 A kind of data service system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611209626.9A CN108241554A (en) 2016-12-23 2016-12-23 A kind of data service system

Publications (1)

Publication Number Publication Date
CN108241554A true CN108241554A (en) 2018-07-03

Family

ID=62704379

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611209626.9A Pending CN108241554A (en) 2016-12-23 2016-12-23 A kind of data service system

Country Status (1)

Country Link
CN (1) CN108241554A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102158540A (en) * 2011-02-18 2011-08-17 广州从兴电子开发有限公司 System and method for realizing distributed database
CN103019875A (en) * 2012-12-19 2013-04-03 北京世纪家天下科技发展有限公司 Method and device for realizing double main reconstruction of database
US9143383B2 (en) * 2012-11-01 2015-09-22 Miiicasa Taiwan Inc. Method and system for managing device identification
CN105224637A (en) * 2015-09-24 2016-01-06 珠海许继芝电网自动化有限公司 A kind of based on PostgreSQL database active and standby/the comprehensive method of cluster application
CN105262835A (en) * 2015-10-30 2016-01-20 北京奇虎科技有限公司 Data storage method and device of multiple machine rooms
CN105262633A (en) * 2015-11-27 2016-01-20 中国建设银行股份有限公司 Application-level disaster tolerant method and application-level disaster system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102158540A (en) * 2011-02-18 2011-08-17 广州从兴电子开发有限公司 System and method for realizing distributed database
US9143383B2 (en) * 2012-11-01 2015-09-22 Miiicasa Taiwan Inc. Method and system for managing device identification
CN103019875A (en) * 2012-12-19 2013-04-03 北京世纪家天下科技发展有限公司 Method and device for realizing double main reconstruction of database
CN105224637A (en) * 2015-09-24 2016-01-06 珠海许继芝电网自动化有限公司 A kind of based on PostgreSQL database active and standby/the comprehensive method of cluster application
CN105262835A (en) * 2015-10-30 2016-01-20 北京奇虎科技有限公司 Data storage method and device of multiple machine rooms
CN105262633A (en) * 2015-11-27 2016-01-20 中国建设银行股份有限公司 Application-level disaster tolerant method and application-level disaster system

Similar Documents

Publication Publication Date Title
US9367600B2 (en) Policy-based storage structure distribution
US9246780B2 (en) System and method for supporting port multiplexing in a server environment
US9749445B2 (en) System and method for updating service information for across-domain messaging in a transactional middleware machine environment
CN108183961A (en) A kind of distributed caching method based on Redis
US11068499B2 (en) Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching
US11609914B2 (en) Policy-based storage structure distribution
US20100023564A1 (en) Synchronous replication for fault tolerance
US20120278817A1 (en) Event distribution pattern for use with a distributed data grid
CN103150304A (en) Cloud database system
CN110648178A (en) Method for increasing kafka consumption capacity
US20180052900A1 (en) Generating database sequences in a replicated database environment
CN105635311A (en) Method for synchronizing resource pool information in cloud management platform
CN112199427A (en) Data processing method and system
CN104753987B (en) A kind of distributed conversation management method and system
US11461053B2 (en) Data storage system with separate interfaces for bulk data ingestion and data access
Malkhi et al. From paxos to corfu: a flash-speed shared log
CN109391487A (en) A kind of configuration update method and system
US20130275670A1 (en) Multiple enhanced catalog sharing (ecs) cache structure for sharing catalogs in a multiprocessor system
CN110012050A (en) Message Processing, storage method, apparatus and system
Pankowski Consistency and availability of Data in replicated NoSQL databases
CN108241554A (en) A kind of data service system
CN111400110B (en) Database access management system
US10061607B2 (en) System and method for providing single group multiple branches based on instance awareness
JP2021072087A (en) Distributed storage remote self-repairing program
CN112799835A (en) Method and system for processing metadata of distributed database system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180703

WD01 Invention patent application deemed withdrawn after publication