CN109635039A - Multiple data centers method of data synchronization and system - Google Patents
Multiple data centers method of data synchronization and system Download PDFInfo
- Publication number
- CN109635039A CN109635039A CN201811409609.9A CN201811409609A CN109635039A CN 109635039 A CN109635039 A CN 109635039A CN 201811409609 A CN201811409609 A CN 201811409609A CN 109635039 A CN109635039 A CN 109635039A
- Authority
- CN
- China
- Prior art keywords
- http
- data
- data center
- blocker
- http request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
Abstract
The present invention relates to network technology and data storage technologies, there is provided a kind of multiple data centers method of data synchronization and system, which comprises web service platform receives the http request for object storage and http request copied to the HTTP blocker of web service platform；When http request will not cause the state change of data center, http request is sent to target data center by HTTP blocker；And when http request can cause the state change of data center, http request is sent to all data centers are synchronous by HTTP blocker.The safety of data is improved by setting HTTP blocker, multiple data centers are synchronized by data may be implemented to be mutually backups, and when certain data center's failure, can be rapidly switched to the data center of backup.Implementation cost is less expensive simultaneously, and existing cluster (data center) is not needed to change, and compatible multi version, to user's unaware.It is shown in addition, richer data mode may be implemented by the user interface of resource status APP.
Description
Technical field
The present invention relates to network technology and technical field of data storage, and in particular to a kind of multiple data centers data side of synchronization
Method and system.
Background technique
Data center (Datacenter) or be server farm, refers to for disposing setting for computer system and associated components
It applies, such as telecommunications and stocking system.Generally it includes redundancy and backup power source, and redundant data communication connects, environmental Kuznets Curves (such as
Air-conditioning, fire extinguisher) and various safety equipments.
As big data and cloud computing are widely used every field is more and more in recent years, data storage requirement is more next
Bigger, heritage storage system can no longer meet demand (scalability of conventional store is extremely limited), possess the Internet-based because of spy
The object storage of matter is only selection.The height scalability of object storage conforms exactly to the unstructured data of large capacity (as schemed
Piece, video, archive file etc.) storage demand.Meanwhile for the availability of storage access it is also proposed that carry out extremely harsh requirement,
The data synchronisation requirement of multiple data centers is come into being.
Multiple data centers (multisite) are the newly-increased functions of Ceph Jewel version, it is intended to realize strange land dual-active, provide
The ability of backup disaster tolerance.And there are multiple data centers to select for user, store resource.
The shortcomings that prior art: existing synchronization scheme has a Ceph minimum version requirement, and different data center
Ceph cluster needs version match, and the legacy system lower than J version can not enjoy this bonus.Meanwhile Multisite scheme is rigid
It releases soon, stability value must be discussed, this is great hidden danger for storage system, and Information Security is all storages
System primary goal.On the other hand, even the storage R&D team of processing logic profession complicated inside Multisite also simultaneously
Non- that is readily able to settle.Therefore the Ceph storage system self-built for general small-to-medium business, Multisite multiple data centers
The synchronization scheme short time is not a feasible scheme.
Therefore, it is necessary to a kind of new multiple data centers synchronization schemes.
Above- mentioned information are only used for reinforcing the understanding to background of the invention, therefore it disclosed in the background technology part
It may include the information not constituted to the prior art known to persons of ordinary skill in the art.
Summary of the invention
The purpose of the present invention is to provide a kind of multiple data centers method of data synchronization and systems, and then solve most in
The data synchronization problems of the heart realize that the data of multiple data centers are synchronous and are mutually backups, improve the safety of data, drop simultaneously
Low implementation cost and the compatibility for improving multi version.
Other characteristics and advantages of the invention will be apparent from by the following detailed description, or partially by the present invention
Practice and acquistion.
According to the first aspect of the invention, a kind of synchronous method of multiple data centers data disclosed, in plurality of data
The heart uses object storage system, which comprises
Web service platform receives the http request for object storage and http request is copied to web service platform
HTTP blocker；
When http request will not cause the state change of data center, sent out by HTTP blocker to target data center
Send http request；And
It is synchronous to all data centers by HTTP blocker when http request can cause the state change of data center
Send http request.
An example embodiment according to the present invention, wherein
Web service platform further includes intermediate storage layer, when the http request for the state change that can cause data center is upper
When passing the request of resource, pass through the resource of intermediate storage layer storage upload；And
HTTP blocker is also used to send the resource uploaded to all data centers are synchronous.
An example embodiment according to the present invention, wherein after the completion of the synchronous resource for sending and uploading, by intermediate storage
The resource of upload in layer is deleted.
An example embodiment according to the present invention, wherein intermediate storage layer is also used to store Synchronization Status Message；And
Intermediate storage layer uses Redis database.
An example embodiment according to the present invention, the method further include being inquired in data by resource status APP
The resource status of the heart or web service platform is simultaneously shown by the user interface of resource status APP.
An example embodiment according to the present invention, wherein object storage system is Ceph storage system；And Web service
Platform is OpenResty.
An example embodiment according to the present invention, wherein between web service platform and data center using CGI agreement into
Row communication；And HTTP blocker is write using Lua scripting language.
According to the second aspect of the invention, a kind of multiple data centers data synchronous system is disclosed, which is characterized in that including
Web service platform and multiple data centers using object storage system, wherein
Web service platform includes HTTP blocker, and web service platform receives the http request and handle for object storage
Http request copies in HTTP blocker, wherein
When http request will not cause the state change of data center, sent out by HTTP blocker to target data center
Send http request；And
It is synchronous to all data centers by HTTP blocker when http request can cause the state change of data center
Send http request.
An example embodiment according to the present invention, wherein
Web service platform further includes intermediate storage layer, when the http request for the state change that can cause data center is upper
When passing the request of resource, pass through the resource of intermediate storage layer storage upload；And
HTTP blocker is also used to send the resource uploaded to all data centers are synchronous.
An example embodiment according to the present invention, wherein intermediate storage layer is also used to store Synchronization Status Message；And
Intermediate storage layer uses Redis database.
An example embodiment according to the present invention, the system also includes resource status APP, for inquiring data center
Or web service platform resource status and be shown by the user interface of resource status APP.
An example embodiment according to the present invention, wherein object storage system is Ceph storage system；And Web service
Platform is OpenResty.
According to the third aspect of the invention we, a kind of computer readable storage medium is provided, computer program is stored thereon with,
It is characterized in that, the program realizes method and step described in above-mentioned any one when being executed by processor.
According to the fourth aspect of the invention, a kind of electronic equipment is provided characterized by comprising
One or more processors；
Storage device, for storing one or more programs, when one or more of programs are one or more of
When processor executes, so that one or more of processors realize method and step described in above-mentioned any one.
Some example embodiments according to the present invention improve the safety of data by setting HTTP blocker, multiple
Data center is synchronized by data may be implemented to be mutually backups, and when certain data center's failure, can be rapidly switched to backup
Data center.
Some example embodiments according to the present invention, implementation cost is less expensive, no for existing cluster (data center)
It needs to change, and compatible multi version, to user's unaware.
The control means of multiplicity may be implemented by HTTP blocker for some example embodiments according to the present invention.
Other example embodiments according to the present invention may be implemented richer by the user interface of resource status APP
Rich data mode is shown.
It should be understood that the above general description and the following detailed description are merely exemplary, this can not be limited
Invention.
Detailed description of the invention
Its example embodiment is described in detail by referring to accompanying drawing, above and other target of the invention, feature and advantage will
It becomes more fully apparent.
Fig. 1 shows the method flow diagram that a multiple data centers data of an example embodiment according to the present invention synchronize.
Fig. 2 shows the block diagrams of a multiple data centers data synchronous system of an example embodiment according to the present invention.
Fig. 3 shows the schematic diagram being shown by user interface to resource status.
Fig. 4 shows the electronic equipment of an example embodiment according to the present invention.
Specific example embodiment
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein；On the contrary, provide these example embodiments make it is of the invention
Description will be more full and complete, and the design of example embodiment is comprehensively communicated to those skilled in the art.Attached drawing
Schematic illustrations only of the invention are not necessarily drawn to scale.Identical appended drawing reference indicates same or like in figure
Part, thus repetition thereof will be omitted.
In addition, described feature, structure or characteristic can be incorporated in one or more examples in any suitable manner
In embodiment.In the following description, many details are provided to provide filling to example embodiment of the invention
Sub-argument solution.It will be appreciated, however, by one skilled in the art that technical solution of the present invention can be practiced and omit the specific detail
In it is one or more, or can be using other methods, constituent element, step etc..In other cases, it is not shown in detail or retouches
Known features, method, realization or operation are stated to avoid a presumptuous guest usurps the role of the host and each aspect of the present invention is made to thicken.
Some block diagrams shown in the drawings are functional entitys, not necessarily must be with physically or logically independent entity phase
It is corresponding.These functional entitys can be realized using software form, or in one or more hardware modules or integrated circuit in fact
These existing functional entitys, or these functions reality is realized in heterogeneous networks and/or processor device and/or microcontroller device
Body.
The purpose of the present invention is to provide a kind of multiple data centers method of data synchronization and system, plurality of data centers
Using object storage system, which comprises web service platform receives the http request for object storage and http is asked
Seek the HTTP blocker for copying to web service platform；When http request will not cause the state change of data center, pass through
HTTP blocker sends http request to target data center；And when http request can cause the state change of data center
When, http request is sent to all data centers are synchronous by HTTP blocker.Data are improved by setting HTTP blocker
Safety, multiple data centers are synchronized by data may be implemented to be mutually backups, and when certain data center's failure, can cut rapidly
The data center of backup is changed to, implementation cost is less expensive, existing cluster (data center) is not needed to change, and compatible
Multi version, to user's unaware.The control means of multiplicity may be implemented by HTTP blocker simultaneously.In addition, passing through resource shape
The user interface of state APP may be implemented richer data mode and show.
It is described in detail below with reference to Fig. 1-4 pairs of multiple data centers method of data synchronization and system of the invention, wherein
Fig. 1 shows the method flow diagram that a multiple data centers data of an example embodiment according to the present invention synchronize.Fig. 2 shows bases
The block diagram of one multiple data centers data synchronous system of an example embodiment of the invention；Fig. 3 is shown through user interface pair
The schematic diagram that resource status is shown；Fig. 4 shows the electronic equipment of an example embodiment according to the present invention.
As shown in Figs. 1-2, multiple data centers data synchronous system uses the WEB frame of Python, including including Web service
Platform 1 and multiple use object storage systems (Object Storage: a kind of to use flat data organizational form and pass through base
In http agreement RESTful interface access distributed memory system) data center 2, wherein web service platform 1 include
HTTP blocker 11, multiple data centers method of data synchronization of the invention are received by web service platform 1 for object storage
Http request simultaneously copies to http request in HTTP blocker 11, wherein when http request will not cause the state of data center
When variation, http request is sent to target data center by HTTP blocker；And when http request can cause data center
State change when, http request is sent to all data centers are synchronous by HTTP blocker.By the way that HTTP blocker is arranged
The data for realizing multiple data centers are synchronous, improve the safety of data, multiple data centers are synchronized by data may be implemented
It being mutually backups, when certain data center's failure, the data center of backup can be rapidly switched to, implementation cost is less expensive, for
Available data cluster (data center) does not need to change, and compatible multi version, to user's unaware.It is blocked simultaneously by HTTP
Cutting device may be implemented the control means of multiplicity.
Multiple data centers method of data synchronization of the invention is specifically described below with reference to Fig. 1-2.As shown in Figure 1,
In S102, web service platform receives the http request for object storage and http request is copied to web service platform
HTTP blocker.
Wherein object (Object) refers to: the basic unit that data store in system, each Object is data and data
The synthesis of property set, data attribute can be configured according to the demand of application, including data distribution, service quality etc..
Wherein http request may come from client, however, the present invention is not limited thereto, and http request can also derive from it
Its source.
In S104, when http request will not cause the state change of data center, by HTTP blocker to number of targets
Http request is sent according to center.That is, when http request will not cause the state change of data center only to number of targets
Http request is sent according to center, without being related to other data centers.
In S106, when http request can cause the state change of data center, by HTTP blocker to all data
Central synchronous sends http request.
An example embodiment according to the present invention, wherein web service platform further includes intermediate storage layer 12 (such as Fig. 2 institute
Show), when can cause the http request of state change of data center is to upload the request of resource, deposited by intermediate storage layer 12
Store up the resource uploaded；And HTTP blocker is also used to send the resource uploaded to all data centers are synchronous.
An example embodiment according to the present invention, wherein after the completion of the synchronous resource for sending and uploading, by intermediate storage
The resource of upload in layer is deleted.
An example embodiment according to the present invention, wherein intermediate storage layer is also used to store Synchronization Status Message.
An example embodiment according to the present invention, wherein intermediate storage layer uses Redis database.Wherein Redis is
One open source write using ANSI C language, support network, it is memory-based also can persistence log type, Key-Value
(Key-Value storage system, i.e. key-value storage system, abbreviation KV storage system) database, and the API of multilingual is provided.
However, the present invention is not limited thereto, intermediate storage layer can also use such as other kinds of database of Mysql database.
An example embodiment according to the present invention, the method further include being inquired in data by resource status APP3
(databases such as the Redis and/or Mysql) resource status of the heart or web service platform (including intermediate storage layer etc.) simultaneously passes through
The user interface (UI) 31 of resource status APP3 is shown (as shown in Figure 3).However, the present invention is not limited thereto, data center or
The resource status of web service platform (including intermediate storage layer etc.) can also be shown by respective user interface.
An example embodiment according to the present invention, wherein object storage system is Ceph storage system.Wherein, Ceph is
A kind of high-performance, highly reliable, expansible unification (including block, file, object) storage system；And RGW (Rados Gateway)
It is Ceph object storage system gateway.
An example embodiment according to the present invention, wherein web service platform is OpenResty.
Web service platform OpenResty is described as follows:
OpenResty: one high-performance Web platform based on Nginx and Lua, has been internally integrated a large amount of superior Lua
Library, third party's module and mostly rely on item.For easily building, to be capable of handling that superelevation is concurrent, scalability is high dynamic
State Web application, Web service and dynamic gateway.
Nginx: one high performance HTTP and Reverse Proxy and an IMAP/POP3/SMTP agency service
Device.
Lua: a kind of succinct, light weight, expansible scripting language, are Rio de Daneiro, BRA Catholic University of Americas
Inner research group of (Pontifical Catholic University of Rio de Janeiro) opened in 1993
Hair.Its purpose of design is in order to be embedded in application program, to provide flexible extension and customization function for application program.Lua
It is write by standard C, can almost be compiled in all operating systems and platform, run, in current all script engines
In, the speed of Lua is most fast.Wherein Lua and non-english abbreviation, but the Portuguese transliteration of this scripting language
(Portuguese is said by Brazil).
An example embodiment according to the present invention, wherein web service platform (OpenResty) and (Ceph) data center
It is communicated between (Ceph object storage system gateway, that is, RGW) using CGI agreement.Wherein CGI (Common Gateway
It Interface) is a standard agreement, it provides the agreement of a standard for web server, in order to which server can picture
Operation command line interface program runs third equation like that, these third equations can be dynamically generated web page.This
A little third equations are referred to as CGI scripting.Further, it can also be communicated using Fastcgi, wherein Fastcgi is CGI
A kind of more advanced mode, be for improving cgi script performance.
An example embodiment according to the present invention, wherein HTTP blocker is write using Lua scripting language.
In terms of client visual angle, RGW is exactly a HTTP service.At the same time, RGW also supports Fastcgi mode,
A new WEB service (OpenResty) is set up before RGW, and normal HTTP request is transmitted to original (mesh by Fastcgi
Mark data center) RGW, the lua processing routine for " replicating " HTTP request simultaneously and being pushed in OpenResty (HTTP intercept
Device), realize that (multiple data centers) data are synchronous and relevant control is handled by it.
It is illustrated so that HTTP request is the POST request for uploading resource as an example below using in most evidences of the invention
Heart method of data synchronization carries out the synchronous process flow of data:
1, when a request (being primarily referred to as uploading the POST request of resource) is by web service platform OpenResty, root
According to treatment mechanism of the request in web service platform OpenResty, request is copied in the HTTP blocker that lua writes；
2, the resource of upload is put into intermediate storage layer (redis) by HTTP blocker；
3, resource is numbered in HTTP blocker, and is arranged and starts synchronous state (this Synchronication status message can also be with
It is placed on redis, and is checked at any time)；
4, HTTP blocker is triggered (namely constructs the request that object stores in fact and is sent to strange land to remote synchronization
Ceph cluster/Ceph data center)；
5, synchronous regime is inquired in continuous training in rotation, modifies state storage table (table in redis) when synchronously completing；
6, after synchronously completing, the temporary resource in redis can be deleted；
7, relative program can be arranged in HTTP blocker in all state changes, they are persisted to lane database (ratio
Such as mysql database).
Multiple data centers data synchronous system of the invention is specifically described below with reference to Fig. 2.
As shown in Fig. 2, multiple data centers data synchronous system, using the WEB frame of Python, including including Web service
Platform 1 and multiple use object storage systems (Object Storage: a kind of to use flat data organizational form and pass through base
In http agreement RESTful interface access distributed memory system) data center 2, wherein web service platform 1 include
HTTP blocker 11, web service platform 1 receive the http request for object storage and http request are copied to HTTP and intercept
In device 11, wherein when http request will not cause the state change of data center, through HTTP blocker into target data
The heart sends http request, that is to say, that when http request will not cause the state change of data center only into target data
The heart sends http request, without being related to other data centers；And when http request can cause the state of data center
When variation, http request is sent to all data centers are synchronous by HTTP blocker.It is realized by the way that HTTP blocker is arranged
The data of multiple data centers are synchronous, improve the safety of data, multiple data centers synchronized by data may be implemented it is standby each other
Part, when certain data center's failure, it can be rapidly switched to the data center of backup, implementation cost is less expensive, for existing number
It does not need to change according to cluster (data center), and compatible multi version, to user's unaware.It simultaneously can by HTTP blocker
To realize the control means of multiplicity.
Wherein http request may come from client, however, the present invention is not limited thereto, and http request can also derive from it
Its source.
An example embodiment according to the present invention, wherein
Web service platform further includes intermediate storage layer 12, when the http request for the state change that can cause data center is
When uploading the request of resource, the resource uploaded is stored by intermediate storage layer 12；And
HTTP blocker is also used to send the resource uploaded to all data centers are synchronous.
An example embodiment according to the present invention, wherein after the completion of the synchronous resource for sending and uploading, by intermediate storage
The resource of upload in layer is deleted.
An example embodiment according to the present invention, wherein intermediate storage layer is also used to store Synchronization Status Message.
An example embodiment according to the present invention, wherein intermediate storage layer uses Redis database.Wherein Redis is
One open source write using ANSI C language, support network, it is memory-based also can persistence log type, Key-Value
(Key-Value storage system, i.e. key-value storage system, abbreviation KV storage system) database, and the API of multilingual is provided.
However, the present invention is not limited thereto, intermediate storage layer can also use such as other kinds of database of Mysql database.
An example embodiment according to the present invention further includes resource status APP3, for inquiring data center or Web clothes
(databases such as the Redis and/or Mysql) resource status of business platform (including intermediate storage layer etc.) simultaneously passes through resource status
The user interface (UI) 31 of APP3 is shown (as shown in Figure 3).However, the present invention is not limited thereto, data center or Web service are flat
The resource status of platform (including intermediate storage layer etc.) can also be shown by respective user interface.
An example embodiment according to the present invention, wherein object storage system is Ceph storage system.
An example embodiment according to the present invention, wherein web service platform is OpenResty.
An example embodiment according to the present invention, wherein web service platform (OpenResty) and (Ceph) data center
It is communicated between (Ceph object storage system gateway, that is, RGW) using CGI agreement.Wherein CGI (Common Gateway
It Interface) is a standard agreement, it provides the agreement of a standard for web server, in order to which server can picture
Operation command line interface program runs third equation like that, these third equations can be dynamically generated web page.This
A little third equations are referred to as CGI scripting.Further, it can also be communicated using Fastcgi, wherein Fastcgi is CGI
A kind of more advanced mode, be for improving cgi script performance.
An example embodiment according to the present invention, wherein HTTP blocker is write using Lua scripting language.
In terms of client visual angle, RGW is exactly a HTTP service.At the same time, RGW also supports Fastcgi mode,
A new WEB service (OpenResty) is set up before RGW, and normal HTTP request is transmitted to original (mesh by Fastcgi
Mark data center) RGW, the lua processing routine for " replicating " HTTP request simultaneously and being pushed in OpenResty (HTTP intercept
Device), realize that (multiple data centers) data are synchronous and relevant control is handled by it.
As on the other hand, the present invention also provides a kind of computer-readable medium, which be can be
Included in system described in above-described embodiment；It is also possible to individualism, and without in the supplying system.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the system, makes
Obtaining the system may be implemented method and step described in any of the above-described example embodiment.
Fig. 4 shows the electronic equipment of an example embodiment according to the present invention.
As shown in figure 4, electronic equipment 400 can include: one or more processors 410；Memory 420.In addition, according to one
Embodiment, electronic equipment may also include transmitter and receiver.
Processor 410 can call the instruction stored in memory 420 to control relevant operation, such as control transmitter and receiver
It sends and receives signals.According to an embodiment, memory 420 is stored for storing one or more programs, when one or
When multiple programs are executed by one or more of processors 410, so that one or more of processors 410 realize above-mentioned
Method and step described in one example embodiment.Processor 410 can call the related behaviour of the instruction stored in memory 420 control
Make.It can be readily appreciated that memory 420 can also store the finger for controlling other operations according to an embodiment of the present invention for processor 410
It enables, which is not described herein again.
By above detailed description, those skilled in the art is it can be readily appreciated that majority evidence according to an embodiment of the present invention
Centre data synchronous method and system have one or more of the following advantages.
Some example embodiments according to the present invention improve the safety of data by setting HTTP blocker, multiple
Data center is synchronized by data may be implemented to be mutually backups, and when certain data center's failure, can be rapidly switched to backup
Data center.
Some example embodiments according to the present invention, implementation cost is less expensive, no for existing cluster (data center)
It needs to change, and compatible multi version, to user's unaware.
The control means of multiplicity may be implemented by HTTP blocker for some example embodiments according to the present invention.
Other example embodiments according to the present invention may be implemented richer by the user interface of resource status APP
Rich data mode is shown.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its
Its embodiment.The present invention is directed to cover any variations, uses, or adaptations of the invention, these modifications, purposes or
Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the present invention
Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by following
Claim is pointed out.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.
Claims (14)
1. a kind of synchronous method of multiple data centers data, plurality of data center use object storage system, the method
Include:
Web service platform receives the http request for object storage and http request is copied to the HTTP of web service platform
Blocker；
When http request will not cause the state change of data center, sent by HTTP blocker to target data center
Http request；And
When http request can cause the state change of data center, sent by HTTP blocker to all data centers are synchronous
Http request.
2. the method according to claim 1, wherein wherein
Web service platform further includes intermediate storage layer, when the http request for the state change that can cause data center is to upload money
When the request in source, pass through the resource of intermediate storage layer storage upload；And
HTTP blocker is also used to send the resource uploaded to all data centers are synchronous.
3. according to the method described in claim 2, it is characterized in that, wherein after the completion of the synchronous resource for sending and uploading, will in
Between the resource of upload in accumulation layer delete.
4. according to the method described in claim 2, it is characterized in that, wherein intermediate storage layer is also used to store synchronous regime letter
Breath；And intermediate storage layer uses Redis database.
5. method according to claim 1 or 2, which is characterized in that further include inquiring data center by resource status APP
Or web service platform resource status and be shown by the user interface of resource status APP.
6. the method according to claim 1, wherein wherein object storage system is Ceph storage system；And
Web service platform is OpenResty.
7. the method according to claim 1, wherein wherein using CGI between web service platform and data center
Agreement is communicated；And HTTP blocker is write using Lua scripting language.
8. a kind of multiple data centers data synchronous system, which is characterized in that deposited including web service platform and multiple use objects
The data center of storage system, wherein
Web service platform includes HTTP blocker, and web service platform receives the http request for object storage and http is asked
It asks and copies in HTTP blocker, wherein
When http request will not cause the state change of data center, sent by HTTP blocker to target data center
Http request；And
When http request can cause the state change of data center, sent by HTTP blocker to all data centers are synchronous
Http request.
9. system according to claim 8, which is characterized in that wherein
Web service platform further includes intermediate storage layer, when the http request for the state change that can cause data center is to upload money
When the request in source, pass through the resource of intermediate storage layer storage upload；And
HTTP blocker is also used to send the resource uploaded to all data centers are synchronous.
10. system according to claim 8, which is characterized in that wherein intermediate storage layer is also used to store synchronous regime letter
Breath；And intermediate storage layer uses Redis database.
11. system according to claim 8 or claim 9, which is characterized in that further include resource status APP, for inquiring in data
The resource status of the heart or web service platform is simultaneously shown by the user interface of resource status APP.
12. system according to claim 8, which is characterized in that wherein object storage system is Ceph storage system；And
Web service platform is OpenResty.
13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Method and step of any of claims 1-7 is realized when execution.
14. a kind of electronic equipment characterized by comprising
One or more processors；
Storage device, for storing one or more programs, when one or more of programs are by one or more of processing
When device executes, so that one or more of processors realize such as method and step of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811409609.9A CN109635039B (en) | 2018-11-23 | 2018-11-23 | Multi-data center data synchronization method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811409609.9A CN109635039B (en) | 2018-11-23 | 2018-11-23 | Multi-data center data synchronization method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109635039A true CN109635039A (en) | 2019-04-16 |
| CN109635039B CN109635039B (en) | 2021-08-24 |
Family
ID=66068961
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811409609.9A Active CN109635039B (en) | 2018-11-23 | 2018-11-23 | Multi-data center data synchronization method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109635039B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110502583A (en) * | 2019-08-27 | 2019-11-26 | 深圳前海微众银行股份有限公司 | Distributed Data Synchronization method, apparatus, equipment and readable storage medium storing program for executing |
| CN110795280A (en) * | 2019-09-11 | 2020-02-14 | 杭州衣科信息技术有限公司 | Remote double-activity disaster recovery system based on mysql asynchronous and bidirectional |
| CN113535469A (en) * | 2021-06-03 | 2021-10-22 | 北京思特奇信息技术股份有限公司 | Switching method and switching system of disaster recovery database |
| CN116466960A (en) * | 2023-04-14 | 2023-07-21 | 北京星汉未来网络科技有限公司 | Method, device, equipment and medium for multi-activity deployment of database |
| CN110502583B (en) * | 2019-08-27 | 2024-05-17 | 深圳前海微众银行股份有限公司 | Distributed data synchronization method, device, equipment and readable storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104580226A (en) * | 2015-01-15 | 2015-04-29 | 上海瀚之友信息技术服务有限公司 | Session data sharing system and method |
| US9141814B1 (en) * | 2014-06-03 | 2015-09-22 | Zettaset, Inc. | Methods and computer systems with provisions for high availability of cryptographic keys |
| CN105471945A (en) * | 2014-09-04 | 2016-04-06 | 中国石油化工股份有限公司 | Application method of cloud storage in seismic integrated interpretation |
| CN105608229A (en) * | 2016-01-29 | 2016-05-25 | 锐达互动科技股份有限公司 | System and method for synchronizing master-slave databases |
| US9369529B2 (en) * | 2011-02-28 | 2016-06-14 | Olympus Corporation | Server system and method of controlling client apparatus |
| CN106462635A (en) * | 2014-06-20 | 2017-02-22 | 微软技术许可有限责任公司 | Intelligent web page content blocking |
| CN106484565A (en) * | 2016-09-22 | 2017-03-08 | 华为数字技术（成都）有限公司 | Method of data synchronization between multiple data centers and relevant device |
| CN106649141A (en) * | 2016-11-02 | 2017-05-10 | 郑州云海信息技术有限公司 | Storage interaction device and storage system based on ceph |
| CN106682119A (en) * | 2016-12-08 | 2017-05-17 | 杭州销冠网络科技有限公司 | System and method for asynchronous data synchronization on basis of http service aspect and log system |
| CN107547654A (en) * | 2017-09-12 | 2018-01-05 | 郑州云海信息技术有限公司 | A kind of distributed objects storage cluster, deployment, method of servicing and system |
| CN108616498A (en) * | 2018-02-24 | 2018-10-02 | 国家计算机网络与信息安全管理中心 | A kind of web access exceptions detection method and device |
| CN108809686A (en) * | 2017-07-11 | 2018-11-13 | 北京视联动力国际信息技术有限公司 | Resource synchronization method, device, electronic equipment and computer readable storage medium |
-
2018
- 2018-11-23 CN CN201811409609.9A patent/CN109635039B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9369529B2 (en) * | 2011-02-28 | 2016-06-14 | Olympus Corporation | Server system and method of controlling client apparatus |
| US9141814B1 (en) * | 2014-06-03 | 2015-09-22 | Zettaset, Inc. | Methods and computer systems with provisions for high availability of cryptographic keys |
| CN106462635A (en) * | 2014-06-20 | 2017-02-22 | 微软技术许可有限责任公司 | Intelligent web page content blocking |
| CN105471945A (en) * | 2014-09-04 | 2016-04-06 | 中国石油化工股份有限公司 | Application method of cloud storage in seismic integrated interpretation |
| CN104580226A (en) * | 2015-01-15 | 2015-04-29 | 上海瀚之友信息技术服务有限公司 | Session data sharing system and method |
| CN105608229A (en) * | 2016-01-29 | 2016-05-25 | 锐达互动科技股份有限公司 | System and method for synchronizing master-slave databases |
| CN106484565A (en) * | 2016-09-22 | 2017-03-08 | 华为数字技术（成都）有限公司 | Method of data synchronization between multiple data centers and relevant device |
| CN106649141A (en) * | 2016-11-02 | 2017-05-10 | 郑州云海信息技术有限公司 | Storage interaction device and storage system based on ceph |
| CN106682119A (en) * | 2016-12-08 | 2017-05-17 | 杭州销冠网络科技有限公司 | System and method for asynchronous data synchronization on basis of http service aspect and log system |
| CN108809686A (en) * | 2017-07-11 | 2018-11-13 | 北京视联动力国际信息技术有限公司 | Resource synchronization method, device, electronic equipment and computer readable storage medium |
| CN107547654A (en) * | 2017-09-12 | 2018-01-05 | 郑州云海信息技术有限公司 | A kind of distributed objects storage cluster, deployment, method of servicing and system |
| CN108616498A (en) * | 2018-02-24 | 2018-10-02 | 国家计算机网络与信息安全管理中心 | A kind of web access exceptions detection method and device |
Non-Patent Citations (1)
| Title |
|---|
| 鲁念平: "针对信息披露网站的实时爬虫检测与拦截", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110502583A (en) * | 2019-08-27 | 2019-11-26 | 深圳前海微众银行股份有限公司 | Distributed Data Synchronization method, apparatus, equipment and readable storage medium storing program for executing |
| CN110502583B (en) * | 2019-08-27 | 2024-05-17 | 深圳前海微众银行股份有限公司 | Distributed data synchronization method, device, equipment and readable storage medium |
| CN110795280A (en) * | 2019-09-11 | 2020-02-14 | 杭州衣科信息技术有限公司 | Remote double-activity disaster recovery system based on mysql asynchronous and bidirectional |
| CN113535469A (en) * | 2021-06-03 | 2021-10-22 | 北京思特奇信息技术股份有限公司 | Switching method and switching system of disaster recovery database |
| CN113535469B (en) * | 2021-06-03 | 2024-01-30 | 北京思特奇信息技术股份有限公司 | Switching method and switching system for disaster recovery database |
| CN116466960A (en) * | 2023-04-14 | 2023-07-21 | 北京星汉未来网络科技有限公司 | Method, device, equipment and medium for multi-activity deployment of database |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109635039B (en) | 2021-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102628362B1 (en) | Live migration of clusters in containerized environments | |
| CN107526626B (en) | Docker container thermal migration method and system based on CRIU | |
| US11314687B2 (en) | Container data mover for migrating data between distributed data storage systems integrated with application orchestrators | |
| CN107515776A (en) | The uninterrupted upgrade method of business, node to be upgraded and readable storage medium storing program for executing | |
| US11893264B1 (en) | Methods and systems to interface between a multi-site distributed storage system and an external mediator to efficiently process events related to continuity | |
| US10754821B2 (en) | Virtual file server | |
| US10168927B2 (en) | Data mirroring for network attached storage | |
| EP2718833B1 (en) | Automatic configuration of a recovery service | |
| US9645753B2 (en) | Overlapping write detection and processing for sync replication | |
| US20150370788A1 (en) | Synchronizing user states across multiple clients of a nas system | |
| US10324799B2 (en) | Enhanced application write performance | |
| CN109635039A (en) | Multiple data centers method of data synchronization and system | |
| CN111104069B (en) | Multi-region data processing method and device of distributed storage system and electronic equipment | |
| CN106993064A (en) | A kind of system and its construction method and application that the storage of mass data scalability is realized based on Openstack cloud platforms | |
| US9582559B1 (en) | Multi-site storage system with replicated file system synchronization utilizing virtual block storage appliances | |
| CN106357452A (en) | High-availability framework system with single-point heterogeneous data storage function and realizing method thereof | |
| CN103841180B (en) | A kind of network data synchronizing method, apparatus, terminal device and server based on operational order | |
| WO2019073324A1 (en) | File system content based security | |
| US10887382B2 (en) | Methods, apparatuses and systems for cloud-based disaster recovery | |
| US11489730B2 (en) | Methods, apparatuses and systems for configuring a network environment for a server | |
| US10079883B2 (en) | Primary device selection at operating system initialization | |
| US20130238675A1 (en) | Information processing apparatus, image file management method and storage medium | |
| US11599427B2 (en) | Distributed recovery of server information | |
| US11704289B2 (en) | Role reversal of primary and secondary sites with minimal replication delay | |
| US20110320509A1 (en) | Managing the site where data is stored in a distributed storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |