CN102447742A - Dynamic data active and standby synchronization method and system as well as metadata server - Google Patents
Dynamic data active and standby synchronization method and system as well as metadata server Download PDFInfo
- Publication number
- CN102447742A CN102447742A CN2011103781362A CN201110378136A CN102447742A CN 102447742 A CN102447742 A CN 102447742A CN 2011103781362 A CN2011103781362 A CN 2011103781362A CN 201110378136 A CN201110378136 A CN 201110378136A CN 102447742 A CN102447742 A CN 102447742A
- Authority
- CN
- China
- Prior art keywords
- file
- dynamic data
- data server
- record
- meta data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a dynamic data active and standby synchronization method and system as well as a metadata server. When an active metadata server receives a file editing request sent by a client side, nodes in a dynamic data area of the file are updated according to the request, and correspondingly, out-of-step record in an out-of-step queue of an out-of-step data storage module, of the file is updated; and when a synchronization period ends, corresponding dynamic data in a dynamic data storage module is synchronized with a standby metadata server according to the out-of-step record in the out-of-step queue. According to the invention, when the set period ends, the active metadata server triggers synchronization of a dynamic data area between the active and the standby metadata servers regularly; therefore, when real active and standby switch is required really, only a small amount of remaining dynamic data is synchronized between the active and the standby metadata servers, and the dynamic data area of the standby metadata server is established quickly, so as to ensure that all operations in the dynamic data area are carried out smoothly.
Description
Technical field
The present invention relates to the communications field, be specifically related to the active and standby synchronous method of a kind of dynamic data, system and a kind of meta data server.
Background technology
Distributed file system is widely used in professional occasions such as cloud storage, IPTV, streaming media server.Meta data server generally is used to preserve the file size of file; File attribute; Metadata informations such as file distribution position; Remove in addition, meta data server also needs with client mutual, thus meta data server also need real-time keeping records when which client of file ownership of front opening, editor, each client be respectively the dynamic data of real-time change such as which kind of edit pattern of employing to corresponding file.
For disaster tolerance, general meta data server all can active and standbyly be provided with, when main with meta data server break down or the people when switching, subsequent use meta data server just converts into and mainly continues current business with meta data server.When main breaking down with meta data server needs active and standby conversion or people when switching, subsequent use meta data server needs will lead with all current on meta data server dynamic datas to carry out synchronously, could guarantee that the operation of the interior correspondence of dynamic data area can not failed.But have now in the masterslave switchover process; Often because main too much with the dynamic data on the meta data server; Subsequent use meta data server can not will be led in effective time with all dynamic datas on the meta data server and carry out synchronously or promptly enable synchronously but not prompt enough synchronously; Cause the certain operations failure in the dynamic data area, and then cause some business normally not carry out, reduce user's experience greatly.
Summary of the invention
The technical problem underlying that the present invention will solve is; The active and standby synchronous method of a kind of dynamic data, system and a kind of meta data server are provided; Can be when masterslave switchover; Can guarantee that subsequent use meta data server can carry out synchronously leading with the dynamic data on the meta data server timely, avoid the operation failure in the dynamic data area that the dynamic data synchronization failure causes, and then influence the situation generation of user experience.
For solving the problems of the technologies described above, the present invention provides a kind of dynamic data active and standby synchronous method, comprising:
When the master receives the file edit requests of client transmission with meta data server, in its dynamic data storage module, upgrade the dynamic data area node of said file according to said file edit requests; And the corresponding step-out record that upgrades file described in the interior out-of-synchronization queue of its step-out data memory module;
According to step-out record in said out-of-synchronization queue, carry out said dynamic data storage module in corresponding dynamic data and said subsequent use meta data server synchronously when arriving main synchronizing cycle of presetting with the meta data server judgement.
In an embodiment of the present invention; The main record with the step-out of file described in the out-of-synchronization queue in its step-out data memory module of the corresponding renewal of meta data server comprises: said master searches the step-out record that whether has this document in the out-of-synchronization queue in its step-out data memory module with meta data server; As do not exist, then in said out-of-synchronization queue, create the step-out record corresponding with said file edit requests; As existing, then it is done and the corresponding renewal of said file edit requests.
In an embodiment of the present invention, said step-out record comprises file unique identification and edit operation type.
In an embodiment of the present invention; Said file edit requests comprises file open request; When said master received file open request with meta data server, the dynamic data area node and the step-out record that upgrade said file at its dynamic data storage module and step-out data memory module respectively comprised:
Main search the dynamic data area node that whether has said file in its dynamic data storage module, as not existing, then at the dynamic data area node of the said file of dynamic data storage module creation with meta data server; And in said out-of-synchronization queue, create the step-out record of said file, its edit operation type is set for opening add;
As existing, then to the relevant information of the new client of dynamic data area node updates of said file; And search the step-out record that whether has said file in the out-of-synchronization queue in its step-out data memory module, as not existing, then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
In an embodiment of the present invention; Said file edit requests comprises the file modification request; When said master received the file modification request with meta data server, the dynamic data area node and the step-out record that upgrade said file at its dynamic data storage module and step-out data memory module respectively comprised:
The main dynamic data area node that in its dynamic data storage module, upgrades said file with meta data server according to said file modification request; And search the step-out record that whether has said file in the out-of-synchronization queue in its step-out data memory module, as not existing, then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
In an embodiment of the present invention; Said file edit requests comprises file close request; When said master received file close request with meta data server, the dynamic data area node and the step-out record that upgrade said file at its dynamic data storage module and step-out data memory module respectively comprised:
The main dynamic data area node that in its dynamic data storage module, upgrades said file with meta data server according to said file close request; And further whether also held the step-out record of the said file of renewal in said out-of-synchronization queue by other clients according to the dynamic data area node of said file.
In an embodiment of the present invention, whether the master is also comprising at the step-out record that is used the said files of renewal by other clients in said out-of-synchronization queue according to said file with meta data server:
If the dynamic data area node of said file is not held by other clients; Then search the step-out record that whether has said file in the out-of-synchronization queue in the said step-out data memory module; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for deleting de l; As existing, then judge its edit operation type, be add like its edit operation type, then with the step-out record deletion of said file; Otherwise, its edit operation type is updated to deletion del;
If the dynamic data area node of said file is held by other clients; Then search the step-out record that whether has said file in the out-of-synchronization queue in the said step-out data memory module; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
In an embodiment of the present invention; When said master judges with meta data server whether arrive preset synchronizing cycle; Judge also whether the record number in the said out-of-synchronization queue reaches preset value; If reach said preset value,, corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server are carried out synchronously then according to the step-out record in the said out-of-synchronization queue.
In an embodiment of the present invention, said master, comprises corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server according to the step-out record in the said out-of-synchronization queue with meta data server synchronously:
The master wins step-out in sequence with meta data server and records the synchrodata memory module from said out-of-synchronization queue, and is sent to the synchrodata memory module with writing down corresponding dynamic data with the step-out of winning in the dynamic data storage module;
The master sends synchronization message with meta data server to subsequent use meta data server, accomplishes with the dynamic data of subsequent use meta data server synchronous.
In an embodiment of the present invention; Said master, also comprises the state information in the client data district is sent in the said synchrodata memory module when writing down corresponding dynamic data and be sent to the synchrodata memory module with the step-out won in the dynamic data storage module with meta data server.
The present invention also provides a kind of meta data server, comprising:
The step-out data memory module is used to store out-of-synchronization queue, comprises the step-out record of the file dynamic data node reference record in the dynamic data storage module that is used to write down said meta data server in the said out-of-synchronization queue;
Processing module when being used to receive the file edit requests of client transmission, is upgraded the dynamic data area node of file described in the said dynamic data storage module according to said file edit requests; And the corresponding step-out record that upgrades file described in the interior out-of-synchronization queue of said step-out data memory module;
Whether timing module is used to set synchronizing cycle, and detect synchronizing cycle point in real time and arrive;
Synchronization module is used for, according to the step-out record in the said out-of-synchronization queue corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server being carried out synchronously in the synchronizing cycle that receives that timing module sends during arrival notice.
In an embodiment of the present invention; The corresponding step-out record that upgrades said file in its step-out data memory module of said processing module comprises: said processing module is searched the step-out record that whether has this document in the out-of-synchronization queue in its step-out data memory module; As do not exist, then in said out-of-synchronization queue, create and the corresponding step-out record of said file edit requests; As existing, then it is done and the corresponding renewal of said file edit requests.
The present invention also provides a kind of dynamic data active and standby synchronous system, and it is main with meta data server and subsequent use meta data server to comprise that mutual communication connects, and wherein, said master comprises with meta data server:
The step-out data memory module is used to store out-of-synchronization queue, comprises the step-out record of the file dynamic data node reference record in the dynamic data storage module that is used to write down said meta data server in the said out-of-synchronization queue;
Processing module when being used to receive the file edit requests of client transmission, is upgraded the dynamic data area node of file described in the said dynamic data storage module according to said file edit requests; And the corresponding step-out record that upgrades file described in the interior out-of-synchronization queue of said step-out data memory module;
Whether timing module is used to set synchronizing cycle, and detect synchronizing cycle point in real time and arrive;
Synchronization module is used for, according to the step-out record in the said out-of-synchronization queue corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server being carried out synchronously in the synchronizing cycle that receives that timing module sends during arrival notice.
The invention has the beneficial effects as follows: when the master among the present invention receives the file edit requests of client transmission with meta data server; Dynamic data area node according to receiving file edit requests said file in its dynamic data storage module upgrades, and the corresponding step-out record to this document in the out-of-synchronization queue in the step-out data memory module upgrades; And when arrive in synchronizing cycle, then send synchronization request to corresponding with it subsequent use meta data server; And after the synchronization request response that receives subsequent use meta data server,, corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server are carried out synchronously according to the step-out record in the said out-of-synchronization queue.Be that master among the present invention is not only when the masterslave switchover with meta data server; Just initiate the dynamic data synchronization request to subsequent use meta data server, but when the cycle of setting arrives, regularly trigger dynamic data area between the active and standby meta data server synchronously; Therefore in the time of real masterslave switchover; Only need a spot of dynamic data of residue synchronously between the active and standby meta data server; The dynamic data area of subsequent use meta data server is set up rapidly; Accomplish alternation of hosts's switching fully, and then the satisfaction of raising user experience is carried out in each operation in the assurance dynamic data area smoothly.
Description of drawings
Fig. 1 is the flow chart of the dynamic data main standby synchronous method of an embodiment of the present invention;
Fig. 2 is the structured flowchart of the meta data server of an embodiment of the present invention;
Fig. 3 is the active and standby synchro system block diagram of the dynamic data of an embodiment of the present invention.
Embodiment
Combine accompanying drawing that the present invention is done further explain through embodiment below.
See also Fig. 1, in this example, when the master receives the file edit requests of client transmission with meta data server, in its dynamic data storage module, upgrade the dynamic data area node of said file according to the file edit requests that receives; And the step-out record of file described in the out-of-synchronization queue in corresponding its step-out data memory module of renewal; It should be noted that; Upgrade the dynamic data area node of said file among Fig. 1 and upgrade between two steps of step-out record of said file and do not have strict time sequencing; Dynamic data area node that can first transaction file, step-out record that also can first transaction file, perhaps the two upgrades simultaneously;
According to the step-out record of each file in out-of-synchronization queue, carry out dynamic data storage module in corresponding dynamic data and said subsequent use meta data server synchronously when arriving main synchronizing cycle of presetting with the meta data server judgement; Be specially:
Whether arrive main synchronizing cycle of presetting with the meta data server judgement, as arriving synchronizing cycle, then sends synchronization request to corresponding with it subsequent use meta data server;
Lead with meta data server after the synchronization request response that receives subsequent use meta data server feedback; According to the step-out record of each file in the out-of-synchronization queue, corresponding dynamic data in the dynamic data storage module and said subsequent use meta data server are carried out synchronously.
Be that master in this example is not only when the masterslave switchover with meta data server, just initiate the dynamic data synchronization request to subsequent use meta data server, but regularly trigger dynamic data area between the active and standby meta data server synchronously; Therefore in the time of real masterslave switchover; Only need the synchronously remaining synchronous dynamic data that also is not able to do in time on a small quantity between the active and standby meta data server; The dynamic data area of subsequent use meta data server is set up rapidly; Accomplish the switching that is equipped with the alternation of hosts, and then each operation in the assurance dynamic data area is carried out smoothly.
File edit requests in this example comprises file open request, file modification request and file close request.After the master received the file edit requests with meta data server in this example, the step-out record that upgrades this document in the interior out-of-synchronization queue of its step-out data memory module specifically can be following:
The master searches the step-out record that whether has this document in the out-of-synchronization queue in the step-out data memory module with meta data server, as not existing, then in said out-of-synchronization queue, creates and the corresponding step-out record of file edit requests that receives; As existing, the corresponding renewal of file edit requests of then the step-out record of this document being done and being received.It should be noted that the step-out record that establishment in this example is corresponding with the file edit requests that receives and do and the corresponding renewal of file edit requests that receives, is not to be meant that edit requests that basis receives creates or upgrade.Create and upgrade a condition of step-out record during the file edit requests that receives in this example, but be not unique conditional.
The step-out record of this routine file comprises file unique identification and edit operation type.When creating the step-out record, comprise the unique identification and its edit operation type corresponding of creating this document with the file edit requests that receives.In this example; Step-out record edit operation type is not according to receiving the decision of file edit requests; Also the factor according to the dynamic data area node that whether has file in the dynamic data area decides, and promptly also decides according to the current dynamic data area node of this file that whether comprises of subsequent use meta data server.To the different files edit requests dynamic data area node of file is upgraded respectively with the step-out record below and explain that the renewal in this example comprises operations such as rebuliding and update.
Main when receiving file open request with meta data server, search the dynamic data area node that whether has this document in its dynamic data storage module, as not existing, then at the dynamic data area node of dynamic data storage module creation this document; And create the step-out record of this document in the out-of-synchronization queue in its step-out data memory module; This moment is not owing to exist the dynamic data area node of this document in the dynamic data area; Show the dynamic data area node of not preserving this document in the current subsequent use meta data server; Therefore its edit operation type is set for opening add, also can be regarded as increase, show the current dynamic data area node that does not have this document of subsequent use former data server;
Like the dynamic data area node of dynamic data storage module memory, then this node updates is opened the relevant information of the new client of this document at this document; And search the step-out record that whether has this document in the out-of-synchronization queue in its step-out data memory module; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set, show that subsequent use meta data server preserved the dynamic data area node of this document this moment for revising mod; But its state needs to upgrade with main inconsistent with the current state in the meta data server; As existing, then keep its edit operation type constant.
When the master receives the file modification request with meta data server; Main with the dynamic data area node of meta data server according to said file modification request transaction file in its dynamic data storage module; For example this modification possibly be the modification such as file size, attribute to file; The apply metadata server is done corresponding renewal according to concrete modification to the dynamic data area node of this document.The master searches the step-out record that whether has said file in the out-of-synchronization queue in its step-out data memory module with meta data server; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
When the master receives file close request with meta data server, in its dynamic data storage module, upgrade the dynamic data area node of this document according to this document turn-off request; And further whether also held the step-out record of renewal this document in said out-of-synchronization queue by other clients according to the dynamic data area node of this document, specific as follows:
If the dynamic data area node of said file is not held by other clients, show that the current user of not having is using this document, therefore needs to discharge the dynamic data area node of this document.Simultaneously, search the step-out record that whether has said file in the out-of-synchronization queue in the said step-out data memory module, as not existing, then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for deleting de l; As existing, then judge its edit operation type, be add like its edit operation type; The current not dynamic data area node of this document in the subsequent use meta data server in surface; And yet also be not able to do in time synchronously, this moment is with the step-out record deletion of said file, because need not let subsequent use meta data server know this process; Reduce active and standby between synchronous amount of dynamic data, improve its dynamic efficiency; Like its edit operation type is not add, shows that current saved in the subsequent use meta data server has the dynamic data area node of this document this moment, need notify it to discharge this node, and therefore its edit operation type with this document record is updated to deletion de l.
If the dynamic data area node of said file is still held by other clients; Then search the step-out record that whether has said file in the out-of-synchronization queue in the said step-out data memory module; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
It should be noted that; Trigger the synchronous condition of dynamic data in this example except being provided with synchronizing cycle; Also can whether reach preset number and determine whether starting trigger process according to the step-out record number of the file that comprises in the out-of-synchronization queue; The two can the triggering synchronous process as long as a condition is when satisfying.When therefore the master in this example judges with meta data server whether arrive preset synchronizing cycle; Whether the number of also judging the step-out record in the out-of-synchronization queue reaches preset value; If reach said preset value, then send synchronization request to corresponding with it subsequent use meta data server; Preferably, the preset value in this example can be the maximum that out-of-synchronization queue allows storage step-out record.
When synchronizing cycle arrive or out-of-synchronization queue in the number of step-out record when reaching preset value; Main with meta data server according to the step-out record in the out-of-synchronization queue, it is following that corresponding dynamic data in the dynamic data storage module and said subsequent use meta data server are carried out synchronous detailed process:
The master wins step-out in sequence with meta data server and records the dynamic data storage module from said out-of-synchronization queue; Out-of-synchronization queue in preferred this example can realize through chained list; Increase the control corresponding field in main document control data field with meta data server; Be used for writing down the recorded address of corresponding out-of-synchronization queue, when winning the step-out record, can select to begin to win from the gauge outfit of out-of-synchronization queue chained list; When synchronous at every turn; The record number of winning can be provided with in advance, also is sent to the synchrodata memory module with writing down corresponding dynamic data with the step-out of winning in the dynamic data storage module simultaneously, specifically can copy to the synchrodata district through copy mode; In this example, the concrete setting of actual number of winning record can be according to the size setting of synchrodata memory module, and the record number of promptly winning is till the synchrodata memory module storage dynamic data area node storage corresponding with these records is full; When all step-outs write down in having won out-of-synchronization queue,, all think to win to finish no matter whether reach preset number.
The master sends synchronization message with meta data server to subsequent use meta data server then, accomplishes with the dynamic data of subsequent use meta data server synchronous.
In this example main with meta data server before subsequent use meta data server sends synchronization message, also can comprise the step that the data with the storage of synchrodata memory module lock;
If receive the synchronous response of successful of subsequent use meta data server, release synchrodata memory module;
All do not receive the synchronous response of successful of subsequent use meta data server, the overtime repeating transmission in synchrodata district if surpass the preset response time.Arrive preset higher limit if retransmit number of times, the record of winning is returned to out-of-synchronization queue, release synchrodata district; Whether the process of giving back is: judge that the step-out record inediting action type win is add or mod, in current states, delete or change, as deleting; Then, guarantee that the file that active and standby all known are closed no longer is placed on the out-of-synchronization queue, as change the step-out record deletion of correspondence; Then it is updated to up-to-date state, the step-out with after unchanged and the renewal of order writes down the tail of the queue that is returned to out-of-synchronization queue then, with the file that guarantees not close; When changing once more, can be synchronized to standby host once more.Before starting synchronously next time, real-time update in this formation, and when arriving synchronously, undertaken dynamically by said process next time.
In this example when synchronous; Main with meta data server when writing down corresponding dynamic data and be sent to the synchrodata memory module with the step-out of winning in the dynamic data storage module; Also can the state information in the client data district be sent in the said synchrodata memory module, let subsequent use meta data server in time understand the online situation of active client.
In this example, when lead, when being switched, main remaining also not synchronous dynamic data can switch according to the said process realization with meta data server and subsequent use meta data server the time.And can know by foregoing; In the active and standby synchronous method of dynamic data provided by the invention; Dynamic data is active and standby not to be when only betiding masterslave switchover synchronously; But when arrive in the synchronizing cycle of setting or out-of-synchronization queue when full, the step-out that all can fulfil ahead of schedule in the out-of-synchronization queue writes down pairing dynamic data; Therefore when when masterslave switchover takes place; Not synchronous dynamic data just seldom between the primary, spare meta data server; The dynamic data area of subsequent use meta data server is set up rapidly; Accomplish alternation of hosts's switching fully, and then the satisfaction of raising user experience is carried out in each operation in the assurance dynamic data area smoothly.
See also Fig. 2, a kind of meta data server also be provided in this example, comprising:
The step-out data memory module is used to store out-of-synchronization queue, comprises the step-out record of the file dynamic data node reference record in the dynamic data storage module that is used to write down said meta data server in the out-of-synchronization queue;
Processing module when being used to receive the file edit requests of client transmission, is upgraded the dynamic data area node and the step-out record of file described in said dynamic data storage module and the step-out data memory module respectively as stated above;
Whether timing module is used to set synchronizing cycle, and detect synchronizing cycle point in real time and arrive;
Synchronization module is used for sending synchronization request in the synchronizing cycle that receives that timing module sends during arrival notice to corresponding subsequent use meta data server; And after the synchronization request response that receives said subsequent use meta data server; According to the step-out record in the said out-of-synchronization queue; Corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server are carried out synchronously, and concrete method for synchronous is seen the part shown in the said method.
Meta data server in this example also can comprise detection module; Whether the step-out record quantity that is used for detecting in real time out-of-synchronization queue reaches preset value; And when reaching; The notice synchronization module, after the synchronization module in this example also was used to receive this notice, the dynamic data of accomplishing as stated above between active and standby was synchronous.
See also Fig. 3, the present invention also provides a kind of dynamic data active and standby synchronous system, and it is main with meta data server and subsequent use meta data server to comprise that mutual communication connects, and wherein, the master in this example can be above-mentioned meta data server with meta data server.
It should be noted that the master in this example is relative with meta data server and subsequent use meta data server, depend on the work at present state of meta data server.
Above content is to combine concrete execution mode to the further explain that the present invention did, and can not assert that practical implementation of the present invention is confined to these explanations.For the those of ordinary skill of technical field under the present invention, under the prerequisite that does not break away from the present invention's design, can also make some simple deduction or replace, all should be regarded as belonging to protection scope of the present invention.
Claims (13)
1. active and standby synchronous method of dynamic data is characterized in that comprising:
When the master receives the file edit requests of client transmission with meta data server, in its dynamic data storage module, upgrade the dynamic data area node of said file according to said file edit requests; And the corresponding step-out record that upgrades file described in the interior out-of-synchronization queue of its step-out data memory module;
The master, according to the step-out record in the said out-of-synchronization queue, carries out corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server when judging that arrive in preset synchronizing cycle with meta data server synchronously.
2. the method for claim 1; It is characterized in that; The main record with the step-out of file described in the out-of-synchronization queue in its step-out data memory module of the corresponding renewal of meta data server comprises: said master searches the step-out record that whether has this document in the out-of-synchronization queue in its step-out data memory module with meta data server; As do not exist, then in said out-of-synchronization queue, create the step-out record corresponding with said file edit requests; As existing, then it is done and the corresponding renewal of said file edit requests.
3. method as claimed in claim 2 is characterized in that, said step-out record comprises file unique identification and edit operation type.
4. method as claimed in claim 3; It is characterized in that; Said file edit requests comprises file open request; When said master received file open request with meta data server, the dynamic data area node and the step-out record that upgrade said file at its dynamic data storage module and step-out data memory module respectively comprised:
Main search the dynamic data area node that whether has said file in its dynamic data storage module, as not existing, then at the dynamic data area node of the said file of dynamic data storage module creation with meta data server; And in said out-of-synchronization queue, create the step-out record of said file, its edit operation type is set for opening add;
As existing, then to the relevant information of the new client of dynamic data area node updates of said file; And search the step-out record that whether has said file in the out-of-synchronization queue in its step-out data memory module, as not existing, then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
5. method as claimed in claim 3; It is characterized in that; Said file edit requests comprises the file modification request; When said master received the file modification request with meta data server, the dynamic data area node and the step-out record that upgrade said file at its dynamic data storage module and step-out data memory module respectively comprised:
The main dynamic data area node that in its dynamic data storage module, upgrades said file with meta data server according to said file modification request; And search the step-out record that whether has said file in the out-of-synchronization queue in its step-out data memory module, as not existing, then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
6. method as claimed in claim 3; It is characterized in that; Said file edit requests comprises file close request; When said master received file close request with meta data server, the dynamic data area node and the step-out record that upgrade said file at its dynamic data storage module and step-out data memory module respectively comprised:
The main dynamic data area node that in its dynamic data storage module, upgrades said file with meta data server according to said file close request; And further whether also held the step-out record of the said file of renewal in said out-of-synchronization queue by other clients according to the dynamic data area node of said file.
7. method as claimed in claim 6 is characterized in that, whether the master is also comprising at the step-out record that is used the said files of renewal by other clients in said out-of-synchronization queue according to said file with meta data server:
If the dynamic data area node of said file is not held by other clients; Then search the step-out record that whether has said file in the out-of-synchronization queue in the said step-out data memory module; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for deleting de l; As existing, then judge its edit operation type, be add like its edit operation type, then with the step-out record deletion of said file; Otherwise, its edit operation type is updated to deletion del;
If the dynamic data area node of said file is held by other clients; Then search the step-out record that whether has said file in the out-of-synchronization queue in the said step-out data memory module; As do not exist; Then in said out-of-synchronization queue, create the step-out record of said file, and its edit operation type is set for revising mod; As existing, then keep its edit operation type constant.
8. like each described method of claim 1-7; It is characterized in that; When said master judges with meta data server whether arrive preset synchronizing cycle, judge also whether the record number in the said out-of-synchronization queue reaches preset value, if reach said preset value; Then, corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server are carried out synchronously according to the step-out record in the said out-of-synchronization queue.
9. method as claimed in claim 8 is characterized in that, said master, comprises corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server according to the step-out record in the said out-of-synchronization queue with meta data server synchronously:
The master wins step-out in sequence with meta data server and records the synchrodata memory module from said out-of-synchronization queue, and is sent to the synchrodata memory module with writing down corresponding dynamic data with the step-out of winning in the dynamic data storage module;
The master sends synchronization message with meta data server to subsequent use meta data server, accomplishes with the dynamic data of subsequent use meta data server synchronous.
10. method as claimed in claim 9; It is characterized in that; Said master, also comprises the state information in the client data district is sent in the said synchrodata memory module when writing down corresponding dynamic data and be sent to the synchrodata memory module with the step-out won in the dynamic data storage module with meta data server.
11. a meta data server is characterized in that comprising:
The step-out data memory module is used to store out-of-synchronization queue, comprises the step-out record of the file dynamic data node reference record in the dynamic data storage module that is used to write down said meta data server in the said out-of-synchronization queue;
Processing module when being used to receive the file edit requests of client transmission, is upgraded the dynamic data area node of file described in the said dynamic data storage module according to said file edit requests; And the corresponding step-out record that upgrades file described in the interior out-of-synchronization queue of said step-out data memory module;
Whether timing module is used to set synchronizing cycle, and detect synchronizing cycle point in real time and arrive;
Synchronization module is used for, according to the step-out record in the said out-of-synchronization queue corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server being carried out synchronously in the synchronizing cycle that receives that timing module sends during arrival notice.
12. meta data server as claimed in claim 11; It is characterized in that; The corresponding step-out record that upgrades said file in its step-out data memory module of said processing module comprises: said processing module is searched the step-out record that whether has this document in the out-of-synchronization queue in its step-out data memory module; As do not exist, then in said out-of-synchronization queue, create and the corresponding step-out record of said file edit requests; As existing, then it is done and the corresponding renewal of said file edit requests.
13. the active and standby synchronous system of dynamic data is characterized in that, it is main with meta data server and subsequent use meta data server to comprise that mutual communication connects, and wherein, said master comprises with meta data server:
The step-out data memory module is used to store out-of-synchronization queue, comprises the step-out record of the file dynamic data node reference record in the dynamic data storage module that is used to write down said meta data server in the said out-of-synchronization queue;
Processing module when being used to receive the file edit requests of client transmission, is upgraded the dynamic data area node of file described in the said dynamic data storage module according to said file edit requests; And the corresponding step-out record that upgrades file described in the interior out-of-synchronization queue of said step-out data memory module;
Whether timing module is used to set synchronizing cycle, and detect synchronizing cycle point in real time and arrive;
Synchronization module is used for, according to the step-out record in the said out-of-synchronization queue corresponding dynamic data in the said dynamic data storage module and said subsequent use meta data server being carried out synchronously in the synchronizing cycle that receives that timing module sends during arrival notice.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103781362A CN102447742A (en) | 2011-11-24 | 2011-11-24 | Dynamic data active and standby synchronization method and system as well as metadata server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103781362A CN102447742A (en) | 2011-11-24 | 2011-11-24 | Dynamic data active and standby synchronization method and system as well as metadata server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102447742A true CN102447742A (en) | 2012-05-09 |
Family
ID=46009826
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103781362A Pending CN102447742A (en) | 2011-11-24 | 2011-11-24 | Dynamic data active and standby synchronization method and system as well as metadata server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102447742A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064779A (en) * | 2012-12-26 | 2013-04-24 | 北京思特奇信息技术股份有限公司 | Method for processing log information rapidly |
| CN103235748A (en) * | 2013-04-24 | 2013-08-07 | 曙光信息产业(北京)有限公司 | Method and system for managing metadata |
| CN103973727A (en) * | 2013-01-28 | 2014-08-06 | 深圳市腾讯计算机系统有限公司 | Data synchronizing method and device |
| CN104104739A (en) * | 2014-08-08 | 2014-10-15 | 成都致云科技有限公司 | Data synchronization method for metadata service cluster of cloud storage system |
| CN104158898A (en) * | 2014-08-25 | 2014-11-19 | 曙光信息产业股份有限公司 | Updating method of file layout in distributed file system |
| CN104778214A (en) * | 2015-03-20 | 2015-07-15 | 四川长虹电器股份有限公司 | Distributed file system on basis of jump of resource locator and data synchronization method thereof |
| CN106408441A (en) * | 2015-07-29 | 2017-02-15 | Ls 产电株式会社 | Energy management system |
| CN106921503A (en) * | 2015-12-24 | 2017-07-04 | 华为技术有限公司 | A kind of method of data synchronization, apparatus and system |
| WO2018223991A1 (en) * | 2017-06-08 | 2018-12-13 | 华为技术有限公司 | Method and system for switching between active bng and standby bng, and bng |
| CN111400111A (en) * | 2020-03-12 | 2020-07-10 | 北京交大思诺科技股份有限公司 | Safe computer platform with standby machine out-of-step state |
| CN113656490A (en) * | 2020-05-12 | 2021-11-16 | 华为技术有限公司 | Data synchronization method, device, terminal and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1725186A (en) * | 2004-07-23 | 2006-01-25 | 中兴通讯股份有限公司 | Multiple data base data syne method |
| CN101221522A (en) * | 2007-01-11 | 2008-07-16 | 中兴通讯股份有限公司 | Data synchronization method of disaster tolerant backup system |
| CN101446972A (en) * | 2008-12-12 | 2009-06-03 | 中兴通讯股份有限公司 | Method and system for dynamic data synchronization |
-
2011
- 2011-11-24 CN CN2011103781362A patent/CN102447742A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1725186A (en) * | 2004-07-23 | 2006-01-25 | 中兴通讯股份有限公司 | Multiple data base data syne method |
| CN101221522A (en) * | 2007-01-11 | 2008-07-16 | 中兴通讯股份有限公司 | Data synchronization method of disaster tolerant backup system |
| CN101446972A (en) * | 2008-12-12 | 2009-06-03 | 中兴通讯股份有限公司 | Method and system for dynamic data synchronization |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064779B (en) * | 2012-12-26 | 2016-08-03 | 北京思特奇信息技术股份有限公司 | A kind of method of quick process log information |
| CN103064779A (en) * | 2012-12-26 | 2013-04-24 | 北京思特奇信息技术股份有限公司 | Method for processing log information rapidly |
| CN103973727A (en) * | 2013-01-28 | 2014-08-06 | 深圳市腾讯计算机系统有限公司 | Data synchronizing method and device |
| CN103973727B (en) * | 2013-01-28 | 2019-03-19 | 深圳市腾讯计算机系统有限公司 | Method of data synchronization and device |
| CN103235748A (en) * | 2013-04-24 | 2013-08-07 | 曙光信息产业(北京)有限公司 | Method and system for managing metadata |
| CN104104739A (en) * | 2014-08-08 | 2014-10-15 | 成都致云科技有限公司 | Data synchronization method for metadata service cluster of cloud storage system |
| CN104158898A (en) * | 2014-08-25 | 2014-11-19 | 曙光信息产业股份有限公司 | Updating method of file layout in distributed file system |
| CN104158898B (en) * | 2014-08-25 | 2018-01-19 | 曙光信息产业股份有限公司 | The update method of file layout in a kind of distributed file system |
| CN104778214B (en) * | 2015-03-20 | 2018-02-06 | 四川长虹电器股份有限公司 | The distributed file system and its method of data synchronization redirected based on resource localizer |
| CN104778214A (en) * | 2015-03-20 | 2015-07-15 | 四川长虹电器股份有限公司 | Distributed file system on basis of jump of resource locator and data synchronization method thereof |
| CN106408441A (en) * | 2015-07-29 | 2017-02-15 | Ls 产电株式会社 | Energy management system |
| CN106921503A (en) * | 2015-12-24 | 2017-07-04 | 华为技术有限公司 | A kind of method of data synchronization, apparatus and system |
| CN106921503B (en) * | 2015-12-24 | 2020-02-21 | 华为技术有限公司 | Data synchronization method, device and system |
| WO2018223991A1 (en) * | 2017-06-08 | 2018-12-13 | 华为技术有限公司 | Method and system for switching between active bng and standby bng, and bng |
| CN111400111A (en) * | 2020-03-12 | 2020-07-10 | 北京交大思诺科技股份有限公司 | Safe computer platform with standby machine out-of-step state |
| CN111400111B (en) * | 2020-03-12 | 2024-02-27 | 北京交大思诺科技股份有限公司 | Safe computer platform with standby machine out-of-step state |
| CN113656490A (en) * | 2020-05-12 | 2021-11-16 | 华为技术有限公司 | Data synchronization method, device, terminal and storage medium |
| CN113656490B (en) * | 2020-05-12 | 2024-01-30 | 华为技术有限公司 | Data synchronization method, device, terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102447742A (en) | Dynamic data active and standby synchronization method and system as well as metadata server | |
| US10567506B2 (en) | Data storage method, SDN controller, and distributed network storage system | |
| CN103095769B (en) | Across method of data synchronization and the system of machine room | |
| CN104468521B (en) | Online moving method, device and system | |
| US7165145B2 (en) | System and method to protect data stored in a storage system | |
| JP5452615B2 (en) | Method for implementing multi-array consistency groups using a write queuing mechanism | |
| US8140637B2 (en) | Communicating chunks between devices | |
| US8285824B2 (en) | Storage system and data replication method that refuses one or more requests for changing the first logical configuration information until the first storage apparatus and second storage apparatus are synchronized | |
| CN105760556A (en) | Low-time delay high-throughput multi-copy file read-write optimization method | |
| CN102368222A (en) | Online repairing method of multiple-copy storage system | |
| CN108897641B (en) | Log analysis service real-time synchronization system under database master-slave environment | |
| WO2014059804A1 (en) | Method and system for data synchronization | |
| WO2016026306A1 (en) | Data backup method, system, node and computer storage media | |
| RU2006140686A (en) | DEVICE AND METHOD FOR SYNCHRONIZING CACHE TABLES OF NEIGHBORS | |
| CN104536699B (en) | A kind of stream data wiring method based on embedded file system | |
| CN106919471B (en) | Method and system for snapshot creation | |
| CN105511862A (en) | Information copy paste method and copy paste device | |
| CN112817544B (en) | Data processing method, storage system and storage device | |
| CN105589887A (en) | Data processing method for distributed file system and distributed file system | |
| CN103902410A (en) | Data backup acceleration method for cloud storage system | |
| CN103023879A (en) | Method for synchronizing wide area data between data centers based on cache | |
| CN107016014A (en) | The method of data synchronization and device of heterogeneous database | |
| WO2019057193A1 (en) | Data deletion method and distributed storage system | |
| CN102508740A (en) | Remote replication method of file system | |
| CN105376277A (en) | Data synchronization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120509 |