CN102915338A - Data synchronization method of distributed file systems and file systems - Google Patents
Data synchronization method of distributed file systems and file systems Download PDFInfo
- Publication number
- CN102915338A CN102915338A CN2012103482435A CN201210348243A CN102915338A CN 102915338 A CN102915338 A CN 102915338A CN 2012103482435 A CN2012103482435 A CN 2012103482435A CN 201210348243 A CN201210348243 A CN 201210348243A CN 102915338 A CN102915338 A CN 102915338A
- Authority
- CN
- China
- Prior art keywords
- file
- changes
- module
- distributed
- distributed file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a data synchronization method of distributed file systems and the file systems. The data synchronization method comprises the following steps: detecting whether a file is changed or not; and if the file is detected changed, synchronizing the changed file to other distributed file systems. The data synchronization method can be deployed on distributed file systems, so that real-time synchronization or fixed-time synchronization of user data can be realized, the requirements of safety and timeliness of the user data can be met to the largest extend.
Description
Technical field
The present invention relates to the data field of synchronization, characteristics relate to a kind of distributed file system data synchronous method and file system.
Background technology
The most user may have such demand, be exactly that the user is in order to guarantee the security of own data, want significant data is backed up, and require data to want the energy real-time synchronization, can be synchronized to other system from a file system and get on, and will guarantee that the data in past can be accessed synchronously.Usually, in order to meet consumers' demand, now a lot of file system can not be accomplished real-time; In addition, even if can realize that data are synchronous, but the situation that the data after may occurring synchronously can not be accessed occurs.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of distributed file system data synchronous method and file system, carries out between different file synchronously to guarantee data.
In order to solve the problems of the technologies described above, the invention provides the synchronous method of a kind of distributed file system data, comprising:
Detect file and whether change,
As detect file and change, then with the file synchronization that changes to other distributed file systems.
Further, said method also has following characteristics: whether described detection file changes and comprises:
Whether detect has newly-built file, or
Whether detect to former documentary modification.
Further, said method also has following characteristics: whether described detection is achieved in the following ways former documentary modification:
Obtain the metadata attributes that original file changes.
Further, said method also has following characteristics: as after detecting file and changing, also comprise:
The file that record changes,
Described the file synchronization that changes is comprised to other distributed file systems:
In real time, periodically or receive the file synchronization that just changes behind the synchronic command to other distributed file systems.
In order to address the above problem, the present invention also provides a kind of file system, comprising:
Whether the first module changes for detection of file,
The second module is used in the situation that the first module detects file changes, with the file synchronization that changes to other distributed file systems.
Further, said method also has following characteristics:
Described the first module is specifically for detection of whether newly-built file being arranged, or whether detect to former documentary modification.
Further, said method also has following characteristics:
Whether described the first module is to detect former documentary modification by obtaining metadata attributes that original file changes.
Further, said method also has following characteristics: described distributed file system also comprises:
The 3rd module is used for recording the file that changes that described the first module detects;
Described the second module concrete is used in real time, periodically or after receiving synchronic command, the file synchronization that just changes is to other distributed file systems.
To sum up, the invention provides a kind of distributed file system data synchronous method and file system, this invention can be deployed on the distributed file system, realizes the real-time synchronization of user data, or Timing Synchronization, the requirement that solves to the full extent secure user data and promptness.
Description of drawings
Fig. 1 is the synchronous method of a kind of distributed file system data of the embodiment of the invention;
Fig. 2 is the schematic diagram of the file system of the embodiment of the invention;
Fig. 3 is the synchronous Organization Chart of distributed file system data that the present invention one uses example.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, hereinafter in connection with accompanying drawing embodiments of the invention are elaborated.Need to prove, in the situation that do not conflict, the embodiment among the application and the feature among the embodiment be combination in any mutually.
Fig. 1 is the synchronous method of a kind of distributed file system data of the embodiment of the invention, and the method comprises:
Whether S10, detection file change,
S20, change as detecting file, then with the file synchronization that changes to other distributed file systems.
Wherein, have to comprise whether detection has newly-built file among the step S10, or whether detect to former documentary modification.
The metadata attributes that can change by obtaining original file in the present embodiment detects original file is revised.
Described metadata attributes can including, but not limited to: the authority of the size of file, the modification time of file, file changes, variation of the coded lock information of file etc.
In a preferred embodiment, after detecting file and changing, can also record the file that changes, file system namely can be located rapidly like this needs synchronous file.
In synchronous process, can one detect file and change, namely the file that changes is processed synchronously, can solve to the full extent like this requirement of secure user data and promptness;
Also can periodically process synchronously the file that changes, the time interval of timing had better not be oversize here, can freely arrange according to user's wish, for example is set to half an hour, 1 hour;
Certainly, also can receive user's synchronic command after, the file that changes is processed synchronously, can improve user's experience.
Fig. 2 is the schematic diagram of the file system of the embodiment of the invention, and as shown in Figure 2, the file system of the present embodiment comprises:
Whether the first module changes for detection of file,
The second module is used in the situation that the first module detects file changes, with the file synchronization that changes to other distributed file systems.
Wherein, described the first module is specifically for detection of whether newly-built file being arranged, or whether detect to former documentary modification.
In a preferred embodiment, described distributed file system can also comprise:
The 3rd module is used for recording the file that changes that described the first module detects;
Described the second module concrete is used in real time, periodically or after receiving synchronic command, the file synchronization that just changes is to other distributed file systems.
Fig. 3 is the Organization Chart of the synchronous method of the distributed file system data of the present invention's one application example, carries out the synchronous method of data and may further comprise the steps in this application scenarios:
Step 101, client foundation link with cluster file system;
If step 102 client has file operation, synchronous processing module (being equivalent to the first module above) receives the operation of file so, and records the metadata attributes after the file operation, and this record operation can not affect normal data write operation;
In case the metadata attributes of step 103 file operation goes on record, synchronous processing module can send to synchronization module (being equivalent to the second module above) to the metadata attributes tabulation of log file operation in real time or periodically so, and triggers it and carry out synchronous operation;
After step 104, synchronization module receive metadata attributes tabulation, can timely triggering synchronous instruction, with the file synchronization of the correspondence of record in the metadata attributes tabulation file system to other.
One of ordinary skill in the art will appreciate that all or part of step in the said method can come the instruction related hardware to finish by program, described program can be stored in the computer-readable recording medium, such as ROM (read-only memory), disk or CD etc.Alternatively, all or part of step of above-described embodiment also can realize with one or more integrated circuit.Correspondingly, each the module/unit in above-described embodiment can adopt the form of hardware to realize, also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
Below only be the preferred embodiments of the present invention; certainly; the present invention also can have other various embodiments; in the situation that do not deviate from spirit of the present invention and essence thereof; those of ordinary skill in the art work as can make according to the present invention various corresponding changes and distortion, but these corresponding changes and distortion all should belong to the protection domain of the appended claim of the present invention.
Claims (8)
1. method that the distributed file system data are synchronous comprises:
Detect file and whether change,
As detect file and change, then with the file synchronization that changes to other distributed file systems.
2. the method for claim 1, it is characterized in that: whether described detection file changes and comprises:
Whether detect has newly-built file, or
Whether detect to former documentary modification.
3. method as claimed in claim 2, it is characterized in that: whether described detection is achieved in the following ways former documentary modification:
Obtain the metadata attributes that original file changes.
4. such as each described method of claim 1-3, it is characterized in that: as after detecting file and changing, also comprise:
The file that record changes,
Described the file synchronization that changes is comprised to other distributed file systems:
In real time, periodically or receive the file synchronization that just changes behind the synchronic command to other distributed file systems.
5. file system comprises:
Whether the first module changes for detection of file,
The second module is used in the situation that the first module detects file changes, with the file synchronization that changes to other distributed file systems.
6. distributed file system as claimed in claim 5 is characterized in that:
Described the first module is specifically for detection of whether newly-built file being arranged, or whether detect to former documentary modification.
7. distributed file system as claimed in claim 6 is characterized in that:
Whether described the first module is to detect former documentary modification by obtaining metadata attributes that original file changes.
8. such as the described distributed file system of claim 5-7, it is characterized in that: described distributed file system also comprises:
The 3rd module is used for recording the file that changes that described the first module detects;
Described the second module concrete is used in real time, periodically or after receiving synchronic command, the file synchronization that just changes is to other distributed file systems.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103482435A CN102915338A (en) | 2012-09-18 | 2012-09-18 | Data synchronization method of distributed file systems and file systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103482435A CN102915338A (en) | 2012-09-18 | 2012-09-18 | Data synchronization method of distributed file systems and file systems |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102915338A true CN102915338A (en) | 2013-02-06 |
Family
ID=47613705
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012103482435A Pending CN102915338A (en) | 2012-09-18 | 2012-09-18 | Data synchronization method of distributed file systems and file systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102915338A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105824916A (en) * | 2016-03-16 | 2016-08-03 | 上海携程商务有限公司 | System and method for synchronizing data |
| CN106599106A (en) * | 2016-11-28 | 2017-04-26 | 深圳中兴网信科技有限公司 | Distributed file system-based data synchronization method and apparatus |
| CN108268794A (en) * | 2016-12-30 | 2018-07-10 | 珠海金山办公软件有限公司 | A kind of document security privileges of management system record and querying method and device |
| CN111522688A (en) * | 2019-02-01 | 2020-08-11 | 阿里巴巴集团控股有限公司 | Data backup method and device for distributed system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101281543A (en) * | 2008-05-13 | 2008-10-08 | 华为技术有限公司 | File synchronisation method and device |
| CN102202073A (en) * | 2010-03-24 | 2011-09-28 | 杭州华三通信技术有限公司 | Distributed system and data synchronization method thereof |
| CN102333108A (en) * | 2011-03-18 | 2012-01-25 | 北京神州数码思特奇信息技术股份有限公司 | Distributed cache synchronization system and method |
-
2012
- 2012-09-18 CN CN2012103482435A patent/CN102915338A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101281543A (en) * | 2008-05-13 | 2008-10-08 | 华为技术有限公司 | File synchronisation method and device |
| CN102202073A (en) * | 2010-03-24 | 2011-09-28 | 杭州华三通信技术有限公司 | Distributed system and data synchronization method thereof |
| CN102333108A (en) * | 2011-03-18 | 2012-01-25 | 北京神州数码思特奇信息技术股份有限公司 | Distributed cache synchronization system and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105824916A (en) * | 2016-03-16 | 2016-08-03 | 上海携程商务有限公司 | System and method for synchronizing data |
| CN105824916B (en) * | 2016-03-16 | 2019-05-31 | 上海携程商务有限公司 | Data synchronous system and method |
| CN106599106A (en) * | 2016-11-28 | 2017-04-26 | 深圳中兴网信科技有限公司 | Distributed file system-based data synchronization method and apparatus |
| CN108268794A (en) * | 2016-12-30 | 2018-07-10 | 珠海金山办公软件有限公司 | A kind of document security privileges of management system record and querying method and device |
| CN111522688A (en) * | 2019-02-01 | 2020-08-11 | 阿里巴巴集团控股有限公司 | Data backup method and device for distributed system |
| CN111522688B (en) * | 2019-02-01 | 2023-09-15 | 阿里巴巴集团控股有限公司 | Data backup method and device for distributed system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102760126B (en) | Data synchronization method in distributive system, and distributive system | |
| CN101719165A (en) | Method for realizing high-efficiency rapid backup of database | |
| CN102546253A (en) | Webpage tamper-resistant method, system and management server | |
| CN104246767A (en) | Telemetry system for a cloud synchronization system | |
| CN111444274B (en) | Data synchronization method, data synchronization system, and apparatus, medium, and system thereof | |
| CN102915338A (en) | Data synchronization method of distributed file systems and file systems | |
| CN105187464A (en) | Data synchronization method, device and system in distributed storage system | |
| CN105574109A (en) | Database synchronizing method and equipment and system | |
| CN102867035A (en) | High-availability method and device of distributed document system cluster | |
| CN103064757A (en) | Method and system for backing up data | |
| US20180139280A1 (en) | Methods and apparatuses for cluster switching | |
| CN105787129B (en) | Data storage method and electronic equipment | |
| CN102014012A (en) | Synchronous alarming method and device | |
| CN102752294A (en) | Method and system for synchronizing data of multiple terminals on basis of equipment capacity | |
| CN101216794A (en) | Improved Server-Less backup method, memory apparatus and backup server | |
| CN103973727A (en) | Data synchronizing method and device | |
| CN109299116B (en) | Data synchronization method, device, equipment and readable storage medium | |
| CN112463880B (en) | Block chain data storage method and related device | |
| CN103714179A (en) | Multi-language supporting method and system for system blog | |
| CN105701158A (en) | File system read-write optimization method and framework | |
| CN104346346A (en) | Service issuing method and system, service updating method and client | |
| CN109885258B (en) | Data deleting device and method based on block chain | |
| CN102413154B (en) | Method of data information synchronization between systems and apparatus thereof | |
| CN101840552A (en) | Method, device and system for distributing and canceling advertising information of digital newspaper | |
| CN115104295A (en) | Data processing method, data processing device, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130206 |