CN105430026A - Cloud storage data synchronization method based on a plurality of control strategies - Google Patents
Cloud storage data synchronization method based on a plurality of control strategies Download PDFInfo
- Publication number
- CN105430026A CN105430026A CN201410447804.6A CN201410447804A CN105430026A CN 105430026 A CN105430026 A CN 105430026A CN 201410447804 A CN201410447804 A CN 201410447804A CN 105430026 A CN105430026 A CN 105430026A
- Authority
- CN
- China
- Prior art keywords
- synchronization
- data
- synchronous
- time
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention aims at problems of data consistency and different management among multiple sets of equipment, and provides a cloud storage data synchronization method based on a plurality of control strategies. The data storage data synchronization method comprises the steps of customizing different synchronization methods by a user according to a data management requirement through disposing a cloud storage server and a cloud storage client; ensuring a fact that modification by one set of equipment is immediately distributed to other equipment and modification of other equipment is immediately downloaded to the local equipment by means of a real-time synchronization mechanism; finishing distribution and downloading of all modification contents generated in two time intervals in one time at a fixed time point by means of a fixed-time synchronization mechanism; temporarily canceling any data synchronization by means of a pausing synchronization mechanism; and ensuring a fact that target data are invisible on other equipment by means of a neglect synchronization mechanism. The data synchronization method based on a plurality of control strategies improves flexibility and furthermore improves synchronization process control by the user.
Description
Technical field
The present invention relates to distributed data processing field, particularly relate to a kind of cloud dish method of data synchronization based on various control strategy.
Background technology
Along with the development of distributed system and cloud memory technology, and mobile device is universal, and the importance of file synchronization highlights day by day, particularly for the isomerous environment such as kinds of platform, plurality of devices, needs to realize the consistency of data and the control and management of otherness.According to the method for synchronization, automatic synchronization and manual synchronization can be divided into; According to locking range, Complete Synchronization can be divided into and select synchronous; Sync direction can be divided into up differential synchronization (for the data newly revised are diffused into other equipment) and descending differential synchronization (for obtaining up-to-date amendment from other equipment, and upgrading local data).Existing synchronization mechanism, has often only focused on the consistency of data, and ignores the demand of file difference management; In addition existing single automatic synchronization strategy, lacks flexibility to user operation.
Summary of the invention
The object of the invention is to solve above technical problem, proposing a kind of cloud dish method of data synchronization based on various control strategy newly.The method, based on the data synchronization mechanism of the various control strategy of cloud dish, can improve flexibility and the controllability of data management, solves existing single data syn-chronization pattern, provides a kind of method of many equipment rooms data consistency and otherness management to user.
Object of the present invention realizes by following technical scheme:
Based on a cloud dish method of data synchronization for various control strategy, comprise storage server, multi-platform (windows, Linux, Android etc.) client, the management by synchronization of multi-control strategy.
Described storage server, for leaving, managing up-to-date user file concentratedly, first the revised context of client uploads to storage server; Client opens synchronous mode, is also obtain current latest document from storage server.It can be based on Ceph, Swift, HDFS distributed storage architecture, also can be the centralised storage framework based on softwares such as MySQL, Oracle.
The plug-in unit that described multi-platform client is exactly windows, Linux and Android, iOS platform is installed, user according to self needs, can arrange synchronization policy in client.
The management by synchronization of described multi-control strategy, comprising: real-time synchronization, the technology such as monitor file operation by Inotify, long-chain connects, and realizes the change of real-time capture-data, and automatically triggers the synchronizing process with storage server; Timing Synchronization, by arranging timer, according to certain frequency, triggers the synchronizing process with storage server at setting-up time; Suspend synchronous, provisional interruption and the message communication of storage server; Ignore synchronous, ignoring file directory list by arranging, in synchronizing process, ignoring the data variation of these files.
Key step is as follows:
Step 1, user starts client plug-in, selects synchronization policy as required: real-time synchronization, Timing Synchronization, time-out be synchronous, it is synchronous to ignore.
Step 2, user arranges the corresponding parameter of synchronization policy.Timing Synchronization needs to arrange timer, and definition starts synchronous time, frequency etc.; Ignore and synchronously need setting to ignore file directory, like this when synchronous, the file under this catalogue can automatic shield.Suspend synchronous and real-time synchronization and then do not need further setting.
Step 3, user starts synchronization mechanism, the strategy that client plug-in will be selected according to user in step 1, and the parameter that in step 2, user is arranged, and carries out the data syn-chronization between client and storage server.
A kind of cloud dish method of data synchronization based on various control strategy in the present invention, synchronous by real-time synchronization, Timing Synchronization, time-out, ignore synchronization mechanism, effectively improve user to many equipment rooms data file consistency and otherness managerial ability, and improve flexibility and the controllability of management.
Accompanying drawing explanation
Fig. 1 is the flow chart of the specific embodiment of the cloud dish method of data synchronization based on various control strategy of the present invention;
Fig. 2 is client and server Directory Synchronization flow process;
Embodiment
For making above and other object of the present invention, feature and advantage can become apparent, cited below particularly go out preferred embodiment, and coordinate institute's accompanying drawings, be described in detail below.
As shown in Figure 1, Fig. 1 is the flow chart of the method for data synchronization based on various control strategy of a kind of cloud dish of the present invention.In step 101, user, according to the needs of oneself management document, selects synchronization policy.According to the different choice of user, flow process can enter into step 102, step 103, step 105 and step 106 respectively.
In step 102, client can interrupt the monitoring to local file change, and with the communication of storage server.
In step 103, user needs to arrange timer, and definition starts synchronous time, frequency etc.When this time of arrival, client can be carried out one subsynchronous automatically, and flow process enters step 106.
In step 104, client terminal start-up Inotify monitors file change, and unlatching is connected with the long-chain of storage server end and interrogated.When there is file status difference, enter step 106.
In step 105, user needs setting to ignore file directory, and like this when synchronous, file modification under this catalogue can automatic shield, both can not upload local amendment to storage server, and amendment that also can not be up-to-date on downloaded stored server, flow process enters step 106.
In step 106, if client Inotify finds that local file changes, first can obtain the nearest state of this file to storage server, through contrast difference, only upload difference section to storage server.If storage server has file to change, first up-to-date amendment to the client query difference of current communication with it, if not up-to-date, can will be downloaded to client by it.
As shown in Figure 2, Fig. 2 is client and server Directory Synchronization flow process.In step 201, judge whether to be provided with timer at Timing Synchronization.If there is timer, then enter step 202, otherwise enter step 203.
In step 202, judge whether the time of triggering synchronous, if do not arrived, continued to wait for, otherwise enter step 203.
In step 203, user end to server obtains latest document directory information, compares for same local directory.
In step 204, judge whether to ignore synchronous directory ignoring synchronously to be provided with, if do not had, enter step 206, otherwise enter step 205.
In step 205, ignore synchronous directory if be provided with, need the associative directory change information in the latest list obtained in step 203 to reject.
In step 206, by traversal, compare the latest list of server acquisition and the difference of local directory one by one.If there are differences, enter step 207.
Step 207, by timestamp and version number, judges whether that local data upgrades than server data, if so, enters step 208, otherwise return step 201.
Step 208, sends to server by local variance data.
Step 209, is updated to local file by server variance data.
Claims (3)
1. based on a cloud dish method of data synchronization for various control strategy, it is characterized in that comprising: the storage server of Client/Server cloud plate rail structure, multi-platform client, the management by synchronization of multi-control strategy;
Described storage server, for leaving, managing up-to-date user file concentratedly, first the revised context of client uploads to storage server; Client opens synchronous mode, is obtain current latest document from storage server, comprises the distributed storage architecture based on Ceph, Swift, HDFS, also comprise the centralised storage framework based on MySQL, oracle software;
The plug-in unit that described multi-platform client is exactly windows, Linux and Android, iOS platform is installed, user according to self needs, can arrange synchronization policy in client;
The management by synchronization of described multi-control strategy, comprises real-time synchronization, Timing Synchronization, time-out is synchronous and ignore synchronous.
2. the cloud dish method of data synchronization based on various control strategy according to claim 1, is characterized in that main implementation step is as follows:
Step 1, user starts client plug-in, selects real-time synchronization, Timing Synchronization, time-out synchronous or ignore synchronous as required;
Step 2, user arranges the corresponding parameter of synchronization policy, and Timing Synchronization needs to arrange timer, and definition starts synchronous time, frequency; Ignore and synchronously need setting to ignore file directory, like this when synchronous, the file meeting automatic shield under this catalogue; Suspend synchronous and real-time synchronization and then do not need further setting,
Step 3, user starts synchronization mechanism, the strategy that client plug-in will be selected according to user in step 1, and the parameter that in step 2, user is arranged, and carries out the data syn-chronization between client and storage server.
3. the cloud dish method of data synchronization based on various control strategy according to claim 1 and 2, it is characterized in that: real-time synchronization, monitor file operation by Inotify, long-chain connects, realize the change of real-time capture-data, and automatically trigger the synchronizing process with storage server; Timing Synchronization, by arranging timer, according to certain frequency, triggers the synchronizing process with storage server at setting-up time; Suspend synchronous, provisional interruption and the message communication of storage server; Ignore synchronous, ignoring file directory list by arranging, in synchronizing process, ignoring the data variation of these files.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410447804.6A CN105430026A (en) | 2014-09-04 | 2014-09-04 | Cloud storage data synchronization method based on a plurality of control strategies |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410447804.6A CN105430026A (en) | 2014-09-04 | 2014-09-04 | Cloud storage data synchronization method based on a plurality of control strategies |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105430026A true CN105430026A (en) | 2016-03-23 |
Family
ID=55507967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410447804.6A Pending CN105430026A (en) | 2014-09-04 | 2014-09-04 | Cloud storage data synchronization method based on a plurality of control strategies |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430026A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106357735A (en) * | 2016-08-26 | 2017-01-25 | 北京百度网讯科技有限公司 | Method and device for operating infrastructure layer of cloud computing architecture |
| CN108156215A (en) * | 2017-11-20 | 2018-06-12 | 广东睿江云计算股份有限公司 | A kind of monitoring method, the system of XenServer storage devices |
| CN110196859A (en) * | 2019-06-10 | 2019-09-03 | 天津神舟通用数据技术有限公司 | Data base read-write based on JDBC distributor separates cluster real-time consistency method |
| CN110535907A (en) * | 2019-07-26 | 2019-12-03 | 济南浪潮数据技术有限公司 | A kind of metadata synchronization method and system |
| CN112068872A (en) * | 2020-09-11 | 2020-12-11 | 上海湃睿信息科技有限公司 | Cloud management platform based on intranet software |
| TWI801730B (en) * | 2020-04-07 | 2023-05-11 | 神雲科技股份有限公司 | Server with system setting data synchronization function |
| CN117149885A (en) * | 2023-10-31 | 2023-12-01 | 天津神舟通用数据技术有限公司 | Read-write separation implementation method based on database master node forwarding |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102088491A (en) * | 2011-02-01 | 2011-06-08 | 西安建筑科技大学 | Distributed storage oriented cloud storage security architecture and data access method thereof |
| CN102868754A (en) * | 2012-09-26 | 2013-01-09 | 北京联创信安科技有限公司 | High-availability method, node device and system for achieving cluster storage |
| CN103647829A (en) * | 2013-12-11 | 2014-03-19 | 北京荣之联科技股份有限公司 | Cloud disc file synchronization device and method |
-
2014
- 2014-09-04 CN CN201410447804.6A patent/CN105430026A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102088491A (en) * | 2011-02-01 | 2011-06-08 | 西安建筑科技大学 | Distributed storage oriented cloud storage security architecture and data access method thereof |
| CN102868754A (en) * | 2012-09-26 | 2013-01-09 | 北京联创信安科技有限公司 | High-availability method, node device and system for achieving cluster storage |
| CN103647829A (en) * | 2013-12-11 | 2014-03-19 | 北京荣之联科技股份有限公司 | Cloud disc file synchronization device and method |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106357735A (en) * | 2016-08-26 | 2017-01-25 | 北京百度网讯科技有限公司 | Method and device for operating infrastructure layer of cloud computing architecture |
| CN106357735B (en) * | 2016-08-26 | 2018-05-22 | 北京百度网讯科技有限公司 | For operating the method and apparatus of the infrastructure layer of cloud computing framework |
| CN108156215A (en) * | 2017-11-20 | 2018-06-12 | 广东睿江云计算股份有限公司 | A kind of monitoring method, the system of XenServer storage devices |
| CN108156215B (en) * | 2017-11-20 | 2021-01-15 | 广东睿江云计算股份有限公司 | Monitoring method and system for XenServer storage equipment |
| CN110196859A (en) * | 2019-06-10 | 2019-09-03 | 天津神舟通用数据技术有限公司 | Data base read-write based on JDBC distributor separates cluster real-time consistency method |
| CN110535907A (en) * | 2019-07-26 | 2019-12-03 | 济南浪潮数据技术有限公司 | A kind of metadata synchronization method and system |
| TWI801730B (en) * | 2020-04-07 | 2023-05-11 | 神雲科技股份有限公司 | Server with system setting data synchronization function |
| CN112068872A (en) * | 2020-09-11 | 2020-12-11 | 上海湃睿信息科技有限公司 | Cloud management platform based on intranet software |
| CN117149885A (en) * | 2023-10-31 | 2023-12-01 | 天津神舟通用数据技术有限公司 | Read-write separation implementation method based on database master node forwarding |
| CN117149885B (en) * | 2023-10-31 | 2024-01-26 | 天津神舟通用数据技术有限公司 | Read-write separation implementation method based on database master node forwarding |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430026A (en) | Cloud storage data synchronization method based on a plurality of control strategies | |
| US11520808B2 (en) | System and method for synchronizing data between communication devices in a networked environment without a central server | |
| CN101841536B (en) | Remote automatic upgrading method for digital monitoring equipment | |
| CN111569426B (en) | Game scene editing method and device, storage medium and electronic device | |
| US20180034709A1 (en) | Method and Device for Asset Information Management | |
| CN103024082B (en) | A kind of Point-to-point Communication Method for Digital Media distribution | |
| CN103647829B (en) | A kind of cloud disc file sychronisation and method | |
| CN103731452A (en) | File synchronization system and method | |
| CN110162334B (en) | Code management method, device and storage medium | |
| CN111708836B (en) | Cluster management method, device and cluster system | |
| CN103856559A (en) | Working method and system for web services with various versions coexisting | |
| CN103024077A (en) | Schedule correlation information push method, schedule correlation information push system and server | |
| JP2012069088A (en) | Medical information processor and software distribution system | |
| CN105959363A (en) | Big data cluster deployment method capable of adapting to hardware configuration | |
| CN104516744A (en) | Software updating method and system | |
| WO2017161820A1 (en) | Server grouping management method, device, and electronic apparatus | |
| CN104219243A (en) | Method and device for managing client function | |
| CN110545207A (en) | Synchronous automatic intelligent DNS system and configuration method | |
| CN104104668A (en) | Network Synchronization System and Method for Automatically Setting Through Physical Line | |
| CN110958287B (en) | Operation object data synchronization method, device and system | |
| CN105681105A (en) | Network element configuration information synchronization method and device | |
| CN104717368A (en) | Flow-data updating method, flow-data updating system and terminal | |
| CN103118072B (en) | A kind of method and system of database update | |
| CN114780137A (en) | Software version management method and device, storage medium and electronic equipment | |
| CN103914339A (en) | Server management system and server management method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160323 |