CN111797065A - Cloud storage technology-based cloud synchronization method and system - Google Patents

Cloud storage technology-based cloud synchronization method and system Download PDF

Info

Publication number
CN111797065A
CN111797065A CN202010457888.7A CN202010457888A CN111797065A CN 111797065 A CN111797065 A CN 111797065A CN 202010457888 A CN202010457888 A CN 202010457888A CN 111797065 A CN111797065 A CN 111797065A
Authority
CN
China
Prior art keywords
file
update
synchronization
setting
cloud storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010457888.7A
Other languages
Chinese (zh)
Inventor
沈亮杰
蔡功达
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Changjie Information Technology Co ltd
Original Assignee
Wuhan Changjie Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Changjie Information Technology Co ltd filed Critical Wuhan Changjie Information Technology Co ltd
Priority to CN202010457888.7A priority Critical patent/CN111797065A/en
Publication of CN111797065A publication Critical patent/CN111797065A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/178Techniques for file synchronisation in file systems
    • G06F16/1787Details of non-transparently synchronising file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention provides a cloud synchronization method and a system based on a cloud storage technology, wherein the method comprises the following steps: after the cloud storage server synchronization authority is set, controlling a client to periodically scan to obtain local file update; acquiring a file updating list and recording file updating acquisition time; and setting a data synchronization strategy according to the acquisition time of the update file, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server. By the scheme, the problem that the existing cloud synchronization method is low in synchronization efficiency is solved, the cloud synchronization efficiency can be improved, and the user experience is guaranteed.

Description

Cloud storage technology-based cloud synchronization method and system
Technical Field
The invention relates to the field of cloud storage, in particular to a cloud synchronization method and system based on a cloud storage technology.
Background
The cloud storage allows a large amount of data to be stored in a plurality of virtual servers in the cloud through a network, and provides the data to authorized users through a uniform interface. The cloud storage can centralize the storage resources, the software automatically manages the storage resources without human participation, and meanwhile, the storage resources can be dynamically used without considering data distribution, expansibility, fault tolerance and the like.
The cloud storage platform can automatically synchronize the local files of the user according to the authorization of the user, however, when the amount of the automatically synchronized files is large, the file synchronization efficiency is affected. At present, data synchronization of local files is mostly performed according to a file list obtained by scanning and directly performed in sequence, and although the data synchronization can be ensured in time, the data synchronization efficiency is reduced, and the user experience is affected.
Disclosure of Invention
In view of this, embodiments of the present invention provide a cloud synchronization method and system based on a cloud storage technology, so as to solve the problem of low efficiency of existing local data synchronization.
In a first aspect of the embodiments of the present invention, a cloud synchronization method based on a cloud storage technology is provided, including:
after the cloud storage server synchronization authority is set, controlling a client to periodically scan to obtain local file update;
acquiring a file updating list and recording file updating acquisition time;
and setting a data synchronization strategy according to the acquisition time of the update file, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server.
In a second aspect of the embodiments of the present invention, there is provided a cloud synchronization system based on a cloud storage technology, including:
the scanning module is used for controlling the client to regularly scan and obtain local file updates after the cloud storage server synchronization authority is set;
the recording module is used for acquiring a file updating list and recording file updating and acquiring time;
and the synchronization module is used for setting a data synchronization strategy according to the acquisition time of the update file, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server.
In a third aspect of the embodiments of the present invention, there is provided a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the method according to the first aspect of the embodiments of the present invention.
In a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the method provided in the first aspect of the embodiments of the present invention.
In the embodiment of the invention, local file update is acquired through periodic scanning, a file update list is acquired, the file update acquisition time is recorded, and a data synchronization strategy is set according to the update file acquisition time, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server. Therefore, the problem that the local data synchronization efficiency of the existing cloud synchronization method is low is solved, the important files can be guaranteed, the files are firstly obtained and are preferentially synchronized, meanwhile, the occupation of the background by the network environment and the file size is also considered, the influence on the normal use of the terminal application by a user is avoided, the data synchronization efficiency is effectively improved, and the use experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a cloud synchronization method based on cloud storage technology according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a cloud synchronization system based on a cloud storage technology according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "comprises" and "comprising," when used in this specification and claims, and in the accompanying drawings and figures, are intended to cover non-exclusive inclusions, such that a process, method or system, or apparatus that comprises a list of steps or elements is not limited to the listed steps or elements. In addition, "first" and "second" are used to distinguish different objects, and are not used to describe a specific order.
Referring to fig. 1, fig. 1 is a schematic flowchart of a cloud synchronization method based on a cloud storage technology according to an embodiment of the present invention, where the method includes:
s101, after the synchronization authority of the cloud storage server is set, controlling a client to periodically scan to obtain local file updates;
before a user uses the cloud storage platform to store data, the user needs to register an account number on the cloud storage platform to obtain a certain cloud storage space. When the user client side carries out data synchronization, the data synchronization can be carried out in a manual or automatic mode, and generally, when an automatic cloud synchronization mode is adopted, a cloud synchronization permission needs to be preset.
When the cloud storage server synchronization right is set, one or more types of data files can be synchronized, such as different types of data such as short messages, pictures, videos and the like.
After the server side sets the cloud synchronization authority, the client side periodically scans the local update file, namely scans the locally added file. Generally, after a file data synchronized to a cloud service is locally deleted, a server side does not need to delete the file data synchronously; for the locally modified file data, the corresponding file on the cloud service can be modified or the modified file can be directly added.
Preferably, the local file scanning period is set according to the user history synchronization frequency and the current network environment. The history synchronization frequency generally refers to an update frequency of a synchronization period adjacent to a current synchronization period, such as the first 1-10 synchronization periods of the current period, where the synchronization period is expressed by a time length, and the period time length may not be fixed. When the history synchronization frequency is high, the synchronization frequency can be reduced appropriately, i.e. the synchronization scanning period is prolonged. If the current network is better and the bandwidth is large, the synchronous frequency can be properly increased, and the synchronous scanning period can be shortened.
S102, acquiring a file updating list and recording file updating and acquiring time;
by scanning a local specific file or all files, an added file needing synchronization can be obtained, and the file scanning acquisition time or the time of file creation and generation in the local is recorded. By recording the file updating and acquiring time, the updating file can be ensured to be synchronized to the cloud service in time.
Further, a file update list is obtained, and the update file type and the update file size are recorded. By recording the type of the updated file and the size of the file, a corresponding updating strategy can be set conveniently during data synchronization, the file of a specific type can be updated in time, and the influence of uploading of an overlarge file on normal use experience of a user is avoided.
S103, setting a data synchronization strategy according to the acquisition time of the update file, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server.
Setting a file synchronization strategy based on file acquisition time, file size, current network environment and the like, wherein the occupation of network bandwidth by file synchronization needs to be considered in the synchronization strategy, and the synchronous file size timely synchronizes the occupation of a terminal memory and a file obtained by scanning.
Optionally, the number of files that can be synchronously transmitted in each synchronization period is set based on the current network environment; uploading a preset number of update files in a synchronization period according to the update file acquisition time and the file size; and if the transmission of the preset number of update files in the synchronization period is not finished, moving the update files which are not transmitted to a file transmission list of the next synchronization period for file uploading.
Based on different network environments, synchronous uploading of multiple files can be performed when the network condition is good, for example, time slices are allocated to each file to be uploaded synchronously, and uploading of corresponding files is performed in each time slice. Therefore, the occupation of a certain larger file on a data channel can be avoided, and the transmission of the small file is prevented from being influenced.
Preferably, the priority of uploading the update file is set based on the acquisition time of the update file, the file type, the historical preference of the user and the current time period. Setting priority for each file according to file acquisition time, file type, size and the like, wherein the higher the priority is when the file waits for uploading for a longer time, the higher the priority can be set for a specific type of file.
Furthermore, according to the historical use habit and the current time period of the user terminal, the synchronization frequency of the non-high frequency use time period can be properly improved, for example, the file synchronization frequency and the synchronization data volume can be improved for the time period with lower user use frequency, such as a specific time period at night, early morning and the like.
Compared with the traditional sequential synchronization method, the method provided by the embodiment can effectively improve the synchronization efficiency and guarantee the user experience.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, but should not constitute any limitation to the implementation process of the embodiments of the present invention,
fig. 2 is a schematic structural diagram of a cloud synchronization system based on a cloud storage technology according to a second embodiment of the present invention, where the system includes:
the scanning module 210 is configured to control the client to periodically scan and obtain local file updates after the cloud storage server synchronization permission is set;
optionally, the scanning module 210 includes.
And the setting unit is used for setting a local file scanning period according to the historical synchronization frequency of the user and the current network bandwidth.
The recording module 220 is configured to obtain a file update list and record file update obtaining time;
optionally, the obtaining the file update list and recording the file update obtaining time further includes:
and acquiring a file update list, and recording the type and the size of the update file.
The synchronization module 230 is configured to set a data synchronization policy according to the update file acquisition time, the file size, and the current network environment, so as to automatically synchronize the update file to the cloud storage server.
Optionally, the synchronization module 230 includes.
The setting unit is used for setting the number of files which can be synchronously transmitted in each synchronization period based on the current network environment;
the uploading unit uploads a preset number of update files in a synchronization period according to the update file acquisition time and the file size;
and the adjusting unit is used for moving the update files which are not transmitted to the file transmission list of the next synchronization period for uploading the files if the predetermined number of update files in the synchronization period are not transmitted completely.
Preferably, the setting a data synchronization policy according to the update file acquisition time, the file size, and the current network environment to automatically synchronize the update file to the cloud storage server further includes:
and setting the uploading priority of the update file based on the acquisition time of the update file, the file type, the historical preference of the user and the current time period.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
It will be understood by those skilled in the art that all or part of the steps in the method for implementing the above embodiments may be implemented by a program to instruct associated hardware, where the program may be stored in a computer-readable storage medium, and when the program is executed, the program includes steps S101 to S103, where the storage medium includes, for example: ROM/RAM, magnetic disk, optical disk, etc.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A cloud synchronization method based on cloud storage technology is characterized by comprising the following steps:
after the cloud storage server synchronization authority is set, controlling a client to periodically scan to obtain local file update;
acquiring a file updating list and recording file updating acquisition time;
and setting a data synchronization strategy according to the acquisition time of the update file, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server.
2. The method of claim 1, wherein the controlling client periodically scanning for local file updates comprises:
and setting a local file scanning period according to the historical synchronization frequency of the user and the current network bandwidth.
3. The method of claim 1, wherein obtaining the file update list and recording the file update obtaining time further comprises:
and acquiring a file update list, and recording the type and the size of the update file.
4. The method of claim 1, wherein setting a data synchronization policy according to the update file acquisition time, the file size, and the current network environment to automatically synchronize the update file to the cloud storage server comprises:
setting the number of files which can be synchronously transmitted in each synchronization period based on the current network environment;
uploading a preset number of update files in a synchronization period according to the update file acquisition time and the file size;
and if the transmission of the preset number of update files in the synchronization period is not finished, moving the update files which are not transmitted to a file transmission list of the next synchronization period for file uploading.
5. The method of claim 1, wherein setting a data synchronization policy according to the update file acquisition time, the file size, and the current network environment to automatically synchronize the update file to the cloud storage server further comprises:
and setting the uploading priority of the update file based on the acquisition time of the update file, the file type, the historical preference of the user and the current time period.
6. A cloud synchronization system based on cloud storage technology is characterized by comprising:
the scanning module is used for controlling the client to regularly scan and obtain local file updates after the cloud storage server synchronization authority is set;
the recording module is used for acquiring a file updating list and recording file updating and acquiring time;
and the synchronization module is used for setting a data synchronization strategy according to the acquisition time of the update file, the file size and the current network environment so as to automatically synchronize the update file to the cloud storage server.
7. The system of claim 6, wherein the scanning module comprises:
and the setting unit is used for setting a local file scanning period according to the historical synchronization frequency of the user and the current network bandwidth.
8. The system of claim 6, wherein obtaining the file update list and recording the file update obtaining time further comprises:
and acquiring a file update list, and recording the type and the size of the update file.
9. The system of claim 6, wherein the synchronization module comprises:
the setting unit is used for setting the number of files which can be synchronously transmitted in each synchronization period based on the current network environment;
the uploading unit uploads a preset number of update files in a synchronization period according to the update file acquisition time and the file size;
and the adjusting unit is used for moving the update files which are not transmitted to the file transmission list of the next synchronization period for uploading the files if the predetermined number of update files in the synchronization period are not transmitted completely.
10. The system of claim 6, wherein setting a data synchronization policy to automatically synchronize the update file to the cloud storage server according to the update file acquisition time, the file size, and the current network environment further comprises:
and setting the uploading priority of the update file based on the acquisition time of the update file, the file type, the historical preference of the user and the current time period.
CN202010457888.7A 2020-05-26 2020-05-26 Cloud storage technology-based cloud synchronization method and system Pending CN111797065A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010457888.7A CN111797065A (en) 2020-05-26 2020-05-26 Cloud storage technology-based cloud synchronization method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010457888.7A CN111797065A (en) 2020-05-26 2020-05-26 Cloud storage technology-based cloud synchronization method and system

Publications (1)

Publication Number Publication Date
CN111797065A true CN111797065A (en) 2020-10-20

Family

ID=72806213

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010457888.7A Pending CN111797065A (en) 2020-05-26 2020-05-26 Cloud storage technology-based cloud synchronization method and system

Country Status (1)

Country Link
CN (1) CN111797065A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113067892A (en) * 2021-04-09 2021-07-02 北京理工大学 Method for realizing safe cloud synchronization and cloud storage by using public cloud
WO2022100136A1 (en) * 2020-11-13 2022-05-19 深圳市前海手绘科技文化有限公司 Animation draft online storage optimization method and device
WO2023001208A1 (en) * 2021-07-22 2023-01-26 华为技术有限公司 Multi-file synchronization method and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102857570A (en) * 2012-09-13 2013-01-02 清华大学 Cloud synchronized method of files and cloud storage server
CN103916479A (en) * 2014-04-15 2014-07-09 大连理工大学 Cloud synchronous local area network accelerating system based on working group document
CN104519078A (en) * 2013-09-26 2015-04-15 中国电信股份有限公司 A method and a device for realizing cloud storage
US20170249328A1 (en) * 2014-09-02 2017-08-31 Telefonaktiebolaget Lm Ericsson (Publ) A Method, Cloud Synchronization Function Means and File System for Handling Files and Directories in a Cloud Storage Service
CN107332918A (en) * 2017-07-07 2017-11-07 上海斐讯数据通信技术有限公司 A kind of high in the clouds local file synchronization realizing method and system
CN108063779A (en) * 2016-11-07 2018-05-22 天脉聚源(北京)科技有限公司 A kind of cloud storage method and system synchronous with realization is locally stored

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102857570A (en) * 2012-09-13 2013-01-02 清华大学 Cloud synchronized method of files and cloud storage server
CN104519078A (en) * 2013-09-26 2015-04-15 中国电信股份有限公司 A method and a device for realizing cloud storage
CN103916479A (en) * 2014-04-15 2014-07-09 大连理工大学 Cloud synchronous local area network accelerating system based on working group document
US20170249328A1 (en) * 2014-09-02 2017-08-31 Telefonaktiebolaget Lm Ericsson (Publ) A Method, Cloud Synchronization Function Means and File System for Handling Files and Directories in a Cloud Storage Service
CN108063779A (en) * 2016-11-07 2018-05-22 天脉聚源(北京)科技有限公司 A kind of cloud storage method and system synchronous with realization is locally stored
CN107332918A (en) * 2017-07-07 2017-11-07 上海斐讯数据通信技术有限公司 A kind of high in the clouds local file synchronization realizing method and system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022100136A1 (en) * 2020-11-13 2022-05-19 深圳市前海手绘科技文化有限公司 Animation draft online storage optimization method and device
CN113067892A (en) * 2021-04-09 2021-07-02 北京理工大学 Method for realizing safe cloud synchronization and cloud storage by using public cloud
CN113067892B (en) * 2021-04-09 2022-07-15 北京理工大学 Method for realizing safe cloud synchronization and cloud storage by using public cloud
WO2023001208A1 (en) * 2021-07-22 2023-01-26 华为技术有限公司 Multi-file synchronization method and electronic device

Similar Documents

Publication Publication Date Title
CN111797065A (en) Cloud storage technology-based cloud synchronization method and system
US10574826B2 (en) Visual voicemail method for managing deleted messages
US10459750B2 (en) Tenant-controlled cloud apparatus
CN107707616B (en) A kind of data transmission method and system
CN103207867B (en) It handles the method for data block, initiate the method and node of recovery operation
CN109936473B (en) Deep learning prediction-based distributed computing system and operation method thereof
US9515838B2 (en) Bandwidth adaptive communication event scheduling
CN101741830A (en) Method, system, client and server for realizing multi-client data synchronization
CN101406060A (en) Time-delay video downloading service by using P2P content distribution network
CN101841557B (en) P2P streaming media downloading method and system based on orthogonal list
CN110099084B (en) Method, system and computer readable medium for ensuring storage service availability
WO2019029522A1 (en) Method for managing network component, and network device
CN101841691A (en) Method and device for exchanging streaming media data
CN103369020A (en) Cache synchronization system, cache synchronization method and apparatus thereof
CN102026228B (en) Statistical method and equipment for communication network performance data
CN111726388A (en) Cross-cluster high-availability implementation method, device, system and equipment
CN111143733A (en) Local data caching method and device, electronic equipment and readable storage medium
CN114598484B (en) Certificate updating method, device, cluster and storage medium
CN114143376A (en) Server for loading cache, display equipment and resource playing method
CN111246315B (en) Video interaction method, system, edge node, client and storage medium
CN111404978B (en) Data storage method and cloud storage system
CN101883124A (en) Data downloading method, device and system of on-demand system
CN204089866U (en) LAN router and cloud storage system
CN108629039B (en) Data processing method and device
CN103441865A (en) Method and system for managing IP addresses, BRASes and Portal server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination