CN111309528A - Data collaborative backup system and method based on cloud computing and distributed storage - Google Patents

Data collaborative backup system and method based on cloud computing and distributed storage Download PDF

Info

Publication number
CN111309528A
CN111309528A CN202010208182.7A CN202010208182A CN111309528A CN 111309528 A CN111309528 A CN 111309528A CN 202010208182 A CN202010208182 A CN 202010208182A CN 111309528 A CN111309528 A CN 111309528A
Authority
CN
China
Prior art keywords
data
collaborative
storage
cloud
backed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010208182.7A
Other languages
Chinese (zh)
Inventor
巩书凯
王巧
何荣
易敏
李宏
卢仁谦
江虹锋
江河
刘斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Humi Network Technology Co Ltd
Original Assignee
Chongqing Humi Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Humi Network Technology Co Ltd filed Critical Chongqing Humi Network Technology Co Ltd
Priority to CN202010208182.7A priority Critical patent/CN111309528A/en
Publication of CN111309528A publication Critical patent/CN111309528A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

The invention discloses a data collaborative backup system based on cloud computing and distributed storage, which comprises a multi-cloud processor, a cloud storage and a plurality of collaborative user sides, wherein each collaborative user side is provided with a collaborative storage space. The invention also discloses a corresponding data collaborative backup method based on cloud computing and distributed storage, which comprises the following steps: the cloud processor acquires data to be backed up, and allocates and stores a cooperative storage space for the data to be backed up; and the cloud processor generates a storage record of the data to be backed up and stores the storage record into a cloud storage. According to the cloud storage system and the data backup method, the storage space of the user side needing to backup data is utilized to provide data backup for other users, only data backup records need to be stored in the cloud storage, the size of the data stored in the cloud storage is greatly reduced, and the hardware requirement of the cloud backup is reduced. And because the data are dispersedly stored in each user side, even if the data of a certain cooperative storage space is leaked, no serious result is caused.

Description

Data collaborative backup system and method based on cloud computing and distributed storage
Technical Field
The invention relates to the technical field of data storage, in particular to a data collaborative backup system and method based on cloud computing and distributed storage.
Background
Cloud Computing (Cloud Computing) is a kind of distributed Computing, and means that a huge data Computing processing program is decomposed into countless small programs through a network "Cloud", and then the small programs are processed and analyzed by a system composed of a plurality of servers to obtain results and are returned to a user. In the current stage, cloud computing is not just distributed computing, but is a result of hybrid evolution and leap of computer technologies such as distributed computing, utility computing, load balancing, parallel computing, network storage, hot backup redundancy, virtualization and the like through continuous progress.
The cloud disk is a successful product for the successful development of cloud computing, and provides services such as information storage, reading, downloading and the like for enterprises and individuals through the Internet. Has the characteristics of safety, stability and mass storage. Compared with the traditional physical disk, the method is more convenient, and a user does not need to bring the physical disk for storing important data on the body. Therefore, cloud disks are an important means for data backup. However, in the prior art, data backed up by each user through a cloud disk is stored in the same centralized database, which puts extremely high requirements on hardware conditions of the database, and because all data are stored in a centralized manner, when information leakage occurs in the database, a great loss is caused.
Therefore, how to reduce the hardware requirement on the backup device and improve the security of data backup becomes a problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to solve the problems that: how to reduce the hardware requirement on backup equipment during data backup and improve the safety of data backup.
The invention adopts the following technical scheme:
a data collaborative backup system based on cloud computing and distributed storage comprises a multi-cloud processor, a cloud storage and a plurality of collaborative user sides, wherein the cloud processor is respectively in communication connection with the cloud storage and each collaborative user side, and each collaborative user side is provided with a collaborative storage space.
A data collaborative backup method based on cloud computing and distributed storage is realized by the data collaborative backup system based on cloud computing and distributed storage, and comprises the following steps:
s1, the cloud processor acquires data to be backed up uploaded by any one collaborative user side;
s2, the cloud processor allocates a collaborative storage space for the data to be backed up, wherein the collaborative storage space does not belong to a collaborative user side for uploading the data to be backed up;
s3, the cloud processor sends the data to be backed up to the distributed collaborative storage space for storage;
and S4, the cloud processor generates a storage record of the data to be backed up and stores the storage record into a cloud storage.
Preferably, step S2 includes:
s2011, comparing the size of the available space of a cooperative storage space with the size of the data to be backed up by the cloud processor, wherein the cooperative storage space does not belong to a cooperative user side uploading the data to be backed up;
s2012, if the size of the available space of the cooperative storage space is smaller than or equal to the size of the data to be backed up, allocating the cooperative storage space to the data to be backed up.
Preferably, step S2 includes:
s2021, the cloud processor divides the data to be backed up into a plurality of sub-data based on a preset rule;
s2022, comparing the size of an available space of a collaborative storage space with the size of the subdata by the cloud processor, wherein the collaborative storage space does not belong to a collaborative user side uploading the data to be backed up, and the number of the collaborative storage spaces is equal to the number of the subdata;
s2023, if the size of the available space of the collaborative storage space is smaller than or equal to the size of the sub-data, allocating the collaborative storage space to the sub-data.
Preferably, when the size of the available space of the collaborative storage space of any collaborative user side changes, the collaborative user side sends the size information of the available space to the cloud processor, and the cloud processor stores the size information of the available space in the cloud database; and when the cloud processor needs to allocate the cooperative storage space for the data to be backed up, calling the size information of the available space stored in the cloud database.
Preferably, in step S2, the cloud processor allocates first to nth target collaborative storage spaces for the data to be backed up, where N is greater than or equal to 2, the first to nth target collaborative storage spaces respectively belong to different collaborative clients, and the first to nth target collaborative storage spaces store the same data to be backed up.
Preferably, when the data to be backed up in any one target collaborative storage space is damaged, the cloud processor allocates a new target collaborative storage space for the data to be backed up, the number of the new target collaborative storage space is equal to the number of the target collaborative storage space in which the data to be backed up is damaged, and the cloud processor calls the data to be backed up and stores the data to be backed up into the new target storage collaborative space.
In summary, the present invention discloses a data collaborative backup system based on cloud computing and distributed storage, which includes a multi-cloud processor, a cloud storage, and a plurality of collaborative user terminals, where the cloud processor is respectively in communication connection with the cloud storage and each collaborative user terminal, and each collaborative user terminal is provided with a collaborative storage space. The invention also discloses a corresponding data collaborative backup method based on cloud computing and distributed storage, which comprises the following steps: s1, the cloud processor acquires data to be backed up uploaded by any one collaborative user side; s2, the cloud processor allocates a collaborative storage space for the data to be backed up, wherein the collaborative storage space does not belong to a collaborative user side for uploading the data to be backed up; s3, the cloud processor sends the data to be backed up to the distributed collaborative storage space for storage; and S4, the cloud processor generates a storage record of the data to be backed up and stores the storage record into a cloud storage. According to the cloud storage system and the data backup method, the storage space of the user side needing to backup data is utilized to provide data backup for other users, only data backup records need to be stored in the cloud storage, the size of the data stored in the cloud storage is greatly reduced, and the hardware requirement of the cloud backup is reduced. And because the data are dispersedly stored in each user side, even if the data of a certain cooperative storage space is leaked, no serious result is caused.
Drawings
For purposes of promoting a better understanding of the objects, aspects and advantages of the invention, reference will now be made in detail to the present invention as illustrated in the accompanying drawings, in which:
fig. 1 is a schematic structural diagram of a data collaborative backup system based on cloud computing and distributed storage according to the present disclosure;
fig. 2 is a flowchart of a data collaborative backup method based on cloud computing and distributed storage disclosed by the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings.
As shown in fig. 1, the invention discloses a data collaborative backup system based on cloud computing and distributed storage, which includes a multi-cloud processor, a cloud storage, and a plurality of collaborative user terminals, where the cloud processor is respectively in communication connection with the cloud storage and each collaborative user terminal, and each collaborative user terminal is provided with a collaborative storage space.
As shown in fig. 2, the present invention further discloses a data collaborative backup method based on cloud computing and distributed storage, where the data collaborative backup method based on cloud computing and distributed storage is implemented by using the data collaborative backup system based on cloud computing and distributed storage, and the data collaborative backup method based on cloud computing and distributed storage includes the following steps:
s1, the cloud processor acquires data to be backed up uploaded by any one collaborative user side;
s2, the cloud processor allocates a collaborative storage space for the data to be backed up, wherein the collaborative storage space does not belong to a collaborative user side for uploading the data to be backed up;
s3, the cloud processor sends the data to be backed up to the distributed collaborative storage space for storage;
and S4, the cloud processor generates a storage record of the data to be backed up and stores the storage record into a cloud storage.
The storage record comprises the identity information of the user to which the data to be backed up belongs and the position information of the collaborative storage space stored in the storage record.
In the invention, each user terminal needing data backup also takes the own storage space as the backup space of other users, and the idle storage space of each user terminal is fully utilized. According to the cloud storage system and the data backup method, the storage space of the user side needing to backup data is utilized to provide data backup for other users, only data backup records need to be stored in the cloud storage, the size of the data stored in the cloud storage is greatly reduced, and the hardware requirement of the cloud backup is reduced. And because the data are dispersedly stored in each user side, even if the data of a certain cooperative storage space is leaked, no serious result is caused.
In specific implementation, step S2 includes:
s2011, comparing the size of the available space of a cooperative storage space with the size of the data to be backed up by the cloud processor, wherein the cooperative storage space does not belong to a cooperative user side uploading the data to be backed up;
s2012, if the size of the available space of the cooperative storage space is smaller than or equal to the size of the data to be backed up, allocating the cooperative storage space to the data to be backed up.
Therefore, the appropriate cooperative storage space can be reasonably allocated for the data to be backed up, and storage errors caused by insufficient available space of the allocated cooperative storage space are avoided.
In specific implementation, step S2 includes:
s2021, the cloud processor divides the data to be backed up into a plurality of sub-data based on a preset rule;
s2022, comparing the size of an available space of a collaborative storage space with the size of the subdata by the cloud processor, wherein the collaborative storage space does not belong to a collaborative user side uploading the data to be backed up, and the number of the collaborative storage spaces is equal to the number of the subdata;
s2023, if the size of the available space of the collaborative storage space is smaller than or equal to the size of the sub-data, allocating the collaborative storage space to the sub-data.
In order to further implement distributed backup of data, therefore, the data may be divided into a plurality of sub-data according to a preset rule, and the preset rule is set by a worker. For example, all the data to be backed up is divided into M pieces of sub data, or the data to be backed up is divided according to the size of the data to be backed up, and the number of the divided sub data is positively correlated to the size of the data to be backed up. Therefore, even if data in a certain collaborative storage space is leaked, one party acquiring the leaked data can only obtain one sub data, the difficulty of stealing the data by lawbreakers is increased, and the safety of data backup is improved.
In specific implementation, when the size of the available space of the collaborative storage space of any collaborative user side changes, the collaborative user side sends the size information of the available space to the cloud processor, and the cloud processor stores the size information of the available space into the cloud database; and when the cloud processor needs to allocate the cooperative storage space for the data to be backed up, calling the size information of the available space stored in the cloud database.
In order to reasonably allocate the cooperative storage space, the cloud processor needs to compare the size of the available space with the size of the data needing to be stored. Therefore, when the available space size of the collaborative storage space of the collaborative user side changes every time, the collaborative user side sends the available space size information to the cloud processor, and therefore when distribution is needed, the cloud processor can directly call the space size, interaction times of the cloud processor and the user side are reduced, and distribution efficiency is improved.
In specific implementation, in step S2, the cloud processor allocates first to nth target collaborative storage spaces for the data to be backed up, where N is greater than or equal to 2, the first to nth target collaborative storage spaces respectively belong to different collaborative clients, and the first to nth target collaborative storage spaces store the same data to be backed up.
In the invention, a collaborative backup mode is adopted, and a collaborative user side can be a computer, a mobile phone or other electronic equipment with a storage function of a user, so that the collaborative user side which backs up data when the user extracts backup data is in an off-line state, and at the moment, the data extraction delay of the user can be caused. In addition, the mode is equivalent to performing multiple backups, and the backup failure caused by the damage of backup data at a certain position can be avoided.
In specific implementation, when data to be backed up in any one target collaborative storage space is damaged, the cloud processor allocates a new target collaborative storage space for the data to be backed up, the number of the new target collaborative storage spaces is equal to the number of the target collaborative storage spaces where the data to be backed up is damaged, and the cloud processor calls the data to be backed up and stores the data to be backed up into the new target storage collaborative space.
When multiple backups are adopted, in order to ensure the stability of the backup data, the target cooperative storage space is always maintained at a fixed quantity, and when data at a certain position is damaged, data at other positions are adopted to perform backups in a new target cooperative storage space again.
Finally, it is noted that the above-mentioned embodiments illustrate rather than limit the invention, and that, while the invention has been described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (7)

1. A data collaborative backup system based on cloud computing and distributed storage is characterized by comprising a multi-cloud processor, a cloud storage and a plurality of collaborative user sides, wherein the cloud processor is respectively in communication connection with the cloud storage and each collaborative user side, and each collaborative user side is provided with a collaborative storage space.
2. A collaborative data backup method based on cloud computing and distributed storage, which is implemented by using the collaborative data backup system based on cloud computing and distributed storage according to claim 1, and comprises the following steps:
s1, the cloud processor acquires data to be backed up uploaded by any one collaborative user side;
s2, the cloud processor allocates a collaborative storage space for the data to be backed up, wherein the collaborative storage space does not belong to a collaborative user side for uploading the data to be backed up;
s3, the cloud processor sends the data to be backed up to the distributed collaborative storage space for storage;
and S4, the cloud processor generates a storage record of the data to be backed up and stores the storage record into a cloud storage.
3. The cloud computing and distributed storage based data collaborative backup method according to claim 2, wherein the step S2 includes:
s2011, comparing the size of the available space of a cooperative storage space with the size of the data to be backed up by the cloud processor, wherein the cooperative storage space does not belong to a cooperative user side uploading the data to be backed up;
s2012, if the size of the available space of the cooperative storage space is smaller than or equal to the size of the data to be backed up, allocating the cooperative storage space to the data to be backed up.
4. The cloud computing and distributed storage based data collaborative backup method according to claim 2, wherein the step S2 includes:
s2021, the cloud processor divides the data to be backed up into a plurality of sub-data based on a preset rule;
s2022, comparing the size of an available space of a collaborative storage space with the size of the subdata by the cloud processor, wherein the collaborative storage space does not belong to a collaborative user side uploading the data to be backed up, and the number of the collaborative storage spaces is equal to the number of the subdata;
s2023, if the size of the available space of the collaborative storage space is smaller than or equal to the size of the sub-data, allocating the collaborative storage space to the sub-data.
5. The cooperative data backup method based on cloud computing and distributed storage according to claim 3 or 4, wherein when the size of the available space of the cooperative storage space of any cooperative user side changes, the cooperative user side sends the size information of the available space to the cloud processor, and the cloud processor stores the size information of the available space into the cloud database; and when the cloud processor needs to allocate the cooperative storage space for the data to be backed up, calling the size information of the available space stored in the cloud database.
6. The cloud computing and distributed storage based data collaborative backup method according to claim 2, wherein in step S2, the cloud processor allocates first to nth target collaborative storage spaces for the data to be backed up, N is greater than or equal to 2, the first to nth target collaborative storage spaces respectively belong to different collaborative user sides, and the first to nth target collaborative storage spaces store the same data to be backed up.
7. The cooperative data backup method based on cloud computing and distributed storage as claimed in claim 6, wherein when data to be backed up in any one target cooperative storage space is damaged, the cloud processor allocates a new target cooperative storage space for the data to be backed up, the number of the new target cooperative storage spaces is equal to the number of the damaged target cooperative storage spaces of the data to be backed up, and the cloud processor calls the data to be backed up and stores the data to be backed up into the new target storage cooperative storage space.
CN202010208182.7A 2020-03-23 2020-03-23 Data collaborative backup system and method based on cloud computing and distributed storage Pending CN111309528A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010208182.7A CN111309528A (en) 2020-03-23 2020-03-23 Data collaborative backup system and method based on cloud computing and distributed storage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010208182.7A CN111309528A (en) 2020-03-23 2020-03-23 Data collaborative backup system and method based on cloud computing and distributed storage

Publications (1)

Publication Number Publication Date
CN111309528A true CN111309528A (en) 2020-06-19

Family

ID=71158886

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010208182.7A Pending CN111309528A (en) 2020-03-23 2020-03-23 Data collaborative backup system and method based on cloud computing and distributed storage

Country Status (1)

Country Link
CN (1) CN111309528A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930560A (en) * 2020-06-29 2020-11-13 东风汽车集团有限公司 ECU self-learning data backup method and system
WO2022143158A1 (en) * 2020-12-30 2022-07-07 花瓣云科技有限公司 Data backup method, electronic device, data backup system and chip system

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103607418A (en) * 2013-07-25 2014-02-26 上海和辰信息技术有限公司 Large-scale data partitioning system and partitioning method based on cloud service data characteristics
CN104102557A (en) * 2014-06-27 2014-10-15 武汉理工大学 Cloud computing platform data backup method based on clustering
CN104331346A (en) * 2014-11-21 2015-02-04 四川神琥科技有限公司 Data protection method
CN106502826A (en) * 2016-10-19 2017-03-15 广东欧珀移动通信有限公司 Data backup and transmission method and mobile terminal
CN106598782A (en) * 2016-12-05 2017-04-26 安徽建工集团有限公司 Multi-organization collaboration platform-based data backup storage management method
CN107659652A (en) * 2017-09-28 2018-02-02 郑州云海信息技术有限公司 A kind of method and device of cloud backup
CN108139869A (en) * 2015-10-08 2018-06-08 罗伯托焦里有限公司 The backup method and system of DYNAMIC DISTRIBUTION
CN108241555A (en) * 2016-12-26 2018-07-03 阿里巴巴集团控股有限公司 A kind of backup of distributed data base, restoration methods, device and server
CN108710547A (en) * 2018-05-10 2018-10-26 腾讯科技(深圳)有限公司 A kind of data back up method, device, terminal and storage medium
CN109145054A (en) * 2018-08-02 2019-01-04 力当高(上海)智能科技有限公司 A kind of method of managing customer end data
US20200074096A1 (en) * 2018-08-30 2020-03-05 International Business Machines Corporation Enhancing security during access and retrieval of data with multi-cloud storage

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103607418A (en) * 2013-07-25 2014-02-26 上海和辰信息技术有限公司 Large-scale data partitioning system and partitioning method based on cloud service data characteristics
CN104102557A (en) * 2014-06-27 2014-10-15 武汉理工大学 Cloud computing platform data backup method based on clustering
CN104331346A (en) * 2014-11-21 2015-02-04 四川神琥科技有限公司 Data protection method
CN108139869A (en) * 2015-10-08 2018-06-08 罗伯托焦里有限公司 The backup method and system of DYNAMIC DISTRIBUTION
CN106502826A (en) * 2016-10-19 2017-03-15 广东欧珀移动通信有限公司 Data backup and transmission method and mobile terminal
CN106598782A (en) * 2016-12-05 2017-04-26 安徽建工集团有限公司 Multi-organization collaboration platform-based data backup storage management method
CN108241555A (en) * 2016-12-26 2018-07-03 阿里巴巴集团控股有限公司 A kind of backup of distributed data base, restoration methods, device and server
CN107659652A (en) * 2017-09-28 2018-02-02 郑州云海信息技术有限公司 A kind of method and device of cloud backup
CN108710547A (en) * 2018-05-10 2018-10-26 腾讯科技(深圳)有限公司 A kind of data back up method, device, terminal and storage medium
CN109145054A (en) * 2018-08-02 2019-01-04 力当高(上海)智能科技有限公司 A kind of method of managing customer end data
US20200074096A1 (en) * 2018-08-30 2020-03-05 International Business Machines Corporation Enhancing security during access and retrieval of data with multi-cloud storage

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930560A (en) * 2020-06-29 2020-11-13 东风汽车集团有限公司 ECU self-learning data backup method and system
CN111930560B (en) * 2020-06-29 2023-02-28 东风汽车集团有限公司 ECU self-learning data backup method and system
WO2022143158A1 (en) * 2020-12-30 2022-07-07 花瓣云科技有限公司 Data backup method, electronic device, data backup system and chip system

Similar Documents

Publication Publication Date Title
US8849776B2 (en) Method and system for resolving data inconsistency
WO2020220535A1 (en) Data storage method, and related device
CN106997557B (en) Order information acquisition method and device
CN111309528A (en) Data collaborative backup system and method based on cloud computing and distributed storage
CN105282328A (en) Method and device for task prompting during communication
CN111026767B (en) Block chain data storage method and device and hardware equipment
CN110071965B (en) Data center management system based on cloud platform
CN108519856B (en) Data block copy placement method based on heterogeneous Hadoop cluster environment
CN112306655A (en) Task auditing method and device, computer equipment and storage medium
CN108650334A (en) A kind of setting method and device of session failed
CN113655969B (en) Data balanced storage method based on streaming distributed storage system
CN109977168A (en) The method for synchronizing data of database and equipment preloaded based on data page
CN111400105A (en) Database backup method and device
CN111949681A (en) Data aggregation processing device and method and storage medium
CN109669644A (en) A kind of method and apparatus of data storage
CN108958659A (en) A kind of small documents polymerization, device and the medium of distributed memory system
CN105975614A (en) Cluster configuration device and data updating method and device
CN112883121A (en) Data processing method, data processing device, computer equipment and storage medium
CN112632375A (en) Session information processing method, server and storage medium
CN106534234B (en) Relationship chain processing system, method and device
CN111258821A (en) Backup data rapid extraction method based on cloud computing
CN108681494A (en) Backup Data restoring method, device, user equipment and storage medium
CN107704557B (en) Processing method and device for operating mutually exclusive data, computer equipment and storage medium
CN111209061B (en) User information filling method, device, computer equipment and storage medium
CN110442447B (en) Message queue-based load balancing method and device and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200619