CN110998537A - 一种过期备份处理方法及备份服务器 - Google Patents

一种过期备份处理方法及备份服务器 Download PDF

Info

Publication number
CN110998537A
CN110998537A CN201780002847.5A CN201780002847A CN110998537A CN 110998537 A CN110998537 A CN 110998537A CN 201780002847 A CN201780002847 A CN 201780002847A CN 110998537 A CN110998537 A CN 110998537A
Authority
CN
China
Prior art keywords
data
backup
disk
storage system
large object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780002847.5A
Other languages
English (en)
Other versions
CN110998537B (zh
Inventor
舒治
侯杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN110998537A publication Critical patent/CN110998537A/zh
Application granted granted Critical
Publication of CN110998537B publication Critical patent/CN110998537B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1453—Management of the data involved in backup or backup restore using de-duplication of the data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1469—Backup restoration techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80—Database-specific techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Retry When Errors Occur (AREA)

Abstract

一种过期备份处理方法，所述方法由备份服务器(130)执行。包括：备份服务器(130)每次确定第一磁盘数据的过期备份后，会创建所述第一磁盘数据的删除日志，并保存所述过期备份中的无效数据的指针至所述删除日志中。所述过期备份为截止当前第一时刻对象存储系统(140)中对所述第一磁盘数据进行的所有未过期备份中的最早备份。如此，后续备份服务器(130)检测满足删除条件后，获取与所述第一磁盘数据对应的多条删除日志，根据删除日志确定包括无效数据和有效数据的大对象，将有效数据移动至另一大对象，并且指示所述对象存储系统(140)删除包括无效数据的大对象，进而对以大对象存储方式进行增量备份的磁盘数据实现过期备份的处理。

Description

PCT国内申请，说明书已公开。

Claims (20)

  1. PCT国内申请，权利要求书已公开。
CN201780002847.5A 2017-12-26 2017-12-26 一种过期备份处理方法及备份服务器 Active CN110998537B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/118689 WO2019127034A1 (zh) 2017-12-26 2017-12-26 一种过期备份处理方法及备份服务器

Publications (2)

Publication Number Publication Date
CN110998537A true CN110998537A (zh) 2020-04-10
CN110998537B CN110998537B (zh) 2022-09-02

Family

ID=67064270

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780002847.5A Active CN110998537B (zh) 2017-12-26 2017-12-26 一种过期备份处理方法及备份服务器

Country Status (5)

Country Link
US (1) US11615000B2 (zh)
EP (1) EP3537302B1 (zh)
JP (1) JP6968876B2 (zh)
CN (1) CN110998537B (zh)
WO (1) WO2019127034A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111597078A (zh) * 2020-05-15 2020-08-28 山东汇贸电子口岸有限公司 一种复制ceph块存储数据至对象存储的定时备份方法及系统
CN116340732A (zh) * 2023-05-29 2023-06-27 天翼云科技有限公司 一种过期数据的自动清理方法、装置及电子设备
CN116661706A (zh) * 2023-07-26 2023-08-29 江苏华存电子科技有限公司 一种固态硬盘的缓存清理分析方法及系统
CN117349086A (zh) * 2023-12-04 2024-01-05 四川精容数安科技有限公司 一种Windows整机永久增量备份的方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11947493B2 (en) * 2022-03-16 2024-04-02 Rubrik, Inc. Techniques for archived log deletion
US11876864B1 (en) * 2023-02-13 2024-01-16 Dell Products L.P. Using predictive analytics on SFP metrics to influence the target port selection process
CN116560914B (zh) * 2023-07-10 2023-10-13 成都云祺科技有限公司 虚拟机cbt失效下的增量备份方法、系统及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101453490A (zh) * 2008-12-23 2009-06-10 上海爱数软件有限公司 一种合成备份方法和装置
CN101937377A (zh) * 2009-06-29 2011-01-05 百度在线网络技术（北京）有限公司 数据恢复方法和装置
US20130173548A1 (en) * 2012-01-02 2013-07-04 International Business Machines Corporation Method and system for backup and recovery
CN103399806A (zh) * 2013-07-26 2013-11-20 安徽省徽商集团有限公司 网络备份更新管理方法及其系统
CN103645971A (zh) * 2013-12-13 2014-03-19 江苏名通信息科技有限公司 Linux系统下文件备份及转移方法
CN105740098A (zh) * 2016-01-26 2016-07-06 浪潮(北京)电子信息产业有限公司 备份数据中过期数据的判定方法及系统

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3632539B2 (ja) * 2000-01-11 2005-03-23 日本電気株式会社 自動バックアップ装置、自動バックアップ方法および自動バックアップ用プログラムを記録した記録媒体
US7756833B2 (en) * 2004-09-22 2010-07-13 Microsoft Corporation Method and system for synthetic backup and restore
US7694088B1 (en) * 2005-03-31 2010-04-06 Symantec Operating Corporation System and method for efficient creation of aggregate backup images
JP4883027B2 (ja) * 2008-02-27 2012-02-22 日本電気株式会社 バックアップ装置、その制御方法及びプログラム
US9367401B2 (en) * 2014-09-30 2016-06-14 Storagecraft Technology Corporation Utilizing an incremental backup in a decremental backup system
US9626250B2 (en) * 2015-03-16 2017-04-18 International Business Machines Corporation Data synchronization of block-level backup
US10942813B2 (en) * 2015-10-30 2021-03-09 Netapp, Inc. Cloud object data layout (CODL)
US10228962B2 (en) * 2015-12-09 2019-03-12 Commvault Systems, Inc. Live synchronization and management of virtual machines across computing and virtualization platforms and using live synchronization to support disaster recovery

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101453490A (zh) * 2008-12-23 2009-06-10 上海爱数软件有限公司 一种合成备份方法和装置
CN101937377A (zh) * 2009-06-29 2011-01-05 百度在线网络技术（北京）有限公司 数据恢复方法和装置
US20130173548A1 (en) * 2012-01-02 2013-07-04 International Business Machines Corporation Method and system for backup and recovery
CN103399806A (zh) * 2013-07-26 2013-11-20 安徽省徽商集团有限公司 网络备份更新管理方法及其系统
CN103645971A (zh) * 2013-12-13 2014-03-19 江苏名通信息科技有限公司 Linux系统下文件备份及转移方法
CN105740098A (zh) * 2016-01-26 2016-07-06 浪潮(北京)电子信息产业有限公司 备份数据中过期数据的判定方法及系统

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111597078A (zh) * 2020-05-15 2020-08-28 山东汇贸电子口岸有限公司 一种复制ceph块存储数据至对象存储的定时备份方法及系统
CN116340732A (zh) * 2023-05-29 2023-06-27 天翼云科技有限公司 一种过期数据的自动清理方法、装置及电子设备
CN116340732B (zh) * 2023-05-29 2023-08-04 天翼云科技有限公司 一种过期数据的自动清理方法、装置及电子设备
CN116661706A (zh) * 2023-07-26 2023-08-29 江苏华存电子科技有限公司 一种固态硬盘的缓存清理分析方法及系统
CN116661706B (zh) * 2023-07-26 2023-11-14 江苏华存电子科技有限公司 一种固态硬盘的缓存清理分析方法及系统
CN117349086A (zh) * 2023-12-04 2024-01-05 四川精容数安科技有限公司 一种Windows整机永久增量备份的方法
CN117349086B (zh) * 2023-12-04 2024-02-23 四川精容数安科技有限公司 一种Windows整机永久增量备份的方法

Also Published As

Publication number Publication date
US11615000B2 (en) 2023-03-28
JP2020506444A (ja) 2020-02-27
EP3537302B1 (en) 2022-01-19
WO2019127034A1 (zh) 2019-07-04
JP6968876B2 (ja) 2021-11-17
EP3537302A4 (en) 2020-01-22
EP3537302A1 (en) 2019-09-11
CN110998537B (zh) 2022-09-02
US20200319976A1 (en) 2020-10-08

Similar Documents

Publication Publication Date Title
CN110998537B (zh) 一种过期备份处理方法及备份服务器
US10013317B1 (en) Restoring a volume in a storage system
US8683156B2 (en) Format-preserving deduplication of data
US9195668B2 (en) Log access method storage control apparatus, archive system, and method of operation
US10599337B2 (en) Method and device for writing data and acquiring data in a distributed storage system
US10303797B1 (en) Clustering files in deduplication systems
US8782011B2 (en) System and method for scalable reference management in a deduplication based storage system
US11625374B2 (en) Eventual consistency in a deduplicated cloud storage system
US9251160B1 (en) Data transfer between dissimilar deduplication systems
US10019323B1 (en) Method and system for container data recovery in a storage system
US9990156B1 (en) Deduplicating snapshots associated with a backup operation
CN111381779B (zh) 数据处理方法、装置、设备及存储介质
US9292520B1 (en) Advanced virtual synthetic full backup synthesized from previous full-backups
US11093442B1 (en) Non-disruptive and efficient migration of data across cloud providers
WO2013086969A1 (zh) 重复数据查找方法、装置及系统
US10437682B1 (en) Efficient resource utilization for cross-site deduplication
US10929176B2 (en) Method of efficiently migrating data from one tier to another with suspend and resume capability
WO2017020576A1 (zh) 一种键值存储系统中文件压实的方法和装置
CN109508254B (zh) 一种数据恢复方法及装置
CN105493080B (zh) 基于上下文感知的重复数据删除的方法和装置
US11093453B1 (en) System and method for asynchronous cleaning of data objects on cloud partition in a file system with deduplication
CN113767378A (zh) 文件系统元数据去重复
US10649807B1 (en) Method to check file data integrity and report inconsistencies with bulk data movement
US20190034282A1 (en) Offline repopulation of cache
CN113821476B (zh) 数据处理方法及装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant