CN103415842B - 用于数据管理虚拟化的系统和方法 - Google Patents

用于数据管理虚拟化的系统和方法 Download PDF

Info

Publication number
CN103415842B
CN103415842B CN201180061716.7A CN201180061716A CN103415842B CN 103415842 B CN103415842 B CN 103415842B CN 201180061716 A CN201180061716 A CN 201180061716A CN 103415842 B CN103415842 B CN 103415842B
Authority
CN
China
Prior art keywords
data
time
hash
content
time state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201180061716.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN103415842A (zh
Inventor
A·阿述托什
C·A·普罗文扎诺
D·F·常
P·J·阿伯尔克罗姆比埃
M·穆塔里克
M·A·罗曼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Actifio Inc
Original Assignee
Actifio Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/947,436 external-priority patent/US8904126B2/en
Priority claimed from US12/947,418 external-priority patent/US8402004B2/en
Priority claimed from US12/947,385 external-priority patent/US9858155B2/en
Priority claimed from US12/947,375 external-priority patent/US8843489B2/en
Priority claimed from US12/947,383 external-priority patent/US8396905B2/en
Priority claimed from US12/947,438 external-priority patent/US8299944B2/en
Priority claimed from US12/947,513 external-priority patent/US8417674B2/en
Priority claimed from US12/947,393 external-priority patent/US8788769B2/en
Application filed by Actifio Inc filed Critical Actifio Inc
Publication of CN103415842A publication Critical patent/CN103415842A/zh
Application granted granted Critical
Publication of CN103415842B publication Critical patent/CN103415842B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1453Management of the data involved in backup or backup restore using de-duplication of the data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1456Hardware arrangements for backup
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/064Management of blocks
    • G06F3/0641De-duplication techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0685Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1469Backup restoration techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84Using snapshots, i.e. a logical point-in-time copy of the data
CN201180061716.7A 2010-11-16 2011-11-11 用于数据管理虚拟化的系统和方法 Active CN103415842B (zh)

Applications Claiming Priority (17)

Application Number Priority Date Filing Date Title
US12/947,383 US8396905B2 (en) 2010-11-16 2010-11-16 System and method for improved garbage collection operations in a deduplicated store by tracking temporal relationships among copies
US12/947,383 2010-11-16
US12/947,438 2010-11-16
US12/947,438 US8299944B2 (en) 2010-11-16 2010-11-16 System and method for creating deduplicated copies of data storing non-lossy encodings of data directly in a content addressable store
US12/947,418 2010-11-16
US12/947,418 US8402004B2 (en) 2010-11-16 2010-11-16 System and method for creating deduplicated copies of data by tracking temporal relationships among copies and by ingesting difference data
US12/947,393 US8788769B2 (en) 2010-11-16 2010-11-16 System and method for performing backup or restore operations utilizing difference information and timeline state information
US12/947,436 2010-11-16
US12/947,375 US8843489B2 (en) 2010-11-16 2010-11-16 System and method for managing deduplicated copies of data using temporal relationships among copies
US12/947,375 2010-11-16
US12/947,436 US8904126B2 (en) 2010-11-16 2010-11-16 System and method for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage
US12/947,385 2010-11-16
US12/947,393 2010-11-16
US12/947,513 US8417674B2 (en) 2010-11-16 2010-11-16 System and method for creating deduplicated copies of data by sending difference data between near-neighbor temporal states
US12/947,513 2010-11-16
US12/947,385 US9858155B2 (en) 2010-11-16 2010-11-16 System and method for managing data with service level agreements that may specify non-uniform copying of data
PCT/US2011/060417 WO2012067964A1 (en) 2010-11-16 2011-11-11 Systems and methods for data management virtualization

Publications (2)

Publication Number Publication Date
CN103415842A CN103415842A (zh) 2013-11-27
CN103415842B true CN103415842B (zh) 2016-02-03

Family

ID=46084354

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201180061716.7A Active CN103415842B (zh) 2010-11-16 2011-11-11 用于数据管理虚拟化的系统和方法

Country Status (8)

Country Link
EP (1) EP2643760A4 (ja)
JP (1) JP2013543198A (ja)
KR (1) KR20140051107A (ja)
CN (1) CN103415842B (ja)
AU (1) AU2011329232A1 (ja)
BR (1) BR112013012134A2 (ja)
CA (1) CA2817592A1 (ja)
WO (1) WO2012067964A1 (ja)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8983961B2 (en) 2012-11-29 2015-03-17 International Business Machines Corporation High availability for cloud servers
KR101451807B1 (ko) 2012-12-24 2014-10-22 주식회사 케이티 NoSQL 메타 데이터의 백업 및 복원장치 및 방법
CN104679665A (zh) * 2013-12-02 2015-06-03 中兴通讯股份有限公司 一种实现分布式文件系统块存储的方法及系统
CN104750538B (zh) * 2013-12-27 2020-03-03 伊姆西Ip控股有限责任公司 用于为目标应用提供虚拟存储池的方法和系统
JP6394070B2 (ja) * 2014-05-28 2018-09-26 日本電気株式会社 バックアップシステムおよびバックアップ方法
CN104133852B (zh) * 2014-07-04 2018-03-16 小米科技有限责任公司 网页访问方法、装置、服务器及终端
US20170249218A1 (en) * 2014-09-18 2017-08-31 Hewlett Packard Enterprise Development Lp Data to be backed up in a backup system
WO2016048263A1 (en) 2014-09-22 2016-03-31 Hewlett Packard Enterprise Development Lp Identification of content-defined chunk boundaries
CN104361069A (zh) * 2014-11-07 2015-02-18 广东电子工业研究院有限公司 一种集成本地文件系统的云存储服务方法
AU2016206826A1 (en) * 2015-01-13 2016-12-22 Hewlett Packard Enterprise Development Lp Systems and methods for oprtimized signature comparisons and data replication
CN105068767A (zh) * 2015-08-19 2015-11-18 山东超越数控电子有限公司 一种基于一致性hash算法的全虚拟化存储方法
CN105938457B (zh) * 2016-03-31 2018-10-02 华为技术有限公司 数据的过滤方法、装置及数据读取系统
US10785302B2 (en) * 2016-10-31 2020-09-22 Huawei Technologies Co., Ltd. Systems and methods for unified data management in a communication network
US10346062B2 (en) * 2016-11-16 2019-07-09 International Business Machines Corporation Point-in-time backups via a storage controller to an object storage cloud
US10884984B2 (en) 2017-01-06 2021-01-05 Oracle International Corporation Low-latency direct cloud access with file system hierarchies and semantics
US10846339B2 (en) * 2017-06-20 2020-11-24 Cisco Technology, Inc. Structured schema for temporal graph storage and retrieval
US10572168B2 (en) * 2017-11-16 2020-02-25 International Business Machines Corporation DRAM bank activation management
CN110019097B (zh) * 2017-12-29 2021-09-28 中国移动通信集团四川有限公司 虚拟逻辑副本管理方法、装置、设备及介质
CN111656340B (zh) * 2018-07-06 2023-07-18 斯诺弗雷克公司 在数据库系统中的数据复制和数据故障转移
US10705927B2 (en) * 2018-07-19 2020-07-07 Hewlett Packard Enterprise Development Lp Freeze a volume of a replication set and unfreeze the volume based on at least one of a snapshot permit message, a snapshot abort message, and expiration of a timeout
US11573892B2 (en) * 2019-04-26 2023-02-07 EMC IP Holding Company LLC Garbage collection for a deduplicated cloud tier using microservices
CN112699097B (zh) * 2020-12-31 2024-03-08 北京浩瀚深度信息技术股份有限公司 一种多元策略镜像实现方法、装置及存储介质
US11922047B2 (en) * 2021-09-16 2024-03-05 EMC IP Holding Company LLC Using RPO as an optimization target for DataDomain garbage collection
CN114218014B (zh) * 2021-12-21 2022-07-19 中科豪联(杭州)技术有限公司 基于存储卷级的虚拟服务器备份及还原方法
CN116088770B (zh) * 2023-03-20 2023-07-14 苏州浪潮智能科技有限公司 数据管理方法及装置、系统、电子设备、存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101710323A (zh) * 2008-09-11 2010-05-19 威睿公司 计算机存储去复制操作

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020049778A1 (en) * 2000-03-31 2002-04-25 Bell Peter W. System and method of information outsourcing
JP2003202964A (ja) * 2002-01-09 2003-07-18 Hitachi Ltd 計算機システムの制御方法、計算機システム、記憶装置の制御方法及び記憶装置
US7734603B1 (en) * 2006-01-26 2010-06-08 Netapp, Inc. Content addressable storage array element
US8311988B2 (en) * 2006-08-04 2012-11-13 Apple Inc. Consistent back up of electronic information
JP5275692B2 (ja) * 2007-10-24 2013-08-28 株式会社日立製作所 ストレージシステム群
US7797279B1 (en) * 2007-12-31 2010-09-14 Emc Corporation Merging of incremental data streams with prior backed-up data
JP5313600B2 (ja) * 2008-09-16 2013-10-09 株式会社日立製作所 ストレージシステム、及びストレージシステムの運用方法
US8701106B2 (en) * 2008-11-30 2014-04-15 Red Hat Israel, Ltd. Hashing storage images of a virtual machine

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101710323A (zh) * 2008-09-11 2010-05-19 威睿公司 计算机存储去复制操作

Also Published As

Publication number Publication date
CN103415842A (zh) 2013-11-27
WO2012067964A1 (en) 2012-05-24
AU2011329232A1 (en) 2013-06-06
EP2643760A1 (en) 2013-10-02
BR112013012134A2 (pt) 2016-09-27
KR20140051107A (ko) 2014-04-30
JP2013543198A (ja) 2013-11-28
EP2643760A4 (en) 2015-09-30
CA2817592A1 (en) 2012-05-24

Similar Documents

Publication Publication Date Title
CN103415842B (zh) 用于数据管理虚拟化的系统和方法
CN104769555A (zh) 增强型数据管理虚拟化系统
US9372758B2 (en) System and method for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage
US10275474B2 (en) System and method for managing deduplicated copies of data using temporal relationships among copies
US8299944B2 (en) System and method for creating deduplicated copies of data storing non-lossy encodings of data directly in a content addressable store
US9372866B2 (en) System and method for creating deduplicated copies of data by sending difference data between near-neighbor temporal states
US9384207B2 (en) System and method for creating deduplicated copies of data by tracking temporal relationships among copies using higher-level hash structures
US8396905B2 (en) System and method for improved garbage collection operations in a deduplicated store by tracking temporal relationships among copies
US8788769B2 (en) System and method for performing backup or restore operations utilizing difference information and timeline state information
US9858155B2 (en) System and method for managing data with service level agreements that may specify non-uniform copying of data
JP2016524220A (ja) 効率的なデータ複製及びガベージコレクション予測
US11816001B2 (en) Managing structured data in a data storage system
US11669261B2 (en) Skipping data backed up in prior backup operations
US20220179985A1 (en) User entitlement management system
US20220261321A1 (en) Automatic failover of a storage manager

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant