CN103415842B - 用于数据管理虚拟化的系统和方法 - Google Patents
用于数据管理虚拟化的系统和方法 Download PDFInfo
- Publication number
- CN103415842B CN103415842B CN201180061716.7A CN201180061716A CN103415842B CN 103415842 B CN103415842 B CN 103415842B CN 201180061716 A CN201180061716 A CN 201180061716A CN 103415842 B CN103415842 B CN 103415842B
- Authority
- CN
- China
- Prior art keywords
- data
- time
- hash
- content
- time state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1453—Management of the data involved in backup or backup restore using de-duplication of the data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1456—Hardware arrangements for backup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
- G06F3/0641—De-duplication techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data
Applications Claiming Priority (17)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/947,383 US8396905B2 (en) | 2010-11-16 | 2010-11-16 | System and method for improved garbage collection operations in a deduplicated store by tracking temporal relationships among copies |
US12/947,383 | 2010-11-16 | ||
US12/947,438 | 2010-11-16 | ||
US12/947,438 US8299944B2 (en) | 2010-11-16 | 2010-11-16 | System and method for creating deduplicated copies of data storing non-lossy encodings of data directly in a content addressable store |
US12/947,418 | 2010-11-16 | ||
US12/947,418 US8402004B2 (en) | 2010-11-16 | 2010-11-16 | System and method for creating deduplicated copies of data by tracking temporal relationships among copies and by ingesting difference data |
US12/947,393 US8788769B2 (en) | 2010-11-16 | 2010-11-16 | System and method for performing backup or restore operations utilizing difference information and timeline state information |
US12/947,436 | 2010-11-16 | ||
US12/947,375 US8843489B2 (en) | 2010-11-16 | 2010-11-16 | System and method for managing deduplicated copies of data using temporal relationships among copies |
US12/947,375 | 2010-11-16 | ||
US12/947,436 US8904126B2 (en) | 2010-11-16 | 2010-11-16 | System and method for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage |
US12/947,385 | 2010-11-16 | ||
US12/947,393 | 2010-11-16 | ||
US12/947,513 US8417674B2 (en) | 2010-11-16 | 2010-11-16 | System and method for creating deduplicated copies of data by sending difference data between near-neighbor temporal states |
US12/947,513 | 2010-11-16 | ||
US12/947,385 US9858155B2 (en) | 2010-11-16 | 2010-11-16 | System and method for managing data with service level agreements that may specify non-uniform copying of data |
PCT/US2011/060417 WO2012067964A1 (en) | 2010-11-16 | 2011-11-11 | Systems and methods for data management virtualization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103415842A CN103415842A (zh) | 2013-11-27 |
CN103415842B true CN103415842B (zh) | 2016-02-03 |
Family
ID=46084354
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201180061716.7A Active CN103415842B (zh) | 2010-11-16 | 2011-11-11 | 用于数据管理虚拟化的系统和方法 |
Country Status (8)
Country | Link |
---|---|
EP (1) | EP2643760A4 (ja) |
JP (1) | JP2013543198A (ja) |
KR (1) | KR20140051107A (ja) |
CN (1) | CN103415842B (ja) |
AU (1) | AU2011329232A1 (ja) |
BR (1) | BR112013012134A2 (ja) |
CA (1) | CA2817592A1 (ja) |
WO (1) | WO2012067964A1 (ja) |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8983961B2 (en) | 2012-11-29 | 2015-03-17 | International Business Machines Corporation | High availability for cloud servers |
KR101451807B1 (ko) | 2012-12-24 | 2014-10-22 | 주식회사 케이티 | NoSQL 메타 데이터의 백업 및 복원장치 및 방법 |
CN104679665A (zh) * | 2013-12-02 | 2015-06-03 | 中兴通讯股份有限公司 | 一种实现分布式文件系统块存储的方法及系统 |
CN104750538B (zh) * | 2013-12-27 | 2020-03-03 | 伊姆西Ip控股有限责任公司 | 用于为目标应用提供虚拟存储池的方法和系统 |
JP6394070B2 (ja) * | 2014-05-28 | 2018-09-26 | 日本電気株式会社 | バックアップシステムおよびバックアップ方法 |
CN104133852B (zh) * | 2014-07-04 | 2018-03-16 | 小米科技有限责任公司 | 网页访问方法、装置、服务器及终端 |
US20170249218A1 (en) * | 2014-09-18 | 2017-08-31 | Hewlett Packard Enterprise Development Lp | Data to be backed up in a backup system |
WO2016048263A1 (en) | 2014-09-22 | 2016-03-31 | Hewlett Packard Enterprise Development Lp | Identification of content-defined chunk boundaries |
CN104361069A (zh) * | 2014-11-07 | 2015-02-18 | 广东电子工业研究院有限公司 | 一种集成本地文件系统的云存储服务方法 |
AU2016206826A1 (en) * | 2015-01-13 | 2016-12-22 | Hewlett Packard Enterprise Development Lp | Systems and methods for oprtimized signature comparisons and data replication |
CN105068767A (zh) * | 2015-08-19 | 2015-11-18 | 山东超越数控电子有限公司 | 一种基于一致性hash算法的全虚拟化存储方法 |
CN105938457B (zh) * | 2016-03-31 | 2018-10-02 | 华为技术有限公司 | 数据的过滤方法、装置及数据读取系统 |
US10785302B2 (en) * | 2016-10-31 | 2020-09-22 | Huawei Technologies Co., Ltd. | Systems and methods for unified data management in a communication network |
US10346062B2 (en) * | 2016-11-16 | 2019-07-09 | International Business Machines Corporation | Point-in-time backups via a storage controller to an object storage cloud |
US10884984B2 (en) | 2017-01-06 | 2021-01-05 | Oracle International Corporation | Low-latency direct cloud access with file system hierarchies and semantics |
US10846339B2 (en) * | 2017-06-20 | 2020-11-24 | Cisco Technology, Inc. | Structured schema for temporal graph storage and retrieval |
US10572168B2 (en) * | 2017-11-16 | 2020-02-25 | International Business Machines Corporation | DRAM bank activation management |
CN110019097B (zh) * | 2017-12-29 | 2021-09-28 | 中国移动通信集团四川有限公司 | 虚拟逻辑副本管理方法、装置、设备及介质 |
CN111656340B (zh) * | 2018-07-06 | 2023-07-18 | 斯诺弗雷克公司 | 在数据库系统中的数据复制和数据故障转移 |
US10705927B2 (en) * | 2018-07-19 | 2020-07-07 | Hewlett Packard Enterprise Development Lp | Freeze a volume of a replication set and unfreeze the volume based on at least one of a snapshot permit message, a snapshot abort message, and expiration of a timeout |
US11573892B2 (en) * | 2019-04-26 | 2023-02-07 | EMC IP Holding Company LLC | Garbage collection for a deduplicated cloud tier using microservices |
CN112699097B (zh) * | 2020-12-31 | 2024-03-08 | 北京浩瀚深度信息技术股份有限公司 | 一种多元策略镜像实现方法、装置及存储介质 |
US11922047B2 (en) * | 2021-09-16 | 2024-03-05 | EMC IP Holding Company LLC | Using RPO as an optimization target for DataDomain garbage collection |
CN114218014B (zh) * | 2021-12-21 | 2022-07-19 | 中科豪联(杭州)技术有限公司 | 基于存储卷级的虚拟服务器备份及还原方法 |
CN116088770B (zh) * | 2023-03-20 | 2023-07-14 | 苏州浪潮智能科技有限公司 | 数据管理方法及装置、系统、电子设备、存储介质 |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101710323A (zh) * | 2008-09-11 | 2010-05-19 | 威睿公司 | 计算机存储去复制操作 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020049778A1 (en) * | 2000-03-31 | 2002-04-25 | Bell Peter W. | System and method of information outsourcing |
JP2003202964A (ja) * | 2002-01-09 | 2003-07-18 | Hitachi Ltd | 計算機システムの制御方法、計算機システム、記憶装置の制御方法及び記憶装置 |
US7734603B1 (en) * | 2006-01-26 | 2010-06-08 | Netapp, Inc. | Content addressable storage array element |
US8311988B2 (en) * | 2006-08-04 | 2012-11-13 | Apple Inc. | Consistent back up of electronic information |
JP5275692B2 (ja) * | 2007-10-24 | 2013-08-28 | 株式会社日立製作所 | ストレージシステム群 |
US7797279B1 (en) * | 2007-12-31 | 2010-09-14 | Emc Corporation | Merging of incremental data streams with prior backed-up data |
JP5313600B2 (ja) * | 2008-09-16 | 2013-10-09 | 株式会社日立製作所 | ストレージシステム、及びストレージシステムの運用方法 |
US8701106B2 (en) * | 2008-11-30 | 2014-04-15 | Red Hat Israel, Ltd. | Hashing storage images of a virtual machine |
-
2011
- 2011-11-11 CA CA2817592A patent/CA2817592A1/en not_active Abandoned
- 2011-11-11 WO PCT/US2011/060417 patent/WO2012067964A1/en active Application Filing
- 2011-11-11 AU AU2011329232A patent/AU2011329232A1/en not_active Abandoned
- 2011-11-11 KR KR1020137015597A patent/KR20140051107A/ko not_active Application Discontinuation
- 2011-11-11 EP EP11841345.9A patent/EP2643760A4/en not_active Withdrawn
- 2011-11-11 BR BR112013012134A patent/BR112013012134A2/pt not_active IP Right Cessation
- 2011-11-11 JP JP2013539918A patent/JP2013543198A/ja active Pending
- 2011-11-11 CN CN201180061716.7A patent/CN103415842B/zh active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101710323A (zh) * | 2008-09-11 | 2010-05-19 | 威睿公司 | 计算机存储去复制操作 |
Also Published As
Publication number | Publication date |
---|---|
CN103415842A (zh) | 2013-11-27 |
WO2012067964A1 (en) | 2012-05-24 |
AU2011329232A1 (en) | 2013-06-06 |
EP2643760A1 (en) | 2013-10-02 |
BR112013012134A2 (pt) | 2016-09-27 |
KR20140051107A (ko) | 2014-04-30 |
JP2013543198A (ja) | 2013-11-28 |
EP2643760A4 (en) | 2015-09-30 |
CA2817592A1 (en) | 2012-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103415842B (zh) | 用于数据管理虚拟化的系统和方法 | |
CN104769555A (zh) | 增强型数据管理虚拟化系统 | |
US9372758B2 (en) | System and method for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage | |
US10275474B2 (en) | System and method for managing deduplicated copies of data using temporal relationships among copies | |
US8299944B2 (en) | System and method for creating deduplicated copies of data storing non-lossy encodings of data directly in a content addressable store | |
US9372866B2 (en) | System and method for creating deduplicated copies of data by sending difference data between near-neighbor temporal states | |
US9384207B2 (en) | System and method for creating deduplicated copies of data by tracking temporal relationships among copies using higher-level hash structures | |
US8396905B2 (en) | System and method for improved garbage collection operations in a deduplicated store by tracking temporal relationships among copies | |
US8788769B2 (en) | System and method for performing backup or restore operations utilizing difference information and timeline state information | |
US9858155B2 (en) | System and method for managing data with service level agreements that may specify non-uniform copying of data | |
JP2016524220A (ja) | 効率的なデータ複製及びガベージコレクション予測 | |
US11816001B2 (en) | Managing structured data in a data storage system | |
US11669261B2 (en) | Skipping data backed up in prior backup operations | |
US20220179985A1 (en) | User entitlement management system | |
US20220261321A1 (en) | Automatic failover of a storage manager |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |