CN103238140B - 基于去重复的存储系统中用于可扩展引用管理的系统和方法 - Google Patents

基于去重复的存储系统中用于可扩展引用管理的系统和方法 Download PDF

Info

Publication number
CN103238140B
CN103238140B CN201180050077.4A CN201180050077A CN103238140B CN 103238140 B CN103238140 B CN 103238140B CN 201180050077 A CN201180050077 A CN 201180050077A CN 103238140 B CN103238140 B CN 103238140B
Authority
CN
China
Prior art keywords
file
container
storage
storage container
reference list
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201180050077.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN103238140A (zh
Inventor
F·郭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gen Digital Inc
Original Assignee
Symantec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Symantec Corp filed Critical Symantec Corp
Priority to CN201610032143.XA priority Critical patent/CN105718548B/zh
Publication of CN103238140A publication Critical patent/CN103238140A/zh
Application granted granted Critical
Publication of CN103238140B publication Critical patent/CN103238140B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/1727—Details of free space management performed by the file system
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1453—Management of the data involved in backup or backup restore using de-duplication of the data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1469—Backup restoration techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201180050077.4A 2010-09-03 2011-08-31 基于去重复的存储系统中用于可扩展引用管理的系统和方法 Active CN103238140B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610032143.XA CN105718548B (zh) 2010-09-03 2011-08-31 基于去重复存储系统中用于可扩展引用管理的系统和方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/875,815 US8392376B2 (en) 2010-09-03 2010-09-03 System and method for scalable reference management in a deduplication based storage system
US12/875815 2010-09-03
PCT/US2011/050101 WO2012031047A1 (en) 2010-09-03 2011-08-31 System and method for scalable reference management in a deduplication based storage system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201610032143.XA Division CN105718548B (zh) 2010-09-03 2011-08-31 基于去重复存储系统中用于可扩展引用管理的系统和方法

Publications (2)

Publication Number Publication Date
CN103238140A CN103238140A (zh) 2013-08-07
CN103238140B true CN103238140B (zh) 2016-02-17

Family

ID=44645235

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201180050077.4A Active CN103238140B (zh) 2010-09-03 2011-08-31 基于去重复的存储系统中用于可扩展引用管理的系统和方法
CN201610032143.XA Active CN105718548B (zh) 2010-09-03 2011-08-31 基于去重复存储系统中用于可扩展引用管理的系统和方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610032143.XA Active CN105718548B (zh) 2010-09-03 2011-08-31 基于去重复存储系统中用于可扩展引用管理的系统和方法

Country Status (5)

Country Link
US (2) US8392376B2 (https=)
EP (1) EP2612242B1 (https=)
JP (1) JP5732536B2 (https=)
CN (2) CN103238140B (https=)
WO (1) WO2012031047A1 (https=)

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8392376B2 (en) 2010-09-03 2013-03-05 Symantec Corporation System and method for scalable reference management in a deduplication based storage system
US20120216052A1 (en) * 2011-01-11 2012-08-23 Safenet, Inc. Efficient volume encryption
US9021198B1 (en) * 2011-01-20 2015-04-28 Commvault Systems, Inc. System and method for sharing SAN storage
CN102810075B (zh) * 2011-06-01 2014-11-19 英业达股份有限公司 事务型系统处理方法
KR20130046540A (ko) * 2011-10-28 2013-05-08 삼성에스디에스 주식회사 데이터 전송 장치 및 방법
US9367397B1 (en) 2011-12-20 2016-06-14 Emc Corporation Recovering data lost in data de-duplication system
US8996467B2 (en) * 2011-12-29 2015-03-31 Druva Inc. Distributed scalable deduplicated data backup system
US8700634B2 (en) 2011-12-29 2014-04-15 Druva Inc. Efficient deduplicated data storage with tiered indexing
WO2013183083A1 (en) * 2012-06-06 2013-12-12 Hitachi, Ltd. Storage system and storage system management method
CN104380287B (zh) * 2012-06-14 2018-01-26 英派尔科技开发有限公司 数据去重管理
US9880771B2 (en) * 2012-06-19 2018-01-30 International Business Machines Corporation Packing deduplicated data into finite-sized containers
US9141633B1 (en) * 2012-06-27 2015-09-22 Emc Corporation Special markers to optimize access control list (ACL) data for deduplication
WO2014068617A1 (en) * 2012-10-31 2014-05-08 Hitachi, Ltd. Storage apparatus and method for controlling storage apparatus
CN103502957B (zh) * 2012-12-28 2016-07-06 华为技术有限公司 数据处理方法及装置
US9986209B2 (en) * 2013-02-15 2018-05-29 Steven Philip Meyer Method and system for managing data from digital network surveillance cameras
US10275397B2 (en) * 2013-02-22 2019-04-30 Veritas Technologies Llc Deduplication storage system with efficient reference updating and space reclamation
US9361028B2 (en) 2013-05-07 2016-06-07 Veritas Technologies, LLC Systems and methods for increasing restore speeds of backups stored in deduplicated storage systems
US9256612B1 (en) 2013-06-11 2016-02-09 Symantec Corporation Systems and methods for managing references in deduplicating data systems
US9298724B1 (en) 2013-06-14 2016-03-29 Symantec Corporation Systems and methods for preserving deduplication efforts after backup-job failures
WO2015198371A1 (ja) * 2014-06-23 2015-12-30 株式会社日立製作所 ストレージシステム及び記憶制御方法
US10402113B2 (en) 2014-07-31 2019-09-03 Hewlett Packard Enterprise Development Lp Live migration of data
US10540109B2 (en) 2014-09-02 2020-01-21 Hewlett Packard Enterprise Development Lp Serializing access to fault tolerant memory
US10241708B2 (en) 2014-09-25 2019-03-26 Hewlett Packard Enterprise Development Lp Storage of a data chunk with a colliding fingerprint
US10594442B2 (en) 2014-10-24 2020-03-17 Hewlett Packard Enterprise Development Lp End-to-end negative acknowledgment
WO2016122610A1 (en) 2015-01-30 2016-08-04 Hewlett Packard Enterprise Development Lp Preventing data corruption and single point of failure in a fault-tolerant memory
WO2016122642A1 (en) 2015-01-30 2016-08-04 Hewlett Packard Enterprise Development Lp Determine failed components in fault-tolerant memory
WO2016122637A1 (en) 2015-01-30 2016-08-04 Hewlett Packard Enterprise Development Lp Non-idempotent primitives in fault-tolerant memory
US10402261B2 (en) 2015-03-31 2019-09-03 Hewlett Packard Enterprise Development Lp Preventing data corruption and single point of failure in fault-tolerant memory fabrics
US10042854B2 (en) 2015-06-18 2018-08-07 International Business Machines Corporation Detection of data affected by inaccessible storage blocks in a deduplication system
US9965488B2 (en) 2015-06-18 2018-05-08 International Business Machines Corporation Back referencing of deduplicated data
US9965487B2 (en) 2015-06-18 2018-05-08 International Business Machines Corporation Conversion of forms of user data segment IDs in a deduplication system
US10248656B2 (en) 2015-06-18 2019-04-02 International Business Machines Corporation Removal of reference information for storage blocks in a deduplication system
US20170123689A1 (en) * 2015-11-04 2017-05-04 HGST Netherlands B.V. Pipelined Reference Set Construction and Use in Memory Management
US20170123678A1 (en) * 2015-11-04 2017-05-04 HGST Netherlands B.V. Garbage Collection for Reference Sets in Flash Storage Systems
US20170123676A1 (en) * 2015-11-04 2017-05-04 HGST Netherlands B.V. Reference Block Aggregating into a Reference Set for Deduplication in Memory Management
CN105701024B (zh) * 2015-12-31 2018-11-06 华为技术有限公司 一种存储设备及其垃圾数据回收的方法
CN107193686A (zh) * 2016-03-15 2017-09-22 伊姆西公司 用于数据备份的方法及设备
US20180024767A1 (en) 2016-07-19 2018-01-25 Western Digital Technologies, Inc. Reference Set Construction for Data Deduplication
US10417202B2 (en) 2016-12-21 2019-09-17 Hewlett Packard Enterprise Development Lp Storage system deduplication
US10620860B2 (en) * 2017-02-13 2020-04-14 Oracle International Corporation System for storing data in tape volume containers
US10282127B2 (en) 2017-04-20 2019-05-07 Western Digital Technologies, Inc. Managing data in a storage system
US10809928B2 (en) 2017-06-02 2020-10-20 Western Digital Technologies, Inc. Efficient data deduplication leveraging sequential chunks or auxiliary databases
US10389342B2 (en) 2017-06-28 2019-08-20 Hewlett Packard Enterprise Development Lp Comparator
US10503608B2 (en) 2017-07-24 2019-12-10 Western Digital Technologies, Inc. Efficient management of reference blocks used in data deduplication
WO2019037878A1 (en) * 2017-08-25 2019-02-28 Huawei Technologies Co., Ltd. APPARATUS AND METHOD FOR STORING DATA BLOCKS RECEIVED AS DEDPLICATED DATA BLOCKS
US10310765B1 (en) * 2017-08-31 2019-06-04 Amazon Technologies, Inc. Record-oriented data storage for a distributed storage system
CN108196940B (zh) * 2017-12-29 2022-03-11 华为云计算技术有限公司 删除容器的方法和相关设备
US10749958B2 (en) 2018-04-24 2020-08-18 Western Digital Technologies, Inc. Reduced storage of metadata in a distributed encoded storage system
US10474368B1 (en) * 2018-04-24 2019-11-12 Western Digital Technologies, Inc Fast read operation utilizing reduced storage of metadata in a distributed encoded storage system
US10216424B1 (en) * 2018-04-25 2019-02-26 Western Digital Technologies, Inc. Staging of write operations for container-based storage for sequential media
US10579515B1 (en) 2018-09-10 2020-03-03 International Business Machines Corporation Recycling segment pages while preserving integrity of memory addressing
CN109597896B (zh) * 2018-10-19 2023-06-20 上海星佑网络科技有限公司 信息引用方法和装置
US11567913B2 (en) * 2019-04-10 2023-01-31 Veritas Technologies Llc Method and system for improving efficiency in the management of data references
CN112306894B (zh) * 2019-07-29 2025-02-11 腾讯科技（深圳）有限公司 对象引用方法、装置、设备及存储介质
US11392547B2 (en) * 2020-04-09 2022-07-19 Micron Technology, Inc. Using prefix-delete operations for data containers
CN112685334B (zh) * 2020-12-21 2025-05-27 联想(北京)有限公司 一种分块缓存数据的方法、装置及存储介质
US11663234B2 (en) * 2021-04-23 2023-05-30 Hewlett Packard Enterprise Development Lp Storage of a small object representation in a deduplication system
US12253997B2 (en) 2021-12-17 2025-03-18 Hewlett Packard Enterprise Development Lp Data objects in a distributed file system
CN114405003B (zh) * 2021-12-31 2025-06-13 北京像素软件科技股份有限公司 关系称号相关表建立方法、关系称号管理方法和装置
CN116450864B (zh) * 2023-03-15 2026-04-17 阿里巴巴（中国）有限公司 渲染方法、装置、设备及产品
US12367106B1 (en) * 2023-06-28 2025-07-22 Cohesity, Inc. Methods and systems for space reclamation in immutable deduplication systems

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101753428A (zh) * 2008-12-16 2010-06-23 华为终端有限公司 实例标识的信息获取、上报方法及装置、处理系统
CN101814045A (zh) * 2010-04-22 2010-08-25 华中科技大学 一种用于备份服务的数据组织方法

Family Cites Families (95)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5537652A (en) * 1990-08-20 1996-07-16 International Business Machines Corporation Data file directory system and method for writing data file directory information
US5555391A (en) * 1993-12-23 1996-09-10 Unisys Corporation System and method for storing partial blocks of file data in a file cache system by merging partial updated blocks with file block to be written
US5561421A (en) 1994-07-28 1996-10-01 International Business Machines Corporation Access method data compression with system-built generic dictionaries
US5990810A (en) 1995-02-17 1999-11-23 Williams; Ross Neil Method for partitioning a block of data into subblocks and for storing and communcating such subblocks
US5778395A (en) 1995-10-23 1998-07-07 Stac, Inc. System for backing up files from disk volumes on multiple nodes of a computer network
US5794254A (en) 1996-12-03 1998-08-11 Fairbanks Systems Group Incremental computer file backup using a two-step comparison of first two characters in the block and a signature with pre-stored character and signature sets
US6785786B1 (en) 1997-08-29 2004-08-31 Hewlett Packard Development Company, L.P. Data backup and recovery systems
US6141784A (en) 1997-11-26 2000-10-31 International Business Machines Corporation Method and system in a data communications system for the retransmission of only an incorrectly transmitted portion of a data packet
US6151685A (en) * 1998-05-15 2000-11-21 International Business Machines Corporation System and method for recovering a segment directory for a log structured array
GB9811574D0 (en) * 1998-05-30 1998-07-29 Ibm Indexed file system and a method and a mechanism for accessing data records from such a system
US6920537B2 (en) 1998-12-31 2005-07-19 Emc Corporation Apparatus and methods for copying, backing up and restoring logical objects in a computer storage system by transferring blocks out of order or in parallel
US6389433B1 (en) 1999-07-16 2002-05-14 Microsoft Corporation Method and system for automatically merging files into a single instance store
US6513051B1 (en) 1999-07-16 2003-01-28 Microsoft Corporation Method and system for backing up and restoring files stored in a single instance store
US6687815B1 (en) * 2000-02-01 2004-02-03 Sun Microsystems, Inc. Method and apparatus for storing non-volatile configuration information
US6983365B1 (en) 2000-05-05 2006-01-03 Microsoft Corporation Encryption systems and methods for identifying and coalescing identical objects encrypted with different keys
US6886019B1 (en) * 2000-05-15 2005-04-26 International Business Machines Corporation Optimized selection and accessing of stored files to avoid mount and position thrashing
KR100387965B1 (ko) 2000-05-27 2003-06-18 엘지전자 주식회사 사용자 적응적 멀티미디어 서비스 시스템
EP1168174A1 (en) 2000-06-19 2002-01-02 Hewlett-Packard Company, A Delaware Corporation Automatic backup/recovery process
JP4491980B2 (ja) 2001-03-05 2010-06-30 ソニー株式会社 通信処理システム、通信処理方法、および通信端末装置、並びにプログラム
US7146429B2 (en) 2001-03-16 2006-12-05 The Aerospace Corporation Cooperative adaptive web caching routing and forwarding web content data requesting method
US7359920B1 (en) 2001-04-18 2008-04-15 Intellisync Corporation Communication protocol for synchronization of personal information management databases
US20020162021A1 (en) 2001-04-30 2002-10-31 Audebert Yves Louis Gabriel Method and system for establishing a remote connection to a personal security device
US7310644B2 (en) 2001-06-06 2007-12-18 Microsoft Corporation Locating potentially identical objects across multiple computers
US7257643B2 (en) 2002-05-16 2007-08-14 Intel Corporation Method and apparatus to improve network routing
US7213158B2 (en) 2002-06-28 2007-05-01 Lenovo (Singapore) Pte. Ltd. Distributed autonomic backup
US6865655B1 (en) 2002-07-30 2005-03-08 Sun Microsystems, Inc. Methods and apparatus for backing up and restoring data portions stored in client computer systems
US7424514B2 (en) 2002-11-08 2008-09-09 The Regents Of The University Of Michigan Peer-to-peer method and system for performing and managing backups in a network of nodes
US7055008B2 (en) 2003-01-22 2006-05-30 Falconstor Software, Inc. System and method for backing up data
US7478096B2 (en) 2003-02-26 2009-01-13 Burnside Acquisition, Llc History preservation in a computer storage system
US7523139B1 (en) 2003-05-02 2009-04-21 Symantec Operating Corporation Volume server and volume owner communication protocol in a distributed storage management system
US8918316B2 (en) 2003-07-29 2014-12-23 Alcatel Lucent Content identification system
US8280926B2 (en) * 2003-08-05 2012-10-02 Sepaton, Inc. Scalable de-duplication mechanism
JP4354233B2 (ja) 2003-09-05 2009-10-28 株式会社日立製作所 バックアップシステム及び方法
US7555504B2 (en) * 2003-09-23 2009-06-30 Emc Corporation Maintenance of a file version set including read-only and read-write snapshot copies of a production file
CA2452251C (en) 2003-12-04 2010-02-09 Timothy R. Jewell Data backup system and method
US7644167B2 (en) 2004-01-30 2010-01-05 Hewlett-Packard Development Company, L.P. Identifying a service node in a network
US7200604B2 (en) 2004-02-17 2007-04-03 Hewlett-Packard Development Company, L.P. Data de-duplication
US7240236B2 (en) 2004-03-23 2007-07-03 Archivas, Inc. Fixed content distributed data storage using permutation ring encoding
US7320061B2 (en) * 2004-05-10 2008-01-15 Oracle International Corporation Storage optimization for VARRAY columns
US7657581B2 (en) 2004-07-29 2010-02-02 Archivas, Inc. Metadata management for fixed content distributed data storage
US8051252B2 (en) 2005-03-11 2011-11-01 Ross Neil Williams Method and apparatus for detecting the presence of subblocks in a reduced-redundancy storage system
US8356021B2 (en) 2005-03-11 2013-01-15 Ross Neil Williams Method and apparatus for indexing in a reduced-redundancy storage system
US7636767B2 (en) * 2005-11-29 2009-12-22 Cisco Technology, Inc. Method and apparatus for reducing network traffic over low bandwidth links
US7409523B2 (en) 2005-12-16 2008-08-05 Microsoft Corporation Online storage volume shrink
US7352627B2 (en) * 2006-01-03 2008-04-01 Saifon Semiconductors Ltd. Method, system, and circuit for operating a non-volatile memory array
US20070198659A1 (en) 2006-01-25 2007-08-23 Lam Wai T Method and system for storing data
US7454592B1 (en) 2006-02-16 2008-11-18 Symantec Operating Corporation Block-level and hash-based single-instance storage
US7689764B1 (en) 2006-04-13 2010-03-30 Symantec Operating Corporation Network routing of data based on content thereof
US7478113B1 (en) 2006-04-13 2009-01-13 Symantec Operating Corporation Boundaries
US7685459B1 (en) 2006-04-13 2010-03-23 Symantec Operating Corporation Parallel backup
US8862841B2 (en) 2006-04-25 2014-10-14 Hewlett-Packard Development Company, L.P. Method and system for scaleable, distributed, differential electronic-data backup and archiving
US7930557B2 (en) * 2006-05-16 2011-04-19 Autodesk, Inc. Framework for embedding graphical processing unit programs in computer software
US8412682B2 (en) 2006-06-29 2013-04-02 Netapp, Inc. System and method for retrieving and using block fingerprints for data deduplication
US20080104146A1 (en) * 2006-10-31 2008-05-01 Rebit, Inc. System for automatically shadowing encrypted data and file directory structures for a plurality of network-connected computers using a network-attached memory with single instance storage
US8214517B2 (en) 2006-12-01 2012-07-03 Nec Laboratories America, Inc. Methods and systems for quick and efficient data management and/or processing
US20080154989A1 (en) 2006-12-21 2008-06-26 Boxicom, Inc. (Dba 3X Systems) Data backup system and method associated therewith
US7840537B2 (en) * 2006-12-22 2010-11-23 Commvault Systems, Inc. System and method for storing redundant information
US7925798B2 (en) * 2007-01-26 2011-04-12 Lantiq Deutschland Gmbh Data packet processing device
US7672981B1 (en) * 2007-02-28 2010-03-02 Emc Corporation Object classification and indexing of very large name spaces using grid technology
US7865585B2 (en) 2007-03-12 2011-01-04 Citrix Systems, Inc. Systems and methods for providing dynamic ad hoc proxy-cache hierarchies
US7769971B2 (en) 2007-03-29 2010-08-03 Data Center Technologies Replication and restoration of single-instance storage pools
US20080243769A1 (en) 2007-03-30 2008-10-02 Symantec Corporation System and method for exporting data directly from deduplication storage to non-deduplication storage
US8489830B2 (en) 2007-03-30 2013-07-16 Symantec Corporation Implementing read/write, multi-versioned file system on top of backup data
US7783598B1 (en) * 2007-04-27 2010-08-24 Network Appliance, Inc. Avoiding frozen-volume write penalties
US8046509B2 (en) * 2007-07-06 2011-10-25 Prostor Systems, Inc. Commonality factoring for removable media
US20090132616A1 (en) * 2007-10-02 2009-05-21 Richard Winter Archival backup integration
JP5233233B2 (ja) * 2007-10-05 2013-07-10 日本電気株式会社 情報検索システム、情報検索用インデックスの登録装置、情報検索方法及びプログラム
FR2924839B1 (fr) * 2007-12-06 2010-03-19 Agematis Procede de sauvegarde automatique de donnees numeriques conservees en memoire dans une installation informatique, support de donnees lisible par un ordinateur, installation informatique et systeme pour la mise en oeuvre de ce procede
CN101196920B (zh) * 2007-12-21 2011-04-06 北京中星微电子有限公司 基于引用关系的文件配置管理方法和装置
JP4990828B2 (ja) * 2008-03-25 2012-08-01 株式会社日立製作所 ストレージ装置及びこれの制御方法
US8650228B2 (en) 2008-04-14 2014-02-11 Roderick B. Wideman Methods and systems for space management in data de-duplication
US7984022B2 (en) * 2008-04-18 2011-07-19 International Business Machines Corporation Space recovery with storage management coupled with a deduplicating storage system
US8266114B2 (en) * 2008-09-22 2012-09-11 Riverbed Technology, Inc. Log structured content addressable deduplicating storage
US8484162B2 (en) * 2008-06-24 2013-07-09 Commvault Systems, Inc. De-duplication systems and methods for application-specific data
US8176269B2 (en) * 2008-06-30 2012-05-08 International Business Machines Corporation Managing metadata for data blocks used in a deduplication system
US8495316B2 (en) * 2008-08-25 2013-07-23 Symantec Operating Corporation Efficient management of archival images of virtual machines having incremental snapshots
US10642794B2 (en) * 2008-09-11 2020-05-05 Vmware, Inc. Computer storage deduplication
US7992037B2 (en) * 2008-09-11 2011-08-02 Nec Laboratories America, Inc. Scalable secondary storage systems and methods
JP5414223B2 (ja) * 2008-09-16 2014-02-12 株式会社日立ソリューションズ インターネットバックアップにおける転送データ管理システム
US9015181B2 (en) * 2008-09-26 2015-04-21 Commvault Systems, Inc. Systems and methods for managing single instancing data
US8572409B2 (en) 2008-09-26 2013-10-29 Stephen P. Spackman Method and apparatus for non-redundant encrypted storage
US8099572B1 (en) * 2008-09-30 2012-01-17 Emc Corporation Efficient backup and restore of storage objects in a version set
US8751462B2 (en) * 2008-11-14 2014-06-10 Emc Corporation Delta compression after identity deduplication
US8074043B1 (en) * 2009-01-30 2011-12-06 Symantec Corporation Method and apparatus to recover from interrupted data streams in a deduplication system
US20100199065A1 (en) * 2009-02-04 2010-08-05 Hitachi, Ltd. Methods and apparatus for performing efficient data deduplication by metadata grouping
US8205065B2 (en) 2009-03-30 2012-06-19 Exar Corporation System and method for data deduplication
US20100257403A1 (en) 2009-04-03 2010-10-07 Microsoft Corporation Restoration of a system from a set of full and partial delta system snapshots across a distributed system
US8935366B2 (en) 2009-04-24 2015-01-13 Microsoft Corporation Hybrid distributed and cloud backup architecture
US8635184B2 (en) 2009-06-25 2014-01-21 Emc Corporation System and method for providing long-term storage for data
US8612439B2 (en) * 2009-06-30 2013-12-17 Commvault Systems, Inc. Performing data storage operations in a cloud storage environment, including searching, encryption and indexing
US8204862B1 (en) * 2009-10-02 2012-06-19 Symantec Corporation Systems and methods for restoring deduplicated data
US8862559B2 (en) * 2009-10-06 2014-10-14 Dell Products L.P. Scalable mechanism for detection of commonality in a deduplicated data set
US9501365B2 (en) * 2009-12-28 2016-11-22 Netapp, Inc. Cloud-based disaster recovery of backup data and metadata
US8396843B2 (en) * 2010-06-14 2013-03-12 Dell Products L.P. Active file instant cloning
US8392376B2 (en) * 2010-09-03 2013-03-05 Symantec Corporation System and method for scalable reference management in a deduplication based storage system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101753428A (zh) * 2008-12-16 2010-06-23 华为终端有限公司 实例标识的信息获取、上报方法及装置、处理系统
CN101814045A (zh) * 2010-04-22 2010-08-25 华中科技大学 一种用于备份服务的数据组织方法

Also Published As

Publication number Publication date
US8392376B2 (en) 2013-03-05
US20130185259A1 (en) 2013-07-18
US8782011B2 (en) 2014-07-15
CN105718548B (zh) 2019-04-26
EP2612242A1 (en) 2013-07-10
JP2013541083A (ja) 2013-11-07
US20120059800A1 (en) 2012-03-08
EP2612242B1 (en) 2014-10-08
JP5732536B2 (ja) 2015-06-10
CN103238140A (zh) 2013-08-07
WO2012031047A1 (en) 2012-03-08
CN105718548A (zh) 2016-06-29

Similar Documents

Publication Publication Date Title
CN103238140B (zh) 基于去重复的存储系统中用于可扩展引用管理的系统和方法
CN103635900B (zh) 基于时间的数据分割
US10761758B2 (en) Data aware deduplication object storage (DADOS)
US8452739B2 (en) Highly scalable and distributed data de-duplication
US8370315B1 (en) System and method for high performance deduplication indexing
EP2646915B1 (en) Synthetic backups within deduplication storage system
US8108446B1 (en) Methods and systems for managing deduplicated data using unilateral referencing
US9424185B1 (en) Method and system for garbage collection of data storage systems
CN103562914B (zh) 节约资源型扩展文件系统
US10860738B2 (en) Augmented metadata and signatures for objects in object stores
CN103345472A (zh) 基于有限二叉树布隆过滤器的去冗文件系统及其构建方法
CN106201771A (zh) 数据存储系统和数据读写方法
US10229127B1 (en) Method and system for locality based cache flushing for file system namespace in a deduplicating storage system
CN105069111A (zh) 云存储中基于相似性的数据块级数据去重方法
CN103020255A (zh) 分级存储方法和装置
CN110908589A (zh) 数据文件的处理方法、装置、系统和存储介质
US11334247B2 (en) Systems and methods for a scalable de-duplication engine
US9678972B2 (en) Packing deduplicated data in a self-contained deduplicated repository
EP4428706A2 (en) File system metadata deduplication
Goel et al. A detailed review of data deduplication approaches in the cloud and key challenges
CN104484402B (zh) 一种删除重复数据的方法及装置
CN119201841A (zh) 文件系统的管理方法、装置、集群、介质和产品
US11221779B2 (en) Method and system for building content for a de-duplication engine
CN110945483B (zh) 重复数据删除的网络系统和方法
CN111949439B (zh) 基于数据库的数据文件更新方法和装置

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant