CN103842987B - 在部分克隆中使用压缩的方法及系统 - Google Patents

在部分克隆中使用压缩的方法及系统 Download PDF

Info

Publication number
CN103842987B
CN103842987B CN201280044922.1A CN201280044922A CN103842987B CN 103842987 B CN103842987 B CN 103842987B CN 201280044922 A CN201280044922 A CN 201280044922A CN 103842987 B CN103842987 B CN 103842987B
Authority
CN
China
Prior art keywords
blocks
group size
variable compression
data
compressed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201280044922.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN103842987A (zh
Inventor
桑迪普·亚达夫
德亚内施沃·帕瓦尔
阿南德·纳塔拉詹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NetApp Inc
Original Assignee
NetApp Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NetApp Inc filed Critical NetApp Inc
Publication of CN103842987A publication Critical patent/CN103842987A/zh
Application granted granted Critical
Publication of CN103842987B publication Critical patent/CN103842987B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/128—Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0613—Improving I/O performance in relation to throughput
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0617—Improving the reliability of storage systems in relation to availability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1453—Management of the data involved in backup or backup restore using de-duplication of the data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201280044922.1A 2011-09-14 2012-09-14 在部分克隆中使用压缩的方法及系统 Expired - Fee Related CN103842987B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/232,216 2011-09-14
US13/232,216 US8866649B2 (en) 2011-09-14 2011-09-14 Method and system for using non-variable compression group size in partial cloning
PCT/US2012/055372 WO2013040329A1 (en) 2011-09-14 2012-09-14 Method and system for using compression in partial cloning

Publications (2)

Publication Number Publication Date
CN103842987A CN103842987A (zh) 2014-06-04
CN103842987B true CN103842987B (zh) 2016-08-17

Family

ID=47830895

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280044922.1A Expired - Fee Related CN103842987B (zh) 2011-09-14 2012-09-14 在部分克隆中使用压缩的方法及系统

Country Status (5)

Country Link
US (1) US8866649B2 (https=)
EP (1) EP2756420A4 (https=)
JP (1) JP2014526749A (https=)
CN (1) CN103842987B (https=)
WO (1) WO2013040329A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160335198A1 (en) * 2015-05-12 2016-11-17 Apple Inc. Methods and system for maintaining an indirection system for a mass storage device
US9760310B2 (en) 2015-08-06 2017-09-12 International Business Machines Corporation High performance data storage management using dynamic compression
US10732881B1 (en) * 2019-01-30 2020-08-04 Hewlett Packard Enterprise Development Lp Region cloning for deduplication
US12547582B2 (en) 2020-03-30 2026-02-10 Pure Storage, Inc. Cloning a managed directory of a file system
US12399869B2 (en) 2020-03-30 2025-08-26 Pure Storage, Inc. Replicating a file system
US12373397B2 (en) 2020-03-30 2025-07-29 Pure Storage, Inc. Managing directory-tree operations in file storage
US12079162B2 (en) 2020-03-30 2024-09-03 Pure Storage, Inc. Snapshot management in a storage system
US12235799B2 (en) 2020-03-30 2025-02-25 Pure Storage, Inc. Optimizing a transfer of a file system
US12541486B2 (en) 2020-03-30 2026-02-03 Pure Storage, Inc. Copying a file system
US11704035B2 (en) 2020-03-30 2023-07-18 Pure Storage, Inc. Unified storage on block containers
CN115688067A (zh) * 2022-09-30 2023-02-03 金航数码科技有限责任公司 一种基于容器的数据存储及访问控制方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6058462A (en) * 1998-01-23 2000-05-02 International Business Machines Corporation Method and apparatus for enabling transfer of compressed data record tracks with CRC checking
CN1310389A (zh) * 2000-02-21 2001-08-29 英业达股份有限公司 计算机硬盘数据复制方法及系统
US6594743B1 (en) * 1999-05-15 2003-07-15 Inventec Corporation Disk-Cloning method and system for cloning computer data from source disk to target disk
US6965897B1 (en) * 2002-10-25 2005-11-15 At&T Corp. Data compression method and apparatus
CN1809813A (zh) * 2003-06-16 2006-07-26 英特尔公司 利用渴望压缩、故障保险提取和重新启动时压缩扫描来存储固件变量的方法
US20060181441A1 (en) * 1998-12-11 2006-08-17 Fallon James J Content independent data compression method and system
US20100079314A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Method and apparatus for compressing and decompressing data

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5630092A (en) * 1994-10-20 1997-05-13 International Business Machines System and method for transferring compressed and uncompressed data between storage systems
US7484007B2 (en) * 2002-02-01 2009-01-27 Codekko Inc. System and method for partial data compression and data transfer
NZ546498A (en) * 2003-10-17 2007-05-31 Pacbyte Software Pty Ltd Data compression system and method
US7756833B2 (en) * 2004-09-22 2010-07-13 Microsoft Corporation Method and system for synthetic backup and restore
US8122191B2 (en) * 2005-02-17 2012-02-21 Overland Storage, Inc. Data protection systems with multiple site replication
US7689630B1 (en) * 2006-03-15 2010-03-30 Richard L. Lam Two-level bitmap structure for bit compression and data management
US20090204650A1 (en) * 2007-11-15 2009-08-13 Attune Systems, Inc. File Deduplication using Copy-on-Write Storage Tiers
US8204854B2 (en) * 2009-03-06 2012-06-19 International Business Machines Corporation Dynamically redirecting a target location during a file I/O operation

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6058462A (en) * 1998-01-23 2000-05-02 International Business Machines Corporation Method and apparatus for enabling transfer of compressed data record tracks with CRC checking
US20060181441A1 (en) * 1998-12-11 2006-08-17 Fallon James J Content independent data compression method and system
US6594743B1 (en) * 1999-05-15 2003-07-15 Inventec Corporation Disk-Cloning method and system for cloning computer data from source disk to target disk
CN1310389A (zh) * 2000-02-21 2001-08-29 英业达股份有限公司 计算机硬盘数据复制方法及系统
US6965897B1 (en) * 2002-10-25 2005-11-15 At&T Corp. Data compression method and apparatus
CN1809813A (zh) * 2003-06-16 2006-07-26 英特尔公司 利用渴望压缩、故障保险提取和重新启动时压缩扫描来存储固件变量的方法
US20100079314A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Method and apparatus for compressing and decompressing data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
具有部分复制功能的数据录入程序;曹义锋;《电脑学习》;19980815(第4期);第46-47页 *

Also Published As

Publication number Publication date
US8866649B2 (en) 2014-10-21
JP2014526749A (ja) 2014-10-06
EP2756420A1 (en) 2014-07-23
EP2756420A4 (en) 2015-03-18
WO2013040329A1 (en) 2013-03-21
US20130067175A1 (en) 2013-03-14
CN103842987A (zh) 2014-06-04

Similar Documents

Publication Publication Date Title
CN103842987B (zh) 在部分克隆中使用压缩的方法及系统
EP4377782B1 (en) Flexible tiering of snapshots to archival storage in remote object stores
US9798496B2 (en) Methods and systems for efficiently storing data
US7809693B2 (en) System and method for restoring data on demand for instant volume restoration
US9798728B2 (en) System performing data deduplication using a dense tree data structure
US7890504B2 (en) Using the LUN type for storage allocation
JP4824085B2 (ja) ネットワークファイルシステムをキャッシュするシステム、及び方法
CN102460439B (zh) 通过条带式文件系统中的容量平衡进行数据分布
US8296260B2 (en) System and method for managing data deduplication of storage systems utilizing persistent consistency point images
US8671445B1 (en) Method and system for transferring replicated information from source storage to destination storage
US7321962B1 (en) Technique for translating a hybrid virtual volume file system into a pure virtual file system data stream
US7243207B1 (en) Technique for translating a pure virtual file system data stream into a hybrid virtual volume
WO2008005211A2 (en) System and method for retrieving and using block fingerprints for data deduplication
CN101218583A (zh) 用于在群集的卷上带区化数据容器内容的存储系统体系结构
CN101473305A (zh) 用于集群环境中的作业的管理的系统和方法
US20190258604A1 (en) System and method for implementing a quota system in a distributed file system
US20170300508A1 (en) System and method for adaptive data placement within a distributed file system
US8918378B1 (en) Cloning using an extent-based architecture
EP1882223B1 (en) System and method for restoring data on demand for instant volume restoration
US12277090B2 (en) Mechanism to maintain data compliance within a distributed file system
US20150261811A1 (en) Methods and systems for detecting data container modification

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: American California

Applicant after: NETAPP incorporated company

Address before: American California

Applicant before: Netapp Inc.

COR Change of bibliographic data
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160817

Termination date: 20180914

CF01 Termination of patent right due to non-payment of annual fee