CN104272244B - 用于对处理进行调度以实现空间节省的系统、方法 - Google Patents

用于对处理进行调度以实现空间节省的系统、方法 Download PDF

Info

Publication number
CN104272244B
CN104272244B CN201380023646.5A CN201380023646A CN104272244B CN 104272244 B CN104272244 B CN 104272244B CN 201380023646 A CN201380023646 A CN 201380023646A CN 104272244 B CN104272244 B CN 104272244B
Authority
CN
China
Prior art keywords
storage
space saving
storage objects
list
deduplication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201380023646.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN104272244A (zh
Inventor
V·K·达盖
C·约翰斯顿
郑玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NetApp Inc
Original Assignee
NetApp Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NetApp Inc filed Critical NetApp Inc
Publication of CN104272244A publication Critical patent/CN104272244A/zh
Application granted granted Critical
Publication of CN104272244B publication Critical patent/CN104272244B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/119—Details of migration of file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201380023646.5A 2012-03-30 2013-03-11 用于对处理进行调度以实现空间节省的系统、方法 Active CN104272244B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/436,554 US8812456B2 (en) 2012-03-30 2012-03-30 Systems, methods, and computer program products for scheduling processing to achieve space savings
US13/436,554 2012-03-30
PCT/US2013/030279 WO2013148143A1 (en) 2012-03-30 2013-03-11 Systems, methods, and computer program products for scheduling processing to achieve space savings

Publications (2)

Publication Number Publication Date
CN104272244A CN104272244A (zh) 2015-01-07
CN104272244B true CN104272244B (zh) 2017-09-29

Family

ID=49236410

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380023646.5A Active CN104272244B (zh) 2012-03-30 2013-03-11 用于对处理进行调度以实现空间节省的系统、方法

Country Status (4)

Country Link
US (2) US8812456B2 (enExample)
JP (1) JP2015517147A (enExample)
CN (1) CN104272244B (enExample)
WO (1) WO2013148143A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8671265B2 (en) 2010-03-05 2014-03-11 Solidfire, Inc. Distributed data storage system providing de-duplication of data using block identifiers
US9054992B2 (en) 2011-12-27 2015-06-09 Solidfire, Inc. Quality of service policy sets
US9838269B2 (en) 2011-12-27 2017-12-05 Netapp, Inc. Proportional quality of service based on client usage and system metrics
US8996881B2 (en) 2012-04-23 2015-03-31 International Business Machines Corporation Preserving redundancy in data deduplication systems by encryption
US9262428B2 (en) 2012-04-23 2016-02-16 International Business Machines Corporation Preserving redundancy in data deduplication systems by designation of virtual address
US10133747B2 (en) 2012-04-23 2018-11-20 International Business Machines Corporation Preserving redundancy in data deduplication systems by designation of virtual device
US9779103B2 (en) 2012-04-23 2017-10-03 International Business Machines Corporation Preserving redundancy in data deduplication systems
US20150244795A1 (en) 2014-02-21 2015-08-27 Solidfire, Inc. Data syncing in a distributed system
US9565250B2 (en) * 2014-05-30 2017-02-07 Microsoft Technology Licensing, Llc Data transfer service
CN105468733B (zh) * 2015-11-23 2019-04-19 上海爱数信息技术股份有限公司 一种基于源端数据重删的卷复制方法
US10929022B2 (en) * 2016-04-25 2021-02-23 Netapp. Inc. Space savings reporting for storage system supporting snapshot and clones
US10318161B2 (en) * 2016-06-20 2019-06-11 Red Hat Israel, Ltd. Virtual machine initiated memory deduplication
US10664200B2 (en) * 2016-08-30 2020-05-26 International Business Machines Corporation Directing read request with disk deduplication
US10642763B2 (en) 2016-09-20 2020-05-05 Netapp, Inc. Quality of service policy sets
US10255314B2 (en) * 2017-03-16 2019-04-09 International Business Machines Corporation Comparison of block based volumes with ongoing inputs and outputs
US10795861B2 (en) 2018-06-20 2020-10-06 International Business Machines Corporation Online measurement of potential deduplication efficiency
CN109005577B (zh) * 2018-06-29 2021-06-18 歌尔科技有限公司 一种数据访问方法、装置、智能穿戴设备及存储介质
US11010082B2 (en) * 2018-10-31 2021-05-18 EMC IP Holding Company LLC Mechanisms for performing accurate space accounting for volume families
US11221778B1 (en) 2019-04-02 2022-01-11 Pure Storage, Inc. Preparing data for deduplication
US11645013B2 (en) 2019-11-25 2023-05-09 International Business Machines Corporation Managing dispersed storage network background tasks
US12086710B2 (en) 2021-02-09 2024-09-10 Hewlett Packard Enterprise Development Lp Predictive data capacity planning
US11409667B1 (en) * 2021-04-15 2022-08-09 Dell Products, L.P. Method and apparatus for accelerating deduplication processing
US11954331B2 (en) * 2021-10-07 2024-04-09 International Business Machines Corporation Storage system workload scheduling for deduplication
US12141201B2 (en) * 2022-05-27 2024-11-12 Sling TV L.L.C. Detecting content of interest in streaming media

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101916171A (zh) * 2010-07-16 2010-12-15 中国科学院计算技术研究所 一种并发层次式的重复数据消除方法和系统
US8095756B1 (en) * 2009-04-28 2012-01-10 Netapp, Inc. System and method for coordinating deduplication operations and backup operations of a storage volume

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996025801A1 (en) 1995-02-17 1996-08-22 Trustus Pty. Ltd. Method for partitioning a block of data into subblocks and for storing and communicating such subblocks
US8019789B2 (en) 2001-07-03 2011-09-13 Research In Motion Limited System and method of object-oriented persistence
US8280926B2 (en) * 2003-08-05 2012-10-02 Sepaton, Inc. Scalable de-duplication mechanism
US7426617B2 (en) 2004-02-04 2008-09-16 Network Appliance, Inc. Method and system for synchronizing volumes in a continuous data protection system
US8165221B2 (en) 2006-04-28 2012-04-24 Netapp, Inc. System and method for sampling based elimination of duplicate data
US8117464B1 (en) 2008-04-30 2012-02-14 Netapp, Inc. Sub-volume level security for deduplicated data
US8112661B1 (en) 2009-02-02 2012-02-07 Netapp, Inc. Method and system for changing a protection policy for a dataset in a network storage system
US20120311113A1 (en) * 2010-02-10 2012-12-06 Nec Corporation Storage device
US8108447B2 (en) * 2010-03-11 2012-01-31 Symantec Corporation Systems and methods for garbage collection in deduplicated data systems
KR20120072909A (ko) * 2010-12-24 2012-07-04 주식회사 케이티 내용 기반 중복 방지 기능을 가지는 분산 저장 시스템 및 그 오브젝트 저장 방법 및 컴퓨터에 의하여 독출가능한 저장 매체
US8554918B1 (en) * 2011-06-08 2013-10-08 Emc Corporation Data migration with load balancing and optimization

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8095756B1 (en) * 2009-04-28 2012-01-10 Netapp, Inc. System and method for coordinating deduplication operations and backup operations of a storage volume
CN101916171A (zh) * 2010-07-16 2010-12-15 中国科学院计算技术研究所 一种并发层次式的重复数据消除方法和系统

Also Published As

Publication number Publication date
US20140358873A1 (en) 2014-12-04
CN104272244A (zh) 2015-01-07
US9280571B2 (en) 2016-03-08
US20130262404A1 (en) 2013-10-03
JP2015517147A (ja) 2015-06-18
US8812456B2 (en) 2014-08-19
WO2013148143A1 (en) 2013-10-03

Similar Documents

Publication Publication Date Title
CN104272244B (zh) 用于对处理进行调度以实现空间节省的系统、方法
US12282686B2 (en) Performing low latency operations using a distinct set of resources
US12032826B2 (en) Automated selection of functions to reduce storage capacity based on performance requirements
CN106662981B (zh) 存储设备、程序和信息处理方法
US8429307B1 (en) Application aware intelligent storage system
US8639669B1 (en) Method and apparatus for determining optimal chunk sizes of a deduplicated storage system
US9087010B2 (en) Data selection for movement from a source to a target
US8712963B1 (en) Method and apparatus for content-aware resizing of data chunks for replication
US9798629B1 (en) Predicting backup failures due to exceeding the backup window
CN116601596A (zh) 使用数据相似度来选择分段进行垃圾收集
US12008266B2 (en) Efficient read by reconstruction
US9185188B1 (en) Method and system for determining optimal time period for data movement from source storage to target storage
US10649668B2 (en) Systems, methods, and computer program products providing read access in a storage system
US11151030B1 (en) Method for prediction of the duration of garbage collection for backup storage systems
US11893256B2 (en) Partitioning of deduplication domains in storage systems
US12253990B2 (en) Tier-specific data compression
US20220221997A1 (en) Allocating data storage based on aggregate duplicate performance
Cherubini et al. Cognitive storage for big data
US12341537B2 (en) Partitional data compression
Cha et al. Analysis of i/o performance for optimizing software defined storage in cloud integration
Goel et al. Leveraging Data Deduplication Approaches in the Cloud Storage: A Succinct Review
Lin Using similarity in content and access patterns to improve space efficiency and performance in storage systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant