JP5147979B2 - データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 - Google Patents
データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 Download PDFInfo
- Publication number
- JP5147979B2 JP5147979B2 JP2011207613A JP2011207613A JP5147979B2 JP 5147979 B2 JP5147979 B2 JP 5147979B2 JP 2011207613 A JP2011207613 A JP 2011207613A JP 2011207613 A JP2011207613 A JP 2011207613A JP 5147979 B2 JP5147979 B2 JP 5147979B2
- Authority
- JP
- Japan
- Prior art keywords
- data
- raid
- data storage
- raid array
- rebuild rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
- G06F11/1084—Degraded mode, e.g. caused by single or multiple storage removals or disk failures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Description
よって遂行される。或る実施例では、ステップ440はホスト・コンピュータによって遂行される。
(数式1)
N=(M+1)+M*O
或る実施例では、ステップ450はRAIDコントローラによって遂行される。或る実施例では、ステップ450はホスト・コンピュータによって遂行される。
ステップ410のデータ記憶システムが如何なるデータ記憶装置障害もなく作動している場合、数式1を使ってNが1であると計算される。この例では、本方法は、ステップ420のホスト・データにおける識別された重複データ・ブロック毎に重複排除される。
ステップ410のデータ記憶システムがデータ記憶装置障害を生じたまま作動している場合、およびOが0にセットされる場合、数式1を使ってNが2であると計算される。この例では、本方法は、ステップ420のホスト・データにおける識別された重複データ・ブロックの50パーセントを重複排除する。
ステップ410のデータ記憶システムがデータ記憶装置障害を生じたまま作動している場合、およびOが1にセットされる場合、数式1を使ってNが3であると計算される。この例では、本方法は、ステップ420のホスト・データにおける識別された重複データ・ブロックの33.3パーセントを重複排除する。
Claims (8)
- RAIDアレイとして構成された複数個のデータ記憶装置を含むデータ記憶ライブラリにおいて使用するためのデータ重複排除プロトコルを設定するための、コンピュータに実装される方法であって、
複数個のインターリーブしたデータ・ブロックを含むホスト・データを受け取るステップと、
障害のあるデータ記憶装置の数Mを決定するステップと、
オフセット係数Oの値を設定するステップと、
N=(M+1)+M*O としてNについての値を計算するステップと、
前記ホスト・データにおける識別された重複データ・ブロックをN個のデータ・ブロックごとに重複排除するステップと
を含む、前記方法。 - Mが0に等しいとき、Oを0に等しく設定するステップを更に含む、請求項1に記載の方法。
- Mが1に等しいとき、Oを1に等しく設定するステップを更に含む、請求項1に記載の方法。
- Mが2に等しいとき、Oを2に等しく設定するステップを更に含む、請求項1に記載の方法。
- 最小RAIDアレイ再構築率閾値を設定するステップと、
最大RAIDアレイ再構築率閾値を設定するステップと、
実際のRAIDアレイ再構築率を決定するステップと、
前記実際のRAIDアレイ再構築率が前記最小RAIDアレイ再構築率閾値よりも小さいかどうかを判断するステップと、
前記実際のRAIDアレイ再構築率が前記最小RAIDアレイ再構築率閾値よりも小さいとき、Oを2に等しく設定するステップと
を更に含む、請求項1に記載の方法。 - 前記実際のRAIDアレイ再構築率が前記最小RAIDアレイ再構築率閾値よりも小さくないとき、前記実際のRAIDアレイ再構築率が前記最大RAIDアレイ再構築率閾値よりも小さいかどうかを判断するステップと、
前記実際のRAIDアレイ再構築率が前記最小RAIDアレイ再構築率閾値よりも小さくなく、前記最大RAIDアレイ再構築率閾値よりも小さいとき、Oを1に等しく設定するステップと
を更に含む、請求項5に記載の方法。 - 前記実際のRAIDアレイ再構築率が前記最大RAIDアレイ再構築率閾値よりも小さくない場合、Oを0に等しく設定するステップを更に含む、請求項6に記載の方法。
- RAIDアレイとして構成された複数個のデータ記憶装置を含むデータ記憶ライブラリにおいて使用するためのデータ重複排除プロトコルを設定するためのコンピュータ・プログラムであって、コンピュータに、請求項1〜7のいずれか一項に記載の方法の各ステップを実行させる前記コンピュータ・プログラム。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/046,315 | 2008-03-11 | ||
US12/046,315 US8234444B2 (en) | 2008-03-11 | 2008-03-11 | Apparatus and method to select a deduplication protocol for a data storage library |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2010550113A Division JP4876187B2 (ja) | 2008-03-11 | 2009-02-18 | データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2012043449A JP2012043449A (ja) | 2012-03-01 |
JP5147979B2 true JP5147979B2 (ja) | 2013-02-20 |
Family
ID=40941909
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2010550113A Expired - Fee Related JP4876187B2 (ja) | 2008-03-11 | 2009-02-18 | データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 |
JP2011207613A Expired - Fee Related JP5147979B2 (ja) | 2008-03-11 | 2011-09-22 | データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2010550113A Expired - Fee Related JP4876187B2 (ja) | 2008-03-11 | 2009-02-18 | データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 |
Country Status (6)
Country | Link |
---|---|
US (1) | US8234444B2 (ja) |
EP (1) | EP2255287B1 (ja) |
JP (2) | JP4876187B2 (ja) |
KR (1) | KR20100135765A (ja) |
CN (2) | CN102981922B (ja) |
WO (1) | WO2009112332A2 (ja) |
Families Citing this family (58)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7640746B2 (en) * | 2005-05-27 | 2010-01-05 | Markon Technologies, LLC | Method and system integrating solar heat into a regenerative rankine steam cycle |
US8416954B1 (en) | 2008-09-30 | 2013-04-09 | Emc Corporation | Systems and methods for accessing storage or network based replicas of encrypted volumes with no additional key management |
US8261068B1 (en) | 2008-09-30 | 2012-09-04 | Emc Corporation | Systems and methods for selective encryption of operating system metadata for host-based encryption of data at rest on a logical unit |
US7840537B2 (en) | 2006-12-22 | 2010-11-23 | Commvault Systems, Inc. | System and method for storing redundant information |
US9501355B2 (en) * | 2008-03-31 | 2016-11-22 | International Business Machines Corporation | Storing data and directory information in a distributed storage network |
US9098495B2 (en) | 2008-06-24 | 2015-08-04 | Commvault Systems, Inc. | Application-aware and remote single instance data management |
US8166263B2 (en) | 2008-07-03 | 2012-04-24 | Commvault Systems, Inc. | Continuous data protection over intermittent connections, such as continuous data backup for laptops or wireless devices |
AU2009296695B2 (en) | 2008-09-26 | 2013-08-01 | Commvault Systems, Inc. | Systems and methods for managing single instancing data |
US9015181B2 (en) | 2008-09-26 | 2015-04-21 | Commvault Systems, Inc. | Systems and methods for managing single instancing data |
US8412677B2 (en) | 2008-11-26 | 2013-04-02 | Commvault Systems, Inc. | Systems and methods for byte-level or quasi byte-level single instancing |
US8166314B1 (en) | 2008-12-30 | 2012-04-24 | Emc Corporation | Selective I/O to logical unit when encrypted, but key is not available or when encryption status is unknown |
US8401996B2 (en) | 2009-03-30 | 2013-03-19 | Commvault Systems, Inc. | Storing a variable number of instances of data objects |
US8578120B2 (en) | 2009-05-22 | 2013-11-05 | Commvault Systems, Inc. | Block-level single instancing |
US8156306B1 (en) | 2009-12-18 | 2012-04-10 | Emc Corporation | Systems and methods for using thin provisioning to reclaim space identified by data reduction processes |
US8140821B1 (en) | 2009-12-18 | 2012-03-20 | Emc Corporation | Efficient read/write algorithms and associated mapping for block-level data reduction processes |
US8671265B2 (en) | 2010-03-05 | 2014-03-11 | Solidfire, Inc. | Distributed data storage system providing de-duplication of data using block identifiers |
JP5691234B2 (ja) * | 2010-04-27 | 2015-04-01 | 日本電気株式会社 | ディスクアレイ装置、及び、ミラーリング制御方法 |
JP2010257477A (ja) * | 2010-06-21 | 2010-11-11 | Hitachi Ltd | 記憶制御システム及び同システムの制御方法 |
US8612699B2 (en) | 2010-06-25 | 2013-12-17 | International Business Machines Corporation | Deduplication in a hybrid storage environment |
WO2012045023A2 (en) | 2010-09-30 | 2012-04-05 | Commvault Systems, Inc. | Archiving data objects using secondary copies |
GB2473409B (en) * | 2011-01-17 | 2013-03-13 | Quantum Corp | Cloud-based de-duplication |
JP5742931B2 (ja) * | 2011-03-18 | 2015-07-01 | 富士通株式会社 | ストレージ装置,制御装置及び制御方法 |
US8775376B2 (en) | 2011-06-30 | 2014-07-08 | International Business Machines Corporation | Hybrid data backup in a networked computing environment |
US8620886B1 (en) | 2011-09-20 | 2013-12-31 | Netapp Inc. | Host side deduplication |
US8781800B2 (en) | 2011-11-01 | 2014-07-15 | International Business Machines Corporation | Data de-duplication in computer storage systems |
US9054992B2 (en) | 2011-12-27 | 2015-06-09 | Solidfire, Inc. | Quality of service policy sets |
US9838269B2 (en) | 2011-12-27 | 2017-12-05 | Netapp, Inc. | Proportional quality of service based on client usage and system metrics |
US9020890B2 (en) | 2012-03-30 | 2015-04-28 | Commvault Systems, Inc. | Smart archiving and data previewing for mobile devices |
US9633022B2 (en) | 2012-12-28 | 2017-04-25 | Commvault Systems, Inc. | Backup and restoration for a deduplicated file system |
US9336076B2 (en) | 2013-08-23 | 2016-05-10 | Globalfoundries Inc. | System and method for controlling a redundancy parity encoding amount based on deduplication indications of activity |
US9298386B2 (en) | 2013-08-23 | 2016-03-29 | Globalfoundries Inc. | System and method for improved placement of blocks in a deduplication-erasure code environment |
KR101748717B1 (ko) * | 2013-09-27 | 2017-06-19 | 인하대학교 산학협력단 | Ssd 기반 raid 시스템에서 패리티 데이터의 중복제거 |
US9454434B2 (en) * | 2014-01-17 | 2016-09-27 | Netapp, Inc. | File system driven raid rebuild technique |
US10324897B2 (en) | 2014-01-27 | 2019-06-18 | Commvault Systems, Inc. | Techniques for serving archived electronic mail |
US20150244795A1 (en) | 2014-02-21 | 2015-08-27 | Solidfire, Inc. | Data syncing in a distributed system |
US10242020B2 (en) * | 2014-06-17 | 2019-03-26 | International Business Machines Corporation | Placement of data fragments generated by an erasure code in distributed computational devices based on a deduplication factor |
US10133511B2 (en) | 2014-09-12 | 2018-11-20 | Netapp, Inc | Optimized segment cleaning technique |
US9836229B2 (en) | 2014-11-18 | 2017-12-05 | Netapp, Inc. | N-way merge technique for updating volume metadata in a storage I/O stack |
US9645897B2 (en) | 2015-03-11 | 2017-05-09 | International Business Machines Corporation | Using duplicated data to enhance data security in RAID environments |
US10324914B2 (en) | 2015-05-20 | 2019-06-18 | Commvalut Systems, Inc. | Handling user queries against production and archive storage systems, such as for enterprise customers having large and/or numerous files |
US10929022B2 (en) | 2016-04-25 | 2021-02-23 | Netapp. Inc. | Space savings reporting for storage system supporting snapshot and clones |
US10235396B2 (en) * | 2016-08-29 | 2019-03-19 | International Business Machines Corporation | Workload optimized data deduplication using ghost fingerprints |
US10642763B2 (en) | 2016-09-20 | 2020-05-05 | Netapp, Inc. | Quality of service policy sets |
KR102611571B1 (ko) * | 2016-11-09 | 2023-12-07 | 삼성전자주식회사 | 비휘발성 메모리를 포함하는 raid 시스템 |
US10846178B2 (en) * | 2019-01-11 | 2020-11-24 | EMC IP Holding Company LLC | Hash-based remote rebuild assistance for content addressable storage systems |
US20200241781A1 (en) | 2019-01-29 | 2020-07-30 | Dell Products L.P. | Method and system for inline deduplication using erasure coding |
US11442642B2 (en) | 2019-01-29 | 2022-09-13 | Dell Products L.P. | Method and system for inline deduplication using erasure coding to minimize read and write operations |
US20210034472A1 (en) * | 2019-07-31 | 2021-02-04 | Dell Products L.P. | Method and system for any-point-in-time recovery within a continuous data protection software-defined storage |
US11328071B2 (en) | 2019-07-31 | 2022-05-10 | Dell Products L.P. | Method and system for identifying actor of a fraudulent action during legal hold and litigation |
US11609820B2 (en) | 2019-07-31 | 2023-03-21 | Dell Products L.P. | Method and system for redundant distribution and reconstruction of storage metadata |
US11372730B2 (en) | 2019-07-31 | 2022-06-28 | Dell Products L.P. | Method and system for offloading a continuous health-check and reconstruction of data in a non-accelerator pool |
US11775193B2 (en) | 2019-08-01 | 2023-10-03 | Dell Products L.P. | System and method for indirect data classification in a storage system operations |
JP7413396B2 (ja) * | 2019-10-29 | 2024-01-15 | 積水化成品工業株式会社 | 中空樹脂粒子およびその製造方法 |
US11281535B2 (en) | 2020-03-06 | 2022-03-22 | Dell Products L.P. | Method and system for performing a checkpoint zone operation for a spare persistent storage |
US11416357B2 (en) | 2020-03-06 | 2022-08-16 | Dell Products L.P. | Method and system for managing a spare fault domain in a multi-fault domain data cluster |
US11301327B2 (en) | 2020-03-06 | 2022-04-12 | Dell Products L.P. | Method and system for managing a spare persistent storage device and a spare node in a multi-node data cluster |
US11418326B2 (en) | 2020-05-21 | 2022-08-16 | Dell Products L.P. | Method and system for performing secure data transactions in a data cluster |
US11403175B2 (en) * | 2020-07-31 | 2022-08-02 | EMC IP Holding Company LLC | Rebuilding data previously stored on a failed data storage drive |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5486844A (en) | 1992-05-01 | 1996-01-23 | Radius Inc | Method and apparatus for superimposing displayed images |
DE4323471C2 (de) | 1993-07-14 | 1996-10-17 | Atecom Advanced Telecommunicat | Anordnung und Verfahren zum Bearbeiten von Datenstrukturen bei deren Durchlauf durch einen Netzwerkknoten |
US6453396B1 (en) | 1999-07-14 | 2002-09-17 | Compaq Computer Corporation | System, method and computer program product for hardware assisted backup for a computer mass storage system |
JP3623697B2 (ja) | 1999-07-29 | 2005-02-23 | 富士通株式会社 | ディスク・タイムシェアリング装置及び方法 |
US6647514B1 (en) | 2000-03-23 | 2003-11-11 | Hewlett-Packard Development Company, L.P. | Host I/O performance and availability of a storage array during rebuild by prioritizing I/O request |
US6636878B1 (en) | 2001-01-16 | 2003-10-21 | Sun Microsystems, Inc. | Mechanism for replicating and maintaining files in a spaced-efficient manner |
US7072910B2 (en) * | 2002-03-22 | 2006-07-04 | Network Appliance, Inc. | File folding technique |
JP4322068B2 (ja) * | 2003-03-07 | 2009-08-26 | 富士通株式会社 | ストレージシステム及びそのデイスク負荷バランス制御方法 |
JP4225378B2 (ja) | 2003-12-17 | 2009-02-18 | インターナショナル・ビジネス・マシーンズ・コーポレーション | 複製装置、複製方法、複製プログラム、ブロック識別情報取得プログラム、及び記録媒体 |
US7188212B2 (en) * | 2004-05-06 | 2007-03-06 | International Business Machines Corporation | Method and system for storing data in an array of storage devices with additional and autonomic protection |
JP4324088B2 (ja) | 2004-12-17 | 2009-09-02 | 富士通株式会社 | データ複製制御装置 |
JP2006236001A (ja) * | 2005-02-24 | 2006-09-07 | Nec Corp | ディスクアレイ装置 |
US7401253B2 (en) * | 2005-05-09 | 2008-07-15 | International Business Machines Corporation | Convolution-encoded data storage on a redundant array of independent devices |
JP4690783B2 (ja) | 2005-06-08 | 2011-06-01 | 株式会社日立製作所 | ボリューム管理システムおよびその方法 |
US8165221B2 (en) * | 2006-04-28 | 2012-04-24 | Netapp, Inc. | System and method for sampling based elimination of duplicate data |
US8412682B2 (en) | 2006-06-29 | 2013-04-02 | Netapp, Inc. | System and method for retrieving and using block fingerprints for data deduplication |
US7853750B2 (en) * | 2007-01-30 | 2010-12-14 | Netapp, Inc. | Method and an apparatus to store data patterns |
-
2008
- 2008-03-11 US US12/046,315 patent/US8234444B2/en not_active Expired - Fee Related
-
2009
- 2009-02-18 JP JP2010550113A patent/JP4876187B2/ja not_active Expired - Fee Related
- 2009-02-18 EP EP09719575A patent/EP2255287B1/en active Active
- 2009-02-18 WO PCT/EP2009/051921 patent/WO2009112332A2/en active Application Filing
- 2009-02-18 KR KR1020107021839A patent/KR20100135765A/ko not_active Application Discontinuation
- 2009-02-18 CN CN201210436082.5A patent/CN102981922B/zh not_active Expired - Fee Related
- 2009-02-18 CN CN200980108498.0A patent/CN101971148B/zh not_active Expired - Fee Related
-
2011
- 2011-09-22 JP JP2011207613A patent/JP5147979B2/ja not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
WO2009112332A3 (en) | 2010-02-25 |
WO2009112332A2 (en) | 2009-09-17 |
KR20100135765A (ko) | 2010-12-27 |
JP2012043449A (ja) | 2012-03-01 |
CN102981922A (zh) | 2013-03-20 |
CN102981922B (zh) | 2015-08-26 |
US20090235022A1 (en) | 2009-09-17 |
EP2255287B1 (en) | 2012-11-07 |
JP4876187B2 (ja) | 2012-02-15 |
EP2255287A2 (en) | 2010-12-01 |
US8234444B2 (en) | 2012-07-31 |
CN101971148A (zh) | 2011-02-09 |
CN101971148B (zh) | 2013-04-17 |
JP2011515746A (ja) | 2011-05-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5147979B2 (ja) | データ記憶ライブラリのための重複排除プロトコルを選択する装置および方法 | |
US10613934B2 (en) | Managing RAID parity stripe contention | |
US10360119B2 (en) | Data recovery in a distributed storage system | |
US7979635B2 (en) | Apparatus and method to allocate resources in a data storage library | |
US9389975B2 (en) | Method and apparatus to utilize large capacity disk drives | |
US8984241B2 (en) | Heterogeneous redundant storage array | |
US8719619B2 (en) | Performance enhancement technique for raids under rebuild | |
US11157361B2 (en) | Efficient utilization of storage space in arrays of storage drives | |
US20160170841A1 (en) | Non-Disruptive Online Storage Device Firmware Updating | |
US7962690B2 (en) | Apparatus and method to access data in a raid array | |
US10133640B2 (en) | Storage apparatus and storage system | |
US11748196B2 (en) | Adaptive parity rotation for redundant arrays of independent disks | |
US11080136B2 (en) | Dropped write error detection | |
US10133630B2 (en) | Disposable subset parities for use in a distributed RAID | |
US20210034472A1 (en) | Method and system for any-point-in-time recovery within a continuous data protection software-defined storage |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20120511 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20120626 Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20120626 |
|
TRDD | Decision of grant or rejection written | ||
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20121102 |
|
RD14 | Notification of resignation of power of sub attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7434 Effective date: 20121102 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20121102 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20121127 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 5147979 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20151207 Year of fee payment: 3 |
|
LAPS | Cancellation because of no payment of annual fees |