WO2007115317A2 - Storage assignment and erasure coding technique for scalable and fault tolerant storage system - Google Patents

Storage assignment and erasure coding technique for scalable and fault tolerant storage system Download PDF

Info

Publication number
WO2007115317A2
WO2007115317A2 PCT/US2007/065989 US2007065989W WO2007115317A2 WO 2007115317 A2 WO2007115317 A2 WO 2007115317A2 US 2007065989 W US2007065989 W US 2007065989W WO 2007115317 A2 WO2007115317 A2 WO 2007115317A2
Authority
WO
WIPO (PCT)
Prior art keywords
storage
components
block
original
storage elements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2007/065989
Other languages
English (en)
French (fr)
Other versions
WO2007115317A3 (en
Inventor
Norman H. Margolus
Jonathan Coburn
Thomas Jaskiewicz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Permabit Inc
Original Assignee
Permabit Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Permabit Inc filed Critical Permabit Inc
Priority to JP2009504455A priority Critical patent/JP5167243B2/ja
Priority to EP07760124.3A priority patent/EP2158542B1/en
Publication of WO2007115317A2 publication Critical patent/WO2007115317A2/en
Anticipated expiration legal-status Critical
Publication of WO2007115317A3 publication Critical patent/WO2007115317A3/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2094—Redundant storage or storage space
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1096—Parity calculation or recalculation after configuration or reconfiguration of the system
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/1658—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
    • G06F11/1662—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit the resynchronized component or unit being a persistent storage device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1023—Different size disks, i.e. non uniform size of disks in RAID systems with parity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1028—Distributed, i.e. distributed RAID systems with parity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1057—Parity-multiple bits-RAID6, i.e. RAID 6 implementations

Definitions

  • the invention may further comprise determining a block address that uniquely identifies a block of day independently of w here it is stored svuhm the storage .system, encoding tne block of data as a set of K redundant data components, not all of which are needed in aider to reconstruct the block, locating a table entry wuhm the storage assignment table using the block address, identifying the one of the storage elements using the table entry, and storing a one of the set of R redundant data components on the one of the storage elements.
  • the scaling step may comprise performing a non-cyclic shift operation.
  • u may be thai spreading the data evenly across servers is moic important that spreading if evenly across stores. If, however, data is spread in proportion to the product of the aval lahie capacities of paiis of stores, then it in also spread in proportion to the product of the available capacities of pairs of servers, and so both goals are as well as is posMblc.
  • Target values lor the distribution of entries and pairs of entries are not used expiicfly by she algorithm: targets for these arc implicit m ih ⁇ choices that arc considered better oi woise in the operation of the algorithm.
  • the list of candidates for the Replacement store is initially all stores except the Target store. » beiji nl oop 'JPnATS_C0LUKN
  • each component stored at one level is redundantly encoded with some overhead at the next level.
  • the usable capacity C seen at the top level S is computed by 0 decreasing the actual available capacity /t * h> the storage overhead used by tcdundancv at the lop level, in computing/! " , the usable capacities C[i ⁇ of the constituent storage systems SV] play the pale of raw capacities, since the stoiage overhead used io redundantly encode components within S[i] does not appear as usable space at the top ie ⁇ el.
  • the R[P. redundant components representing a block are full replicas of the block (see Figure 4. example I)
  • Stomge of replicas has the advantage of simplicity and allows fast recovery ft am a wngle hardware failure, since no computational work is reeded -o reconstruct stored blocks f i oin icdu ⁇ da ⁇ t components Jt has the disadvantage that the ability to withstand 3U R- i simultaneous * haidwaru failures requnes using R times as much s.otage av JS needed to" a single cop) of everything. 33
  • some of the choices which might be varied and still achieve good over-pairing metrics include: change the order of the preferences governing (he selection of Replacement, change the order of the preferences governing the selection of TheColumn, remove some of the preferences eonsideied, or change the way in which the pairing constraint is computed. The last of these might involve, for example, considering the most-improvm" case before the least-worsening case, or computing the pairing constraint by alternating the two cases, considering only the best pair or least-worst pair at each step, and then eliminating them from consideration at the next step until a single best TheC ⁇ ium ⁇ has been found, oi all pairs have been considered. Higher order evenness metrics could also be applied to the distribution of combinations that appear in the routing table, rather titan just considering pairing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Hardware Redundancy (AREA)
PCT/US2007/065989 2006-04-04 2007-04-04 Storage assignment and erasure coding technique for scalable and fault tolerant storage system Ceased WO2007115317A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2009504455A JP5167243B2 (ja) 2006-04-04 2007-04-04 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法
EP07760124.3A EP2158542B1 (en) 2006-04-04 2007-04-04 Storage assignment and erasure coding technique for scalable and fault tolerant storage system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US78901606P 2006-04-04 2006-04-04
US60/789,016 2006-04-04

Publications (2)

Publication Number Publication Date
WO2007115317A2 true WO2007115317A2 (en) 2007-10-11
WO2007115317A3 WO2007115317A3 (en) 2008-11-20

Family

ID=38564321

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/065989 Ceased WO2007115317A2 (en) 2006-04-04 2007-04-04 Storage assignment and erasure coding technique for scalable and fault tolerant storage system

Country Status (4)

Country Link
US (2) US7979771B2 (https=)
EP (1) EP2158542B1 (https=)
JP (1) JP5167243B2 (https=)
WO (1) WO2007115317A2 (https=)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645978B2 (en) 2011-09-02 2014-02-04 Compuverde Ab Method for data maintenance
US8650365B2 (en) 2011-09-02 2014-02-11 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
US8688630B2 (en) 2008-10-24 2014-04-01 Compuverde Ab Distributed data storage
US8769138B2 (en) 2011-09-02 2014-07-01 Compuverde Ab Method for data retrieval from a distributed data storage system
US8850019B2 (en) 2010-04-23 2014-09-30 Ilt Innovations Ab Distributed data storage
US8997124B2 (en) 2011-09-02 2015-03-31 Compuverde Ab Method for updating data in a distributed data storage system
US9021053B2 (en) 2011-09-02 2015-04-28 Compuverde Ab Method and device for writing data to a data storage system comprising a plurality of data storage nodes
US9626378B2 (en) 2011-09-02 2017-04-18 Compuverde Ab Method for handling requests in a storage system and a storage node for a storage system
US10644726B2 (en) 2013-10-18 2020-05-05 Universite De Nantes Method and apparatus for reconstructing a data block
US12009660B1 (en) 2023-07-11 2024-06-11 T-Mobile Usa, Inc. Predicting space, power, and cooling capacity of a facility to optimize energy usage

Families Citing this family (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7921142B2 (en) * 2007-01-08 2011-04-05 International Business Machines Corporation Method and apparatus for storing and accessing data records on solid state disks
CA2926677C (en) 2007-09-26 2020-07-14 Nicira, Inc. Network operating system for managing and securing networks
US7925927B2 (en) * 2008-06-23 2011-04-12 Hewlett-Packard Development Company, L.P. Simulator for determining data loss in a fault tolerant system
US20100138717A1 (en) * 2008-12-02 2010-06-03 Microsoft Corporation Fork codes for erasure coding of data blocks
US20100174968A1 (en) * 2009-01-02 2010-07-08 Microsoft Corporation Heirarchical erasure coding
JP5637552B2 (ja) * 2009-02-17 2014-12-10 日本電気株式会社 ストレージシステム
CA3204215A1 (en) 2009-04-01 2010-10-07 Nicira, Inc. Method and apparatus for implementing and managing virtual switches
US8275966B2 (en) * 2009-07-30 2012-09-25 Cleversafe, Inc. Dispersed storage network virtual address generations
US8381025B2 (en) * 2009-09-30 2013-02-19 Cleversafe, Inc. Method and apparatus for dispersed storage memory device selection
US10103939B2 (en) 2010-07-06 2018-10-16 Nicira, Inc. Network control apparatus and method for populating logical datapath sets
US8964528B2 (en) 2010-07-06 2015-02-24 Nicira, Inc. Method and apparatus for robust packet distribution among hierarchical managed switching elements
US9525647B2 (en) 2010-07-06 2016-12-20 Nicira, Inc. Network control apparatus and method for creating and modifying logical switching elements
US8718070B2 (en) 2010-07-06 2014-05-06 Nicira, Inc. Distributed network virtualization apparatus and method
US9680750B2 (en) 2010-07-06 2017-06-13 Nicira, Inc. Use of tunnels to hide network addresses
US8433685B2 (en) * 2010-08-18 2013-04-30 Hewlett-Packard Development Company, L.P. Method and system for parity-page distribution among nodes of a multi-node data-storage system
EP2659369B1 (en) * 2010-12-27 2014-10-15 Amplidata NV A distributed object storage system comprising performance optimizations
US9043452B2 (en) 2011-05-04 2015-05-26 Nicira, Inc. Network control apparatus and method for port isolation
US8954787B2 (en) * 2011-05-09 2015-02-10 Cleversafe, Inc. Establishing trust in a maintenance free storage container
US8429162B1 (en) 2011-09-27 2013-04-23 Amazon Technologies, Inc. Facilitating data redistribution in database sharding
US8914706B2 (en) 2011-12-30 2014-12-16 Streamscale, Inc. Using parity data for concurrent data authentication, correction, compression, and encryption
US8683296B2 (en) 2011-12-30 2014-03-25 Streamscale, Inc. Accelerated erasure coding system and method
US8788915B2 (en) * 2012-03-05 2014-07-22 Micron Technology, Inc. Apparatuses and methods for encoding using error protection codes
EP2845100A1 (en) * 2012-05-04 2015-03-11 Thomson Licensing Method of storing a data item in a distributed data storage system, corresponding storage device failure repair method and corresponding devices
CN104583965B (zh) * 2012-08-16 2017-08-11 英派尔科技开发有限公司 将编码数据文件存储在多个文件服务器上
US9037679B2 (en) * 2012-12-31 2015-05-19 Futurewei Technologies, Inc. Efficient high availability storage systems
US9823986B2 (en) 2013-04-30 2017-11-21 Hewlett Packard Enterprise Development Lp Memory node error correction
US9378084B2 (en) 2013-06-25 2016-06-28 Microsoft Technology Licensing, Llc Erasure coding across multiple zones
US9244761B2 (en) 2013-06-25 2016-01-26 Microsoft Technology Licensing, Llc Erasure coding across multiple zones and sub-zones
US9846540B1 (en) * 2013-08-19 2017-12-19 Amazon Technologies, Inc. Data durability using un-encoded copies and encoded combinations
US9626180B2 (en) 2013-12-16 2017-04-18 International Business Machines Corporation Live operating system update mechanisms
US20190056995A1 (en) * 2014-01-31 2019-02-21 International Business Machines Corporation Managing migration of encoded data slices in a dispersed storage network
JP6269120B2 (ja) * 2014-02-06 2018-01-31 日本電気株式会社 ストレージシステム
WO2015161140A1 (en) * 2014-04-16 2015-10-22 The Research Foundation For The State University Of New York System and method for fault-tolerant block data storage
US9575846B2 (en) 2014-07-24 2017-02-21 At&T Intellectual Property I, L.P. Distributed storage of data
US9858325B1 (en) * 2014-09-29 2018-01-02 Amazon Technologies, Inc. Consolidating data in storage host groupings
US10198288B2 (en) 2014-10-30 2019-02-05 Oracle International Corporation System and method for providing a dynamic cloud with subnet administration (SA) query caching
JP6653699B2 (ja) * 2014-10-31 2020-02-26 オラクル・インターナショナル・コーポレイション マルチテナントクラスタ環境においてパーティション認識ルーティングをサポートするためのシステムおよび方法
US12585541B2 (en) 2015-03-31 2026-03-24 Pure Storage, Inc. Recovering data objects encoded with locally decodable code segments
US20170060700A1 (en) * 2015-08-28 2017-03-02 Qualcomm Incorporated Systems and methods for verification of code resiliency for data storage
US20170083603A1 (en) * 2015-09-18 2017-03-23 Qualcomm Incorporated Co-derived data storage patterns for distributed storage systems
US10187310B2 (en) 2015-10-13 2019-01-22 Oracle International Corporation System and method for efficient network isolation and load balancing in a multi-tenant cluster environment
US20230342250A1 (en) * 2015-10-30 2023-10-26 Pure Storage, Inc. Allocating Data in a Decentralized Computer System
US10409514B2 (en) * 2015-11-30 2019-09-10 International Business Machines Corporation IP multicast message transmission for event notifications
US9959179B1 (en) * 2016-03-24 2018-05-01 Veritas Technologies Llc Systems and methods for repairing corrupted data segments
US10776846B2 (en) * 2016-07-27 2020-09-15 Nike, Inc. Assortment optimization
US11169731B2 (en) * 2016-10-31 2021-11-09 International Business Machines Corporation Managing storage resources in a dispersed storage network
US10545805B2 (en) * 2017-03-29 2020-01-28 Macronix International Co., Ltd. Memory system, reading method thereof and writing method thereof
CN109213619B (zh) * 2017-06-30 2022-02-22 伊姆西Ip控股有限责任公司 用于管理存储系统的方法、设备和计算机程序产品
US10545921B2 (en) * 2017-08-07 2020-01-28 Weka.IO Ltd. Metadata control in a load-balanced distributed storage system
US10936453B2 (en) * 2017-09-19 2021-03-02 Seagate Technology Llc Data storage systems using elastic spares
CN110018783B (zh) 2018-01-09 2022-12-20 阿里巴巴集团控股有限公司 一种数据存储方法、装置及系统
US10740181B2 (en) 2018-03-06 2020-08-11 Western Digital Technologies, Inc. Failed storage device rebuild method
US10860446B2 (en) 2018-04-26 2020-12-08 Western Digital Technologiies, Inc. Failed storage device rebuild using dynamically selected locations in overprovisioned space
CN112313628A (zh) 2018-06-01 2021-02-02 微软技术许可有限责任公司 利用重叠的本地重构代码的擦除编码
US10942725B2 (en) * 2018-07-30 2021-03-09 Ford Global Technologies, Llc Over the air Ecu update
US10901848B2 (en) 2018-08-03 2021-01-26 Western Digital Technologies, Inc. Storage systems with peer data recovery
US10831603B2 (en) 2018-08-03 2020-11-10 Western Digital Technologies, Inc. Rebuild assist using failed storage device
US10649843B2 (en) 2018-08-03 2020-05-12 Western Digital Technologies, Inc. Storage systems with peer data scrub
US10824526B2 (en) 2018-08-03 2020-11-03 Western Digital Technologies, Inc. Using failed storage device in peer-to-peer storage system to perform storage-centric task
US11182258B2 (en) 2019-01-04 2021-11-23 Western Digital Technologies, Inc. Data rebuild using dynamic peer work allocation
US11080092B1 (en) 2019-03-27 2021-08-03 Amazon Technologies, Inc. Correlated volume placement in a distributed block storage service
US11048554B1 (en) * 2019-03-27 2021-06-29 Amazon Technologies, Inc. Correlated volume placement in a distributed block storage service
US11210002B2 (en) 2020-01-29 2021-12-28 Samsung Electronics Co., Ltd. Offloaded device-driven erasure coding
TWI810871B (zh) * 2022-03-29 2023-08-01 睿寬智能科技有限公司 交錯式ｒａｉｄ編碼法
CN114415983B (zh) * 2022-03-30 2022-06-07 苏州浪潮智能科技有限公司 一种raid编解码方法、装置、设备及可读存储介质

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2941452C2 (de) 1979-10-12 1982-06-24 Polygram Gmbh, 2000 Hamburg Verfahren zur Codierung von Analogsignalen
US5485474A (en) * 1988-02-25 1996-01-16 The President And Fellows Of Harvard College Scheme for information dispersal and reconstruction
US5499253A (en) * 1994-01-05 1996-03-12 Digital Equipment Corporation System and method for calculating RAID 6 check codes
DE69533764T2 (de) * 1994-06-22 2005-12-01 Hewlett-Packard Development Co., L.P., Houston Verfahren zum Gebrauch von Speicherplatten unterschiedlicher Inhalte in einem Einzelvolumen einer hierarchischen Speicherplattenanordnung
US5615352A (en) * 1994-10-05 1997-03-25 Hewlett-Packard Company Methods for adding storage disks to a hierarchic disk array while maintaining data availability
US5617541A (en) * 1994-12-21 1997-04-01 International Computer Science Institute System for packetizing data encoded corresponding to priority levels where reconstructed data corresponds to fractionalized priority level and received fractionalized packets
JP3358687B2 (ja) * 1995-03-13 2002-12-24 株式会社日立製作所 ディスクアレイ装置
CA2219379A1 (en) * 1995-04-27 1996-10-31 Cadathur V. Chakravarthy High integrity transport for time critical multimedia networking applications
US5845319A (en) * 1995-08-23 1998-12-01 Fujitsu Limited Disk array device which separates local and physical disks using striping and operation mode selection
JP4044160B2 (ja) * 1995-08-23 2008-02-06 富士通株式会社 ディスクアレイ装置
US5790774A (en) * 1996-05-21 1998-08-04 Storage Computer Corporation Data storage system with dedicated allocation of parity storage and parity reads and writes only on operations requiring parity information
US5949993A (en) * 1997-10-31 1999-09-07 Production Languages Corporation Method for the generation of ISA simulators and assemblers from a machine description
US6553420B1 (en) * 1998-03-13 2003-04-22 Massachusetts Institute Of Technology Method and apparatus for distributing requests among a plurality of resources
US6320520B1 (en) * 1998-09-23 2001-11-20 Digital Fountain Information additive group code generator and decoder for communications systems
US6307487B1 (en) * 1998-09-23 2001-10-23 Digital Fountain, Inc. Information additive code generator and decoder for communication systems
JP3454183B2 (ja) 1999-04-13 2003-10-06 日本電気株式会社 ディスクアレイ装置
US7304990B2 (en) * 2000-02-03 2007-12-04 Bandwiz Inc. Method of encoding and transmitting data over a communication medium through division and segmentation
US7062648B2 (en) * 2000-02-18 2006-06-13 Avamar Technologies, Inc. System and method for redundant array network storage
US6607231B2 (en) * 2001-07-23 2003-08-19 Ford Global Technologies, Inc. Liftgate with low-liftover liftglass
WO2004012337A2 (en) * 2002-07-29 2004-02-05 Robert Halford Multi-dimensional data protection and mirroring method for micro level data
US7363346B2 (en) 2002-09-07 2008-04-22 Appistry, Inc. Reliably storing information across multiple computers such as in a hive of computers
US7080229B2 (en) * 2002-10-28 2006-07-18 Network Appliance Inc. Method and system for strategy driven provisioning of storage in a storage area network
US7478096B2 (en) 2003-02-26 2009-01-13 Burnside Acquisition, Llc History preservation in a computer storage system
JP4215606B2 (ja) * 2003-09-24 2009-01-28 日本電気株式会社 ディスクアレイ装置および記憶容量拡張方法ならびにプログラム
US7472334B1 (en) * 2003-10-15 2008-12-30 Scott Thomas P Efficient method for the reconstruction of digital information
US7188226B2 (en) * 2003-10-20 2007-03-06 Hewlett-Packard Development Company, L.P. Defective data site information storage
TWI310497B (en) * 2004-02-06 2009-06-01 Hon Hai Prec Ind Co Ltd System and method for disk fault tolerance
US7240236B2 (en) * 2004-03-23 2007-07-03 Archivas, Inc. Fixed content distributed data storage using permutation ring encoding
EP1797510A2 (en) 2004-10-06 2007-06-20 Permabit, Inc. A storage system for randomly named blocks of data
CA2590361C (en) * 2004-11-05 2012-01-03 Data Robotics Incorporated Dynamically expandable and contractible fault-tolerant storage system permitting variously sized storage devices and method
US7219289B2 (en) * 2005-03-15 2007-05-15 Tandberg Data Corporation Multiply redundant raid system and XOR-efficient method and apparatus for implementing the same
US7577866B1 (en) * 2005-06-27 2009-08-18 Emc Corporation Techniques for fault tolerant data storage

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None
See also references of EP2158542A4

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9329955B2 (en) 2008-10-24 2016-05-03 Compuverde Ab System and method for detecting problematic data storage nodes
US11907256B2 (en) 2008-10-24 2024-02-20 Pure Storage, Inc. Query-based selection of storage nodes
US8688630B2 (en) 2008-10-24 2014-04-01 Compuverde Ab Distributed data storage
US11468088B2 (en) 2008-10-24 2022-10-11 Pure Storage, Inc. Selection of storage nodes for storage of data
US10650022B2 (en) 2008-10-24 2020-05-12 Compuverde Ab Distributed data storage
US9026559B2 (en) 2008-10-24 2015-05-05 Compuverde Ab Priority replication
US9495432B2 (en) 2008-10-24 2016-11-15 Compuverde Ab Distributed data storage
US8850019B2 (en) 2010-04-23 2014-09-30 Ilt Innovations Ab Distributed data storage
US9948716B2 (en) 2010-04-23 2018-04-17 Compuverde Ab Distributed data storage
US9503524B2 (en) 2010-04-23 2016-11-22 Compuverde Ab Distributed data storage
US8997124B2 (en) 2011-09-02 2015-03-31 Compuverde Ab Method for updating data in a distributed data storage system
US10579615B2 (en) 2011-09-02 2020-03-03 Compuverde Ab Method for data retrieval from a distributed data storage system
US9021053B2 (en) 2011-09-02 2015-04-28 Compuverde Ab Method and device for writing data to a data storage system comprising a plurality of data storage nodes
US9626378B2 (en) 2011-09-02 2017-04-18 Compuverde Ab Method for handling requests in a storage system and a storage node for a storage system
US8645978B2 (en) 2011-09-02 2014-02-04 Compuverde Ab Method for data maintenance
US9965542B2 (en) 2011-09-02 2018-05-08 Compuverde Ab Method for data maintenance
US10430443B2 (en) 2011-09-02 2019-10-01 Compuverde Ab Method for data maintenance
US9305012B2 (en) 2011-09-02 2016-04-05 Compuverde Ab Method for data maintenance
US8650365B2 (en) 2011-09-02 2014-02-11 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
US8843710B2 (en) 2011-09-02 2014-09-23 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
US10769177B1 (en) 2011-09-02 2020-09-08 Pure Storage, Inc. Virtual file structure for data storage system
US10909110B1 (en) 2011-09-02 2021-02-02 Pure Storage, Inc. Data retrieval from a distributed data storage system
US11372897B1 (en) 2011-09-02 2022-06-28 Pure Storage, Inc. Writing of data to a storage system that implements a virtual file structure on an unstructured storage layer
US8769138B2 (en) 2011-09-02 2014-07-01 Compuverde Ab Method for data retrieval from a distributed data storage system
US10644726B2 (en) 2013-10-18 2020-05-05 Universite De Nantes Method and apparatus for reconstructing a data block
US12009660B1 (en) 2023-07-11 2024-06-11 T-Mobile Usa, Inc. Predicting space, power, and cooling capacity of a facility to optimize energy usage

Also Published As

Publication number Publication date
EP2158542A2 (en) 2010-03-03
EP2158542A4 (en) 2012-10-10
US20070245083A1 (en) 2007-10-18
JP5167243B2 (ja) 2013-03-21
JP2009532812A (ja) 2009-09-10
US7979771B2 (en) 2011-07-12
US8364891B2 (en) 2013-01-29
WO2007115317A3 (en) 2008-11-20
US20070245082A1 (en) 2007-10-18
EP2158542B1 (en) 2019-06-05

Similar Documents

Publication Publication Date Title
WO2007115317A2 (en) Storage assignment and erasure coding technique for scalable and fault tolerant storage system
Honicky et al. Replication under scalable hashing: A family of algorithms for scalable decentralized data distribution
US9823980B2 (en) Prioritizing data reconstruction in distributed storage systems
EP3839767B1 (en) Efficient data reads from distributed storage systems
KR101148697B1 (ko) 디스크 어레이 전체에서의 패리티 분배 방법 및 저장시스템의 디스크들 전체에서의 패리티 분배 시스템
US7054927B2 (en) File system metadata describing server directory information
US7386757B2 (en) Method and apparatus for enabling high-reliability storage of distributed data on a plurality of independent storage devices
US7096328B2 (en) Pseudorandom data storage
US20020174296A1 (en) Disk replacement via hot swapping with variable parity
US20020124137A1 (en) Enhancing disk array performance via variable parity based load balancing
Huang et al. Scale-RS: An efficient scaling scheme for RS-coded storage clusters
US7346831B1 (en) Parity assignment technique for parity declustering in a parity array of a storage system
EP1695271A2 (en) Uniform and symmetric double failure correcting technique for protecting against two disk failures in a disk array
Xu et al. Deterministic data distribution for efficient recovery in erasure-coded storage systems
Li et al. D3: Deterministic data distribution for efficient data reconstruction in erasure-coded distributed storage systems
Miranda et al. Reliable and randomized data distribution strategies for large scale storage systems
Li et al. Relieving both storage and recovery burdens in big data clusters with R-STAIR codes
Schwarz et al. RESAR: Reliable storage at exabyte scale
Chen et al. Replication and retrieval strategies of multidimensional data on parallel disks
CN111694509A (zh) 存储空间的自动配置的设备和方法
Brinkmann et al. Redundant data placement strategies for cluster storage environments
Niu et al. DRBoost: Boosting Degraded Read Performance in MSR-Coded Storage Clusters
Dau et al. Parity declustering for fault-tolerant storage systems via t-designs
Ahn et al. Dynamic erasure coding decision for modern block-oriented distributed storage systems
US11630596B1 (en) Sharing spare capacity of disks with multiple sizes to parallelize RAID rebuild

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07760124

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2009504455

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2007760124

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE