JP2009532812A5 - - Google Patents

Download PDF

Info

Publication number
JP2009532812A5
JP2009532812A5 JP2009504455A JP2009504455A JP2009532812A5 JP 2009532812 A5 JP2009532812 A5 JP 2009532812A5 JP 2009504455 A JP2009504455 A JP 2009504455A JP 2009504455 A JP2009504455 A JP 2009504455A JP 2009532812 A5 JP2009532812 A5 JP 2009532812A5
Authority
JP
Japan
Prior art keywords
storage
available capacity
storage system
allocation table
storage elements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2009504455A
Other languages
English (en)
Japanese (ja)
Other versions
JP2009532812A (ja
JP5167243B2 (ja
Filing date
Publication date
Application filed filed Critical
Priority claimed from PCT/US2007/065989 external-priority patent/WO2007115317A2/en
Publication of JP2009532812A publication Critical patent/JP2009532812A/ja
Publication of JP2009532812A5 publication Critical patent/JP2009532812A5/ja
Application granted granted Critical
Publication of JP5167243B2 publication Critical patent/JP5167243B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

JP2009504455A 2006-04-04 2007-04-04 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法 Expired - Fee Related JP5167243B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US78901606P 2006-04-04 2006-04-04
US60/789,016 2006-04-04
PCT/US2007/065989 WO2007115317A2 (en) 2006-04-04 2007-04-04 Storage assignment and erasure coding technique for scalable and fault tolerant storage system

Publications (3)

Publication Number Publication Date
JP2009532812A JP2009532812A (ja) 2009-09-10
JP2009532812A5 true JP2009532812A5 (cg-RX-API-DMAC7.html) 2010-05-20
JP5167243B2 JP5167243B2 (ja) 2013-03-21

Family

ID=38564321

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009504455A Expired - Fee Related JP5167243B2 (ja) 2006-04-04 2007-04-04 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法

Country Status (4)

Country Link
US (2) US7979771B2 (cg-RX-API-DMAC7.html)
EP (1) EP2158542B1 (cg-RX-API-DMAC7.html)
JP (1) JP5167243B2 (cg-RX-API-DMAC7.html)
WO (1) WO2007115317A2 (cg-RX-API-DMAC7.html)

Families Citing this family (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7921142B2 (en) * 2007-01-08 2011-04-05 International Business Machines Corporation Method and apparatus for storing and accessing data records on solid state disks
EP2582091B1 (en) 2007-09-26 2017-05-31 Nicira Inc. Network operating system for managing and securing networks
US7925927B2 (en) * 2008-06-23 2011-04-12 Hewlett-Packard Development Company, L.P. Simulator for determining data loss in a fault tolerant system
SE533007C2 (sv) 2008-10-24 2010-06-08 Ilt Productions Ab Distribuerad datalagring
US20100138717A1 (en) * 2008-12-02 2010-06-03 Microsoft Corporation Fork codes for erasure coding of data blocks
US20100174968A1 (en) * 2009-01-02 2010-07-08 Microsoft Corporation Heirarchical erasure coding
JP5637552B2 (ja) * 2009-02-17 2014-12-10 日本電気株式会社 ストレージシステム
CA2756289C (en) 2009-04-01 2016-02-02 Nicira Networks, Inc. Method and apparatus for implementing and managing virtual switches
US8560798B2 (en) * 2009-07-30 2013-10-15 Cleversafe, Inc. Dispersed storage network virtual address space
US8381025B2 (en) * 2009-09-30 2013-02-19 Cleversafe, Inc. Method and apparatus for dispersed storage memory device selection
EP2387200B1 (en) 2010-04-23 2014-02-12 Compuverde AB Distributed data storage
US9680750B2 (en) 2010-07-06 2017-06-13 Nicira, Inc. Use of tunnels to hide network addresses
US10103939B2 (en) 2010-07-06 2018-10-16 Nicira, Inc. Network control apparatus and method for populating logical datapath sets
US8817620B2 (en) 2010-07-06 2014-08-26 Nicira, Inc. Network virtualization apparatus and method
US8964528B2 (en) 2010-07-06 2015-02-24 Nicira, Inc. Method and apparatus for robust packet distribution among hierarchical managed switching elements
US9525647B2 (en) 2010-07-06 2016-12-20 Nicira, Inc. Network control apparatus and method for creating and modifying logical switching elements
US8433685B2 (en) * 2010-08-18 2013-04-30 Hewlett-Packard Development Company, L.P. Method and system for parity-page distribution among nodes of a multi-node data-storage system
EP2793130B1 (en) 2010-12-27 2015-12-23 Amplidata NV Apparatus for storage or retrieval of a data object on a storage medium, which is unreliable
US9043452B2 (en) 2011-05-04 2015-05-26 Nicira, Inc. Network control apparatus and method for port isolation
US8996910B2 (en) * 2011-05-09 2015-03-31 Cleversafe, Inc. Assigning a dispersed storage network address range in a maintenance free storage container
US8997124B2 (en) 2011-09-02 2015-03-31 Compuverde Ab Method for updating data in a distributed data storage system
US8650365B2 (en) 2011-09-02 2014-02-11 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
US8645978B2 (en) 2011-09-02 2014-02-04 Compuverde Ab Method for data maintenance
US8769138B2 (en) 2011-09-02 2014-07-01 Compuverde Ab Method for data retrieval from a distributed data storage system
US9626378B2 (en) 2011-09-02 2017-04-18 Compuverde Ab Method for handling requests in a storage system and a storage node for a storage system
US9021053B2 (en) 2011-09-02 2015-04-28 Compuverde Ab Method and device for writing data to a data storage system comprising a plurality of data storage nodes
US8429162B1 (en) 2011-09-27 2013-04-23 Amazon Technologies, Inc. Facilitating data redistribution in database sharding
US8683296B2 (en) 2011-12-30 2014-03-25 Streamscale, Inc. Accelerated erasure coding system and method
US8914706B2 (en) 2011-12-30 2014-12-16 Streamscale, Inc. Using parity data for concurrent data authentication, correction, compression, and encryption
US8788915B2 (en) * 2012-03-05 2014-07-22 Micron Technology, Inc. Apparatuses and methods for encoding using error protection codes
US20150127974A1 (en) * 2012-05-04 2015-05-07 Thomson Licensing Method of storing a data item in a distributed data storage system, corresponding storage device failure repair method and corresponding devices
CN104583965B (zh) * 2012-08-16 2017-08-11 英派尔科技开发有限公司 将编码数据文件存储在多个文件服务器上
US9037679B2 (en) 2012-12-31 2015-05-19 Futurewei Technologies, Inc. Efficient high availability storage systems
US9823986B2 (en) 2013-04-30 2017-11-21 Hewlett Packard Enterprise Development Lp Memory node error correction
US9244761B2 (en) 2013-06-25 2016-01-26 Microsoft Technology Licensing, Llc Erasure coding across multiple zones and sub-zones
US9378084B2 (en) 2013-06-25 2016-06-28 Microsoft Technology Licensing, Llc Erasure coding across multiple zones
US9846540B1 (en) * 2013-08-19 2017-12-19 Amazon Technologies, Inc. Data durability using un-encoded copies and encoded combinations
EP2863566B1 (en) 2013-10-18 2020-09-02 Université de Nantes Method and apparatus for reconstructing a data block
US9626180B2 (en) * 2013-12-16 2017-04-18 International Business Machines Corporation Live operating system update mechanisms
US20190056995A1 (en) * 2014-01-31 2019-02-21 International Business Machines Corporation Managing migration of encoded data slices in a dispersed storage network
JP6269120B2 (ja) * 2014-02-06 2018-01-31 日本電気株式会社 ストレージシステム
WO2015161140A1 (en) * 2014-04-16 2015-10-22 The Research Foundation For The State University Of New York System and method for fault-tolerant block data storage
US9575846B2 (en) * 2014-07-24 2017-02-21 At&T Intellectual Property I, L.P. Distributed storage of data
US9858325B1 (en) * 2014-09-29 2018-01-02 Amazon Technologies, Inc. Consolidating data in storage host groupings
US10198288B2 (en) 2014-10-30 2019-02-05 Oracle International Corporation System and method for providing a dynamic cloud with subnet administration (SA) query caching
EP3213471B1 (en) * 2014-10-31 2018-08-29 Oracle International Corporation System and method for supporting partition-aware routing in a multi-tenant cluster environment
US20170060700A1 (en) * 2015-08-28 2017-03-02 Qualcomm Incorporated Systems and methods for verification of code resiliency for data storage
US20170083603A1 (en) * 2015-09-18 2017-03-23 Qualcomm Incorporated Co-derived data storage patterns for distributed storage systems
US10033647B2 (en) 2015-10-13 2018-07-24 Oracle International Corporation System and method for efficient network isolation and load balancing in a multi-tenant cluster environment
US20230342250A1 (en) * 2015-10-30 2023-10-26 Pure Storage, Inc. Allocating Data in a Decentralized Computer System
US10409514B2 (en) * 2015-11-30 2019-09-10 International Business Machines Corporation IP multicast message transmission for event notifications
US9959179B1 (en) * 2016-03-24 2018-05-01 Veritas Technologies Llc Systems and methods for repairing corrupted data segments
US10776846B2 (en) * 2016-07-27 2020-09-15 Nike, Inc. Assortment optimization
US11169731B2 (en) * 2016-10-31 2021-11-09 International Business Machines Corporation Managing storage resources in a dispersed storage network
US10545805B2 (en) * 2017-03-29 2020-01-28 Macronix International Co., Ltd. Memory system, reading method thereof and writing method thereof
CN109213619B (zh) * 2017-06-30 2022-02-22 伊姆西Ip控股有限责任公司 用于管理存储系统的方法、设备和计算机程序产品
US10545921B2 (en) * 2017-08-07 2020-01-28 Weka.IO Ltd. Metadata control in a load-balanced distributed storage system
US10936453B2 (en) * 2017-09-19 2021-03-02 Seagate Technology Llc Data storage systems using elastic spares
CN110018783B (zh) 2018-01-09 2022-12-20 阿里巴巴集团控股有限公司 一种数据存储方法、装置及系统
US10740181B2 (en) 2018-03-06 2020-08-11 Western Digital Technologies, Inc. Failed storage device rebuild method
US10860446B2 (en) 2018-04-26 2020-12-08 Western Digital Technologiies, Inc. Failed storage device rebuild using dynamically selected locations in overprovisioned space
US11748009B2 (en) 2018-06-01 2023-09-05 Microsoft Technology Licensing, Llc Erasure coding with overlapped local reconstruction codes
US10942725B2 (en) * 2018-07-30 2021-03-09 Ford Global Technologies, Llc Over the air Ecu update
US10824526B2 (en) 2018-08-03 2020-11-03 Western Digital Technologies, Inc. Using failed storage device in peer-to-peer storage system to perform storage-centric task
US10649843B2 (en) 2018-08-03 2020-05-12 Western Digital Technologies, Inc. Storage systems with peer data scrub
US10831603B2 (en) * 2018-08-03 2020-11-10 Western Digital Technologies, Inc. Rebuild assist using failed storage device
US10901848B2 (en) 2018-08-03 2021-01-26 Western Digital Technologies, Inc. Storage systems with peer data recovery
US11182258B2 (en) 2019-01-04 2021-11-23 Western Digital Technologies, Inc. Data rebuild using dynamic peer work allocation
US11080092B1 (en) 2019-03-27 2021-08-03 Amazon Technologies, Inc. Correlated volume placement in a distributed block storage service
US11048554B1 (en) * 2019-03-27 2021-06-29 Amazon Technologies, Inc. Correlated volume placement in a distributed block storage service
US11210002B2 (en) 2020-01-29 2021-12-28 Samsung Electronics Co., Ltd. Offloaded device-driven erasure coding
TWI810871B (zh) * 2022-03-29 2023-08-01 睿寬智能科技有限公司 交錯式ｒａｉｄ編碼法
CN114415983B (zh) * 2022-03-30 2022-06-07 苏州浪潮智能科技有限公司 一种raid编解码方法、装置、设备及可读存储介质
US12009660B1 (en) 2023-07-11 2024-06-11 T-Mobile Usa, Inc. Predicting space, power, and cooling capacity of a facility to optimize energy usage

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2941452C2 (de) * 1979-10-12 1982-06-24 Polygram Gmbh, 2000 Hamburg Verfahren zur Codierung von Analogsignalen
US5485474A (en) * 1988-02-25 1996-01-16 The President And Fellows Of Harvard College Scheme for information dispersal and reconstruction
US5499253A (en) * 1994-01-05 1996-03-12 Digital Equipment Corporation System and method for calculating RAID 6 check codes
DE69533764T2 (de) * 1994-06-22 2005-12-01 Hewlett-Packard Development Co., L.P., Houston Verfahren zum Gebrauch von Speicherplatten unterschiedlicher Inhalte in einem Einzelvolumen einer hierarchischen Speicherplattenanordnung
US5615352A (en) * 1994-10-05 1997-03-25 Hewlett-Packard Company Methods for adding storage disks to a hierarchic disk array while maintaining data availability
US5617541A (en) * 1994-12-21 1997-04-01 International Computer Science Institute System for packetizing data encoded corresponding to priority levels where reconstructed data corresponds to fractionalized priority level and received fractionalized packets
JP3358687B2 (ja) * 1995-03-13 2002-12-24 株式会社日立製作所 ディスクアレイ装置
CA2219379A1 (en) * 1995-04-27 1996-10-31 Cadathur V. Chakravarthy High integrity transport for time critical multimedia networking applications
US5845319A (en) * 1995-08-23 1998-12-01 Fujitsu Limited Disk array device which separates local and physical disks using striping and operation mode selection
JP4044160B2 (ja) * 1995-08-23 2008-02-06 富士通株式会社 ディスクアレイ装置
US5790774A (en) * 1996-05-21 1998-08-04 Storage Computer Corporation Data storage system with dedicated allocation of parity storage and parity reads and writes only on operations requiring parity information
US5949993A (en) * 1997-10-31 1999-09-07 Production Languages Corporation Method for the generation of ISA simulators and assemblers from a machine description
US6553420B1 (en) * 1998-03-13 2003-04-22 Massachusetts Institute Of Technology Method and apparatus for distributing requests among a plurality of resources
US6320520B1 (en) * 1998-09-23 2001-11-20 Digital Fountain Information additive group code generator and decoder for communications systems
US6307487B1 (en) * 1998-09-23 2001-10-23 Digital Fountain, Inc. Information additive code generator and decoder for communication systems
JP3454183B2 (ja) * 1999-04-13 2003-10-06 日本電気株式会社 ディスクアレイ装置
US7304990B2 (en) * 2000-02-03 2007-12-04 Bandwiz Inc. Method of encoding and transmitting data over a communication medium through division and segmentation
US7062648B2 (en) * 2000-02-18 2006-06-13 Avamar Technologies, Inc. System and method for redundant array network storage
US6607231B2 (en) * 2001-07-23 2003-08-19 Ford Global Technologies, Inc. Liftgate with low-liftover liftglass
WO2004012337A2 (en) * 2002-07-29 2004-02-05 Robert Halford Multi-dimensional data protection and mirroring method for micro level data
US7363346B2 (en) 2002-09-07 2008-04-22 Appistry, Inc. Reliably storing information across multiple computers such as in a hive of computers
US7080229B2 (en) * 2002-10-28 2006-07-18 Network Appliance Inc. Method and system for strategy driven provisioning of storage in a storage area network
US7478096B2 (en) * 2003-02-26 2009-01-13 Burnside Acquisition, Llc History preservation in a computer storage system
JP4215606B2 (ja) * 2003-09-24 2009-01-28 日本電気株式会社 ディスクアレイ装置および記憶容量拡張方法ならびにプログラム
US7472334B1 (en) * 2003-10-15 2008-12-30 Scott Thomas P Efficient method for the reconstruction of digital information
US7188226B2 (en) * 2003-10-20 2007-03-06 Hewlett-Packard Development Company, L.P. Defective data site information storage
TWI310497B (en) * 2004-02-06 2009-06-01 Hon Hai Prec Ind Co Ltd System and method for disk fault tolerance
US7240236B2 (en) * 2004-03-23 2007-07-03 Archivas, Inc. Fixed content distributed data storage using permutation ring encoding
JP4932726B2 (ja) * 2004-10-06 2012-05-16 パーマビット テクノロジー コーポレイション データのランダムに命名したブロック用の記憶システム
JP5055125B2 (ja) 2004-11-05 2012-10-24 ドロボ， インコーポレイテッド 種々のサイズの格納デバイスを許容する動的にアップグレード可能な故障許容格納システムおよび方法
US7219289B2 (en) * 2005-03-15 2007-05-15 Tandberg Data Corporation Multiply redundant raid system and XOR-efficient method and apparatus for implementing the same
US7577866B1 (en) * 2005-06-27 2009-08-18 Emc Corporation Techniques for fault tolerant data storage

Similar Documents

Publication Publication Date Title
JP2009532812A5 (cg-RX-API-DMAC7.html)
JP6346565B2 (ja) ディスク記憶に消去符号化データを割り当てるための方法および装置
US10691366B2 (en) Policy-based hierarchical data protection in distributed storage
US11182248B2 (en) Methods and apparatus to assign indices and relocate object fragments in distributed storage systems
US9823980B2 (en) Prioritizing data reconstruction in distributed storage systems
EP2787446B1 (en) Distributed storage method, device and system
JP5167243B2 (ja) 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法
US10228867B2 (en) Distributed object storage system comprising performance optimizations
CN106293492B (zh) 一种存储管理方法及分布式文件系统
US20170371571A1 (en) Efficient erasure coding of large data objects
US7565569B2 (en) Data protection in a mass storage system
WO2017048373A1 (en) Co-derived data storage patterns for distributed storage systems
WO2016137402A1 (en) Data stripping, allocation and reconstruction
US11442827B2 (en) Policy-based hierarchical data protection in distributed storage
WO2012007715A2 (en) Distributed data storage and recovery
US10958731B2 (en) Indicating multiple encoding schemes in a dispersed storage network
JP6053712B2 (ja) 管理装置およびプログラム
US10169229B2 (en) Protocols for expanding existing sites in a dispersed storage network
US20190026186A1 (en) Using storage locations greater than an ida width in a dispersed storage network
Evgenii et al. Cloud Wolverine: The fastest data recovery
CN105843556A (zh) 一种vd选取方法及装置