JP2009532812A5 - - Google Patents

Download PDF

Info

Publication number
JP2009532812A5
JP2009532812A5 JP2009504455A JP2009504455A JP2009532812A5 JP 2009532812 A5 JP2009532812 A5 JP 2009532812A5 JP 2009504455 A JP2009504455 A JP 2009504455A JP 2009504455 A JP2009504455 A JP 2009504455A JP 2009532812 A5 JP2009532812 A5 JP 2009532812A5
Authority
JP
Japan
Prior art keywords
storage
available capacity
storage system
allocation table
storage elements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2009504455A
Other languages
English (en)
Japanese (ja)
Other versions
JP5167243B2 (ja
JP2009532812A (ja
Filing date
Publication date
Application filed filed Critical
Priority claimed from PCT/US2007/065989 external-priority patent/WO2007115317A2/en
Publication of JP2009532812A publication Critical patent/JP2009532812A/ja
Publication of JP2009532812A5 publication Critical patent/JP2009532812A5/ja
Application granted granted Critical
Publication of JP5167243B2 publication Critical patent/JP5167243B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

JP2009504455A 2006-04-04 2007-04-04 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法 Expired - Fee Related JP5167243B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US78901606P 2006-04-04 2006-04-04
US60/789,016 2006-04-04
PCT/US2007/065989 WO2007115317A2 (en) 2006-04-04 2007-04-04 Storage assignment and erasure coding technique for scalable and fault tolerant storage system

Publications (3)

Publication Number Publication Date
JP2009532812A JP2009532812A (ja) 2009-09-10
JP2009532812A5 true JP2009532812A5 (enExample) 2010-05-20
JP5167243B2 JP5167243B2 (ja) 2013-03-21

Family

ID=38564321

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009504455A Expired - Fee Related JP5167243B2 (ja) 2006-04-04 2007-04-04 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法

Country Status (4)

Country Link
US (2) US8364891B2 (enExample)
EP (1) EP2158542B1 (enExample)
JP (1) JP5167243B2 (enExample)
WO (1) WO2007115317A2 (enExample)

Families Citing this family (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7921142B2 (en) * 2007-01-08 2011-04-05 International Business Machines Corporation Method and apparatus for storing and accessing data records on solid state disks
JP5393686B2 (ja) 2007-09-26 2014-01-22 ニシラ， インコーポレイテッド ネットワークを管理する及び安全にするためのネットワークオペレーティングシステム
US7925927B2 (en) * 2008-06-23 2011-04-12 Hewlett-Packard Development Company, L.P. Simulator for determining data loss in a fault tolerant system
SE533007C2 (sv) 2008-10-24 2010-06-08 Ilt Productions Ab Distribuerad datalagring
US20100138717A1 (en) * 2008-12-02 2010-06-03 Microsoft Corporation Fork codes for erasure coding of data blocks
US20100174968A1 (en) * 2009-01-02 2010-07-08 Microsoft Corporation Heirarchical erasure coding
JP5637552B2 (ja) * 2009-02-17 2014-12-10 日本電気株式会社 ストレージシステム
WO2010115060A2 (en) 2009-04-01 2010-10-07 Nicira Networks Method and apparatus for implementing and managing virtual switches
US8275744B2 (en) * 2009-07-30 2012-09-25 Cleversafe, Inc. Dispersed storage network virtual address fields
US8381025B2 (en) * 2009-09-30 2013-02-19 Cleversafe, Inc. Method and apparatus for dispersed storage memory device selection
EP2712149B1 (en) 2010-04-23 2019-10-30 Compuverde AB Distributed data storage
US9680750B2 (en) 2010-07-06 2017-06-13 Nicira, Inc. Use of tunnels to hide network addresses
US10103939B2 (en) 2010-07-06 2018-10-16 Nicira, Inc. Network control apparatus and method for populating logical datapath sets
US8964528B2 (en) 2010-07-06 2015-02-24 Nicira, Inc. Method and apparatus for robust packet distribution among hierarchical managed switching elements
US8837493B2 (en) 2010-07-06 2014-09-16 Nicira, Inc. Distributed network control apparatus and method
US9525647B2 (en) 2010-07-06 2016-12-20 Nicira, Inc. Network control apparatus and method for creating and modifying logical switching elements
US8433685B2 (en) * 2010-08-18 2013-04-30 Hewlett-Packard Development Company, L.P. Method and system for parity-page distribution among nodes of a multi-node data-storage system
US8738582B2 (en) 2010-12-27 2014-05-27 Amplidata Nv Distributed object storage system comprising performance optimizations
US9043452B2 (en) 2011-05-04 2015-05-26 Nicira, Inc. Network control apparatus and method for port isolation
US8996910B2 (en) * 2011-05-09 2015-03-31 Cleversafe, Inc. Assigning a dispersed storage network address range in a maintenance free storage container
US9626378B2 (en) 2011-09-02 2017-04-18 Compuverde Ab Method for handling requests in a storage system and a storage node for a storage system
US8650365B2 (en) 2011-09-02 2014-02-11 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
US8997124B2 (en) 2011-09-02 2015-03-31 Compuverde Ab Method for updating data in a distributed data storage system
US8769138B2 (en) 2011-09-02 2014-07-01 Compuverde Ab Method for data retrieval from a distributed data storage system
US9021053B2 (en) 2011-09-02 2015-04-28 Compuverde Ab Method and device for writing data to a data storage system comprising a plurality of data storage nodes
US8645978B2 (en) 2011-09-02 2014-02-04 Compuverde Ab Method for data maintenance
US8429162B1 (en) 2011-09-27 2013-04-23 Amazon Technologies, Inc. Facilitating data redistribution in database sharding
US8914706B2 (en) 2011-12-30 2014-12-16 Streamscale, Inc. Using parity data for concurrent data authentication, correction, compression, and encryption
US8683296B2 (en) 2011-12-30 2014-03-25 Streamscale, Inc. Accelerated erasure coding system and method
US8788915B2 (en) * 2012-03-05 2014-07-22 Micron Technology, Inc. Apparatuses and methods for encoding using error protection codes
US20150127974A1 (en) * 2012-05-04 2015-05-07 Thomson Licensing Method of storing a data item in a distributed data storage system, corresponding storage device failure repair method and corresponding devices
WO2014026355A1 (en) * 2012-08-16 2014-02-20 Empire Technology Development Llc Storing encoded data files on multiple file servers
US9037679B2 (en) * 2012-12-31 2015-05-19 Futurewei Technologies, Inc. Efficient high availability storage systems
EP2992435B1 (en) 2013-04-30 2020-12-30 Hewlett-Packard Enterprise Development LP Memory node error correction
US9244761B2 (en) 2013-06-25 2016-01-26 Microsoft Technology Licensing, Llc Erasure coding across multiple zones and sub-zones
US9378084B2 (en) 2013-06-25 2016-06-28 Microsoft Technology Licensing, Llc Erasure coding across multiple zones
US9846540B1 (en) * 2013-08-19 2017-12-19 Amazon Technologies, Inc. Data durability using un-encoded copies and encoded combinations
EP2863566B1 (en) * 2013-10-18 2020-09-02 Université de Nantes Method and apparatus for reconstructing a data block
US9626180B2 (en) 2013-12-16 2017-04-18 International Business Machines Corporation Live operating system update mechanisms
US20190056995A1 (en) * 2014-01-31 2019-02-21 International Business Machines Corporation Managing migration of encoded data slices in a dispersed storage network
JP6269120B2 (ja) * 2014-02-06 2018-01-31 日本電気株式会社 ストレージシステム
WO2015161140A1 (en) * 2014-04-16 2015-10-22 The Research Foundation For The State University Of New York System and method for fault-tolerant block data storage
US9575846B2 (en) 2014-07-24 2017-02-21 At&T Intellectual Property I, L.P. Distributed storage of data
US9858325B1 (en) * 2014-09-29 2018-01-02 Amazon Technologies, Inc. Consolidating data in storage host groupings
US10198288B2 (en) 2014-10-30 2019-02-05 Oracle International Corporation System and method for providing a dynamic cloud with subnet administration (SA) query caching
CN107113233B (zh) * 2014-10-31 2020-06-23 甲骨文国际公司 用于支持多租户集群环境中的分区感知路由的系统和方法
US10003357B2 (en) * 2015-08-28 2018-06-19 Qualcomm Incorporated Systems and methods for verification of code resiliency for data storage
US20170083603A1 (en) * 2015-09-18 2017-03-23 Qualcomm Incorporated Co-derived data storage patterns for distributed storage systems
US10033647B2 (en) 2015-10-13 2018-07-24 Oracle International Corporation System and method for efficient network isolation and load balancing in a multi-tenant cluster environment
US20230342250A1 (en) * 2015-10-30 2023-10-26 Pure Storage, Inc. Allocating Data in a Decentralized Computer System
US10409514B2 (en) * 2015-11-30 2019-09-10 International Business Machines Corporation IP multicast message transmission for event notifications
US9959179B1 (en) * 2016-03-24 2018-05-01 Veritas Technologies Llc Systems and methods for repairing corrupted data segments
US10776846B2 (en) * 2016-07-27 2020-09-15 Nike, Inc. Assortment optimization
US11169731B2 (en) * 2016-10-31 2021-11-09 International Business Machines Corporation Managing storage resources in a dispersed storage network
US10545805B2 (en) * 2017-03-29 2020-01-28 Macronix International Co., Ltd. Memory system, reading method thereof and writing method thereof
CN109213619B (zh) * 2017-06-30 2022-02-22 伊姆西Ip控股有限责任公司 用于管理存储系统的方法、设备和计算机程序产品
US10545921B2 (en) * 2017-08-07 2020-01-28 Weka.IO Ltd. Metadata control in a load-balanced distributed storage system
US10936453B2 (en) * 2017-09-19 2021-03-02 Seagate Technology Llc Data storage systems using elastic spares
CN110018783B (zh) 2018-01-09 2022-12-20 阿里巴巴集团控股有限公司 一种数据存储方法、装置及系统
US10740181B2 (en) 2018-03-06 2020-08-11 Western Digital Technologies, Inc. Failed storage device rebuild method
US10860446B2 (en) 2018-04-26 2020-12-08 Western Digital Technologiies, Inc. Failed storage device rebuild using dynamically selected locations in overprovisioned space
CN112313628A (zh) 2018-06-01 2021-02-02 微软技术许可有限责任公司 利用重叠的本地重构代码的擦除编码
US10942725B2 (en) * 2018-07-30 2021-03-09 Ford Global Technologies, Llc Over the air Ecu update
US10831603B2 (en) * 2018-08-03 2020-11-10 Western Digital Technologies, Inc. Rebuild assist using failed storage device
US10649843B2 (en) 2018-08-03 2020-05-12 Western Digital Technologies, Inc. Storage systems with peer data scrub
US10901848B2 (en) 2018-08-03 2021-01-26 Western Digital Technologies, Inc. Storage systems with peer data recovery
US10824526B2 (en) 2018-08-03 2020-11-03 Western Digital Technologies, Inc. Using failed storage device in peer-to-peer storage system to perform storage-centric task
US11182258B2 (en) 2019-01-04 2021-11-23 Western Digital Technologies, Inc. Data rebuild using dynamic peer work allocation
US11048554B1 (en) * 2019-03-27 2021-06-29 Amazon Technologies, Inc. Correlated volume placement in a distributed block storage service
US11080092B1 (en) 2019-03-27 2021-08-03 Amazon Technologies, Inc. Correlated volume placement in a distributed block storage service
US11210002B2 (en) 2020-01-29 2021-12-28 Samsung Electronics Co., Ltd. Offloaded device-driven erasure coding
TWI810871B (zh) * 2022-03-29 2023-08-01 睿寬智能科技有限公司 交錯式ｒａｉｄ編碼法
CN114415983B (zh) * 2022-03-30 2022-06-07 苏州浪潮智能科技有限公司 一种raid编解码方法、装置、设备及可读存储介质
US12009660B1 (en) 2023-07-11 2024-06-11 T-Mobile Usa, Inc. Predicting space, power, and cooling capacity of a facility to optimize energy usage

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2941452C2 (de) * 1979-10-12 1982-06-24 Polygram Gmbh, 2000 Hamburg Verfahren zur Codierung von Analogsignalen
US5485474A (en) * 1988-02-25 1996-01-16 The President And Fellows Of Harvard College Scheme for information dispersal and reconstruction
US5499253A (en) * 1994-01-05 1996-03-12 Digital Equipment Corporation System and method for calculating RAID 6 check codes
EP0689125B1 (en) 1994-06-22 2004-11-17 Hewlett-Packard Company, A Delaware Corporation Method of utilizing storage disks of differing capacity in a single storage volume in a hierarchic disk array
US5615352A (en) * 1994-10-05 1997-03-25 Hewlett-Packard Company Methods for adding storage disks to a hierarchic disk array while maintaining data availability
US5617541A (en) * 1994-12-21 1997-04-01 International Computer Science Institute System for packetizing data encoded corresponding to priority levels where reconstructed data corresponds to fractionalized priority level and received fractionalized packets
JP3358687B2 (ja) * 1995-03-13 2002-12-24 株式会社日立製作所 ディスクアレイ装置
US6079042A (en) * 1995-04-27 2000-06-20 The Trustees Of The Stevens Institute Of Technology High integrity transport for time critical multimedia networking applications
JP4044160B2 (ja) * 1995-08-23 2008-02-06 富士通株式会社 ディスクアレイ装置
US5845319A (en) 1995-08-23 1998-12-01 Fujitsu Limited Disk array device which separates local and physical disks using striping and operation mode selection
US5790774A (en) * 1996-05-21 1998-08-04 Storage Computer Corporation Data storage system with dedicated allocation of parity storage and parity reads and writes only on operations requiring parity information
US5949993A (en) 1997-10-31 1999-09-07 Production Languages Corporation Method for the generation of ISA simulators and assemblers from a machine description
US6553420B1 (en) 1998-03-13 2003-04-22 Massachusetts Institute Of Technology Method and apparatus for distributing requests among a plurality of resources
US6320520B1 (en) * 1998-09-23 2001-11-20 Digital Fountain Information additive group code generator and decoder for communications systems
US6307487B1 (en) * 1998-09-23 2001-10-23 Digital Fountain, Inc. Information additive code generator and decoder for communication systems
JP3454183B2 (ja) * 1999-04-13 2003-10-06 日本電気株式会社 ディスクアレイ装置
US7304990B2 (en) * 2000-02-03 2007-12-04 Bandwiz Inc. Method of encoding and transmitting data over a communication medium through division and segmentation
US7062648B2 (en) * 2000-02-18 2006-06-13 Avamar Technologies, Inc. System and method for redundant array network storage
US6607231B2 (en) * 2001-07-23 2003-08-19 Ford Global Technologies, Inc. Liftgate with low-liftover liftglass
CA2493610C (en) * 2002-07-29 2014-01-14 Robert Halford Multi-dimensional data protection and mirroring method for micro level data
US7363346B2 (en) 2002-09-07 2008-04-22 Appistry, Inc. Reliably storing information across multiple computers such as in a hive of computers
US7080229B2 (en) * 2002-10-28 2006-07-18 Network Appliance Inc. Method and system for strategy driven provisioning of storage in a storage area network
US7478096B2 (en) * 2003-02-26 2009-01-13 Burnside Acquisition, Llc History preservation in a computer storage system
JP4215606B2 (ja) 2003-09-24 2009-01-28 日本電気株式会社 ディスクアレイ装置および記憶容量拡張方法ならびにプログラム
US7472334B1 (en) * 2003-10-15 2008-12-30 Scott Thomas P Efficient method for the reconstruction of digital information
US7188226B2 (en) * 2003-10-20 2007-03-06 Hewlett-Packard Development Company, L.P. Defective data site information storage
TWI310497B (en) * 2004-02-06 2009-06-01 Hon Hai Prec Ind Co Ltd System and method for disk fault tolerance
US7240236B2 (en) * 2004-03-23 2007-07-03 Archivas, Inc. Fixed content distributed data storage using permutation ring encoding
US7457813B2 (en) 2004-10-06 2008-11-25 Burnside Acquisition, Llc Storage system for randomly named blocks of data
WO2006052888A2 (en) * 2004-11-05 2006-05-18 Trusted Data Corporation Dynamically expandable and contractible fault-tolerant storage system permitting variously sized storage devices and method
US7219289B2 (en) * 2005-03-15 2007-05-15 Tandberg Data Corporation Multiply redundant raid system and XOR-efficient method and apparatus for implementing the same
US7577866B1 (en) * 2005-06-27 2009-08-18 Emc Corporation Techniques for fault tolerant data storage

Similar Documents

Publication Publication Date Title
JP2009532812A5 (enExample)
JP6346565B2 (ja) ディスク記憶に消去符号化データを割り当てるための方法および装置
US10691366B2 (en) Policy-based hierarchical data protection in distributed storage
US11182248B2 (en) Methods and apparatus to assign indices and relocate object fragments in distributed storage systems
US9823980B2 (en) Prioritizing data reconstruction in distributed storage systems
EP2787446B1 (en) Distributed storage method, device and system
JP5167243B2 (ja) 拡張性及び耐障害性を有する記憶システムのための記憶領域割当て及び消去符号化技法
US10228867B2 (en) Distributed object storage system comprising performance optimizations
CN106293492B (zh) 一种存储管理方法及分布式文件系统
US7565569B2 (en) Data protection in a mass storage system
WO2017048373A1 (en) Co-derived data storage patterns for distributed storage systems
US20170371571A1 (en) Efficient erasure coding of large data objects
WO2016137402A1 (en) Data stripping, allocation and reconstruction
US11442827B2 (en) Policy-based hierarchical data protection in distributed storage
WO2012007715A2 (en) Distributed data storage and recovery
US10958731B2 (en) Indicating multiple encoding schemes in a dispersed storage network
JP6053712B2 (ja) 管理装置およびプログラム
US10169229B2 (en) Protocols for expanding existing sites in a dispersed storage network
US20190026186A1 (en) Using storage locations greater than an ida width in a dispersed storage network
Evgenii et al. Cloud Wolverine: The fastest data recovery
CN105843556A (zh) 一种vd选取方法及装置