WO2004036424A3 - Efficient expansion of highly reliable storage arrays and clusters - Google Patents

Efficient expansion of highly reliable storage arrays and clusters Download PDF

Info

Publication number
WO2004036424A3
WO2004036424A3 PCT/US2003/032624 US0332624W WO2004036424A3 WO 2004036424 A3 WO2004036424 A3 WO 2004036424A3 US 0332624 W US0332624 W US 0332624W WO 2004036424 A3 WO2004036424 A3 WO 2004036424A3
Authority
WO
WIPO (PCT)
Prior art keywords
storage devices
physical storage
array
clusters
highly reliable
Prior art date
Application number
PCT/US2003/032624
Other languages
French (fr)
Other versions
WO2004036424A2 (en
Inventor
Myron Zimmerman
Thomas Scott
Doss Karan
Original Assignee
Storage Matrix Inc
Myron Zimmerman
Thomas Scott
Doss Karan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Storage Matrix Inc, Myron Zimmerman, Thomas Scott, Doss Karan filed Critical Storage Matrix Inc
Priority to AU2003284216A priority Critical patent/AU2003284216A1/en
Publication of WO2004036424A2 publication Critical patent/WO2004036424A2/en
Publication of WO2004036424A3 publication Critical patent/WO2004036424A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662—Virtualisation aspects
    • G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1096—Parity calculation or recalculation after configuration or reconfiguration of the system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD

Abstract

Method to flexibly expand a storage array so that the I/O load is uniformly distributed among the new physical storage devices and the amount of copying resulting form the reorganization is minimized. The storage of the array is organized into reliability groups. The data of a reliability group is encoded and stored in blocks distributed among k physical storage devices. The invention supports any type of encoding; including those used by existing RAID levels. The storage array can be expanded by adding one or more physical storage devices. The mapping of reliability groups to physical storage devices is modified to take into account the new physical storage devices using a pseudo random replacement algorithm. The new mapping uniformly distributes the existing storage among the expanded array, yet minimizes the amount of data that must be reorganized.
PCT/US2003/032624 2002-10-16 2003-10-15 Efficient expansion of highly reliable storage arrays and clusters WO2004036424A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2003284216A AU2003284216A1 (en) 2002-10-16 2003-10-15 Efficient expansion of highly reliable storage arrays and clusters

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US41879202P 2002-10-16 2002-10-16
US60/418,792 2002-10-16

Publications (2)

Publication Number Publication Date
WO2004036424A2 WO2004036424A2 (en) 2004-04-29
WO2004036424A3 true WO2004036424A3 (en) 2005-07-14

Family

ID=32107973

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/032624 WO2004036424A2 (en) 2002-10-16 2003-10-15 Efficient expansion of highly reliable storage arrays and clusters

Country Status (2)

Country Link
AU (1) AU2003284216A1 (en)
WO (1) WO2004036424A2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012045529A1 (en) 2010-10-07 2012-04-12 International Business Machines Corporation Raid array transformation
CN102446072B (en) 2010-10-07 2014-11-19 国际商业机器公司 System and method for DAID array transformation in a pooled storage system
US8904143B2 (en) 2011-09-30 2014-12-02 International Business Machines Corporation Obtaining additional data storage from another data storage system
JP2013122691A (en) * 2011-12-12 2013-06-20 Fujitsu Ltd Allocation device and storage device
CN108520025B (en) * 2018-03-26 2020-12-18 腾讯科技（深圳）有限公司 Service node determination method, device, equipment and medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5615352A (en) * 1994-10-05 1997-03-25 Hewlett-Packard Company Methods for adding storage disks to a hierarchic disk array while maintaining data availability
US5758118A (en) * 1995-12-08 1998-05-26 International Business Machines Corporation Methods and data storage devices for RAID expansion by on-line addition of new DASDs
US20020016889A1 (en) * 2000-08-04 2002-02-07 Quantel Ltd. File servers

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5615352A (en) * 1994-10-05 1997-03-25 Hewlett-Packard Company Methods for adding storage disks to a hierarchic disk array while maintaining data availability
US5758118A (en) * 1995-12-08 1998-05-26 International Business Machines Corporation Methods and data storage devices for RAID expansion by on-line addition of new DASDs
US20020016889A1 (en) * 2000-08-04 2002-02-07 Quantel Ltd. File servers

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
GOEL A ET AL INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS: "SCADDAR: an efficient randomized technique to reorganize continuous media blocks", PROCEEDINGS 18TH. INTERNATIONAL CONFERENCE ON DATA ENGINEERING. (ICDE'2002). SAN JOSE, CA, FEB. 26 - MARCH 1, 2002, INTERNATIONAL CONFERENCE ON DATA ENGINEERING. (ICDE), LOS ALAMITOS, CA : IEEE COMP. SOC, US, vol. CONF. 18, 26 February 2002 (2002-02-26), pages 473 - 482, XP010588261, ISBN: 0-7695-1531-2 *

Also Published As

Publication number Publication date
AU2003284216A1 (en) 2004-05-04
AU2003284216A8 (en) 2004-05-04
WO2004036424A2 (en) 2004-04-29

Similar Documents

Publication Publication Date Title
WO2002029539A3 (en) A data storage subsystem including a storage disk array employing dynamic data striping
AU1205801A (en) Load balancing configuration for storage arrays employing mirroring and striping
TW200644446A (en) Convolution-encoded data storage on a redundant array of independent devices
WO2003009124A3 (en) Data transmission from raid devices
WO2008082584A3 (en) System and method for symmetric triple parity
EP0874312A3 (en) Method of replacing faulty disks in a redundant array of disks
WO2008157081A3 (en) Distributed data storage using erasure resilient coding
AU2003271982A1 (en) Method and means for tolerating multiple dependent or arbitrary double disk failures in a disk array
EP1400899A3 (en) Accelerated RAID capable of returning to a previous state
WO2005043530A3 (en) Method of recovering data
WO2000058825A3 (en) Data distribution in a server cluster
CN106776112B (en) A kind of locality reparation coding method based on Pyramid code
CA2124753A1 (en) Modified buddy system for managing disk space
EP1343087A3 (en) Technique for correcting multiple storage device failures in a storage array
WO2005006173A3 (en) Data storage array
AU2003259297A8 (en) Consistent message ordering for semi-active and passive replication
AU6753000A (en) System and method for detecting double-bit errors and for correcting errors due to component failures
BRPI0514179A (en) method and apparatus for encoding and decoding data
JP2001249854A5 (en)
WO2004036424A3 (en) Efficient expansion of highly reliable storage arrays and clusters
CN102521067A (en) Redundant array of independent disks (RAID)-6 code with optimized partial strip writing performance and method for reconstructing RAID-6 code
IL172449A (en) Method and apparatus for encoding and decoding data
WO2005041045A3 (en) Methods of reading and writing data
WO2004057461A3 (en) Data division method and device using exclusive or calculation
TW200516381A (en) Autonomic parity exchange

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP