AU2001249741A1 - Tightly coupled secondary storage system and file system - Google Patents

Tightly coupled secondary storage system and file system

Info

Publication number
AU2001249741A1
AU2001249741A1 AU2001249741A AU4974101A AU2001249741A1 AU 2001249741 A1 AU2001249741 A1 AU 2001249741A1 AU 2001249741 A AU2001249741 A AU 2001249741A AU 4974101 A AU4974101 A AU 4974101A AU 2001249741 A1 AU2001249741 A1 AU 2001249741A1
Authority
AU
Australia
Prior art keywords
storage
access
sau
saus
file system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
AU2001249741A
Inventor
Alexandru Mitaru
Michael Powell
Richard W. Stallkamp
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omneon Inc
Original Assignee
Omneon Video Networks Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omneon Video Networks Inc filed Critical Omneon Video Networks Inc
Publication of AU2001249741A1 publication Critical patent/AU2001249741A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1016—Continuous RAID, i.e. RAID system that allows streaming or continuous media, e.g. VOD
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1021—Different size blocks, i.e. mapping of blocks of different size in RAID systems with parity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/103—Hybrid, i.e. RAID systems with parity comprising a mix of RAID types
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/104—Metadata, i.e. metadata associated with RAID systems with parity

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Hardware Redundancy (AREA)
  • Retry When Errors Occur (AREA)

Abstract

A fault tolerant, secondary storage engine (such as a RAID engine) is closely coupled with a file system to achieve greater overall throughput in storage/database applications having a mix of large, sequential access transactions and small, random access transactions. In addition, disk rebuild time may be greatly reduced using such an embodiment. A logical storage space representing a storage area in a set of non-volatile storage devices is divided into nonoverlapping storage allocation units (SAUs) such as stripes, each SAU to overlay all of the devices in the set. Different fault tolerant storage methodologies (FTSMs) are assigned to access (i.e. read/write) data in the different SAUs, respectively. An access is made to an SAU in the set responsive to an input storage request of a first or second type, respectively.
AU2001249741A 2000-04-07 2001-03-28 Tightly coupled secondary storage system and file system Abandoned AU2001249741A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/544,946 US6571351B1 (en) 2000-04-07 2000-04-07 Tightly coupled secondary storage system and file system
US09544946 2000-04-07
PCT/US2001/010526 WO2001077829A2 (en) 2000-04-07 2001-03-28 Multi-device storage system with differing fault tolerant methodologies

Publications (1)

Publication Number Publication Date
AU2001249741A1 true AU2001249741A1 (en) 2001-10-23

Family

ID=24174233

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2001249741A Abandoned AU2001249741A1 (en) 2000-04-07 2001-03-28 Tightly coupled secondary storage system and file system

Country Status (6)

Country Link
US (1) US6571351B1 (en)
EP (1) EP1272931B1 (en)
AT (1) ATE296464T1 (en)
AU (1) AU2001249741A1 (en)
DE (1) DE60111039T2 (en)
WO (1) WO2001077829A2 (en)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6675318B1 (en) * 2000-07-25 2004-01-06 Sun Microsystems, Inc. Two-dimensional storage array with prompt parity in one dimension and delayed parity in a second dimension
US7533405B2 (en) * 2000-08-30 2009-05-12 Panasonic Corporation Nonlinear broadcast system
US6996742B2 (en) * 2000-11-28 2006-02-07 Sedna Patent Services, Llc Method for regenerating and streaming content from a video server using RAID 5 data striping
US20020069317A1 (en) * 2000-12-01 2002-06-06 Chow Yan Chiew E-RAID system and method of operating the same
US6775794B1 (en) * 2001-05-23 2004-08-10 Applied Micro Circuits Corporation Use of activity bins to increase the performance of disk arrays
US6904540B2 (en) * 2001-10-29 2005-06-07 Hewlett-Packard Development Company, L.P. Targeted data protection
US7788396B2 (en) * 2001-11-28 2010-08-31 Interactive Content Engines, Llc Synchronized data transfer system
US7644136B2 (en) * 2001-11-28 2010-01-05 Interactive Content Engines, Llc. Virtual file system
JP3579389B2 (en) * 2001-11-30 2004-10-20 株式会社東芝 Disk array device and data recovery method in the device
JP3682256B2 (en) * 2001-11-30 2005-08-10 株式会社東芝 Disk array device and parity processing method in the same
US7024586B2 (en) * 2002-06-24 2006-04-04 Network Appliance, Inc. Using file system information in raid data reconstruction and migration
WO2004099988A1 (en) * 2003-05-05 2004-11-18 Trustees Of Boston University Data storage distribution and retrieval
US7386663B2 (en) * 2004-05-13 2008-06-10 Cousins Robert E Transaction-based storage system and method that uses variable sized objects to store data
US20060041793A1 (en) * 2004-08-17 2006-02-23 Dell Products L.P. System, method and software for enhanced raid rebuild
US8555109B2 (en) 2009-07-30 2013-10-08 Cleversafe, Inc. Method and apparatus for distributed storage integrity processing
US8352782B2 (en) * 2005-09-30 2013-01-08 Cleversafe, Inc. Range based rebuilder for use with a dispersed data storage network
US8880799B2 (en) * 2005-09-30 2014-11-04 Cleversafe, Inc. Rebuilding data on a dispersed storage network
US11620185B2 (en) 2005-09-30 2023-04-04 Pure Storage, Inc. Integrity processing in a dispersed storage network
US10860424B1 (en) 2005-09-30 2020-12-08 Pure Storage, Inc. Background verification processing in a storage network
US11221917B1 (en) 2005-09-30 2022-01-11 Pure Storage, Inc. Integrity processing in a dispersed storage network
US7644303B2 (en) * 2005-10-07 2010-01-05 Agere Systems Inc. Back-annotation in storage-device array
US7769948B2 (en) * 2005-10-07 2010-08-03 Agere Systems Inc. Virtual profiles for storage-device array encoding/decoding
US8291161B2 (en) * 2005-10-07 2012-10-16 Agere Systems Llc Parity rotation in storage-device array
US7653783B2 (en) * 2005-10-07 2010-01-26 Agere Systems Inc. Ping-pong state machine for storage-device array
US20090013213A1 (en) * 2007-07-03 2009-01-08 Adaptec, Inc. Systems and methods for intelligent disk rebuild and logical grouping of san storage zones
US7861036B2 (en) * 2007-09-18 2010-12-28 Agere Systems Inc. Double degraded array protection in an integrated network attached storage device
US8001417B2 (en) * 2007-12-30 2011-08-16 Agere Systems Inc. Method and apparatus for repairing uncorrectable drive errors in an integrated network attached storage device
US8706980B2 (en) * 2009-07-30 2014-04-22 Cleversafe, Inc. Method and apparatus for slice partial rebuilding in a dispersed storage network
US9152514B2 (en) * 2009-11-24 2015-10-06 Cleversafe, Inc. Rebuilding a data segment in a dispersed storage network
US9270298B2 (en) * 2009-11-24 2016-02-23 International Business Machines Corporation Selecting storage units to rebuild an encoded data slice
US8918897B2 (en) * 2009-11-24 2014-12-23 Cleversafe, Inc. Dispersed storage network data slice integrity verification
US8464090B2 (en) 2010-09-21 2013-06-11 International Business Machines Corporation Recovery of failed disks in an array of disks
US9201747B2 (en) * 2010-11-26 2015-12-01 Telefonaktiebolaget L M Ericsson (Publ) Real time database system
JP2013058172A (en) * 2011-09-09 2013-03-28 Toshiba Corp Video recording/reproducing device, recording method and reconstructing method
US9842117B1 (en) * 2014-12-29 2017-12-12 EMC IP Holding Company LLC Managing replication of file systems
US10001947B1 (en) * 2015-05-08 2018-06-19 American Megatrends, Inc. Systems, methods and devices for performing efficient patrol read operations in a storage system
US9952769B2 (en) 2015-09-14 2018-04-24 Microsoft Technology Licensing, Llc. Data storage system with data storage devices operative to manage storage device functions specific to a particular data storage device
CN108228085A (en) * 2016-12-21 2018-06-29 伊姆西Ip控股有限责任公司 For managing the method and apparatus of storage system
CN115309348B (en) * 2022-10-11 2023-03-10 苏州浪潮智能科技有限公司 Metadata management method and device, computer equipment and storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5166939A (en) 1990-03-02 1992-11-24 Micro Technology, Inc. Data storage apparatus and method
DE69131551T2 (en) 1990-11-09 2000-02-17 Emc Corp Logical division of a storage system with redundant matrix
JP3183719B2 (en) 1992-08-26 2001-07-09 三菱電機株式会社 Array type recording device
JP3188071B2 (en) 1993-10-14 2001-07-16 富士通株式会社 Disk cache device
US5732239A (en) 1994-05-19 1998-03-24 Starlight Networks Method for operating a disk storage system which stores video data so as to maintain the continuity of a plurality of video streams
US5657468A (en) 1995-08-17 1997-08-12 Ambex Technologies, Inc. Method and apparatus for improving performance in a reduntant array of independent disks
US6161192A (en) 1995-10-13 2000-12-12 Compaq Computer Corporation Raid array data storage system with storage device consistency bits and raidset consistency bits
JP3641872B2 (en) 1996-04-08 2005-04-27 株式会社日立製作所 Storage system

Also Published As

Publication number Publication date
WO2001077829A2 (en) 2001-10-18
ATE296464T1 (en) 2005-06-15
EP1272931A2 (en) 2003-01-08
EP1272931B1 (en) 2005-05-25
US6571351B1 (en) 2003-05-27
DE60111039D1 (en) 2005-06-30
WO2001077829A3 (en) 2002-04-04
DE60111039T2 (en) 2006-05-04

Similar Documents

Publication Publication Date Title
AU2001249741A1 (en) Tightly coupled secondary storage system and file system
US10031675B1 (en) Method and system for tiering data
CN101587425B (en) Method and device for increasing magnetic disc redundant array redundancy
US6631456B2 (en) Hypercache RAM based disk emulation and method
Bonwick et al. The zettabyte file system
CN101814045B (en) Data organization method for backup services
CN101286165B (en) Multiple concurrent active file systems
WO2005043378A3 (en) Dynamic parity distribution technique
US8612678B2 (en) Creating logical disk drives for raid subsystems
US9009424B2 (en) Data placement for loss protection in a storage system
Cidon et al. Tiered replication: A cost-effective alternative to full cluster geo-replication
CN102831069B (en) Internal memory processing method, memory management equipment
CN105027122A (en) Compression and deduplication layered driver
MY137598A (en) File management method
CA2590361A1 (en) Dynamically expandable and contractible fault-tolerant storage system permitting variously sized storage devices and method
CN101510145B (en) Storage system management method and apparatus
HK1013871A1 (en) Method and file system for allocating blocks of files to storage space in a raid disk system
CN101576833A (en) Data reconstruction method for Redundant Array of Independent Disks (RAID) and appliance thereof
CN102187317A (en) Flashcopy handling
US20160117120A1 (en) Systems and methods for optimizing write accesses in a storage array
CN106776106A (en) A kind of date storage method based on NandFlash
CN104281717B (en) A kind of method for setting up magnanimity ID mapping relations
CN106227731A (en) A kind of data processing method, device and distributed file system
CN104809178A (en) Write-in method of key/value database memory log
CN107632780A (en) A kind of roll of strip implementation method and its storage architecture based on distributed memory system