CN111095217A - 资源全局共享的基于raid机制的数据存储系统 - Google Patents

资源全局共享的基于raid机制的数据存储系统 Download PDF

Info

Publication number
CN111095217A
CN111095217A CN201780091514.4A CN201780091514A CN111095217A CN 111095217 A CN111095217 A CN 111095217A CN 201780091514 A CN201780091514 A CN 201780091514A CN 111095217 A CN111095217 A CN 111095217A
Authority
CN
China
Prior art keywords
data
stripe
disk
disks
block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780091514.4A
Other languages
English (en)
Other versions
CN111095217B (zh
Inventor
张广艳
郑纬民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Publication of CN111095217A publication Critical patent/CN111095217A/zh
Application granted granted Critical
Publication of CN111095217B publication Critical patent/CN111095217B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1092—Rebuilding, e.g. when physically replacing a failing disk
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1096—Parity calculation or recalculation after configuration or reconfiguration of the system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2089—Redundant storage control functionality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/104—Metadata, i.e. metadata associated with RAID systems with parity

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种资源全局共享的基于RAID机制的数据存储系统，包括第一数目个磁盘，以RAID机制来在各个磁盘上存储数据，不同磁盘上的分块组成条带，条带的分块中的至少一块存储奇偶校验信息，其中条带的宽度小于第一数目，以及数据存储系统的数据布局满足如下特征：条带内部任意的两个物理块分布在不同磁盘上；各个磁盘上分布的数据块相同，分布的校验块也相同；与任意一块磁盘数据相关的条带的其它数据均衡分布在剩余所有磁盘上。可以通过正交拉丁方来具体实现正常数据布局和降级数据布局。该系统能够解除通常数据存储系统中磁盘的数目与条带宽度相等的限制，打破各个磁盘组之间的资源隔离，并在磁盘发生故障时，实现重建读取负载的完全均衡。

Description

PCT国内申请，说明书已公开。

Claims (12)

  1. PCT国内申请，权利要求书已公开。
CN201780091514.4A 2017-11-13 2017-11-13 资源全局共享的基于raid机制的数据存储系统 Active CN111095217B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/110662 WO2019090756A1 (zh) 2017-11-13 2017-11-13 资源全局共享的基于raid机制的数据存储系统

Publications (2)

Publication Number Publication Date
CN111095217A true CN111095217A (zh) 2020-05-01
CN111095217B CN111095217B (zh) 2024-02-06

Family

ID=66438698

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780091514.4A Active CN111095217B (zh) 2017-11-13 2017-11-13 资源全局共享的基于raid机制的数据存储系统

Country Status (3)

Country Link
US (1) US10997025B2 (zh)
CN (1) CN111095217B (zh)
WO (1) WO2019090756A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113835637A (zh) * 2020-03-19 2021-12-24 北京奥星贝斯科技有限公司 一种数据的写入方法、装置以及设备
CN114415982A (zh) * 2022-03-30 2022-04-29 苏州浪潮智能科技有限公司 一种数据存储方法、装置、设备及可读存储介质
CN116149576A (zh) * 2023-04-20 2023-05-23 北京大学 面向服务器无感知计算的磁盘冗余阵列重建方法及系统

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111124249B (zh) 2018-10-30 2023-09-22 伊姆西Ip控股有限责任公司 用于数据处理的方法、设备和计算机程序产品
US11209990B2 (en) * 2019-03-15 2021-12-28 Super Micro Computer, Inc. Apparatus and method of allocating data segments in storage regions of group of storage units
CN110297601B (zh) * 2019-06-06 2020-06-23 清华大学 固态硬盘阵列构建方法、电子设备及存储介质
CN115712390B (zh) * 2022-11-14 2023-05-09 安超云软件有限公司 可用数据条带分片数确定方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101976176A (zh) * 2010-08-19 2011-02-16 北京同有飞骥科技有限公司 一种水平型分组并行分布校验的磁盘阵列的构建方法
US8261016B1 (en) * 2009-04-24 2012-09-04 Netapp, Inc. Method and system for balancing reconstruction load in a storage array using a scalable parity declustered layout
CN105930097A (zh) * 2015-05-20 2016-09-07 德州学院 一种消除局部并行中小写操作的分布校验式磁盘阵列
CN107250975A (zh) * 2014-12-09 2017-10-13 清华大学 数据存储系统和数据存储方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5488701A (en) * 1994-11-17 1996-01-30 International Business Machines Corporation In log sparing for log structured arrays
CN101482802A (zh) * 2009-02-18 2009-07-15 杭州华三通信技术有限公司 独立磁盘冗余阵列5扩展方法及装置
US8453036B1 (en) * 2010-02-01 2013-05-28 Network Appliance, Inc. System and method for dynamically resizing a parity declustered group
US20150205667A1 (en) * 2014-01-23 2015-07-23 DSSD, Inc. Method and system for service-aware data placement in a storage system
JP6369226B2 (ja) * 2014-08-28 2018-08-08 富士通株式会社 情報処理装置、情報処理システム、情報処理システムの制御方法および情報処理装置の制御プログラム
CN104765660B (zh) * 2015-04-24 2017-04-05 中国人民解放军国防科学技术大学 一种基于ssd的raid6系统的单盘快速恢复方法器

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8261016B1 (en) * 2009-04-24 2012-09-04 Netapp, Inc. Method and system for balancing reconstruction load in a storage array using a scalable parity declustered layout
CN101976176A (zh) * 2010-08-19 2011-02-16 北京同有飞骥科技有限公司 一种水平型分组并行分布校验的磁盘阵列的构建方法
CN107250975A (zh) * 2014-12-09 2017-10-13 清华大学 数据存储系统和数据存储方法
CN105930097A (zh) * 2015-05-20 2016-09-07 德州学院 一种消除局部并行中小写操作的分布校验式磁盘阵列

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113835637A (zh) * 2020-03-19 2021-12-24 北京奥星贝斯科技有限公司 一种数据的写入方法、装置以及设备
CN114415982A (zh) * 2022-03-30 2022-04-29 苏州浪潮智能科技有限公司 一种数据存储方法、装置、设备及可读存储介质
CN114415982B (zh) * 2022-03-30 2022-06-07 苏州浪潮智能科技有限公司 一种数据存储方法、装置、设备及可读存储介质
CN116149576A (zh) * 2023-04-20 2023-05-23 北京大学 面向服务器无感知计算的磁盘冗余阵列重建方法及系统
CN116149576B (zh) * 2023-04-20 2023-07-25 北京大学 面向服务器无感知计算的磁盘冗余阵列重建方法及系统

Also Published As

Publication number Publication date
US20200250036A1 (en) 2020-08-06
CN111095217B (zh) 2024-02-06
US10997025B2 (en) 2021-05-04
WO2019090756A1 (zh) 2019-05-16

Similar Documents

Publication Publication Date Title
CN111095217B (zh) 资源全局共享的基于raid机制的数据存储系统
US10140041B1 (en) Mapped RAID (redundant array of independent disks) in a data storage system with RAID extent sub-groups that are used to perform drive extent allocation and data striping for sequential data accesses to a storage object
US10210045B1 (en) Reducing concurrency bottlenecks while rebuilding a failed drive in a data storage system
US10146447B1 (en) Mapped RAID (redundant array of independent disks) in a data storage system with drive extents allocated to individual RAID extents from individual sub-groups of storage made up of ranges of logical block addresses defined across a group of hard disk drives
US20220107729A1 (en) Reorganizing disks and raid members to split a disk array during capacity expansion
US7328305B2 (en) Dynamic parity distribution technique
US8261016B1 (en) Method and system for balancing reconstruction load in a storage array using a scalable parity declustered layout
US20190129614A1 (en) Load Balancing of I/O by Moving Logical Unit (LUN) Slices Between Non-Volatile Storage Represented by Different Rotation Groups of RAID (Redundant Array of Independent Disks) Extent Entries in a RAID Extent Table of a Mapped RAID Data Storage System
US20100162044A1 (en) Method for erasure coding data across a plurality of data stores in a network
US11327668B1 (en) Predictable member assignment for expanding flexible raid system
JPH05505481A (ja) データ記憶装置および方法
US10310752B1 (en) Extent selection with mapped raid
US11340789B2 (en) Predictive redistribution of capacity in a flexible RAID system
US11144396B1 (en) Raid reliability with a provisional spare disk
US11281537B2 (en) Managing mapped raid extents in data storage systems
US10521145B1 (en) Method, apparatus and computer program product for managing data storage
CN104714758B (zh) 一种基于校验raid加入镜像结构的阵列构建方法及读写系统
CN105988727A (zh) 一种基于raid的存储方法和存储装置
CN102164165A (zh) 一种网络存储系统的管理方法及装置
US10977130B2 (en) Method, apparatus and computer program product for managing raid storage in data storage systems
US10776205B2 (en) Method, apparatus and computer program product for managing data storage in data storage systems
CN111124251B (zh) 用于i/o控制的方法、装置以及计算机可读介质
US11983414B2 (en) Successive raid distribution for single disk expansion with efficient and balanced spare capacity
JP4259800B2 (ja) データ格納装置、データ管理方法及びプログラム
US11860746B2 (en) Resilient data storage system with efficient space management

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant