CN103246480B - 用于raid中改善重建的系统和方法 - Google Patents

用于raid中改善重建的系统和方法 Download PDF

Info

Publication number
CN103246480B
CN103246480B CN201310031133.0A CN201310031133A CN103246480B CN 103246480 B CN103246480 B CN 103246480B CN 201310031133 A CN201310031133 A CN 201310031133A CN 103246480 B CN103246480 B CN 103246480B
Authority
CN
China
Prior art keywords
reconstruction
rebuild
raid
time
queue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310031133.0A
Other languages
English (en)
Chinese (zh)
Other versions
CN103246480A (zh
Inventor
雷门·奈尔
凯·M·勒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Avago Technologies International Sales Pte Ltd
Original Assignee
Avago Technologies Fiber IP Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Avago Technologies Fiber IP Singapore Pte Ltd filed Critical Avago Technologies Fiber IP Singapore Pte Ltd
Publication of CN103246480A publication Critical patent/CN103246480A/zh
Application granted granted Critical
Publication of CN103246480B publication Critical patent/CN103246480B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1092—Rebuilding, e.g. when physically replacing a failing disk
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/16—Protection against loss of memory contents
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0613—Improving I/O performance in relation to throughput
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Debugging And Monitoring (AREA)
CN201310031133.0A 2012-02-08 2013-01-26 用于raid中改善重建的系统和方法 Active CN103246480B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/368,725 US8751861B2 (en) 2012-02-08 2012-02-08 System and method for improved rebuild in RAID
US13/368,725 2012-02-08

Publications (2)

Publication Number Publication Date
CN103246480A CN103246480A (zh) 2013-08-14
CN103246480B true CN103246480B (zh) 2017-06-09

Family

ID=47632751

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310031133.0A Active CN103246480B (zh) 2012-02-08 2013-01-26 用于raid中改善重建的系统和方法

Country Status (6)

Country Link
US (1) US8751861B2 (enExample)
EP (1) EP2626780B1 (enExample)
JP (1) JP2013161476A (enExample)
KR (1) KR20130091628A (enExample)
CN (1) CN103246480B (enExample)
TW (1) TWI544344B (enExample)

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8707090B2 (en) * 2011-10-19 2014-04-22 Hitachi, Ltd. Storage system
US20140215147A1 (en) * 2013-01-25 2014-07-31 Hewlett-Packard Development Company, L.P. Raid storage rebuild processing
US10681134B2 (en) * 2013-07-31 2020-06-09 Pure Storage, Inc. Accelerated learning in adaptive rebuilding by applying observations to other samples
WO2015073042A1 (en) 2013-11-18 2015-05-21 Hewlett-Packard Development Company, L.P. Indicating rebuild state of storage devices
CN103677669B (zh) * 2013-11-29 2016-08-17 华为技术有限公司 调度io的方法和装置
US9075773B1 (en) * 2014-05-07 2015-07-07 Igneous Systems, Inc. Prioritized repair of data storage failures
US9921879B2 (en) 2014-05-13 2018-03-20 International Business Machines Corporation Using queues corresponding to attribute values associated with units of work to select the units of work to process
US9563366B2 (en) * 2014-05-13 2017-02-07 International Business Machines Corporation Using queues corresponding to attribute values associated with units of work and sub-units of the unit of work to select the units of work and their sub-units to process
US9575800B2 (en) 2014-05-13 2017-02-21 International Business Machines Corporation Using queues corresponding to attribute values and priorities associated with units of work and sub-units of the unit of work to select the units of work and their sub-units to process
US9201735B1 (en) 2014-06-25 2015-12-01 Igneous Systems, Inc. Distributed storage data repair air via partial data rebuild within an execution path
US9734007B2 (en) 2014-07-09 2017-08-15 Qualcomm Incorporated Systems and methods for reliably storing data using liquid distributed storage
US9582355B2 (en) * 2014-07-09 2017-02-28 Qualcomm Incorporated Systems and methods for reliably storing data using liquid distributed storage
US9594632B2 (en) * 2014-07-09 2017-03-14 Qualcomm Incorporated Systems and methods for reliably storing data using liquid distributed storage
US9053114B1 (en) 2014-08-07 2015-06-09 Igneous Systems, Inc. Extensible data path
US9098451B1 (en) 2014-11-21 2015-08-04 Igneous Systems, Inc. Shingled repair set for writing data
US9276900B1 (en) 2015-03-19 2016-03-01 Igneous Systems, Inc. Network bootstrapping for a distributed storage system
US9747042B2 (en) * 2015-06-30 2017-08-29 International Business Machines Corporation Statistic-based isolation of lethargic drives
CN105224243B (zh) * 2015-08-31 2018-06-12 深圳神州数码云科数据技术有限公司 一种磁盘阵列的初始化和重建的速度调节方法
US9798473B2 (en) 2015-10-29 2017-10-24 OWC Holdings, Inc. Storage volume device and method for increasing write speed for data streams while providing data protection
CN107203442B (zh) * 2016-03-16 2020-04-21 伊姆西Ip控股有限责任公司 独立磁盘冗余阵列的重建性能的评估方法和设备
CN107491263B (zh) * 2016-06-12 2022-07-22 北京忆恒创源科技股份有限公司 一种基于存储对象的数据重构方法
KR102611571B1 (ko) * 2016-11-09 2023-12-07 삼성전자주식회사 비휘발성 메모리를 포함하는 raid 시스템
CN106980468A (zh) * 2017-03-03 2017-07-25 杭州宏杉科技股份有限公司 触发raid阵列重建的方法及装置
WO2018165952A1 (zh) * 2017-03-16 2018-09-20 深圳大趋智能科技有限公司 iOS线程恢复的方法及装置
US10678643B1 (en) * 2017-04-26 2020-06-09 EMC IP Holding Company LLC Splitting a group of physical data storage drives into partnership groups to limit the risk of data loss during drive rebuilds in a mapped RAID (redundant array of independent disks) data storage system
CN107422989B (zh) * 2017-07-27 2020-04-07 深圳市云舒网络技术有限公司 一种Server SAN系统多副本读取方法及存储系统
US10691543B2 (en) 2017-11-14 2020-06-23 International Business Machines Corporation Machine learning to enhance redundant array of independent disks rebuilds
US10664187B2 (en) 2017-12-01 2020-05-26 International Business Machines Corporation Reducing a rate at which data is mirrored from a primary server to a secondary server
US10417069B2 (en) 2017-12-01 2019-09-17 International Business Machines Corporation Handling zero fault tolerance events in machines where failure likely results in unacceptable loss
US10725776B2 (en) 2017-12-01 2020-07-28 International Business Machines Corporation Reducing a rate at which requests are sent from one processor to another to reduce processor utilization at the processor receiving the requests
US10733053B1 (en) 2018-01-31 2020-08-04 Pure Storage, Inc. Disaster recovery for high-bandwidth distributed archives
CN110413209B (zh) * 2018-04-28 2023-05-30 伊姆西Ip控股有限责任公司 管理存储系统的方法和设备
US10824526B2 (en) 2018-08-03 2020-11-03 Western Digital Technologies, Inc. Using failed storage device in peer-to-peer storage system to perform storage-centric task
US10649843B2 (en) 2018-08-03 2020-05-12 Western Digital Technologies, Inc. Storage systems with peer data scrub
US10901848B2 (en) 2018-08-03 2021-01-26 Western Digital Technologies, Inc. Storage systems with peer data recovery
US10831603B2 (en) 2018-08-03 2020-11-10 Western Digital Technologies, Inc. Rebuild assist using failed storage device
US11099934B2 (en) * 2018-08-24 2021-08-24 International Business Machines Corporation Data rebuilding
US11182258B2 (en) 2019-01-04 2021-11-23 Western Digital Technologies, Inc. Data rebuild using dynamic peer work allocation
US10990480B1 (en) * 2019-04-05 2021-04-27 Pure Storage, Inc. Performance of RAID rebuild operations by a storage group controller of a storage system
US11194663B2 (en) * 2019-09-20 2021-12-07 DigitalOcean, LLC Protocol for improving rebuild times of redundant array of independent disks
CN111352584A (zh) * 2020-02-21 2020-06-30 北京天融信网络安全技术有限公司 一种数据重建方法及装置
CN111427515A (zh) * 2020-03-27 2020-07-17 杭州宏杉科技股份有限公司 Raid重建方法及装置
US11221765B2 (en) 2020-04-22 2022-01-11 Seagate Technology, Llc Apparatus and method for executing background operations using rotational position sorting
US11301162B2 (en) * 2020-05-31 2022-04-12 EMC IP Holding Company LLC Balancing resiliency and performance by selective use of degraded writes and spare capacity in storage systems
US11403175B2 (en) * 2020-07-31 2022-08-02 EMC IP Holding Company LLC Rebuilding data previously stored on a failed data storage drive
CN114385412A (zh) * 2020-10-22 2022-04-22 伊姆西Ip控股有限责任公司 存储管理方法、设备和计算机程序产品
CN112596818B (zh) * 2020-12-30 2023-12-05 上海众源网络有限公司 一种应用程序控制方法、系统及装置
CN114816221B (zh) * 2021-01-22 2025-07-18 伊姆西Ip控股有限责任公司 存储管理方法、设备和计算机程序产品
CN112887432B (zh) * 2021-03-31 2023-07-18 中国工商银行股份有限公司 分布式系统重建运维方法、运维节点及系统
US11593237B2 (en) 2021-05-28 2023-02-28 International Business Machines Corporation Fast recovery with enhanced raid protection
US11687258B2 (en) 2021-09-08 2023-06-27 Hewlett Packard Enterprise Development Lp Operational feature activation/disabling
CN114546279B (zh) * 2022-02-24 2023-11-14 重庆紫光华山智安科技有限公司 Io请求预测方法、装置、存储节点及可读存储介质
US12164366B2 (en) * 2022-12-08 2024-12-10 Dell Products L.P. Disk failure prediction using machine learning
TWI891531B (zh) * 2024-10-09 2025-07-21 宏碁股份有限公司 儲存裝置管理方法與資料儲存系統

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101576833A (zh) * 2009-06-26 2009-11-11 杭州华三通信技术有限公司 一种独立磁盘冗余阵列raid数据重建方法和装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2923702B2 (ja) * 1991-04-01 1999-07-26 株式会社日立製作所 記憶装置及びそのデータ修復方法
US5278838A (en) * 1991-06-18 1994-01-11 Ibm Corp. Recovery from errors in a redundant array of disk drives
US5313626A (en) * 1991-12-17 1994-05-17 Jones Craig S Disk drive array with efficient background rebuilding
US5822584A (en) * 1995-10-13 1998-10-13 Compaq Computer Corporation User selectable priority for disk array background operations
US6834386B1 (en) * 1999-07-16 2004-12-21 Microsoft Corporation Method and system for regulating background tasks using performance measurements
US6516425B1 (en) * 1999-10-29 2003-02-04 Hewlett-Packard Co. Raid rebuild using most vulnerable data redundancy scheme first
US6647514B1 (en) * 2000-03-23 2003-11-11 Hewlett-Packard Development Company, L.P. Host I/O performance and availability of a storage array during rebuild by prioritizing I/O request
US7139931B2 (en) * 2002-08-19 2006-11-21 Aristos Logic Corporation Method of controlling the system performance and reliability impact of hard disk drive rebuild
JP4322068B2 (ja) 2003-03-07 2009-08-26 富士通株式会社 ストレージシステム及びそのデイスク負荷バランス制御方法
JP4472617B2 (ja) * 2005-10-28 2010-06-02 富士通株式会社 Ｒａｉｄシステム、ｒａｉｄコントローラ及びそのリビルド／コピーバック処理方法
US7979635B2 (en) * 2008-02-14 2011-07-12 International Business Machines Corporation Apparatus and method to allocate resources in a data storage library
US8589625B2 (en) * 2010-09-15 2013-11-19 Pure Storage, Inc. Scheduling of reconstructive I/O read operations in a storage environment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101576833A (zh) * 2009-06-26 2009-11-11 杭州华三通信技术有限公司 一种独立磁盘冗余阵列raid数据重建方法和装置

Also Published As

Publication number Publication date
JP2013161476A (ja) 2013-08-19
TW201342082A (zh) 2013-10-16
US8751861B2 (en) 2014-06-10
TWI544344B (zh) 2016-08-01
CN103246480A (zh) 2013-08-14
EP2626780B1 (en) 2019-11-06
EP2626780A1 (en) 2013-08-14
KR20130091628A (ko) 2013-08-19
US20130205166A1 (en) 2013-08-08

Similar Documents

Publication Publication Date Title
CN103246480B (zh) 用于raid中改善重建的系统和方法
JP5289557B2 (ja) 分散データストレージシステムの信頼性の動的定量化と改善
US10082965B1 (en) Intelligent sparing of flash drives in data storage systems
CN105573660B (zh) 用于改善分簇磁盘阵列的性能的方法和装置
US9104316B2 (en) Runtime dynamic performance skew elimination
JP3078972B2 (ja) ディスクアレイ装置
CN101131675B (zh) 预防存储控制器的分区高速缓存中写饥饿的装置和方法
US10346245B2 (en) Data storage system and data storage method
US7330932B2 (en) Disk array with spare logic drive created from space physical drives
US20170090793A1 (en) Devices and methods for a data storage device
US10860260B2 (en) Method, apparatus and computer program product for managing storage system
EP2338119A1 (en) Power and performance management using maidx and adaptive data placement
JP6565560B2 (ja) ストレージ制御装置、及び制御プログラム
CN107239233A (zh) 一种磁盘阵列及基于其的数据重构方法和存储设备
DE10317925A1 (de) Steuerungskommunikation über eine ständig eingeschaltete Steuerungsverbindung
US20150378622A1 (en) Management of data operations
JP6622273B2 (ja) リソース管理装置、リソース管理方法、及びリソース管理プログラム
US20070050670A1 (en) Disk array apparatus, method for controlling the same, and program
CN114063929A (zh) 基于双控制器硬盘阵列的局部raid重构系统及方法
CN116414295A (zh) 用于存储管理的方法、设备和计算机程序产品
LeFevre Improving disk array reliability and performance
JP2006260446A (ja) ディスクアレイ装置
JP2002182863A (ja) 冗長階層データ記憶システムにおける適時なデータ移行方法
Klein et al. Optimizing RAID for long term data archives

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) CORPORAT

Free format text: FORMER OWNER: INFINEON TECHNOLOGIES CORP.

Effective date: 20150819

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20150819

Address after: Singapore Singapore

Applicant after: Avago Technologies General IP (Singapore) Pte. Ltd.

Address before: Milpitas, California, USA

Applicant before: LSI Corp.

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20181017

Address after: Singapore Singapore

Patentee after: Avago Technologies General IP (Singapore) Pte. Ltd.

Address before: Singapore Singapore

Patentee before: Avago Technologies General IP (Singapore) Pte. Ltd.

TR01 Transfer of patent right