TWI788554B - 用於儲存裝置協助低頻寬資料修補的設備與系統 - Google Patents

用於儲存裝置協助低頻寬資料修補的設備與系統 Download PDF

Info

Publication number
TWI788554B
TWI788554B TW108112265A TW108112265A TWI788554B TW I788554 B TWI788554 B TW I788554B TW 108112265 A TW108112265 A TW 108112265A TW 108112265 A TW108112265 A TW 108112265A TW I788554 B TWI788554 B TW I788554B
Authority
TW
Taiwan
Prior art keywords
data
code
storage device
host device
regeneration
Prior art date
Application number
TW108112265A
Other languages
English (en)
Chinese (zh)
Other versions
TW202018503A (zh
Inventor
瑞克哈 皮茲馬尼
奇亮奭
Original Assignee
南韓商三星電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南韓商三星電子股份有限公司 filed Critical 南韓商三星電子股份有限公司
Publication of TW202018503A publication Critical patent/TW202018503A/zh
Application granted granted Critical
Publication of TWI788554B publication Critical patent/TWI788554B/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1008—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
    • G06F11/1012—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices using codes or arrangements adapted for a specific type of error
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1088—Reconstruction on already foreseen single or plurality of spare disks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Computer Security & Cryptography (AREA)
  • Detection And Correction Of Errors (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
TW108112265A 2018-06-08 2019-04-09 用於儲存裝置協助低頻寬資料修補的設備與系統 TWI788554B (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862682763P 2018-06-08 2018-06-08
US62/682,763 2018-06-08
US16/103,907 US10719397B2 (en) 2018-06-08 2018-08-14 System, device and method for storage device assisted low-bandwidth data repair
US16/103,907 2018-08-14

Publications (2)

Publication Number Publication Date
TW202018503A TW202018503A (zh) 2020-05-16
TWI788554B true TWI788554B (zh) 2023-01-01

Family

ID=68763832

Family Applications (1)

Application Number Title Priority Date Filing Date
TW108112265A TWI788554B (zh) 2018-06-08 2019-04-09 用於儲存裝置協助低頻寬資料修補的設備與系統

Country Status (5)

Country Link
US (4) US10719397B2 (enExample)
JP (1) JP7187387B2 (enExample)
KR (1) KR102434917B1 (enExample)
CN (1) CN110580204B (enExample)
TW (1) TWI788554B (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10719397B2 (en) * 2018-06-08 2020-07-21 Samsung Electronics Co., Ltd. System, device and method for storage device assisted low-bandwidth data repair
WO2020160142A1 (en) * 2019-01-29 2020-08-06 ClineHair Commercial Endeavors Encoding and storage node repairing method for minimum storage regenerating codes for distributed storage systems
US12306717B2 (en) 2020-05-11 2025-05-20 Samsung Electronics Co., Ltd. Systems, methods, and devices for data recovery using parity space as recovery space
US12321236B2 (en) 2020-05-11 2025-06-03 Samsung Electronics Co., Ltd. Systems, methods, and devices for fault resilient storage
US12298853B2 (en) 2020-05-11 2025-05-13 Samsung Electronics Co., Ltd. Systems, methods, and devices for data recovery with spare storage device and fault resilient storage device
US12026055B2 (en) 2020-07-13 2024-07-02 Samsung Electronics Co., Ltd. Storage device with fault resilient read-only mode
US11340986B1 (en) 2020-12-08 2022-05-24 Western Digital Technologies, Inc. Host-assisted storage device error correction
JP7140424B1 (ja) * 2021-06-18 2022-09-21 Ｎｅｃプラットフォームズ株式会社 コンピュータ装置、情報処理方法、プログラム
CN113656346B (zh) * 2021-09-03 2024-07-16 西安紫光国芯半导体有限公司 一种三维芯片及计算系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201201017A (en) * 2010-01-27 2012-01-01 Toshiba Kk Memory device and host device
CN104035903A (zh) * 2014-07-02 2014-09-10 东南大学 一种基于可重构技术的二维数据访问动态自适应方法
US20150205664A1 (en) * 2014-01-17 2015-07-23 Fusion-Io, Inc. Determining a configuration parameter using a soft read command
US20160110252A1 (en) * 2014-10-20 2016-04-21 SanDisk Technologies, Inc. Distributing storage of ecc code words
US20170161148A1 (en) * 2015-12-02 2017-06-08 Netapp, Inc. Detection of and recovery from silent data loss in an erasure-coded storage system
US20180060169A1 (en) * 2016-08-26 2018-03-01 Netapp, Inc. Multiple node repair using high rate minimum storage regeneration erasure code

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8751859B2 (en) 2007-05-10 2014-06-10 International Business Machines Corporation Monitoring lost data in a storage system
JP2009289170A (ja) * 2008-05-30 2009-12-10 Nec Electronics Corp データ処理装置、メモリコントローラ及びそのアクセス制御方法
US8281227B2 (en) 2009-05-18 2012-10-02 Fusion-10, Inc. Apparatus, system, and method to increase data integrity in a redundant storage system
EP2702502A4 (en) 2011-04-29 2015-06-03 Tata Consultancy Services Ltd ARCHIVING AND RECOVERY SYSTEM
US8713404B2 (en) * 2011-07-01 2014-04-29 Apple Inc. Controller interface providing improved data reliability
US8519737B2 (en) * 2011-07-01 2013-08-27 Apple Inc. Controller interface providing improved signal integrity
US9031922B2 (en) * 2012-05-02 2015-05-12 Microsoft Technology Licensing, Llc Code regeneration determination from selected metadata fingerprints
US9058122B1 (en) * 2012-08-30 2015-06-16 Google Inc. Controlling access in a single-sided distributed storage system
US20150006846A1 (en) * 2013-06-28 2015-01-01 Saratoga Speed, Inc. Network system to distribute chunks across multiple physical nodes with disk support for object storage
US9697226B1 (en) * 2013-06-28 2017-07-04 Sanmina Corporation Network system to distribute chunks across multiple physical nodes
US9152495B2 (en) * 2013-07-03 2015-10-06 SanDisk Technologies, Inc. Managing non-volatile media using multiple error correcting codes
US10073731B2 (en) * 2013-11-27 2018-09-11 Intel Corporation Error correction in memory
US9367562B2 (en) * 2013-12-05 2016-06-14 Google Inc. Distributing data on distributed storage systems
US9292389B2 (en) * 2014-01-31 2016-03-22 Google Inc. Prioritizing data reconstruction in distributed storage systems
US9323615B2 (en) * 2014-01-31 2016-04-26 Google Inc. Efficient data reads from distributed storage systems
US9223644B1 (en) * 2014-02-25 2015-12-29 Google Inc. Preventing unnecessary data recovery
US9804925B1 (en) * 2014-02-25 2017-10-31 Google Inc. Data reconstruction in distributed storage systems
US9311194B1 (en) * 2014-03-28 2016-04-12 Google Inc. Efficient resource utilization in data centers
US9239757B2 (en) * 2014-05-30 2016-01-19 Sandisk Technologies Inc. Method and apparatus for relocating data in non-volatile memory
US9740610B2 (en) * 2014-12-24 2017-08-22 Intel Corporation Polarity based data transfer function for volatile memory
US9811420B2 (en) 2015-03-27 2017-11-07 Intel Corporation Extracting selective information from on-die dynamic random access memory (DRAM) error correction code (ECC)
KR101609510B1 (ko) * 2015-04-10 2016-04-06 홍익대학교 산학협력단 에러를 검출하고 수정하는 컴퓨팅 방법 및 장치
WO2017041233A1 (zh) * 2015-09-08 2017-03-16 广东超算数据安全技术有限公司 一种功能修复再生码的编码和存储节点修复方法
US10360119B2 (en) * 2015-10-06 2019-07-23 Netapp, Inc. Data recovery in a distributed storage system
CN108140016B (zh) * 2015-10-12 2021-02-23 华为技术有限公司 确定矩阵-向量相乘的运算最优序列的优化器
US20170179979A1 (en) * 2015-12-18 2017-06-22 Netapp, Inc. Systems and Methods for Minimum Storage Regeneration Erasure Code Construction Using r-Ary Trees
US10019317B2 (en) 2016-04-25 2018-07-10 Nexenta Systems, Inc. Parity protection for data chunks in an object storage system
US20170329684A1 (en) 2016-05-13 2017-11-16 Synology Incorporated Method and apparatus for performing data recovery in redundant storage system
US10372534B2 (en) * 2016-09-20 2019-08-06 Samsung Electronics Co., Ltd. Method of operating memory device using a compressed party difference, memory device using the same and memory system including the device
US10740198B2 (en) * 2016-12-22 2020-08-11 Purdue Research Foundation Parallel partial repair of storage
US20190095296A1 (en) * 2017-09-27 2019-03-28 Hewlett Packard Enterprise Development Lp Reading or Reconstructing Requested Data from RAID Volume
US11329817B2 (en) * 2017-10-19 2022-05-10 Devi Selva Kumar Vijayanarayanan Protecting data using controlled corruption in computer networks
US10719397B2 (en) * 2018-06-08 2020-07-21 Samsung Electronics Co., Ltd. System, device and method for storage device assisted low-bandwidth data repair

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201201017A (en) * 2010-01-27 2012-01-01 Toshiba Kk Memory device and host device
US20150205664A1 (en) * 2014-01-17 2015-07-23 Fusion-Io, Inc. Determining a configuration parameter using a soft read command
CN104035903A (zh) * 2014-07-02 2014-09-10 东南大学 一种基于可重构技术的二维数据访问动态自适应方法
US20160110252A1 (en) * 2014-10-20 2016-04-21 SanDisk Technologies, Inc. Distributing storage of ecc code words
US20170161148A1 (en) * 2015-12-02 2017-06-08 Netapp, Inc. Detection of and recovery from silent data loss in an erasure-coded storage system
US20180060169A1 (en) * 2016-08-26 2018-03-01 Netapp, Inc. Multiple node repair using high rate minimum storage regeneration erasure code

Also Published As

Publication number Publication date
JP7187387B2 (ja) 2022-12-12
KR102434917B1 (ko) 2022-08-22
JP2019212310A (ja) 2019-12-12
US11940875B2 (en) 2024-03-26
KR20190139752A (ko) 2019-12-18
CN110580204A (zh) 2019-12-17
US20190377637A1 (en) 2019-12-12
US20240345923A1 (en) 2024-10-17
US20230016236A1 (en) 2023-01-19
TW202018503A (zh) 2020-05-16
US12346202B2 (en) 2025-07-01
CN110580204B (zh) 2022-12-06
US11449387B2 (en) 2022-09-20
US20200349006A1 (en) 2020-11-05
US10719397B2 (en) 2020-07-21

Similar Documents

Publication Publication Date Title
TWI788554B (zh) 用於儲存裝置協助低頻寬資料修補的設備與系統
TWI791891B (zh) 用於錯誤修正代碼的加速的裝置及系統
US10715181B2 (en) Facilitation of data deletion for distributed erasure coding
US9304852B2 (en) Combined asynchronous and synchronous fountain code storage in an object store
US20190042103A1 (en) Resilient external memory
WO2019084916A1 (zh) 恢复fpga芯片中的逻辑的方法、系统和fpga设备
CN105378676A (zh) 本地生成的简单纠删码
WO2018054081A1 (zh) 故障处理方法、虚拟架构管理系统和业务管理系统
WO2021120585A1 (zh) 数据存储方法、装置、设备及存储介质
CN104750428A (zh) 块储存存取和网关模块、储存系统和方法与内容递送装置
KR20190113544A (ko) 대역 내 dram ecc
CN105468387A (zh) 升级处理方法、装置和系统
CN116302659B (zh) Gpu显存错误处理方法及装置、电子设备和存储介质
WO2017041671A1 (zh) 故障恢复的方法和装置
CN111506450B (zh) 用于数据处理的方法、设备和计算机程序产品
US11171671B2 (en) Reducing vulnerability window in key value storage server without sacrificing usable capacity
US11663079B2 (en) Data recovery using a combination of error correction schemes
CN107463462B (zh) 数据修复方法及数据修复装置
US11347596B2 (en) Preliminary data protection using composite copies of data in a data storage system
CN104572350A (zh) 一种元数据处理方法及装置