EP3713094A1 - Anwendung der mojette transformation zur korrektur von auslöschungen bei der verteilten speicherung von daten - Google Patents

Anwendung der mojette transformation zur korrektur von auslöschungen bei der verteilten speicherung von daten Download PDF

Info

Publication number
EP3713094A1
EP3713094A1 EP20160320.6A EP20160320A EP3713094A1 EP 3713094 A1 EP3713094 A1 EP 3713094A1 EP 20160320 A EP20160320 A EP 20160320A EP 3713094 A1 EP3713094 A1 EP 3713094A1
Authority
EP
European Patent Office
Prior art keywords
block
data
blocks
devices
parity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20160320.6A
Other languages
English (en)
French (fr)
Inventor
Johan Andersson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zebware AB
Original Assignee
Zebware AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zebware AB filed Critical Zebware AB
Publication of EP3713094A1 publication Critical patent/EP3713094A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/03—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
    • H03M13/05—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
    • H03M13/07—Arithmetic codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2089—Redundant storage control functionality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/03—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
    • H03M13/05—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
    • H03M13/13—Linear codes
    • H03M13/15—Cyclic codes, i.e. cyclic shifts of codewords produce other codewords, e.g. codes defined by a generator polynomial, Bose-Chaudhuri-Hocquenghem [BCH] codes
    • H03M13/151—Cyclic codes, i.e. cyclic shifts of codewords produce other codewords, e.g. codes defined by a generator polynomial, Bose-Chaudhuri-Hocquenghem [BCH] codes using error location or error correction polynomials
    • H03M13/154—Error and erasure correction, e.g. by using the error and erasure locator or Forney polynomial
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/37—Decoding methods or techniques, not specific to the particular type of coding provided for in groups H03M13/03 - H03M13/35
    • H03M13/373—Decoding methods or techniques, not specific to the particular type of coding provided for in groups H03M13/03 - H03M13/35 with erasure correction and erasure determination, e.g. for packet loss recovery or setting of erasures for the decoding of Reed-Solomon codes
EP20160320.6A 2019-03-22 2020-03-02 Anwendung der mojette transformation zur korrektur von auslöschungen bei der verteilten speicherung von daten Pending EP3713094A1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US201962822508P 2019-03-22 2019-03-22

Publications (1)

Publication Number Publication Date
EP3713094A1 true EP3713094A1 (de) 2020-09-23

Family

ID=69784075

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20160320.6A Pending EP3713094A1 (de) 2019-03-22 2020-03-02 Anwendung der mojette transformation zur korrektur von auslöschungen bei der verteilten speicherung von daten

Country Status (3)

Country Link
US (1) US11055175B2 (de)
EP (1) EP3713094A1 (de)
CN (1) CN111722796A (de)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017023199A1 (en) * 2015-07-31 2017-02-09 Zebware Ab Data integrity detection and correction
US20180048333A1 (en) * 2016-08-11 2018-02-15 Zebware Ab Device and associated methodoloy for encoding and decoding of data for an erasure code
US20190050293A1 (en) * 2011-11-01 2019-02-14 International Business Machines Corporation Updating an encoded data slice
US20190158120A1 (en) * 2017-11-20 2019-05-23 Zebware Ab Method and devices for a reduced repair and update erasure code

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0315157D0 (en) * 2003-06-28 2003-08-06 Ibm Safe write to multiply-redundant storage
TWI310497B (en) * 2004-02-06 2009-06-01 Hon Hai Prec Ind Co Ltd System and method for disk fault tolerance
US7934120B2 (en) * 2006-09-11 2011-04-26 International Business Machines Corporation Storing data redundantly
EP2660723A1 (de) * 2012-05-03 2013-11-06 Thomson Licensing Verfahren zur Datenspeicherung sowie Wartung in einem verteilten Datenspeicherungssystem und zugehörige Vorrichtung
EP2863566B1 (de) * 2013-10-18 2020-09-02 Université de Nantes Verfahren zur Rekonstruktion eines Datenblocks und Vorrichtung zur Verwendung davon
US9459958B2 (en) * 2013-12-02 2016-10-04 Annapurna Labs Ltd. Flexible redundant array of independent disks (RAID) computation device
US9965351B2 (en) * 2015-01-27 2018-05-08 Quantum Corporation Power savings in cold storage
US9940194B2 (en) * 2016-03-04 2018-04-10 Sandisk Technologies Llc ECC decoding using raid-type parity

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190050293A1 (en) * 2011-11-01 2019-02-14 International Business Machines Corporation Updating an encoded data slice
WO2017023199A1 (en) * 2015-07-31 2017-02-09 Zebware Ab Data integrity detection and correction
US20180048333A1 (en) * 2016-08-11 2018-02-15 Zebware Ab Device and associated methodoloy for encoding and decoding of data for an erasure code
US20190158120A1 (en) * 2017-11-20 2019-05-23 Zebware Ab Method and devices for a reduced repair and update erasure code

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DIMITRI PERTIN ET AL: "Performance evaluation of the Mojette erasure code for fault-tolerant distributed hot data storage", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 27 April 2015 (2015-04-27), XP080808751 *
PIERRE VERBERTVINCENT RICORDELJEAN-PIERRE GU'EDON: "ANALYSIS OF MOJETTE TRANS- FORM PROJECTIONS FOR AN EFFICIENT CODING", April 2004, WORKSHOP ON IMAGE ANALYSIS FOR MULTIMEDIA INTERACTIVE SERVICES (WIAMIS

Also Published As

Publication number Publication date
US11055175B2 (en) 2021-07-06
CN111722796A (zh) 2020-09-29
US20200301781A1 (en) 2020-09-24

Similar Documents

Publication Publication Date Title
US10013207B2 (en) Considering object health of a multi-region object
US10387249B2 (en) Migrating data slices within a dispersed storage network
US9104790B2 (en) Arranging data handling in a computer-implemented system in accordance with reliability ratings based on reverse predictive failure analysis in response to changes
US9251154B2 (en) Priority based reliability mechanism for archived data
US10289319B2 (en) Varying rebuild task priorities
US20120192037A1 (en) Data storage systems and methods having block group error correction for repairing unrecoverable read errors
US10440107B2 (en) Protecting encoded data slice integrity at various levels
US10996894B2 (en) Application storage segmentation reallocation
JP2013506191A (ja) 最大ｎ個までの記憶装置故障からの復旧を可能にするｎウェイパリティ技術
JP2018508073A (ja) データ除去、割り当て、及び再構築
US11074130B2 (en) Reducing rebuild time in a computing storage environment
US20120198195A1 (en) Data storage system and method
WO2024001494A1 (zh) 一种数据存储的方法、单节点服务器及设备
US10210062B2 (en) Data storage system comprising an array of drives
US10958731B2 (en) Indicating multiple encoding schemes in a dispersed storage network
EP3713094A1 (de) Anwendung der mojette transformation zur korrektur von auslöschungen bei der verteilten speicherung von daten
US10592132B2 (en) Read-foreign-slices request for improved read efficiency with bundled writes
US20190026147A1 (en) Avoiding index contention with distributed task queues in a distributed storage system
EP3596606B1 (de) Speichersystemsteuerung
US10423506B1 (en) Fast rebuild using layered RAID
US11463420B1 (en) Storage unit partial task processing
US20190213076A1 (en) Systems and methods for managing digital data in a fault tolerant matrix
US20190349431A1 (en) Rebuilding derived content
US10379961B2 (en) Ensuring metadata and index consistency using write intents
US11169731B2 (en) Managing storage resources in a dispersed storage network

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210322

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20220215