CN103703446A - 网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置 - Google Patents

网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置 Download PDF

Info

Publication number
CN103703446A
CN103703446A CN201280032806.8A CN201280032806A CN103703446A CN 103703446 A CN103703446 A CN 103703446A CN 201280032806 A CN201280032806 A CN 201280032806A CN 103703446 A CN103703446 A CN 103703446A
Authority
CN
China
Prior art keywords
data
matrix
memory node
failure
node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201280032806.8A
Other languages
English (en)
Other versions
CN103703446B (zh
Inventor
李挥
缪伟豪
黄显霞
鲁跃
傅峰春
王茂亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China United Television Co ltd
Peking University Shenzhen Graduate School
Original Assignee
China United Television Co ltd
Peking University Shenzhen Graduate School
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China United Television Co ltd, Peking University Shenzhen Graduate School filed Critical China United Television Co ltd
Publication of CN103703446A publication Critical patent/CN103703446A/zh
Application granted granted Critical
Publication of CN103703446B publication Critical patent/CN103703446B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/64—Hybrid switching systems
    • H04L12/6418—Hybrid transport
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1004—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems

Abstract

本发明涉及一种网络存储中抗拜占庭失效的数据重构方法：从k个存储节点下载其所存储的编码数据和校验值，得到矩阵Y并得到CRC校验和；对矩阵Y进行错误擦除解码，得到码字C′；由码字C′得到信息序列m′并判断信息序列m′能否通过CRC校验，依据判断结果结束数据恢复或再下载两个新的节点存储的编码数据和校验值，再次得到矩阵Y和校验和，继续上述过程直到得到通过校验的信息序列m′；否则，解码失败退出。本发明还涉及一种数据恢复装置、失效数据修复方法及装置。实施本发明的网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置，具有以下有益效果：可以抗拜占庭失效节点、数据传输有误时还有进一步的方法来恢复存储数据。

Description

PCT国内申请，说明书已公开。

Claims (1)

  1. PCT国内申请，权利要求书已公开。
CN201280032806.8A 2012-06-11 2012-06-11 网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置 Active CN103703446B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/076694 WO2013185271A1 (zh) 2012-06-11 2012-06-11 网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置

Publications (2)

Publication Number Publication Date
CN103703446A true CN103703446A (zh) 2014-04-02
CN103703446B CN103703446B (zh) 2016-08-17

Family

ID=49757397

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280032806.8A Active CN103703446B (zh) 2012-06-11 2012-06-11 网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置

Country Status (2)

Country Link
CN (1) CN103703446B (zh)
WO (1) WO2013185271A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109144768A (zh) * 2017-06-16 2019-01-04 西部数据技术公司 在纠删码编码期间的cpu错误修复
CN111224747A (zh) * 2019-12-19 2020-06-02 湖北大学 可降低修复带宽和磁盘读取开销的编码方法及其修复方法
CN113296999A (zh) * 2021-05-20 2021-08-24 山东云海国创云计算装备产业创新中心有限公司 一种raid6编码方法及编码电路
CN114205370A (zh) * 2020-08-28 2022-03-18 希捷科技有限公司 具有拜占庭攻击弹性的分布式安全边缘异构存储网络
CN114244853A (zh) * 2021-11-29 2022-03-25 国网北京市电力公司 大数据共享方法、装置以及大数据共享系统
CN116560957A (zh) * 2023-04-21 2023-08-08 珠海云艺网络科技有限公司 一种受损文档修复结果的测试方法、系统、装置及介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1859115A (zh) * 2006-01-24 2006-11-08 华为技术有限公司 一种网络数据的分布式存储下载系统、设备及方法
US7555673B1 (en) * 2002-10-17 2009-06-30 Symantec Operating Corporation Cluster failover for storage management services
US7657781B1 (en) * 2003-07-25 2010-02-02 Cisco Technology, Inc. System and method for providing redundant data load sharing in a distributed network

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7555673B1 (en) * 2002-10-17 2009-06-30 Symantec Operating Corporation Cluster failover for storage management services
US7657781B1 (en) * 2003-07-25 2010-02-02 Cisco Technology, Inc. System and method for providing redundant data load sharing in a distributed network
CN1859115A (zh) * 2006-01-24 2006-11-08 华为技术有限公司 一种网络数据的分布式存储下载系统、设备及方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
姜春茂,张国印,曲明成: "一种P2P分布式系统高可靠数据恢复模型", 《哈尔滨工程大学学报》, vol. 33, no. 3, 31 March 2012 (2012-03-31) *
常乾: "基于网络编码的分布式文件系统设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》, 15 January 2010 (2010-01-15) *
蔡鸾佳: "拜占庭容错纠删码分布式存储协议", 《计算机系统应用》, vol. 21, no. 2, 15 February 2012 (2012-02-15) *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109144768A (zh) * 2017-06-16 2019-01-04 西部数据技术公司 在纠删码编码期间的cpu错误修复
CN109144768B (zh) * 2017-06-16 2021-12-17 西部数据技术公司 用于数据编码的系统及其计算机实现方法
CN111224747A (zh) * 2019-12-19 2020-06-02 湖北大学 可降低修复带宽和磁盘读取开销的编码方法及其修复方法
CN114205370A (zh) * 2020-08-28 2022-03-18 希捷科技有限公司 具有拜占庭攻击弹性的分布式安全边缘异构存储网络
CN113296999A (zh) * 2021-05-20 2021-08-24 山东云海国创云计算装备产业创新中心有限公司 一种raid6编码方法及编码电路
CN114244853A (zh) * 2021-11-29 2022-03-25 国网北京市电力公司 大数据共享方法、装置以及大数据共享系统
CN116560957A (zh) * 2023-04-21 2023-08-08 珠海云艺网络科技有限公司 一种受损文档修复结果的测试方法、系统、装置及介质

Also Published As

Publication number Publication date
WO2013185271A1 (zh) 2013-12-19
CN103703446B (zh) 2016-08-17

Similar Documents

Publication Publication Date Title
CN107656832B (zh) 一种低数据重建开销的纠删码方法
Hou et al. Rack-aware regenerating codes for data centers
US9600365B2 (en) Local erasure codes for data storage
CN104052576B (zh) 一种云存储下基于纠错码的数据恢复方法
CN103124182B (zh) 文件下载和流系统
CN103688515B (zh) 一种最小带宽再生码的编码和存储节点修复方法
CN103703446A (zh) 网络存储中抗拜占庭失效的数据重构、失效数据恢复方法及装置
CN111149093B (zh) 分布式存储系统的数据编码、解码及修复方法
Shum et al. Exact minimum-repair-bandwidth cooperative regenerating codes for distributed storage systems
Silberstein et al. Error resilience in distributed storage via rank-metric codes
Han et al. Exact regenerating codes for byzantine fault tolerance in distributed storage
CN107179961A (zh) 存储系统中错误校正编码数据的冗余
CN103746774B (zh) 一种高效数据读取的容错编码方法
CN102412847A (zh) 用联合节点处理来解码低密度奇偶校验码的方法和设备
CN105518996B (zh) 一种基于二进制域里德所罗门码的数据编解码方法
Silberstein et al. Error-correcting regenerating and locally repairable codes via rank-metric codes
CN107086870A (zh) 修复多节点失效的mds阵列码编码以及解码方法
Han et al. Update-efficient error-correcting product-matrix codes
CN108279995A (zh) 一种基于安全再生码的分布式存储系统的存储方法
CN103650462A (zh) 基于同态的自修复码的编码、解码和数据修复方法及其存储系统
CN104782101A (zh) 用于分布式网络存储的自修复码的编码、重构和恢复方法
CN115454712B (zh) 一种校验码恢复方法、系统、电子设备及存储介质
CN115237662A (zh) 一种分布式存储节点纠错方法及系统
Han et al. Progressive data retrieval for distributed networked storage
Puchinger et al. Decoding high-order interleaved rank-metric codes

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant