CN101023412A - 半静态奇偶性分布技术 - Google Patents
半静态奇偶性分布技术 Download PDFInfo
- Publication number
- CN101023412A CN101023412A CNA200480034712XA CN200480034712A CN101023412A CN 101023412 A CN101023412 A CN 101023412A CN A200480034712X A CNA200480034712X A CN A200480034712XA CN 200480034712 A CN200480034712 A CN 200480034712A CN 101023412 A CN101023412 A CN 101023412A
- Authority
- CN
- China
- Prior art keywords
- disk
- parity
- array
- piece
- band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
- G06F11/1096—Parity calculation or recalculation after configuration or reconfiguration of the system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
- Detection And Correction Of Errors (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
半静态分布技术跨越阵列中的磁盘分布奇偶性。根据所述技术,以保持磁盘的条带之中的奇偶性块的固定模式的方式跨越阵列中的磁盘分布(分配)奇偶性。当一个或多个磁盘被添加到阵列中时,所述半静态技术以不需要重新计算奇偶性或者移动任何数据块的方式重新分布奇偶性。值得注意的,奇偶性信息实际上没有被移动;所述技术仅仅涉及在将每个预先存在的磁盘中的一些奇偶性块分配(或者保留)至新添加的磁盘时的变化。
Description
技术领域
本发明涉及存储系统阵列,具体而言,涉及一种在存储阵列的存储设备中高效地分配奇偶性块(parity block)的系统。
背景技术
存储系统通常包括一个或多个可以按需要将信息输入到其中以及从其中获取信息的存储设备。存储系统包括存储操作系统,所述存储操作系统尤其通过启用支持由系统实现的存储服务的存储操作功能性地组织该系统。可以根据各种存储结构实现所述存储系统,包括但不限于:网络连接存储(network-attached storage)环境、存储区域网络和直接连接到客户端或者主机的磁盘组件。存储设备通常是组成磁盘阵列的磁盘驱动器,其中术语“磁盘”通常描述独立旋转磁介质存储设备。在本文中的术语磁盘的意义和硬盘驱动器(HDD)或者直接存取存储设备(DASD)是一样的。
磁盘阵列上的信息的存储优选地是以一个或多个存储“卷”的方式实现的,所述存储“卷”包括一簇物理磁盘,定义了磁盘空间的总体逻辑配置。卷内的磁盘通常组成一个或多个组,其中每个组作为独立(或者廉价)磁盘冗余阵列(RAID)工作。在这里,RAID组被定义为多个磁盘和与那些磁盘有关的地址/块空间。术语“RAID”和它的各种实现方式是公知的,并且已经在由D.A.Patterson、G.A.Gibson和R.H.Katz所撰写的“A Case for Redundant Arrays ofInexpensive Disks(RAID)”(Proceeding of the InternationalConference on Management of data(SIGMOD),June 1988)中公开。
存储系统的存储操作系统可以实现文件系统以便将信息逻辑组织为磁盘上的目录、文件和块的分级结构。例如,每个“磁盘上(on-disk)”文件可以以配置成存储诸如文件实际数据的信息的数据结构集的方式实现,也就是磁盘存储块。存储操作系统还可以实现根据写入和读出操作对向磁盘存储信息或者从磁盘检索信息进行管理的RAID系统。在存储在例如磁盘块号空间中的磁盘上的信息和文件系统组织的信息之间通常存在一对一的映射。
一种常用类型的文件系统是“原地写入(write in-place)”文件系统,这种文件系统的一个实例是传统的伯克利(Berkeley)快速文件系统。在原地写入文件系统中,诸如数据块的数据结构在磁盘上的位置通常是固定的。数据块的变化“原地”进行;如果对文件的更新扩展了文件的数据量,那么分配另外的数据块。另一种类型的文件系统是随地写入(write-anywhere)文件系统,这种文件系统不重写磁盘上的数据。如果磁盘上的数据块被从磁盘检索(读取)到存储系统的存储器中并被新数据“弄脏”,那么数据块被存储(写入)至磁盘上新的位置以便借此优化写入性能。随地写入文件系统最初可以假定最优布局以便数据基本上连续地排列在磁盘上。特别对顺序读出操作而言,该最优磁盘布局导致指向磁盘的有效存取操作。配置成对存储系统进行操作的随地写入文件系统的实例是随地写入文件布局(WriteAnywhere File Layout,WAFLTM)文件系统,其可以从NetworkAppliance公司(Sunnyvale,California)获得。
大多数RAID的实施方式通过下述方式改善数据存储的可靠性/完整性:跨越RAID组中指定数目的物理磁盘冗余写入数据“条”;以及适当存储关于条带化数据的冗余信息。当磁盘发生故障时,例如奇偶性信息之类的冗余信息使得丢失数据能够恢复。通过跨越多个存有不同数据的类似磁盘对特殊字长(通常是一位)的数据求和(通常以2为模)、然后将结果存储在另外的类似磁盘中,可以计算奇偶值。也就是说,在由每一个磁盘的对应位置上的位组成的1位宽的向量上可以计算奇偶性。当在1位宽的向量上计算时,奇偶性可以是计算而来的和或者它的补码;这些分别被称为偶数和奇数奇偶性。在1位向量上的加减法都等于异-或(XOR)逻辑操作。然后数据被保护以避免任一个磁盘,或者任一个磁盘上任一部分数据的丢失。如果存储奇偶性的磁盘丢失,那么可以根据数据重新生成奇偶性。如果一个数据磁盘丢失,那么通过将幸存数据磁盘的内容加在一起然后从所存储的奇偶性减去所述结果,可以重新生成数据。
通常,磁盘被分成奇偶性组,每个奇偶性组包括一个或多个数据磁盘和奇偶性磁盘。奇偶性集合是块的集合,包括若干数据块和一个奇偶性块,其中奇偶性块是所有数据块的XOR。奇偶性组是从其中选择一个或多个奇偶性集合的磁盘的集合。磁盘空间被分成条带,其中每个条带包含来自每个磁盘的一个块。一个条带中的块通常处于奇偶性组中每个磁盘上相同的位置。在一个条带内,除一个块以外全部块都包含数据(“数据块”),而所述一个块包含对所有数据进行XOR计算而来的奇偶性(“奇偶性块”)。
如在此使用的,术语“编码”意指对预定数据块子集计算冗余值,而术语“解码”意指利用数据块的子集和冗余值、通过与冗余计算相同的处理重建数据或者奇偶性块。如果奇偶性组中的一个磁盘发生故障,那么那个磁盘的内容可以通过计算剩余数据块的全部内容的总和并从奇偶性块中减去该结果来解码(重建)在备用的一个或者多个磁盘上。因为1位字段上的二进制补码和及差都等于XOR操作,所以该重建是由全部幸存数据和奇偶性块的XOR结果组成的。类似地,如果奇偶性磁盘丢失,那么可以根据幸存的数据以同样的方式重新计算。
如果奇偶性块全部存储在一个磁盘上,借此提供包含全部的(并且仅包含)奇偶性信息的单个磁盘,那么提供RAID-4级实施方式。因为RAID-4实施方式固定了每个RAID组中奇偶性信息的位置,所以其概念上是高级RAID(也就是与条带化和镜像相比)的最简单形式。特别地,RAID-4实施方式避免了单个附加磁盘的单个磁盘错误,同时使得将数据磁盘逐渐添加到RAID组中十分容易。
如果奇偶性块以旋转模式包含在每个条带的不同磁盘中,那么所述实施方式是RAID-5。使用高级RAID技术的大多数的商用实施方式使用RAID-5级实施方式,所述实施方式分布奇偶信息。选择RAID-5实施方式的动机在于对大多数静态文件系统而言利用RAID-4实施方式将限制写入处理量。这种静态文件系统趋向跨越磁盘阵列中的多个条带分散写入数据,从而促使奇偶性磁盘找寻每个写入条带。然而,因为诸如WAFL文件系统的随地写入文件系统将写入数据集中在少量邻近的条带上,所以其不具有这个问题。
在随地写入文件系统中使用RAID-4级实施方式是实现不断增加容量同时保持性能的理想方式;然而存在一些“隐藏的”负面效应。第一,在RAID-5实施方式中RAID组中的全部磁盘均可用于读取通信量,在RAID-4实施方式中磁盘中的一个(奇偶性磁盘)不参与这种通信量。虽然对大的RAID组大小而言该效应是可忽略的,但是由于例如有限数量的可用磁盘或更大磁盘的重建时间增加,所以那些组大小一直在减少。因为磁盘的尺寸继续增加,所以小的RAID组配置变得更加有吸引力。但是这增加了在RAID-4配置中不能用于读取操作的磁盘部分。因此使用RAID-4级实施方式可导致每秒读取操作的不可忽略的损失。第二,当新的磁盘被添加到完整卷中时,随地写入文件系统倾向于将大部分写入数据通信量引导到新的磁盘,在所述新的磁盘中具有大部分可用空间。
在磁盘阵列的RAID-5级实施方式中,RAID系统通常跟踪分配的数据。所以,RAID系统以固定模式保留奇偶性块,所述固定模式易于计算并且实现了对非数据(奇偶性)块的有效识别。然而,添加新的专用磁盘至RAID-5级实施方式的RAID组中通常需要跨越阵列中每个条带的旧的和新的磁盘重新定位奇偶信息以保持该固定模式。奇偶信息的重新配置通常需要使用复杂的(并且昂贵的)奇偶性块重新分布方案以及复制奇偶性块和数据块二者以符合新的分布,其中所述奇偶性块重新分布方案“扫过”旧的和新的磁盘。该奇偶性重新分布方案还需要这样的机制,所述机制识别哪些块包含数据并确保对每个条带而言没有分配太多的数据块以便存在充足的空间以存储奇偶信息。由于这种方案的复杂性和成本,大多数的RAID-5实施方式放弃向RAID组中添加专用磁盘的能力,相反,使用固定的RAID组大小(通常在4-8个磁盘这样的范围)。然后每次磁盘容量都被增加完整的RAID组。此外,利用小的RAID组导致高的奇偶校验开销,而利用大的RAID组意味着增加容量需要花费很高的成本。
因此,希望提供一种分布系统,其使存储系统能够平均地或者近乎平均地在系统的磁盘之间分布奇偶性,同时保持逐渐增加磁盘的能力。
此外,希望提供一种分布系统,其使得存储系统的随地写入文件系统能够在更小(RAID组)配置下以更好的性能运行。
发明内容
本发明通过提供一种跨越阵列中的磁盘分布奇偶性的半静态(semi-static)分布技术克服了现有技术的缺点。根据所述技术的说明性的实施方式,以保持磁盘的条带之间的奇偶性块的固定模式的方式跨越阵列中的磁盘分布(分配)奇偶性。当一个或多个磁盘被添加到阵列中时,所述半静态技术以不需要重新计算奇偶性或者移动任何数据块的方式重新分布奇偶性。值得注意的是,奇偶性信息实际上没有移动;所述技术仅仅涉及将每个预先存在的磁盘中的一些奇偶性块分配至新近添加的磁盘(或者保留)中的变化。举例来说,例如在第一预先存在的磁盘上存储奇偶性的预先存在的块可以继续存储奇偶性;或者,新添加磁盘上的块可以被分配用于存储条带的奇偶性,其“释放”第一个磁盘上的预先存在的奇偶性块以存储文件系统数据。
有利地,当磁盘被添加到阵列中时,半静态分布允许那些保留(条带中的)奇偶性的块发生改变。在条带的块之间发生重新分配以重新平衡奇偶性从而避免在写入通信期间具有奇偶性优势的磁盘变“热”(即,比其它磁盘的使用更频繁)的情况。所述新颖的分布技术适用于单个磁盘故障校正,并且可以被扩展至应用于两个(或者更多)磁盘丢失保护。此外,所述半静态分布技术具有改善磁盘限制(disk-bound)结构中的性能的潜能,并同时保持一次一个或多个磁盘地向卷添加磁盘的能力。
附图说明
通过结合附图参考以下说明可以更透彻地理解本发明的上述和其他优点,在所述附图中相同的附图标记指示相同的或者功能类似的部件:
图1是可以有利地结合本发明使用的存储系统的示意性方框图;
图2是举例说明根据本发明的半静态分布技术的奇偶性分配的磁盘阵列的示意图;
图3是举例说明根据所述半静态分布技术的说明性实施方式、在阵列的磁盘之间分布奇偶性的一系列步骤的流程图;以及
图4是举例说明根据所述半静态分布技术的各种组大小的重复间隔的奇偶性分配表的框图。
具体实施方式
图1是可以有利地结合本发明使用的存储系统100的示意性方框图。在该说明性的实施方式中,存储系统100包括通过系统总线125互连的处理器122、存储器124以及存储装置适配器128。存储器124包括可由处理器和适配器寻址的存储位置,用于存储与本发明有关的软件程序代码和数据结构。处理器和适配器可以包括被配置成执行软件代码和操作数据结构的处理元件和/或逻辑电路。对所属领域的技术人员而言显而易见的是:包括各种计算机可读介质在内的其他处理和存储装置也可以用于存储和执行与在此描述的具有创造性的技术有关的程序指令。
存储操作系统150尤其通过启用由存储系统执行的存储操作功能性地组织系统100,其中存储操作系统150的一部分通常驻存在存储器中并由处理元件执行。存储操作系统实现高级模块,以将信息逻辑组织为阵列中磁盘上的目录、文件和块的分级结构。操作系统150还实现存储模块,该存储模块根据写入和读出操作管理向磁盘中存储信息或从磁盘中检索信息。应当注意的是高级模块和存储模块可以以软件、硬件、固件或者其组合的方式来实现。
特别地,高级模块可以包括文件系统160或者诸如数据库之类的其他模块,所述其他模块用于在磁盘阵列中为自身分配存储空间并控制该阵列上的数据的布局(layout)。此外,存储模块可以包括被配置成利用冗余存储算法计算冗余(例如奇偶性)信息并且恢复磁盘故障的磁盘阵列控制系统或者RAID系统170。磁盘阵列控制系统(“磁盘阵列控制器”)或者RAID系统还可以响应于阵列上固定数据的放置而利用代数的和算法的运算计算冗余信息。应当注意的是术语“RAID系统”和“磁盘阵列控制系统”或“磁盘阵列控制器”的意义是一样的,并因此术语“RAID系统”的使用不表示仅利用公知的RAID技术的一种。相反,本发明的RAID系统采用了具有创造性的半静态奇偶性分布技术。如在此描述的那样,文件系统或者数据库作出关于将数据放置在阵列上哪里的决定并将所述决定发送至RAID系统。
在该说明性的实施方式中,存储操作系统优选地是NetAppDataONTAPTM操作系统,其可以从Network Appliance公司(Sunnyvaly,California)获得,所述操作系统实现了具有磁盘上(on-disk)格式表示的随地写入文件布局(WAFLTM)文件系统,其是利用例如4千字节(kB)WAFL块的基于块的文件系统。然而,特别应当注意的是根据在此描述的发明原则可以改善例如包括原地写入文件系统的任何适当的存储操作系统以供使用。因此,当采用术语“WAFL”时,其应当被广泛地理解为涉及以其他方式适于本发明的示范的任何存储操作系统。
如在此使用的,术语“存储操作系统”泛指可操作用于执行存储系统中的存储功能的计算机可执行代码,例如,管理文件语义以及在文件服务器情况下可以实现文件系统语义和管理数据存取的计算机可执行代码。在这种意义上讲,ONTAP软件是这种存储操作系统的实例,其以微核形式实现并包括WAFL层以实现WAFL文件系统语义并管理数据存取。存储操作系统还可以实现为在诸如UNIX或者WindowsNT的通用操作系统上运行的应用程序,或者实现为配置成存储在此描述的应用程序的具有可配置功能的通用操作系统。
存储装置适配器128与在系统100上执行的存储操作系统150协作以存取用户(或者客户端)所请求的信息。所述信息可以存储在任何类型的可写入存储设备介质的连接阵列上,所述可写入存储设备介质诸如是录像带、光学的、DVD、磁带、磁泡存储器、电子随机存取存储器、微机电的和适合于存储包括数据和奇偶性信息在内的信息的任何其他类似介质。然而,如在此所描述的那样,信息优选地存储在阵列200中的诸如HDD和/或DASD的磁盘上。存储装置适配器包括输入/输出(I/O)接口电路,所述输入/输出(I/O)接口电路经由诸如传统高性能光纤信道串行链路拓扑(serial link topology)的I/O互连装置连接到磁盘。
阵列200上的信息的存储优选地是以一个或多个存储“卷”(例如,VOL1-2 140)的方式实现的,所述存储“卷”包括一簇物理存储磁盘,其通常以130来表示并定义磁盘空间的总体逻辑配置。尽管不是必需的,但是通常每卷与它自己的文件系统相关联。卷/文件系统内的磁盘通常组织为一个或多个组,其中每个组与RAID组相类似。大多数的RAID实施方式通过下述方式改善数据存储的可靠性/完整性:跨越RAID组中给定数量的物理磁盘冗余写入数据“条带”并适当存储关于条带化数据的奇偶性信息。
特别地,每个卷140从被分成块的物理磁盘130的阵列构造,所述块组织成条带。磁盘被组织成组132、134和136。虽然这些组与RAID组相类似,但是在每个组内使用在此描述的半静态分布技术。每个组中的每个条带具有一个或多个奇偶性块,取决于所述组所需的容错程度。在每个条带中选择哪个(些)磁盘包含奇偶性并不像在传统RAID-4或RAID-5阵列中那样由RAID配置决定。
本发明涉及跨越阵列中的磁盘分布奇偶性的半静态分布技术。所述具有创造性的技术优选地是由RAID系统170实现的,RAID系统170尤其跨越磁盘计算条带中的奇偶性,在在此描述的那些条带之间分布奇偶性并重建因故障导致丢失的磁盘。半静态分布技术不需要文件系统160的参与,因此,半静态分布技术还适用于在具体化为例如RAID控制器的RAID代码中推广,所述RAID控制器可以在内部或者从外部连接于存储系统100。
根据所述技术,以保持磁盘的条带之间的奇偶性块的固定模式的方式跨越阵列中的磁盘分布(分配)奇偶性。当一个或多个磁盘被添加到阵列时,所述半静态技术以不需要重新计算奇偶性或者移动任何数据块的方式重新分布奇偶性。值得注意,所述奇偶性信息实际上没有移动;所述技术仅仅涉及将每个预先存在磁盘的一些奇偶性块分配(或者保留)到新添加的磁盘时的变化。举例来说,在例如第一预先存在的磁盘上存储奇偶性的预先存在的块可以继续存储奇偶性;或者,新添加的磁盘上的块可以被指定成存储该条带的奇偶性,其“释放”第一个磁盘上的预先存在的奇偶性块以存储文件系统数据。注意文件系统数据的引用不排除由诸如数据库之类的其他高级模块生成的数据。
假定跨越阵列200中的磁盘密集地分配数据,那么存储操作系统150可以选择按照固定模式跨越磁盘平均地分配奇偶性。然而,当一个或多个磁盘被添加到阵列中时该固定模式改变。作为响应,半静态分布技术以在磁盘的条带之间保持奇偶性块的固定模式的方式重新分布(重新分配)奇偶性。注意每个新近添加的磁盘被初始化至预定的且固定的值,例如归零,以便不会影响条带的固定奇偶性。还应该注意的是:固定奇偶性可以是偶数或者奇数,只要奇偶值是已知的(预定的);在此的下列说明使用偶数奇偶性。此外,新近添加磁盘的初始化允许在没有进行任何奇偶性运算或者写入的情况下将一些条带(例如,条带的1/N,其中N等于磁盘的数目)中的奇偶性块重新分配至新磁盘。
根据本发明,重新分配算法仅曾经将奇偶性块改变为数据块,而从不会将数据块改变为奇偶性块。例如,响应于将新的第N个磁盘添加到组132-136中,文件系统160可以将每个现有磁盘的每第N个奇偶性块重新分配给新的磁盘。因为新的磁盘仅仅包含空闲块和奇偶性块,所以这种重新分配不需要任何重新计算或者数据移动,因此存在的奇偶性块可以得到重新分配以供数据使用,但是反过来并非如此。该重新分配(构造)算法形成奇偶性模式,所述奇偶性模式对每种组大小而言是确定的并在组的全部磁盘之间平均地分布。
图2是举例说明根据本发明的半静态分布技术的奇偶性分配的磁盘阵列200的示意图。假定阵列200最初包括一个磁盘202并且希望存储冗余(奇偶性)信息;因此,该磁盘上的每个块存储奇偶性(P)信息。当第二个磁盘204被添加以扩展所述阵列时,可以在两个磁盘之间分布奇偶性块。同样地,当第三个磁盘206以及此后的第四个磁盘208被添加到扩展的阵列中时,可以在那些磁盘之间分布奇偶性决。当磁盘被添加到阵列200中时,奇偶性没有被存储在包含文件系统数据的块中。半静态分布技术仅仅针对重新分配奇偶性块,这释放了块以供数据使用。换句话说,所述技术从不重新分配数据块,这和传统的RAID-5级实施方式的扩展恰恰相反。
可以根据所述具有创造性的技术的构造算法在磁盘之间分布奇偶性,所述算法将每个预先存在的磁盘中的N个奇偶性块之一重新分配到新的磁盘,其中N等于扩展的阵列中的磁盘数目。总的说来,N个奇偶性块之一被重新分配给新的磁盘,同时每个预先存在的磁盘继续精确地保留扩展阵列中奇偶性块的1/N。对于2个磁盘的阵列而言,在第一个磁盘202上的每隔一个奇偶性块将一个奇偶性块移到到第二个磁盘204。当第三个磁盘206被添加到扩展的阵列200中时,由此产生3个磁盘的阵列,在第一个磁盘202上的每第三个剩余奇偶性块以及在第二个磁盘204上的每第三个奇偶性块被移到第三个磁盘206。当第四个磁盘208被添加到该阵列中时,产生4个磁盘的阵列,来自每个磁盘(磁盘1-3)的每第四个剩余奇偶性块被移到第四个磁盘208。作为该重新分配的结果,在每个磁盘上的奇偶性的数量基本上是相同的。奇偶性块的位置还以一种可预测且确定的模式跨越阵列中的磁盘在条带之间变化。
图3是举例说明根据本发明的半静态分布技术的说明性的实施方式、在阵列的磁盘之间分布奇偶性的一系列步骤的流程图。这里,新的第N个磁盘被添加到阵列的组132-136中,并且如上所述,每N个奇偶性块中的一个被分配给新的磁盘,其中N等于阵列中的磁盘数目。应当注意的是,不必在磁盘之间实际地移动奇偶性信息;所述具有创造性的半静态分布技术仅考虑新添加磁盘上的每个奇偶性块的分配(或者保留)的变化。
所述序列始于步骤300并前进至步骤302,在步骤302中新的磁盘被添加到阵列中的N个磁盘组中。在步骤304,新的磁盘被初始化(例如,调零)以保证在每个条带上的块的奇偶性不受影响。在条带内可能存在多个不包含数据并且可能存储奇偶性的块(也就是,未分配数据的块)。该条带将包含至少一个未分配的块(其为奇偶性块),以及一个或多个未分配的、为空闲数据块的块。所有块对于例如偶数奇偶性有贡献,因此奇偶性块和空闲数据块是完全相等的。文件系统(或者高级模块,如果没有文件系统)响应于在条带中存储写入数据的写入请求来确定在条带中哪些磁盘包含空闲块。在步骤306,文件系统160通过冗余存储算法按要求保留多个空闲块以任意地存储奇偶性。例如,诸如在第一预先存在的磁盘上存储奇偶性的预先存在的块可以继续存储奇偶性;做为选择,在新添加的磁盘上的块可以被分配用于存储该条带的奇偶性,其“释放”第一磁盘上预先存在的奇偶性块以用于存储数据。
应当注意的,防止两个(或更多)磁盘故障的任何奇偶性算法都可以为半静态分布技术所用,只要所述算法允许条带中的任何两个(或更多)块存储奇偶性。可以有利地为本发明所使用的双故障校正算法的实例是均匀并对称行对角(symmetic row-diagonal,SRD)奇偶性,这在由Peter F.Corbett等所申请的序列号为112056-0141、标题为“Uniform and Symmetric Double Failure Correcting Technique forProtecting against Two Disk Failures in a Disk Array”的美国专利申请中有所描述。这里,所述具有创造性的技术不依赖于均匀或对称奇偶性算法,尽管可以利用所述奇偶性算法。当将双故障校正算法与所述半静态分布技术一起使用时,文件系统保留两个未分配数据的块以分配用于存储奇偶性。因为奇偶性块的位置是确定的,所以非均匀的双或者更高故障校正算法能被使用。然而,利用这种算法可能牺牲当磁盘被添加到阵列中时不需要重新计算奇偶性的优点。
另一种技术是采用非均匀算法,使得数据块被写入到阵列的任何块中,即使那些块通常将被用于存储冗余信息。因为多故障校正算法可以恢复任何丢失磁盘的内容,所以剩余块可以用于存储冗余信息,即使它们是利用通常用于重建丢失数据块的技术构造的。以这种方式利用非均匀算法可以产生比利用诸如SRD的均匀和对称算法能够实现的实施方式复杂得多的实施方式。
在步骤308,文件系统的写入分配器165安排写入数据以存储在条带中的磁盘上。在步骤310,文件系统经由由文件系统发出的写入请求消息提供保留块的指示到RAID系统(存储模块)。在步骤312,RAID系统提供奇偶性信息(和写入数据)到磁盘驱动器系统以存储在磁盘上。特别地,在步骤314,在磁盘的块之间分布奇偶性以便在每个磁盘上存储1/N的奇偶性块,从而由此跨过阵列中的磁盘平衡数据。此外,以似乎复杂化但易于计算的可预测模式在阵列的条带之间“移动”奇偶性块的位置。接着在步骤316所述序列结束。
借由其可以在双故障校正阵列中实现冗余或者奇偶性块的平衡半静态分布的其他技术包括简单地利用双故障校正阵列中的一对磁盘替换单故障校正半静态阵列中的每个单个磁盘的技术,其中所述双故障校正阵列在每个条带具有两个冗余块。这里,每对磁盘的角色与单故障校正阵列中的相应单一磁盘的角色相类似。通过利用与在单故障校正阵列中所使用的相同数目的行来保持平衡;然而该技术限于以二的倍数向阵列中添加磁盘。
另一种技术通过下述步骤构造平衡的或者几乎平衡的阵列:从完全充满奇偶性块的两个初始(“旧”)磁盘开始,然后添加第三个磁盘并将两个初始磁盘的每一个中的每第三个奇偶性块移动到新的磁盘。该技术向每个磁盘分布三分之一的奇偶性块,占据每个磁盘上三分之二的空间。当重新分配来自旧的磁盘的奇偶性块时,可以发现在新的磁盘上的块已经被指定为奇偶性。在这种情况下,在新的磁盘尚末包含奇偶性而旧的磁盘包含奇偶性的下一行,下一个可能的奇偶性块被从旧的磁盘重新分配到新的磁盘,。
后面的这种技术还可以被外推到为任何数量的磁盘建立奇偶性分配的确定性集合,其中每个条带有两个冗余(例如奇偶性)块并且跨越阵列冗余块是平衡或者几乎平衡的。类似地,对每个条带三个或者更多数目的冗余块的情况而言,可以采用相同的技术以通过使得每个磁盘的冗余块的数目是平衡或者几乎平衡的方式确定任何大小的更大阵列中冗余块的设置。此外,所述技术允许添加任意数目的磁盘而永远不会将数据块改变为奇偶性块,同时继续使得每个磁盘的冗余块数目保持平衡或者几乎平衡。
可以开发其他类似的技术以在任何大小的阵列中将块的角色确定为数据块或者冗余块,同时保留在数据块和冗余块二者的分布保持平衡或者几乎平衡时阵列可以增加的方式扩展的性能,并永远不会将数据块变化为冗余块。通过在包含特定大小阵列中特定数目的行的分配的存储器中存储或者生成数据结构(例如,表格),可以实现这些分配技术的任何一种。还可以将直至某一极限的任何阵列大小的冗余块的全部可能的分配存储在单个表中。这里,例如,所述表可以为每行存储位图,其中选择小于N的一个(或更多)最高编号位组,其中N是阵列中的磁盘数目。总之,无论每行中冗余块的数目(也就是,阵列可以允许的故障的数目),本发明设想了任何一种具有如下特性的基于表格的奇偶性分配:保持分布的数据和冗余块平衡,同时允许在没有将数据块改变为冗余(奇偶性)块的情况下实现扩展。
为磁盘阵列的组132-136的已知大小,或者为该阵列的最大组大小计算半静态分布技术的奇偶性分配;总之,如上所述,所计算的奇偶性分配可以存储在表中。由所存储的分配定义的奇偶性分布模式,特别是该模式的重复间隔可用于确定:对于给定组大小和给定条带,奇偶性存储在阵列中的任何磁盘上的位置。也就是说,所述模式可用于指示每个条带中哪个块被用于奇偶性,或者几个条带可使用不同的模式。
图4是举例说明根据半静态分布技术的各种组大小的重复间隔的奇偶性分配表400的框图。奇偶性分布模式以取决于阵列的组大小的重复间隔重复。如果大小为N的组每K个条带重复一次,那么大小为(N+1)的组将以为K和(N+1)所整除的最小数字重复一次。值得注意,表的内容不重复直到其到达一个取决于N值的数(重复间隔)为止,其中N等于磁盘的数目。例如,在2个磁盘的阵列中(也就是,组大小为2),所述奇偶性分布模式每两个条带重复一次。当第三个磁盘被添加时(组大小为3),奇偶性模式每六个条带重复一次。当第四个磁盘被添加时(组大小为4),奇偶性模式每十二个条带重复一次。从表400可以看到:对五(和六)的组大小而言,所述奇偶性模式每六十个条带重复一次。
与组大小有关的重复间隔是根据直至N的唯一素因子(“素数”)集确定的,其中N等于磁盘的数目。重复间隔(其等于表400中的条目数)少于N的阶乘,实际上等于所有小于或等于N的素数的乘积,其中每个素数升到最大可能次幂以便结果小于或等于N。因为在1和N之间一些数字是素数,所以很明显重复间隔可能变得很大,导致表很大。例如,对N=10而言,表大小是2^3×3^2×5^1×7^1=8×9×5×7=2520。类似地,对N=32而言,表大小是2^5×3^3×5^2×7^1×11^1×13^1×17^1×19^1×23^1×29^1×31^1=32×27×25×7×11×13×17×19×23×29×31≌144×10^12。
在模式的表大小和平衡的精确性之间可以作出折中;所述表可以在一个合理的点处终止并且能使用该特定重复间隔处的组大小。此后,即使存在比组大小更多的磁盘,所述技术也可以继续重复所述模式并仍可以在例如0.5%的范围内跨越阵列实现数据的几乎均匀的平衡。例如,如上所述,十的组大小转化成每2,520个条带重复一次的奇偶性分布模式。该大小(也就是,2,520个条目)的表在存储器124中是相对紧凑的,并且可以利用适当的软件代码在启动时相对迅速地加以计算。相反,32的组大小(也就是,144×10^12个条目)的表太大了以至于不能够存储在存储器中。
2,520个条目的表适用于任何合理数目的磁盘以提供良好的数据平衡;然而,应当注意的是该大小的表不是唯一的选择,其他大小的表也可以被使用。对于直至十的N个磁盘而言2,520个条目的模式是完美平衡的;对于N大于10的情况而言,即使该模式没有重复,该模式也提供了良好的数据平衡。换句话说,虽然17个磁盘组的奇偶性分配表相当大(7.7MB,其中每个模式5位),但是只要使用表的一部分,那么仍可以实现良好的奇偶性平衡。例如,在2,520处切断所述模式得到直截至10个磁盘的所有组大小的完美平衡,对于较大组产生低于1%的不平衡,同时对于N=11将表大小限定为2520×4位=1260字节,对于N=17至32的情况将表大小限定为5×2520位=1,575字节。
奇偶性分配表400可以被编码为单个数字,用于表示N的特定值的奇偶性的位位置。所述表还可以被编码为位向量,使用一到二(或更多)位的集合指示提供单或双(或更多)磁盘故障保护的单个或者两个(或更多)奇偶性块的位置。此外,该表可以被编码为单个表以指示(用于直到某些极限(例如32个磁盘)的所有磁盘阵列大小)在每个条带中什么磁盘可以包含奇偶性。然后通过屏蔽高次序的32-N位并选择最高次序的剩余一或二(或更多)位,确定对于N的特定值哪个磁盘实际包含奇偶性。
总而言之,半静态分布力求跨越阵列保持每个磁盘中数据块的数目大致匹配,由此跨越阵列中的全部磁盘“分散”读取负载。因此,所述技术消除了在阵列中由阵列中任何一个磁盘的处理量所引起的任何“瓶颈”,同时还消除了对写入操作而言(多个)奇偶性磁盘为(多个)热点的问题。可以利用诸如SRD奇偶性的对称算法或者诸如行对角线(RD)奇偶性的不对称双故障校正算法来应用所述通用技术。在2001年12月28日由Peter F.Corbett等申请的、序列号为10/035,607、标题为“Row-Diagonal Parity Technique for Enabling EfficientRecovery from Double Failures in a Storage Array”的美国专利申请中描述了RD奇偶性技术。
当采用诸如RD奇偶性的非均匀算法时,相对于在不对称奇偶性算法中磁盘的典型角色,在将数据或者冗余块存储在任何定块时磁盘的角色可以忽略。因为任何双故障校正算法可以为阵列中任何两个丢失磁盘构造所丢失的“数据”,所以在分配了存储数据的角色的行中的全部块的内容是固定的,并且利用双故障校正算法计算两个冗余块的内容,其取决于磁盘在所述行中的位置而以不同方式加以施加。已经在每行中存储两个冗余块,所以阵列可以允许两个磁盘发生故障,从而无论在任何特定条带中丢失块的角色是什么都可以恢复丢失的数据块或者冗余块。
做为选择,因为磁盘的角色被很确定地定义,所以可以采用允许阵列中任意两个或更多磁盘包含冗余信息的任何算法。利用这种算法可能需要在奇偶性块移动了的条带中重新计算奇偶性,但是这种算法保持了本发明不移动数据块的优点。SRD还具有当奇偶性块被分配给新添加的磁盘时不需重新计算奇偶性块的优点。
在此描述的分布技术特别适用于具有较少磁盘还想要利用可从那些磁盘获得的所有每秒读取操作(ops)的系统。较小阵列的性能受可从磁盘获取的ops束缚(磁盘-限制)。但是即使在大阵列中,当磁盘变得更大时,因为重建时间的缘故,趋向于减少每组132-136的磁盘数目。这导致冗余开销的增加(在组中用于冗余的磁盘的百分比增加)。因此,希望利用可以从那些冗余磁盘中获得的读取ops。该分布技术的另一个优点是重建和/或恢复“盲目地”(也就是在不知道磁盘的角色的情况下)发生。
因为半静态分布技术跨越阵列平衡数据,所以该技术可以方便地为具有少量大磁盘的阵列所使用。利用较大磁盘需要获得合理的容量,除此之外还意味利用较小的组来限制重建时间。如果14个磁盘的结构使用两个组和一个备用,那么20%以上的磁盘都不能够用于存储或者检索数据。8个磁盘的结构甚至更差。
如上所述,半静态分布技术允许将磁盘逐渐增加到磁盘阵列的分布奇偶性实施方式中。在RAID-5级实施方式上,本发明的分布技术的优点是其允许很容易地扩展阵列,避免了添加整个组到阵列中或者执行昂贵的RAID-5重组的需要。所述半静态分布技术可以结合单/双故障错误校正一起使用。此外,所述技术允许在相同的组132-136中使用多种磁盘大小。
虽然已经显示和描述了跨越磁盘分布奇偶性的半静态分布技术的说明性的实施方式,但是应当理解的是在本发明的精神和范围内可以作出各种其他的改进和修改。例如,在此描述的分布技术可以应用于基于块的RAID阵列,以例如允许很容易地将磁盘添加到RAID组中。基于块的RAID阵列通常不知道它们被要求存储的哪些块包含文件系统数据。相反,阵列必须假定没有被预先指定为奇偶性块的全部块包含文件系统数据。因此,他们通常预先分配哪些块将被用于奇偶性。对给定阵列而言,这些预先分配的块保持固定。通常这是以一些预定算法实现的以便系统无须跟踪每个奇偶性块。
根据本发明,RAID系统可以利用半静态分布技术将现有磁盘中的一些块的奇偶性指定移动至新的磁盘。RAID系统还必须保证现有磁盘中的非奇偶性块的逻辑单元号(1un)块偏移量不改变。然后在全部磁盘之间分布新空间。在基于块的阵列中这种非线性映射通常不是所希望的,因为文件系统不能补偿它。然而,如果奇偶性块被大块地(例如至少磁道大小)连续分配,那么可以减轻该效应。
对所属技术领域的工作人员应当理解的是:在此描述的本发明的技术可以应用于任何类型的具体化为存储系统100或者包括存储系统100的专用计算机(例如,文件服务器、文件管理器或者多协议存储设备)或者通用计算机,包括独立计算机及其部件。可以有利地使用本发明的多协议存储设备的实例在2002年8月8日申请的、序列号为10/215,917、标题为“Multi-Protocol Storage Appliance that providesIntegrated Support for File and Block Access Protocols”的美国专利申请中已经描述。此外,本发明的示范可以适合于各种存储系统结构,包括但不限于:网络连接的存储环境、存储区域网络和直接连接于客户端或者主机的磁盘集合。术语“存储系统”因此应该被广泛理解为包括除任何配置成执行存储功能的子系统之外的这种装置并与其它设备或系统相关联。
上述说明已经涉及了本发明的特定实施方式。然而,显而易见的是:可以对所描述的实施方式作出其他变化和修改,且保持一些或全部其优点。例如,所述半静态分布技术可以普及为涉及在系统的诸如磁盘的持久存储装置或者例如存储器的非持久存储装置之间分布数据结构的其他应用。广义上,所述技术可以应用于当更多贮存器被添加到系统中时,任何物品(commodity)在任何贮存器集合上的重新分配。举例来说,半静态技术可以应用于具有单元和贮存器的系统,其中所述单元被均匀地分布在贮存器上并且希望保持沿一些编号的维度向贮存器分配单元的平衡率。当新的贮存器被添加到系统中时,所述技术可以被采用以保持总体和局部平衡的方式将一些现有单元传送至新的贮存器中。
更具体地,半静态技术可以被用于在阵列的持久存储设备(诸如磁盘)之间分布诸如信息节点文件块的数据结构,其中所述阵列同诸如存储“头(head)”的多个存储实体相连接。注意“头”被定义为除磁盘之外的存储系统中的全部部件。这种应用的实例涉及所述多个(N个)存储头上分布现有信息节点文件块,其包括一个或多个新添加的存储头。这里,本发明的半静态分布技术可以用于将任何现有信息节点文件块的仅1/N移动到新添加的存储头。
可以清楚理解的是:本发明的示范可以以软件、硬件、固件或者其组合的方式加以实现,其中所述软件包括具有在计算机上执行的程序指令的计算机可读取介质。因此本说明仅仅是示例性的而非以其它方式限制本发明的范围。因此,所附权利要求的目的在于覆盖所有这类落入本发明的真实精神和范围内的变化和修改。
Claims (21)
1.一种用于跨越磁盘阵列分布奇偶性的方法,所述方法包括下述步骤:
将新的磁盘添加至阵列中预先存在的磁盘;
将每个磁盘分成块,所述块被组织成条带使得每个条带包含来自每个磁盘的一个块;以及
在不重新计算或者移动任何包含数据的块的情况下在新的和预先存在的磁盘的块之间分布奇偶性。
2.根据权利要求1所述的方法,其中所述分布步骤包括以在磁盘的条带之间保持奇偶性块的固定模式的方式在新的和预先存在的磁盘的块之间分布奇偶性的步骤。
3.根据权利要求1所述的方法,其中所述分布步骤包括如下步骤:改变每个预先存在的磁盘的一个或多个包含奇偶性的块向新添加的磁盘的分配。
4.根据权利要求2所述的方法,其中所述添加步骤包括初始化添加的磁盘以便不会影响条带的奇偶性的步骤。
5.根据权利要求4所述的方法,其中所述初始化步骤包括在不计算或写入奇偶性的情况下将某些条带中的包含奇偶性的块重新分配到新的磁盘步骤。
6.根据权利要求5所述的方法,其中所述某些条带包括1/N的条带,其中N等于阵列中的磁盘数目。
7.根据权利要求5所述的方法,其中所述重新分配步骤包括将包含奇偶性的块(奇偶性块)改变为包含数据的块(数据块)而不将数据块改变为奇偶性块的步骤。
8.根据权利要求1所述的方法,其中所述分布步骤包括将N个包含奇偶性的块(奇偶性块)之一从每个预先存在的磁盘重新分配至所添加的磁盘的步骤,其中N等于阵列中的磁盘数目。
9.根据权利要求8所述的方法,其中所述重新分配步骤包括将N个奇偶性块之一重新分配给新磁盘的步骤,同时每个预先存在的磁盘继续保持阵列中1/N的奇偶性块。
10.一种适合于跨越存储系统的磁盘分布奇偶性的系统,所述系统包括:
磁盘阵列,包括预先存在的磁盘以及至少一个新磁盘;以及
存储模块,配置成跨越磁盘计算条带的块中的奇偶性以及重建由于故障而丢失的磁盘的块,所述存储模块还被配置成在不重新计算或者移动任何数据块的情况下在新的和预先存在的磁盘的块之间分配奇偶性。
11.根据权利要求10所述的系统,还包括配置成存储为磁盘阵列的已知组大小和该阵列的最大组大小之一所计算的奇偶性分配的表,所存储的奇偶性分配定义奇偶性分布模式的重复间隔,所述奇偶性分布模式用于确定奇偶性在阵列中的任何磁盘上的存储位置。
12.根据权利要求10所述的系统,其中所述存储模块具体化为存储系统的RAID系统。
13.根据权利要求10所述的系统,其中所述存储模块具体化为存储系统的内部磁盘阵列控制器。
14.根据权利要求10所述的系统,其中所述存储模块具体化为从外部耦合到存储系统的磁盘阵列控制系统。
15.根据权利要求10所述的系统,其中所述磁盘阵列是基于块的RAID阵列。
16.一种用于在系统的贮存器上分布物品的方法,所述方法包括下述步骤:
将新贮存器添加到系统的预先存在的贮存器,由此提供N个贮存器;以及
仅将1/N的物品移至新贮存器。
17.根据权利要求16所述的方法,其中所述系统是存储系统,所述物品是适合于存储在阵列中的存储设备上的数据结构,以及所述贮存器是与阵列耦合的存储实体。
18.根据权利要求17所述的方法,其中所述存储实体是存储头。
19.根据权利要求17所述的方法,其中所述数据结构是信息节点文件块。
20.一种用于跨越磁盘阵列分布奇偶性的设备,所述设备包括:
用于添加新磁盘至阵列中的预先存在的磁盘的装置;
用于将每个磁盘分成块的装置,所述块被组织成条带使得每个条带都包含来自每个磁盘的一个块;以及
用于在不重新计算或者移动任何包含数据的块的情况下在新的和预先存在的磁盘的块之间分布奇偶性的装置。
21.一种包含用于跨越磁盘阵列分布奇偶性的可执行程序指令的计算机可读介质,所述可执行指令包括用于实现下述操作的一个或多个程序指令:
将新磁盘添加至阵列中的预先存在的磁盘;
将每个磁盘分成块,所述块被组织成条带使得每个条带包含来自每个磁盘的一个块;以及
在不重新计算或者移动任何包含数据的块的情况下在新的和预先存在的磁盘的块之间分布奇偶性。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/720,364 | 2003-11-24 | ||
US10/720,364 US7185144B2 (en) | 2003-11-24 | 2003-11-24 | Semi-static distribution technique |
PCT/US2004/039618 WO2005052784A2 (en) | 2003-11-24 | 2004-11-24 | Semi-static parity distribution technique |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101023412A true CN101023412A (zh) | 2007-08-22 |
CN101023412B CN101023412B (zh) | 2012-10-31 |
Family
ID=34591531
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN200480034712XA Expired - Fee Related CN101023412B (zh) | 2003-11-24 | 2004-11-24 | 半静态奇偶性分布技术 |
Country Status (9)
Country | Link |
---|---|
US (2) | US7185144B2 (zh) |
EP (1) | EP1687707B1 (zh) |
JP (1) | JP2007516524A (zh) |
KR (1) | KR101148697B1 (zh) |
CN (1) | CN101023412B (zh) |
AU (1) | AU2004294208B2 (zh) |
CA (1) | CA2546242C (zh) |
IL (1) | IL175829A (zh) |
WO (1) | WO2005052784A2 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104156276A (zh) * | 2014-08-14 | 2014-11-19 | 浪潮电子信息产业股份有限公司 | 一种防两块磁盘损坏的raid方法 |
Families Citing this family (698)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7647451B1 (en) | 2003-11-24 | 2010-01-12 | Netapp, Inc. | Data placement technique for striping data containers across volumes of a storage system cluster |
US7698289B2 (en) * | 2003-12-02 | 2010-04-13 | Netapp, Inc. | Storage system architecture for striping data container content across volumes of a cluster |
CA2922200A1 (en) | 2004-10-25 | 2006-05-04 | Security First Corp. | Secure data parser method and system |
JP4324088B2 (ja) * | 2004-12-17 | 2009-09-02 | 富士通株式会社 | データ複製制御装置 |
US7941602B2 (en) | 2005-02-10 | 2011-05-10 | Xiotech Corporation | Method, apparatus and program storage device for providing geographically isolated failover using instant RAID swapping in mirrored virtual disks |
US20060218360A1 (en) * | 2005-03-22 | 2006-09-28 | Burkey Todd R | Method, apparatus and program storage device for providing an optimized read methodology for synchronously mirrored virtual disk pairs |
US7904649B2 (en) * | 2005-04-29 | 2011-03-08 | Netapp, Inc. | System and method for restriping data across a plurality of volumes |
US7698501B1 (en) * | 2005-04-29 | 2010-04-13 | Netapp, Inc. | System and method for utilizing sparse data containers in a striped volume set |
US7698334B2 (en) * | 2005-04-29 | 2010-04-13 | Netapp, Inc. | System and method for multi-tiered meta-data caching and distribution in a clustered computer environment |
JP4473175B2 (ja) * | 2005-05-13 | 2010-06-02 | 富士通株式会社 | 記憶制御方法、プログラム及び装置 |
US11909418B1 (en) | 2005-09-30 | 2024-02-20 | Pure Storage, Inc. | Access authentication in a dispersed storage network |
US7546427B2 (en) * | 2005-09-30 | 2009-06-09 | Cleversafe, Inc. | System for rebuilding dispersed data |
US11327674B2 (en) | 2012-06-05 | 2022-05-10 | Pure Storage, Inc. | Storage vault tiering and data migration in a distributed storage network |
US7574579B2 (en) * | 2005-09-30 | 2009-08-11 | Cleversafe, Inc. | Metadata management system for an information dispersed storage system |
US12061519B2 (en) | 2005-09-30 | 2024-08-13 | Purage Storage, Inc. | Reconstructing data segments in a storage network and methods for use therewith |
US7574570B2 (en) * | 2005-09-30 | 2009-08-11 | Cleversafe Inc | Billing system for information dispersal system |
US10169229B2 (en) | 2012-06-05 | 2019-01-01 | International Business Machines Corporation | Protocols for expanding existing sites in a dispersed storage network |
US10747616B2 (en) | 2015-03-31 | 2020-08-18 | Pure Storage, Inc. | Adapting rebuilding of encoded data slices in a dispersed storage network |
US11474903B1 (en) | 2005-09-30 | 2022-10-18 | Pure Storage, Inc. | Rebuilding of encoded data slices using locally decodable code segments |
US10250686B2 (en) | 2005-09-30 | 2019-04-02 | International Business Machines Corporation | Finding alternate storage locations to support failing disk migration |
US11416339B1 (en) | 2005-09-30 | 2022-08-16 | Pure Storage, Inc. | Validating requests based on stored vault information |
US10356177B2 (en) | 2005-09-30 | 2019-07-16 | International Business Machines Corporation | Prioritizing ranges to rebuild based on namespace health |
US10432726B2 (en) | 2005-09-30 | 2019-10-01 | Pure Storage, Inc. | Last-resort operations to save at-risk-data |
US9996413B2 (en) * | 2007-10-09 | 2018-06-12 | International Business Machines Corporation | Ensuring data integrity on a dispersed storage grid |
US8694668B2 (en) * | 2005-09-30 | 2014-04-08 | Cleversafe, Inc. | Streaming media software interface to a dispersed data storage network |
US9774684B2 (en) | 2005-09-30 | 2017-09-26 | International Business Machines Corporation | Storing data in a dispersed storage network |
US8352782B2 (en) * | 2005-09-30 | 2013-01-08 | Cleversafe, Inc. | Range based rebuilder for use with a dispersed data storage network |
US11841770B2 (en) | 2005-09-30 | 2023-12-12 | Pure Storage, Inc. | Storage unit connection security in a storage network and methods for use therewith |
US8595435B2 (en) * | 2009-07-30 | 2013-11-26 | Cleversafe, Inc. | Dispersed storage write process |
US10389814B2 (en) | 2005-09-30 | 2019-08-20 | Pure Storage, Inc. | Prioritizing memory devices to replace based on namespace health |
US8285878B2 (en) * | 2007-10-09 | 2012-10-09 | Cleversafe, Inc. | Block based access to a dispersed data storage network |
US10044807B2 (en) | 2005-09-30 | 2018-08-07 | International Business Machines Corporation | Optimistic checked writes |
US8209363B2 (en) | 2007-10-09 | 2012-06-26 | Cleversafe, Inc. | File system adapted for use with a dispersed data storage network |
US8555109B2 (en) | 2009-07-30 | 2013-10-08 | Cleversafe, Inc. | Method and apparatus for distributed storage integrity processing |
US9027080B2 (en) | 2008-03-31 | 2015-05-05 | Cleversafe, Inc. | Proxy access to a dispersed storage network |
US11080138B1 (en) | 2010-04-26 | 2021-08-03 | Pure Storage, Inc. | Storing integrity information in a vast storage system |
US10860424B1 (en) | 2005-09-30 | 2020-12-08 | Pure Storage, Inc. | Background verification processing in a storage network |
US11272009B1 (en) | 2005-09-30 | 2022-03-08 | Pure Storage, Inc. | Managed data slice maintenance in a distributed storage system |
US10855769B2 (en) | 2005-09-30 | 2020-12-01 | Pure Storage, Inc. | Prioritizing memory devices to replace based on namespace health |
US7904475B2 (en) * | 2007-10-09 | 2011-03-08 | Cleversafe, Inc. | Virtualized data storage vaults on a dispersed data storage network |
US10866754B2 (en) | 2010-04-26 | 2020-12-15 | Pure Storage, Inc. | Content archiving in a distributed storage network |
US7953937B2 (en) | 2005-09-30 | 2011-05-31 | Cleversafe, Inc. | Systems, methods, and apparatus for subdividing data for storage in a dispersed data storage grid |
US10257276B2 (en) | 2005-09-30 | 2019-04-09 | International Business Machines Corporation | Predictive rebalancing according to future usage expectations |
US10938418B2 (en) | 2005-09-30 | 2021-03-02 | Pure Storage, Inc. | Online disk replacement/removal |
US8938591B2 (en) * | 2005-09-30 | 2015-01-20 | Cleversafe, Inc. | Dispersed storage processing unit and methods with data aggregation for use in a dispersed storage system |
US8880799B2 (en) * | 2005-09-30 | 2014-11-04 | Cleversafe, Inc. | Rebuilding data on a dispersed storage network |
US10270858B2 (en) | 2005-09-30 | 2019-04-23 | International Business Machines Corporation | Inducing memory device idle time through rolling read prioritizations |
US10051057B2 (en) | 2005-09-30 | 2018-08-14 | International Business Machines Corporation | Prioritizing read locations based on an error history |
US11340988B2 (en) | 2005-09-30 | 2022-05-24 | Pure Storage, Inc. | Generating integrity information in a vast storage system |
US11221917B1 (en) | 2005-09-30 | 2022-01-11 | Pure Storage, Inc. | Integrity processing in a dispersed storage network |
US11620185B2 (en) | 2005-09-30 | 2023-04-04 | Pure Storage, Inc. | Integrity processing in a dispersed storage network |
US8171101B2 (en) * | 2005-09-30 | 2012-05-01 | Cleversafe, Inc. | Smart access to a dispersed data storage network |
US10154034B2 (en) | 2010-04-26 | 2018-12-11 | International Business Machines Corporation | Cooperative data access request authorization in a dispersed storage network |
US9632722B2 (en) | 2010-05-19 | 2017-04-25 | International Business Machines Corporation | Balancing storage unit utilization within a dispersed storage network |
US12120177B2 (en) | 2005-09-30 | 2024-10-15 | Pure Storage, Inc. | Performance based access in a storage network |
US10282440B2 (en) | 2015-03-31 | 2019-05-07 | International Business Machines Corporation | Prioritizing rebuilding of encoded data slices |
WO2007053356A2 (en) | 2005-10-28 | 2007-05-10 | Network Appliance, Inc. | System and method for optimizing multi-pathing support in a distributed storage system environment |
US7730258B1 (en) | 2005-11-01 | 2010-06-01 | Netapp, Inc. | System and method for managing hard and soft lock state information in a distributed storage system environment |
US8255425B1 (en) | 2005-11-01 | 2012-08-28 | Netapp, Inc. | System and method for event notification using an event routing table |
US8009830B2 (en) | 2005-11-18 | 2011-08-30 | Security First Corporation | Secure data parser method and system |
US8012542B2 (en) * | 2005-12-30 | 2011-09-06 | E.I. Du Pont De Nemours And Company | Fluoropolymer coating compositions containing adhesive polymers and substrate coating process |
TW200727167A (en) * | 2006-01-02 | 2007-07-16 | Via Tech Inc | Disk array data arrangement structure and its data access method |
US7934120B2 (en) * | 2006-09-11 | 2011-04-26 | International Business Machines Corporation | Storing data redundantly |
US8301673B2 (en) * | 2006-12-29 | 2012-10-30 | Netapp, Inc. | System and method for performing distributed consistency verification of a clustered file system |
US8489811B1 (en) | 2006-12-29 | 2013-07-16 | Netapp, Inc. | System and method for addressing data containers using data set identifiers |
US8639656B2 (en) | 2007-02-02 | 2014-01-28 | International Business Machines Corporation | Method for implementing persistent file pre-allocation |
US8312046B1 (en) | 2007-02-28 | 2012-11-13 | Netapp, Inc. | System and method for enabling a data container to appear in a plurality of locations in a super-namespace |
US7827350B1 (en) | 2007-04-27 | 2010-11-02 | Netapp, Inc. | Method and system for promoting a snapshot in a distributed file system |
US7797489B1 (en) | 2007-06-01 | 2010-09-14 | Netapp, Inc. | System and method for providing space availability notification in a distributed striped volume set |
US7975102B1 (en) | 2007-08-06 | 2011-07-05 | Netapp, Inc. | Technique to avoid cascaded hot spotting |
US8819179B2 (en) * | 2007-10-09 | 2014-08-26 | Cleversafe, Inc. | Data revision synchronization in a dispersed storage network |
US8185614B2 (en) * | 2007-10-09 | 2012-05-22 | Cleversafe, Inc. | Systems, methods, and apparatus for identifying accessible dispersed digital storage vaults utilizing a centralized registry |
US9697171B2 (en) | 2007-10-09 | 2017-07-04 | Internaitonal Business Machines Corporation | Multi-writer revision synchronization in a dispersed storage network |
US10027478B2 (en) | 2007-10-09 | 2018-07-17 | International Business Machines Corporation | Differential key backup |
US8572429B2 (en) * | 2007-10-09 | 2013-10-29 | Cleversafe, Inc. | Optimistic data writing in a dispersed storage network |
US9959076B2 (en) | 2007-10-09 | 2018-05-01 | International Business Machines Corporation | Optimized disk load distribution |
US8533256B2 (en) * | 2007-10-09 | 2013-09-10 | Cleversafe, Inc. | Object interface to a dispersed data storage network |
US8549351B2 (en) * | 2007-10-09 | 2013-10-01 | Cleversafe, Inc. | Pessimistic data reading in a dispersed storage network |
US9888076B2 (en) | 2007-10-09 | 2018-02-06 | International Business Machines Corporation | Encoded data slice caching in a distributed storage network |
US8965956B2 (en) | 2007-10-09 | 2015-02-24 | Cleversafe, Inc. | Integrated client for use with a dispersed data storage network |
US8478865B2 (en) * | 2007-10-09 | 2013-07-02 | Cleversafe, Inc. | Systems, methods, and apparatus for matching a connection request with a network interface adapted for use with a dispersed data storage network |
US8156405B1 (en) * | 2007-12-07 | 2012-04-10 | Emc Corporation | Efficient redundant memory unit array |
US7996607B1 (en) | 2008-01-28 | 2011-08-09 | Netapp, Inc. | Distributing lookup operations in a striped storage system |
US9501355B2 (en) | 2008-03-31 | 2016-11-22 | International Business Machines Corporation | Storing data and directory information in a distributed storage network |
US7971013B2 (en) | 2008-04-30 | 2011-06-28 | Xiotech Corporation | Compensating for write speed differences between mirroring storage devices by striping |
US8819011B2 (en) * | 2008-07-16 | 2014-08-26 | Cleversafe, Inc. | Command line interpreter for accessing a data object stored in a distributed storage network |
US8630987B2 (en) * | 2008-07-16 | 2014-01-14 | Cleversafe, Inc. | System and method for accessing a data object stored in a distributed storage network |
US8429514B1 (en) * | 2008-09-24 | 2013-04-23 | Network Appliance, Inc. | Dynamic load balancing of distributed parity in a RAID array |
US7992055B1 (en) | 2008-11-07 | 2011-08-02 | Netapp, Inc. | System and method for providing autosupport for a security system |
US8161076B1 (en) * | 2009-04-02 | 2012-04-17 | Netapp, Inc. | Generation and use of a data structure for distributing responsibilities among multiple resources in a network storage system |
US8656187B2 (en) * | 2009-04-20 | 2014-02-18 | Cleversafe, Inc. | Dispersed storage secure data decoding |
US9092294B2 (en) * | 2009-04-20 | 2015-07-28 | Cleversafe, Inc. | Systems, apparatus, and methods for utilizing a reachability set to manage a network upgrade |
US8744071B2 (en) * | 2009-04-20 | 2014-06-03 | Cleversafe, Inc. | Dispersed data storage system data encryption and encoding |
US10395054B2 (en) | 2011-06-06 | 2019-08-27 | Pure Storage, Inc. | Updating distributed storage network software |
US8601259B2 (en) * | 2009-04-20 | 2013-12-03 | Cleversafe, Inc. | Securing data in a dispersed storage network using security sentinel value |
US8504847B2 (en) * | 2009-04-20 | 2013-08-06 | Cleversafe, Inc. | Securing data in a dispersed storage network using shared secret slices |
US9483656B2 (en) | 2009-04-20 | 2016-11-01 | International Business Machines Corporation | Efficient and secure data storage utilizing a dispersed data storage system |
US11991280B2 (en) | 2009-04-20 | 2024-05-21 | Pure Storage, Inc. | Randomized transforms in a dispersed data storage system |
US10104045B2 (en) * | 2009-04-20 | 2018-10-16 | International Business Machines Corporation | Verifying data security in a dispersed storage network |
US11868498B1 (en) | 2009-04-20 | 2024-01-09 | Pure Storage, Inc. | Storage integrity processing in a storage network |
US8819781B2 (en) * | 2009-04-20 | 2014-08-26 | Cleversafe, Inc. | Management of network devices within a dispersed data storage network |
US10447474B2 (en) | 2009-04-20 | 2019-10-15 | Pure Storage, Inc. | Dispersed data storage system data decoding and decryption |
US8117388B2 (en) * | 2009-04-30 | 2012-02-14 | Netapp, Inc. | Data distribution through capacity leveling in a striped file system |
US10230692B2 (en) * | 2009-06-30 | 2019-03-12 | International Business Machines Corporation | Distributed storage processing module |
US10108492B2 (en) | 2009-07-30 | 2018-10-23 | International Business Machines Corporation | Rebuilding data stored in a dispersed storage network |
US9207870B2 (en) | 2009-07-30 | 2015-12-08 | Cleversafe, Inc. | Allocating storage units in a dispersed storage network |
US9208025B2 (en) | 2009-07-30 | 2015-12-08 | Cleversafe, Inc. | Virtual memory mapping in a dispersed storage network |
US9009575B2 (en) | 2009-07-30 | 2015-04-14 | Cleversafe, Inc. | Rebuilding a data revision in a dispersed storage network |
US8706980B2 (en) * | 2009-07-30 | 2014-04-22 | Cleversafe, Inc. | Method and apparatus for slice partial rebuilding in a dispersed storage network |
US8489915B2 (en) * | 2009-07-30 | 2013-07-16 | Cleversafe, Inc. | Method and apparatus for storage integrity processing based on error types in a dispersed storage network |
US8275744B2 (en) * | 2009-07-30 | 2012-09-25 | Cleversafe, Inc. | Dispersed storage network virtual address fields |
US9558059B2 (en) | 2009-07-30 | 2017-01-31 | International Business Machines Corporation | Detecting data requiring rebuilding in a dispersed storage network |
US8527838B2 (en) | 2009-07-31 | 2013-09-03 | Cleversafe, Inc. | Memory controller utilizing an error coding dispersal function |
US9167277B2 (en) * | 2009-08-03 | 2015-10-20 | Cleversafe, Inc. | Dispersed storage network data manipulation |
US9047217B2 (en) * | 2009-08-27 | 2015-06-02 | Cleversafe, Inc. | Nested distributed storage unit and applications thereof |
US8560855B2 (en) | 2009-08-27 | 2013-10-15 | Cleversafe, Inc. | Verification of dispersed storage network access control information |
US9411810B2 (en) | 2009-08-27 | 2016-08-09 | International Business Machines Corporation | Method and apparatus for identifying data inconsistency in a dispersed storage network |
US8548913B2 (en) | 2009-09-29 | 2013-10-01 | Cleversafe, Inc. | Method and apparatus to secure an electronic commerce transaction |
US8924387B2 (en) | 2009-09-29 | 2014-12-30 | Cleversafe, Inc. | Social networking utilizing a dispersed storage network |
US20110078343A1 (en) | 2009-09-29 | 2011-03-31 | Cleversafe, Inc. | Distributed storage network including memory diversity |
US8381025B2 (en) * | 2009-09-30 | 2013-02-19 | Cleversafe, Inc. | Method and apparatus for dispersed storage memory device selection |
US8402344B2 (en) * | 2009-10-05 | 2013-03-19 | Cleversafe, Inc. | Method and apparatus for controlling dispersed storage of streaming data |
US8291277B2 (en) * | 2009-10-29 | 2012-10-16 | Cleversafe, Inc. | Data distribution utilizing unique write parameters in a dispersed storage system |
US10389845B2 (en) | 2009-10-29 | 2019-08-20 | Pure Storage, Inc. | Determining how to service requests based on several indicators |
US9015431B2 (en) * | 2009-10-29 | 2015-04-21 | Cleversafe, Inc. | Distributed storage revision rollbacks |
US9774678B2 (en) | 2009-10-29 | 2017-09-26 | International Business Machines Corporation | Temporarily storing data in a dispersed storage network |
US10757187B2 (en) | 2009-10-29 | 2020-08-25 | Pure Storage, Inc. | Streaming all-or-nothing encoding with random offset support |
US9661356B2 (en) | 2009-10-29 | 2017-05-23 | International Business Machines Corporation | Distribution of unique copies of broadcast data utilizing fault-tolerant retrieval from dispersed storage |
US9311185B2 (en) | 2009-10-30 | 2016-04-12 | Cleversafe, Inc. | Dispersed storage unit solicitation method and apparatus |
US8589637B2 (en) * | 2009-10-30 | 2013-11-19 | Cleversafe, Inc. | Concurrent set storage in distributed storage network |
US9195408B2 (en) | 2009-10-30 | 2015-11-24 | Cleversafe, Inc. | Highly autonomous dispersed storage system retrieval method |
US9098376B2 (en) | 2009-10-30 | 2015-08-04 | Cleversafe, Inc. | Distributed storage network for modification of a data object |
US8479078B2 (en) * | 2009-10-30 | 2013-07-02 | Cleversafe, Inc. | Distributed storage network for modification of a data object |
US8572282B2 (en) | 2009-10-30 | 2013-10-29 | Cleversafe, Inc. | Router assisted dispersed storage network method and apparatus |
US9900150B2 (en) * | 2009-10-30 | 2018-02-20 | International Business Machines Corporation | Dispersed storage camera device and method of operation |
US9413529B2 (en) | 2009-10-30 | 2016-08-09 | International Business Machines Corporation | Distributed storage network and method for storing and retrieving encryption keys |
US10073737B2 (en) | 2009-10-30 | 2018-09-11 | International Business Machines Corporation | Slice location identification |
US9501349B2 (en) | 2009-11-24 | 2016-11-22 | International Business Machines Corporation | Changing dispersed storage error encoding parameters |
US8918897B2 (en) | 2009-11-24 | 2014-12-23 | Cleversafe, Inc. | Dispersed storage network data slice integrity verification |
US9270298B2 (en) | 2009-11-24 | 2016-02-23 | International Business Machines Corporation | Selecting storage units to rebuild an encoded data slice |
US9152514B2 (en) | 2009-11-24 | 2015-10-06 | Cleversafe, Inc. | Rebuilding a data segment in a dispersed storage network |
US9996548B2 (en) | 2009-11-25 | 2018-06-12 | International Business Machines Corporation | Dispersed storage using localized peer-to-peer capable wireless devices in a peer-to-peer or femto cell supported carrier served fashion |
US8819452B2 (en) * | 2009-11-25 | 2014-08-26 | Cleversafe, Inc. | Efficient storage of encrypted data in a dispersed storage network |
US8688907B2 (en) * | 2009-11-25 | 2014-04-01 | Cleversafe, Inc. | Large scale subscription based dispersed storage network |
US8527807B2 (en) * | 2009-11-25 | 2013-09-03 | Cleversafe, Inc. | Localized dispersed storage memory system |
US10015141B2 (en) | 2009-11-25 | 2018-07-03 | International Business Machines Corporation | Dispersed data storage in a VPN group of devices |
US9836352B2 (en) | 2009-11-25 | 2017-12-05 | International Business Machines Corporation | Detecting a utilization imbalance between dispersed storage network storage units |
US9672109B2 (en) | 2009-11-25 | 2017-06-06 | International Business Machines Corporation | Adaptive dispersed storage network (DSN) and system |
US8621268B2 (en) * | 2009-11-25 | 2013-12-31 | Cleversafe, Inc. | Write threshold utilization in a dispersed storage system |
US9626248B2 (en) | 2009-11-25 | 2017-04-18 | International Business Machines Corporation | Likelihood based rebuilding of missing encoded data slices |
US9489264B2 (en) | 2009-11-25 | 2016-11-08 | International Business Machines Corporation | Storing an encoded data slice as a set of sub-slices |
US12120127B1 (en) | 2009-12-29 | 2024-10-15 | Pure Storage, Inc. | Storage of data objects in a storage network |
US8352831B2 (en) * | 2009-12-29 | 2013-01-08 | Cleversafe, Inc. | Digital content distribution utilizing dispersed storage |
US10289505B2 (en) | 2009-12-29 | 2019-05-14 | International Business Machines Corporation | Dispersed multi-media content for a centralized digital video storage system |
US9369526B2 (en) | 2009-12-29 | 2016-06-14 | International Business Machines Corporation | Distributed storage time synchronization based on retrieval delay |
US10158648B2 (en) | 2009-12-29 | 2018-12-18 | International Business Machines Corporation | Policy-based access in a dispersed storage network |
US9507735B2 (en) | 2009-12-29 | 2016-11-29 | International Business Machines Corporation | Digital content retrieval utilizing dispersed storage |
US9152489B2 (en) | 2009-12-29 | 2015-10-06 | Cleversafe, Inc. | Revision synchronization of a dispersed storage network |
US10067831B2 (en) | 2009-12-29 | 2018-09-04 | International Business Machines Corporation | Slice migration in a dispersed storage network |
US10237281B2 (en) | 2009-12-29 | 2019-03-19 | International Business Machines Corporation | Access policy updates in a dispersed storage network |
US8468368B2 (en) * | 2009-12-29 | 2013-06-18 | Cleversafe, Inc. | Data encryption parameter dispersal |
US9866595B2 (en) | 2009-12-29 | 2018-01-09 | International Busines Machines Corporation | Policy based slice deletion in a dispersed storage network |
US10001923B2 (en) | 2009-12-29 | 2018-06-19 | International Business Machines Corporation | Generation collapse |
US9798467B2 (en) | 2009-12-29 | 2017-10-24 | International Business Machines Corporation | Security checks for proxied requests |
US9330241B2 (en) | 2009-12-29 | 2016-05-03 | International Business Machines Corporation | Applying digital rights management to multi-media file playback |
US9922063B2 (en) | 2009-12-29 | 2018-03-20 | International Business Machines Corporation | Secure storage of secret data in a dispersed storage network |
US10031669B2 (en) | 2009-12-29 | 2018-07-24 | International Business Machines Corporation | Scheduling migration related traffic to be non-disruptive and performant |
US10133632B2 (en) | 2009-12-29 | 2018-11-20 | International Business Machines Corporation | Determining completion of migration in a dispersed storage network |
US10372686B2 (en) | 2009-12-29 | 2019-08-06 | International Business Machines Corporation | Policy-based storage in a dispersed storage network |
US9413393B2 (en) | 2009-12-29 | 2016-08-09 | International Business Machines Corporation | Encoding multi-media content for a centralized digital video storage system |
US9727266B2 (en) | 2009-12-29 | 2017-08-08 | International Business Machines Corporation | Selecting storage units in a dispersed storage network |
US8990585B2 (en) * | 2009-12-29 | 2015-03-24 | Cleversafe, Inc. | Time based dispersed storage access |
US10148788B2 (en) | 2009-12-29 | 2018-12-04 | International Business Machines Corporation | Method for providing schedulers in a distributed storage network |
US9672108B2 (en) | 2009-12-29 | 2017-06-06 | International Business Machines Corporation | Dispersed storage network (DSN) and system with improved security |
US9305597B2 (en) | 2009-12-29 | 2016-04-05 | Cleversafe, Inc. | Accessing stored multi-media content based on a subscription priority level |
US8762343B2 (en) | 2009-12-29 | 2014-06-24 | Cleversafe, Inc. | Dispersed storage of software |
US20180335967A1 (en) | 2009-12-29 | 2018-11-22 | International Business Machines Corporation | User customizable data processing plan in a dispersed storage network |
US8959366B2 (en) | 2010-01-28 | 2015-02-17 | Cleversafe, Inc. | De-sequencing encoded data slices |
US8522113B2 (en) * | 2010-01-28 | 2013-08-27 | Cleversafe, Inc. | Selecting storage facilities and dispersal parameters in a dispersed storage network |
US11301592B2 (en) | 2010-01-28 | 2022-04-12 | Pure Storage, Inc. | Distributed storage with data obfuscation and method for use therewith |
US8918674B2 (en) | 2010-01-28 | 2014-12-23 | Cleversafe, Inc. | Directory file system in a dispersed storage network |
US9201732B2 (en) | 2010-01-28 | 2015-12-01 | Cleversafe, Inc. | Selective activation of memory to retrieve data in a dispersed storage network |
US8954667B2 (en) * | 2010-01-28 | 2015-02-10 | Cleversafe, Inc. | Data migration in a dispersed storage network |
US9760440B2 (en) | 2010-01-28 | 2017-09-12 | International Business Machines Corporation | Site-based namespace allocation |
US9043548B2 (en) | 2010-01-28 | 2015-05-26 | Cleversafe, Inc. | Streaming content storage |
US20180365105A1 (en) | 2014-06-05 | 2018-12-20 | International Business Machines Corporation | Establishing an operation execution schedule in a dispersed storage network |
US10216647B2 (en) | 2010-02-27 | 2019-02-26 | International Business Machines Corporation | Compacting dispersed storage space |
US9135115B2 (en) | 2010-02-27 | 2015-09-15 | Cleversafe, Inc. | Storing data in multiple formats including a dispersed storage format |
US10324791B2 (en) | 2010-11-01 | 2019-06-18 | International Business Machines Corporation | Selectable parallel processing of dispersed storage error encoding |
US10007575B2 (en) | 2010-02-27 | 2018-06-26 | International Business Machines Corporation | Alternative multiple memory format storage in a storage network |
US9606867B2 (en) | 2014-06-05 | 2017-03-28 | International Business Machines Corporation | Maintaining data storage in accordance with an access metric |
US8725940B2 (en) * | 2010-02-27 | 2014-05-13 | Cleversafe, Inc. | Distributedly storing raid data in a raid memory and a dispersed storage network memory |
US10268374B2 (en) | 2010-02-27 | 2019-04-23 | International Business Machines Corporation | Redundant array of independent discs and dispersed storage network system re-director |
US11429486B1 (en) | 2010-02-27 | 2022-08-30 | Pure Storage, Inc. | Rebuilding data via locally decodable redundancy in a vast storage network |
US8347169B1 (en) * | 2010-03-01 | 2013-01-01 | Applied Micro Circuits Corporation | System and method for encoding using common partial parity products |
US8281182B2 (en) | 2010-03-12 | 2012-10-02 | Cleversafe, Inc. | Dispersed storage unit selection |
US8578205B2 (en) * | 2010-03-15 | 2013-11-05 | Cleversafe, Inc. | Requesting cloud data storage |
US8938013B2 (en) * | 2010-03-16 | 2015-01-20 | Cleversafe, Inc. | Dispersal of priority data in a dispersed storage network |
US9170884B2 (en) | 2010-03-16 | 2015-10-27 | Cleversafe, Inc. | Utilizing cached encoded data slices in a dispersed storage network |
US9229824B2 (en) | 2010-03-16 | 2016-01-05 | International Business Machines Corporation | Caching rebuilt encoded data slices in a dispersed storage network |
US9898373B2 (en) | 2010-04-26 | 2018-02-20 | International Business Machines Corporation | Prioritizing rebuilding of stored data in a dispersed storage network |
US10447767B2 (en) | 2010-04-26 | 2019-10-15 | Pure Storage, Inc. | Resolving a performance issue within a dispersed storage network |
US8938552B2 (en) | 2010-08-02 | 2015-01-20 | Cleversafe, Inc. | Resolving a protocol issue within a dispersed storage network |
US10956292B1 (en) | 2010-04-26 | 2021-03-23 | Pure Storage, Inc. | Utilizing integrity information for data retrieval in a vast storage system |
US8914669B2 (en) | 2010-04-26 | 2014-12-16 | Cleversafe, Inc. | Secure rebuilding of an encoded data slice in a dispersed storage network |
US8625635B2 (en) | 2010-04-26 | 2014-01-07 | Cleversafe, Inc. | Dispersed storage network frame protocol header |
US9092386B2 (en) | 2010-04-26 | 2015-07-28 | Cleversafe, Inc. | Indicating an error within a dispersed storage network |
US9606858B2 (en) | 2010-04-26 | 2017-03-28 | International Business Machines Corporation | Temporarily storing an encoded data slice |
US9047218B2 (en) | 2010-04-26 | 2015-06-02 | Cleversafe, Inc. | Dispersed storage network slice name verification |
US9495117B2 (en) | 2010-04-26 | 2016-11-15 | International Business Machines Corporation | Storing data in a dispersed storage network |
US10911230B2 (en) | 2010-05-19 | 2021-02-02 | Pure Storage, Inc. | Securely activating functionality of a computing device in a dispersed storage network |
US8621580B2 (en) | 2010-05-19 | 2013-12-31 | Cleversafe, Inc. | Retrieving access information in a dispersed storage network |
US11740972B1 (en) | 2010-05-19 | 2023-08-29 | Pure Storage, Inc. | Migrating data in a vast storage network |
US8861727B2 (en) | 2010-05-19 | 2014-10-14 | Cleversafe, Inc. | Storage of sensitive data in a dispersed storage network |
US10193689B2 (en) | 2010-05-19 | 2019-01-29 | International Business Machines Corporation | Storing access information in a dispersed storage network |
US8707088B2 (en) | 2010-05-19 | 2014-04-22 | Cleversafe, Inc. | Reconfiguring data storage in multiple dispersed storage networks |
US10353774B2 (en) | 2015-10-30 | 2019-07-16 | International Business Machines Corporation | Utilizing storage unit latency data in a dispersed storage network |
US8909858B2 (en) | 2010-06-09 | 2014-12-09 | Cleversafe, Inc. | Storing encoded data slices in a dispersed storage network |
US8892598B2 (en) | 2010-06-22 | 2014-11-18 | Cleversafe, Inc. | Coordinated retrieval of data from a dispersed storage network |
US8555142B2 (en) | 2010-06-22 | 2013-10-08 | Cleversafe, Inc. | Verifying integrity of data stored in a dispersed storage memory |
US8627114B2 (en) | 2010-08-02 | 2014-01-07 | Cleversafe, Inc. | Authenticating a data access request to a dispersed storage network |
US9063968B2 (en) | 2010-08-02 | 2015-06-23 | Cleversafe, Inc. | Identifying a compromised encoded data slice |
US9077734B2 (en) | 2010-08-02 | 2015-07-07 | Cleversafe, Inc. | Authentication of devices of a dispersed storage network |
US10162524B2 (en) | 2010-08-02 | 2018-12-25 | International Business Machines Corporation | Determining whether to compress a data segment in a dispersed storage network |
US20190095101A1 (en) | 2010-08-02 | 2019-03-28 | International Business Machines Corporation | Authenticating a credential in a dispersed storage network |
US10255135B2 (en) | 2010-08-25 | 2019-04-09 | International Business Machines Corporation | Method and apparatus for non-interactive information dispersal |
US9940195B2 (en) | 2010-08-25 | 2018-04-10 | International Business Machines Corporation | Encryption of slice partials |
US8904226B2 (en) | 2010-08-26 | 2014-12-02 | Cleversafe, Inc. | Migrating stored copies of a file to stored encoded data slices |
US9112535B2 (en) | 2010-10-06 | 2015-08-18 | Cleversafe, Inc. | Data transmission utilizing partitioning and dispersed storage error encoding |
US9843412B2 (en) | 2010-10-06 | 2017-12-12 | International Business Machines Corporation | Optimizing routing of data across a communications network |
US9571230B2 (en) | 2010-10-06 | 2017-02-14 | International Business Machines Corporation | Adjusting routing of data within a network path |
US10970168B2 (en) | 2010-10-06 | 2021-04-06 | Pure Storage, Inc. | Adjusting dispersed storage error encoding parameters based on path performance |
US9116831B2 (en) | 2010-10-06 | 2015-08-25 | Cleversafe, Inc. | Correcting an errant encoded data slice |
US10298957B2 (en) | 2010-10-06 | 2019-05-21 | International Business Machines Corporation | Content-based encoding in a multiple routing path communications system |
US9015499B2 (en) | 2010-11-01 | 2015-04-21 | Cleversafe, Inc. | Verifying data integrity utilizing dispersed storage |
US8707105B2 (en) | 2010-11-01 | 2014-04-22 | Cleversafe, Inc. | Updating a set of memory devices in a dispersed storage network |
US10082970B2 (en) | 2010-11-01 | 2018-09-25 | International Business Machines Corporation | Storing an effective dynamic width of encoded data slices |
US10146645B2 (en) | 2010-11-01 | 2018-12-04 | International Business Machines Corporation | Multiple memory format storage in a storage network |
US10289318B2 (en) | 2010-11-01 | 2019-05-14 | International Business Machines Corporation | Adjusting optimistic writes in a dispersed storage network |
US10768833B2 (en) | 2010-11-01 | 2020-09-08 | Pure Storage, Inc. | Object dispersal load balancing |
US8627065B2 (en) | 2010-11-09 | 2014-01-07 | Cleversafe, Inc. | Validating a certificate chain in a dispersed storage network |
US9590838B2 (en) | 2010-11-09 | 2017-03-07 | International Business Machines Corporation | Transferring data of a dispersed storage network |
US10802763B2 (en) | 2010-11-29 | 2020-10-13 | Pure Storage, Inc. | Remote storage verification |
US11307930B1 (en) | 2010-11-29 | 2022-04-19 | Pure Storage, Inc. | Optimized selection of participants in distributed data rebuild/verification |
US10372350B2 (en) | 2010-11-29 | 2019-08-06 | Pure Storage, Inc. | Shared ownership of namespace ranges |
US11789631B2 (en) | 2010-11-29 | 2023-10-17 | Pure Storage, Inc. | Utilizing metadata storage trees in a vast storage network |
US9454431B2 (en) | 2010-11-29 | 2016-09-27 | International Business Machines Corporation | Memory selection for slice storage in a dispersed storage network |
US9483398B2 (en) | 2010-11-29 | 2016-11-01 | International Business Machines Corporation | Partitioning data for storage in a dispersed storage network |
US10922179B2 (en) | 2010-11-29 | 2021-02-16 | Pure Storage, Inc. | Post rebuild verification |
US8892845B2 (en) | 2010-12-22 | 2014-11-18 | Cleversafe, Inc. | Segmenting data for storage in a dispersed storage network |
US8897443B2 (en) | 2010-12-27 | 2014-11-25 | Cleversafe, Inc. | Watermarking slices stored in a dispersed storage network |
US10402268B2 (en) | 2011-02-01 | 2019-09-03 | Pure Storage, Inc. | Utilizing a dispersed storage network access token module to acquire digital content from a digital content provider |
US8688949B2 (en) | 2011-02-01 | 2014-04-01 | Cleversafe, Inc. | Modifying data storage in response to detection of a memory system imbalance |
US9658911B2 (en) | 2011-03-02 | 2017-05-23 | International Business Machines Corporation | Selecting a directory of a dispersed storage network |
US8868695B2 (en) | 2011-03-02 | 2014-10-21 | Cleversafe, Inc. | Configuring a generic computing device utilizing specific computing device operation information |
US11418580B2 (en) | 2011-04-01 | 2022-08-16 | Pure Storage, Inc. | Selective generation of secure signatures in a distributed storage network |
US8874990B2 (en) | 2011-04-01 | 2014-10-28 | Cleversafe, Inc. | Pre-fetching data segments stored in a dispersed storage network |
US8843804B2 (en) | 2011-04-01 | 2014-09-23 | Cleversafe, Inc. | Adjusting a dispersal parameter of dispersedly stored data |
US10298684B2 (en) | 2011-04-01 | 2019-05-21 | International Business Machines Corporation | Adaptive replication of dispersed data to improve data access performance |
US9298550B2 (en) | 2011-05-09 | 2016-03-29 | Cleversafe, Inc. | Assigning a dispersed storage network address range in a maintenance free storage container |
US10452836B2 (en) | 2011-05-09 | 2019-10-22 | Pure Storage, Inc. | Retrieving a hypertext markup language file from a dispersed storage network memory |
US8954787B2 (en) | 2011-05-09 | 2015-02-10 | Cleversafe, Inc. | Establishing trust in a maintenance free storage container |
US20170192684A1 (en) | 2011-05-09 | 2017-07-06 | International Business Machines Corporation | Auditing a transaction in a dispersed storage network |
US9219604B2 (en) | 2011-05-09 | 2015-12-22 | Cleversafe, Inc. | Generating an encrypted message for storage |
US10949301B2 (en) | 2011-06-06 | 2021-03-16 | Pure Storage, Inc. | Pre-positioning pre-stored content in a content distribution system |
US10061650B2 (en) | 2011-06-06 | 2018-08-28 | International Business Machines Corporation | Priority based rebuilding |
US8762479B2 (en) | 2011-06-06 | 2014-06-24 | Cleversafe, Inc. | Distributing multi-media content to a plurality of potential accessing devices |
US9400714B2 (en) | 2011-06-06 | 2016-07-26 | International Business Machines Corporation | Wirelessly communicating a data file |
US10042709B2 (en) | 2011-06-06 | 2018-08-07 | International Business Machines Corporation | Rebuild prioritization during a plurality of concurrent data object write operations |
US8694545B2 (en) | 2011-07-06 | 2014-04-08 | Cleversafe, Inc. | Storing data and metadata in a distributed storage network |
US8966311B2 (en) | 2011-07-06 | 2015-02-24 | Cleversafe, Inc. | Maintenance free storage container storage module access |
US12099752B2 (en) | 2011-07-27 | 2024-09-24 | Pure Storage, Inc. | Error prediction based on correlation using event records |
US10678619B2 (en) | 2011-07-27 | 2020-06-09 | Pure Storage, Inc. | Unified logs and device statistics |
EP2737431A4 (en) | 2011-07-27 | 2015-03-25 | Cleversafe Inc | GENERATION OF DISTRIBUTED STORAGE NETWORK EVENT RECORDS |
US11016702B2 (en) | 2011-07-27 | 2021-05-25 | Pure Storage, Inc. | Hierarchical event tree |
US10454678B2 (en) | 2011-08-17 | 2019-10-22 | Pure Storage, Inc. | Accesor-based audit trails |
US9229823B2 (en) | 2011-08-17 | 2016-01-05 | International Business Machines Corporation | Storage and retrieval of dispersed storage network access information |
US10120756B2 (en) | 2011-08-17 | 2018-11-06 | International Business Machines Corporation | Audit object generation in a dispersed storage network |
US9971802B2 (en) | 2011-08-17 | 2018-05-15 | International Business Machines Corporation | Audit record transformation in a dispersed storage network |
US11907060B2 (en) | 2011-09-06 | 2024-02-20 | Pure Storage, Inc. | Coding of data streams in a vast storage network |
US8930649B2 (en) | 2011-09-06 | 2015-01-06 | Cleversafe, Inc. | Concurrent coding of data streams |
US20190179696A1 (en) | 2011-09-06 | 2019-06-13 | International Business Machines Corporation | Demultiplexing decoded data streams in a distributed storage network |
US10235237B2 (en) | 2011-09-06 | 2019-03-19 | Intertnational Business Machines Corporation | Decoding data streams in a distributed storage network |
US8555130B2 (en) | 2011-10-04 | 2013-10-08 | Cleversafe, Inc. | Storing encoded data slices in a dispersed storage unit |
US8677214B2 (en) | 2011-10-04 | 2014-03-18 | Cleversafe, Inc. | Encoding data utilizing a zero information gain function |
US9274864B2 (en) | 2011-10-04 | 2016-03-01 | International Business Machines Corporation | Accessing large amounts of data in a dispersed storage network |
US9304843B2 (en) | 2011-11-01 | 2016-04-05 | Cleversafe, Inc. | Highly secure method for accessing a dispersed storage network |
US10437678B2 (en) | 2011-11-01 | 2019-10-08 | Pure Storage, Inc. | Updating an encoded data slice |
US10365969B2 (en) | 2011-11-01 | 2019-07-30 | International Business Machines Corporation | Multiple wireless communication systems stream slices based on geography |
US11329830B1 (en) | 2011-11-01 | 2022-05-10 | Pure Storage, Inc. | Dispersed credentials |
US10496500B2 (en) | 2011-11-01 | 2019-12-03 | Pure Storage, Inc. | Preemptively reading extra encoded data slices |
US8627066B2 (en) | 2011-11-03 | 2014-01-07 | Cleversafe, Inc. | Processing a dispersed storage network access request utilizing certificate chain validation information |
US8848906B2 (en) | 2011-11-28 | 2014-09-30 | Cleversafe, Inc. | Encrypting data for storage in a dispersed storage network |
US10558592B2 (en) | 2011-11-28 | 2020-02-11 | Pure Storage, Inc. | Priority level adaptation in a dispersed storage network |
US11474958B1 (en) | 2011-11-28 | 2022-10-18 | Pure Storage, Inc. | Generating and queuing system messages with priorities in a storage network |
US10318445B2 (en) | 2011-11-28 | 2019-06-11 | International Business Machines Corporation | Priority level adaptation in a dispersed storage network |
US10387071B2 (en) | 2011-11-28 | 2019-08-20 | Pure Storage, Inc. | On-the-fly cancellation of unnecessary read requests |
US10977194B2 (en) | 2011-11-28 | 2021-04-13 | Pure Storage, Inc. | Securely storing random keys in a dispersed storage network |
US10469578B2 (en) | 2011-11-28 | 2019-11-05 | Pure Storage, Inc. | Prioritization of messages of a dispersed storage network |
US10055283B2 (en) | 2011-11-28 | 2018-08-21 | International Business Machines Corporation | Securely distributing random keys in a dispersed storage network |
US10666596B2 (en) | 2011-12-12 | 2020-05-26 | Pure Storage, Inc. | Messaging via a shared memory of a distributed computing system |
US10346218B2 (en) | 2011-12-12 | 2019-07-09 | International Business Machines Corporation | Partial task allocation in a dispersed storage network |
US10671585B2 (en) | 2012-01-31 | 2020-06-02 | Pure Storage, Inc. | Storing indexed data to a dispersed storage network |
US9141468B2 (en) | 2011-12-12 | 2015-09-22 | Cleversafe, Inc. | Managing memory utilization in a distributed storage and task network |
US10176045B2 (en) | 2011-12-12 | 2019-01-08 | International Business Machines Corporation | Internet based shared memory in a distributed computing system |
US9817701B2 (en) | 2011-12-12 | 2017-11-14 | International Business Machines Corporation | Threshold computing in a distributed computing system |
US9507786B2 (en) | 2012-01-31 | 2016-11-29 | International Business Machines Corporation | Retrieving data utilizing a distributed index |
US10104168B2 (en) | 2011-12-12 | 2018-10-16 | International Business Machines Corporation | Method for managing throughput in a distributed storage network |
US9674155B2 (en) | 2011-12-12 | 2017-06-06 | International Business Machines Corporation | Encrypting segmented data in a distributed computing system |
US9430286B2 (en) | 2011-12-12 | 2016-08-30 | International Business Machines Corporation | Authorizing distributed task processing in a distributed storage network |
US20130238900A1 (en) | 2011-12-12 | 2013-09-12 | Cleversafe, Inc. | Dispersed storage network secure hierarchical file directory |
US10146621B2 (en) | 2011-12-12 | 2018-12-04 | International Business Machines Corporation | Chaining computes in a distributed computing system |
US10360106B2 (en) | 2011-12-12 | 2019-07-23 | International Business Machines Corporation | Throttled real-time writes |
US20180083930A1 (en) | 2011-12-12 | 2018-03-22 | International Business Machines Corporation | Reads for dispersed computation jobs |
US9009567B2 (en) | 2011-12-12 | 2015-04-14 | Cleversafe, Inc. | Encrypting distributed computing data |
US10348640B2 (en) | 2011-12-12 | 2019-07-09 | International Business Machines Corporation | Partial task execution in a dispersed storage network |
US9584359B2 (en) | 2011-12-12 | 2017-02-28 | International Business Machines Corporation | Distributed storage and computing of interim data |
US9298548B2 (en) | 2011-12-12 | 2016-03-29 | Cleversafe, Inc. | Distributed computing in a distributed storage and task network |
US9465861B2 (en) | 2012-01-31 | 2016-10-11 | International Business Machines Corporation | Retrieving indexed data from a dispersed storage network |
US9146810B2 (en) | 2012-01-31 | 2015-09-29 | Cleversafe, Inc. | Identifying a potentially compromised encoded data slice |
US9891995B2 (en) | 2012-01-31 | 2018-02-13 | International Business Machines Corporation | Cooperative decentralized rebuild scanning |
US9203901B2 (en) | 2012-01-31 | 2015-12-01 | Cleversafe, Inc. | Efficiently storing data in a dispersed storage network |
US8935256B2 (en) | 2012-03-02 | 2015-01-13 | Cleversafe, Inc. | Expanding a hierarchical dispersed storage index |
US9588994B2 (en) | 2012-03-02 | 2017-03-07 | International Business Machines Corporation | Transferring task execution in a distributed storage and task network |
US11232093B2 (en) | 2012-03-02 | 2022-01-25 | Pure Storage, Inc. | Slice migration in a dispersed storage network |
US10157051B2 (en) | 2012-03-02 | 2018-12-18 | International Business Machines Corporation | Upgrading devices in a dispersed storage network |
US10402393B2 (en) | 2012-03-02 | 2019-09-03 | Pure Storage, Inc. | Slice migration in a dispersed storage network |
US9380032B2 (en) | 2012-04-25 | 2016-06-28 | International Business Machines Corporation | Encrypting data for storage in a dispersed storage network |
US10795766B2 (en) | 2012-04-25 | 2020-10-06 | Pure Storage, Inc. | Mapping slice groupings in a dispersed storage network |
US10621044B2 (en) | 2012-04-25 | 2020-04-14 | Pure Storage, Inc. | Mapping slice groupings in a dispersed storage network |
US10073638B2 (en) | 2012-06-05 | 2018-09-11 | International Business Machines Corporation | Automatic namespace ordering determination |
US9164841B2 (en) | 2012-06-05 | 2015-10-20 | Cleversafe, Inc. | Resolution of a storage error in a dispersed storage network |
US9613052B2 (en) | 2012-06-05 | 2017-04-04 | International Business Machines Corporation | Establishing trust within a cloud computing system |
US10002047B2 (en) | 2012-06-05 | 2018-06-19 | International Business Machines Corporation | Read-if-not-revision-equals protocol message |
US10474395B2 (en) | 2012-06-05 | 2019-11-12 | Pure Storage, Inc. | Abstracting namespace mapping in a dispersed storage network through multiple hierarchies |
US10447471B2 (en) | 2012-06-05 | 2019-10-15 | Pure Storage, Inc. | Systematic secret sharing |
US10430276B2 (en) | 2012-06-25 | 2019-10-01 | Pure Storage, Inc. | Optimal orderings of processing unit priorities in a dispersed storage network |
US9110833B2 (en) | 2012-06-25 | 2015-08-18 | Cleversafe, Inc. | Non-temporarily storing temporarily stored data in a dispersed storage network |
US10157011B2 (en) | 2012-06-25 | 2018-12-18 | International Business Machines Corporation | Temporary suspension of vault access |
US11093327B1 (en) | 2012-06-25 | 2021-08-17 | Pure Storage, Inc. | Failure abatement approach for failed storage units common to multiple vaults |
US20180336097A1 (en) | 2012-06-25 | 2018-11-22 | International Business Machines Corporation | Namespace affinity and failover for processing units in a dispersed storage network |
US10114697B2 (en) | 2012-06-25 | 2018-10-30 | International Business Machines Corporation | Large object parallel writing |
US9292212B2 (en) | 2012-06-25 | 2016-03-22 | International Business Machines Corporation | Detecting storage errors in a dispersed storage network |
US10120574B2 (en) | 2012-06-25 | 2018-11-06 | International Business Machines Corporation | Reversible data modifications within DS units |
US10651975B2 (en) | 2012-08-02 | 2020-05-12 | Pure Storage, Inc. | Forwarding data amongst cooperative DSTN processing units of a massive data ingestion system |
US9258177B2 (en) | 2012-08-02 | 2016-02-09 | International Business Machines Corporation | Storing a data stream in a set of storage devices |
US10409679B2 (en) | 2012-08-31 | 2019-09-10 | Pure Storage, Inc. | Migrating data slices in a dispersed storage network |
US9875158B2 (en) | 2012-08-31 | 2018-01-23 | International Business Machines Corporation | Slice storage in a dispersed storage network |
US12105588B2 (en) | 2012-08-31 | 2024-10-01 | Pure Storage, Inc. | Adjusting error encoding parameters for writing encoded data slices |
US11360851B2 (en) | 2012-08-31 | 2022-06-14 | Pure Storage, Inc. | Duplicating authentication information between connections |
US10409678B2 (en) | 2012-08-31 | 2019-09-10 | Pure Storage, Inc. | Self-optimizing read-ahead |
US10331518B2 (en) | 2012-08-31 | 2019-06-25 | International Business Machines Corporation | Encoding data in a dispersed storage network |
US10241863B2 (en) | 2012-08-31 | 2019-03-26 | International Business Machines Corporation | Slice rebuilding in a dispersed storage network |
US9154298B2 (en) | 2012-08-31 | 2015-10-06 | Cleversafe, Inc. | Securely storing data in a dispersed storage network |
US10318549B2 (en) | 2012-09-13 | 2019-06-11 | International Business Machines Corporation | Batching modifications to nodes in a dispersed index |
US10417253B2 (en) | 2012-09-13 | 2019-09-17 | Pure Storage, Inc. | Multi-level data storage in a dispersed storage network |
US10057351B2 (en) | 2012-09-13 | 2018-08-21 | International Business Machines Corporation | Modifying information dispersal algorithm configurations in a dispersed storage network |
US10402423B2 (en) | 2012-09-13 | 2019-09-03 | Pure Storage, Inc. | Sliding windows for batching index updates |
US9483539B2 (en) | 2012-09-13 | 2016-11-01 | International Business Machines Corporation | Updating local data utilizing a distributed storage network |
US10331698B2 (en) | 2012-09-13 | 2019-06-25 | International Business Machines Corporation | Rebuilding data in a dispersed storage network |
US10606700B2 (en) | 2012-10-08 | 2020-03-31 | Pure Storage, Inc. | Enhanced dispersed storage error encoding using multiple encoding layers |
US9503513B2 (en) | 2012-10-08 | 2016-11-22 | International Business Machines Corporation | Robust transmission of data utilizing encoded data slices |
US10331519B2 (en) | 2012-10-08 | 2019-06-25 | International Business Machines Corporation | Application of secret sharing schemes at multiple levels of a dispersed storage network |
US10127111B2 (en) | 2012-10-08 | 2018-11-13 | International Business Machines Corporation | Client provided request prioritization hints |
US9936020B2 (en) | 2012-10-30 | 2018-04-03 | International Business Machines Corporation | Access control of data in a dispersed storage network |
US9311179B2 (en) | 2012-10-30 | 2016-04-12 | Cleversafe, Inc. | Threshold decoding of data based on trust levels |
US10558621B2 (en) | 2012-12-05 | 2020-02-11 | Pure Storage, Inc. | Lock stealing writes for improved reliability |
US10587691B2 (en) | 2012-12-05 | 2020-03-10 | Pure Storage, Inc. | Impatient writes |
US9521197B2 (en) | 2012-12-05 | 2016-12-13 | International Business Machines Corporation | Utilizing data object storage tracking in a dispersed storage network |
US9811533B2 (en) | 2012-12-05 | 2017-11-07 | International Business Machines Corporation | Accessing distributed computing functions in a distributed computing system |
US20140181455A1 (en) * | 2012-12-20 | 2014-06-26 | Apple Inc. | Category based space allocation for multiple storage devices |
US10402270B2 (en) | 2013-01-04 | 2019-09-03 | Pure Storage, Inc. | Deterministically determining affinity for a source name range |
US10642992B2 (en) | 2013-01-04 | 2020-05-05 | Pure Storage, Inc. | Password augmented all-or-nothin transform |
US10013203B2 (en) | 2013-01-04 | 2018-07-03 | International Business Machines Corporation | Achieving storage compliance in a dispersed storage network |
US10229002B2 (en) | 2013-01-04 | 2019-03-12 | International Business Machines Corporation | Process to migrate named objects to a dispersed or distributed storage network (DSN) |
US10204009B2 (en) | 2013-01-04 | 2019-02-12 | International Business Machines Corporation | Prioritized rebuilds using dispersed indices |
US10241866B2 (en) | 2013-01-04 | 2019-03-26 | International Business Machines Corporation | Allocating rebuilding queue entries in a dispersed storage network |
US11416340B1 (en) | 2013-01-04 | 2022-08-16 | Pure Storage, Inc. | Storage system with multiple storage types in a vast storage network |
US9311187B2 (en) | 2013-01-04 | 2016-04-12 | Cleversafe, Inc. | Achieving storage compliance in a dispersed storage network |
US9558067B2 (en) | 2013-01-04 | 2017-01-31 | International Business Machines Corporation | Mapping storage of data in a dispersed storage network |
US20190250823A1 (en) | 2013-01-04 | 2019-08-15 | International Business Machines Corporation | Efficient computation of only the required slices |
US10423491B2 (en) | 2013-01-04 | 2019-09-24 | Pure Storage, Inc. | Preventing multiple round trips when writing to target widths |
US10664360B2 (en) | 2013-02-05 | 2020-05-26 | Pure Storage, Inc. | Identifying additional resources to accelerate rebuildling |
US10310763B2 (en) | 2013-02-05 | 2019-06-04 | International Business Machines Corporation | Forming a distributed storage network memory without namespace aware distributed storage units |
US10621021B2 (en) | 2013-02-05 | 2020-04-14 | Pure Storage, Inc. | Using dispersed data structures to point to slice or date source replicas |
US10268554B2 (en) | 2013-02-05 | 2019-04-23 | International Business Machines Corporation | Using dispersed computation to change dispersal characteristics |
US10055441B2 (en) | 2013-02-05 | 2018-08-21 | International Business Machines Corporation | Updating shared group information in a dispersed storage network |
US10430122B2 (en) | 2013-02-05 | 2019-10-01 | Pure Storage, Inc. | Using partial rebuilding to change information dispersal algorithm (IDA) |
US9043499B2 (en) | 2013-02-05 | 2015-05-26 | Cleversafe, Inc. | Modifying a dispersed storage network memory data access response plan |
EP2956887A1 (en) | 2013-02-13 | 2015-12-23 | Security First Corp. | Systems and methods for a cryptographic file system layer |
US9274908B2 (en) | 2013-02-26 | 2016-03-01 | International Business Machines Corporation | Resolving write conflicts in a dispersed storage network |
US10642489B2 (en) | 2013-02-26 | 2020-05-05 | Pure Storage, Inc. | Determining when to initiate an intra-distributed storage unit rebuild vs. an inter-distributed storage unit rebuild |
US11036392B2 (en) | 2013-02-26 | 2021-06-15 | Pure Storage, Inc. | Determining when to use convergent encryption |
JP6135226B2 (ja) * | 2013-03-21 | 2017-05-31 | 日本電気株式会社 | 情報処理装置、情報処理方法、ストレージシステム及びコンピュータプログラム |
US10075523B2 (en) | 2013-04-01 | 2018-09-11 | International Business Machines Corporation | Efficient storage of data in a dispersed storage network |
US9456035B2 (en) | 2013-05-03 | 2016-09-27 | International Business Machines Corporation | Storing related data in a dispersed storage network |
US10223213B2 (en) | 2013-05-03 | 2019-03-05 | International Business Machines Corporation | Salted zero expansion all or nothing transformation |
US9405609B2 (en) | 2013-05-22 | 2016-08-02 | International Business Machines Corporation | Storing data in accordance with a performance threshold |
US9424132B2 (en) | 2013-05-30 | 2016-08-23 | International Business Machines Corporation | Adjusting dispersed storage network traffic due to rebuilding |
US9432341B2 (en) | 2013-05-30 | 2016-08-30 | International Business Machines Corporation | Securing data in a dispersed storage network |
US11226860B1 (en) | 2013-05-30 | 2022-01-18 | Pure Storage, Inc. | Difference based rebuild list scanning |
US12079081B2 (en) | 2013-07-01 | 2024-09-03 | Pure Storage, Inc. | Prioritizing storage units for data storage operations |
US10133635B2 (en) | 2013-07-01 | 2018-11-20 | International Business Machines Corporation | Low-width vault in distributed storage system |
US9501360B2 (en) | 2013-07-01 | 2016-11-22 | International Business Machines Corporation | Rebuilding data while reading data in a dispersed storage network |
US11221916B2 (en) | 2013-07-01 | 2022-01-11 | Pure Storage, Inc. | Prioritized data reconstruction in a dispersed storage network |
US9652470B2 (en) | 2013-07-01 | 2017-05-16 | International Business Machines Corporation | Storing data in a dispersed storage network |
US10169369B2 (en) | 2013-07-01 | 2019-01-01 | International Business Machines Corporation | Meeting storage requirements with limited storage resources |
US10681134B2 (en) | 2013-07-31 | 2020-06-09 | Pure Storage, Inc. | Accelerated learning in adaptive rebuilding by applying observations to other samples |
US9848044B2 (en) | 2013-07-31 | 2017-12-19 | International Business Machines Corporation | Distributed storage network with coordinated partial task execution and methods for use therewith |
US10180880B2 (en) | 2013-07-31 | 2019-01-15 | International Business Machines Corporation | Adaptive rebuilding rates based on sampling and inference |
US9626125B2 (en) | 2013-07-31 | 2017-04-18 | International Business Machines Corporation | Accounting for data that needs to be rebuilt or deleted |
US20180188964A1 (en) | 2013-07-31 | 2018-07-05 | International Business Machines Corporation | Managed storage unit shutdown in a distributed storage network |
US10484474B2 (en) | 2013-08-29 | 2019-11-19 | Pure Storage, Inc. | Rotating offline DS units |
US10489071B2 (en) | 2013-08-29 | 2019-11-26 | Pure Storage, Inc. | Vault provisioning within dispersed or distributed storage network (DSN) |
US10514857B2 (en) | 2013-08-29 | 2019-12-24 | Pure Storage, Inc. | Dynamic adjusting of parameters based on resource scoring |
US10686880B2 (en) | 2013-08-29 | 2020-06-16 | Pure Storage, Inc. | Dispersed storage based on range availability and methods for use therewith |
US9661074B2 (en) | 2013-08-29 | 2017-05-23 | International Business Machines Corporations | Updating de-duplication tracking data for a dispersed storage network |
US10601918B2 (en) | 2013-08-29 | 2020-03-24 | Pure Storage, Inc. | Rotating inactive storage units in a distributed storage network |
US9857974B2 (en) | 2013-10-03 | 2018-01-02 | International Business Machines Corporation | Session execution decision |
US9781208B2 (en) | 2013-11-01 | 2017-10-03 | International Business Machines Corporation | Obtaining dispersed storage network system registry information |
US10304096B2 (en) | 2013-11-01 | 2019-05-28 | International Business Machines Corporation | Renting a pipe to a storage system |
US10182115B2 (en) | 2013-11-01 | 2019-01-15 | International Business Machines Corporation | Changing rebuild priority for a class of data |
US9900316B2 (en) | 2013-12-04 | 2018-02-20 | International Business Machines Corporation | Accessing storage units of a dispersed storage network |
US10922181B2 (en) | 2014-01-06 | 2021-02-16 | Pure Storage, Inc. | Using storage locations greater than an IDA width in a dispersed storage network |
US11340993B2 (en) | 2014-01-06 | 2022-05-24 | Pure Storage, Inc. | Deferred rebuilding with alternate storage locations |
US9594639B2 (en) | 2014-01-06 | 2017-03-14 | International Business Machines Corporation | Configuring storage resources of a dispersed storage network |
US8949692B1 (en) | 2014-01-23 | 2015-02-03 | DSSD, Inc. | Method and system for service-aware parity placement in a storage system |
US20150205667A1 (en) * | 2014-01-23 | 2015-07-23 | DSSD, Inc. | Method and system for service-aware data placement in a storage system |
US9778987B2 (en) | 2014-01-31 | 2017-10-03 | International Business Machines Corporation | Writing encoded data slices in a dispersed storage network |
US11983070B2 (en) | 2014-01-31 | 2024-05-14 | Pure Storage, Inc. | Determining segmentation size in a distributed storage network |
US10318382B2 (en) | 2014-01-31 | 2019-06-11 | International Business Machines Corporation | Determining missing encoded data slices |
US9552261B2 (en) | 2014-01-31 | 2017-01-24 | International Business Machines Corporation | Recovering data from microslices in a dispersed storage network |
US11204836B1 (en) | 2014-01-31 | 2021-12-21 | Pure Storage, Inc. | Using trap slices for anomaly detection in a distributed storage network |
US9529834B2 (en) | 2014-02-26 | 2016-12-27 | International Business Machines Corporation | Concatenating data objects for storage in a dispersed storage network |
US10635312B2 (en) | 2014-02-26 | 2020-04-28 | Pure Storage, Inc. | Recovering data in a dispersed storage network |
US10678638B2 (en) | 2014-02-26 | 2020-06-09 | Pure Storage, Inc. | Resolving write conflicts in a dispersed storage network |
US10592109B2 (en) | 2014-02-26 | 2020-03-17 | Pure Storage, Inc. | Selecting storage resources in a dispersed storage network |
US10769016B2 (en) | 2014-02-26 | 2020-09-08 | Pure Storage, Inc. | Storing a plurality of correlated data in a dispersed storage network |
US9665429B2 (en) | 2014-02-26 | 2017-05-30 | International Business Machines Corporation | Storage of data with verification in a dispersed storage network |
US10140182B2 (en) | 2014-02-26 | 2018-11-27 | International Business Machines Corporation | Modifying allocation of storage resources in a dispersed storage network |
US10681138B2 (en) | 2014-04-02 | 2020-06-09 | Pure Storage, Inc. | Storing and retrieving multi-format content in a distributed storage network |
US10628245B2 (en) | 2014-04-02 | 2020-04-21 | Pure Storage, Inc. | Monitoring of storage units in a dispersed storage network |
US11347590B1 (en) | 2014-04-02 | 2022-05-31 | Pure Storage, Inc. | Rebuilding data in a distributed storage network |
US20150288680A1 (en) | 2014-04-02 | 2015-10-08 | Cleversafe, Inc. | Distributing registry information in a dispersed storage network |
US10761917B2 (en) | 2014-04-02 | 2020-09-01 | Pure Storage, Inc. | Using global namespace addressing in a dispersed storage network |
US10015152B2 (en) | 2014-04-02 | 2018-07-03 | International Business Machines Corporation | Securing data in a dispersed storage network |
US20190087599A1 (en) | 2014-04-02 | 2019-03-21 | International Business Machines Corporation | Compressing a slice name listing in a dispersed storage network |
US10020826B2 (en) | 2014-04-02 | 2018-07-10 | International Business Machines Corporation | Generating molecular encoding information for data storage |
US10394476B2 (en) | 2014-04-30 | 2019-08-27 | Pure Storage, Inc. | Multi-level stage locality selection on a large system |
US10296263B2 (en) | 2014-04-30 | 2019-05-21 | International Business Machines Corporation | Dispersed bloom filter for determining presence of an object |
US10802732B2 (en) | 2014-04-30 | 2020-10-13 | Pure Storage, Inc. | Multi-level stage locality selection on a large system |
US9735967B2 (en) | 2014-04-30 | 2017-08-15 | International Business Machines Corporation | Self-validating request message structure and operation |
US9542239B2 (en) | 2014-04-30 | 2017-01-10 | International Business Machines Corporation | Resolving write request conflicts in a dispersed storage network |
US10007602B2 (en) | 2014-05-06 | 2018-06-26 | International Business Machines Corporation | Flash copy relationship management |
US10509577B2 (en) | 2014-06-05 | 2019-12-17 | Pure Storage, Inc. | Reliable storage in a dispersed storage network |
US10152601B2 (en) | 2014-06-05 | 2018-12-11 | International Business Machines Corporation | Reliably recovering stored data in a dispersed storage network |
US10042564B2 (en) | 2014-06-30 | 2018-08-07 | International Business Machines Corporation | Accessing data while migrating storage of the data |
US9923838B2 (en) | 2014-06-30 | 2018-03-20 | International Business Machines Corporation | Accessing a dispersed storage network |
US10673946B2 (en) | 2014-06-30 | 2020-06-02 | Pure Storage, Inc. | Using separate weighting scores for different types of data in a decentralized agreement protocol |
US9690520B2 (en) | 2014-06-30 | 2017-06-27 | International Business Machines Corporation | Recovering an encoded data slice in a dispersed storage network |
US11398988B1 (en) | 2014-06-30 | 2022-07-26 | Pure Storage, Inc. | Selection of access resources in a distributed storage network |
US9838478B2 (en) | 2014-06-30 | 2017-12-05 | International Business Machines Corporation | Identifying a task execution resource of a dispersed storage network |
US10440105B2 (en) | 2014-06-30 | 2019-10-08 | Pure Storage, Inc. | Using a decentralized agreement protocol to rank storage locations for target width |
US11099763B1 (en) | 2014-06-30 | 2021-08-24 | Pure Storage, Inc. | Migrating generational storage to a decentralized agreement protocol paradigm |
US11606431B2 (en) | 2014-06-30 | 2023-03-14 | Pure Storage, Inc. | Maintaining failure independence for storage of a set of encoded data slices |
US9841925B2 (en) | 2014-06-30 | 2017-12-12 | International Business Machines Corporation | Adjusting timing of storing data in a dispersed storage network |
US10459797B2 (en) | 2014-06-30 | 2019-10-29 | Pure Storage, Inc. | Making trade-offs between rebuild scanning and failing memory device flexibility |
US10644874B2 (en) | 2014-07-31 | 2020-05-05 | Pure Storage, Inc. | Limiting brute force attacks against dispersed credentials in a distributed storage system |
US10089036B2 (en) | 2014-07-31 | 2018-10-02 | International Business Machines Corporation | Migrating data in a distributed storage network |
US11728964B2 (en) | 2014-07-31 | 2023-08-15 | Pure Storage, Inc. | Performance aided data migration in a distributed storage network |
US10613936B2 (en) | 2014-07-31 | 2020-04-07 | Pure Storage, Inc. | Fractional slices in a distributed storage system |
US10402395B2 (en) | 2014-09-05 | 2019-09-03 | Pure Storage, Inc. | Facilitating data consistency in a dispersed storage network |
US10176191B2 (en) | 2014-09-05 | 2019-01-08 | International Business Machines Corporation | Recovering from conflicts that emerge from eventually consistent operations |
US11442921B1 (en) | 2014-09-05 | 2022-09-13 | Pure Storage, Inc. | Data access in a dispersed storage network with consistency |
US10049120B2 (en) | 2014-09-05 | 2018-08-14 | International Business Machines Corporation | Consistency based access of data in a dispersed storage network |
US9591076B2 (en) | 2014-09-08 | 2017-03-07 | International Business Machines Corporation | Maintaining a desired number of storage units |
US10268545B2 (en) | 2014-09-08 | 2019-04-23 | International Business Machines Corporation | Using reinforcement learning to select a DS processing unit |
US10146622B2 (en) | 2014-09-08 | 2018-12-04 | International Business Machines Corporation | Combining deduplication with locality for efficient and fast storage |
US10095582B2 (en) | 2014-10-29 | 2018-10-09 | International Business Machines Corporation | Partial rebuilding techniques in a dispersed storage unit |
US10223033B2 (en) | 2014-10-29 | 2019-03-05 | International Business Machines Corporation | Coordinating arrival times of data slices in a dispersed storage network |
US10481833B2 (en) | 2014-10-29 | 2019-11-19 | Pure Storage, Inc. | Transferring data encoding functions in a distributed storage network |
US9916114B2 (en) | 2014-10-29 | 2018-03-13 | International Business Machines Corporation | Deterministically sharing a plurality of processing resources |
US10459792B2 (en) | 2014-10-29 | 2019-10-29 | Pure Storage, Inc. | Using an eventually consistent dispersed memory to implement storage tiers |
US10282135B2 (en) | 2014-10-29 | 2019-05-07 | International Business Machines Corporation | Strong consistency write threshold |
US20180101457A1 (en) | 2014-10-29 | 2018-04-12 | International Business Machines Corporation | Retrying failed write operations in a dispersed storage network |
US10503592B2 (en) | 2014-12-02 | 2019-12-10 | Pure Storage, Inc. | Overcoming bottlenecks in partial and traditional rebuild operations |
US10558527B2 (en) | 2014-12-02 | 2020-02-11 | Pure Storage, Inc. | Rebuilding strategy in memory managed multi-site duplication |
US10521298B2 (en) | 2014-12-02 | 2019-12-31 | Pure Storage, Inc. | Temporarily storing dropped and rebuilt slices in a DSN memory |
US10402271B2 (en) | 2014-12-02 | 2019-09-03 | Pure Storage, Inc. | Overcoming bottlenecks in zero information gain (ZIG) rebuild operations |
US10120739B2 (en) | 2014-12-02 | 2018-11-06 | International Business Machines Corporation | Prioritized data rebuilding in a dispersed storage network |
US10481832B2 (en) | 2014-12-02 | 2019-11-19 | Pure Storage, Inc. | Applying a probability function to avoid storage operations for already-deleted data |
US9727275B2 (en) | 2014-12-02 | 2017-08-08 | International Business Machines Corporation | Coordinating storage of data in dispersed storage networks |
US11604707B2 (en) | 2014-12-31 | 2023-03-14 | Pure Storage, Inc. | Handling failures when synchronizing objects during a write operation |
US10621042B2 (en) | 2014-12-31 | 2020-04-14 | Pure Storage, Inc. | Vault transformation within a dispersed storage network |
US10642687B2 (en) | 2014-12-31 | 2020-05-05 | Pure Storage, Inc. | Pessimistic reads and other smart-read enhancements with synchronized vaults |
US10423359B2 (en) | 2014-12-31 | 2019-09-24 | Pure Storage, Inc. | Linking common attributes among a set of synchronized vaults |
US10387252B2 (en) | 2014-12-31 | 2019-08-20 | Pure Storage, Inc. | Synchronously storing data in a plurality of dispersed storage networks |
US10452317B2 (en) | 2014-12-31 | 2019-10-22 | Pure Storage, Inc. | DAP redistribution operation within a dispersed storage network |
US10489247B2 (en) | 2014-12-31 | 2019-11-26 | Pure Storage, Inc. | Generating time-ordered globally unique revision numbers |
US9727427B2 (en) | 2014-12-31 | 2017-08-08 | International Business Machines Corporation | Synchronizing storage of data copies in a dispersed storage network |
US10623495B2 (en) | 2014-12-31 | 2020-04-14 | Pure Storage, Inc. | Keeping synchronized writes from getting out of synch |
US10656866B2 (en) | 2014-12-31 | 2020-05-19 | Pure Storage, Inc. | Unidirectional vault synchronization to support tiering |
US10126974B2 (en) | 2014-12-31 | 2018-11-13 | International Business Machines Corporation | Redistributing encoded data slices in a dispersed storage network |
US10740180B2 (en) | 2015-01-30 | 2020-08-11 | Pure Storage, Inc. | Storing and retrieving data using proxies |
US10530862B2 (en) | 2015-01-30 | 2020-01-07 | Pure Storage, Inc. | Determining slices to rebuild from low-level failures |
US10498823B2 (en) | 2015-01-30 | 2019-12-03 | Pure Storage, Inc. | Optimally apportioning rebuilding resources |
US10594793B2 (en) | 2015-01-30 | 2020-03-17 | Pure Storage, Inc. | Read-prepare requests to multiple memories |
US9826038B2 (en) | 2015-01-30 | 2017-11-21 | International Business Machines Corporation | Selecting a data storage resource of a dispersed storage network |
US10169123B2 (en) | 2015-01-30 | 2019-01-01 | International Business Machines Corporation | Distributed data rebuilding |
US10423490B2 (en) | 2015-01-30 | 2019-09-24 | Pure Storage, Inc. | Read-source requests to support bundled writes in a distributed storage system |
US10506045B2 (en) | 2015-01-30 | 2019-12-10 | Pure Storage, Inc. | Memory access using deterministic function and secure seed |
US10511665B2 (en) | 2015-01-30 | 2019-12-17 | Pure Storage, Inc. | Efficient resource reclamation after deletion of slice from common file |
US10498822B2 (en) | 2015-01-30 | 2019-12-03 | Pure Storage, Inc. | Adaptive scanning rates |
US9740547B2 (en) | 2015-01-30 | 2017-08-22 | International Business Machines Corporation | Storing data using a dual path storage approach |
US10592132B2 (en) | 2015-01-30 | 2020-03-17 | Pure Storage, Inc. | Read-foreign-slices request for improved read efficiency with bundled writes |
US10289342B2 (en) | 2015-01-30 | 2019-05-14 | International Business Machines Corporation | Data access optimization protocol in a dispersed storage network |
US10802915B2 (en) | 2015-01-30 | 2020-10-13 | Pure Storage, Inc. | Time based storage of encoded data slices |
US10440116B2 (en) | 2015-01-30 | 2019-10-08 | Pure Storage, Inc. | Minimizing data movement through rotation of spare memory devices |
US10620878B2 (en) | 2015-01-30 | 2020-04-14 | Pure Storage, Inc. | Write threshold plus value in dispersed storage network write operations |
US10069915B2 (en) | 2015-02-27 | 2018-09-04 | International Business Machines Corporation | Storing data in a dispersed storage network |
US10078472B2 (en) | 2015-02-27 | 2018-09-18 | International Business Machines Corporation | Rebuilding encoded data slices in a dispersed storage network |
US10530861B2 (en) | 2015-02-27 | 2020-01-07 | Pure Storage, Inc. | Utilizing multiple storage pools in a dispersed storage network |
US10440115B2 (en) | 2015-02-27 | 2019-10-08 | Pure Storage, Inc. | Write intent messaging in a dispersed storage network |
US10437677B2 (en) | 2015-02-27 | 2019-10-08 | Pure Storage, Inc. | Optimized distributed rebuilding within a dispersed storage network |
US10423502B2 (en) | 2015-02-27 | 2019-09-24 | Pure Storage, Inc. | Stand-by distributed storage units |
US10387067B2 (en) | 2015-02-27 | 2019-08-20 | Pure Storage, Inc. | Optimizing data storage in a dispersed storage network |
US10503591B2 (en) | 2015-02-27 | 2019-12-10 | Pure Storage, Inc. | Selecting retrieval locations in a dispersed storage network |
US10437676B2 (en) | 2015-02-27 | 2019-10-08 | Pure Storage, Inc. | Urgent reads and using data source health to determine error recovery procedures |
US11836369B1 (en) | 2015-02-27 | 2023-12-05 | Pure Storage, Inc. | Storing data in an expanded storage pool of a vast storage network |
US10528425B2 (en) | 2015-02-27 | 2020-01-07 | Pure Storage, Inc. | Transitioning to an optimized data storage approach in a dispersed storage network |
US10409772B2 (en) | 2015-02-27 | 2019-09-10 | Pure Storage, Inc. | Accessing serially stored data in a dispersed storage network |
US10275185B2 (en) | 2015-02-27 | 2019-04-30 | International Business Machines Corporation | Fail-in-place supported via decentralized or Distributed Agreement Protocol (DAP) |
US10534668B2 (en) | 2015-02-27 | 2020-01-14 | Pure Storage, Inc. | Accessing data in a dispersed storage network |
US10404410B2 (en) | 2015-02-27 | 2019-09-03 | Pure Storage, Inc. | Storage unit (SU) report cards |
US11188665B2 (en) | 2015-02-27 | 2021-11-30 | Pure Storage, Inc. | Using internal sensors to detect adverse interference and take defensive actions |
US10579451B2 (en) | 2015-02-27 | 2020-03-03 | Pure Storage, Inc. | Pro-actively preparing a dispersed storage network memory for higher-loads |
US10657000B2 (en) | 2015-02-27 | 2020-05-19 | Pure Storage, Inc. | Optimizing data storage in a dispersed storage network |
US10108352B2 (en) * | 2015-03-03 | 2018-10-23 | International Business Machines Corporation | Incremental replication of a source data set |
US10331384B2 (en) | 2015-03-31 | 2019-06-25 | International Business Machines Corporation | Storing data utilizing a maximum accessibility approach in a dispersed storage network |
US10437515B2 (en) | 2015-03-31 | 2019-10-08 | Pure Storage, Inc. | Selecting storage units in a dispersed storage network |
US10963180B2 (en) | 2015-03-31 | 2021-03-30 | Pure Storage, Inc. | Adding incremental storage resources in a dispersed storage network |
US10915261B2 (en) | 2015-03-31 | 2021-02-09 | Pure Storage, Inc. | Selecting a set of storage units in a distributed storage network |
US10528282B2 (en) | 2015-03-31 | 2020-01-07 | Pure Storage, Inc. | Modifying and utilizing a file structure in a dispersed storage network |
US10387070B2 (en) | 2015-03-31 | 2019-08-20 | Pure Storage, Inc. | Migrating data in response to adding incremental storage resources in a dispersed storage network |
US10713374B2 (en) | 2015-03-31 | 2020-07-14 | Pure Storage, Inc. | Resolving detected access anomalies in a dispersed storage network |
US11055177B2 (en) | 2015-03-31 | 2021-07-06 | Pure Storage, Inc. | Correlating operational information with an error condition in a dispersed storage network |
US10852957B2 (en) | 2015-03-31 | 2020-12-01 | Pure Storage, Inc. | Migration agent employing moveslice request |
US10079887B2 (en) | 2015-03-31 | 2018-09-18 | International Business Machines Corporation | Expanding storage capacity of a set of storage units in a distributed storage network |
US10534661B2 (en) | 2015-03-31 | 2020-01-14 | Pure Storage, Inc. | Selecting a storage error abatement alternative in a dispersed storage network |
US10168904B2 (en) | 2015-04-30 | 2019-01-01 | International Business Machines Corporation | Quasi-error notifications in a dispersed storage network |
US10268376B2 (en) | 2015-04-30 | 2019-04-23 | International Business Machines Corporation | Automated deployment and assignment of access devices in a dispersed storage network |
US10055170B2 (en) | 2015-04-30 | 2018-08-21 | International Business Machines Corporation | Scheduling storage unit maintenance tasks in a dispersed storage network |
US10067998B2 (en) | 2015-04-30 | 2018-09-04 | International Business Machines Corporation | Distributed sync list |
US10037171B2 (en) | 2015-04-30 | 2018-07-31 | International Business Machines Corporation | Accessing common data in a dispersed storage network |
US10216594B2 (en) | 2015-04-30 | 2019-02-26 | International Business Machines Corporation | Automated stalled process detection and recovery |
US10254992B2 (en) | 2015-04-30 | 2019-04-09 | International Business Machines Corporation | Rebalancing data storage in a dispersed storage network |
US10157094B2 (en) | 2015-04-30 | 2018-12-18 | International Business Machines Corporation | Validating system registry files in a dispersed storage network |
US10078561B2 (en) | 2015-04-30 | 2018-09-18 | International Business Machines Corporation | Handling failing memory devices in a dispersed storage network |
US10409522B2 (en) | 2015-05-29 | 2019-09-10 | Pure Storage, Inc. | Reclaiming storage capacity in a dispersed storage network |
US10838664B2 (en) | 2015-05-29 | 2020-11-17 | Pure Storage, Inc. | Determining a storage location according to legal requirements |
US10613798B2 (en) | 2015-05-29 | 2020-04-07 | Pure Storage, Inc. | Slice fanout write request |
US10324657B2 (en) | 2015-05-29 | 2019-06-18 | International Business Machines Corporation | Accounting for data whose rebuilding is deferred |
US10789128B2 (en) | 2015-05-29 | 2020-09-29 | Pure Storage, Inc. | External healing mode for a dispersed storage network memory |
US10891058B2 (en) | 2015-05-29 | 2021-01-12 | Pure Storage, Inc. | Encoding slice verification information to support verifiable rebuilding |
US10523241B2 (en) | 2015-05-29 | 2019-12-31 | Pure Storage, Inc. | Object fan out write operation |
US10169125B2 (en) | 2015-05-29 | 2019-01-01 | International Business Machines Corporation | Re-encoding data in a dispersed storage network |
US10430107B2 (en) | 2015-05-29 | 2019-10-01 | Pure Storage, Inc. | Identifying stored data slices during a slice migration activity in a dispersed storage network |
US10402122B2 (en) | 2015-05-29 | 2019-09-03 | Pure Storage, Inc. | Transferring encoded data slices in a dispersed storage network |
US11115221B2 (en) | 2015-05-29 | 2021-09-07 | Pure Storage, Inc. | Verifying a rebuilt encoded data slice using slice verification information |
US10055291B2 (en) | 2015-06-30 | 2018-08-21 | International Business Machines Corporation | Method and system for processing data access requests during data transfers |
US11669546B2 (en) | 2015-06-30 | 2023-06-06 | Pure Storage, Inc. | Synchronizing replicated data in a storage network |
US10437671B2 (en) | 2015-06-30 | 2019-10-08 | Pure Storage, Inc. | Synchronizing replicated stored data |
US11782789B2 (en) | 2015-07-31 | 2023-10-10 | Pure Storage, Inc. | Encoding data and associated metadata in a storage network |
US20170034184A1 (en) | 2015-07-31 | 2017-02-02 | International Business Machines Corporation | Proxying data access requests |
US10466914B2 (en) | 2015-08-31 | 2019-11-05 | Pure Storage, Inc. | Verifying authorized access in a dispersed storage network |
US10073652B2 (en) | 2015-09-24 | 2018-09-11 | International Business Machines Corporation | Performance optimized storage vaults in a dispersed storage network |
US10169147B2 (en) | 2015-10-30 | 2019-01-01 | International Business Machines Corporation | End-to-end secure data storage in a dispersed storage network |
US10409514B2 (en) | 2015-11-30 | 2019-09-10 | International Business Machines Corporation | IP multicast message transmission for event notifications |
US10346246B2 (en) | 2015-11-30 | 2019-07-09 | International Business Machines Corporation | Recovering data copies in a dispersed storage network |
US12072763B2 (en) | 2015-11-30 | 2024-08-27 | Pure Storage, Inc. | Utilizing memories of different operational speeds in a vast storage network |
US20170192688A1 (en) | 2015-12-30 | 2017-07-06 | International Business Machines Corporation | Lazy deletion of vaults in packed slice storage (pss) and zone slice storage (zss) |
US10616330B2 (en) | 2016-01-26 | 2020-04-07 | Pure Storage, Inc. | Utilizing tree storage structures in a dispersed storage network |
US10089178B2 (en) | 2016-02-29 | 2018-10-02 | International Business Machines Corporation | Developing an accurate dispersed storage network memory performance model through training |
US10831381B2 (en) | 2016-03-29 | 2020-11-10 | International Business Machines Corporation | Hierarchies of credential and access control sharing between DSN memories |
US10387248B2 (en) | 2016-03-29 | 2019-08-20 | International Business Machines Corporation | Allocating data for storage by utilizing a location-based hierarchy in a dispersed storage network |
US10419538B2 (en) | 2016-04-26 | 2019-09-17 | International Business Machines Corporation | Selecting memory for data access in a dispersed storage network |
US10169082B2 (en) | 2016-04-27 | 2019-01-01 | International Business Machines Corporation | Accessing data in accordance with an execution deadline |
US10628399B2 (en) | 2016-04-29 | 2020-04-21 | International Business Machines Corporation | Storing data in a dispersed storage network with consistency |
US10007444B2 (en) | 2016-04-29 | 2018-06-26 | International Business Machines Corporation | Batching access requests in a dispersed storage network |
US10091298B2 (en) | 2016-05-27 | 2018-10-02 | International Business Machines Corporation | Enhancing performance of data storage in a dispersed storage network |
US10122795B2 (en) | 2016-05-31 | 2018-11-06 | International Business Machines Corporation | Consistency level driven data storage in a dispersed storage network |
US10353772B2 (en) | 2016-05-31 | 2019-07-16 | International Business Machines Corporation | Selecting data for storage in a dispersed storage network |
US10027755B2 (en) | 2016-06-01 | 2018-07-17 | International Business Machines Corporation | Selecting storage units in one or more dispersed storage networks |
US10394650B2 (en) | 2016-06-03 | 2019-08-27 | International Business Machines Corporation | Multiple writes using inter-site storage unit relationship |
US10652350B2 (en) | 2016-06-06 | 2020-05-12 | International Business Machines Corporation | Caching for unique combination reads in a dispersed storage network |
US10719499B2 (en) | 2016-06-06 | 2020-07-21 | INTERNATIONAL BUSINESS MACHINES CORPORATIOb | Establishing distributed consensus via alternate voting strategies in a dispersed storage network |
US10735545B2 (en) | 2016-06-06 | 2020-08-04 | International Business Machines Corporation | Routing vault access requests in a dispersed storage network |
US10334045B2 (en) | 2016-06-06 | 2019-06-25 | International Business Machines Corporation | Indicating multiple encoding schemes in a dispersed storage network |
US10007438B2 (en) | 2016-06-25 | 2018-06-26 | International Business Machines Corporation | Method and system for achieving consensus using alternate voting strategies (AVS) with incomplete information |
US10564852B2 (en) | 2016-06-25 | 2020-02-18 | International Business Machines Corporation | Method and system for reducing memory device input/output operations |
US10235085B2 (en) | 2016-06-27 | 2019-03-19 | International Business Machines Corporation | Relocating storage unit data in response to detecting hotspots in a dispersed storage network |
US11115469B2 (en) | 2016-06-28 | 2021-09-07 | International Business Machines Corporation | Efficient updates within a dispersed storage network |
US10157021B2 (en) | 2016-06-29 | 2018-12-18 | International Business Machines Corporation | Processing incomplete data access transactions |
US10025505B2 (en) | 2016-06-29 | 2018-07-17 | International Business Machines Corporation | Accessing data in a dispersed storage network during write operations |
US10387286B2 (en) | 2016-06-30 | 2019-08-20 | International Business Machines Corporation | Managing configuration updates in a dispersed storage network |
US9934092B2 (en) | 2016-07-12 | 2018-04-03 | International Business Machines Corporation | Manipulating a distributed agreement protocol to identify a desired set of storage units |
US10114696B2 (en) | 2016-07-14 | 2018-10-30 | International Business Machines Corporation | Tracking data access in a dispersed storage network |
US10534666B2 (en) | 2016-07-14 | 2020-01-14 | International Business Machines Corporation | Determining storage requirements based on licensing right in a dispersed storage network |
US10102067B2 (en) | 2016-07-14 | 2018-10-16 | International Business Machines Corporation | Performing a desired manipulation of an encoded data slice based on a metadata restriction and a storage operational condition |
US10360103B2 (en) | 2016-07-18 | 2019-07-23 | International Business Machines Corporation | Focused storage pool expansion to prevent a performance degradation |
US9992063B2 (en) | 2016-07-18 | 2018-06-05 | International Business Machines Corporation | Utilizing reallocation via a decentralized, or distributed, agreement protocol (DAP) for storage unit (SU) replacement |
US10769015B2 (en) | 2016-07-19 | 2020-09-08 | International Business Machines Corporation | Throttling access requests at different layers of a DSN memory |
US10277490B2 (en) | 2016-07-19 | 2019-04-30 | International Business Machines Corporation | Monitoring inter-site bandwidth for rebuilding |
US10127112B2 (en) | 2016-07-20 | 2018-11-13 | International Business Machines Corporation | Assigning prioritized rebuild resources optimally |
US10031809B2 (en) | 2016-07-20 | 2018-07-24 | International Business Machines Corporation | Efficient method for rebuilding a set of encoded data slices |
US10459796B2 (en) | 2016-07-20 | 2019-10-29 | International Business Machines Corporation | Prioritizing rebuilding based on a longevity estimate of the rebuilt slice |
US10554752B2 (en) | 2016-07-20 | 2020-02-04 | International Business Machines Corporation | Efficient transfer of encoded data slice sets to new or alternate storage units |
US10379744B2 (en) | 2016-07-21 | 2019-08-13 | International Business Machines Corporation | System for collecting end-user feedback and usability metrics |
US10416930B2 (en) | 2016-07-21 | 2019-09-17 | International Business Machines Corporation | Global access permit listing |
US10459790B2 (en) | 2016-07-26 | 2019-10-29 | International Business Machines Corporation | Elastic storage in a dispersed storage network |
US10395043B2 (en) | 2016-07-29 | 2019-08-27 | International Business Machines Corporation | Securely storing data in an elastically scalable dispersed storage network |
US10031805B2 (en) | 2016-08-09 | 2018-07-24 | International Business Machines Corporation | Assigning slices to storage locations based on a predicted lifespan |
US10223036B2 (en) | 2016-08-10 | 2019-03-05 | International Business Machines Corporation | Expanding a dispersed storage network (DSN) |
US10129023B2 (en) | 2016-08-11 | 2018-11-13 | International Business Machines Corporation | Enhancing security for multiple storage configurations |
US10348829B2 (en) | 2016-08-15 | 2019-07-09 | International Business Machines Corporation | Auto indexing with customizable metadata |
US10013309B2 (en) | 2016-08-17 | 2018-07-03 | International Business Machines Corporation | Missing slice reconstruction in a dispersed storage network |
US10078468B2 (en) | 2016-08-18 | 2018-09-18 | International Business Machines Corporation | Slice migration in a dispersed storage network |
US10379778B2 (en) | 2016-08-18 | 2019-08-13 | International Business Machines Corporation | Using a master encryption key to sanitize a dispersed storage network memory |
US10389683B2 (en) | 2016-08-26 | 2019-08-20 | International Business Machines Corporation | Securing storage units in a dispersed storage network |
US10379773B2 (en) | 2016-08-29 | 2019-08-13 | International Business Machines Corporation | Storage unit for use in a dispersed storage network |
US10581807B2 (en) | 2016-08-29 | 2020-03-03 | International Business Machines Corporation | Using dispersal techniques to securely store cryptographic resources and respond to attacks |
US10061524B2 (en) | 2016-09-01 | 2018-08-28 | International Business Machines Corporation | Wear-leveling of memory devices |
US10169149B2 (en) | 2016-09-06 | 2019-01-01 | International Business Machines Corporation | Standard and non-standard dispersed storage network data access |
US10387079B2 (en) | 2016-09-09 | 2019-08-20 | International Business Machines Corporation | Placement of dispersed storage data based on requestor properties |
US10225271B2 (en) | 2016-09-09 | 2019-03-05 | International Business Machines Corporation | Distributed storage network with enhanced security monitoring |
US10547615B2 (en) | 2016-09-12 | 2020-01-28 | International Business Machines Corporation | Security response protocol based on security alert encoded data slices of a distributed storage network |
US10558396B2 (en) | 2016-09-14 | 2020-02-11 | International Business Machines Corporation | Pre-caching data according to a current or predicted requester location |
US10558389B2 (en) | 2016-09-20 | 2020-02-11 | International Business Machines Corporation | Per-storage class quality of service (QoS) management within a distributed storage network (DSN) where the DSN stores data using dispersed storage error decoding/encoding |
US10067822B2 (en) | 2016-09-26 | 2018-09-04 | International Business Machines Corporation | Combined slice objects in alternate memory locations |
US10394630B2 (en) | 2016-10-26 | 2019-08-27 | International Business Machines Corporation | Estimating relative data importance in a dispersed storage network |
US10448062B2 (en) | 2016-10-26 | 2019-10-15 | International Business Machines Corporation | Pre-fetching media content to reduce peak loads |
US10585751B2 (en) | 2016-10-27 | 2020-03-10 | International Business Machines Corporation | Partial rebuild operation within a dispersed storage network including local memory and cloud-based alternative memory |
US10481977B2 (en) | 2016-10-27 | 2019-11-19 | International Business Machines Corporation | Dispersed storage of error encoded data objects having multiple resolutions |
US11169731B2 (en) | 2016-10-31 | 2021-11-09 | International Business Machines Corporation | Managing storage resources in a dispersed storage network |
US10540247B2 (en) | 2016-11-10 | 2020-01-21 | International Business Machines Corporation | Handling degraded conditions using a redirect module |
US10585607B2 (en) | 2016-11-10 | 2020-03-10 | International Business Machines Corporation | Determining an optimum selection of functions for units in a DSN memory |
US10114698B2 (en) | 2017-01-05 | 2018-10-30 | International Business Machines Corporation | Detecting and responding to data loss events in a dispersed storage network |
US10782921B2 (en) | 2017-01-25 | 2020-09-22 | International Business Machines Corporation | Non-writing device finalization of a write operation initiated by another device |
US10180787B2 (en) | 2017-02-09 | 2019-01-15 | International Business Machines Corporation | Dispersed storage write process with lock/persist |
US10241865B2 (en) | 2017-02-15 | 2019-03-26 | International Business Machines Corporation | Handling storage unit failure in a dispersed storage network |
US10579309B2 (en) | 2017-02-16 | 2020-03-03 | International Business Machines Corporation | Method for increasing throughput in a distributed storage network |
US10552341B2 (en) | 2017-02-17 | 2020-02-04 | International Business Machines Corporation | Zone storage—quickly returning to a state of consistency following an unexpected event |
US10248495B2 (en) | 2017-02-17 | 2019-04-02 | International Business Machines Corporation | Eventual consistency intent cleanup in a dispersed storage network |
US10382553B2 (en) | 2017-02-20 | 2019-08-13 | International Business Machines Corporation | Zone storage—resilient and efficient storage transactions |
US10394468B2 (en) | 2017-02-23 | 2019-08-27 | International Business Machines Corporation | Handling data slice revisions in a dispersed storage network |
US10241677B2 (en) | 2017-02-24 | 2019-03-26 | International Business Machines Corporation | Ensuring consistency between content and metadata with intents |
US9998147B1 (en) | 2017-02-27 | 2018-06-12 | International Business Machines Corporation | Method for using write intents in a distributed storage network |
US10642532B2 (en) | 2017-02-28 | 2020-05-05 | International Business Machines Corporation | Storing data sequentially in zones in a dispersed storage network |
US10372380B2 (en) | 2017-03-01 | 2019-08-06 | International Business Machines Corporation | Asserting integrity with a verifiable codec |
US10169392B2 (en) | 2017-03-08 | 2019-01-01 | International Business Machines Corporation | Persistent data structures on a dispersed storage network memory |
US11226980B2 (en) | 2017-03-13 | 2022-01-18 | International Business Machines Corporation | Replicating containers in object storage using intents |
US10235241B2 (en) | 2017-03-15 | 2019-03-19 | International Business Machines Corporation | Method for partial updating data content in a distributed storage network |
US10693640B2 (en) | 2017-03-17 | 2020-06-23 | International Business Machines Corporation | Use of key metadata during write and read operations in a dispersed storage network memory |
US10241861B2 (en) | 2017-03-23 | 2019-03-26 | International Business Machines Corporation | Method for tenant isolation in a distributed computing system |
US10133634B2 (en) | 2017-03-30 | 2018-11-20 | International Business Machines Corporation | Method for performing in-place disk format changes in a distributed storage network |
US10360391B2 (en) | 2017-04-03 | 2019-07-23 | International Business Machines Corporation | Verifiable keyed all-or-nothing transform |
US10545699B2 (en) | 2017-04-11 | 2020-01-28 | International Business Machines Corporation | Dynamic retention policies and optional deletes |
US10379961B2 (en) | 2017-04-11 | 2019-08-13 | International Business Machines Corporation | Ensuring metadata and index consistency using write intents |
US10567509B2 (en) | 2017-05-15 | 2020-02-18 | International Business Machines Corporation | Rebuilding derived content |
US10339003B2 (en) | 2017-06-01 | 2019-07-02 | International Business Machines Corporation | Processing data access transactions in a dispersed storage network using source revision indicators |
US10491386B2 (en) | 2017-06-01 | 2019-11-26 | International Business Machines Corporation | Slice-level keyed encryption with support for efficient rekeying |
US10467097B2 (en) | 2017-06-02 | 2019-11-05 | International Business Machines Corporation | Indicating data health in a DSN memory |
US10372381B2 (en) | 2017-06-05 | 2019-08-06 | International Business Machines Corporation | Implicit leader election in a distributed storage network |
US10361813B2 (en) | 2017-06-16 | 2019-07-23 | International Business Machine Corporation | Using slice routers for improved storage placement determination |
US10534548B2 (en) | 2017-06-20 | 2020-01-14 | International Business Machines Corporation | Validating restricted operations on a client using trusted environments |
US10324855B2 (en) | 2017-06-23 | 2019-06-18 | International Business Machines Corporation | Associating a processing thread and memory section to a memory device |
US10594790B2 (en) | 2017-06-28 | 2020-03-17 | International Business Machines Corporation | Data compression in a dispersed storage network |
US10540111B2 (en) | 2017-06-28 | 2020-01-21 | International Business Machines Corporation | Managing data container instances in a dispersed storage network |
US10509699B2 (en) | 2017-08-07 | 2019-12-17 | International Business Machines Corporation | Zone aware request scheduling and data placement |
US10599502B2 (en) | 2017-08-07 | 2020-03-24 | International Business Machines Corporation | Fault detection and recovery in a distributed storage network |
US10671746B2 (en) | 2017-08-28 | 2020-06-02 | International Business Machines Corporation | Controlling access when processing intents in a dispersed storage network |
US10459798B2 (en) | 2017-09-15 | 2019-10-29 | Seagate Technology Llc | Data storage system with multiple parity redundancy |
US10379942B2 (en) | 2017-09-27 | 2019-08-13 | International Business Machines Corporation | Efficient transfer of objects between containers on the same vault |
US10802713B2 (en) | 2017-09-29 | 2020-10-13 | International Business Machines Corporation | Requester-associated storage entity data |
US10409661B2 (en) | 2017-09-29 | 2019-09-10 | International Business Machines Corporation | Slice metadata for optimized dispersed storage network memory storage strategies |
US10585748B2 (en) | 2017-09-29 | 2020-03-10 | International Business Machines Corporation | Scalable cloud—assigning scores to requesters and treating requests differently based on those scores |
US10540120B2 (en) | 2017-11-14 | 2020-01-21 | International Business Machines Corporation | Contention avoidance on associative commutative updates |
US10423497B2 (en) | 2017-11-28 | 2019-09-24 | International Business Machines Corporation | Mechanism for representing system configuration changes as a series of objects writable to an object storage container |
US10565392B2 (en) | 2017-11-28 | 2020-02-18 | International Business Machines Corporation | Secure and verifiable update operations |
US10785194B2 (en) | 2017-12-07 | 2020-09-22 | International Business Machines Corporation | Processing intents using trusted entities in a dispersed storage network |
US10681135B2 (en) | 2017-12-08 | 2020-06-09 | International Business Machines Corporation | Generating slices from a broadcast message and a recipient identity |
US11412041B2 (en) | 2018-06-25 | 2022-08-09 | International Business Machines Corporation | Automatic intervention of global coordinator |
US10936452B2 (en) | 2018-11-14 | 2021-03-02 | International Business Machines Corporation | Dispersed storage network failover units used to improve local reliability |
US11593026B2 (en) | 2020-03-06 | 2023-02-28 | International Business Machines Corporation | Zone storage optimization using predictive protocol patterns |
JP2021189937A (ja) * | 2020-06-03 | 2021-12-13 | 株式会社日立製作所 | ストレージシステム及びストレージシステムの制御方法 |
US11868656B2 (en) | 2021-06-07 | 2024-01-09 | Netapp, Inc. | Distributed file system with disaggregated data management and storage management layers |
US12045207B2 (en) | 2021-06-07 | 2024-07-23 | Netapp, Inc. | Distributed file system that provides scalability and resiliency |
US12079242B2 (en) | 2021-10-19 | 2024-09-03 | Netapp, Inc. | Dynamically scaling application and storage system functions based on a heterogeneous resource pool available for use by a distributed storage management system |
Family Cites Families (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US34100A (en) * | 1862-01-07 | Improved step-ladder | ||
US3876978A (en) * | 1973-06-04 | 1975-04-08 | Ibm | Archival data protection |
US4092732A (en) * | 1977-05-31 | 1978-05-30 | International Business Machines Corporation | System for recovering data stored in failed memory unit |
US4201976A (en) * | 1977-12-23 | 1980-05-06 | International Business Machines Corporation | Plural channel error correcting methods and means using adaptive reallocation of redundant channels among groups of channels |
US4205324A (en) * | 1977-12-23 | 1980-05-27 | International Business Machines Corporation | Methods and means for simultaneously correcting several channels in error in a parallel multi channel data system using continuously modifiable syndromes and selective generation of internal channel pointers |
JPS5637883A (en) * | 1979-09-04 | 1981-04-11 | Fanuc Ltd | Information rewrite system |
US4467421A (en) * | 1979-10-18 | 1984-08-21 | Storage Technology Corporation | Virtual storage system and method |
DE3040004A1 (de) * | 1979-10-24 | 1981-05-07 | Matsushita Electric Industrial Co., Ltd., Kadoma, Osaka | Verfahren und vorrichtung zum codieren von pruefworten geringer redundanz aus ursprungsdaten |
US4825403A (en) * | 1983-05-16 | 1989-04-25 | Data General Corporation | Apparatus guaranteeing that a controller in a disk drive system receives at least some data from an invalid track sector |
JPS60142418A (ja) * | 1983-12-28 | 1985-07-27 | Hitachi Ltd | 入出力エラ−回復方式 |
FR2561428B1 (fr) * | 1984-03-16 | 1986-09-12 | Bull Sa | Procede d'enregistrement dans une memoire a disques et systeme de memoire a disques |
US4667326A (en) * | 1984-12-20 | 1987-05-19 | Advanced Micro Devices, Inc. | Method and apparatus for error detection and correction in systems comprising floppy and/or hard disk drives |
US5202979A (en) * | 1985-05-08 | 1993-04-13 | Thinking Machines Corporation | Storage system using multiple independently mechanically-driven storage units |
US4722085A (en) * | 1986-02-03 | 1988-01-26 | Unisys Corp. | High capacity disk storage system having unusually high fault tolerance level and bandpass |
JPH0675329B2 (ja) * | 1986-02-18 | 1994-09-21 | ソニー株式会社 | ディスクプレーヤ |
US4761785B1 (en) * | 1986-06-12 | 1996-03-12 | Ibm | Parity spreading to enhance storage access |
USRE34100E (en) | 1987-01-12 | 1992-10-13 | Seagate Technology, Inc. | Data error correction system |
US4775978A (en) * | 1987-01-12 | 1988-10-04 | Magnetic Peripherals Inc. | Data error correction system |
US4796260A (en) * | 1987-03-30 | 1989-01-03 | Scs Telecom, Inc. | Schilling-Manela forward error correction and detection code method and apparatus |
US5257367A (en) * | 1987-06-02 | 1993-10-26 | Cab-Tek, Inc. | Data storage system with asynchronous host operating system communication link |
US4849974A (en) * | 1987-08-03 | 1989-07-18 | Scs Telecom, Inc. | PASM and TASM forward error correction and detection code method and apparatus |
US4849976A (en) * | 1987-08-03 | 1989-07-18 | Scs Telecom, Inc. | PASM and TASM forward error correction and detection code method and apparatus |
US4837680A (en) * | 1987-08-28 | 1989-06-06 | International Business Machines Corporation | Controlling asynchronously operating peripherals |
US4870643A (en) * | 1987-11-06 | 1989-09-26 | Micropolis Corporation | Parallel drive array storage system |
US4847842A (en) * | 1987-11-19 | 1989-07-11 | Scs Telecom, Inc. | SM codec method and apparatus |
US4899342A (en) * | 1988-02-01 | 1990-02-06 | Thinking Machines Corporation | Method and apparatus for operating multi-unit array of memories |
US5077736A (en) * | 1988-06-28 | 1991-12-31 | Storage Technology Corporation | Disk drive memory |
US4989206A (en) * | 1988-06-28 | 1991-01-29 | Storage Technology Corporation | Disk drive memory |
US4989205A (en) * | 1988-06-28 | 1991-01-29 | Storage Technology Corporation | Disk drive memory |
US5128810A (en) * | 1988-08-02 | 1992-07-07 | Cray Research, Inc. | Single disk emulation interface for an array of synchronous spindle disk drives |
US5218689A (en) * | 1988-08-16 | 1993-06-08 | Cray Research, Inc. | Single disk emulation interface for an array of asynchronously operating disk drives |
US5148432A (en) * | 1988-11-14 | 1992-09-15 | Array Technology Corporation | Arrayed disk drive system and method |
US5163131A (en) * | 1989-09-08 | 1992-11-10 | Auspex Systems, Inc. | Parallel i/o network file server architecture |
US5101492A (en) * | 1989-11-03 | 1992-03-31 | Compaq Computer Corporation | Data redundancy and recovery protection |
US5233618A (en) * | 1990-03-02 | 1993-08-03 | Micro Technology, Inc. | Data correcting applicable to redundant arrays of independent disks |
US5088081A (en) * | 1990-03-28 | 1992-02-11 | Prime Computer, Inc. | Method and apparatus for improved disk access |
US5210860A (en) * | 1990-07-20 | 1993-05-11 | Compaq Computer Corporation | Intelligent disk array controller |
US5166936A (en) * | 1990-07-20 | 1992-11-24 | Compaq Computer Corporation | Automatic hard disk bad sector remapping |
US5208813A (en) * | 1990-10-23 | 1993-05-04 | Array Technology Corporation | On-line reconstruction of a failed redundant array system |
US5235601A (en) * | 1990-12-21 | 1993-08-10 | Array Technology Corporation | On-line restoration of redundancy information in a redundant array system |
US5274799A (en) * | 1991-01-04 | 1993-12-28 | Array Technology Corporation | Storage device array architecture with copyback cache |
US5579475A (en) * | 1991-02-11 | 1996-11-26 | International Business Machines Corporation | Method and means for encoding and rebuilding the data contents of up to two unavailable DASDS in a DASD array using simple non-recursive diagonal and row parity |
US5179704A (en) * | 1991-03-13 | 1993-01-12 | Ncr Corporation | Method and apparatus for generating disk array interrupt signals |
EP0519669A3 (en) * | 1991-06-21 | 1994-07-06 | Ibm | Encoding and rebuilding data for a dasd array |
US5237658A (en) * | 1991-10-01 | 1993-08-17 | Tandem Computers Incorporated | Linear and orthogonal expansion of array storage in multiprocessor computing systems |
US5305326A (en) * | 1992-03-06 | 1994-04-19 | Data General Corporation | High availability disk arrays |
US5410667A (en) * | 1992-04-17 | 1995-04-25 | Storage Technology Corporation | Data record copy system for a disk drive array data storage subsystem |
US5537567A (en) * | 1994-03-14 | 1996-07-16 | International Business Machines Corporation | Parity block configuration in an array of storage devices |
US5522032A (en) * | 1994-05-05 | 1996-05-28 | International Business Machines Corporation | Raid level 5 with free blocks parity cache |
US5623595A (en) * | 1994-09-26 | 1997-04-22 | Oracle Corporation | Method and apparatus for transparent, real time reconstruction of corrupted data in a redundant array data storage system |
US5615352A (en) * | 1994-10-05 | 1997-03-25 | Hewlett-Packard Company | Methods for adding storage disks to a hierarchic disk array while maintaining data availability |
US5812753A (en) * | 1995-10-13 | 1998-09-22 | Eccs, Inc. | Method for initializing or reconstructing data consistency within an array of storage elements |
US5862158A (en) * | 1995-11-08 | 1999-01-19 | International Business Machines Corporation | Efficient method for providing fault tolerance against double device failures in multiple device systems |
US5758118A (en) * | 1995-12-08 | 1998-05-26 | International Business Machines Corporation | Methods and data storage devices for RAID expansion by on-line addition of new DASDs |
US5884098A (en) * | 1996-04-18 | 1999-03-16 | Emc Corporation | RAID controller system utilizing front end and back end caching systems including communication path connecting two caching systems and synchronizing allocation of blocks in caching systems |
US5805788A (en) * | 1996-05-20 | 1998-09-08 | Cray Research, Inc. | Raid-5 parity generation and data reconstruction |
US6000010A (en) * | 1997-05-09 | 1999-12-07 | Unisys Corporation | Method of increasing the storage capacity of a level five RAID disk array by adding, in a single step, a new parity block and N--1 new data blocks which respectively reside in a new columns, where N is at least two |
KR100267366B1 (en) | 1997-07-15 | 2000-10-16 | Samsung Electronics Co Ltd | Method for recoding parity and restoring data of failed disks in an external storage subsystem and apparatus therefor |
US6092215A (en) | 1997-09-29 | 2000-07-18 | International Business Machines Corporation | System and method for reconstructing data in a storage array system |
JP3616487B2 (ja) | 1997-11-21 | 2005-02-02 | アルプス電気株式会社 | ディスクアレイ装置 |
US6138201A (en) | 1998-04-15 | 2000-10-24 | Sony Corporation | Redundant array of inexpensive tape drives using data compression and data allocation ratios |
US6442649B1 (en) * | 1999-08-18 | 2002-08-27 | Intel Corporation | Dynamic expansion of storage device array |
US6532548B1 (en) | 1999-09-21 | 2003-03-11 | Storage Technology Corporation | System and method for handling temporary errors on a redundant array of independent tapes (RAIT) |
US6581185B1 (en) | 2000-01-24 | 2003-06-17 | Storage Technology Corporation | Apparatus and method for reconstructing data using cross-parity stripes on storage media |
US7080278B1 (en) * | 2002-03-08 | 2006-07-18 | Network Appliance, Inc. | Technique for correcting multiple storage device failures in a storage array |
-
2003
- 2003-11-24 US US10/720,364 patent/US7185144B2/en not_active Expired - Lifetime
-
2004
- 2004-11-24 AU AU2004294208A patent/AU2004294208B2/en not_active Ceased
- 2004-11-24 JP JP2006541726A patent/JP2007516524A/ja active Pending
- 2004-11-24 WO PCT/US2004/039618 patent/WO2005052784A2/en not_active Application Discontinuation
- 2004-11-24 CN CN200480034712XA patent/CN101023412B/zh not_active Expired - Fee Related
- 2004-11-24 KR KR1020067010172A patent/KR101148697B1/ko not_active IP Right Cessation
- 2004-11-24 EP EP04812189A patent/EP1687707B1/en active Active
- 2004-11-24 CA CA2546242A patent/CA2546242C/en not_active Expired - Fee Related
-
2006
- 2006-05-22 IL IL175829A patent/IL175829A/en not_active IP Right Cessation
- 2006-12-05 US US11/633,900 patent/US7257676B2/en not_active Expired - Lifetime
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104156276A (zh) * | 2014-08-14 | 2014-11-19 | 浪潮电子信息产业股份有限公司 | 一种防两块磁盘损坏的raid方法 |
CN104156276B (zh) * | 2014-08-14 | 2017-06-09 | 浪潮电子信息产业股份有限公司 | 一种防两块磁盘损坏的raid方法 |
Also Published As
Publication number | Publication date |
---|---|
US7257676B2 (en) | 2007-08-14 |
WO2005052784A3 (en) | 2007-02-08 |
WO2005052784A2 (en) | 2005-06-09 |
KR20060120143A (ko) | 2006-11-24 |
US7185144B2 (en) | 2007-02-27 |
IL175829A (en) | 2010-12-30 |
JP2007516524A (ja) | 2007-06-21 |
EP1687707B1 (en) | 2012-08-22 |
CN101023412B (zh) | 2012-10-31 |
CA2546242C (en) | 2011-07-26 |
IL175829A0 (en) | 2006-10-05 |
EP1687707A2 (en) | 2006-08-09 |
CA2546242A1 (en) | 2005-06-09 |
AU2004294208B2 (en) | 2009-06-11 |
AU2004294208A1 (en) | 2005-06-09 |
US20070083710A1 (en) | 2007-04-12 |
KR101148697B1 (ko) | 2012-07-05 |
US20050114594A1 (en) | 2005-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101023412B (zh) | 半静态奇偶性分布技术 | |
US6845465B2 (en) | Method and system for leveraging spares in a data storage system including a plurality of disk drives | |
US7328305B2 (en) | Dynamic parity distribution technique | |
US8261016B1 (en) | Method and system for balancing reconstruction load in a storage array using a scalable parity declustered layout | |
US7386757B2 (en) | Method and apparatus for enabling high-reliability storage of distributed data on a plurality of independent storage devices | |
US7594075B2 (en) | Metadata for a grid based data storage system | |
US5301297A (en) | Method and means for managing RAID 5 DASD arrays having RAID DASD arrays as logical devices thereof | |
US5303244A (en) | Fault tolerant disk drive matrix | |
US8131926B2 (en) | Generic storage container for allocating multiple data formats | |
US9542101B2 (en) | System and methods for performing embedded full-stripe write operations to a data volume with data elements distributed across multiple modules | |
US5007053A (en) | Method and apparatus for checksum address generation in a fail-safe modular memory | |
JP5722225B2 (ja) | 性能改善のためのraidボリュームとドライブ・グループとの間の疎結合 | |
JPH0642193B2 (ja) | Dasdアレイのための更新記録方法及び装置 | |
JP6663482B2 (ja) | 計算機システム、物理記憶デバイスの制御方法、および記録媒体 | |
US7979632B2 (en) | Storage system including a fast storage device for storing redundant data | |
Thomasian et al. | Performance, reliability, and performability of a hybrid RAID array and a comparison with traditional RAID1 arrays | |
JP2750316B2 (ja) | データのコーディング及び再生方法 | |
AU692287B2 (en) | Disk array for data storage | |
JP2021189937A (ja) | ストレージシステム及びストレージシステムの制御方法 | |
圷弘明 | Efficient and Reliable Data Storing Methods in Large-scale Storage Systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C56 | Change in the name or address of the patentee | ||
CP01 | Change in the name or title of a patent holder |
Address after: American California Patentee after: NETAPP incorporated company Address before: American California Patentee before: Network Appliance Inc. |
|
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121031 Termination date: 20161124 |