CN1965298B - 用于管理奇偶raid数据重建的方法、系统和设备 - Google Patents

用于管理奇偶raid数据重建的方法、系统和设备 Download PDF

Info

Publication number
CN1965298B
CN1965298B CN2004800391368A CN200480039136A CN1965298B CN 1965298 B CN1965298 B CN 1965298B CN 2004800391368 A CN2004800391368 A CN 2004800391368A CN 200480039136 A CN200480039136 A CN 200480039136A CN 1965298 B CN1965298 B CN 1965298B
Authority
CN
China
Prior art keywords
data
data cell
logic engine
volatile memory
memory cells
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2004800391368A
Other languages
English (en)
Other versions
CN1965298A (zh
Inventor
M·施米索伊尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of CN1965298A publication Critical patent/CN1965298A/zh
Application granted granted Critical
Publication of CN1965298B publication Critical patent/CN1965298B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G06F11/1088—Reconstruction on already foreseen single or plurality of spare disks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1009—Cache, i.e. caches used in RAID system with parity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1054—Parity-fast hardware, i.e. dedicated fast hardware for RAID systems with parity

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Detection And Correction Of Errors (AREA)

Abstract

提供一种用于构建数据的方法、系统和设备，包括重建组织成允许数据重建的数据组织类型例如独立盘冗余阵列(RAID)组织的数据。在一个实施例中，将数据块从存储在存储单元例如RAID阵列中的盘驱动器上的数据条带传送到存储处理器的逻辑引擎，旁路存储处理器的高速缓存。在每个数据块从盘驱动器传送时，存储队列对该数据块执行逻辑操作，例如“异或”，以从条带重建数据块。重建的数据块随后可传送到RAID阵列的盘驱动器，以替代RAID阵列上数据条带中丢失的数据块，或替代老奇偶数据块。

Description

用于管理奇偶RAID数据重建的方法、系统和设备
技术领域
实施例涉及在数据组织系统例如RAID系统中管理数据的方法、系统和程序。
背景技术
已提出了许多技术用于组织存储在存储设备例如盘驱动器中的数据。一个这种数据存储组织称为独立(或廉价)盘冗余阵列或(RAID)。在RAID组织中，两个或更多个盘驱动器配合使用，以改进容错或性能，或二者。有不同类型的RAID数据存储组织，并且这些不同的类型常称为RAID 0级、1级、2级...。
例如，在RAID 0级数据组织中，使用户文件数据成“条带”状，即，用户数据块分布在多个盘上以改进性能。但是，在RAID 0级数据组织中，如果其中一个驱动器失效，则通常没有提供冗余作数据恢复。RAID 3级数据组织与RAID 0级类似，但通常保留有一个盘来存储纠错数据，常常称为“奇偶数据”。如果一个驱动器失效，则该奇偶数据就可用来重建丢失的用户数据。在RAID 5级数据组织中，为盘驱动器阵列上的每个条带提供有奇偶数据，且没有特定的盘驱动器专门用来存储奇偶数据。而是，用于用户数据条带的奇偶数据块分布在该阵列的所有盘上，以进一步改进性能。
在一个RAID-5组织中，有一个奇偶数据块用于盘驱动器阵列上的每个条带。如果一个驱动器失效，那么这种布置提供简便的数据重建。例如，如果一个数据条带包括四个数据块和一个奇偶数据块，如果由于驱动器故障、数据破坏或其它类型故障，条带的一个数据块丢失，则使用条带中仍保持完好的四个块就可重建丢失的块。
图1示出现有技术为重建丢失数据可执行的逻辑操作的一个实例。如果数据条带n有四个数据块和一个奇偶数据块，且条带n中一个块的数据丢失了，则使用条带n中三个好数据块的一个好数据子块以及好奇偶数据块的一个好奇偶数据子块就可重建丢失的数据。因此，在图1的实例中，对条带n中一个好数据块的第一好数据子块30和条带n中第二好数据块的第二好数据子块32执行“异或”操作。“异或”逻辑操作的结果可与条带n中第三好数据块的另一好数据子块33进行“异或”。这次“异或”逻辑操作的结果可与条带n的好奇偶数据块中的好奇偶数据子块34进行“异或”，以重建数据子块36，来替代丢失的数据子块。如果条带的整个数据块丢失了，则对于该块的每个子块重复图1的操作，就可重建整个块。
图2示出按照图1逻辑操作用于重建RAID存储单元丢失数据的RAID存储处理器的现有技术逻辑引擎50的实例。逻辑引擎50具有存储队列52，其可对存储队列52的内容执行“异或”逻辑操作，如箭头54所表示，并在其输入端给出数据，如箭头56表示。英特尔80303集成电路芯片具有类似的逻辑引擎，称为应用加速器单元(AAU)。
图3示出在重建数据中使用逻辑引擎50读出数据和处理所读数据的操作。在复位(过程框60)存储队列52后，在第一读出操作63(图2)中，可将好数据块从RAID阵列66中盘驱动器64a的条带n中读(过程框62)到存储处理器或控制器的局部内存68中。在第二读出操作70中，可将另一好数据块从RAID阵列66中盘驱动器64b的条带n中读(过程框62)到存储处理器或控制器的局部内存68中。在第三读出操作72中，可将第三好数据块从RAID阵列66中盘驱动器64c的条带n中读(过程框62)到局部内存68中。在第四读出操作74中，可将一个好奇偶数据块从RAID阵列66中盘驱动器64e的条带n中读(过程框62)到局部内存68中。
一旦所有好的数据块和奇偶数据块都已从条带读出(过程框80)，在一部分第五读出操作84中从盘驱动器64a读出的数据子块就可从局部内存68读出(过程框82)，并存储在存储队列52中。该数据例如可以是图1的数据子块30。由于存储队列52之前已复位，所以通过对从局部内存68读出的数据30和存储队列52的复位内容执行“异或”操作，源自驱动器64a的数据30就可存储在存储队列52中。从局部内存68到逻辑引擎50的读出操作的大小通常取决于存储队列52的容量。因此，如果例如存储队列52的容量是1K字节，则读出操作84会继续执行，直到存储队列52填满1K字节的数据30为止。
条带n中下一数据块的子块，即从盘驱动器64b读出的数据块的子块，可在一部分第六读出操作90中从局部内存68中读出(过程框86)。该数据例如可以是图1的数据子块32。从驱动器64b读出的数据块的数据子块32与以前存储在存储队列52中的数据子块30进行“异或”(过程框88)，并作为中间结果存储在存储队列52中。
条带n中下一数据块的子块33(图1)，即从盘驱动器64c读出的数据块的子块，可在一部分第七读出操作92中从局部内存68中读出(过程框86)。从驱动器64c读出的数据块的数据子块33与存储队列52的内容进行“异或”操作(过程框88)，并作为中间结果存储在存储队列52中。
条带n中数据的奇偶数据块的子块34(图1)，即从盘驱动器64e读出的数据块的子块，可在一部分第八读出操作94中从局部内存68中读出(过程框86)。从驱动器64e读出的奇偶块的奇偶数据子块34与存储队列52的内容进行“异或”操作(过程框88)，并作为中间结果存储在存储队列52中。
一旦条带n中好的数据块和奇偶数据块的所有对应子块都已被接收和处理(过程框95)，存储在存储队列52中的中间结果就是条带n的重建子块36，它可在一部分写入操作96中被写入(过程框96)局部内存68，要在随后的写入操作97中写入到盘驱动器64d，来替代丢失的子块。
可对条带n中数据块的每个子块重复图3的过程，直到所有子块都已被逻辑引擎50接收(过程框98)和处理，其中如果需要，条带n的整个块可被重建。而且，如果驱动器64d的所有数据例如都已丢失，则该过程可以对盘驱动器阵列66的每个条带重复，直到损坏的盘驱动器64d的每个块都已重建为止。当在RAID类型数据组织中用新数据更新老数据时，构建新奇偶数据的过程也类似。
尽管如此，业界一直有一种需要，要改进数据存储组织中处理器的性能。
发明内容
本发明提供一种用于构建数据的方法，包括：
在旁路高速缓存的第一传送操作中，将存储在多个非易失性存储单元上条带中的第一数据单元从多个非易失性存储单元的第一非易失性存储单元传送到具有高速缓存的存储处理器的逻辑引擎；
在旁路高速缓存的第二传送操作中，将存储在条带中的第二数据单元从多个非易失性存储单元的第二非易失性存储单元传送到逻辑引擎；以及
使用在第一传送操作中传送到逻辑引擎的第一数据单元并使用在第二传送操作中传送到逻辑引擎的第二数据单元，在逻辑引擎中构建第三数据单元。
本发明还提供一种用于构建数据的装置，包括：
用于在旁路高速缓存的第一传送操作中将存储在多个非易失性存储单元上条带中的第一数据单元从多个非易失性存储单元的第一非易失性存储单元传送到具有高速缓存的存储处理器的逻辑引擎的部件；
用于在旁路高速缓存的第二传送操作中将存储在条带中的第二数据单元从多个非易失性存储单元的第二非易失性存储单元传送到逻辑引擎的部件；以及
用于使用在第一传送操作中传送到逻辑引擎的第一数据单元并使用在第二传送操作中传送到逻辑引擎的第二数据单元来在逻辑引擎中构建第三数据单元的部件。
本发明还提供一种用于构建数据的系统，包括：
至少一个内存，它包含操作系统和应用程序；
耦合到内存的处理器；
具有多个非易失性存储单元的数据存储器；
数据存储处理器，适于管理对数据存储器的输入/输出(I/O)存取，并具有高速缓存和逻辑引擎；以及
在内存中可由处理器执行的设备驱动程序，其中应用程序、操作系统、设备驱动程序和存储处理器中至少一项包括：
用于在旁路高速缓存的第一传送操作中将存储在多个非易失性存储单元上条带中的第一数据单元从第一非易失性存储单元传送到存储处理器的逻辑引擎的部件；
用于在旁路高速缓存的第二传送操作中将存储在条带中的第二数据单元从多个非易失性存储单元的第二非易失性存储单元传送到逻辑引擎的部件；以及
用于使用在第一传送操作中传送到逻辑引擎的第一数据单元并使用在第二传送操作中传送到逻辑引擎的第二数据单元来在逻辑引擎中构建第三数据单元的部件。
本发明还提供一种与具有多个非易失性存储单元的数据存储器一起使用的用于构建数据的设备，包括：
数据存储处理器，适于管理对数据存储器的输入/输出(I/O)存取，并具有高速缓存和逻辑引擎，其中存储处理器还包括：
用于在旁路高速缓存的第一传送操作中将存储在多个非易失性存储单元上条带中的第一数据单元从第一非易失性存储单元传送到存储处理器的逻辑引擎的部件；
用于在旁路高速缓存的第二传送操作中将存储在条带中的第二数据单元从多个非易失性存储单元的第二非易失性存储单元传送到逻辑引擎的部件；以及
用于使用在第一传送操作中传送到逻辑引擎的第一数据单元并使用在第二传送操作中传送到逻辑引擎的第二数据单元来在逻辑引擎中构建第三数据单元的部件。
附图说明
现参阅附图，所有附图中相同的参考编号表示对应的部件：
图1示出现有技术的RAID数据重建；
图2示出用于RAID数据重建的现有技术逻辑引擎；
图3示出使用图2现有技术逻辑引擎重建数据的现有技术操作；
图4示出实现数据构建方面的计算环境的一个实施例；
图5示出实现数据构建方面的存储处理器环境的一个实施例；
图6示出按照数据构建方面用于图5存储处理器的逻辑引擎的一个实施例；
图7示出重建数据所执行操作的一个实施例；
图8示出用于重建数据块的数据块；
图9示出重建数据所执行操作的另一实施例；
图10示出构建奇偶数据所执行操作的另一实施例；以及
图11示出可与所述实施例一起使用的体系结构。
具体实施方式
在以下说明中，参阅附图，其中附图形成本发明的一部分，并示出几个实施例。应理解，可使用其它实施例，并可作结构和操作改变。
图4示出可以实现数据构建方面的计算环境。计算机102包括一个或多个中央处理单元(CPU)104(仅示出一个)、内存106、非易失性存储器108、存储处理器109、操作系统110以及网络适配器112。应用程序114还在内存106中执行，并能够从存储器108中读出数据和向其写入数据。计算机102可包括业界已知的任何计算设备，例如：大型机、服务器、个人计算机、工作站、膝上型电脑、手持计算机、电话设备、网络设备、虚拟化设备、存储处理器、存储控制器等等。业界已知的任何CPU 104和操作系统110都可使用。作为内存管理操作的一部分，内存106中的程序和数据可交换到存储器108中。计算机102可通过网络适配器112与网络118通信。
设备驱动程序120在内存106中执行，并包括存储处理器特定命令，以与存储处理器109以及操作系统110和存储处理器109之间的接口通信。存储器108包括多个盘存储单元，例如即盘驱动器150a、150b...150n，其中数据可存储为允许数据重建的组织类型。在图示的实施例中，盘驱动器150a、150b...150n组织成RAID阵列151。
在某些实现中，存储处理器109执行某些操作，以协助计算机102从存储器108中读出数据和向其写入数据。例如，存储处理器109可具有软件、固件或硬件或它们的组合，以将LBA地址从计算机102转换成盘驱动器150a、150b...150n的柱面、磁头和扇区规范。此外，存储处理器109包括数据构建管理器130，它在驱动器故障或其它数据丢失时管理数据的重建。另外，在用新数据更新老数据时，构建管理器130可管理新奇偶数据的构建。
图5示出适当存储处理器109的一个实例。存储处理器109便于在主机102和存储器108之间快速移动大量数据。存储处理器109包括电桥160，它在主机102的主总线162和连接到存储器108的存储控制器166的次总线164之间。电桥160允许例如可以是串行-高级技术附件(SATA)控制器的存储控制器166与主总线162物理隔离。控制器166还可将计算机信息转到将存储处理器109连接到存储器108的存储接口。虽然存储控制器166示为存储处理器109的一部分，但存储控制器166可以是存储器108的一部分，或是一个分离单元。
主地址转换单元168提供从主总线162通过局部总线174到处理器170和局部内存172的高通过量数据通路。连接到局部总线174的还有逻辑引擎176，它为RAID算法提供“异或”计算，以产生奇偶块。次地址转换单元178提供从处理器单元170和局部内存172到次总线164的高通过量数据通路。在所示实施例中，总线162、164是PCI总线，但也可使用其它类型的外围总线。
局部内存172具有内存控制器180。在所示实施例中，局部内存172是易失性RAM型存储器，并用于对传送到盘驱动器150a、150b...150e的数据或从这些盘驱动器接收的数据进行高速缓存。也可使用其它类型的存储器。例如，在数据传送期间存储处理器109或存储器108意外停止工作时，非易失性快闪存储器可用于存储标识不完整条带的恢复信息。直接存储器存取(DMA)控制器182、184允许从主机102向局部内存172以及从局部内存172向驱动器150a...150n的直接存储器传送。
如前所述，一些RAID数据重建过程利用至少8个读出操作来为具有5个数据块(包括一个奇偶块)的条带重建数据块。按照所示实施例的一个方面，构建管理器130包括存储处理器109的逻辑引擎176，它在一些应用中能显著便于丢失数据的有效重建或在数据更新时新奇偶数据的构建。例如在一个应用中，为具有5个数据块(包括一个奇偶块)的条带重建数据块的读出操作数可减到四个读出操作。另外，存储重建块的写入操作数可从两个写入操作减到一个写入操作。
图6以示意图形式示出包括存储队列200的逻辑引擎176的一个实例。存储队列200可对存储队列200的内容执行“异或”逻辑操作，如箭头202所示，并在其输入端给出数据，如箭头204所示。按照所示实施例的一个方面，在一个读出操作中，数据可直接从盘驱动器150a、150b...150n之一读出，并在逻辑引擎176中处理，不用先在局部内存172中高速缓冲。按照所示实施例的另一方面，存储队列200一次可容纳整个数据块。更详细解释的是，一个或多个这些和其它特征可便于数据构建，包括数据重建。
在所示实施例中，逻辑引擎176显示为包括存储队列。也可使用其它类型的电路，包括寄存器和其它类型的逻辑和存储器。
图7示出包括处理器单元170和逻辑引擎176的数据构建管理器130在数据重建中的操作实例。在此实例中，包括5个数据块，其中包括一个奇偶块的数据条带n(图8)分别存储在5个盘驱动器150a、150b、150c、150d和150e上，其中条带的每个数据块存储在盘驱动器150a、150b...150e中的一个上。而且，盘驱动器150a、150b...150e中之一，在此实例中，即盘驱动器150d，已失效，以致每个条带的数据块都已丢失或者被破坏，并需要重建。
在复位(过程框260)存储队列200后，可对特定条带的所有块启动读出操作(过程框286)。按照一方面，所有块或子块可以从存储器108中并行读出和处理，如下所述。因此，读出命令可由存储处理器109同时发给所有盘驱动器150a、150b...150e，以读出条带的相应块。一旦对发给盘驱动器的读出命令作出响应而从盘驱动器150a、150b...150e之一接收(过程框292)一个块(或子块)，此块就可存储在存储队列200中(图6)。该数据例如可以是条带n的数据块1，如图8所示，如果含有块1的盘驱动器是第一个对所发出的读出命令作出响应的话。由于存储队列200之前复位了，因此通过对从驱动器150a读出的块1数据和存储队列200的复位内容执行“异或”操作(框296)，例如从驱动器150a读出的数据块1就可存储在存储队列200中。在所示实施例中，存储队列200的容量足以容纳来自盘驱动器条带的整个数据块。因此，如果例如存储队列200的容量是64K字节，则对每个块的读出操作可继续执行，直到存储队列200填满整个64K字节的块1数据为止。应理解，存储队列200的大小可以改变，视应用而定。
对以前发出(过程框286)的读出命令作出响应，可以接收到(过程框292)来自条带n的另一数据块，例如块2(图8)。来自驱动器150b的数据块2与以前存储在存储队列200中的数据块1执行“异或”操作(过程框296)，并作为中间结果存储在存储队列200中。
对以前发出(过程框286)的读出命令作出响应，可以接收到(过程框292)来自条带n的另一数据块，例如块3(图8)。来自驱动器150c的数据块3与存储队列200的内容执行“异或”操作(过程框296)，并作为中间结果存储在存储队列200中。
对以前发出(过程框286)的读出命令作出响应，可以接收到(过程框292)来自条带n的另一数据块，例如块5(图8)。来自驱动器150e的(奇偶)数据块5与存储队列200的内容执行“异或”操作(过程框296)，并作为中间结果存储在存储队列200中。
一旦已从盘驱动器150a、150b...150e接收到(过程框302)条带n的所有好数据块，存储在存储队列200中的中间结果就是条带n的重建块4(图8)，它可在第一写入操作306中被写入(过程框304)盘驱动器150d，来替代条带n的丢失块4。图7的过程可以对盘驱动器150a、150b...150e的阵列151中的每个条带重复，直到每个损坏的块(过程框310)都已被重建为止。
虽然图7的过程框292是指“块”的接收，但应理解，条带n的数据块的子块不必一起接收和处理。而是，子块可以在不同的时间被接收，并在被接收时与存储队列200的内容作“异或”。因此，条带n的每个块的子块可在它们被存储队列200接收和处理时与条带n其它块的子块相互混合。因此，存储处理器109可以同时向每个盘驱动器150a、150b...150e发出读出命令，且盘驱动器可同时用所请求的数据作出响应，这样条带n的各个块的子块就可在它们在总线164上从盘驱动器传送到存储处理器109和存储队列200时相互混合在一起。
图9示出构建管理器130操作的另一实施例，其中在降级数据读出操作中，重建的数据可直接从存储队列200写入主机102，例如写入主机内存106。在此实施例中，构建管理器130包括存储处理器109中的DMA功能，其允许例如在DMA写入操作350中，重建的数据从存储队列200向主机内存106直接转储。DMA控制器例如可以是图5的DMA控制器182，或可以在逻辑引擎176的电路中或其它地方实现，视应用而定。
图10示出构建管理器130操作的另一实施例，其中构建了新的奇偶数据，以在用新数据更新老数据时替代老的奇偶数据。在复位存储队列200后，在第一读出操作400中，可从主机102读出条带n的新数据块，并将其存储在存储队列200中。在如上所述的一个实施例中，此数据传送可作为DMA传送完成。在第一写入操作402中，新数据也可从存储队列200传送到局部内存172中。在第二读出操作404中，老数据可以从盘驱动器例如盘驱动器150a传送出去。来自驱动器150a的老数据块与以前存储在存储队列200中的新数据块执行“异或”操作，并作为中间结果存储在存储队列200中。
在第三读出操作406中，下一个块，即条带n的老奇偶数据块，可从盘驱动器例如盘驱动器150b中读出。来自驱动器150b的老奇偶数据块与存储队列200的内容执行“异或”操作，并作为中间结果存储在存储队列200中。
一旦条带n的老数据块和老奇偶数据块以及条带n的新数据块已分别从盘驱动器150a、150b和主机102接收到，存储在存储队列200中的中间结果就是条带n的新奇偶数据块，它可在第二写入操作408中被写入盘驱动器150b，以替代条带n的老奇偶数据。此外，在第三写入操作410中，新数据可从局部内存172写入到盘驱动器150a，以替代老数据。应理解，在数据更新操作中读出和写入操作数可显著减少，如上所述。
再者按照另一方面，所有块或子块都可从存储器108和主机内存106中并行读出和处理。因此，读出命令可由存储处理器109同时发到主机内存和所有盘驱动器150a、150b...150e，以读出条带的相应块。
附加实施例详情
用于管理数据构建的所述技术可使用标准编程和/或工程技术来产生软件、固件、硬件或它们的任何组合实现为方法、设备或制品。本文所用的词语“制品”是指在硬件逻辑(例如集成电路芯片、可编程门阵列(PGA)、专用集成电路(ASIC)等)或计算机可读介质例如磁存储介质(例如硬盘驱动器、软盘、磁带等)、光存储器(CD-ROM、光盘等)、易失性和非易失性存储器件(例如EEPROM、ROM、PROM、RAM、DRAM、SRAM、固件、可编程逻辑等)实现的代码或逻辑。计算机可读介质中的代码由处理器存取和执行。实现优选实施例的代码还可在网络上通过传输介质或从文件服务器存取。在这种情况下，实现代码的制品可包括传输介质，例如网络传输线、无线传输介质，信号则通过空间、无线电波、红外信号等传播。所以，“制品”可包括实施代码的介质。此外，“制品”可包括实施、处理和执行代码的硬件和软件成分的组合。当然，业界技术人员会认识到，对于这种配置可以作出许多改动，并且制品可包括业界已知的任何信息承载介质。
虽然在本文中将逻辑引擎描述为具有一个存储队列或寄存器用于执行“异或”操作，但应理解，逻辑引擎可具有多个存储队列或寄存器，特别是对于具有多个奇偶块的数据组织，如在2003年12月29日提交的、授予本申请受让人的、代理档案号P17729、题目为“生成奇偶数据的方法、系统和程序(METHOD，SYSTEM AND PROGRAMFOR GENERATING PARITY DATA)”的同时待审的申请中所述。
在某些实现中，存储处理器109包括管理数据构建和重建的数据构建管理器130。存储处理器109可具有软件、固件或硬件或它们的组合，以执行这些和其它功能。例如，在一个实施例中，处理器170和逻辑引擎176可以在与主机处理器分开的存储处理器109中的硬件中实现。在其它实现方案中，数据构建管理器可以在包括驱动程序、操作系统或应用程序或这些的组合的主机软件中实现。
在某些实现方案中，计算机系统可包括驱动程序和存储控制器，例如串行-高级技术附件(SATA)、串行连接SCSI(SAS)、独立盘冗余阵列(RAID)等控制器，其管理对非易失性存储设备的存取，例如磁盘驱动器、磁带介质、光盘等。在备选实现方案中，存储控制器实施例可包含在没有驱动程序的系统中。用于设备和扩展器的SAS体系结构的更多详情在技术说明书“信息技术-串行连接SCSI(SAS)(Information Technology-Serial Attached SCSI(SAS))”中有说明，参考由ANSI出版的No.ISO/IEC 14776-150：200x和ANSI INCITS.***：200x PHY layer(2003年7月9日)。关于SATA体系结构的详情在技术说明书“串行ATA：高速串行化AT附件(Serial ATA：High SpeedSerialized AT Attachment)”Rev.1.0A(2003年1月)中有说明。
虽然在本文中将逻辑引擎描述为接收和处理一个完全的数据块，但应理解，一次也可接收和处理一个块或多个块的一部分。此外，虽然在本文中将逻辑引擎描述为直接从非易失性存储单元例如盘驱动器接收数据，但应理解，在某些实施例中，数据也可从易失性存储器例如RAM存储器传送到逻辑引擎。
在某些实现方案中，设备驱动程序和存储处理器实施例可以在包括视频控制器的计算机系统中实现，以提供信息在连接到包括设备驱动程序和网络适配器的计算机系统的监视器上显示，这种计算机系统包括台式计算机、工作站、服务器、大型机、膝上型电脑、手持计算机等。备选的是，存储处理器和设备驱动程序实施例可以在不包括视频控制器的计算设备中实现。
在某些实现方案中，网络适配器可配置成在连接到网络适配器上端口的电缆上传输数据。备选的是，网络适配器实施例可配置成在无线网络或连接上传输数据，例如无线LAN、蓝牙等。
图7所示逻辑示出了以某种顺序发生的某些事件。在备选实施例中，某些操作可以不同顺序执行、更改或删除。而且，一些操作可添加到上述逻辑，且仍然与所述实施例相符。另外，本文所述的操作可依次发生，或某些操作可并行处理。还有，操作可由单一处理单元执行，或由分布式处理单元执行。
图11示出网络组件的计算机体系结构500的一个实现方案，例如图4所示的主机和存储设备。体系结构500可包括处理器502(例如微处理器)、内存504(例如易失性存储装置)以及存储器506(例如非易失性存储器，例如磁盘驱动器、光盘驱动器、磁带驱动器等)。存储器506可包括内部存储设备或附加的或网络可存取的存储器。存储器506中的程序以业界已知的方式加载到内存504中，并由处理器502执行。存储控制器507可控制存储器506。该体系结构还包括网络适配器508，以便能与网络例如以太网、光纤通道仲裁环路等通信。关于光纤通道体系结构的详情在技术说明书“Fibre Channel Framingand Signaling Interface”中有说明，文件号为ISO/IEC AWI 14165-25。
另外，在某些实施例中，该体系结构可包括视频控制器509，以将信息呈现在显示监视器上，其中视频控制器509可以在视频卡上实现，或集成到安装在母板上的集成电路组件上。如上所述，某些网络设备可具有多个存储卡或控制器。输入设备510用来提供对处理器502的用户输入，并可包括键盘、鼠标、笔针、扩音器、触摸式显示屏、或业界已知的任何其它激活或输入构件。输出设备512能够提供从处理器502或其它组件例如显示监视器、打印机、存储器等传输的信息。
存储控制器507和网络适配器508各可在卡上实现，例如外围部件互连(PCI)卡或某个其它的I/O卡，或在安装在母板上的集成电路组件上实现。关于PCI体系结构的详情在PCI-SIG出版的“PCI LocalBus，Rev.2.3”中有说明。
已经出于图示和说明目的给出了各种实施例的上述说明。上述说明书、实例和数据提供了各成分的制造和使用的完整说明。不应认为本说明书是排他性的，或局限于所公开的明确形式。根据上述内容可以作出许多更改和改变。

Claims (50)

1.一种用于构建数据的方法，包括：
在旁路高速缓存的第一传送操作中，将存储在多个非易失性存储单元上条带中的第一数据单元从所述多个非易失性存储单元的第一非易失性存储单元传送到具有所述高速缓存的存储处理器的逻辑引擎；
在旁路所述高速缓存的第二传送操作中，将存储在所述条带中的第二数据单元从所述多个非易失性存储单元的第二非易失性存储单元传送到所述逻辑引擎；以及
使用在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元并使用在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元，在所述逻辑引擎中构建第三数据单元。
2.如权利要求1所述的方法，还包括在第三传送操作中将所述构建的第三数据单元传送到所述多个非易失性存储单元的第三非易失性存储单元，并将所述构建的第三数据单元存储在所述条带中。
3.如权利要求2所述的方法，其中所述第三传送操作旁路所述高速缓存。
4.如权利要求2所述的方法，其中所述多个非易失性存储单元布置成独立盘冗余阵列组织。
5.如权利要求4所述的方法，其中所述第二数据单元是奇偶数据。
6.如权利要求5所述的方法，其中每个非易失性存储单元是盘驱动器。
7.如权利要求6所述的方法，其中所述条带组织成包括奇偶数据块的数据块的独立盘冗余阵列条带，且每个所述数据单元是所述独立盘冗余阵列条带的数据块。
8.如权利要求7所述的方法，其中所述逻辑引擎包括能够存储来自所述独立盘冗余阵列条带的数据块的存储队列。
9.如权利要求1所述的方法，其中所述逻辑引擎的所述高速缓存是随机存取存储器。
10.如权利要求1所述的方法，其中所述在所述逻辑引擎中构建第三数据单元包括将在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元加到所述逻辑引擎的存储队列，并对所述存储队列的内容和所述所加的第一数据单元执行“异或”逻辑函数操作，并且包括将在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元加到所述逻辑引擎的所述存储队列，并对所述存储队列的内容和所述所加的第二数据单元执行“异或”逻辑函数操作。
11.如权利要求2所述的方法，还包括：
在旁路所述高速缓存的第四传送操作中，将存储在所述条带中的第四数据单元从所述多个非易失性存储单元的第四非易失性存储单元传送到所述逻辑引擎；以及
在旁路所述高速缓存的第五传送操作中，将存储在所述条带中的第五数据单元从所述多个非易失性存储单元的第五非易失性存储单元传送到所述逻辑引擎；以及
其中所述在所述逻辑引擎中构建所述第三数据单元，在所述第三传送操作中所述将所述构建的第三数据单元传送到所述第三非易失性存储单元之前，还使用在所述第四传送操作中传送到所述逻辑引擎的所述第四数据单元，并使用在所述第五传送操作中传送到所述逻辑引擎的所述第五数据单元。
12.如权利要求2所述的方法，还包括：
对于所述多个非易失性存储单元的每个附加非易失性存储单元：
在旁路所述高速缓存的附加传送操作中，将存储在所述条带中的附加数据单元从所述多个非易失性存储单元的附加非易失性存储单元传送到所述逻辑引擎；以及
其中所述在所述逻辑引擎中构建所述第三数据单元，在所述第三传送操作中所述将所述构建的第三数据单元传送到所述第三非易失性存储单元之前，还使用在所述附加传送操作中传送到所述逻辑引擎的所述附加数据单元。
13.如权利要求1所述的方法，还包括：
将作为要存储在所述条带中的新数据的第四数据单元传送到所述逻辑引擎；其中所述第一数据单元是在所述条带中要由所述新数据替代的老数据，所述第二数据单元是在所述条带中要被替代的老奇偶数据，并且其中所述在所述逻辑引擎中构建所述第三数据单元使用传送到所述逻辑引擎的所述新数据来构建替代奇偶数据单元，所述方法还包括将所述替代奇偶数据单元传送到所述第二非易失性存储单元，以替代所述老奇偶数据。
14.如权利要求1所述的方法，还包括在第三传送操作中将所述构建的第三数据单元传送到主机。
15.如权利要求1所述的方法，其中所述存储处理器向所述第一和第二非易失性存储单元发出读出命令，以使所述第一和第二数据单元从所述第一和第二非易失性存储单元中至少并行地存取。
16.一种用于构建数据的装置，包括：
用于在旁路高速缓存的第一传送操作中将存储在多个非易失性存储单元上条带中的第一数据单元从所述多个非易失性存储单元的第一非易失性存储单元传送到具有所述高速缓存的存储处理器的逻辑引擎的部件；
用于在旁路所述高速缓存的第二传送操作中将存储在所述条带中的第二数据单元从所述多个非易失性存储单元的第二非易失性存储单元传送到所述逻辑引擎的部件；以及
用于使用在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元并使用在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元来在所述逻辑引擎中构建第三数据单元的部件。
17.如权利要求16所述的装置，还包括用于在第三传送操作中将所述构建的第三数据单元传送到所述多个非易失性存储单元的第三非易失性存储单元的部件和用于将所述构建的第三数据单元存储在所述条带中的部件。
18.如权利要求17所述的装置，其中所述第三传送操作旁路所述高速缓存。
19.如权利要求17所述的装置，其中所述多个非易失性存储单元布置成独立盘冗余阵列组织。
20.如权利要求19所述的装置，其中所述第二数据单元是奇偶数据。
21.如权利要求20所述的装置，其中每个非易失性存储单元是盘驱动器。
22.如权利要求21所述的装置，其中所述条带组织成包含奇偶数据块的数据块的独立盘冗余阵列条带，且每个所述数据单元是所述独立盘冗余阵列条带的数据块。
23.如权利要求22所述的装置，其中所述逻辑引擎包括能够存储来自所述独立盘冗余阵列条带的数据块的存储队列。
24.如权利要求16所述的装置，其中所述逻辑引擎的所述高速缓存是随机存取存储器。
25.如权利要求16所述的装置，其中用于在所述逻辑引擎中构建第三数据单元的部件包括用于将在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元加到所述逻辑引擎的存储队列并对所述存储队列的内容和所述所加的第一数据单元执行“异或”逻辑函数操作的部件，并且包括用于将在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元加到所述逻辑引擎的所述存储队列并对所述存储队列的内容和所述所加的第二数据单元执行“异或”逻辑函数操作的部件。
26.如权利要求17所述的装置，还包括：
用于在旁路所述高速缓存的第四传送操作中将存储在所述条带中的第四数据单元从所述多个非易失性存储单元的第四非易失性存储单元传送到所述逻辑引擎的部件；以及
用于在旁路所述高速缓存的第五传送操作中将存储在所述条带中的第五数据单元从所述多个非易失性存储单元的第五非易失性存储单元传送到所述逻辑引擎的部件；并且
其中用于在所述逻辑引擎中构建第三数据单元的部件包括用于进行以下处理的部件：在所述第三传送操作中所述将所述构建的第三数据单元传送到所述第三非易失性存储单元之前，使用在所述第四传送操作中传送到所述逻辑引擎的所述第四数据单元，并使用在所述第五传送操作中传送到所述逻辑引擎的所述第五数据单元。
27.如权利要求16所述的装置，还包括用于将作为要存储在所述条带中的新数据的第四数据单元传送到所述逻辑引擎的部件；其中所述第一数据单元是在所述条带中要由所述新数据替代的老数据，所述第二数据单元是在所述条带中要被替代的老奇偶数据，且其中用于在所述逻辑引擎中构建第三数据单元的部件包括用于使用传送到所述逻辑引擎的所述新数据来构建替代奇偶数据单元的部件，所述装置还包括用于将所述替代奇偶数据单元传送到所述第二非易失性存储单元来替代所述老奇偶数据的部件。
28.如权利要求16所述的装置，还包括用于在第三传送操作中将所述构建的第三数据单元传送到主机的部件。
29.如权利要求16所述的装置，还包括用于向所述第一和第二非易失性存储单元发出读出命令以使所述第一和第二数据单元从所述第一和第二非易失性存储单元中至少并行地存取的部件。
30.一种用于构建数据的系统，包括：
至少一个内存，它包含操作系统和应用程序；
耦合到所述内存的处理器；
具有多个非易失性存储单元的数据存储器；
数据存储处理器，适于管理对所述数据存储器的输入/输出(I/O)存取，并具有高速缓存和逻辑引擎；以及
在所述内存中可由所述处理器执行的设备驱动程序，其中所述应用程序、操作系统、设备驱动程序和所述存储处理器中至少一项包括：
用于在旁路所述高速缓存的第一传送操作中将存储在所述多个非易失性存储单元上条带中的第一数据单元从第一非易失性存储单元传送到所述存储处理器的所述逻辑引擎的部件；
用于在旁路所述高速缓存的第二传送操作中将存储在所述条带中的第二数据单元从所述多个非易失性存储单元的第二非易失性存储单元传送到所述逻辑引擎的部件；以及
用于使用在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元并使用在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元来在所述逻辑引擎中构建第三数据单元的部件。
31.如权利要求30所述的系统，其中所述应用程序、操作系统、设备驱动程序和所述存储处理器中的所述至少一项还包括用于在第三传送操作中将所述构建的第三数据单元传送到所述多个非易失性存储单元的第三非易失性存储单元的部件和用于将所述构建的第三数据单元存储在所述条带中的部件。
32.如权利要求31所述的系统，其中所述第三传送操作旁路所述高速缓存。
33.如权利要求31所述的系统，其中所述多个非易失性存储单元布置成独立盘冗余阵列组织。
34.如权利要求33所述的系统，其中所述第二数据单元是奇偶数据。
35.如权利要求34所述的系统，其中每个非易失性存储单元是盘驱动器。
36.如权利要求35所述的系统，其中所述条带组织成包括奇偶数据块的数据块的独立盘冗余阵列条带，且每个所述数据单元是所述独立盘冗余阵列条带的数据块。
37.如权利要求36所述的系统，其中所述逻辑引擎包括能够存储来自所述独立盘冗余阵列条带的数据块的存储队列。
38.如权利要求30所述的系统，其中所述逻辑引擎的所述高速缓存是随机存取存储器。
39.如权利要求30所述的系统，其中用于在所述逻辑引擎中构建第三数据单元的部件包括用于将在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元加到所述逻辑引擎的存储队列并对所述存储队列的内容和所述所加的第一数据单元执行“异或”逻辑函数操作的部件，并且包括用于将在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元加到所述逻辑引擎的所述存储队列并对所述存储队列的内容和所述所加的第二数据单元执行“异或”逻辑函数操作的部件。
40.如权利要求31所述的系统，其中所述应用程序、操作系统、设备驱动程序和所述存储处理器中的所述至少一个还包括：用于在旁路所述高速缓存的第四传送操作中将存储在所述条带中的第四数据单元从所述多个非易失性存储单元的第四非易失性存储单元传送到所述逻辑引擎的部件；以及
用于在旁路所述高速缓存的第五传送操作中将存储在所述条带中的第五数据单元从所述多个非易失性存储单元的第五非易失性存储单元传送到所述逻辑引擎的部件；以及
其中用于在所述逻辑引擎中构建第三数据单元的部件还包括用于进行以下处理的部件：在所述第三传送操作中所述将所述构建的第三数据单元传送到所述第三非易失性存储单元之前，使用在所述第四传送操作中传送到所述逻辑引擎的所述第四数据单元，并使用在所述第五传送操作中传送到所述逻辑引擎的所述第五数据单元。
41.如权利要求30所述的系统，其中所述应用程序、操作系统、设备驱动程序和所述存储处理器中的所述至少一项还包括用于将作为要存储在所述条带中的新数据的第四数据单元传送到所述逻辑引擎的部件；其中所述第一数据单元是在所述条带中要由所述新数据替代的老数据，所述第二数据单元是在所述条带中要被替代的老奇偶数据，且其中用于在所述逻辑引擎中构建第三数据单元的部件包括用于使用传送到所述逻辑引擎的所述新数据来构建替代奇偶数据单元的部件，且所述应用程序、操作系统、设备驱动程序和所述存储处理器中的所述至少一项还包括用于将所述替代奇偶数据单元传送到所述第二非易失性存储单元来替代所述老奇偶数据的部件。
42.如权利要求30所述的系统，其中所述应用程序、操作系统、设备驱动程序和所述存储处理器中的所述至少一项还包括用于在第三传送操作中将所述构建的第三数据单元传送到主机的部件。
43.如权利要求30所述的系统，其中所述应用程序、操作系统、设备驱动程序和所述存储处理器中的所述至少一项还包括用于向所述第一和第二非易失性存储单元发出读出命令以使所述第一和第二数据单元从所述第一和第二非易失性存储单元中至少并行地存取的部件。
44.一种与具有多个非易失性存储单元的数据存储器一起使用的用于构建数据的设备，包括：
数据存储处理器，适于管理对所述数据存储器的输入/输出(I/O)存取，并具有高速缓存和逻辑引擎，其中所述存储处理器还包括：
用于在旁路所述高速缓存的第一传送操作中将存储在所述多个非易失性存储单元上条带中的第一数据单元从第一非易失性存储单元传送到所述存储处理器的所述逻辑引擎的部件；
用于在旁路所述高速缓存的第二传送操作中将存储在所述条带中的第二数据单元从所述多个非易失性存储单元的第二非易失性存储单元传送到所述逻辑引擎的部件；以及
用于使用在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元并使用在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元来在所述逻辑引擎中构建第三数据单元的部件。
45.如权利要求44所述的设备，其中所述存储处理器还包括用于在第三传送操作中将所述构建的第三数据单元传送到所述多个非易失性存储单元的第三非易失性存储单元的部件和用于将所述构建的第三数据单元存储在所述条带中的部件。
46.如权利要求45所述的设备，其中所述第三传送操作旁路所述高速缓存。
47.如权利要求45所述的设备，其中每个非易失性存储单元是盘驱动器，所述多个非易失性存储单元布置成独立盘冗余阵列组织，所述条带组织成包括奇偶数据块的数据块的独立盘冗余阵列条带，且每个所述数据单元是所述独立盘冗余阵列条带的数据块。
48.如权利要求47所述的设备，其中所述逻辑引擎包括能够存储来自所述独立盘冗余阵列条带的数据块的存储队列，所述逻辑引擎的所述高速缓存是随机存取存储器，并且用于在所述逻辑引擎中构建第三数据单元的部件包括用于将在所述第一传送操作中传送到所述逻辑引擎的所述第一数据单元加到所述逻辑引擎的存储队列并对所述存储队列的内容和所述所加的第一数据单元执行“异或”逻辑函数操作的部件和用于将在所述第二传送操作中传送到所述逻辑引擎的所述第二数据单元加到所述逻辑引擎的所述存储队列并对所述存储队列的内容和所述所加的第二数据单元执行“异或”逻辑函数操作的部件。
49.如权利要求44所述的设备，其中所述存储处理器还包括用于在第三传送操作中将所述构建的第三数据单元传送到主机的部件。
50.如权利要求44所述的设备，其中所述存储处理器还包括用于向所述第一和第二非易失性存储单元发出读出命令以使所述第一和第二数据单元从所述第一和第二非易失性存储单元中至少并行存取的部件。
CN2004800391368A 2003-12-29 2004-12-20 用于管理奇偶raid数据重建的方法、系统和设备 Expired - Fee Related CN1965298B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/747,932 2003-12-29
US10/747,932 US7206899B2 (en) 2003-12-29 2003-12-29 Method, system, and program for managing data transfer and construction
PCT/US2004/043041 WO2005066761A2 (en) 2003-12-29 2004-12-20 Method, system, and program for managing parity raid data reconstruction

Publications (2)

Publication Number Publication Date
CN1965298A CN1965298A (zh) 2007-05-16
CN1965298B true CN1965298B (zh) 2011-02-02

Family

ID=34700811

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2004800391368A Expired - Fee Related CN1965298B (zh) 2003-12-29 2004-12-20 用于管理奇偶raid数据重建的方法、系统和设备

Country Status (6)

Country Link
US (1) US7206899B2 (zh)
EP (1) EP1700201A2 (zh)
JP (1) JP2007513435A (zh)
CN (1) CN1965298B (zh)
TW (1) TWI296757B (zh)
WO (1) WO2005066761A2 (zh)

Families Citing this family (676)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10432726B2 (en) 2005-09-30 2019-10-01 Pure Storage, Inc. Last-resort operations to save at-risk-data
US8938591B2 (en) * 2005-09-30 2015-01-20 Cleversafe, Inc. Dispersed storage processing unit and methods with data aggregation for use in a dispersed storage system
US8595435B2 (en) * 2009-07-30 2013-11-26 Cleversafe, Inc. Dispersed storage write process
US11327674B2 (en) 2012-06-05 2022-05-10 Pure Storage, Inc. Storage vault tiering and data migration in a distributed storage network
US10154034B2 (en) 2010-04-26 2018-12-11 International Business Machines Corporation Cooperative data access request authorization in a dispersed storage network
US8285878B2 (en) * 2007-10-09 2012-10-09 Cleversafe, Inc. Block based access to a dispersed data storage network
US10866754B2 (en) 2010-04-26 2020-12-15 Pure Storage, Inc. Content archiving in a distributed storage network
US11474903B1 (en) 2005-09-30 2022-10-18 Pure Storage, Inc. Rebuilding of encoded data slices using locally decodable code segments
US8352782B2 (en) * 2005-09-30 2013-01-08 Cleversafe, Inc. Range based rebuilder for use with a dispersed data storage network
US8171101B2 (en) * 2005-09-30 2012-05-01 Cleversafe, Inc. Smart access to a dispersed data storage network
US9632722B2 (en) 2010-05-19 2017-04-25 International Business Machines Corporation Balancing storage unit utilization within a dispersed storage network
US8694668B2 (en) * 2005-09-30 2014-04-08 Cleversafe, Inc. Streaming media software interface to a dispersed data storage network
US10356177B2 (en) 2005-09-30 2019-07-16 International Business Machines Corporation Prioritizing ranges to rebuild based on namespace health
US10938418B2 (en) 2005-09-30 2021-03-02 Pure Storage, Inc. Online disk replacement/removal
US11340988B2 (en) 2005-09-30 2022-05-24 Pure Storage, Inc. Generating integrity information in a vast storage system
US11416339B1 (en) 2005-09-30 2022-08-16 Pure Storage, Inc. Validating requests based on stored vault information
US10855769B2 (en) 2005-09-30 2020-12-01 Pure Storage, Inc. Prioritizing memory devices to replace based on namespace health
US10282440B2 (en) 2015-03-31 2019-05-07 International Business Machines Corporation Prioritizing rebuilding of encoded data slices
US12061519B2 (en) 2005-09-30 2024-08-13 Purage Storage, Inc. Reconstructing data segments in a storage network and methods for use therewith
US9996413B2 (en) * 2007-10-09 2018-06-12 International Business Machines Corporation Ensuring data integrity on a dispersed storage grid
US7904475B2 (en) * 2007-10-09 2011-03-08 Cleversafe, Inc. Virtualized data storage vaults on a dispersed data storage network
US10169229B2 (en) 2012-06-05 2019-01-01 International Business Machines Corporation Protocols for expanding existing sites in a dispersed storage network
US10044807B2 (en) 2005-09-30 2018-08-07 International Business Machines Corporation Optimistic checked writes
US8880799B2 (en) * 2005-09-30 2014-11-04 Cleversafe, Inc. Rebuilding data on a dispersed storage network
US10250686B2 (en) 2005-09-30 2019-04-02 International Business Machines Corporation Finding alternate storage locations to support failing disk migration
US11841770B2 (en) 2005-09-30 2023-12-12 Pure Storage, Inc. Storage unit connection security in a storage network and methods for use therewith
US12120177B2 (en) 2005-09-30 2024-10-15 Pure Storage, Inc. Performance based access in a storage network
US7546427B2 (en) 2005-09-30 2009-06-09 Cleversafe, Inc. System for rebuilding dispersed data
US11272009B1 (en) 2005-09-30 2022-03-08 Pure Storage, Inc. Managed data slice maintenance in a distributed storage system
US10270858B2 (en) 2005-09-30 2019-04-23 International Business Machines Corporation Inducing memory device idle time through rolling read prioritizations
US10860424B1 (en) 2005-09-30 2020-12-08 Pure Storage, Inc. Background verification processing in a storage network
US10257276B2 (en) 2005-09-30 2019-04-09 International Business Machines Corporation Predictive rebalancing according to future usage expectations
US9774684B2 (en) 2005-09-30 2017-09-26 International Business Machines Corporation Storing data in a dispersed storage network
US9027080B2 (en) 2008-03-31 2015-05-05 Cleversafe, Inc. Proxy access to a dispersed storage network
US11080138B1 (en) 2010-04-26 2021-08-03 Pure Storage, Inc. Storing integrity information in a vast storage system
US7574579B2 (en) * 2005-09-30 2009-08-11 Cleversafe, Inc. Metadata management system for an information dispersed storage system
US10051057B2 (en) 2005-09-30 2018-08-14 International Business Machines Corporation Prioritizing read locations based on an error history
US8209363B2 (en) 2007-10-09 2012-06-26 Cleversafe, Inc. File system adapted for use with a dispersed data storage network
US10747616B2 (en) 2015-03-31 2020-08-18 Pure Storage, Inc. Adapting rebuilding of encoded data slices in a dispersed storage network
US11909418B1 (en) 2005-09-30 2024-02-20 Pure Storage, Inc. Access authentication in a dispersed storage network
US8555109B2 (en) 2009-07-30 2013-10-08 Cleversafe, Inc. Method and apparatus for distributed storage integrity processing
US7574570B2 (en) * 2005-09-30 2009-08-11 Cleversafe Inc Billing system for information dispersal system
US10389814B2 (en) 2005-09-30 2019-08-20 Pure Storage, Inc. Prioritizing memory devices to replace based on namespace health
US7953937B2 (en) * 2005-09-30 2011-05-31 Cleversafe, Inc. Systems, methods, and apparatus for subdividing data for storage in a dispersed data storage grid
US11620185B2 (en) 2005-09-30 2023-04-04 Pure Storage, Inc. Integrity processing in a dispersed storage network
US11221917B1 (en) 2005-09-30 2022-01-11 Pure Storage, Inc. Integrity processing in a dispersed storage network
US8012542B2 (en) * 2005-12-30 2011-09-06 E.I. Du Pont De Nemours And Company Fluoropolymer coating compositions containing adhesive polymers and substrate coating process
US7506200B2 (en) * 2006-01-25 2009-03-17 International Business Machines Corporation Apparatus and method to reconfigure a storage array disposed in a data storage system
US20090055451A1 (en) * 2007-08-17 2009-02-26 Clay Andre Reimer Systems and Methods For Providing Redundant Data Storage
US9697171B2 (en) 2007-10-09 2017-07-04 Internaitonal Business Machines Corporation Multi-writer revision synchronization in a dispersed storage network
US8185614B2 (en) * 2007-10-09 2012-05-22 Cleversafe, Inc. Systems, methods, and apparatus for identifying accessible dispersed digital storage vaults utilizing a centralized registry
US8478865B2 (en) * 2007-10-09 2013-07-02 Cleversafe, Inc. Systems, methods, and apparatus for matching a connection request with a network interface adapted for use with a dispersed data storage network
US9888076B2 (en) 2007-10-09 2018-02-06 International Business Machines Corporation Encoded data slice caching in a distributed storage network
US8572429B2 (en) * 2007-10-09 2013-10-29 Cleversafe, Inc. Optimistic data writing in a dispersed storage network
US8965956B2 (en) 2007-10-09 2015-02-24 Cleversafe, Inc. Integrated client for use with a dispersed data storage network
US8549351B2 (en) * 2007-10-09 2013-10-01 Cleversafe, Inc. Pessimistic data reading in a dispersed storage network
US8533256B2 (en) * 2007-10-09 2013-09-10 Cleversafe, Inc. Object interface to a dispersed data storage network
US9959076B2 (en) 2007-10-09 2018-05-01 International Business Machines Corporation Optimized disk load distribution
US8819179B2 (en) * 2007-10-09 2014-08-26 Cleversafe, Inc. Data revision synchronization in a dispersed storage network
US10027478B2 (en) 2007-10-09 2018-07-17 International Business Machines Corporation Differential key backup
US8799535B2 (en) * 2008-01-11 2014-08-05 Akamai Technologies, Inc. Storage of data utilizing scheduling queue locations associated with different data rates
US9501355B2 (en) 2008-03-31 2016-11-22 International Business Machines Corporation Storing data and directory information in a distributed storage network
US8819011B2 (en) * 2008-07-16 2014-08-26 Cleversafe, Inc. Command line interpreter for accessing a data object stored in a distributed storage network
US8630987B2 (en) * 2008-07-16 2014-01-14 Cleversafe, Inc. System and method for accessing a data object stored in a distributed storage network
US9092294B2 (en) * 2009-04-20 2015-07-28 Cleversafe, Inc. Systems, apparatus, and methods for utilizing a reachability set to manage a network upgrade
US8819781B2 (en) * 2009-04-20 2014-08-26 Cleversafe, Inc. Management of network devices within a dispersed data storage network
US8601259B2 (en) * 2009-04-20 2013-12-03 Cleversafe, Inc. Securing data in a dispersed storage network using security sentinel value
US10395054B2 (en) 2011-06-06 2019-08-27 Pure Storage, Inc. Updating distributed storage network software
US10104045B2 (en) * 2009-04-20 2018-10-16 International Business Machines Corporation Verifying data security in a dispersed storage network
US10447474B2 (en) 2009-04-20 2019-10-15 Pure Storage, Inc. Dispersed data storage system data decoding and decryption
US11991280B2 (en) 2009-04-20 2024-05-21 Pure Storage, Inc. Randomized transforms in a dispersed data storage system
US8504847B2 (en) * 2009-04-20 2013-08-06 Cleversafe, Inc. Securing data in a dispersed storage network using shared secret slices
US9483656B2 (en) 2009-04-20 2016-11-01 International Business Machines Corporation Efficient and secure data storage utilizing a dispersed data storage system
US8744071B2 (en) * 2009-04-20 2014-06-03 Cleversafe, Inc. Dispersed data storage system data encryption and encoding
US8656187B2 (en) * 2009-04-20 2014-02-18 Cleversafe, Inc. Dispersed storage secure data decoding
US11868498B1 (en) 2009-04-20 2024-01-09 Pure Storage, Inc. Storage integrity processing in a storage network
JP5404804B2 (ja) * 2009-05-25 2014-02-05 株式会社日立製作所 ストレージサブシステム
US10230692B2 (en) * 2009-06-30 2019-03-12 International Business Machines Corporation Distributed storage processing module
US8489915B2 (en) * 2009-07-30 2013-07-16 Cleversafe, Inc. Method and apparatus for storage integrity processing based on error types in a dispersed storage network
US9009575B2 (en) 2009-07-30 2015-04-14 Cleversafe, Inc. Rebuilding a data revision in a dispersed storage network
US9558059B2 (en) 2009-07-30 2017-01-31 International Business Machines Corporation Detecting data requiring rebuilding in a dispersed storage network
US10108492B2 (en) 2009-07-30 2018-10-23 International Business Machines Corporation Rebuilding data stored in a dispersed storage network
US9208025B2 (en) 2009-07-30 2015-12-08 Cleversafe, Inc. Virtual memory mapping in a dispersed storage network
US9207870B2 (en) 2009-07-30 2015-12-08 Cleversafe, Inc. Allocating storage units in a dispersed storage network
US8275744B2 (en) * 2009-07-30 2012-09-25 Cleversafe, Inc. Dispersed storage network virtual address fields
US8706980B2 (en) * 2009-07-30 2014-04-22 Cleversafe, Inc. Method and apparatus for slice partial rebuilding in a dispersed storage network
US8527838B2 (en) 2009-07-31 2013-09-03 Cleversafe, Inc. Memory controller utilizing an error coding dispersal function
US9167277B2 (en) * 2009-08-03 2015-10-20 Cleversafe, Inc. Dispersed storage network data manipulation
US9047217B2 (en) * 2009-08-27 2015-06-02 Cleversafe, Inc. Nested distributed storage unit and applications thereof
US9411810B2 (en) 2009-08-27 2016-08-09 International Business Machines Corporation Method and apparatus for identifying data inconsistency in a dispersed storage network
US8560855B2 (en) 2009-08-27 2013-10-15 Cleversafe, Inc. Verification of dispersed storage network access control information
US20110078343A1 (en) 2009-09-29 2011-03-31 Cleversafe, Inc. Distributed storage network including memory diversity
US8924387B2 (en) 2009-09-29 2014-12-30 Cleversafe, Inc. Social networking utilizing a dispersed storage network
US8548913B2 (en) 2009-09-29 2013-10-01 Cleversafe, Inc. Method and apparatus to secure an electronic commerce transaction
US8381025B2 (en) * 2009-09-30 2013-02-19 Cleversafe, Inc. Method and apparatus for dispersed storage memory device selection
US8402344B2 (en) * 2009-10-05 2013-03-19 Cleversafe, Inc. Method and apparatus for controlling dispersed storage of streaming data
US10757187B2 (en) 2009-10-29 2020-08-25 Pure Storage, Inc. Streaming all-or-nothing encoding with random offset support
US8291277B2 (en) * 2009-10-29 2012-10-16 Cleversafe, Inc. Data distribution utilizing unique write parameters in a dispersed storage system
US9661356B2 (en) 2009-10-29 2017-05-23 International Business Machines Corporation Distribution of unique copies of broadcast data utilizing fault-tolerant retrieval from dispersed storage
US9774678B2 (en) 2009-10-29 2017-09-26 International Business Machines Corporation Temporarily storing data in a dispersed storage network
US10389845B2 (en) 2009-10-29 2019-08-20 Pure Storage, Inc. Determining how to service requests based on several indicators
US9015431B2 (en) * 2009-10-29 2015-04-21 Cleversafe, Inc. Distributed storage revision rollbacks
US9195408B2 (en) 2009-10-30 2015-11-24 Cleversafe, Inc. Highly autonomous dispersed storage system retrieval method
US8589637B2 (en) * 2009-10-30 2013-11-19 Cleversafe, Inc. Concurrent set storage in distributed storage network
US8479078B2 (en) * 2009-10-30 2013-07-02 Cleversafe, Inc. Distributed storage network for modification of a data object
US9098376B2 (en) 2009-10-30 2015-08-04 Cleversafe, Inc. Distributed storage network for modification of a data object
US9413529B2 (en) 2009-10-30 2016-08-09 International Business Machines Corporation Distributed storage network and method for storing and retrieving encryption keys
US8572282B2 (en) 2009-10-30 2013-10-29 Cleversafe, Inc. Router assisted dispersed storage network method and apparatus
US10073737B2 (en) 2009-10-30 2018-09-11 International Business Machines Corporation Slice location identification
US9900150B2 (en) * 2009-10-30 2018-02-20 International Business Machines Corporation Dispersed storage camera device and method of operation
US9311185B2 (en) 2009-10-30 2016-04-12 Cleversafe, Inc. Dispersed storage unit solicitation method and apparatus
US8918897B2 (en) * 2009-11-24 2014-12-23 Cleversafe, Inc. Dispersed storage network data slice integrity verification
US9501349B2 (en) 2009-11-24 2016-11-22 International Business Machines Corporation Changing dispersed storage error encoding parameters
US9270298B2 (en) * 2009-11-24 2016-02-23 International Business Machines Corporation Selecting storage units to rebuild an encoded data slice
US9152514B2 (en) * 2009-11-24 2015-10-06 Cleversafe, Inc. Rebuilding a data segment in a dispersed storage network
US8621268B2 (en) * 2009-11-25 2013-12-31 Cleversafe, Inc. Write threshold utilization in a dispersed storage system
US9626248B2 (en) 2009-11-25 2017-04-18 International Business Machines Corporation Likelihood based rebuilding of missing encoded data slices
US8688907B2 (en) * 2009-11-25 2014-04-01 Cleversafe, Inc. Large scale subscription based dispersed storage network
US9996548B2 (en) 2009-11-25 2018-06-12 International Business Machines Corporation Dispersed storage using localized peer-to-peer capable wireless devices in a peer-to-peer or femto cell supported carrier served fashion
US9489264B2 (en) 2009-11-25 2016-11-08 International Business Machines Corporation Storing an encoded data slice as a set of sub-slices
US9672109B2 (en) 2009-11-25 2017-06-06 International Business Machines Corporation Adaptive dispersed storage network (DSN) and system
US8527807B2 (en) * 2009-11-25 2013-09-03 Cleversafe, Inc. Localized dispersed storage memory system
US10015141B2 (en) 2009-11-25 2018-07-03 International Business Machines Corporation Dispersed data storage in a VPN group of devices
US9836352B2 (en) 2009-11-25 2017-12-05 International Business Machines Corporation Detecting a utilization imbalance between dispersed storage network storage units
US8819452B2 (en) * 2009-11-25 2014-08-26 Cleversafe, Inc. Efficient storage of encrypted data in a dispersed storage network
US9330241B2 (en) 2009-12-29 2016-05-03 International Business Machines Corporation Applying digital rights management to multi-media file playback
US9152489B2 (en) 2009-12-29 2015-10-06 Cleversafe, Inc. Revision synchronization of a dispersed storage network
US10237281B2 (en) 2009-12-29 2019-03-19 International Business Machines Corporation Access policy updates in a dispersed storage network
US9507735B2 (en) 2009-12-29 2016-11-29 International Business Machines Corporation Digital content retrieval utilizing dispersed storage
US8990585B2 (en) * 2009-12-29 2015-03-24 Cleversafe, Inc. Time based dispersed storage access
US10148788B2 (en) 2009-12-29 2018-12-04 International Business Machines Corporation Method for providing schedulers in a distributed storage network
US9305597B2 (en) 2009-12-29 2016-04-05 Cleversafe, Inc. Accessing stored multi-media content based on a subscription priority level
US10031669B2 (en) 2009-12-29 2018-07-24 International Business Machines Corporation Scheduling migration related traffic to be non-disruptive and performant
US10133632B2 (en) 2009-12-29 2018-11-20 International Business Machines Corporation Determining completion of migration in a dispersed storage network
US9922063B2 (en) 2009-12-29 2018-03-20 International Business Machines Corporation Secure storage of secret data in a dispersed storage network
US8352831B2 (en) * 2009-12-29 2013-01-08 Cleversafe, Inc. Digital content distribution utilizing dispersed storage
US9672108B2 (en) 2009-12-29 2017-06-06 International Business Machines Corporation Dispersed storage network (DSN) and system with improved security
US12120127B1 (en) 2009-12-29 2024-10-15 Pure Storage, Inc. Storage of data objects in a storage network
US10289505B2 (en) 2009-12-29 2019-05-14 International Business Machines Corporation Dispersed multi-media content for a centralized digital video storage system
US10067831B2 (en) 2009-12-29 2018-09-04 International Business Machines Corporation Slice migration in a dispersed storage network
US10158648B2 (en) 2009-12-29 2018-12-18 International Business Machines Corporation Policy-based access in a dispersed storage network
US9866595B2 (en) 2009-12-29 2018-01-09 International Busines Machines Corporation Policy based slice deletion in a dispersed storage network
US9798467B2 (en) 2009-12-29 2017-10-24 International Business Machines Corporation Security checks for proxied requests
US20180335967A1 (en) 2009-12-29 2018-11-22 International Business Machines Corporation User customizable data processing plan in a dispersed storage network
US8762343B2 (en) 2009-12-29 2014-06-24 Cleversafe, Inc. Dispersed storage of software
US10372686B2 (en) 2009-12-29 2019-08-06 International Business Machines Corporation Policy-based storage in a dispersed storage network
US9369526B2 (en) 2009-12-29 2016-06-14 International Business Machines Corporation Distributed storage time synchronization based on retrieval delay
US10001923B2 (en) 2009-12-29 2018-06-19 International Business Machines Corporation Generation collapse
US8468368B2 (en) * 2009-12-29 2013-06-18 Cleversafe, Inc. Data encryption parameter dispersal
US9413393B2 (en) 2009-12-29 2016-08-09 International Business Machines Corporation Encoding multi-media content for a centralized digital video storage system
US9727266B2 (en) 2009-12-29 2017-08-08 International Business Machines Corporation Selecting storage units in a dispersed storage network
US9760440B2 (en) 2010-01-28 2017-09-12 International Business Machines Corporation Site-based namespace allocation
US11301592B2 (en) 2010-01-28 2022-04-12 Pure Storage, Inc. Distributed storage with data obfuscation and method for use therewith
US8954667B2 (en) * 2010-01-28 2015-02-10 Cleversafe, Inc. Data migration in a dispersed storage network
US9201732B2 (en) 2010-01-28 2015-12-01 Cleversafe, Inc. Selective activation of memory to retrieve data in a dispersed storage network
US8522113B2 (en) * 2010-01-28 2013-08-27 Cleversafe, Inc. Selecting storage facilities and dispersal parameters in a dispersed storage network
US9043548B2 (en) 2010-01-28 2015-05-26 Cleversafe, Inc. Streaming content storage
US8918674B2 (en) 2010-01-28 2014-12-23 Cleversafe, Inc. Directory file system in a dispersed storage network
US8959366B2 (en) 2010-01-28 2015-02-17 Cleversafe, Inc. De-sequencing encoded data slices
US10216647B2 (en) 2010-02-27 2019-02-26 International Business Machines Corporation Compacting dispersed storage space
US8725940B2 (en) * 2010-02-27 2014-05-13 Cleversafe, Inc. Distributedly storing raid data in a raid memory and a dispersed storage network memory
US9135115B2 (en) 2010-02-27 2015-09-15 Cleversafe, Inc. Storing data in multiple formats including a dispersed storage format
US11429486B1 (en) 2010-02-27 2022-08-30 Pure Storage, Inc. Rebuilding data via locally decodable redundancy in a vast storage network
US9606867B2 (en) 2014-06-05 2017-03-28 International Business Machines Corporation Maintaining data storage in accordance with an access metric
US10268374B2 (en) 2010-02-27 2019-04-23 International Business Machines Corporation Redundant array of independent discs and dispersed storage network system re-director
US20180365105A1 (en) 2014-06-05 2018-12-20 International Business Machines Corporation Establishing an operation execution schedule in a dispersed storage network
US10324791B2 (en) 2010-11-01 2019-06-18 International Business Machines Corporation Selectable parallel processing of dispersed storage error encoding
US10007575B2 (en) 2010-02-27 2018-06-26 International Business Machines Corporation Alternative multiple memory format storage in a storage network
US8281182B2 (en) 2010-03-12 2012-10-02 Cleversafe, Inc. Dispersed storage unit selection
US8578205B2 (en) * 2010-03-15 2013-11-05 Cleversafe, Inc. Requesting cloud data storage
US9229824B2 (en) 2010-03-16 2016-01-05 International Business Machines Corporation Caching rebuilt encoded data slices in a dispersed storage network
US8938013B2 (en) * 2010-03-16 2015-01-20 Cleversafe, Inc. Dispersal of priority data in a dispersed storage network
US9170884B2 (en) 2010-03-16 2015-10-27 Cleversafe, Inc. Utilizing cached encoded data slices in a dispersed storage network
US20110238909A1 (en) * 2010-03-29 2011-09-29 Pankaj Kumar Multicasting Write Requests To Multiple Storage Controllers
US10956292B1 (en) 2010-04-26 2021-03-23 Pure Storage, Inc. Utilizing integrity information for data retrieval in a vast storage system
US9047218B2 (en) 2010-04-26 2015-06-02 Cleversafe, Inc. Dispersed storage network slice name verification
US9606858B2 (en) 2010-04-26 2017-03-28 International Business Machines Corporation Temporarily storing an encoded data slice
US9092386B2 (en) 2010-04-26 2015-07-28 Cleversafe, Inc. Indicating an error within a dispersed storage network
US9898373B2 (en) 2010-04-26 2018-02-20 International Business Machines Corporation Prioritizing rebuilding of stored data in a dispersed storage network
US10447767B2 (en) 2010-04-26 2019-10-15 Pure Storage, Inc. Resolving a performance issue within a dispersed storage network
US8938552B2 (en) 2010-08-02 2015-01-20 Cleversafe, Inc. Resolving a protocol issue within a dispersed storage network
US8914669B2 (en) 2010-04-26 2014-12-16 Cleversafe, Inc. Secure rebuilding of an encoded data slice in a dispersed storage network
US9495117B2 (en) 2010-04-26 2016-11-15 International Business Machines Corporation Storing data in a dispersed storage network
US8625635B2 (en) 2010-04-26 2014-01-07 Cleversafe, Inc. Dispersed storage network frame protocol header
US8707088B2 (en) 2010-05-19 2014-04-22 Cleversafe, Inc. Reconfiguring data storage in multiple dispersed storage networks
US10193689B2 (en) 2010-05-19 2019-01-29 International Business Machines Corporation Storing access information in a dispersed storage network
US10911230B2 (en) 2010-05-19 2021-02-02 Pure Storage, Inc. Securely activating functionality of a computing device in a dispersed storage network
US8621580B2 (en) 2010-05-19 2013-12-31 Cleversafe, Inc. Retrieving access information in a dispersed storage network
US10353774B2 (en) 2015-10-30 2019-07-16 International Business Machines Corporation Utilizing storage unit latency data in a dispersed storage network
US8861727B2 (en) 2010-05-19 2014-10-14 Cleversafe, Inc. Storage of sensitive data in a dispersed storage network
US11740972B1 (en) 2010-05-19 2023-08-29 Pure Storage, Inc. Migrating data in a vast storage network
US8909858B2 (en) 2010-06-09 2014-12-09 Cleversafe, Inc. Storing encoded data slices in a dispersed storage network
US8555142B2 (en) 2010-06-22 2013-10-08 Cleversafe, Inc. Verifying integrity of data stored in a dispersed storage memory
US8892598B2 (en) 2010-06-22 2014-11-18 Cleversafe, Inc. Coordinated retrieval of data from a dispersed storage network
US9077734B2 (en) 2010-08-02 2015-07-07 Cleversafe, Inc. Authentication of devices of a dispersed storage network
US8627114B2 (en) 2010-08-02 2014-01-07 Cleversafe, Inc. Authenticating a data access request to a dispersed storage network
US9063968B2 (en) 2010-08-02 2015-06-23 Cleversafe, Inc. Identifying a compromised encoded data slice
US20190095101A1 (en) 2010-08-02 2019-03-28 International Business Machines Corporation Authenticating a credential in a dispersed storage network
US10162524B2 (en) 2010-08-02 2018-12-25 International Business Machines Corporation Determining whether to compress a data segment in a dispersed storage network
US10255135B2 (en) 2010-08-25 2019-04-09 International Business Machines Corporation Method and apparatus for non-interactive information dispersal
US9940195B2 (en) 2010-08-25 2018-04-10 International Business Machines Corporation Encryption of slice partials
US8904226B2 (en) 2010-08-26 2014-12-02 Cleversafe, Inc. Migrating stored copies of a file to stored encoded data slices
US9571230B2 (en) 2010-10-06 2017-02-14 International Business Machines Corporation Adjusting routing of data within a network path
US9112535B2 (en) 2010-10-06 2015-08-18 Cleversafe, Inc. Data transmission utilizing partitioning and dispersed storage error encoding
US10970168B2 (en) 2010-10-06 2021-04-06 Pure Storage, Inc. Adjusting dispersed storage error encoding parameters based on path performance
US9843412B2 (en) 2010-10-06 2017-12-12 International Business Machines Corporation Optimizing routing of data across a communications network
US10298957B2 (en) 2010-10-06 2019-05-21 International Business Machines Corporation Content-based encoding in a multiple routing path communications system
US9116831B2 (en) 2010-10-06 2015-08-25 Cleversafe, Inc. Correcting an errant encoded data slice
US10768833B2 (en) 2010-11-01 2020-09-08 Pure Storage, Inc. Object dispersal load balancing
US9015499B2 (en) 2010-11-01 2015-04-21 Cleversafe, Inc. Verifying data integrity utilizing dispersed storage
US10289318B2 (en) 2010-11-01 2019-05-14 International Business Machines Corporation Adjusting optimistic writes in a dispersed storage network
US10805042B2 (en) 2010-11-01 2020-10-13 Pure Storage, Inc. Creating transmission data slices for use in a dispersed storage network
US8707105B2 (en) 2010-11-01 2014-04-22 Cleversafe, Inc. Updating a set of memory devices in a dispersed storage network
US10082970B2 (en) 2010-11-01 2018-09-25 International Business Machines Corporation Storing an effective dynamic width of encoded data slices
US10146645B2 (en) 2010-11-01 2018-12-04 International Business Machines Corporation Multiple memory format storage in a storage network
US8627065B2 (en) 2010-11-09 2014-01-07 Cleversafe, Inc. Validating a certificate chain in a dispersed storage network
US9590838B2 (en) 2010-11-09 2017-03-07 International Business Machines Corporation Transferring data of a dispersed storage network
US10372350B2 (en) 2010-11-29 2019-08-06 Pure Storage, Inc. Shared ownership of namespace ranges
US9483398B2 (en) 2010-11-29 2016-11-01 International Business Machines Corporation Partitioning data for storage in a dispersed storage network
US11789631B2 (en) 2010-11-29 2023-10-17 Pure Storage, Inc. Utilizing metadata storage trees in a vast storage network
US10922179B2 (en) 2010-11-29 2021-02-16 Pure Storage, Inc. Post rebuild verification
US11307930B1 (en) 2010-11-29 2022-04-19 Pure Storage, Inc. Optimized selection of participants in distributed data rebuild/verification
US10802763B2 (en) 2010-11-29 2020-10-13 Pure Storage, Inc. Remote storage verification
US9454431B2 (en) 2010-11-29 2016-09-27 International Business Machines Corporation Memory selection for slice storage in a dispersed storage network
US8892845B2 (en) 2010-12-22 2014-11-18 Cleversafe, Inc. Segmenting data for storage in a dispersed storage network
US8897443B2 (en) 2010-12-27 2014-11-25 Cleversafe, Inc. Watermarking slices stored in a dispersed storage network
US8688949B2 (en) 2011-02-01 2014-04-01 Cleversafe, Inc. Modifying data storage in response to detection of a memory system imbalance
US10402268B2 (en) 2011-02-01 2019-09-03 Pure Storage, Inc. Utilizing a dispersed storage network access token module to acquire digital content from a digital content provider
US9658911B2 (en) 2011-03-02 2017-05-23 International Business Machines Corporation Selecting a directory of a dispersed storage network
US8868695B2 (en) 2011-03-02 2014-10-21 Cleversafe, Inc. Configuring a generic computing device utilizing specific computing device operation information
US8874990B2 (en) 2011-04-01 2014-10-28 Cleversafe, Inc. Pre-fetching data segments stored in a dispersed storage network
US10298684B2 (en) 2011-04-01 2019-05-21 International Business Machines Corporation Adaptive replication of dispersed data to improve data access performance
US8843804B2 (en) 2011-04-01 2014-09-23 Cleversafe, Inc. Adjusting a dispersal parameter of dispersedly stored data
US11418580B2 (en) 2011-04-01 2022-08-16 Pure Storage, Inc. Selective generation of secure signatures in a distributed storage network
US9219604B2 (en) 2011-05-09 2015-12-22 Cleversafe, Inc. Generating an encrypted message for storage
US9298550B2 (en) 2011-05-09 2016-03-29 Cleversafe, Inc. Assigning a dispersed storage network address range in a maintenance free storage container
US20170192684A1 (en) 2011-05-09 2017-07-06 International Business Machines Corporation Auditing a transaction in a dispersed storage network
US10452836B2 (en) 2011-05-09 2019-10-22 Pure Storage, Inc. Retrieving a hypertext markup language file from a dispersed storage network memory
US8954787B2 (en) 2011-05-09 2015-02-10 Cleversafe, Inc. Establishing trust in a maintenance free storage container
US10061650B2 (en) 2011-06-06 2018-08-28 International Business Machines Corporation Priority based rebuilding
US10042709B2 (en) 2011-06-06 2018-08-07 International Business Machines Corporation Rebuild prioritization during a plurality of concurrent data object write operations
US9400714B2 (en) 2011-06-06 2016-07-26 International Business Machines Corporation Wirelessly communicating a data file
US8762479B2 (en) 2011-06-06 2014-06-24 Cleversafe, Inc. Distributing multi-media content to a plurality of potential accessing devices
US10949301B2 (en) 2011-06-06 2021-03-16 Pure Storage, Inc. Pre-positioning pre-stored content in a content distribution system
US20120317356A1 (en) * 2011-06-09 2012-12-13 Advanced Micro Devices, Inc. Systems and methods for sharing memory between a plurality of processors
US8694545B2 (en) 2011-07-06 2014-04-08 Cleversafe, Inc. Storing data and metadata in a distributed storage network
US8966311B2 (en) 2011-07-06 2015-02-24 Cleversafe, Inc. Maintenance free storage container storage module access
US11016702B2 (en) 2011-07-27 2021-05-25 Pure Storage, Inc. Hierarchical event tree
US10678619B2 (en) 2011-07-27 2020-06-09 Pure Storage, Inc. Unified logs and device statistics
US12099752B2 (en) 2011-07-27 2024-09-24 Pure Storage, Inc. Error prediction based on correlation using event records
EP2737431A4 (en) 2011-07-27 2015-03-25 Cleversafe Inc GENERATION OF DISTRIBUTED STORAGE NETWORK EVENT RECORDS
US10120756B2 (en) 2011-08-17 2018-11-06 International Business Machines Corporation Audit object generation in a dispersed storage network
US9229823B2 (en) 2011-08-17 2016-01-05 International Business Machines Corporation Storage and retrieval of dispersed storage network access information
US10454678B2 (en) 2011-08-17 2019-10-22 Pure Storage, Inc. Accesor-based audit trails
US9971802B2 (en) 2011-08-17 2018-05-15 International Business Machines Corporation Audit record transformation in a dispersed storage network
US20190179696A1 (en) 2011-09-06 2019-06-13 International Business Machines Corporation Demultiplexing decoded data streams in a distributed storage network
US8930649B2 (en) 2011-09-06 2015-01-06 Cleversafe, Inc. Concurrent coding of data streams
US11907060B2 (en) 2011-09-06 2024-02-20 Pure Storage, Inc. Coding of data streams in a vast storage network
US10235237B2 (en) 2011-09-06 2019-03-19 Intertnational Business Machines Corporation Decoding data streams in a distributed storage network
US8677214B2 (en) 2011-10-04 2014-03-18 Cleversafe, Inc. Encoding data utilizing a zero information gain function
US8555130B2 (en) 2011-10-04 2013-10-08 Cleversafe, Inc. Storing encoded data slices in a dispersed storage unit
US9274864B2 (en) 2011-10-04 2016-03-01 International Business Machines Corporation Accessing large amounts of data in a dispersed storage network
US9304843B2 (en) 2011-11-01 2016-04-05 Cleversafe, Inc. Highly secure method for accessing a dispersed storage network
US10496500B2 (en) 2011-11-01 2019-12-03 Pure Storage, Inc. Preemptively reading extra encoded data slices
US11329830B1 (en) 2011-11-01 2022-05-10 Pure Storage, Inc. Dispersed credentials
US10365969B2 (en) 2011-11-01 2019-07-30 International Business Machines Corporation Multiple wireless communication systems stream slices based on geography
US10437678B2 (en) 2011-11-01 2019-10-08 Pure Storage, Inc. Updating an encoded data slice
US8627066B2 (en) 2011-11-03 2014-01-07 Cleversafe, Inc. Processing a dispersed storage network access request utilizing certificate chain validation information
US10318445B2 (en) 2011-11-28 2019-06-11 International Business Machines Corporation Priority level adaptation in a dispersed storage network
US10469578B2 (en) 2011-11-28 2019-11-05 Pure Storage, Inc. Prioritization of messages of a dispersed storage network
US8848906B2 (en) 2011-11-28 2014-09-30 Cleversafe, Inc. Encrypting data for storage in a dispersed storage network
US10055283B2 (en) 2011-11-28 2018-08-21 International Business Machines Corporation Securely distributing random keys in a dispersed storage network
US10387071B2 (en) 2011-11-28 2019-08-20 Pure Storage, Inc. On-the-fly cancellation of unnecessary read requests
US11474958B1 (en) 2011-11-28 2022-10-18 Pure Storage, Inc. Generating and queuing system messages with priorities in a storage network
US10558592B2 (en) 2011-11-28 2020-02-11 Pure Storage, Inc. Priority level adaptation in a dispersed storage network
US10977194B2 (en) 2011-11-28 2021-04-13 Pure Storage, Inc. Securely storing random keys in a dispersed storage network
US10146621B2 (en) 2011-12-12 2018-12-04 International Business Machines Corporation Chaining computes in a distributed computing system
US20130238900A1 (en) 2011-12-12 2013-09-12 Cleversafe, Inc. Dispersed storage network secure hierarchical file directory
US9817701B2 (en) 2011-12-12 2017-11-14 International Business Machines Corporation Threshold computing in a distributed computing system
US9674155B2 (en) 2011-12-12 2017-06-06 International Business Machines Corporation Encrypting segmented data in a distributed computing system
US10104168B2 (en) 2011-12-12 2018-10-16 International Business Machines Corporation Method for managing throughput in a distributed storage network
US10176045B2 (en) 2011-12-12 2019-01-08 International Business Machines Corporation Internet based shared memory in a distributed computing system
US9141468B2 (en) 2011-12-12 2015-09-22 Cleversafe, Inc. Managing memory utilization in a distributed storage and task network
US10346218B2 (en) 2011-12-12 2019-07-09 International Business Machines Corporation Partial task allocation in a dispersed storage network
US10348640B2 (en) 2011-12-12 2019-07-09 International Business Machines Corporation Partial task execution in a dispersed storage network
US10666596B2 (en) 2011-12-12 2020-05-26 Pure Storage, Inc. Messaging via a shared memory of a distributed computing system
US10360106B2 (en) 2011-12-12 2019-07-23 International Business Machines Corporation Throttled real-time writes
US10671585B2 (en) 2012-01-31 2020-06-02 Pure Storage, Inc. Storing indexed data to a dispersed storage network
US20180083930A1 (en) 2011-12-12 2018-03-22 International Business Machines Corporation Reads for dispersed computation jobs
US9584359B2 (en) 2011-12-12 2017-02-28 International Business Machines Corporation Distributed storage and computing of interim data
US9298548B2 (en) 2011-12-12 2016-03-29 Cleversafe, Inc. Distributed computing in a distributed storage and task network
US9009567B2 (en) 2011-12-12 2015-04-14 Cleversafe, Inc. Encrypting distributed computing data
US9507786B2 (en) 2012-01-31 2016-11-29 International Business Machines Corporation Retrieving data utilizing a distributed index
US9430286B2 (en) 2011-12-12 2016-08-30 International Business Machines Corporation Authorizing distributed task processing in a distributed storage network
CN102411516A (zh) * 2011-12-13 2012-04-11 云海创想信息技术（天津）有限公司 一种raid5数据重建的方法及装置
WO2013095571A1 (en) * 2011-12-22 2013-06-27 Intel Corporation Method and apparatus to tunnel messages to storage devices by overloading read/write commands
US9270657B2 (en) 2011-12-22 2016-02-23 Intel Corporation Activation and monetization of features built into storage subsystems using a trusted connect service back end infrastructure
US9465861B2 (en) 2012-01-31 2016-10-11 International Business Machines Corporation Retrieving indexed data from a dispersed storage network
US9891995B2 (en) 2012-01-31 2018-02-13 International Business Machines Corporation Cooperative decentralized rebuild scanning
US9146810B2 (en) 2012-01-31 2015-09-29 Cleversafe, Inc. Identifying a potentially compromised encoded data slice
US9203901B2 (en) 2012-01-31 2015-12-01 Cleversafe, Inc. Efficiently storing data in a dispersed storage network
US11232093B2 (en) 2012-03-02 2022-01-25 Pure Storage, Inc. Slice migration in a dispersed storage network
US10402393B2 (en) 2012-03-02 2019-09-03 Pure Storage, Inc. Slice migration in a dispersed storage network
US8935256B2 (en) 2012-03-02 2015-01-13 Cleversafe, Inc. Expanding a hierarchical dispersed storage index
US9588994B2 (en) 2012-03-02 2017-03-07 International Business Machines Corporation Transferring task execution in a distributed storage and task network
US10157051B2 (en) 2012-03-02 2018-12-18 International Business Machines Corporation Upgrading devices in a dispersed storage network
US10621044B2 (en) 2012-04-25 2020-04-14 Pure Storage, Inc. Mapping slice groupings in a dispersed storage network
US9380032B2 (en) 2012-04-25 2016-06-28 International Business Machines Corporation Encrypting data for storage in a dispersed storage network
US10795766B2 (en) 2012-04-25 2020-10-06 Pure Storage, Inc. Mapping slice groupings in a dispersed storage network
US9613052B2 (en) 2012-06-05 2017-04-04 International Business Machines Corporation Establishing trust within a cloud computing system
US10447471B2 (en) 2012-06-05 2019-10-15 Pure Storage, Inc. Systematic secret sharing
US9164841B2 (en) 2012-06-05 2015-10-20 Cleversafe, Inc. Resolution of a storage error in a dispersed storage network
US10073638B2 (en) 2012-06-05 2018-09-11 International Business Machines Corporation Automatic namespace ordering determination
US10474395B2 (en) 2012-06-05 2019-11-12 Pure Storage, Inc. Abstracting namespace mapping in a dispersed storage network through multiple hierarchies
US10002047B2 (en) 2012-06-05 2018-06-19 International Business Machines Corporation Read-if-not-revision-equals protocol message
US9292212B2 (en) 2012-06-25 2016-03-22 International Business Machines Corporation Detecting storage errors in a dispersed storage network
US10430276B2 (en) 2012-06-25 2019-10-01 Pure Storage, Inc. Optimal orderings of processing unit priorities in a dispersed storage network
US11093327B1 (en) 2012-06-25 2021-08-17 Pure Storage, Inc. Failure abatement approach for failed storage units common to multiple vaults
US20180336097A1 (en) 2012-06-25 2018-11-22 International Business Machines Corporation Namespace affinity and failover for processing units in a dispersed storage network
US10114697B2 (en) 2012-06-25 2018-10-30 International Business Machines Corporation Large object parallel writing
US9110833B2 (en) 2012-06-25 2015-08-18 Cleversafe, Inc. Non-temporarily storing temporarily stored data in a dispersed storage network
US10157011B2 (en) 2012-06-25 2018-12-18 International Business Machines Corporation Temporary suspension of vault access
US10120574B2 (en) 2012-06-25 2018-11-06 International Business Machines Corporation Reversible data modifications within DS units
US9258177B2 (en) 2012-08-02 2016-02-09 International Business Machines Corporation Storing a data stream in a set of storage devices
US10651975B2 (en) 2012-08-02 2020-05-12 Pure Storage, Inc. Forwarding data amongst cooperative DSTN processing units of a massive data ingestion system
US12105588B2 (en) 2012-08-31 2024-10-01 Pure Storage, Inc. Adjusting error encoding parameters for writing encoded data slices
US11360851B2 (en) 2012-08-31 2022-06-14 Pure Storage, Inc. Duplicating authentication information between connections
US9875158B2 (en) 2012-08-31 2018-01-23 International Business Machines Corporation Slice storage in a dispersed storage network
US10331518B2 (en) 2012-08-31 2019-06-25 International Business Machines Corporation Encoding data in a dispersed storage network
US10409679B2 (en) 2012-08-31 2019-09-10 Pure Storage, Inc. Migrating data slices in a dispersed storage network
US10409678B2 (en) 2012-08-31 2019-09-10 Pure Storage, Inc. Self-optimizing read-ahead
US10241863B2 (en) 2012-08-31 2019-03-26 International Business Machines Corporation Slice rebuilding in a dispersed storage network
US9154298B2 (en) 2012-08-31 2015-10-06 Cleversafe, Inc. Securely storing data in a dispersed storage network
US10402423B2 (en) 2012-09-13 2019-09-03 Pure Storage, Inc. Sliding windows for batching index updates
US10417253B2 (en) 2012-09-13 2019-09-17 Pure Storage, Inc. Multi-level data storage in a dispersed storage network
US10057351B2 (en) 2012-09-13 2018-08-21 International Business Machines Corporation Modifying information dispersal algorithm configurations in a dispersed storage network
US9483539B2 (en) 2012-09-13 2016-11-01 International Business Machines Corporation Updating local data utilizing a distributed storage network
US10331698B2 (en) 2012-09-13 2019-06-25 International Business Machines Corporation Rebuilding data in a dispersed storage network
US10318549B2 (en) 2012-09-13 2019-06-11 International Business Machines Corporation Batching modifications to nodes in a dispersed index
US8972645B2 (en) * 2012-09-19 2015-03-03 Hewlett-Packard Development Company, L.P. Request sent to storage device based on moving average
US10331519B2 (en) 2012-10-08 2019-06-25 International Business Machines Corporation Application of secret sharing schemes at multiple levels of a dispersed storage network
US10606700B2 (en) 2012-10-08 2020-03-31 Pure Storage, Inc. Enhanced dispersed storage error encoding using multiple encoding layers
US10127111B2 (en) 2012-10-08 2018-11-13 International Business Machines Corporation Client provided request prioritization hints
US9503513B2 (en) 2012-10-08 2016-11-22 International Business Machines Corporation Robust transmission of data utilizing encoded data slices
US9936020B2 (en) 2012-10-30 2018-04-03 International Business Machines Corporation Access control of data in a dispersed storage network
US9311179B2 (en) 2012-10-30 2016-04-12 Cleversafe, Inc. Threshold decoding of data based on trust levels
US9274971B2 (en) * 2012-11-27 2016-03-01 International Business Machines Corporation Low latency data exchange
US9811533B2 (en) 2012-12-05 2017-11-07 International Business Machines Corporation Accessing distributed computing functions in a distributed computing system
US10558621B2 (en) 2012-12-05 2020-02-11 Pure Storage, Inc. Lock stealing writes for improved reliability
US10587691B2 (en) 2012-12-05 2020-03-10 Pure Storage, Inc. Impatient writes
US9521197B2 (en) 2012-12-05 2016-12-13 International Business Machines Corporation Utilizing data object storage tracking in a dispersed storage network
US10204009B2 (en) 2013-01-04 2019-02-12 International Business Machines Corporation Prioritized rebuilds using dispersed indices
US11416340B1 (en) 2013-01-04 2022-08-16 Pure Storage, Inc. Storage system with multiple storage types in a vast storage network
US10423491B2 (en) 2013-01-04 2019-09-24 Pure Storage, Inc. Preventing multiple round trips when writing to target widths
US10229002B2 (en) 2013-01-04 2019-03-12 International Business Machines Corporation Process to migrate named objects to a dispersed or distributed storage network (DSN)
US9311187B2 (en) 2013-01-04 2016-04-12 Cleversafe, Inc. Achieving storage compliance in a dispersed storage network
US10642992B2 (en) 2013-01-04 2020-05-05 Pure Storage, Inc. Password augmented all-or-nothin transform
US10013203B2 (en) 2013-01-04 2018-07-03 International Business Machines Corporation Achieving storage compliance in a dispersed storage network
US9558067B2 (en) 2013-01-04 2017-01-31 International Business Machines Corporation Mapping storage of data in a dispersed storage network
US10402270B2 (en) 2013-01-04 2019-09-03 Pure Storage, Inc. Deterministically determining affinity for a source name range
US10241866B2 (en) 2013-01-04 2019-03-26 International Business Machines Corporation Allocating rebuilding queue entries in a dispersed storage network
US20190250823A1 (en) 2013-01-04 2019-08-15 International Business Machines Corporation Efficient computation of only the required slices
US10430122B2 (en) 2013-02-05 2019-10-01 Pure Storage, Inc. Using partial rebuilding to change information dispersal algorithm (IDA)
US10310763B2 (en) 2013-02-05 2019-06-04 International Business Machines Corporation Forming a distributed storage network memory without namespace aware distributed storage units
US10268554B2 (en) 2013-02-05 2019-04-23 International Business Machines Corporation Using dispersed computation to change dispersal characteristics
US10664360B2 (en) 2013-02-05 2020-05-26 Pure Storage, Inc. Identifying additional resources to accelerate rebuildling
US10055441B2 (en) 2013-02-05 2018-08-21 International Business Machines Corporation Updating shared group information in a dispersed storage network
US10621021B2 (en) 2013-02-05 2020-04-14 Pure Storage, Inc. Using dispersed data structures to point to slice or date source replicas
US9043499B2 (en) 2013-02-05 2015-05-26 Cleversafe, Inc. Modifying a dispersed storage network memory data access response plan
US11036392B2 (en) 2013-02-26 2021-06-15 Pure Storage, Inc. Determining when to use convergent encryption
US9274908B2 (en) 2013-02-26 2016-03-01 International Business Machines Corporation Resolving write conflicts in a dispersed storage network
US10642489B2 (en) 2013-02-26 2020-05-05 Pure Storage, Inc. Determining when to initiate an intra-distributed storage unit rebuild vs. an inter-distributed storage unit rebuild
US10075523B2 (en) 2013-04-01 2018-09-11 International Business Machines Corporation Efficient storage of data in a dispersed storage network
US10223213B2 (en) 2013-05-03 2019-03-05 International Business Machines Corporation Salted zero expansion all or nothing transformation
US9456035B2 (en) 2013-05-03 2016-09-27 International Business Machines Corporation Storing related data in a dispersed storage network
US9405609B2 (en) 2013-05-22 2016-08-02 International Business Machines Corporation Storing data in accordance with a performance threshold
US9432341B2 (en) 2013-05-30 2016-08-30 International Business Machines Corporation Securing data in a dispersed storage network
US9424132B2 (en) 2013-05-30 2016-08-23 International Business Machines Corporation Adjusting dispersed storage network traffic due to rebuilding
US11226860B1 (en) 2013-05-30 2022-01-18 Pure Storage, Inc. Difference based rebuild list scanning
US10169369B2 (en) 2013-07-01 2019-01-01 International Business Machines Corporation Meeting storage requirements with limited storage resources
US9501360B2 (en) 2013-07-01 2016-11-22 International Business Machines Corporation Rebuilding data while reading data in a dispersed storage network
US11221916B2 (en) 2013-07-01 2022-01-11 Pure Storage, Inc. Prioritized data reconstruction in a dispersed storage network
US9652470B2 (en) 2013-07-01 2017-05-16 International Business Machines Corporation Storing data in a dispersed storage network
US12079081B2 (en) 2013-07-01 2024-09-03 Pure Storage, Inc. Prioritizing storage units for data storage operations
US10133635B2 (en) 2013-07-01 2018-11-20 International Business Machines Corporation Low-width vault in distributed storage system
US20180188964A1 (en) 2013-07-31 2018-07-05 International Business Machines Corporation Managed storage unit shutdown in a distributed storage network
US9626125B2 (en) 2013-07-31 2017-04-18 International Business Machines Corporation Accounting for data that needs to be rebuilt or deleted
US10180880B2 (en) 2013-07-31 2019-01-15 International Business Machines Corporation Adaptive rebuilding rates based on sampling and inference
US10681134B2 (en) 2013-07-31 2020-06-09 Pure Storage, Inc. Accelerated learning in adaptive rebuilding by applying observations to other samples
US9848044B2 (en) 2013-07-31 2017-12-19 International Business Machines Corporation Distributed storage network with coordinated partial task execution and methods for use therewith
US10514857B2 (en) 2013-08-29 2019-12-24 Pure Storage, Inc. Dynamic adjusting of parameters based on resource scoring
US9661074B2 (en) 2013-08-29 2017-05-23 International Business Machines Corporations Updating de-duplication tracking data for a dispersed storage network
US10484474B2 (en) 2013-08-29 2019-11-19 Pure Storage, Inc. Rotating offline DS units
US10601918B2 (en) 2013-08-29 2020-03-24 Pure Storage, Inc. Rotating inactive storage units in a distributed storage network
US10686880B2 (en) 2013-08-29 2020-06-16 Pure Storage, Inc. Dispersed storage based on range availability and methods for use therewith
US10489071B2 (en) 2013-08-29 2019-11-26 Pure Storage, Inc. Vault provisioning within dispersed or distributed storage network (DSN)
US9323630B2 (en) * 2013-09-16 2016-04-26 HGST Netherlands B.V. Enhanced data recovery from data storage devices
US9857974B2 (en) 2013-10-03 2018-01-02 International Business Machines Corporation Session execution decision
US10304096B2 (en) 2013-11-01 2019-05-28 International Business Machines Corporation Renting a pipe to a storage system
US10182115B2 (en) 2013-11-01 2019-01-15 International Business Machines Corporation Changing rebuild priority for a class of data
US9781208B2 (en) 2013-11-01 2017-10-03 International Business Machines Corporation Obtaining dispersed storage network system registry information
US9900316B2 (en) 2013-12-04 2018-02-20 International Business Machines Corporation Accessing storage units of a dispersed storage network
US11340993B2 (en) 2014-01-06 2022-05-24 Pure Storage, Inc. Deferred rebuilding with alternate storage locations
US10922181B2 (en) 2014-01-06 2021-02-16 Pure Storage, Inc. Using storage locations greater than an IDA width in a dispersed storage network
US9594639B2 (en) 2014-01-06 2017-03-14 International Business Machines Corporation Configuring storage resources of a dispersed storage network
US9552261B2 (en) 2014-01-31 2017-01-24 International Business Machines Corporation Recovering data from microslices in a dispersed storage network
US11983070B2 (en) 2014-01-31 2024-05-14 Pure Storage, Inc. Determining segmentation size in a distributed storage network
US9778987B2 (en) 2014-01-31 2017-10-03 International Business Machines Corporation Writing encoded data slices in a dispersed storage network
US10318382B2 (en) 2014-01-31 2019-06-11 International Business Machines Corporation Determining missing encoded data slices
US11204836B1 (en) 2014-01-31 2021-12-21 Pure Storage, Inc. Using trap slices for anomaly detection in a distributed storage network
US10635312B2 (en) 2014-02-26 2020-04-28 Pure Storage, Inc. Recovering data in a dispersed storage network
US9665429B2 (en) 2014-02-26 2017-05-30 International Business Machines Corporation Storage of data with verification in a dispersed storage network
US10678638B2 (en) 2014-02-26 2020-06-09 Pure Storage, Inc. Resolving write conflicts in a dispersed storage network
US10769016B2 (en) 2014-02-26 2020-09-08 Pure Storage, Inc. Storing a plurality of correlated data in a dispersed storage network
US9529834B2 (en) 2014-02-26 2016-12-27 International Business Machines Corporation Concatenating data objects for storage in a dispersed storage network
US10592109B2 (en) 2014-02-26 2020-03-17 Pure Storage, Inc. Selecting storage resources in a dispersed storage network
US10140182B2 (en) 2014-02-26 2018-11-27 International Business Machines Corporation Modifying allocation of storage resources in a dispersed storage network
US10681138B2 (en) 2014-04-02 2020-06-09 Pure Storage, Inc. Storing and retrieving multi-format content in a distributed storage network
US20190087599A1 (en) 2014-04-02 2019-03-21 International Business Machines Corporation Compressing a slice name listing in a dispersed storage network
US10015152B2 (en) 2014-04-02 2018-07-03 International Business Machines Corporation Securing data in a dispersed storage network
US20150288680A1 (en) 2014-04-02 2015-10-08 Cleversafe, Inc. Distributing registry information in a dispersed storage network
US10628245B2 (en) 2014-04-02 2020-04-21 Pure Storage, Inc. Monitoring of storage units in a dispersed storage network
US11347590B1 (en) 2014-04-02 2022-05-31 Pure Storage, Inc. Rebuilding data in a distributed storage network
US10020826B2 (en) 2014-04-02 2018-07-10 International Business Machines Corporation Generating molecular encoding information for data storage
US10761917B2 (en) 2014-04-02 2020-09-01 Pure Storage, Inc. Using global namespace addressing in a dispersed storage network
US9542239B2 (en) 2014-04-30 2017-01-10 International Business Machines Corporation Resolving write request conflicts in a dispersed storage network
US9735967B2 (en) 2014-04-30 2017-08-15 International Business Machines Corporation Self-validating request message structure and operation
US10802732B2 (en) 2014-04-30 2020-10-13 Pure Storage, Inc. Multi-level stage locality selection on a large system
US10296263B2 (en) 2014-04-30 2019-05-21 International Business Machines Corporation Dispersed bloom filter for determining presence of an object
US10394476B2 (en) 2014-04-30 2019-08-27 Pure Storage, Inc. Multi-level stage locality selection on a large system
US10152601B2 (en) 2014-06-05 2018-12-11 International Business Machines Corporation Reliably recovering stored data in a dispersed storage network
US10509577B2 (en) 2014-06-05 2019-12-17 Pure Storage, Inc. Reliable storage in a dispersed storage network
US9841925B2 (en) 2014-06-30 2017-12-12 International Business Machines Corporation Adjusting timing of storing data in a dispersed storage network
US10459797B2 (en) 2014-06-30 2019-10-29 Pure Storage, Inc. Making trade-offs between rebuild scanning and failing memory device flexibility
US9923838B2 (en) 2014-06-30 2018-03-20 International Business Machines Corporation Accessing a dispersed storage network
US11099763B1 (en) 2014-06-30 2021-08-24 Pure Storage, Inc. Migrating generational storage to a decentralized agreement protocol paradigm
US9690520B2 (en) 2014-06-30 2017-06-27 International Business Machines Corporation Recovering an encoded data slice in a dispersed storage network
US10042564B2 (en) 2014-06-30 2018-08-07 International Business Machines Corporation Accessing data while migrating storage of the data
US9838478B2 (en) 2014-06-30 2017-12-05 International Business Machines Corporation Identifying a task execution resource of a dispersed storage network
US11398988B1 (en) 2014-06-30 2022-07-26 Pure Storage, Inc. Selection of access resources in a distributed storage network
US11606431B2 (en) 2014-06-30 2023-03-14 Pure Storage, Inc. Maintaining failure independence for storage of a set of encoded data slices
US10673946B2 (en) 2014-06-30 2020-06-02 Pure Storage, Inc. Using separate weighting scores for different types of data in a decentralized agreement protocol
US10440105B2 (en) 2014-06-30 2019-10-08 Pure Storage, Inc. Using a decentralized agreement protocol to rank storage locations for target width
US10089036B2 (en) 2014-07-31 2018-10-02 International Business Machines Corporation Migrating data in a distributed storage network
US10644874B2 (en) 2014-07-31 2020-05-05 Pure Storage, Inc. Limiting brute force attacks against dispersed credentials in a distributed storage system
US10613936B2 (en) 2014-07-31 2020-04-07 Pure Storage, Inc. Fractional slices in a distributed storage system
US11728964B2 (en) 2014-07-31 2023-08-15 Pure Storage, Inc. Performance aided data migration in a distributed storage network
US11442921B1 (en) 2014-09-05 2022-09-13 Pure Storage, Inc. Data access in a dispersed storage network with consistency
US10402395B2 (en) 2014-09-05 2019-09-03 Pure Storage, Inc. Facilitating data consistency in a dispersed storage network
US10176191B2 (en) 2014-09-05 2019-01-08 International Business Machines Corporation Recovering from conflicts that emerge from eventually consistent operations
US10049120B2 (en) 2014-09-05 2018-08-14 International Business Machines Corporation Consistency based access of data in a dispersed storage network
US9591076B2 (en) 2014-09-08 2017-03-07 International Business Machines Corporation Maintaining a desired number of storage units
US10146622B2 (en) 2014-09-08 2018-12-04 International Business Machines Corporation Combining deduplication with locality for efficient and fast storage
US10268545B2 (en) 2014-09-08 2019-04-23 International Business Machines Corporation Using reinforcement learning to select a DS processing unit
US10095582B2 (en) 2014-10-29 2018-10-09 International Business Machines Corporation Partial rebuilding techniques in a dispersed storage unit
US10459792B2 (en) 2014-10-29 2019-10-29 Pure Storage, Inc. Using an eventually consistent dispersed memory to implement storage tiers
US10282135B2 (en) 2014-10-29 2019-05-07 International Business Machines Corporation Strong consistency write threshold
US10223033B2 (en) 2014-10-29 2019-03-05 International Business Machines Corporation Coordinating arrival times of data slices in a dispersed storage network
US20180101457A1 (en) 2014-10-29 2018-04-12 International Business Machines Corporation Retrying failed write operations in a dispersed storage network
US9916114B2 (en) 2014-10-29 2018-03-13 International Business Machines Corporation Deterministically sharing a plurality of processing resources
US10481833B2 (en) 2014-10-29 2019-11-19 Pure Storage, Inc. Transferring data encoding functions in a distributed storage network
US10402271B2 (en) 2014-12-02 2019-09-03 Pure Storage, Inc. Overcoming bottlenecks in zero information gain (ZIG) rebuild operations
US10503592B2 (en) 2014-12-02 2019-12-10 Pure Storage, Inc. Overcoming bottlenecks in partial and traditional rebuild operations
US9727275B2 (en) 2014-12-02 2017-08-08 International Business Machines Corporation Coordinating storage of data in dispersed storage networks
US10558527B2 (en) 2014-12-02 2020-02-11 Pure Storage, Inc. Rebuilding strategy in memory managed multi-site duplication
US10120739B2 (en) 2014-12-02 2018-11-06 International Business Machines Corporation Prioritized data rebuilding in a dispersed storage network
US10521298B2 (en) 2014-12-02 2019-12-31 Pure Storage, Inc. Temporarily storing dropped and rebuilt slices in a DSN memory
US10481832B2 (en) 2014-12-02 2019-11-19 Pure Storage, Inc. Applying a probability function to avoid storage operations for already-deleted data
KR102368071B1 (ko) 2014-12-29 2022-02-25 삼성전자주식회사 레이드 스토리지 시스템에서의 스트라이프 재구성 방법 및 이를 적용한 가비지 컬렉션 동작 방법 및 레이드 스토리지 시스템
US11604707B2 (en) 2014-12-31 2023-03-14 Pure Storage, Inc. Handling failures when synchronizing objects during a write operation
US10642687B2 (en) 2014-12-31 2020-05-05 Pure Storage, Inc. Pessimistic reads and other smart-read enhancements with synchronized vaults
US10387252B2 (en) 2014-12-31 2019-08-20 Pure Storage, Inc. Synchronously storing data in a plurality of dispersed storage networks
US10621042B2 (en) 2014-12-31 2020-04-14 Pure Storage, Inc. Vault transformation within a dispersed storage network
US10452317B2 (en) 2014-12-31 2019-10-22 Pure Storage, Inc. DAP redistribution operation within a dispersed storage network
US9727427B2 (en) 2014-12-31 2017-08-08 International Business Machines Corporation Synchronizing storage of data copies in a dispersed storage network
US10489247B2 (en) 2014-12-31 2019-11-26 Pure Storage, Inc. Generating time-ordered globally unique revision numbers
US10423359B2 (en) 2014-12-31 2019-09-24 Pure Storage, Inc. Linking common attributes among a set of synchronized vaults
US10623495B2 (en) 2014-12-31 2020-04-14 Pure Storage, Inc. Keeping synchronized writes from getting out of synch
US10126974B2 (en) 2014-12-31 2018-11-13 International Business Machines Corporation Redistributing encoded data slices in a dispersed storage network
US10656866B2 (en) 2014-12-31 2020-05-19 Pure Storage, Inc. Unidirectional vault synchronization to support tiering
US10511665B2 (en) 2015-01-30 2019-12-17 Pure Storage, Inc. Efficient resource reclamation after deletion of slice from common file
US10423490B2 (en) 2015-01-30 2019-09-24 Pure Storage, Inc. Read-source requests to support bundled writes in a distributed storage system
US10498822B2 (en) 2015-01-30 2019-12-03 Pure Storage, Inc. Adaptive scanning rates
US10740180B2 (en) 2015-01-30 2020-08-11 Pure Storage, Inc. Storing and retrieving data using proxies
US10530862B2 (en) 2015-01-30 2020-01-07 Pure Storage, Inc. Determining slices to rebuild from low-level failures
US10498823B2 (en) 2015-01-30 2019-12-03 Pure Storage, Inc. Optimally apportioning rebuilding resources
US9740547B2 (en) 2015-01-30 2017-08-22 International Business Machines Corporation Storing data using a dual path storage approach
US10169123B2 (en) 2015-01-30 2019-01-01 International Business Machines Corporation Distributed data rebuilding
US10620878B2 (en) 2015-01-30 2020-04-14 Pure Storage, Inc. Write threshold plus value in dispersed storage network write operations
US9826038B2 (en) 2015-01-30 2017-11-21 International Business Machines Corporation Selecting a data storage resource of a dispersed storage network
US10506045B2 (en) 2015-01-30 2019-12-10 Pure Storage, Inc. Memory access using deterministic function and secure seed
US10289342B2 (en) 2015-01-30 2019-05-14 International Business Machines Corporation Data access optimization protocol in a dispersed storage network
US10592132B2 (en) 2015-01-30 2020-03-17 Pure Storage, Inc. Read-foreign-slices request for improved read efficiency with bundled writes
US10594793B2 (en) 2015-01-30 2020-03-17 Pure Storage, Inc. Read-prepare requests to multiple memories
US10440116B2 (en) 2015-01-30 2019-10-08 Pure Storage, Inc. Minimizing data movement through rotation of spare memory devices
US10802915B2 (en) 2015-01-30 2020-10-13 Pure Storage, Inc. Time based storage of encoded data slices
JP6536083B2 (ja) * 2015-02-26 2019-07-03 富士通株式会社 ストレージ装置、ストレージシステム、及びリカバリプログラム
US10387067B2 (en) 2015-02-27 2019-08-20 Pure Storage, Inc. Optimizing data storage in a dispersed storage network
US10437676B2 (en) 2015-02-27 2019-10-08 Pure Storage, Inc. Urgent reads and using data source health to determine error recovery procedures
US10657000B2 (en) 2015-02-27 2020-05-19 Pure Storage, Inc. Optimizing data storage in a dispersed storage network
US10409772B2 (en) 2015-02-27 2019-09-10 Pure Storage, Inc. Accessing serially stored data in a dispersed storage network
US10275185B2 (en) 2015-02-27 2019-04-30 International Business Machines Corporation Fail-in-place supported via decentralized or Distributed Agreement Protocol (DAP)
US10078472B2 (en) 2015-02-27 2018-09-18 International Business Machines Corporation Rebuilding encoded data slices in a dispersed storage network
US10440115B2 (en) 2015-02-27 2019-10-08 Pure Storage, Inc. Write intent messaging in a dispersed storage network
US10503591B2 (en) 2015-02-27 2019-12-10 Pure Storage, Inc. Selecting retrieval locations in a dispersed storage network
US11188665B2 (en) 2015-02-27 2021-11-30 Pure Storage, Inc. Using internal sensors to detect adverse interference and take defensive actions
US10069915B2 (en) 2015-02-27 2018-09-04 International Business Machines Corporation Storing data in a dispersed storage network
US10528425B2 (en) 2015-02-27 2020-01-07 Pure Storage, Inc. Transitioning to an optimized data storage approach in a dispersed storage network
US10534668B2 (en) 2015-02-27 2020-01-14 Pure Storage, Inc. Accessing data in a dispersed storage network
US10437677B2 (en) 2015-02-27 2019-10-08 Pure Storage, Inc. Optimized distributed rebuilding within a dispersed storage network
US10530861B2 (en) 2015-02-27 2020-01-07 Pure Storage, Inc. Utilizing multiple storage pools in a dispersed storage network
US11836369B1 (en) 2015-02-27 2023-12-05 Pure Storage, Inc. Storing data in an expanded storage pool of a vast storage network
US10579451B2 (en) 2015-02-27 2020-03-03 Pure Storage, Inc. Pro-actively preparing a dispersed storage network memory for higher-loads
US10404410B2 (en) 2015-02-27 2019-09-03 Pure Storage, Inc. Storage unit (SU) report cards
US10423502B2 (en) 2015-02-27 2019-09-24 Pure Storage, Inc. Stand-by distributed storage units
US10852957B2 (en) 2015-03-31 2020-12-01 Pure Storage, Inc. Migration agent employing moveslice request
US10437515B2 (en) 2015-03-31 2019-10-08 Pure Storage, Inc. Selecting storage units in a dispersed storage network
US10915261B2 (en) 2015-03-31 2021-02-09 Pure Storage, Inc. Selecting a set of storage units in a distributed storage network
US10387070B2 (en) 2015-03-31 2019-08-20 Pure Storage, Inc. Migrating data in response to adding incremental storage resources in a dispersed storage network
US10528282B2 (en) 2015-03-31 2020-01-07 Pure Storage, Inc. Modifying and utilizing a file structure in a dispersed storage network
US11055177B2 (en) 2015-03-31 2021-07-06 Pure Storage, Inc. Correlating operational information with an error condition in a dispersed storage network
US10534661B2 (en) 2015-03-31 2020-01-14 Pure Storage, Inc. Selecting a storage error abatement alternative in a dispersed storage network
US10713374B2 (en) 2015-03-31 2020-07-14 Pure Storage, Inc. Resolving detected access anomalies in a dispersed storage network
US10079887B2 (en) 2015-03-31 2018-09-18 International Business Machines Corporation Expanding storage capacity of a set of storage units in a distributed storage network
US10963180B2 (en) 2015-03-31 2021-03-30 Pure Storage, Inc. Adding incremental storage resources in a dispersed storage network
US10331384B2 (en) 2015-03-31 2019-06-25 International Business Machines Corporation Storing data utilizing a maximum accessibility approach in a dispersed storage network
US10216594B2 (en) 2015-04-30 2019-02-26 International Business Machines Corporation Automated stalled process detection and recovery
US10157094B2 (en) 2015-04-30 2018-12-18 International Business Machines Corporation Validating system registry files in a dispersed storage network
US10254992B2 (en) 2015-04-30 2019-04-09 International Business Machines Corporation Rebalancing data storage in a dispersed storage network
US10168904B2 (en) 2015-04-30 2019-01-01 International Business Machines Corporation Quasi-error notifications in a dispersed storage network
US10268376B2 (en) 2015-04-30 2019-04-23 International Business Machines Corporation Automated deployment and assignment of access devices in a dispersed storage network
US10055170B2 (en) 2015-04-30 2018-08-21 International Business Machines Corporation Scheduling storage unit maintenance tasks in a dispersed storage network
US10067998B2 (en) 2015-04-30 2018-09-04 International Business Machines Corporation Distributed sync list
US10078561B2 (en) 2015-04-30 2018-09-18 International Business Machines Corporation Handling failing memory devices in a dispersed storage network
US10037171B2 (en) 2015-04-30 2018-07-31 International Business Machines Corporation Accessing common data in a dispersed storage network
US10324657B2 (en) 2015-05-29 2019-06-18 International Business Machines Corporation Accounting for data whose rebuilding is deferred
US10613798B2 (en) 2015-05-29 2020-04-07 Pure Storage, Inc. Slice fanout write request
US11115221B2 (en) 2015-05-29 2021-09-07 Pure Storage, Inc. Verifying a rebuilt encoded data slice using slice verification information
US10891058B2 (en) 2015-05-29 2021-01-12 Pure Storage, Inc. Encoding slice verification information to support verifiable rebuilding
US10402122B2 (en) 2015-05-29 2019-09-03 Pure Storage, Inc. Transferring encoded data slices in a dispersed storage network
US10169125B2 (en) 2015-05-29 2019-01-01 International Business Machines Corporation Re-encoding data in a dispersed storage network
US10409522B2 (en) 2015-05-29 2019-09-10 Pure Storage, Inc. Reclaiming storage capacity in a dispersed storage network
US10838664B2 (en) 2015-05-29 2020-11-17 Pure Storage, Inc. Determining a storage location according to legal requirements
US10523241B2 (en) 2015-05-29 2019-12-31 Pure Storage, Inc. Object fan out write operation
US10430107B2 (en) 2015-05-29 2019-10-01 Pure Storage, Inc. Identifying stored data slices during a slice migration activity in a dispersed storage network
US10789128B2 (en) 2015-05-29 2020-09-29 Pure Storage, Inc. External healing mode for a dispersed storage network memory
US11669546B2 (en) 2015-06-30 2023-06-06 Pure Storage, Inc. Synchronizing replicated data in a storage network
US10437671B2 (en) 2015-06-30 2019-10-08 Pure Storage, Inc. Synchronizing replicated stored data
US10055291B2 (en) 2015-06-30 2018-08-21 International Business Machines Corporation Method and system for processing data access requests during data transfers
US20170034184A1 (en) 2015-07-31 2017-02-02 International Business Machines Corporation Proxying data access requests
US11782789B2 (en) 2015-07-31 2023-10-10 Pure Storage, Inc. Encoding data and associated metadata in a storage network
US10466914B2 (en) 2015-08-31 2019-11-05 Pure Storage, Inc. Verifying authorized access in a dispersed storage network
US10073652B2 (en) 2015-09-24 2018-09-11 International Business Machines Corporation Performance optimized storage vaults in a dispersed storage network
US10169147B2 (en) 2015-10-30 2019-01-01 International Business Machines Corporation End-to-end secure data storage in a dispersed storage network
US10346246B2 (en) 2015-11-30 2019-07-09 International Business Machines Corporation Recovering data copies in a dispersed storage network
US12072763B2 (en) 2015-11-30 2024-08-27 Pure Storage, Inc. Utilizing memories of different operational speeds in a vast storage network
US10409514B2 (en) 2015-11-30 2019-09-10 International Business Machines Corporation IP multicast message transmission for event notifications
US10013212B2 (en) * 2015-11-30 2018-07-03 Samsung Electronics Co., Ltd. System architecture with memory channel DRAM FPGA module
US20170192688A1 (en) 2015-12-30 2017-07-06 International Business Machines Corporation Lazy deletion of vaults in packed slice storage (pss) and zone slice storage (zss)
US10616330B2 (en) 2016-01-26 2020-04-07 Pure Storage, Inc. Utilizing tree storage structures in a dispersed storage network
US10089178B2 (en) 2016-02-29 2018-10-02 International Business Machines Corporation Developing an accurate dispersed storage network memory performance model through training
US10831381B2 (en) 2016-03-29 2020-11-10 International Business Machines Corporation Hierarchies of credential and access control sharing between DSN memories
US10387248B2 (en) 2016-03-29 2019-08-20 International Business Machines Corporation Allocating data for storage by utilizing a location-based hierarchy in a dispersed storage network
US10419538B2 (en) 2016-04-26 2019-09-17 International Business Machines Corporation Selecting memory for data access in a dispersed storage network
US10169082B2 (en) 2016-04-27 2019-01-01 International Business Machines Corporation Accessing data in accordance with an execution deadline
US10628399B2 (en) 2016-04-29 2020-04-21 International Business Machines Corporation Storing data in a dispersed storage network with consistency
US10007444B2 (en) 2016-04-29 2018-06-26 International Business Machines Corporation Batching access requests in a dispersed storage network
US10091298B2 (en) 2016-05-27 2018-10-02 International Business Machines Corporation Enhancing performance of data storage in a dispersed storage network
US10122795B2 (en) 2016-05-31 2018-11-06 International Business Machines Corporation Consistency level driven data storage in a dispersed storage network
US10353772B2 (en) 2016-05-31 2019-07-16 International Business Machines Corporation Selecting data for storage in a dispersed storage network
US10027755B2 (en) 2016-06-01 2018-07-17 International Business Machines Corporation Selecting storage units in one or more dispersed storage networks
US10394650B2 (en) 2016-06-03 2019-08-27 International Business Machines Corporation Multiple writes using inter-site storage unit relationship
US10719499B2 (en) 2016-06-06 2020-07-21 INTERNATIONAL BUSINESS MACHINES CORPORATIOb Establishing distributed consensus via alternate voting strategies in a dispersed storage network
US10652350B2 (en) 2016-06-06 2020-05-12 International Business Machines Corporation Caching for unique combination reads in a dispersed storage network
US10735545B2 (en) 2016-06-06 2020-08-04 International Business Machines Corporation Routing vault access requests in a dispersed storage network
US10334045B2 (en) 2016-06-06 2019-06-25 International Business Machines Corporation Indicating multiple encoding schemes in a dispersed storage network
US10007438B2 (en) 2016-06-25 2018-06-26 International Business Machines Corporation Method and system for achieving consensus using alternate voting strategies (AVS) with incomplete information
US10564852B2 (en) 2016-06-25 2020-02-18 International Business Machines Corporation Method and system for reducing memory device input/output operations
US10235085B2 (en) 2016-06-27 2019-03-19 International Business Machines Corporation Relocating storage unit data in response to detecting hotspots in a dispersed storage network
US11115469B2 (en) 2016-06-28 2021-09-07 International Business Machines Corporation Efficient updates within a dispersed storage network
US10157021B2 (en) 2016-06-29 2018-12-18 International Business Machines Corporation Processing incomplete data access transactions
US10025505B2 (en) 2016-06-29 2018-07-17 International Business Machines Corporation Accessing data in a dispersed storage network during write operations
US10387286B2 (en) 2016-06-30 2019-08-20 International Business Machines Corporation Managing configuration updates in a dispersed storage network
US9934092B2 (en) 2016-07-12 2018-04-03 International Business Machines Corporation Manipulating a distributed agreement protocol to identify a desired set of storage units
US10534666B2 (en) 2016-07-14 2020-01-14 International Business Machines Corporation Determining storage requirements based on licensing right in a dispersed storage network
US10102067B2 (en) 2016-07-14 2018-10-16 International Business Machines Corporation Performing a desired manipulation of an encoded data slice based on a metadata restriction and a storage operational condition
US10114696B2 (en) 2016-07-14 2018-10-30 International Business Machines Corporation Tracking data access in a dispersed storage network
US10360103B2 (en) 2016-07-18 2019-07-23 International Business Machines Corporation Focused storage pool expansion to prevent a performance degradation
US9992063B2 (en) 2016-07-18 2018-06-05 International Business Machines Corporation Utilizing reallocation via a decentralized, or distributed, agreement protocol (DAP) for storage unit (SU) replacement
US10277490B2 (en) 2016-07-19 2019-04-30 International Business Machines Corporation Monitoring inter-site bandwidth for rebuilding
US10769015B2 (en) 2016-07-19 2020-09-08 International Business Machines Corporation Throttling access requests at different layers of a DSN memory
US10031809B2 (en) 2016-07-20 2018-07-24 International Business Machines Corporation Efficient method for rebuilding a set of encoded data slices
US10459796B2 (en) 2016-07-20 2019-10-29 International Business Machines Corporation Prioritizing rebuilding based on a longevity estimate of the rebuilt slice
US10127112B2 (en) 2016-07-20 2018-11-13 International Business Machines Corporation Assigning prioritized rebuild resources optimally
US10554752B2 (en) 2016-07-20 2020-02-04 International Business Machines Corporation Efficient transfer of encoded data slice sets to new or alternate storage units
US10416930B2 (en) 2016-07-21 2019-09-17 International Business Machines Corporation Global access permit listing
US10379744B2 (en) 2016-07-21 2019-08-13 International Business Machines Corporation System for collecting end-user feedback and usability metrics
US10459790B2 (en) 2016-07-26 2019-10-29 International Business Machines Corporation Elastic storage in a dispersed storage network
US10395043B2 (en) 2016-07-29 2019-08-27 International Business Machines Corporation Securely storing data in an elastically scalable dispersed storage network
US10031805B2 (en) 2016-08-09 2018-07-24 International Business Machines Corporation Assigning slices to storage locations based on a predicted lifespan
US10223036B2 (en) 2016-08-10 2019-03-05 International Business Machines Corporation Expanding a dispersed storage network (DSN)
US10129023B2 (en) 2016-08-11 2018-11-13 International Business Machines Corporation Enhancing security for multiple storage configurations
US10348829B2 (en) 2016-08-15 2019-07-09 International Business Machines Corporation Auto indexing with customizable metadata
US10013309B2 (en) 2016-08-17 2018-07-03 International Business Machines Corporation Missing slice reconstruction in a dispersed storage network
US10379778B2 (en) 2016-08-18 2019-08-13 International Business Machines Corporation Using a master encryption key to sanitize a dispersed storage network memory
US10078468B2 (en) 2016-08-18 2018-09-18 International Business Machines Corporation Slice migration in a dispersed storage network
US10389683B2 (en) 2016-08-26 2019-08-20 International Business Machines Corporation Securing storage units in a dispersed storage network
US10581807B2 (en) 2016-08-29 2020-03-03 International Business Machines Corporation Using dispersal techniques to securely store cryptographic resources and respond to attacks
US10379773B2 (en) 2016-08-29 2019-08-13 International Business Machines Corporation Storage unit for use in a dispersed storage network
US10061524B2 (en) 2016-09-01 2018-08-28 International Business Machines Corporation Wear-leveling of memory devices
US10169149B2 (en) 2016-09-06 2019-01-01 International Business Machines Corporation Standard and non-standard dispersed storage network data access
US10387079B2 (en) 2016-09-09 2019-08-20 International Business Machines Corporation Placement of dispersed storage data based on requestor properties
US10225271B2 (en) 2016-09-09 2019-03-05 International Business Machines Corporation Distributed storage network with enhanced security monitoring
US10547615B2 (en) 2016-09-12 2020-01-28 International Business Machines Corporation Security response protocol based on security alert encoded data slices of a distributed storage network
US10558396B2 (en) 2016-09-14 2020-02-11 International Business Machines Corporation Pre-caching data according to a current or predicted requester location
US10558389B2 (en) 2016-09-20 2020-02-11 International Business Machines Corporation Per-storage class quality of service (QoS) management within a distributed storage network (DSN) where the DSN stores data using dispersed storage error decoding/encoding
US10067822B2 (en) 2016-09-26 2018-09-04 International Business Machines Corporation Combined slice objects in alternate memory locations
US10448062B2 (en) 2016-10-26 2019-10-15 International Business Machines Corporation Pre-fetching media content to reduce peak loads
US10394630B2 (en) 2016-10-26 2019-08-27 International Business Machines Corporation Estimating relative data importance in a dispersed storage network
US10585751B2 (en) 2016-10-27 2020-03-10 International Business Machines Corporation Partial rebuild operation within a dispersed storage network including local memory and cloud-based alternative memory
US10481977B2 (en) 2016-10-27 2019-11-19 International Business Machines Corporation Dispersed storage of error encoded data objects having multiple resolutions
US11169731B2 (en) 2016-10-31 2021-11-09 International Business Machines Corporation Managing storage resources in a dispersed storage network
US10540247B2 (en) 2016-11-10 2020-01-21 International Business Machines Corporation Handling degraded conditions using a redirect module
US10585607B2 (en) 2016-11-10 2020-03-10 International Business Machines Corporation Determining an optimum selection of functions for units in a DSN memory
US10114698B2 (en) 2017-01-05 2018-10-30 International Business Machines Corporation Detecting and responding to data loss events in a dispersed storage network
US10782921B2 (en) 2017-01-25 2020-09-22 International Business Machines Corporation Non-writing device finalization of a write operation initiated by another device
US10180787B2 (en) 2017-02-09 2019-01-15 International Business Machines Corporation Dispersed storage write process with lock/persist
US10241865B2 (en) 2017-02-15 2019-03-26 International Business Machines Corporation Handling storage unit failure in a dispersed storage network
US10579309B2 (en) 2017-02-16 2020-03-03 International Business Machines Corporation Method for increasing throughput in a distributed storage network
US10248495B2 (en) 2017-02-17 2019-04-02 International Business Machines Corporation Eventual consistency intent cleanup in a dispersed storage network
US10552341B2 (en) 2017-02-17 2020-02-04 International Business Machines Corporation Zone storage—quickly returning to a state of consistency following an unexpected event
US10382553B2 (en) 2017-02-20 2019-08-13 International Business Machines Corporation Zone storage—resilient and efficient storage transactions
US10394468B2 (en) 2017-02-23 2019-08-27 International Business Machines Corporation Handling data slice revisions in a dispersed storage network
US10241677B2 (en) 2017-02-24 2019-03-26 International Business Machines Corporation Ensuring consistency between content and metadata with intents
US9998147B1 (en) 2017-02-27 2018-06-12 International Business Machines Corporation Method for using write intents in a distributed storage network
US10642532B2 (en) 2017-02-28 2020-05-05 International Business Machines Corporation Storing data sequentially in zones in a dispersed storage network
US10372380B2 (en) 2017-03-01 2019-08-06 International Business Machines Corporation Asserting integrity with a verifiable codec
US10169392B2 (en) 2017-03-08 2019-01-01 International Business Machines Corporation Persistent data structures on a dispersed storage network memory
US11226980B2 (en) 2017-03-13 2022-01-18 International Business Machines Corporation Replicating containers in object storage using intents
US10235241B2 (en) 2017-03-15 2019-03-19 International Business Machines Corporation Method for partial updating data content in a distributed storage network
US10693640B2 (en) 2017-03-17 2020-06-23 International Business Machines Corporation Use of key metadata during write and read operations in a dispersed storage network memory
US10241861B2 (en) 2017-03-23 2019-03-26 International Business Machines Corporation Method for tenant isolation in a distributed computing system
US10133634B2 (en) 2017-03-30 2018-11-20 International Business Machines Corporation Method for performing in-place disk format changes in a distributed storage network
US10360391B2 (en) 2017-04-03 2019-07-23 International Business Machines Corporation Verifiable keyed all-or-nothing transform
US10379961B2 (en) 2017-04-11 2019-08-13 International Business Machines Corporation Ensuring metadata and index consistency using write intents
US10545699B2 (en) 2017-04-11 2020-01-28 International Business Machines Corporation Dynamic retention policies and optional deletes
US10567509B2 (en) 2017-05-15 2020-02-18 International Business Machines Corporation Rebuilding derived content
US10339003B2 (en) 2017-06-01 2019-07-02 International Business Machines Corporation Processing data access transactions in a dispersed storage network using source revision indicators
US10491386B2 (en) 2017-06-01 2019-11-26 International Business Machines Corporation Slice-level keyed encryption with support for efficient rekeying
US10467097B2 (en) 2017-06-02 2019-11-05 International Business Machines Corporation Indicating data health in a DSN memory
US10372381B2 (en) 2017-06-05 2019-08-06 International Business Machines Corporation Implicit leader election in a distributed storage network
US10361813B2 (en) 2017-06-16 2019-07-23 International Business Machine Corporation Using slice routers for improved storage placement determination
US10534548B2 (en) 2017-06-20 2020-01-14 International Business Machines Corporation Validating restricted operations on a client using trusted environments
US10324855B2 (en) 2017-06-23 2019-06-18 International Business Machines Corporation Associating a processing thread and memory section to a memory device
US10540111B2 (en) 2017-06-28 2020-01-21 International Business Machines Corporation Managing data container instances in a dispersed storage network
US10594790B2 (en) 2017-06-28 2020-03-17 International Business Machines Corporation Data compression in a dispersed storage network
US10599502B2 (en) 2017-08-07 2020-03-24 International Business Machines Corporation Fault detection and recovery in a distributed storage network
US10509699B2 (en) 2017-08-07 2019-12-17 International Business Machines Corporation Zone aware request scheduling and data placement
US10671746B2 (en) 2017-08-28 2020-06-02 International Business Machines Corporation Controlling access when processing intents in a dispersed storage network
US10379942B2 (en) 2017-09-27 2019-08-13 International Business Machines Corporation Efficient transfer of objects between containers on the same vault
US10409661B2 (en) 2017-09-29 2019-09-10 International Business Machines Corporation Slice metadata for optimized dispersed storage network memory storage strategies
US10802713B2 (en) 2017-09-29 2020-10-13 International Business Machines Corporation Requester-associated storage entity data
US10585748B2 (en) 2017-09-29 2020-03-10 International Business Machines Corporation Scalable cloud—assigning scores to requesters and treating requests differently based on those scores
US10540120B2 (en) 2017-11-14 2020-01-21 International Business Machines Corporation Contention avoidance on associative commutative updates
US10565392B2 (en) 2017-11-28 2020-02-18 International Business Machines Corporation Secure and verifiable update operations
US10423497B2 (en) 2017-11-28 2019-09-24 International Business Machines Corporation Mechanism for representing system configuration changes as a series of objects writable to an object storage container
US10785194B2 (en) 2017-12-07 2020-09-22 International Business Machines Corporation Processing intents using trusted entities in a dispersed storage network
US10681135B2 (en) 2017-12-08 2020-06-09 International Business Machines Corporation Generating slices from a broadcast message and a recipient identity
US10649867B2 (en) * 2017-12-15 2020-05-12 Western Digital Technologies, Inc. RAID array rebuild assist from external array copy
US11412041B2 (en) 2018-06-25 2022-08-09 International Business Machines Corporation Automatic intervention of global coordinator
US10936452B2 (en) 2018-11-14 2021-03-02 International Business Machines Corporation Dispersed storage network failover units used to improve local reliability
US10726936B2 (en) * 2018-12-20 2020-07-28 Micron Technology, Inc. Bad block management for memory sub-systems
CN114503037A (zh) * 2019-09-19 2022-05-13 西门子股份公司 用于柔性自动化工程程序的队列块
US11593026B2 (en) 2020-03-06 2023-02-28 International Business Machines Corporation Zone storage optimization using predictive protocol patterns
CN111897487B (zh) * 2020-06-15 2023-08-18 北京瀚诺半导体科技有限公司 管理数据的方法、装置、电子设备及介质
TWI748609B (zh) * 2020-08-25 2021-12-01 慧榮科技股份有限公司 全快閃陣列儲存裝置與資料處理方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5636359A (en) * 1994-06-20 1997-06-03 International Business Machines Corporation Performance enhancement system and method for a hierarchical data cache using a RAID parity scheme
US6151641A (en) * 1997-09-30 2000-11-21 Lsi Logic Corporation DMA controller of a RAID storage controller with integrated XOR parity computation capability adapted to compute parity in parallel with the transfer of data segments
US6353895B1 (en) * 1998-02-19 2002-03-05 Adaptec, Inc. RAID architecture with two-drive fault tolerance
US6247157B1 (en) * 1998-05-13 2001-06-12 Intel Corporation Method of encoding data signals for storage
AU1444601A (en) 1999-10-28 2001-05-08 Ramot University Authority For Applied Research And Industrial Development Ltd. Caching techniques for improving system performance in raid applications
US7188303B2 (en) * 2003-12-29 2007-03-06 Intel Corporation Method, system, and program for generating parity data

Also Published As

Publication number Publication date
CN1965298A (zh) 2007-05-16
TWI296757B (en) 2008-05-11
US20050144382A1 (en) 2005-06-30
TW200530812A (en) 2005-09-16
WO2005066761A2 (en) 2005-07-21
EP1700201A2 (en) 2006-09-13
US7206899B2 (en) 2007-04-17
WO2005066761A3 (en) 2006-08-24
JP2007513435A (ja) 2007-05-24

Similar Documents

Publication Publication Date Title
CN1965298B (zh) 用于管理奇偶raid数据重建的方法、系统和设备
US8719520B1 (en) System and method for data migration between high-performance computing architectures and data storage devices with increased data reliability and integrity
US7617361B2 (en) Configureable redundant array of independent disks
CN107250975B (zh) 数据存储系统和数据存储方法
US8560772B1 (en) System and method for data migration between high-performance computing architectures and data storage devices
CN104246707B (zh) 存储系统和存储装置
US20120159070A1 (en) System and method for handling io to drives in a memory constrained environment
US9026845B2 (en) System and method for failure protection in a storage array
CN102880525B (zh) 用于独立磁盘冗余阵列(raid)系统的文件服务器
US20110041005A1 (en) Controller and Method for Providing Read Status and Spare Block Management Information in a Flash Memory System
US20060236149A1 (en) System and method for rebuilding a storage disk
US20110041039A1 (en) Controller and Method for Interfacing Between a Host Controller in a Host and a Flash Memory Device
US20110040924A1 (en) Controller and Method for Detecting a Transmission Error Over a NAND Interface Using Error Detection Code
US7689890B2 (en) System and method for handling write commands to prevent corrupted parity information in a storage array
US20090119666A1 (en) Apparatus for cooperative distributed task management in a storage subsystem with multiple controllers using cache locking
TWI501080B (zh) 用於價廉磁碟冗餘陣列（ｒａｉｄ）磁卷與磁碟群組之間的鬆動連結之系統與方法
CN103793182A (zh) 可扩展存储保护
CN101965559A (zh) 包括将处理器与内部存储器连接的交叉切换器的用于闪存的存储控制器
CN100483323C (zh) 用于写入数据的方法、装置和系统
CN108733326B (zh) 一种磁盘处理方法及装置
CN113687977B (zh) 基于raid控制器以实现计算性能提升的数据处理装置
US7188303B2 (en) Method, system, and program for generating parity data
CN113687978B (zh) 用于存储阵列控制器的数据处理方法
US20180307427A1 (en) Storage control apparatus and storage control method
CN107957850A (zh) 具虚拟区块及磁盘阵列结构的数据存储系统及其管理方法

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110202

Termination date: 20181220