CN102301367B - Distributed data storage - Google Patents

Distributed data storage Download PDF

Info

Publication number
CN102301367B
CN102301367B CN200980142022.9A CN200980142022A CN102301367B CN 102301367 B CN102301367 B CN 102301367B CN 200980142022 A CN200980142022 A CN 200980142022A CN 102301367 B CN102301367 B CN 102301367B
Authority
CN
China
Prior art keywords
data
memory node
storage system
data memory
node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200980142022.9A
Other languages
Chinese (zh)
Other versions
CN102301367A (en
Inventor
克里斯蒂安·梅兰德
斯特凡·贝恩博
古斯塔夫·佩特森
罗杰·佩尔松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Compuverde AB
Original Assignee
Compuverde AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Compuverde AB filed Critical Compuverde AB
Publication of CN102301367A publication Critical patent/CN102301367A/en
Application granted granted Critical
Publication of CN102301367B publication Critical patent/CN102301367B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G06F15/163Interprocessor communication
    • G06F15/173Interprocessor communication using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
    • G06F15/17306Intercommunication techniques
    • G06F15/17331Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16Error detection or correction of the data by redundancy in hardware
    • G06F11/1658Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
    • G06F11/1662Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit the resynchronized component or unit being a persistent storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16Error detection or correction of the data by redundancy in hardware
    • G06F11/20Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2094Redundant storage or storage space
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • G06F16/184Distributed file systems implemented as replicated file system
    • G06F16/1844Management specifically adapted to replicated file systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/40Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection

Abstract

The present invention relates to a distributed data storage system comprising a plurality of storage nodes. Using unicast and multicast transmission, a server application may read and write data in the storage system. Each storage node may monitor reading and writing operations on the system as well as the status of other storage nodes. In this way, the storage nodes may detect a need for replication of files on the system, and may carry out a replication process that serves to maintain a storage of a sufficient number of copies of files with correct versions at geographically diverse locations.

Description

Distributed Storage
Technical field
The disclosure relates to the method writing data and maintenance data in the data-storage system comprising multiple data memory node, and the method is used in the memory node in server and data-storage system.The disclosure also relates to the memory node and server that can perform the method.
Background technology
Similar approach is disclosed in such as U.S. 2005/0246393A1.The method is disclosed, for a kind of system using multiple storage center at diverse geographic location.Distributed objects storage manager is included to preserve the information about stored data.
The problem that system is relevant therewith how to complete simple Buddhist monk perfect and write data reliably and keep data.
Summary of the invention
Therefore a target of the present disclosure is in distributed memory system, realize sound writing data or keep data, and does not use the concentrated server that keeps, and himself can be the Weak link in system.The realization of this target is the method by mentioning at first, and the method completes in memory node, and comprises: the state of other memory nodes and the write operation that performs in data-storage system in supervisory system; Based on monitoring, detect the situation in data-storage system, it means the demand to data Replica between the node in data-storage system, and if this situation is detected, then starts reproduction process.This reproduction process comprises and sends multicast message to multiple memory node, and which in these memory nodes of information query stores concrete data.
By defining such method, the data that each memory node can act on whole system keep.If a memory node fault, its data can be recovered by other nodes in system, and therefore system can think its self-recovery.
Monitoring can comprise heartbeat (heartbeat) signal listened to from other memory nodes in system.The condition meaning the demand that copies is then out of order memory node.
Packet contains file, and mean the demand that copies condition can for file erase or file inconsistent in one.
The copy list comprising the file that needs copy can be kept and can comprise priority.
Reproduction process can comprise: send multicast message to multiple memory node, require inquiry those memory nodes in which store concrete data, the response containing these concrete data is received from those memory nodes, determine whether described concrete data are stored on the memory node of sufficient amount, and, if the memory node no, selecting at least one other also transmits described concrete data to this memory node.In addition, the concrete data on the memory node containing its out-of-date version can be updated.
In addition, reproduction process can start from described memory node and attempts to obtain file ownership to be replicated in all memory nodes of system.
Monitoring can also comprise the read operation monitored and perform in data-storage system.
The disclosure also relates to a kind of data memory node, and this memory node keeps for performing the data corresponding with described method.Memory node then generally includes the device of the action for manner of execution.
The realization of target is utilize mention at first that to write data to the method for data-storage system equally, and the method is done in the server of application running the data in visit data storage system.The method comprises: send multicast storing queries to multiple memory node, receive the multiple responses from the subset of this memory node, this respond packet is containing the geodata in geographic position relating to each server, select at least two memory nodes in described subset based on this response, send data and correspond to these data data identifier to selection memory node.
In the meaning that the method realizes in an efficient way in geographical variation, complete and sound write data.
Geographic position can comprise longitude and the latitude of involved (in question) memory node, and response can also comprise involved system load and/or the lifetime of system of memory node.
Multicast storing queries can comprise the data identifier identifying data to be stored.
Typically, at least three nodes can be selected to store, and the memory node list successfully storing data can be sent to selected memory node.
The disclosure also relates to a kind of server, is used for realizing writing data corresponding to described method.Server generally includes the device of the action for implementation method.
Accompanying drawing is sketched
Fig. 1 illustrates distributed data-storage system.
Fig. 2 A-2C and Fig. 3 illustrates data read process.
Fig. 4 A-4C and Fig. 5 illustrates that data write process.
Fig. 6 is stored in the situation of multiple data memory node by illustrating multiple file.
Fig. 7 illustrates the transmission of heartbeat signal.
Fig. 8 is the overview of data keep-process.
Specifically describe
The disclosure relates to a kind of distributed data-storage system comprising multiple memory node.System architecture and environment for use such as Fig. 1 thereof summarize.
Subscriber computer 1 accesses the application program 5 run on the server 7 by internet 3.As illustrated herein, thus user environment is conventional client-server configuration, and itself is known.It is to be noted, however, that this data-storage system that will be disclosed also may be used for other configuration.
In the example illustrated, two methods program 5,9 is run on the server 7.Certainly, but the application program of these quantity can be different.Each application program has application programming interfaces (API) 11, and these application programming interfaces provide the interface about distributed data-storage system 13 and support request, typically, is the write and read request from the application program run on the server.From the angle of application program, the information that reads or writes from/to data-storage system 13 does not need to embody difference in the storage solution using other any kind, such as file server or simple hardware driving.
Each API 11 communicates with the memory node 15 in storage system 13, and communicates mutually between memory node.These communications are based on transmission control protocol (TCP) and User Datagram Protoco (UDP) (UDP).These concepts technician knows, and is not further explained at this.
It should be noted that the different API 11 on same server 7 can access the memory node 15 of different series.Also noteworthy is that can exist and visit each memory node 15 than a more server 7.But this can not any drive manner affecting memory node to a greater degree, will be described as later.
The assembly of distributed data-storage system is memory node 15 and API 11, and in server 7, it accesses memory node 15.Therefore the disclosure relates to the method realized in server 7 and in memory node 15.The most first meeting of those methods is implemented as the software operated in respectively on server and memory node and installs, and jointly determines running and the attribute of whole distributed data-storage system.
Memory node 15 can typically be comprised by file server, and file server is provided with multiple functional module.Therefore memory node can comprise storage medium 17, and this storage medium typically comprises multiple hardware driving, and is selectively configured to RAID (independent disk redundancy array) system.But also can expect other forms of storage medium.
Memory node 15 can also comprise catalogue 19, and this catalogue comprises the list of some data entities/memory node relation as master list (host list), as afterwards by discussion.
Except master list, each memory node is also containing a node listing, and this list is included in the IP address of the whole memory nodes in its set of memory node or group.Memory node quantity in group can change between a hundreds of memory node several.Node listing also can have a version number.
In addition, memory node 15 can comprise a replication module 21 and a monitor module 23 of trooping.Replication module 21 comprises a memory node API 25, and is configured to for performing identification demand and the function realizing reproduction process, and this will describe in detail by details afterwards.The node that the memory node API 25 of replication module 21 contains can be farthest corresponding with the node of the memory node API 11 of server 7, and the function that reproduction process simultaneously comprises farthest keeps corresponding with the function that server 7 realizes during the read and write operation be described.Such as, the write operation performed in reproduction process is farthest corresponding with the write operation that server 7 realizes.Monitor module 23 of trooping is configured to realize monitoring other memory nodes in data-storage system 13, and this will describe in detail by details afterwards.
It is secondary that the memory node 15 of distributed data-storage system can be considered to be present in same layer.Do not need to specify any primary storage node to be responsible for keeping catalogue and the monitor data consistance of storage data entity, etc.On the contrary, all memory nodes 15 can be considered to equivalent, and sometimes can realize data management operations relative to other memory nodes in system.This equation ensures the sound of system.If a memory node is out of order, other memory nodes in system will be covered faulty nodes and ensure that reliable data store.
Dynamic System will be set forth in the following order: read data, write data, and data keep.Even if these methods are proved effective together, it should be noted that they can independently mutually in principle realize.That is, such as method for reading data can provide good attribute, even if data write method of the present disclosure is not used to, vice versa.
The method read is set forth according to Fig. 2 A-2C and 3 now, and the latter is the process flow diagram for illustration of method.
As other functions in system, the operation of reading utilizes multi-casting communication to communicate with multiple memory node simultaneously.Here mean point-to-multipoint communication by multicast or ip multicast, this communication has come by sending a message to IP address, and this address is retained in multicast application program.
Such as, typically be the message required and be sent to such IP address (such as, 244.0.0.1), and multiple reception server is registered as the user of this IP address.Each reception server has oneself IP address.When the switch in network receives the message pointing to 244.0.0.1, this message is forwarded to each IP address being registered as the server of user by switch.
In principle, for multicast address, only have a server to be registered as user, complete point-to-point communication in this case.But within the context of the present disclosure, such communication is still thought of as multi-casting communication, because Multicast Scheme is used.
With reference to the communication with single take over party, also use unicast communication.
According to Fig. 2 A and Fig. 3, the method is used for retrieve data from a data-storage system, and the method comprises transmission 31 multicast inquiry to multiple memory node 15.In illustrated example, have five memory nodes, each memory node has an IP (Internet protocol) address 192.168.1.1,192.168.1.2, etc.Needless to say more, the quantity of memory node is an example.Inquiry comprises data identifier " 2B9B4A97-76E5-499E-A21A6D7932DD7927 ", and this identifier can be such as universal unique identifier UUID, is known in itself.
Memory node scanning self is to obtain the data of corresponding identifier.If such data are found, then memory node sends response, and the serviced device 7 of this response receives 33, as Fig. 2 B.In illustrating, response can also selectively containing the out of Memory except the duplicate that expression memory node has related data.Specifically, response can containing the information about other memory nodes containing data come from memory node catalogue, to be contained in the information of memory node about the data of which version and to be exposed to the information of which load about memory node at present.
Based on this response, server selects 35 from one or more memory nodes of its retrieve data, and the unitcast request sending 37 pairs of data to that/those memory nodes, as Fig. 2 C.
In response to the request to data, memory node clean culture sends the server of related data to reception 39 data.In illustrated example, a memory node is only had to be selected.Although this enough, becoming possibility in order to receive two groups of data to make consistency check, more than one memory node can be selected.If data transmission fails, server can be selected other memory node to retrieve.
The selection of memory node can based on a kind of algorithm, and this algorithm considers some factors to reach good total system effect.Typically, the memory node with up-to-date versions of data and minimum load will be selected, although other concepts also all can be expected.
Selectively, by server transmission list to all memory nodes be included, deducibility goes out operation, indicates which node and contains data and use which version, can obtain a result thus.Based on these information, memory node can by the reproduction process that will be described, and correctly oneself keeps data.
Fig. 4 A-4C and Fig. 5 illustrates that the data of distributed data-storage system write process.
According to Fig. 4 A and Fig. 5, the method comprises server and sends 41 multicast storing queries to multiple memory node.Storing queries comprises data identifier and the problem mainly comprised receives memory node whether can preserve this file.Selectively, memory node can check that their inside catalogue checks the file of its this name whether existing, and can announcement server 7 be these situations in unlikely situation, thus server can Rename file.
Under any circumstance, at least the subset of memory node can be provided to the response of server 7 by clean culture transmission.Typically, the memory node with predetermined minimum vacant disk space answers inquiry.Server 7 receives 43 responses, and this respond packet is containing the geodata relevant with the geographic position of each server.Such as, as shown in Figure 4 B, geodata can comprise the longitude of each server, latitude and height.But the geodata of other kinds also can be conceived, as postcode or analog.
Except geodata, more information can be provided, and it is used as the input to memory node selection course.In illustrated example, be provided together with the instruction that clearance spaces amount and the memory node system lifetim of each memory node indicate the load stood now with memory node.
Based on the response received, server selects 45 at least two memory nodes in the subsets, is three memory nodes, for storing data at typical embodiment.The selection of memory node is realized by the mode of the algorithm considering different pieces of information.The realization of this selection is used for obtaining certain geographic diversity.At least preferably can avoid only having the file server in same stack to be selected as memory node.Typically, a kind of good geographic diversity can be obtained, even if select memory node in different plate.Except geographic diversity, other factors can be included in selection algorithm.As long as reach minimum geographic diversity, clearance spaces, lifetime of system and present load can be considered wherein.
When memory node is selected, data to be stored and corresponding data identifier will be sent to the node of each selection, typically use clean culture transmission.
Optionally, operation can be terminated by each memory node, and described memory node is successful execution write operation, and sends the acknowledgment to server.Server and then transmission list, to involved all memory nodes, shows which node successfully writes data and which does not successfully write data.Based on this information, memory node oneself can pass through the correct maintenance data of reproduction process, and this will be described.Such as, if the write operation failure of a memory node, then xcopy is needed to arrive another one memory node, for use in the memory node of the desired amt of this file.
Data write method itself allows the API in server 7 to store data in a kind of very sound mode, thus can provide good geographic diversity.
Except write and read operation, the API in server 7 can realize the operation of deleted file and updating file.These processes will be described below in conjunction with data keep-process.
The object of data keep-process is the non-fault memory node guaranteeing to have fair amount, and each memory node stores the latest edition of each file.In addition, the function being stored into any memory node without deleted file can be provided.Keep being realized by memory node self.Here special " master control " is not therefore needed to carry out the maintenance of responsible data storage.This guarantees that the reliability as the raising of " master control " may become the weakness of system in other respects.
Fig. 6 is stored into situation in multiple data memory node by illustrating multiple file.In legend, 12 nodes have the IP address of the serial number from 192.168.1.1 to 192.168.1.12, and these 12 nodes are described for explanation.But need not speak more, IP address number does not need in same scope.Node is only easy elaboration with annular sequential arrangement, and that is, node does not need to have specific order.Each node stores one or two file be identified, and in order to easy object, identifies with alphabetical A-F.
According to Fig. 8, the method for preserving data comprises situation and the reproduction process 53 of detection 51 data-storage system, and described situation means the demand copying data between data-storage system interior joint.The result of testing process 51 is listed files 55, copies demand for its identification.This list can also comprise the data of the priority copying demand about difference.Based on this list, reproduction process 53 is implemented.
The viability of distributed storage is fixed against the copy of the fair amount of every part of file, correct storage of versions in systems in which.In the example illustrated, three parts of copies of every part of file are stored.But such as, if mistake appears in the memory node that address is 192.168.1.5, then the file stored copies " B " of anticipated number and " C " can not be satisfied.
One causes the event of the demand that copies therefore to be the fault of memory node in system.
Each memory node in system can the state of other memory nodes in supervisory system.This can by allowing each memory node send so-called heartbeat signal at regular intervals to realize, as shown in Figure 7.In the example illustrated, address is that the memory node of 192.168.1.7 sends multicast signals 57 to other memory nodes in system, shows that this memory node is working properly.This signal can be received by the subset of the memory node of the every other operation of the execution heartbeat monitor 59 (as Fig. 8) in system or memory node.But when the address of memory node is 192.168.1.5, this memory node has fault and does not send any heartbeat signal.Therefore, other memory nodes will be discovered this node and not send any heartbeat signal for a long time, show that the memory node mentioned in problem does not operate thus.
Except the address of memory node, heartbeat signal can also comprise its node listing version number.Other memory node is listened to heartbeat signal and is found that the memory node transmitted has the node listing of later release, its node listing of memory node transmission that then this other memory node can require that to transmit.This means, by adding and removing memory node and send new node listing version to a signal storage node, can the interpolation of memory node be obtained simply and remove.Then this node listing will pass to the every other memory node in system.
Again according to Fig. 8, each memory node search 61 its inner catalogues find file, and this file is stored by failed storage node.The memory node self storing file " B " and " C " will find failed storage node, and therefore, it is possible to add the list 55. of corresponding file to them
Testing process but disclose other conditions of xcopy demand of meaning too.Typically this kind of situation may be inconsistent, that is, and the documentary calcellation version of one or more memory node tools.Deletion action means reproduction process equally, because the actual physics that this process can realize file is deleted.Then the deletion action of server only needs to guarantee that memory node is that the file mentioned in problem arranges deleted marker.Therefore each node can monitor the read and write operation realized in data-storage system.Information is provided by server 7 after read and write operation completes, and this information can show that a memory node contains documentary calcellation version (in the case of a read operation) or memory node successfully can not realize write operation respectively.In both cases, need by copying maintenance data, thus the overall goals of keep-process is achieved.
Except basic read and write operation 63,65, at least two extra processes can also provide the instruction that there is the demand that copies, that is, provide now deletion 67 and 69 processes of renewal of brief explanation.
Delete procedure is (as Fig. 1) by server 7.Be similar to read procedure, server sends with multicast form and inquires all memory nodes, to find out the data which memory node has concrete data identifier.Memory node is browsed self to find has the data of relevant identifier, and if they have the data mentioned in problem, respond by unicast transmission.Response can comprise the list of other memory nodes containing data, and this list is from memory node catalogue.Then server 7 sends unitcast request stores deleted file memory node to being considered.Each memory node arranges the mark about file and indicates that it should be deleted.Then file is added into copy list, and sends the acknowledgment to server.Reproduction process then physically deleted file, as being described.
Renewal process have the looking up function be similar in wherein delete procedure looking up function and be similar to write realize in process write function write function.Server sends inquiry by being multicasted to all memory nodes, to find out which memory node having data with concrete identifier.Memory node scanning self finds the data with relevant identifier, and if they have involved data, then respond by unicast transmission.Response can comprise the list of other memory nodes containing data, and this list is from memory node catalogue.Then server 7 sends unitcast request, informs that memory node carrys out more new data.Request is certainly containing the data be updated.More the memory node of new data sends the acknowledgment to server, and this server responds by sending unicast transmission, and this unicast transmission contains successfully the memory node of more new data and the list of the not more memory node of new data.In addition, keep-process can use this list.
Again according to Fig. 8, reading 63 operates, write 65 operations, delete 67 operations and renewal 69 operates the existence that can show the demand that copies.Be equally applicable to heartbeat monitor 59.Therefore whole testing process 51 according to which file needs to be replicated to generate data.Such as, read operation or renewal rewards theory can disclose the file that concrete memory node contains calcellation version.Delete procedure can arrange deleted marker for concrete file.Heartbeat monitor can disclose the multiple files be stored on failed storage node to be needed to be copied to new memory node.
Each memory node monitoring All Files copy demand, this file stores and keeps copy list 55.Copy list 55 is therefore containing the multiple files needing to be replicated.File can according to each prioritization copied.Typically, the levels of priority that three kinds different can be had here.Highest level is for memory node preserves the file reservation of its up-to-date online copy.This class file needs to copy to rapidly other memory nodes, can reach the redundancy of reasonable level.The priority of medium level can relate to the file that in memory node, version is inconsistent.Low-level priority can relate to the file be stored on failed storage node.
Memory node is according to the file in their levels of priority process copy list 55.Reproduction process is described about memory node now, and memory node is called as operation memory node here, although all memory nodes can this mode be operated.
Keep-process copy part 53 by operation memory node attempt 71 become the master control of the file that it wants to copy.Operation memory node sends the master control that unitcast request becomes other memory nodes, and other memory nodes known store the file mentioned in problem.Catalogue 19 (as Fig. 1) provides master list, and this master list comprises the information about which memory node of inquiry.If such as once there be conflict request, then one of them memory node can not make the response of affirmative, and file can by temporary transient return-list, and substitute with the next file in list and attempt.Otherwise operation memory node can be considered as the master control of this file, and other memory nodes arrange mark, represent that operation memory node is the master control of the file mentioned in problem.
Next step for finding all copies of the file involved by 73 in distributed memory system.This can send multicast inquiry by operation memory node to all memory nodes, which node of inquiring in them has file to realize.The documentary memory node of tool is submitted to for inquiry and is responded, and comprises FileVersion and its master list of their maintenances, the list of the memory node of master list namely containing the associated documents in the catalogue remained in each memory node list.Then these master list merge 75 by operation memory node, thus master control master list is formed according to the set of all master list of fetching.If find extra memory node, when operating memory node and attempting to become master control, this memory node does not have accessed, then this step can carry out repetition for extra memory node now.Master control master list contains information, and this information keeps the file of which version about different memory nodes and the state of the file within whole storage system is described.
If operation memory node does not have the latest edition of involved file, then then from the memory node with latest edition one of this file is retrieved 77.
Typically, if should add extra memory node, operation memory node then determines that 79 the need of change master list.If like this, operation memory node can realize the very similar process writing process, described in write process and realized by server, and to be described in relevant Fig. 4 A-4C and Fig. 5.The result of this process is that file is written to new memory node.
If it is inconsistent that version occurs, operation memory node can upgrade the duplicate of the document that 81 are stored in other memory nodes, thus makes stored All Files have correct version.
The unnecessary copy of storage file can deleted 83.If reproduction process is by deletion action, process can leap to this step.Then, once all memory nodes receive file erase, operation memory node utilizes clean culture physically to delete involved file to ask all memory nodes simply.Memory node confirms that file is deleted.
Other state, that is, the master control master list of file is updated.May selectively repeat step 73-83 to guarantee to copy demand afterwards no longer to exist.This copies the consistent master control master list causing not needing in step 85 to upgrade.
After this, the reproduction process of that file terminates, and operation memory node by sending corresponding message to the every other memory node in master list, can discharge the master control of 87 states as file.
In such a system, each memory node is responsible for the All Files keeping it to store in whole memory node set, and this system provides a kind of (under memory node failure condition) selfreparing (at file in the inconsistent or deleted situation of file) self-cleaning system with fine reliability.The file that this system has simple extensibility and can store for a large amount of different application simultaneously.
The present invention does not limit concrete disclosed example, and can carry out in a different manner within the scope of the appended claims changing and changing.

Claims (17)

1. in data-storage system, keep a method for data, described data-storage system comprises multiple data memory node, and described method is used and comprises in the data memory node of described data-storage system:
The state of other data memory nodes in-monitoring (59) described data-storage system and the write operation (65,67,69) that performs in described data-storage system, described data memory node has master list, and this master list comprises the data memory node storing data entity;
-based on described monitoring, detect the condition in (51) described data-storage system, this condition indicates the memory node in described data-storage system to have fault;
-determine stored data entity based on the information in multiple master list, this data entity is also stored by failed storage node, described master list wherein for each data entity comprises the list be associated, and the list identification that this is associated stores the subset of the memory node in the described data-storage system of data entity; And
If-such condition is detected, then start the reproduction process (53) for the data entity stored by described failed storage node, wherein said reproduction process comprises transmission multicast message to multiple data memory node, and which data memory node in these data memory nodes of described information query stores concrete data.
2. method according to claim 1, wherein said monitoring comprises listens to (59) heartbeat signal from other data memory nodes in described data-storage system.
3. method according to claim 1 and 2, wherein said data comprise file, and the one of condition during to be file erase or file inconsistent.
4. method according to claim 1 and 2, wherein keeps a copy list, and this copy list comprises the file that needs copy.
5. method according to claim 4, wherein said copy list comprises priority.
6. method according to claim 1, wherein said reproduction process also comprises:
-receive response from those data memory nodes comprising described concrete data;
-determine whether described concrete data are stored on the data memory node of sufficient amount; And
If-not having, then the data memory node selecting at least one extra also transmits described concrete data to this data memory node.
7. method according to claim 6, also comprises the described concrete data upgraded on the data memory node of calcellation version comprising described concrete data.
8. the method according to claim 6 or 7, the ownership that wherein said reproduction process attempts to obtain in all data memory nodes in described data-storage system file to be replicated with described data memory node starts.
9. the method according to claim 1 or 2 or 6 or 7, wherein said monitoring also comprises the read operation (63) monitored and perform in described data-storage system.
10. for keeping an equipment for data in data-storage system, described data-storage system comprises multiple data memory node, and described equipment is used and comprises in the data memory node of described data-storage system:
-for the state of monitoring other data memory nodes in described data-storage system and the device of write operation performed in described data-storage system, wherein said monitoring is based on master list, and this master list comprises the data memory node storing data entity;
-for detecting the device of the condition in described data-storage system based on described monitoring, described condition indicates the memory node in described data-storage system to have fault;
-for determining the device of stored data entity based on the information in multiple master list, this data entity is also stored by failed storage node, described master list wherein for each data entity comprises the list be associated, and the list identification that this is associated stores the subset of the memory node in the described data-storage system of data entity; And
-for starting the device of the reproduction process for the data entity stored by described failed storage node when such condition is detected, wherein said reproduction process comprises transmission multicast message to multiple data memory node, and which data memory node in these data memory nodes of described information query stores concrete data.
11. data to be write a method for data-storage system, described data-storage system comprises multiple data memory node, and the method is used in the server of the application of the data run in the described data-storage system of access, and described method comprises:
-send (41) multicast storing queries to multiple described data memory node;
-receiving (43) multiple response from the subset of described data memory node, described response comprises the geodata in the geographic position relating to each data memory node;
-based at least two data memory nodes in described response selection (45) described subset; And
-send (47) data, corresponding to these data data identifier and successfully store described data the list of data memory node to selected data memory node.
12. methods according to claim 11, wherein said geographic position comprises longitude and the latitude of involved described data memory node.
13. methods according to claim 12, wherein said response also comprises the lifetime of system of involved described data memory node.
14. methods according to claim 12 or 13, wherein said response also comprises the system load of involved described data memory node.
15. methods according to claim 12 or 13, wherein said multicast storing queries comprises the data identifier identifying data to be stored.
16. methods according to claim 12 or 13, wherein at least three data memory nodes are selected.
17. data to be write an equipment for data-storage system, described data-storage system comprises multiple data memory node, and this equipment is used in the server of the application of the data run in the described data-storage system of access, and described equipment comprises:
-for sending the device of multicast storing queries to multiple described data memory node;
-for receiving the device of multiple response from the subset of described data memory node, described response comprises the geodata in the geographic position relating to each data memory node;
-for selecting the device of at least two data memory nodes in described subset based on described response; And
-for the data identifier that sends data and correspond to these data and successfully store described data the list of data memory node to the device of selected data memory node.
CN200980142022.9A 2008-10-24 2009-10-21 Distributed data storage Expired - Fee Related CN102301367B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
SE0802277-4 2008-10-24
SE0802277A SE533007C2 (en) 2008-10-24 2008-10-24 Distributed data storage
PCT/EP2009/063796 WO2010046393A2 (en) 2008-10-24 2009-10-21 Distributed data storage

Publications (2)

Publication Number Publication Date
CN102301367A CN102301367A (en) 2011-12-28
CN102301367B true CN102301367B (en) 2015-01-21

Family

ID=41404359

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200980142022.9A Expired - Fee Related CN102301367B (en) 2008-10-24 2009-10-21 Distributed data storage

Country Status (15)

Country Link
US (7) US8688630B2 (en)
EP (3) EP2908257B1 (en)
JP (1) JP5553364B2 (en)
KR (1) KR101635238B1 (en)
CN (1) CN102301367B (en)
AU (1) AU2009306386B2 (en)
BR (1) BRPI0914437A2 (en)
CA (1) CA2741477C (en)
DK (1) DK2342663T3 (en)
EA (1) EA201100545A1 (en)
ES (1) ES2538129T3 (en)
MX (1) MX2011004240A (en)
SE (1) SE533007C2 (en)
WO (1) WO2010046393A2 (en)
ZA (1) ZA201103754B (en)

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8458290B2 (en) 2011-02-01 2013-06-04 Limelight Networks, Inc. Multicast mapped look-up on content delivery networks
US20150207888A1 (en) * 2008-09-19 2015-07-23 Limelight Networks, Inc. Multicast mapped look-up on content delivery networks
SE533007C2 (en) 2008-10-24 2010-06-08 Ilt Productions Ab Distributed data storage
US9002979B2 (en) * 2010-01-11 2015-04-07 Innovative Timing Systems, Llc Sports timing system (STS) event and participant announcement communication system (EPACS) and method
EP2712149B1 (en) 2010-04-23 2019-10-30 Compuverde AB Distributed data storage
US9323775B2 (en) 2010-06-19 2016-04-26 Mapr Technologies, Inc. Map-reduce ready distributed file system
US11726955B2 (en) 2010-06-19 2023-08-15 Hewlett Packard Enterprise Development Lp Methods and apparatus for efficient container location database snapshot operation
US8392368B1 (en) 2010-08-27 2013-03-05 Disney Enterprises, Inc. System and method for distributing and accessing files in a distributed storage system
US8290919B1 (en) 2010-08-27 2012-10-16 Disney Enterprises, Inc. System and method for distributing and accessing files in a distributed storage system
US8768981B1 (en) * 2010-08-27 2014-07-01 Disney Enterprises, Inc. System and method for distributing and accessing files in a distributed storage system
EP2439908A1 (en) * 2010-09-20 2012-04-11 Thomson Licensing Method of data replication in a distributed data storage system and corresponding device
JP2012088955A (en) * 2010-10-20 2012-05-10 Nec Corp Data replication system, data replication server, data replication method, and data replication program
US9710344B1 (en) 2010-12-13 2017-07-18 Amazon Technologies, Inc. Locality based quorum eligibility
US8473775B1 (en) 2010-12-14 2013-06-25 Amazon Technologies, Inc. Locality based quorums
RU2585981C2 (en) 2011-01-10 2016-06-10 Стороун Лтд. Large-scale data storage system
US20120185433A1 (en) * 2011-01-14 2012-07-19 International Business Machines Corporation Priority-based asynchronous data replication
US8478858B2 (en) 2011-02-01 2013-07-02 Limelight Networks, Inc. Policy management for content storage in content delivery networks
US8396970B2 (en) 2011-02-01 2013-03-12 Limelight Networks, Inc. Content processing between locations workflow in content delivery networks
US8521813B2 (en) 2011-02-01 2013-08-27 Limelight Networks, Inc. Content replication workflow in content delivery networks
US8615577B2 (en) 2011-02-01 2013-12-24 Limelight Networks, Inc. Policy based processing of content objects in a content delivery network using mutators
ES2723781T3 (en) * 2011-08-03 2019-09-02 Amadeus Sas Method and system to maintain strong consistency of replicated content distributed on a client / server system
US9385874B2 (en) * 2013-01-23 2016-07-05 Nexenta Systems, Inc. Scalable transport with client-consensus rendezvous
US9910904B2 (en) 2011-08-30 2018-03-06 International Business Machines Corporation Replication of data objects from a source server to a target server
US8645978B2 (en) 2011-09-02 2014-02-04 Compuverde Ab Method for data maintenance
US8769138B2 (en) * 2011-09-02 2014-07-01 Compuverde Ab Method for data retrieval from a distributed data storage system
US8997124B2 (en) 2011-09-02 2015-03-31 Compuverde Ab Method for updating data in a distributed data storage system
US9626378B2 (en) * 2011-09-02 2017-04-18 Compuverde Ab Method for handling requests in a storage system and a storage node for a storage system
US9021053B2 (en) 2011-09-02 2015-04-28 Compuverde Ab Method and device for writing data to a data storage system comprising a plurality of data storage nodes
US8650365B2 (en) 2011-09-02 2014-02-11 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
JP5910117B2 (en) * 2012-01-30 2016-04-27 富士通株式会社 File system
CN103294675B (en) * 2012-02-23 2018-08-03 上海盛大网络发展有限公司 Data-updating method and device in a kind of distributed memory system
CN102694863B (en) * 2012-05-30 2015-08-26 电子科技大学 Based on the implementation method of the distributed memory system of adjustment of load and System Fault Tolerance
CN102821045B (en) * 2012-08-03 2015-07-22 中兴通讯股份有限公司 Method and device for copying multicast message
US8589659B1 (en) * 2012-11-08 2013-11-19 DSSD, Inc. Method and system for global namespace with consistent hashing
US9479587B2 (en) 2013-01-23 2016-10-25 Nexenta Systems, Inc. Scalable object storage using multicast transport
JP5711772B2 (en) * 2013-01-29 2015-05-07 日本電信電話株式会社 Cluster system
US10452284B2 (en) 2013-02-05 2019-10-22 International Business Machines Corporation Storage system based host computer monitoring
US9984083B1 (en) * 2013-02-25 2018-05-29 EMC IP Holding Company LLC Pluggable storage system for parallel query engines across non-native file systems
US9454548B1 (en) 2013-02-25 2016-09-27 Emc Corporation Pluggable storage system for distributed file systems
KR102092921B1 (en) 2013-06-28 2020-03-24 삼성전자주식회사 Simulation apparatus and Distributed simulation system
CN103731505A (en) * 2014-01-17 2014-04-16 中国联合网络通信集团有限公司 Data distributed storage method and system
CN104320452B (en) * 2014-10-22 2017-12-26 南京市测绘勘察研究院股份有限公司 A kind of collection of geodata into figure management cloud service system and its method
CN104360915B (en) * 2014-10-31 2017-08-01 北京思特奇信息技术股份有限公司 A kind of data reconstruction method and device based on distributed storage
US10148748B2 (en) * 2015-02-26 2018-12-04 Microsoft Technology Licensing, Llc Co-locating peer devices for peer matching
US10725708B2 (en) 2015-07-31 2020-07-28 International Business Machines Corporation Replication of versions of an object from a source storage to a target storage
US10306005B1 (en) * 2015-09-30 2019-05-28 EMC IP Holding Company LLC Data retrieval system and method
US10341181B2 (en) * 2016-03-07 2019-07-02 International Business Machines Corporation Method and apparatus to allow dynamic changes of a replica network configuration in distributed systems
CN106250055A (en) * 2016-07-12 2016-12-21 乐视控股(北京)有限公司 A kind of date storage method and system
CN106652153B (en) * 2016-10-17 2019-03-26 深圳市穗彩科技开发有限公司 Color method and system are sent in expansible lottery ticket retrieval
CN108255640B (en) * 2017-12-15 2021-11-02 云南省科学技术情报研究院 Method and device for rapidly recovering redundant data in distributed storage
CN108235751B (en) * 2017-12-18 2020-04-14 华为技术有限公司 Method and device for identifying sub-health of object storage equipment and data storage system
US11216420B2 (en) * 2018-07-31 2022-01-04 Nutanix, Inc. System and method for high replication factor (RF) data replication
JP2020046927A (en) 2018-09-19 2020-03-26 キオクシア株式会社 Storage device, storage system, and method
US11005825B2 (en) * 2018-11-13 2021-05-11 Seagate Technology Llc Sensor nodes and host forming a tiered ecosystem that uses public and private data for duplication
US11388136B2 (en) 2019-06-18 2022-07-12 Nutanix, Inc. Dynamic distributed service location discovery
WO2021155498A1 (en) * 2020-02-04 2021-08-12 华为技术有限公司 Data reading method and terminal
US11893064B2 (en) * 2020-02-05 2024-02-06 EMC IP Holding Company LLC Reliably maintaining strict consistency in cluster wide state of opened files in a distributed file system cluster exposing a global namespace
US11544258B2 (en) 2020-02-05 2023-01-03 Ebay Inc. Selecting a host based on quality of stored data
US11544147B2 (en) 2020-05-22 2023-01-03 Vmware, Inc. Using erasure coding across multiple regions to reduce the likelihood of losing objects maintained in cloud object storage
US11556423B2 (en) 2020-05-22 2023-01-17 Vmware, Inc. Using erasure coding in a single region to reduce the likelihood of losing objects maintained in cloud object storage
US11481319B2 (en) * 2020-05-22 2022-10-25 Vmware, Inc. Using data mirroring across multiple regions to reduce the likelihood of losing objects maintained in cloud object storage

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1726454A (en) * 2002-10-17 2006-01-25 英特尔公司 A distributed network attached storage system
US7266556B1 (en) * 2000-12-29 2007-09-04 Intel Corporation Failover architecture for a distributed storage system

Family Cites Families (275)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3707707A (en) 1970-11-12 1972-12-26 Cipher Data Prod Digital cassette magnetic tape recorder and reproducer
JPS5628707A (en) 1979-08-20 1981-03-20 Hitachi Ltd Hair dryer
JPS6348527Y2 (en) 1984-09-19 1988-12-14
JP3139884B2 (en) * 1993-06-14 2001-03-05 株式会社東芝 Multi-element processing system
US5713017A (en) 1995-06-07 1998-01-27 International Business Machines Corporation Dual counter consistency control for fault tolerant network file servers
JPH103421A (en) 1995-11-20 1998-01-06 Matsushita Electric Ind Co Ltd Virtual file management system
US5787247A (en) 1996-07-12 1998-07-28 Microsoft Corporation Replica administration without data loss in a store and forward replication enterprise
US5924094A (en) 1996-11-01 1999-07-13 Current Network Technologies Corporation Independent distributed database system
US6021118A (en) 1997-02-10 2000-02-01 Lucent Techologies Inc. Synchronization methods for distributed processing systems having replicated data
US6003065A (en) 1997-04-24 1999-12-14 Sun Microsystems, Inc. Method and system for distributed processing of applications on host and peripheral devices
US6259701B1 (en) 1997-09-11 2001-07-10 At&T Corp. Method and system for a unicast endpoint client to access a multicast internet protocol (IP) session
US6055543A (en) 1997-11-21 2000-04-25 Verano File wrapper containing cataloging information for content searching across multiple platforms
EP1049988B1 (en) 1998-01-23 2002-09-04 Emc Corporation Content addressable information encapsulation, representation, and transfer
JPH11249874A (en) * 1998-02-27 1999-09-17 Toshiba Corp Computer system and its synchronous processing method and recording medium
US6510162B1 (en) 1998-05-27 2003-01-21 3Com Corporation System and method for managing channel usage in a data over cable system
JP4146983B2 (en) 1999-02-26 2008-09-10 インターナショナル・ビジネス・マシーンズ・コーポレーション Process method and data processing system for calling method of server object
US6658016B1 (en) 1999-03-05 2003-12-02 Broadcom Corporation Packet switching fabric having a segmented ring with token based resource control protocol and output queuing control
US6401120B1 (en) * 1999-03-26 2002-06-04 Microsoft Corporation Method and system for consistent cluster operational data in a server cluster using a quorum of replicas
US7774469B2 (en) * 1999-03-26 2010-08-10 Massa Michael T Consistent cluster operational data in a server cluster using a quorum of replicas
US6389432B1 (en) 1999-04-05 2002-05-14 Auspex Systems, Inc. Intelligent virtual volume access
JP2000322292A (en) 1999-05-10 2000-11-24 Nec Corp Cluster type data server system and data storage method
US6952741B1 (en) 1999-06-30 2005-10-04 Computer Sciences Corporation System and method for synchronizing copies of data in a computer system
US7634453B1 (en) 1999-08-13 2009-12-15 Storage Technology Corporation Distributed file data location
US6976165B1 (en) 1999-09-07 2005-12-13 Emc Corporation System and method for secure storage, transfer and retrieval of content addressable information
US7934251B2 (en) 1999-12-02 2011-04-26 Western Digital Technologies, Inc. Managed peer-to-peer applications, systems and methods for distributed data access and storage
US6499090B1 (en) 1999-12-28 2002-12-24 Intel Corporation Prioritized bus request scheduling mechanism for processing devices
US6546388B1 (en) 2000-01-14 2003-04-08 International Business Machines Corporation Metadata search results ranking system
US6542972B2 (en) 2000-01-31 2003-04-01 Commvault Systems, Inc. Logical view and access to physical storage in modular data and storage management system
US6738766B2 (en) 2000-02-02 2004-05-18 Doongo Technologies, Inc. Apparatus and methods for providing personalized application search results for wireless devices based on user profiles
US7506034B2 (en) 2000-03-03 2009-03-17 Intel Corporation Methods and apparatus for off loading content servers through direct file transfer from a storage center to an end-user
US6952737B1 (en) 2000-03-03 2005-10-04 Intel Corporation Method and apparatus for accessing remote storage in a distributed storage cluster architecture
US7428540B1 (en) * 2000-03-03 2008-09-23 Intel Corporation Network storage system
US6470420B1 (en) 2000-03-31 2002-10-22 Western Digital Ventures, Inc. Method for designating one of a plurality of addressable storage devices to process a data transfer request
AU2001259402A1 (en) 2000-05-02 2001-11-12 Sun Microsystems, Inc. Cluster membership monitor
US8281022B1 (en) * 2000-06-30 2012-10-02 Emc Corporation Method and apparatus for implementing high-performance, scaleable data processing and storage systems
US6826564B2 (en) 2000-07-10 2004-11-30 Fastforward Networks Scalable and programmable query distribution and collection in a network of queryable devices
US6732237B1 (en) 2000-08-29 2004-05-04 Oracle International Corporation Multi-tier caching system
US7406484B1 (en) 2000-09-12 2008-07-29 Tbrix, Inc. Storage allocation in a distributed segmented file system
US6782389B1 (en) 2000-09-12 2004-08-24 Ibrix, Inc. Distributing files across multiple, permissibly heterogeneous, storage devices
US20040236798A1 (en) 2001-09-11 2004-11-25 Sudhir Srinivasan Migration of control in a distributed segmented file system
US7272613B2 (en) 2000-10-26 2007-09-18 Intel Corporation Method and system for managing distributed content and related metadata
US6970939B2 (en) 2000-10-26 2005-11-29 Intel Corporation Method and apparatus for large payload distribution in a network
SE520129C2 (en) 2000-10-27 2003-05-27 Terraplay Systems Ab Communication infrastructure device in and a computer-readable software product for a multi-user application data processing system
US6985956B2 (en) * 2000-11-02 2006-01-10 Sun Microsystems, Inc. Switching system
AU2002232411A1 (en) 2000-11-28 2002-06-11 Gregory L. Gingerich A method and system for software and hardware multiplicity
US7165096B2 (en) 2000-12-22 2007-01-16 Data Plow, Inc. Storage area network file system
DE50110186D1 (en) 2000-12-27 2006-07-27 Bsh Bosch Siemens Hausgeraete METHOD AND DEVICE FOR DEHUMIDIFYING CLOTHES
US6768871B2 (en) 2001-01-30 2004-07-27 The Regents Of The University Of California Optical layer multicasting using a multicast switch to effect survivability and security
US6865603B2 (en) 2001-01-31 2005-03-08 Hewlett-Packard Development Company, L.P. Correcting for network address changes
WO2002065329A1 (en) 2001-02-14 2002-08-22 The Escher Group, Ltd. Peer-to peer enterprise storage
US20020156912A1 (en) 2001-02-15 2002-10-24 Hurst John T. Programming content distribution
US7062490B2 (en) 2001-03-26 2006-06-13 Microsoft Corporation Serverless distributed file system
US6839815B2 (en) 2001-05-07 2005-01-04 Hitachi, Ltd. System and method for storage on demand service in a global SAN environment
US6918013B2 (en) 2001-07-16 2005-07-12 Bea Systems, Inc. System and method for flushing bean cache
US7039622B2 (en) 2001-09-12 2006-05-02 Sas Institute Inc. Computer-implemented knowledge repository interface system and method
US7054867B2 (en) * 2001-09-18 2006-05-30 Skyris Networks, Inc. Systems, methods and programming for routing and indexing globally addressable objects and associated business models
GB2381427A (en) 2001-10-27 2003-04-30 Hewlett Packard Co Spanning tree in peer to peer networks
US7975016B2 (en) * 2001-10-29 2011-07-05 Oracle America, Inc. Method to manage high availability equipments
US7054910B1 (en) 2001-12-20 2006-05-30 Emc Corporation Data replication facility for distributed computing environments
US6917941B2 (en) 2001-12-28 2005-07-12 Channel Intelligence, Inc. Method and apparatus for creation and maintenance of database structure
JP4202026B2 (en) * 2002-01-31 2008-12-24 株式会社アンソナ Storage system and storage device
US7243103B2 (en) * 2002-02-14 2007-07-10 The Escher Group, Ltd. Peer to peer enterprise storage system with lexical recovery sub-system
JP4198920B2 (en) 2002-02-26 2008-12-17 エイディシーテクノロジー株式会社 Backup system, backup program and backup method
US7020665B2 (en) 2002-03-07 2006-03-28 Microsoft Corporation File availability in distributed file storage systems
JP2003271316A (en) 2002-03-14 2003-09-26 Hitachi Ltd Storage system, its operation program and its operating method, information processing terminal and its operation program and data managing system
US7257645B2 (en) 2002-05-01 2007-08-14 Bea Systems, Inc. System and method for storing large messages
US7305585B2 (en) 2002-05-23 2007-12-04 Exludus Technologies Inc. Asynchronous and autonomous data replication
US7117294B1 (en) * 2002-05-28 2006-10-03 Oracle International Corporation Method and system for archiving and compacting data in a data storage array
US7574488B2 (en) 2002-05-31 2009-08-11 Hitachi, Ltd. Method and apparatus for peer-to-peer file sharing
US6732171B2 (en) 2002-05-31 2004-05-04 Lefthand Networks, Inc. Distributed network storage system with virtualization
US20030233455A1 (en) 2002-06-14 2003-12-18 Mike Leber Distributed file sharing system
US7631313B2 (en) 2002-06-17 2009-12-08 David Mayhew System and method for transferring data
US8060598B1 (en) 2002-07-01 2011-11-15 Sprint Communications Company L.P. Computer network multicasting traffic monitoring and compensation
JP4240930B2 (en) 2002-07-15 2009-03-18 株式会社日立製作所 Method and apparatus for unifying temporary transmission of multiple network storages
DE10237875A1 (en) 2002-08-19 2004-03-04 Siemens Ag Device, in particular automation device, with a file directory structure stored in a file
US7363346B2 (en) * 2002-09-07 2008-04-22 Appistry, Inc. Reliably storing information across multiple computers such as in a hive of computers
US7925623B2 (en) 2002-09-10 2011-04-12 Exagrid Systems, Inc. Method and apparatus for integrating primary data storage with local and remote data protection
JP4254178B2 (en) * 2002-09-11 2009-04-15 富士ゼロックス株式会社 Distributed storage control apparatus and method
US7206836B2 (en) 2002-09-23 2007-04-17 Sun Microsystems, Inc. System and method for reforming a distributed data system cluster after temporary node failures or restarts
US7146499B2 (en) * 2002-09-30 2006-12-05 International Business Machines Corporation Security system for replicated storage devices on computer networks
CA2500166A1 (en) 2002-10-29 2004-05-13 British Telecommunications Public Limited Company Method and apparatus for network management
US7328243B2 (en) 2002-10-31 2008-02-05 Sun Microsystems, Inc. Collaborative content coherence using mobile agents in peer-to-peer networks
US7565419B1 (en) 2002-11-22 2009-07-21 Symantec Operating Corporation Conflict resolution in a peer to peer network
US20040139167A1 (en) 2002-12-06 2004-07-15 Andiamo Systems Inc., A Delaware Corporation Apparatus and method for a scalable network attach storage system
US7624158B2 (en) 2003-01-14 2009-11-24 Eycast Inc. Method and apparatus for transmission and storage of digital medical data
US7320009B1 (en) 2003-03-28 2008-01-15 Novell, Inc. Methods and systems for file replication utilizing differences between versions of files
US7328256B2 (en) 2003-06-02 2008-02-05 Apple Inc. Method and apparatus for distributing computer files across a network to multiple clients
US20040260775A1 (en) 2003-06-20 2004-12-23 Xerox Corporation System and method for sending messages
US7694086B1 (en) 2003-06-30 2010-04-06 Symantec Operating Corporation Method and system for incremental backup of data volumes
US7523217B2 (en) 2003-07-15 2009-04-21 Hewlett-Packard Development Company, L.P. System and method having improved efficiency and reliability for distributing a file among a plurality of recipients
US20050015461A1 (en) 2003-07-17 2005-01-20 Bruno Richard Distributed file system
JP2005044003A (en) 2003-07-23 2005-02-17 Fujitsu Ltd Authentication apparatus, method and program
US6983429B2 (en) 2003-09-30 2006-01-03 Bull Hn Information Systems Inc. Formal proof methods for analyzing circuit loading problems under operating conditions
US20130097302A9 (en) 2003-10-01 2013-04-18 Robert Khedouri Audio visual player apparatus and system and method of content distribution using the same
WO2005042713A2 (en) 2003-10-28 2005-05-12 The Johns Hopkins University Quantitative multiplex methylation-specific pcr
US7340510B1 (en) * 2003-11-18 2008-03-04 Cisco Technology, Inc. Content delivery network (CDN) replication status reporter
JP2005165516A (en) * 2003-12-01 2005-06-23 Hitachi Ltd Storage controller, storage system and control method for storage system
US7376945B1 (en) 2003-12-02 2008-05-20 Cisco Technology, Inc. Software change modeling for network devices
US7039661B1 (en) 2003-12-29 2006-05-02 Veritas Operating Corporation Coordinated dirty block tracking
US7822711B1 (en) 2003-12-31 2010-10-26 Symantec Operating Corporation Conflict resolution for a distributed file sharing system
US8566446B2 (en) * 2004-01-28 2013-10-22 Hewlett-Packard Development Company, L.P. Write operation control in storage networks
US7383463B2 (en) * 2004-02-04 2008-06-03 Emc Corporation Internet protocol based disaster recovery of a server
US7385978B1 (en) * 2004-02-19 2008-06-10 Cisco Technology, Inc. Method and apparatus for reliable multicast distribution
US9160571B2 (en) 2004-03-11 2015-10-13 Hewlett-Packard Development Company, L.P. Requesting a service from a multicast network
JP4448719B2 (en) 2004-03-19 2010-04-14 株式会社日立製作所 Storage system
JP2005276094A (en) * 2004-03-26 2005-10-06 Hitachi Ltd Program, distributed storage system and method for managing file for distributed storage unit
US7503052B2 (en) 2004-04-14 2009-03-10 Microsoft Corporation Asynchronous database API
US20060023969A1 (en) 2004-04-30 2006-02-02 Lara Eyal D Collaboration and multimedia authoring
ATE390013T1 (en) 2004-05-18 2008-04-15 British Telecomm PEER-TO-PEER NETWORKS
US7490089B1 (en) 2004-06-01 2009-02-10 Sanbolic, Inc. Methods and apparatus facilitating access to shared storage among multiple computers
US7634566B2 (en) 2004-06-03 2009-12-15 Cisco Technology, Inc. Arrangement in a network for passing control of distributed data between network nodes for optimized client access based on locality
US7330997B1 (en) * 2004-06-03 2008-02-12 Gary Odom Selective reciprocal backup
US7873650B1 (en) 2004-06-11 2011-01-18 Seisint, Inc. System and method for distributing data in a parallel processing system
US20050278552A1 (en) * 2004-06-14 2005-12-15 Vincent Delisle Secure virtual account
US20060031230A1 (en) 2004-07-21 2006-02-09 Kumar Sinha M Data storage systems
US20060047776A1 (en) 2004-08-31 2006-03-02 Chieng Stephen S Automated failover in a cluster of geographically dispersed server nodes using data replication over a long distance communication link
US20060080574A1 (en) * 2004-10-08 2006-04-13 Yasushi Saito Redundant data storage reconfiguration
US8090776B2 (en) 2004-11-01 2012-01-03 Microsoft Corporation Dynamic content change notification
JP4222295B2 (en) 2004-11-19 2009-02-12 パナソニック株式会社 Video server and video distribution system using the same
US7631023B1 (en) 2004-11-24 2009-12-08 Symantec Operating Corporation Performance-adjusted data allocation in a multi-device file system
JP4451293B2 (en) 2004-12-10 2010-04-14 株式会社日立製作所 Network storage system of cluster configuration sharing name space and control method thereof
US7320088B1 (en) * 2004-12-28 2008-01-15 Veritas Operating Corporation System and method to automate replication in a clustered environment
CA2593542C (en) 2005-01-07 2012-02-28 Thomson Global Resources Systems, methods, and software for distributed loading of databases
JP4843976B2 (en) * 2005-03-25 2011-12-21 日本電気株式会社 Replication systems and methods
US7454426B2 (en) 2005-04-12 2008-11-18 International Business Machines Corporation Referential integrity across a distributed directory
JP2006293864A (en) * 2005-04-13 2006-10-26 Hitachi Ltd Storage system, data movement management system, and data movement management method
US7631016B2 (en) 2005-05-04 2009-12-08 Oracle International Corporation Providing the latest version of a data item from an N-replica set
US7698391B2 (en) * 2005-05-16 2010-04-13 Oracle International Corporation Performing a provisioning operation associated with a software application on a subset of the nodes on which the software application is to operate
WO2006124911A2 (en) 2005-05-18 2006-11-23 Ibrix, Inc. Balanced computer architecture
CA2611527A1 (en) 2005-06-09 2006-12-21 Whirlpool Corporation Software architecture system and method for communication with, and management of, at least one component within a household appliance
US7523146B2 (en) 2005-06-21 2009-04-21 Apple Inc. Apparatus and method for peer-to-peer N-way synchronization in a decentralized environment
US8401997B1 (en) 2005-06-30 2013-03-19 Symantec Operating Corporation System and method for replication using consistency interval markers in a distributed storage environment
US7631045B2 (en) 2005-07-14 2009-12-08 Yahoo! Inc. Content router asynchronous exchange
US7571168B2 (en) 2005-07-25 2009-08-04 Parascale, Inc. Asynchronous file replication and migration in a storage network
US9305011B2 (en) 2005-07-27 2016-04-05 Hitachi Data Systems Corporation Method for improving mean time to data loss (MTDL) in a fixed content distributed data storage
US20070028291A1 (en) * 2005-07-29 2007-02-01 Bit 9, Inc. Parametric content control in a network security system
US7568069B2 (en) 2005-07-29 2009-07-28 Lsi Corporation Method for creating a large-scale storage array system out of multiple mid-range storage arrays
JP4747733B2 (en) * 2005-08-22 2011-08-17 ブラザー工業株式会社 Node device, shared information update processing program, shared information update method, and information sharing system
US20070055703A1 (en) 2005-09-07 2007-03-08 Eyal Zimran Namespace server using referral protocols
US9996413B2 (en) 2007-10-09 2018-06-12 International Business Machines Corporation Ensuring data integrity on a dispersed storage grid
US7752211B1 (en) * 2005-09-30 2010-07-06 Emc Corporation Adaptive index processing
US7558859B2 (en) 2005-10-17 2009-07-07 Microsoft Corporation Peer-to-peer auction based data distribution
US7788303B2 (en) 2005-10-21 2010-08-31 Isilon Systems, Inc. Systems and methods for distributed system scanning
JP2009515278A (en) 2005-11-04 2009-04-09 トムソン ライセンシング Method and apparatus for managing media storage devices
CN101361316B (en) 2005-11-23 2011-12-14 想象It公司 Message broadcasting admission control system and method
EP1798934A1 (en) 2005-12-13 2007-06-20 Deutsche Thomson-Brandt Gmbh Method and apparatus for organizing nodes in a network
US7716180B2 (en) 2005-12-29 2010-05-11 Amazon Technologies, Inc. Distributed storage system with web services client interface
US8392400B1 (en) * 2005-12-29 2013-03-05 Amazon Technologies, Inc. Method and apparatus for stress management in a searchable data service
US7778972B1 (en) 2005-12-29 2010-08-17 Amazon Technologies, Inc. Dynamic object replication within a distributed storage system
US7546484B2 (en) * 2006-02-08 2009-06-09 Microsoft Corporation Managing backup solutions with light-weight storage nodes
US7623474B2 (en) 2006-02-14 2009-11-24 Cisco Technology, Inc. Techniques for distributing information using multicast subsets
US7552148B2 (en) * 2006-02-28 2009-06-23 Microsoft Corporation Shutdown recovery
US8185576B2 (en) 2006-03-14 2012-05-22 Altnet, Inc. Filter for a distributed network
US7778183B2 (en) 2006-03-31 2010-08-17 International Business Machines Corporation Data replica selector
US7480817B2 (en) 2006-03-31 2009-01-20 International Business Machines Corporation Method for replicating data based on probability of concurrent failure
US20070288638A1 (en) 2006-04-03 2007-12-13 British Columbia, University Of Methods and distributed systems for data location and delivery
US7979771B2 (en) 2006-04-04 2011-07-12 Permabit Technology Corporation Erasure coding technique for scalable and fault tolerant storage system
US20070255763A1 (en) 2006-04-27 2007-11-01 International Business Machines Corporation Database replication method and system
US20080126357A1 (en) 2006-05-04 2008-05-29 Wambo, Inc. Distributed file storage and transmission system
JP5584910B2 (en) 2006-05-23 2014-09-10 ノーリャン・ホールディング・コーポレイション Distributed storage
US8255420B2 (en) 2006-05-23 2012-08-28 Noryan Holding Corporation Distributed storage
US20080005195A1 (en) 2006-06-30 2008-01-03 Microsoft Corporation Versioning synchronization for mass p2p file sharing
US8117155B2 (en) 2006-06-30 2012-02-14 Microsoft Corporation Collection-based object replication
US7546486B2 (en) 2006-08-28 2009-06-09 Bycast Inc. Scalable distributed object management in a distributed fixed content storage system
US20080077635A1 (en) 2006-09-22 2008-03-27 Digital Bazaar, Inc. Highly Available Clustered Storage Network
US7840992B1 (en) * 2006-09-28 2010-11-23 Emc Corporation System and method for environmentally aware data protection
US7680048B2 (en) 2006-10-06 2010-03-16 International Business Machiens Corporation Method and apparatus for routing data in an inter-nodal communications lattice of a massively parallel computer system by dynamically adjusting local routing strategies
US8176265B2 (en) 2006-10-30 2012-05-08 Nvidia Corporation Shared single-access memory with management of multiple parallel requests
US8094585B2 (en) 2006-10-31 2012-01-10 International Business Machines Corporation Membership management of network nodes
US8555335B2 (en) 2006-11-01 2013-10-08 Microsoft Corporation Securing distributed application information delivery
US8190561B1 (en) 2006-12-06 2012-05-29 At&T Mobility Ii Llc LDAP replication priority queuing mechanism
US7590672B2 (en) 2006-12-11 2009-09-15 Bycast Inc. Identification of fixed content objects in a distributed fixed content storage system
GB2445986A (en) 2007-01-17 2008-07-30 Connect Spot Ltd Database Update Systems for Wireless communications Systems
US9015342B2 (en) * 2007-01-22 2015-04-21 Xerox Corporation Two-level structured overlay design for cluster management in a peer-to-peer network
ATE485666T1 (en) * 2007-02-22 2010-11-15 Ericsson Telefon Ab L M OVERLAY NETWORK WITH UNIFORM AND FAULT-TOLERANT DISTRIBUTED HASH TABLE (DHT)
US8635691B2 (en) 2007-03-02 2014-01-21 403 Labs, Llc Sensitive data scanner
US7584294B2 (en) 2007-03-12 2009-09-01 Citrix Systems, Inc. Systems and methods for prefetching objects for caching using QOS
JP2008234445A (en) * 2007-03-22 2008-10-02 Brother Ind Ltd Content distributed storage system, duplicate data acquisition method, node device, and node processing program
US8150800B2 (en) * 2007-03-28 2012-04-03 Netapp, Inc. Advanced clock synchronization technique
JP2008250773A (en) 2007-03-30 2008-10-16 Brother Ind Ltd Information distribution system, program for managing device, and program for information processor
JP4696089B2 (en) * 2007-03-30 2011-06-08 三菱電機インフォメーションシステムズ株式会社 Distributed storage system
US7975115B2 (en) 2007-04-11 2011-07-05 Dot Hill Systems Corporation Method and apparatus for separating snapshot preserved and write data
US20080263183A1 (en) * 2007-04-20 2008-10-23 Lisa Midori Nishiyama Management of Kernel configurations for nodes in a clustered system
US8706914B2 (en) 2007-04-23 2014-04-22 David D. Duchesneau Computing infrastructure
TWI483584B (en) * 2007-06-04 2015-05-01 Graco Minnesota Inc Distributed monitoring and control fluid handling system
US7676704B2 (en) 2007-06-29 2010-03-09 Symantec Corporation Resource management for scalable file system recovery
WO2009032711A1 (en) 2007-08-29 2009-03-12 Nirvanix, Inc. Policy-based file management for a storage delivery network
US8156117B2 (en) 2007-09-03 2012-04-10 Obschestvo S Ogranichennoi Otvetstvennostiyu “Meralabs” Method and system for storing, searching and retrieving information based on semistructured and de-centralized data sets
US8533256B2 (en) 2007-10-09 2013-09-10 Cleversafe, Inc. Object interface to a dispersed data storage network
US8185614B2 (en) 2007-10-09 2012-05-22 Cleversafe, Inc. Systems, methods, and apparatus for identifying accessible dispersed digital storage vaults utilizing a centralized registry
US7979662B2 (en) 2007-12-28 2011-07-12 Sandisk Il Ltd. Storage device with transaction indexing capability
US7913030B2 (en) 2007-12-28 2011-03-22 Sandisk Il Ltd. Storage device with transaction logging capability
US7899850B2 (en) 2008-02-22 2011-03-01 Bycast, Inc. Relational objects for the optimized management of fixed-content storage systems
US20090228669A1 (en) 2008-03-10 2009-09-10 Microsoft Corporation Storage Device Optimization Using File Characteristics
US20090249222A1 (en) 2008-03-25 2009-10-01 Square Products Corporation System and method for simultaneous media presentation
US8577957B2 (en) 2008-04-01 2013-11-05 Litl Llc System and method for streamlining user interaction with electronic content
JP2009259007A (en) 2008-04-17 2009-11-05 Nippon Telegr & Teleph Corp <Ntt> Distributed storage method, distributed storage system and distributed storage device
US8296398B2 (en) 2008-04-29 2012-10-23 Overland Storage, Inc. Peer-to-peer redundant file server system and methods
US20100010975A1 (en) * 2008-07-10 2010-01-14 Morris Robert P Methods And Systems For Resolving A Query Region To A Network Identifier
US7869383B2 (en) * 2008-07-24 2011-01-11 Symform, Inc. Shared community storage network
US8255430B2 (en) 2008-08-26 2012-08-28 Caringo, Inc. Shared namespace for storage clusters
US8458128B2 (en) 2008-08-26 2013-06-04 Microsoft Corporation Minimal extensions required for multi-master offline and collaboration for devices and web services
US9390102B2 (en) 2008-09-29 2016-07-12 Oracle International Corporation Client application program interface for network-attached storage system
EP2350854B1 (en) 2008-10-17 2018-12-05 Ericsson AB Method and apparatus for efficient http data streaming
US8347386B2 (en) 2008-10-21 2013-01-01 Lookout, Inc. System and method for server-coupled malware prevention
US9781148B2 (en) 2008-10-21 2017-10-03 Lookout, Inc. Methods and systems for sharing risk responses between collections of mobile communications devices
US8443062B2 (en) * 2008-10-23 2013-05-14 Microsoft Corporation Quorum based transactionally consistent membership management in distributed storage systems
SE533007C2 (en) 2008-10-24 2010-06-08 Ilt Productions Ab Distributed data storage
KR101285113B1 (en) 2008-10-31 2013-07-17 에스케이플래닛 주식회사 A system, a method, a service server, a mobile terminal and a storage means for contents transmission
US8898236B2 (en) 2008-10-31 2014-11-25 Netapp, Inc. Automated conversion of versioned data collections
US8561052B2 (en) 2008-12-08 2013-10-15 Harris Corporation Communications device with a plurality of processors and compatibility synchronization module for processor upgrades and related method
WO2010080533A2 (en) 2008-12-18 2010-07-15 Bizanga Ltd. Multipurpose storage system based upon a distributed hashing mechanism with transactional support and failover capability
US20100185693A1 (en) 2009-01-20 2010-07-22 Murty Venkataesh V Methods and apparatus for creating an audit trail
US8832023B2 (en) 2009-01-30 2014-09-09 Apple Inc. System for managing distributed assets and metadata
US8165122B2 (en) 2009-05-26 2012-04-24 Alcatel Lucent System and method for converting unicast client requests into multicast client requests
US8533151B2 (en) 2009-05-26 2013-09-10 Microsoft Corporation Generating a local copy of a virtualized application package from a local installation
US20130254314A1 (en) 2009-06-09 2013-09-26 Edmond K. Chow Digital content delivery
US8504797B2 (en) 2009-06-02 2013-08-06 Hitachi, Ltd. Method and apparatus for managing thin provisioning volume by using file storage system
US10108492B2 (en) 2009-07-30 2018-10-23 International Business Machines Corporation Rebuilding data stored in a dispersed storage network
US8458287B2 (en) 2009-07-31 2013-06-04 Microsoft Corporation Erasure coded storage aggregation in data centers
US20110035540A1 (en) 2009-08-10 2011-02-10 Adtron, Inc. Flash blade system architecture and method
US9189244B2 (en) 2009-08-18 2015-11-17 Adobe Systems Incorporated Methods and systems for managing data service specifications
US20110047413A1 (en) 2009-08-20 2011-02-24 Mcgill Robert E Methods and devices for detecting service failures and maintaining computing services using a resilient intelligent client computer
US8745170B2 (en) 2009-08-27 2014-06-03 Apple Inc. Dynamic file streaming
WO2011034625A1 (en) 2009-09-21 2011-03-24 Translattice, Inc. Distributed content storage and retrieval
US8745342B2 (en) 2009-09-24 2014-06-03 Hitachi Ltd. Computer system for controlling backups using wide area network
US8620879B2 (en) 2009-10-13 2013-12-31 Google Inc. Cloud based file storage service
CN101710339B (en) 2009-11-20 2012-02-01 中国科学院计算技术研究所 Method and system for controlling data storage in cluster file system and method for creating file
US8190578B2 (en) 2009-12-17 2012-05-29 International Business Machines Corporation Migration of versioned data between configuration management systems
US9135268B2 (en) 2009-12-30 2015-09-15 Symantec Corporation Locating the latest version of replicated data files
US8707091B2 (en) 2010-03-15 2014-04-22 Cleversafe, Inc. Failsafe directory file system in a dispersed storage network
CN102985911B (en) 2010-03-16 2016-07-06 科派恩股份有限公司 Telescopic in height and distributed data de-duplication
US20110238909A1 (en) 2010-03-29 2011-09-29 Pankaj Kumar Multicasting Write Requests To Multiple Storage Controllers
EP2712149B1 (en) 2010-04-23 2019-10-30 Compuverde AB Distributed data storage
WO2011156746A2 (en) 2010-06-11 2011-12-15 California Institute Of Technology Systems and methods for rapid processing and storage of data
US8468214B1 (en) 2010-06-15 2013-06-18 Proximetry, Inc. Systems and methods for distributing content using attributes
WO2011161849A1 (en) 2010-06-22 2011-12-29 株式会社ソニー・コンピュータエンタテインメント Information processing device
CN101909058B (en) 2010-07-30 2013-01-16 天维讯达无线电设备检测(北京)有限责任公司 Platform authentication strategy management method and system suitable for credible connecting architecture
US8495472B1 (en) 2010-08-06 2013-07-23 Amazon Technologies, Inc. Method and system for performing financial reconciliation between two systems using checksums
GB2544888A (en) 2010-09-08 2017-05-31 Saffron Digital Ltd Delivering a file from a content provider to a client
US9253199B2 (en) 2010-09-09 2016-02-02 Red Hat, Inc. Verifying authenticity of a sender of an electronic message sent to a recipient using message salt
US8504758B1 (en) 2010-09-21 2013-08-06 Amazon Technologies, Inc. System and method for logical deletion of stored data objects
US8660986B2 (en) 2010-10-27 2014-02-25 Microsoft Corporation Preserving user intent in merging ordered objects
KR101703925B1 (en) 2010-11-05 2017-02-07 인터디지탈 패튼 홀딩스, 인크 Device validation, distress indication, and remediation
US9471593B1 (en) 2010-12-30 2016-10-18 Emc Corporation Method and apparatus for ensuring consistent ordering of writes in a distributed database storage system
US8949828B2 (en) 2011-01-11 2015-02-03 International Business Machines Corporation Single point, scalable data synchronization for management of a virtual input/output server cluster
US9020996B2 (en) 2011-06-24 2015-04-28 Stephen P. LORD Synthetic view
US9268665B2 (en) 2011-07-26 2016-02-23 Trimble Navigation Limited System and method for identifying fault prone computer code files
US9626378B2 (en) 2011-09-02 2017-04-18 Compuverde Ab Method for handling requests in a storage system and a storage node for a storage system
US8769138B2 (en) 2011-09-02 2014-07-01 Compuverde Ab Method for data retrieval from a distributed data storage system
US9021053B2 (en) 2011-09-02 2015-04-28 Compuverde Ab Method and device for writing data to a data storage system comprising a plurality of data storage nodes
US8997124B2 (en) 2011-09-02 2015-03-31 Compuverde Ab Method for updating data in a distributed data storage system
US8645978B2 (en) 2011-09-02 2014-02-04 Compuverde Ab Method for data maintenance
US8650365B2 (en) 2011-09-02 2014-02-11 Compuverde Ab Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
US9275063B1 (en) 2011-09-30 2016-03-01 Emc Corporation Replication optimizated IO
US9225780B2 (en) 2012-02-24 2015-12-29 Xyratex Technology Limited Data integrity in a networked storage system
US20130268632A1 (en) 2012-04-05 2013-10-10 Canon Kabushiki Kaisha Server assisted authenticated device
US8972478B1 (en) 2012-05-23 2015-03-03 Netapp, Inc. Using append only log format in data storage cluster with distributed zones for determining parity of reliability groups
US9256765B2 (en) 2012-06-29 2016-02-09 Kip Sign P1 Lp System and method for identifying software changes
US9344521B2 (en) 2012-12-13 2016-05-17 Red Hat, Inc. Pluggable infrastructure for cloud provider selection
US9367448B1 (en) 2013-06-04 2016-06-14 Emc Corporation Method and system for determining data integrity for garbage collection of data storage systems
US10025673B1 (en) 2013-09-20 2018-07-17 Amazon Technologies, Inc. Restoring partitioned database tables from backup
US9280678B2 (en) 2013-12-02 2016-03-08 Fortinet, Inc. Secure cloud storage distribution and aggregation
WO2015104833A1 (en) 2014-01-10 2015-07-16 株式会社日立製作所 Information system and i/o processing method
US20150288659A1 (en) 2014-04-03 2015-10-08 Bitdefender IPR Management Ltd. Systems and Methods for Mutual Integrity Attestation Between A Network Endpoint And A Network Appliance
US10491568B1 (en) 2014-05-21 2019-11-26 Amazon Technologies, Inc. Management of encrypted data storage
JP6708948B2 (en) 2016-01-21 2020-06-10 日本電気株式会社 Block storage
US10102356B1 (en) 2016-03-09 2018-10-16 EMC IP Holding Company LLC Securing storage control path against unauthorized access
JP6348527B2 (en) 2016-03-10 2018-06-27 本田技研工業株式会社 Car body rear structure
KR102527992B1 (en) 2016-03-14 2023-05-03 삼성전자주식회사 Data storage device and data processing system having the same
US10810088B1 (en) 2016-05-13 2020-10-20 NortonLifeLock Inc. System and method of dynamic backup policy generation
US10567406B2 (en) 2016-08-16 2020-02-18 International Business Machines Corporation Cloud computing environment activity monitoring
US10846137B2 (en) 2018-01-12 2020-11-24 Robin Systems, Inc. Dynamic adjustment of application resources in a distributed computing system
US11106810B2 (en) 2018-07-30 2021-08-31 EMC IP Holding Company LLC Multi-tenant deduplication with non-trusted storage system
US10877683B2 (en) 2019-04-09 2020-12-29 International Business Machines Corporation Tiered storage optimization and migration

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7266556B1 (en) * 2000-12-29 2007-09-04 Intel Corporation Failover architecture for a distributed storage system
CN1726454A (en) * 2002-10-17 2006-01-25 英特尔公司 A distributed network attached storage system

Also Published As

Publication number Publication date
WO2010046393A3 (en) 2013-02-21
US20230013449A1 (en) 2023-01-19
US20190266174A1 (en) 2019-08-29
EP2908257A1 (en) 2015-08-19
SE533007C2 (en) 2010-06-08
JP2012506582A (en) 2012-03-15
EP2342663B1 (en) 2015-03-11
EP2342663A2 (en) 2011-07-13
MX2011004240A (en) 2011-08-15
EP2908257B1 (en) 2019-09-25
US10650022B2 (en) 2020-05-12
US20110295807A1 (en) 2011-12-01
EP3617897A1 (en) 2020-03-04
EP3617897B1 (en) 2022-04-06
US11907256B2 (en) 2024-02-20
JP5553364B2 (en) 2014-07-16
KR20110086114A (en) 2011-07-27
US9329955B2 (en) 2016-05-03
CN102301367A (en) 2011-12-28
US20120030170A1 (en) 2012-02-02
EA201100545A1 (en) 2012-01-30
US20160212212A1 (en) 2016-07-21
US20140149351A1 (en) 2014-05-29
US9026559B2 (en) 2015-05-05
BRPI0914437A2 (en) 2016-05-24
AU2009306386A1 (en) 2010-04-29
US8688630B2 (en) 2014-04-01
US20120023179A1 (en) 2012-01-26
ES2538129T3 (en) 2015-06-17
AU2009306386B2 (en) 2015-02-05
ZA201103754B (en) 2012-01-25
US11468088B2 (en) 2022-10-11
SE0802277A1 (en) 2010-04-25
WO2010046393A2 (en) 2010-04-29
CA2741477A1 (en) 2010-04-29
DK2342663T3 (en) 2015-06-08
US9495432B2 (en) 2016-11-15
CA2741477C (en) 2016-12-13
KR101635238B1 (en) 2016-06-30

Similar Documents

Publication Publication Date Title
CN102301367B (en) Distributed data storage
KR101905198B1 (en) Distributed data storage
US8843710B2 (en) Method and device for maintaining data in a data storage system comprising a plurality of data storage nodes
EP2751716B1 (en) Method for data maintenance

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent of invention or patent application
CB02 Change of applicant information

Address after: Sweden Karlskrona

Applicant after: COMPUVERDE AB

Address before: Sweden Karlskrona

Applicant before: Ilt Productions Ab

COR Change of bibliographic data

Free format text: CORRECT: APPLICANT; FROM: ILT PRODUCTIONS AB TO: KEMPEWARD CORPORATION

C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150121

Termination date: 20201021

CF01 Termination of patent right due to non-payment of annual fee