US20060259811A1 - System and a method for asynchronous replication for storage area networks - Google Patents
System and a method for asynchronous replication for storage area networks Download PDFInfo
- Publication number
- US20060259811A1 US20060259811A1 US11/487,634 US48763406A US2006259811A1 US 20060259811 A1 US20060259811 A1 US 20060259811A1 US 48763406 A US48763406 A US 48763406A US 2006259811 A1 US2006259811 A1 US 2006259811A1
- Authority
- US
- United States
- Prior art keywords
- data
- recovery
- storage device
- backup
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1471—Saving, restoring, recovering or retrying involving logging of persistent data for recovery
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/82—Solving problems relating to consistency
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/835—Timestamp
Definitions
- a computer program listing appendix is submitted herewith on one compact disc and one duplicate compact disc.
- the total number of compact discs including duplicates is two.
- the files on the compact discs are software object code for carrying out the preferred embodiment of the invention.
- the present invention relates to systems and methods for backup and recovery of information used with geographically dispersed information processing environments.
- the present invention seeks to provide improved systems and methods for backup and recovery of data for geographically dispersed information processing environments and storage area networks.
- a data backup and recovery system for use with at least one server interconnected with at least one storage device, the data backup and recovery system including at least one data recovery device, at least one data recovery storage device associated with and controlled by the at least one data recovery device and at least one data communication monitor for providing to the at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of the at least one server and the at least one storage device, the at least one data recovery device being responsive to at least the control information bearing an order stamp for storing data on the at least one data recovery storage device in a manner which enables reconstruction of a representation of the data communications at a given earlier time but does not require that the data be sent to the at least one data recovery device in a given order or stored on the at least one data recovery storage device in a given order.
- a data backup and recovery system for use with at least one server interconnected with at least one storage device, the data backup and recovery system including at least one data recovery device, at least one data recovery storage device associated with and controlled by the at least one data recovery device and data communication monitors for providing to the at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of the at least one server and the at least one storage device, the at least one data recovery device being operative to receive the at least control information and to store data on the at least one data recovery storage device in parallel and not requiring that the data be received by the at least one data recovery device in a given order.
- a method for data backup and recovery for use with at least one server interconnected with at least one storage device including providing at least one data recovery device, providing at least one data recovery storage device associated with and controlled by the at least one data recovery device and providing at least one data communication monitor operative to perform monitoring the data communication between the at least one server and the at least one storage device, creating at least control information bearing an order stamp regarding the data communications between corresponding ones of the at least one server and the at least one storage device and sending the monitored data communications and the control information to the at least one data recovery device, the at least one data recovery device responding to the at least control information in a manner which enables reconstruction of a representation of the data communications at a given earlier time but not requiring that the sending the monitored data communications and the control information to the at least one data recovery device be in a given order or stored on the at least one data recovery storage device in a given order.
- a method for data backup and recovery for use with at least one server interconnected with at least one storage device including providing at least one data recovery device, providing at least one data recovery storage device associated with and controlled by the at least one data recovery device, providing at least one data communication monitor operative to perform monitoring the data communication between the at least one server and the at least one storage device, creating at least control information bearing an order stamp regarding the data communications between corresponding ones of the at least one server and the at least one storage device and sending the monitored data communications and the control information to the at least one data recovery device, receiving the at least control information by the at least one data recovery device, and storing the data on the at least one data recovery storage device in parallel and without requiring that the data be received by the at least one data recovery device in a given order.
- the data communication monitors are located other than only at the at least one storage device.
- the data communication monitors also provide at least part of the data communications to the at least one data recovery device.
- the at least one data recovery device is operative to receive the at least control information and to store data on the at least one data recovery storage device in parallel.
- the data communications comprise data updates.
- the reconstruction of a representation of the data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on the at least one data recovery storage device unless the first update is stored on the at least one data recovery storage device.
- the data communication monitors are associated with individual ones of the at least one server.
- the data communication monitors are associated with network elements of a storage area network.
- At least one of the control information and the data communications is communicated from the data communication monitors to the data recovery device via a network.
- the network is a private network.
- the network is a public network.
- at least one of the control information and the data communications is communicated from the data communication monitors to the data recovery device via a storage area network.
- the data communication monitors provide at least part of the data communications to the at least one data recovery storage device other than via the at least one data recovery device.
- the data backup and recovery system also includes at least one LOG storage device wherein the at least one LOG storage device includes at least control information bearing a time mark regarding data communications between corresponding ones of the first plurality of servers and the plurality of storage devices via the storage area network.
- the data communication monitors also store at least part of the data communications to the at least one LOG storage device.
- the data communications stored to the at least one LOG storage device include data updates sent by the first plurality of servers to the second plurality of storage devices.
- the data backup and recovery system has at least one storage device LOG such that if either the control information or the data communications, or both, are prematurely erased from the at least one data recovery device due to a failure or other event, the at least one data recovery device restores either the control information or the data communications, or both, from the at least one storage device LOG. Additionally, the at least one data recovery device resumes its activities with the restored data from the at least one storage device LOG.
- the at least one data recovery device retrieves the at least part of the data communications from the at least one storage device LOG for the purpose of storing the data to at least one data recovery storage device associated therewith in the time ordered manner.
- the at least part of the data communications is communicated from the data communication monitors to the at least one storage device LOG via a network.
- the network is a private network.
- the network is a public network.
- the at least part of the data communications is communicated from the data communication monitors to the at least one storage device LOG via the storage area network.
- the at least one data recovery device retrieves both the control information and the at least part of the data communications from at least one storage device LOG for the purpose of storing the data to at least one data recovery storage device associated therewith in the time ordered manner.
- both the control information and the at least part of the data communications are communicated from the data communication monitors to the at least one storage device LOG via a network.
- the network is a private network.
- the network is a public network.
- both the control information and the at least part of the data communications are communicated from the data communication monitors to the at least one storage device LOG via the storage area network.
- the reconstruction includes sending the data communications from the at least one data recovery storage device to the at least one storage device. Additionally, the reconstruction includes employing the at least one data backup and recovery system as at least one of the at least one server and the at least one storage device.
- the at least one server and the at least one storage device are interconnected via a local area network (LAN).
- the at least one server and the at least one storage device are interconnected via a storage area network (SAN).
- LAN local area network
- SAN storage area network
- the at least one storage device is a network attached storage (NAS) device.
- NAS network attached storage
- the at least one data communication monitor monitors data communications between the at least one server and the at least one storage device over the LAN.
- the at least one data communication monitor monitors data communications between the at least one server and the at least one storage device over the SAN.
- the at least one server includes the at least one data communication monitor.
- the at least one storage device includes the at least one data communication monitor.
- the SAN includes the at least one data communication monitor.
- FIG. 1 is a simplified illustration of a data backup and recovery system constructed and operative in accordance with a preferred embodiment of the present invention, operative in a geographically dispersed information processing environment;
- FIGS. 2A, 2B , 2 C, 2 D, 2 E, 2 F and 2 G are simplified illustrations of alternative embodiments wherein an information processing site communicates backup information in accordance with the present invention
- FIGS. 3A and 3B are simplified illustrations of flow of backup data in a data backup and recovery system and method constructed and operative in accordance with preferred embodiments of the present invention
- FIGS. 4A and 4B taken together, are a simplified illustration of the flow of backup data within a data backup and recovery system and method constructed and operative in accordance with the embodiment shown in FIG. 3A ;
- FIGS. 4C and 4D taken together, are a simplified illustration of the flow of backup data within a data backup and recovery system and method constructed and operative in accordance with another embodiment of the present invention.
- FIG. 5 is a simplified illustration of flow of backup data within a data backup and recovery system and method constructed and operative in accordance with another embodiment of the present invention
- FIG. 6 is a simplified illustration of flow of recovery data within a data backup and recovery system and method constructed and operative in accordance with a preferred embodiment of the present invention
- FIG. 7 is a simplified illustration of flow of recovery data within a data backup and recovery system and method constructed and operative in accordance with a preferred embodiment of the present invention
- FIG. 8 is a simplified illustration of flow of backup information and associated order stamps from a plurality of monitors operative in accordance with a preferred embodiment of the present invention
- FIG. 9 is a simplified illustration of backup information flow and a separate and associated flow of order stamps, from a plurality of information processing sites operative in accordance with a preferred embodiment of the present invention.
- FIGS. 10A and 10B taken together, form a simplified flow chart of a typical procedure for managing the temporary memory of a data backup and recovery system constructed and operative in accordance with a preferred embodiment of the present invention.
- Appendix 1 is a computer listing which forms a preferred software embodiment of the present invention.
- FIG. 1 is a simplified illustration of a data backup and recovery system constructed and operative in accordance with a preferred embodiment of the present invention, operative in a geographically dispersed information processing environment 10 .
- the geographically dispersed information processing environment 10 comprises at least one information processing site 12 and at least one information backup and recovery site 14 , typically located at separate geographic locations.
- the information processing site 12 and the information backup and recovery site 14 are interconnected via interconnection 16 , preferably a wide area network (WAN), such as a public services digital network (PSDN).
- WAN wide area network
- PSDN public services digital network
- interconnection 16 may comprise wire line communication facilities as well as wireless communication facilities, including radio communication and satellite communication.
- the information processing site 12 preferably comprises at least one information processing device 20 , at least one information storage device 22 , at least one monitoring server 24 and at least one communication gateway 26 .
- the information processing device 20 , the information storage device 22 , the monitoring server 24 and the communication gateway 26 are preferably interconnected by interconnection 28 , such as a local area network (LAN).
- interconnection 28 may include one or more interconnections connected to devices in addition to information processing device 20 , information storage device 22 , monitoring server 24 and communication gateway 26 .
- the information backup and recovery site 14 preferably comprises at least one information backup and recovery server 30 , at least one information storage device 32 and at least one communication gateway 34 .
- the information backup and recovery server 30 , the information storage device 32 and the communication gateway 34 are preferably interconnected by interconnection 36 , such as a LAN.
- interconnection 38 may be comprised of one or more interconnections connected to devices in addition to information backup and recovery server 30 , information storage device 32 and communication gateway 34 .
- the information processing site 12 in particular the monitoring server 24 , sends backup information 40 , preferably in accordance with embodiments described hereinbelow with reference to FIGS. 3A-4D , to the information backup and recovery site 14 .
- backup information 40 preferably in accordance with embodiments described hereinbelow with reference to FIGS. 3A-4D .
- any suitable communication technology may be used to provide communication between the monitoring servers 24 , via the communication gateway 26 and the interconnection 16 to the information backup and recovery site 14 .
- Recovery of backup information 40 that has been received at the information backup and recovery site 14 from the information processing site 12 , is provided for, preferably in accordance with embodiments described hereinbelow with reference to FIGS. 6 & 7 , in the event of failure of information processing site 12 .
- Recovery information is sent from the backup and recovery site 14 , via the interconnection 16 , to the information processing site 12 , as indicated by arrows 42 .
- the information structure of information processing site 12 such as files and databases, is recovered from the information received from backup and recovery site 14 .
- the backup and recovery site 14 is used as an information processing site instead of the failed information processing site 12 .
- portions of the backup and recovery site 14 are configured to work together with the functional portions of information processing site 12 .
- the remaining portions of information processing site 12 would be connected via the interconnection 16 to the backup and recovery site 14 that would function as the information storage device 22 .
- FIG. 2A is a simplified illustration of a preferred embodiment of an information processing site communicating backup information in accordance with the present invention.
- the interconnection 28 includes a LAN 50 , application servers 54 and a storage area network (SAN) 56 , with corresponding communication links to the information processing devices 20 , the information storage devices 22 , the monitoring server 24 and the communication gateway 26 .
- the communication gateway 26 is connected to the LAN 50
- the monitoring server 24 is connected to both the SAN 56 and the LAN 50 .
- the information processing devices 20 typically communicate input-and-output (I/O) requests 60 , over the LAN 50 , to the application servers 54 , which, in turn, communicate the corresponding storage I/O requests 62 to the information storage devices 22 via the SAN 56 .
- the application servers 54 may convert each I/O request 60 into a plurality of storage I/O requests 62 .
- the monitoring server 24 monitors the storage I/O requests 62 over the SAN 56 , as indicated by stream of data 63 , and sends the corresponding backup information records 64 , via the LAN 50 , the communication gateway 26 and the interconnection 16 , to the information backup and recovery site 14 .
- FIG. 2B is a simplified illustration of another preferred embodiment of an information processing site communicating backup information in accordance with the present invention.
- the monitoring server 24 and the communication gateway 26 are connected to the SAN 56 .
- the monitoring server 24 monitors the storage I/O requests 62 , as indicated by element 63 , and communicates the corresponding backup information records 64 , via the SAN 56 , the communication gateway 26 and the interconnection 16 , to the information backup and recovery site 14 .
- FIG. 2C is a simplified illustration of yet another preferred embodiment of an information processing site communicating backup information in accordance with the present invention.
- a storage network switching and monitoring device 66 functions as a storage network switch, or a similar type of network equipment, with an additional functionality of the monitoring server 24 .
- the application servers 54 communicate storage I/O requests 62 to the storage devices 22 via the storage network switching and monitoring device 66 .
- the storage network switching and monitoring device 66 monitors the storage I/O requests 62 and communicates the corresponding backup information records 64 , typically via the LAN 50 , via the communication gateway 26 and via the interconnection 16 , to the information backup and recovery site 14 .
- application server 68 includes the functionality of the monitoring server 24 , typically as a software component.
- the monitoring server functionality within the application server 68 monitors the I/O requests 60 or 62 and communicates the corresponding backup information records 64 , via the LAN 50 , the communication gateway 26 and the interconnection 16 , to the information backup and recovery site 14 .
- FIG. 2E is a simplified illustration of yet another preferred embodiment of the information processing site communicating backup information in accordance with the present invention.
- one or more information storage devices 22 are replaced by monitoring storage devices 70 which include the functionality of a monitoring server and an information storage device. It is appreciated that a monitoring storage device 70 can monitor one or more additional information storage devices 22 , as shown.
- the application servers 54 communicate the storage I/O requests 62 to the monitoring storage devices 70 .
- the monitoring storage devices 70 monitor the storage I/O requests 62 and communicate the corresponding backup information records 64 , via the LAN 50 , the communication gateway 26 and the interconnection 16 , to the information backup and recovery site 14 .
- FIG. 2F is a simplified illustration of a further preferred embodiment of the information processing site communicating backup information in accordance with the present invention.
- the monitoring server 24 monitors the I/O requests 60 over the LAN 50 , as indicated by element 63 , and sends the corresponding backup information records 64 , via the LAN 50 , the communication gateway 26 and the interconnection 16 , to the remote information backup and recovery site 14 .
- FIG. 2G is a simplified illustration of another preferred embodiment of the information processing site communicating backup information in accordance with the present invention.
- the embodiment of FIG. 2G is similar to the embodiment of FIG. 2A , except in that LAN 50 of FIG. 2A is comprised of multiple LANs 50 in FIG. 2G , typically remotely located from each other, connected via interconnection 76 , and SAN 56 of FIG. 2A is comprised of multiple SANs 56 in FIG. 2G , typically remotely located from each other, connected via interconnection 78 . It is appreciated that while the embodiment of FIG. 2G shows both interconnections 76 and 78 , only one of these two interconnections need be operative according to the present invention. It is also appreciated that multiple interconnected LANs 50 and SANs 56 can be employed using any of the embodiments shown and described in FIGS. 2A-2F .
- FIG. 2G also illustrates an embodiment of the present invention which includes remote storage devices 80 , typically Network Attached Storage (NAS) devices.
- information processing devices 20 communicate I/O requests 82 to remote storage devices 80 .
- Monitoring server 24 monitors the I/O requests 82 and communicates the corresponding backup information records 64 , typically via the LAN 50 , via the communication gateway 26 and via the interconnection 16 to the remote information backup and recovery site 14 .
- NAS Network Attached Storage
- the communications gateway 26 can be connected to the SAN 56 instead of the LAN 50 , as is illustrated in the embodiment shown is FIG. 2B . It is further appreciated that in the configurations of FIGS. 2A-2G the functionality of the communication gateway 26 , as well as at least a portion of the functionality of information storage device 22 , may be embodied in one of the application servers 54 .
- the data processing site 12 includes one or more information processing devices 20 , here specifically designated by reference numerals 90 , 92 and 94 , one or more information storage devices 22 , here specifically designated by reference numerals 96 , 98 , 100 and 102 , and a data switching facility 104 .
- the data switching facility 104 comprises the interconnection 28 , the monitoring server 24 and preferably also the communication gateway 26 in accordance with any of the configurations shown and described with reference to FIGS. 2A-2G . It is appreciated that the data switching facility may comprise a local area network (LAN), a storage area network (SAN), a data router, a data switch, a computer back-plane or any other device providing a similar functionality or any combination thereof.
- LAN local area network
- SAN storage area network
- data router a data router
- data switch a computer back-plane or any other device providing a similar functionality or any combination thereof.
- the information processing server 90 hosts one or more information processing jobs 106 , here specifically designated by reference numerals 110 and 112 and by the letters A and B, respectively.
- the information processing device 92 hosts one or more information processing jobs 106 , here specifically designated by reference numeral 114 and by the letter C.
- the information processing device 94 hosts one or more information processing jobs 106 , here specifically designated by reference numerals 116 and 118 , and by the letters D and E, respectively.
- Each of the information processing jobs 106 has a stream of data 120 which flows to the data switching facility 104 .
- the streams of data 120 of the data processing jobs 110 , 112 , 114 , 116 and 118 are respectively specifically designated by reference numerals 122 , 124 , 126 , 128 and 130 .
- Each stream of data 120 comprises a sequence of data records 132 , which are converted by data switching facility 104 into data records 134 .
- the data records 132 are typically identical to the I/O requests 60 and the data records 134 are typically identical to the storage I/O requests 62 of FIGS. 2A-2G .
- Each data record is specifically designated by a combination of the designation letter of the originating information processing job 106 and a sequential number of the record in the stream of data 120 .
- the data records 132 sent by the data processing job 110 are designated A 1 , A 2 , A 3 and so on according to the order they are sent, wherein data record A 1 precedes data record A 2 .
- the intra-sequence order of the data records 132 within a stream of data 120 is at least partially a material feature of the processing job 106 .
- the inter-sequence order of data records 132 between some of the streams of data 120 may be at least partially a material feature of the corresponding information processing jobs 106 . Consequently, it is appreciated that the intra-sequence and the inter-sequence order of data records 134 may be at least partially a material feature of the information processing jobs 106 . For example, if the data records 134 are not written to the information storage devices 22 in the appropriate order, the integrity of the information may be adversely affected.
- the transmission time delay between records 132 , within a stream of data 120 or between streams of data 120 may be variable or even practically random.
- the overall order in which the data records 132 are received by the data switching facility 104 is designated by the letter T followed by a numeral that represent the inter-sequence order of the data records 132 .
- a data record designated by T 7 always follows a data record T 6 and precedes a data record T 8 .
- data record A 3 T 7 follows the data record B 4 T 6 and precedes the data record D 2 T 8 .
- the data switching facility 104 distributes the data records 134 to the appropriate data storage devices 22 .
- the data switching facility 104 has a stream of data 138 to each of the four data storage devices 22 .
- the streams of data 138 to the data storage devices 96 , 98 , 100 and 102 are respectively specifically designated by reference numerals 140 , 142 , 144 and 146 .
- the data processing job 110 sends data records 132 , converted by data switching facility 104 into data records 134 , designated with a prefix A, to data storage devices 96 , 98 , 100 and 102 ;
- data processing job 112 also designated by the letter B, sends data records 132 , converted by data switching facility 104 into data records 134 , designated with a prefix B, to data storage devices 98 and 100 ;
- data processing job 114 also designated by the letter C, sends data records 132 , converted by data switching facility 104 into data records 134 , designated with a prefix C, to data storage devices 96 and 98 ;
- data processing job 116 also designated by the letter D, sends data records 132 , converted by data switching facility 104 into data records 134 , designated with a prefix D, to data storage device 102 and data processing job 118 , also designated by the letter E, sends data records 132 , converted by the letter
- the data records 134 must be written to the information storage devices 22 in the order they are received by the interconnection 28 . It is especially important that the writing of a data record 134 must be finished before the writing of a related and later data record 134 is started. This requirement is equally valid for I/O operations in the information processing site 12 and for I/O operations in the information backup and recovery site 14 .
- the inter-sequence order values are implemented as time values, where such time value typically represents the time in which the respective data record 132 is received at the interconnection 28 .
- the monitoring server 24 creates a backup information record 64 and sends it to the information backup and recovery site 14 as soon as the corresponding data record 132 is received by interconnection 28 and detected by the monitoring server 24 .
- the data switching facility 104 typically the application servers 54 within interconnection 28 within the data switching facility 104 , converts each data record 132 into a plurality of data records 134 .
- the data records 132 designated by A 1 , A 2 and B 1 , are converted into data records 134 , A 1 . 1 T 1 , A 1 . 2 T 3 , A 1 . 3 T 8 ; A 2 . 1 T 6 , A 2 . 1 T 9 and B 1 . 1 T 2 , B 1 . 2 T 7 , B 1 . 3 T 11 , respectively.
- the monitoring server 24 creates a backup information record 64 for each data record 134 .
- the monitoring server 24 then sends the backup information records 64 to the information backup and recovery site 14 , preserving the order in which the backup information records 64 are written to the information storage devices 22 , as will be discussed hereinbelow with reference to FIGS. 4A-5 .
- FIGS. 4A, 4B , 4 C and 4 D are a simplified illustration of the flow of backup data from the information processing site 12 , via the interconnection 16 , to the information backup and recovery site 14 .
- FIG. 4A illustrates the monitoring server 24 sending the backup information records 64 via the communication gateway 26 to the interconnection 16
- FIG. 4B illustrates the data backup and recovery site 14 receiving the backup information records 64 from the interconnection 16 via the communication gateway 34 .
- the backup information records 64 are specifically designated by reference numerals 150 to 159 according to the order they are sent by monitoring server 24 .
- the monitoring server 24 creates a backup information record 64 and sends it as soon as a data record 134 is detected by the monitoring server 24 .
- the order in which the backup information records 64 are received at the information backup and recovery site 14 may be different from the order in which backup information records 64 are sent by the monitoring server 24 of the information processing site 12 , as seen in FIG. 4B .
- the backup information records 64 are marked by the monitoring server 24 with corresponding order stamps 162 .
- the order stamps 162 designate the order in which the corresponding backup information records 64 are received by the interconnection 28 .
- the order stamp 162 comprises the designation letter of the information processing job 106 that originated the I/O requests 60 for which the specific backup information records 64 is sent, followed by the sequential number of the I/O request 60 in the stream of data 120 , followed by the letter “T” and the overall sequential number that designates the order of arrival of the I/O request 60 at the interconnection 28 .
- the order stamp 162 comprises a time mark that designates the order of arrival of the I/O requests 60 or the storage I/O requests 62 at the interconnection 28 and their detection by the monitoring server 24 .
- FIGS. 4C and 4D taken together, are a simplified illustration of the flow of backup data from the information processing site 12 , via the interconnection 16 , to the information backup and recovery site 14 in another preferred embodiment of the present invention.
- the order stamp 162 comprises an order mark, typically a numerator, designating the order of arrival of the I/O request 60 or the storage I/O requests 62 at the interconnection 28 and their detection by the monitoring server 24 , and a time mark, designating the time of arrival of the I/O request 60 or the storage I/O requests 62 at the interconnection 28 and their detection by the monitoring server 24 .
- the order mark is designated in FIGS. 4C and 4D by the letter N followed by an integer and the time mark is designated by the letter T followed by a time value represented by an integer.
- the information backup and recovery site 14 comprises a communication gateway 34 , a data switching facility 170 , typically communicating with one or more information backup and recovery servers 30 , here specifically designated by reference numerals 172 and 174 , which communicate with one or more information storage devices 32 , here specifically designated by reference numerals 176 , 178 , 180 and 182 , typically via another information switching facility 184 .
- the information backup and recovery servers 30 have a temporary memory 186 , implemented in FIG. 5 as shared redundant disk storage. It is appreciated that the temporary memory 186 can comprise a RAM memory, a non-volatile memory, a log file stored in the disk storage system, or any other suitable temporary storage device.
- the information switching facilities 170 and 184 may be a local area network (LAN), a data router, a data switch, a storage area network (SAN), a computer back-plane or any other device providing a similar functionality.
- LAN local area network
- SAN storage area network
- computer back-plane any other device providing a similar functionality.
- the two backup and recovery servers 30 are provided for redundancy and enhanced reliability. It is appreciated that a single information backup and recovery server 30 as well as more than two information backup and recovery servers 30 can be used. It is further appreciated that the functionality of the communication gateway 34 , as well as the functionality of part or all of information storage devices 32 , may be embodied in one of the information backup and recovery servers 30 .
- the backup information records 64 are received at the data-switching device 170 , which distributes the backup information records 64 to the backup and recovery servers 30 .
- the backup and recovery servers 30 distribute the data records to the data storage devices 32 .
- the backup and recovery servers 30 store the backup information records 64 that are received out of sequence in the temporary memory 186 , until the sequence is completed.
- the information backup and recovery site 14 verifies that a sequence is completed by checking the order stamps 162 of the backup information records 64 in the temporary memory.
- the order stamps 162 are a sequence of integer numbers and the information backup and recovery site 14 verifies that a complete sequence of one or more order stamps 162 exists in the temporary memory.
- the information backup and recovery site 14 writes this sequence of backup information records 64 to the data storage devices 32 .
- the backup information records 64 are written to the data storage devices 32 in their respective order according to their order stamps 162 .
- the backup information records 64 designated by reference numerals 150 , 151 and 152 are received at the information backup and recovery site 14 in the order 152 , 150 , 151 .
- the backup information records 64 designated by reference numerals 152 and 150 , with order stamps 162 N 2 T 2 and N 3 T 3 respectively, were stored in the temporary memory 186 until the backup information records 64 designated by reference numeral 151 , with order stamp 162 N 1 T 1 was received and the sequence was completed.
- the backup information records 64 designated by reference numerals 150 , 151 , and 152 , are written to the data storage devices 32 .
- FIG. 5 the backup information records 64 , designated by reference numerals 150 , 151 , and 152
- the backup information records 64 are written to the data storage devices 32 in the order they have been written to the information storage devices 22 , namely 151 , 152 , and 150 , according to their corresponding order stamps 162 , N 1 T 1 , N 2 T 2 and N 3 T 3 .
- the backup information records 64 designated by reference numerals 156 and 154 bearing the corresponding order stamps 162 N 6 T 6 and N 5 T 5 , are received next.
- the backup information records 64 designated by reference numerals 156 and 154 are stored in the temporary memory 186 until the backup information record 64 designated by reference numeral 153 and bearing the order stamp 162 N 4 T 4 is received.
- the backup and recovery servers 30 check the storage addresses where the backup information records 64 are to be written to.
- the backup information records 64 that are not being sent to the same data storage devices 32 are written in parallel, not necessarily according to the order of their order stamps 162 .
- the backup and recovery servers 30 check the storage addresses where the backup information records 64 are to be written to. If more than one backup information record 64 is to be written to the same place in the data storage devices 32 , the backup and recovery server 30 writes only the last backup information record 64 to be written to that same place. It is appreciated that this procedure enables the backup and recovery server 30 to quickly purge the temporary memory 186 to the data storage devices 32 .
- each sequence completion serves as a point of synchronization between the information processing site 12 and the information backup and recovery site 14 , or as a point of consistency of the backup information received at the information backup and recovery site 14 .
- an internal recovery process can employ the information stored in the temporary memory 186 , especially when implemented in non-volatile memory or as a log file in the disk storage system, to recover backup information up and until the latest backup information record 64 in the temporary memory 186 for which the sequence of order stamps 162 is complete.
- the information recovery process which follows a failure of the information processing site 12 , can recover the information up to the latest backup information record 64 , which may still reside in the temporary memory 186 , provided that information consistency is preserved, for example, up and until the latest backup information record 64 for which the sequence of order stamps is complete.
- the order by which the backup information records 64 are stored in the information storage devices 32 is immaterial, and, for example, can be the order of their arrival at the information switching facility 170 .
- the backup information records 64 and the corresponding order stamps 162 are stored in the data storage devices.
- the order stamps 162 are stored separately from the backup information records 64 , for example, in a separate file or even in a separate information storage device 32 , and are associated with their respective backup information records 64 , for example, with a pointer embedded in each order stamp 162 pointing to the respective backup information record 64 .
- the backup information records 64 stored in the information storage devices 32 of the information backup and recovery site 14 are used in the recovery process.
- the recovered data-structure can be rebuilt in the information processing site 12 or in the information backup and recovery site 14 .
- the backup processes enable the information processing site 12 to transmit the storage I/O requests 62 to the information backup and recovery site 14 without any delay, greatly reducing the possibility that storage I/O requests 62 are awaiting transmission to the information backup and recovery site 14 and are thus lost. Additionally, the backup processes described enable the information backup and recovery site 14 to identify the points of synchronization, or the points of consistency, without requiring the information processing site 12 to delay the sending of more I/O requests 62 until the recent point of synchronization is identified. The information processing site 12 also does not wait to receive an acknowledgement from the information backup and recovery site 14 that a synchronization point has been identified.
- the present invention provides for less potential data loss in the event of a failure of the information processing site 12 , as well as increased efficiency of the interconnection 16 .
- FIGS. 6 and 7 are simplified illustrations of the flow of recovery data within a data backup and recovery system and method constructed and operative in accordance with a preferred embodiment of the present invention.
- the embodiment of FIGS. 6 and 7 describes the flow of recovery data from the information backup and recovery site 14 , which enables the recovery of the data-structure at the information processing site 12 , in the case of a “log-based backup”.
- the backup information records 64 are transmitted to the information processing site 12 according to their respective order stamps 162 , with the backup information records 64 associated with the earlier order stamps 162 being sent first.
- the backup information records 64 are thus transmitted to the information processing site 12 in the order they were originally sent by their originating information processing job 106 .
- the data-structure is recovered in the information processing site 12 and further processing continues in the information processing site 12 after the recovery of the data-structure is completed.
- the information processing activity continues directly from the data-structure in the information backup and recovery site 14 .
- FIG. 8 is a simplified illustration of the flow of backup information and associated order stamps from a plurality of monitoring servers 24 operative in accordance with a preferred embodiment of the present invention.
- a plurality of monitoring servers 24 send backup information records 64 and corresponding order stamps 162 to backup and recovery site 14 .
- the monitoring servers 24 are operative to assign order stamps 162 to the backup information records 64 , wherein the order stamps 162 comprise a universal order information, typically a time stamp, providing the order of the backup information records 64 across all monitoring servers 24 .
- the order stamps 162 may comprise a global order stamp, typically a single numerator that is common to all the monitoring servers 24 .
- the plurality of monitoring servers 24 of FIG. 8 may be part of a single information processing site 12 , as is shown and described in FIGS. 2D, 2E and 2 G or may be located in multiple information processing sites 12 .
- the plurality of monitoring servers 24 enables the information processing site 12 to send the backup information records 64 in parallel. This configuration decreases the number of storage I/O requests 62 that may be lost in the case of a failure of the information processing site 12 .
- FIG. 9 is a simplified illustration of the flow of backup information and separate, associated, order stamps, from a plurality of information processing sites operative in accordance with another preferred embodiment of the present invention.
- the backup information records 64 bearing their order stamps 162 , are sent via a first interconnection 16 , here specifically designated by reference numeral 190 , and written directly to the temporary memory 186 of the backup and recovery site 14 .
- the order stamps 162 here specifically designated by reference numeral 192 , are also sent to the backup and recovery site 14 , in parallel to the backup information records 64 , via a second interconnection 16 , here specifically designated by reference numeral 194 , to the information backup and recovery servers 30 .
- Each of the order stamps 192 typically comprises a pointer that associates the order stamp 192 with its corresponding backup information record 64 .
- the information backup and recovery servers 30 detect a complete sequence of order stamps 192 , the information backup and recovery servers 30 retrieve the corresponding backup information records 64 from the temporary memory 186 and write them to the information storage devices 32 .
- FIGS. 10A and 10B which, taken together, form a simplified flow chart of a typical procedure, executed by the information backup and recovery servers 30 of a data backup and recovery system, comprising a multiplicity of monitoring servers 24 , as shown and described above with reference to FIGS. 8 and 9 , in accordance with a preferred embodiment of the present invention, to manage the temporary memory 186 .
- the information backup and recovery server 30 receives a backup information record 64 and stores it in the temporary memory 186 , in a queue associated with the monitoring server 24 from which the backup information record 64 has been received.
- the information backup and recovery server 30 attempts to create a complete sequence of backup information records 64 for the specific monitoring server 24 . If the attempt succeeds (step 206 ), the backup and recovery server 30 updates the “last order mark” and the “last time mark” fields that are associated with the specific monitoring server 24 according to the order mark and the time mark of the last backup information records 64 in the complete sequence (step 208 ) and proceeds to scan the temporary memory 186 ( FIG. 10B ). If the attempt to create a complete sequence fails, the procedure ends.
- the procedure of scanning the temporary memory first checks that all the monitoring servers 24 have a complete sequence (step 210 ). If all the monitoring servers 24 have a complete sequence the procedure calculates (step 212 ) the values of “next consistency point”, which is the earliest of the “last time marks” of all the complete sequences. As described hereinabove with reference to FIG. 10A , a “last time mark” is created for each complete sequence.
- the procedure executes steps 214 and 216 , in which all backup information records 64 which are to be written to the same area in the information storage device 32 are erased except for the latest backup information record 64 .
- the procedure then proceeds to steps 218 and 220 in which all the backup information records 64 in the temporary memory 186 , with a time mark earlier or equal to the “next consistency point”, are written to the information storage devices 32 and then erased from the temporary memory 186 .
- Appendix 1 is a computer listing which forms a preferred software embodiment of the present invention.
- a preferred method for installing and running the software listing of the CD-ROM Appendix 1 is as follows:
- 1.1 Provide an Intel compatible computer with a minimum of 512 MB RAM, 350 Mhz CPU, 30 Gigabyte Hard disk, and a network interface card. Install a Microsoft Windows 2000 operating system and Microsoft Internet Explorer. Ensure that the Virtual memory page size is configured to allow growth to 4 gigabytes.
- 1.2. Provide connectivity via a Local Area Network and/or a Wide Area Network.
- 2.2 Provide connectivity via a Local Area Network and/or a Wide Area Network.
- 3.1 Provide an Intel compatible computer with a minimum of 512 MB RAM, 350 Mhz CPU, 30 Gigabyte Hard disk, and a network interface card. Install a Microsoft Windows 2000 operating system and Microsoft Internet Explorer. Ensure that the Virtual memory page size is configured to allow growth to 4 gigabytes.
- step 1.1 On the computer terminal referenced in step 1.1:
- step 2.1 On the computer terminal referenced in step 2.1:
- step 3.1 On the computer terminal referenced in step 3.1:
- step 4.1 On the computer terminal referenced in step 4.1:
Abstract
A data backup and recovery system for use with at least one server interconnected with at least one storage device, including at least one data recovery device, at least one associated data recovery storage device, controlled by the data recovery device, and at least one data communication monitor. A method for data backup and recovery is also disclosed.
Description
- Applicant hereby claims priority of U.S. Provisional Patent Application Ser. No. 60/272,782, filed Mar. 5, 2001, entitled “A SYSTEM AND A METHOD FOR ASYNCHRONOUS REPLICATION FOR STORAGE AREA NETWORKS”.
- A computer program listing appendix is submitted herewith on one compact disc and one duplicate compact disc. The total number of compact discs including duplicates is two. The files on the compact discs are software object code for carrying out the preferred embodiment of the invention.
- Their names, dates of creation, directory locations, and sizes in bytes of the compact disc are:
- 42541.hex of Feb. 28, 2002 located in the root folder and of length 124,437,726 bytes.
- The files are referred to herein as
Appendix 1. The material on the compact discs is incorporated by reference herein. - The present invention relates to systems and methods for backup and recovery of information used with geographically dispersed information processing environments.
- The following U.S. Patents are believed to represent the current state of the art:
- U.S. Pat. Nos. 6,148,383; 5,734,818; 5,577,222 and 5,446,871.
- The present invention seeks to provide improved systems and methods for backup and recovery of data for geographically dispersed information processing environments and storage area networks.
- There is thus provided in accordance with a preferred embodiment of the present invention a data backup and recovery system for use with at least one server interconnected with at least one storage device, the data backup and recovery system including at least one data recovery device, at least one data recovery storage device associated with and controlled by the at least one data recovery device and at least one data communication monitor for providing to the at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of the at least one server and the at least one storage device, the at least one data recovery device being responsive to at least the control information bearing an order stamp for storing data on the at least one data recovery storage device in a manner which enables reconstruction of a representation of the data communications at a given earlier time but does not require that the data be sent to the at least one data recovery device in a given order or stored on the at least one data recovery storage device in a given order.
- There is also provided in accordance with a preferred embodiment of the present invention a data backup and recovery system for use with at least one server interconnected with at least one storage device, the data backup and recovery system including at least one data recovery device, at least one data recovery storage device associated with and controlled by the at least one data recovery device and data communication monitors for providing to the at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of the at least one server and the at least one storage device, the at least one data recovery device being operative to receive the at least control information and to store data on the at least one data recovery storage device in parallel and not requiring that the data be received by the at least one data recovery device in a given order.
- There is further provided in accordance with a preferred embodiment of the present invention a method for data backup and recovery for use with at least one server interconnected with at least one storage device, including providing at least one data recovery device, providing at least one data recovery storage device associated with and controlled by the at least one data recovery device and providing at least one data communication monitor operative to perform monitoring the data communication between the at least one server and the at least one storage device, creating at least control information bearing an order stamp regarding the data communications between corresponding ones of the at least one server and the at least one storage device and sending the monitored data communications and the control information to the at least one data recovery device, the at least one data recovery device responding to the at least control information in a manner which enables reconstruction of a representation of the data communications at a given earlier time but not requiring that the sending the monitored data communications and the control information to the at least one data recovery device be in a given order or stored on the at least one data recovery storage device in a given order.
- There is yet further provided in accordance with a preferred embodiment of the present invention a method for data backup and recovery for use with at least one server interconnected with at least one storage device, including providing at least one data recovery device, providing at least one data recovery storage device associated with and controlled by the at least one data recovery device, providing at least one data communication monitor operative to perform monitoring the data communication between the at least one server and the at least one storage device, creating at least control information bearing an order stamp regarding the data communications between corresponding ones of the at least one server and the at least one storage device and sending the monitored data communications and the control information to the at least one data recovery device, receiving the at least control information by the at least one data recovery device, and storing the data on the at least one data recovery storage device in parallel and without requiring that the data be received by the at least one data recovery device in a given order.
- Preferably, the data communication monitors are located other than only at the at least one storage device.
- In accordance with a preferred embodiment of the present invention, the data communication monitors also provide at least part of the data communications to the at least one data recovery device.
- Preferably, the at least one data recovery device is operative to receive the at least control information and to store data on the at least one data recovery storage device in parallel.
- In accordance with a preferred embodiment of the present invention the data communications comprise data updates.
- In accordance with another preferred embodiment of the present invention, the reconstruction of a representation of the data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on the at least one data recovery storage device unless the first update is stored on the at least one data recovery storage device.
- Preferably, the data communication monitors are associated with individual ones of the at least one server. Alternatively, the data communication monitors are associated with network elements of a storage area network.
- In accordance with a preferred embodiment of the present invention, at least one of the control information and the data communications is communicated from the data communication monitors to the data recovery device via a network. Preferably, the network is a private network. Alternatively, the network is a public network. Alternatively, at least one of the control information and the data communications is communicated from the data communication monitors to the data recovery device via a storage area network.
- In accordance with another preferred embodiment of the present invention, the data communication monitors provide at least part of the data communications to the at least one data recovery storage device other than via the at least one data recovery device.
- In accordance with yet another preferred embodiment of the present invention, the data backup and recovery system also includes at least one LOG storage device wherein the at least one LOG storage device includes at least control information bearing a time mark regarding data communications between corresponding ones of the first plurality of servers and the plurality of storage devices via the storage area network. Preferably, the data communication monitors also store at least part of the data communications to the at least one LOG storage device. Additionally, the data communications stored to the at least one LOG storage device include data updates sent by the first plurality of servers to the second plurality of storage devices.
- In accordance with still another preferred embodiment of the present invention, the data backup and recovery system has at least one storage device LOG such that if either the control information or the data communications, or both, are prematurely erased from the at least one data recovery device due to a failure or other event, the at least one data recovery device restores either the control information or the data communications, or both, from the at least one storage device LOG. Additionally, the at least one data recovery device resumes its activities with the restored data from the at least one storage device LOG.
- Preferably, the at least one data recovery device retrieves the at least part of the data communications from the at least one storage device LOG for the purpose of storing the data to at least one data recovery storage device associated therewith in the time ordered manner.
- In accordance with yet another preferred embodiment of the present invention, the at least part of the data communications is communicated from the data communication monitors to the at least one storage device LOG via a network. Preferably, the network is a private network. Alternatively, the network is a public network. In accordance with another preferred embodiment, the at least part of the data communications is communicated from the data communication monitors to the at least one storage device LOG via the storage area network.
- In accordance with yet another preferred embodiment, the at least one data recovery device retrieves both the control information and the at least part of the data communications from at least one storage device LOG for the purpose of storing the data to at least one data recovery storage device associated therewith in the time ordered manner.
- In accordance with yet another preferred embodiment of the present invention, both the control information and the at least part of the data communications are communicated from the data communication monitors to the at least one storage device LOG via a network. Preferably, the network is a private network. Alternatively, the network is a public network. In another preferred embodiment, both the control information and the at least part of the data communications are communicated from the data communication monitors to the at least one storage device LOG via the storage area network.
- Preferably, the reconstruction includes sending the data communications from the at least one data recovery storage device to the at least one storage device. Additionally, the reconstruction includes employing the at least one data backup and recovery system as at least one of the at least one server and the at least one storage device.
- In accordance with another preferred embodiment, the at least one server and the at least one storage device are interconnected via a local area network (LAN). Alternatively, the at least one server and the at least one storage device are interconnected via a storage area network (SAN).
- In accordance with still another preferred embodiment, the at least one storage device is a network attached storage (NAS) device.
- In accordance with another preferred embodiment, the at least one data communication monitor monitors data communications between the at least one server and the at least one storage device over the LAN. Alternatively, the at least one data communication monitor monitors data communications between the at least one server and the at least one storage device over the SAN.
- Preferably, the at least one server includes the at least one data communication monitor. Alternatively, the at least one storage device includes the at least one data communication monitor.
- In accordance with another preferred embodiment, the SAN includes the at least one data communication monitor.
- The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:
-
FIG. 1 is a simplified illustration of a data backup and recovery system constructed and operative in accordance with a preferred embodiment of the present invention, operative in a geographically dispersed information processing environment; -
FIGS. 2A, 2B , 2C, 2D, 2E, 2F and 2G are simplified illustrations of alternative embodiments wherein an information processing site communicates backup information in accordance with the present invention; -
FIGS. 3A and 3B are simplified illustrations of flow of backup data in a data backup and recovery system and method constructed and operative in accordance with preferred embodiments of the present invention; -
FIGS. 4A and 4B , taken together, are a simplified illustration of the flow of backup data within a data backup and recovery system and method constructed and operative in accordance with the embodiment shown inFIG. 3A ; -
FIGS. 4C and 4D , taken together, are a simplified illustration of the flow of backup data within a data backup and recovery system and method constructed and operative in accordance with another embodiment of the present invention; -
FIG. 5 is a simplified illustration of flow of backup data within a data backup and recovery system and method constructed and operative in accordance with another embodiment of the present invention; -
FIG. 6 is a simplified illustration of flow of recovery data within a data backup and recovery system and method constructed and operative in accordance with a preferred embodiment of the present invention; -
FIG. 7 is a simplified illustration of flow of recovery data within a data backup and recovery system and method constructed and operative in accordance with a preferred embodiment of the present invention; -
FIG. 8 is a simplified illustration of flow of backup information and associated order stamps from a plurality of monitors operative in accordance with a preferred embodiment of the present invention; -
FIG. 9 is a simplified illustration of backup information flow and a separate and associated flow of order stamps, from a plurality of information processing sites operative in accordance with a preferred embodiment of the present invention; and -
FIGS. 10A and 10B , taken together, form a simplified flow chart of a typical procedure for managing the temporary memory of a data backup and recovery system constructed and operative in accordance with a preferred embodiment of the present invention. -
Appendix 1 is a computer listing which forms a preferred software embodiment of the present invention. - Reference is now made to
FIG. 1 , which is a simplified illustration of a data backup and recovery system constructed and operative in accordance with a preferred embodiment of the present invention, operative in a geographically dispersedinformation processing environment 10. As seen inFIG. 1 , the geographically dispersedinformation processing environment 10 comprises at least oneinformation processing site 12 and at least one information backup andrecovery site 14, typically located at separate geographic locations. Theinformation processing site 12 and the information backup andrecovery site 14 are interconnected viainterconnection 16, preferably a wide area network (WAN), such as a public services digital network (PSDN). - It is appreciated that the
information processing site 12 and the information backup andrecovery site 14 may be situated at a single geographic location or a multiplicity of geographically dispersed locations. It is also appreciated that any suitable data communication technology or combination of data communication technologies may be used to interconnect theinformation processing site 12 with the information backup andrecovery site 14 of theinformation processing environment 10. For example,interconnection 16 may comprise wire line communication facilities as well as wireless communication facilities, including radio communication and satellite communication. - As further seen in
FIG. 1 , theinformation processing site 12 preferably comprises at least oneinformation processing device 20, at least oneinformation storage device 22, at least onemonitoring server 24 and at least onecommunication gateway 26. Theinformation processing device 20, theinformation storage device 22, the monitoringserver 24 and thecommunication gateway 26 are preferably interconnected byinterconnection 28, such as a local area network (LAN). As described hereinbelow with reference toFIGS. 2A-2G ,interconnection 28 may include one or more interconnections connected to devices in addition toinformation processing device 20,information storage device 22, monitoringserver 24 andcommunication gateway 26. - The information backup and
recovery site 14 preferably comprises at least one information backup andrecovery server 30, at least oneinformation storage device 32 and at least onecommunication gateway 34. The information backup andrecovery server 30, theinformation storage device 32 and thecommunication gateway 34 are preferably interconnected byinterconnection 36, such as a LAN. As described hereinbelow with reference toFIGS. 5, 6 , 8 and 9, interconnection 38 may be comprised of one or more interconnections connected to devices in addition to information backup andrecovery server 30,information storage device 32 andcommunication gateway 34. - In accordance with a preferred embodiment of the present invention, the
information processing site 12, in particular the monitoringserver 24, sendsbackup information 40, preferably in accordance with embodiments described hereinbelow with reference toFIGS. 3A-4D , to the information backup andrecovery site 14. It is appreciated that any suitable communication technology may be used to provide communication between the monitoringservers 24, via thecommunication gateway 26 and theinterconnection 16 to the information backup andrecovery site 14. - Recovery of
backup information 40, that has been received at the information backup andrecovery site 14 from theinformation processing site 12, is provided for, preferably in accordance with embodiments described hereinbelow with reference toFIGS. 6 & 7 , in the event of failure ofinformation processing site 12. Recovery information is sent from the backup andrecovery site 14, via theinterconnection 16, to theinformation processing site 12, as indicated byarrows 42. The information structure ofinformation processing site 12, such as files and databases, is recovered from the information received from backup andrecovery site 14. - Alternatively, in the event of failure of
information processing site 12, the backup andrecovery site 14 is used as an information processing site instead of the failedinformation processing site 12. In an alternative embodiment of the present invention, when part of theinformation processing site 12 remains functional, portions of the backup andrecovery site 14 are configured to work together with the functional portions ofinformation processing site 12. For example, in the event of failure of thestorage device 22, the remaining portions ofinformation processing site 12 would be connected via theinterconnection 16 to the backup andrecovery site 14 that would function as theinformation storage device 22. - Reference is now made to
FIG. 2A , which is a simplified illustration of a preferred embodiment of an information processing site communicating backup information in accordance with the present invention. As seen in the embodiment ofFIG. 2A , theinterconnection 28 includes aLAN 50,application servers 54 and a storage area network (SAN) 56, with corresponding communication links to theinformation processing devices 20, theinformation storage devices 22, the monitoringserver 24 and thecommunication gateway 26. Thecommunication gateway 26 is connected to theLAN 50, while themonitoring server 24 is connected to both theSAN 56 and theLAN 50. - The
information processing devices 20 typically communicate input-and-output (I/O) requests 60, over theLAN 50, to theapplication servers 54, which, in turn, communicate the corresponding storage I/O requests 62 to theinformation storage devices 22 via theSAN 56. It is appreciated that theapplication servers 54 may convert each I/O request 60 into a plurality of storage I/O requests 62. The monitoringserver 24 monitors the storage I/O requests 62 over theSAN 56, as indicated by stream ofdata 63, and sends the corresponding backup information records 64, via theLAN 50, thecommunication gateway 26 and theinterconnection 16, to the information backup andrecovery site 14. - Reference is now made to
FIG. 2B , which is a simplified illustration of another preferred embodiment of an information processing site communicating backup information in accordance with the present invention. In the embodiment ofFIG. 2B , the monitoringserver 24 and thecommunication gateway 26 are connected to theSAN 56. The monitoringserver 24 monitors the storage I/O requests 62, as indicated byelement 63, and communicates the corresponding backup information records 64, via theSAN 56, thecommunication gateway 26 and theinterconnection 16, to the information backup andrecovery site 14. - Reference is now made to
FIG. 2C , which is a simplified illustration of yet another preferred embodiment of an information processing site communicating backup information in accordance with the present invention. In this embodiment, a storage network switching andmonitoring device 66 functions as a storage network switch, or a similar type of network equipment, with an additional functionality of themonitoring server 24. Theapplication servers 54 communicate storage I/O requests 62 to thestorage devices 22 via the storage network switching andmonitoring device 66. The storage network switching andmonitoring device 66 monitors the storage I/O requests 62 and communicates the corresponding backup information records 64, typically via theLAN 50, via thecommunication gateway 26 and via theinterconnection 16, to the information backup andrecovery site 14. - Reference is now made to
FIG. 2D , which is a simplified illustration of still another preferred embodiment of the information processing site communicating backup information in accordance with the present invention. As seen inFIG. 2D ,application server 68 includes the functionality of themonitoring server 24, typically as a software component. The monitoring server functionality within theapplication server 68 monitors the I/O requests 60 or 62 and communicates the corresponding backup information records 64, via theLAN 50, thecommunication gateway 26 and theinterconnection 16, to the information backup andrecovery site 14. - Reference is now made to
FIG. 2E , which is a simplified illustration of yet another preferred embodiment of the information processing site communicating backup information in accordance with the present invention. In this embodiment, one or moreinformation storage devices 22 are replaced by monitoringstorage devices 70 which include the functionality of a monitoring server and an information storage device. It is appreciated that amonitoring storage device 70 can monitor one or more additionalinformation storage devices 22, as shown. Theapplication servers 54 communicate the storage I/O requests 62 to themonitoring storage devices 70. Themonitoring storage devices 70 monitor the storage I/O requests 62 and communicate the corresponding backup information records 64, via theLAN 50, thecommunication gateway 26 and theinterconnection 16, to the information backup andrecovery site 14. - Reference is now made to
FIG. 2F , which is a simplified illustration of a further preferred embodiment of the information processing site communicating backup information in accordance with the present invention. As seen inFIG. 2F , the monitoringserver 24 monitors the I/O requests 60 over theLAN 50, as indicated byelement 63, and sends the corresponding backup information records 64, via theLAN 50, thecommunication gateway 26 and theinterconnection 16, to the remote information backup andrecovery site 14. - Reference is now made to
FIG. 2G , which is a simplified illustration of another preferred embodiment of the information processing site communicating backup information in accordance with the present invention. The embodiment ofFIG. 2G is similar to the embodiment ofFIG. 2A , except in thatLAN 50 ofFIG. 2A is comprised ofmultiple LANs 50 inFIG. 2G , typically remotely located from each other, connected viainterconnection 76, andSAN 56 ofFIG. 2A is comprised ofmultiple SANs 56 inFIG. 2G , typically remotely located from each other, connected viainterconnection 78. It is appreciated that while the embodiment ofFIG. 2G shows bothinterconnections LANs 50 and SANs 56 can be employed using any of the embodiments shown and described inFIGS. 2A-2F . -
FIG. 2G also illustrates an embodiment of the present invention which includesremote storage devices 80, typically Network Attached Storage (NAS) devices. In this embodiment,information processing devices 20 communicate I/O requests 82 toremote storage devices 80. Monitoringserver 24 monitors the I/O requests 82 and communicates the corresponding backup information records 64, typically via theLAN 50, via thecommunication gateway 26 and via theinterconnection 16 to the remote information backup andrecovery site 14. - It is appreciated that in any of the embodiments of
FIGS. 2A-2G , thecommunications gateway 26 can be connected to theSAN 56 instead of theLAN 50, as is illustrated in the embodiment shown isFIG. 2B . It is further appreciated that in the configurations ofFIGS. 2A-2G the functionality of thecommunication gateway 26, as well as at least a portion of the functionality ofinformation storage device 22, may be embodied in one of theapplication servers 54. - Reference is now made to
FIGS. 3A and 3B , which are simplified illustrations of the flow of backup data in a data backup and recovery system and method constructed and operative in accordance with preferred embodiments of the present invention. As seen inFIG. 3A , thedata processing site 12 includes one or moreinformation processing devices 20, here specifically designated byreference numerals information storage devices 22, here specifically designated byreference numerals data switching facility 104. Thedata switching facility 104 comprises theinterconnection 28, the monitoringserver 24 and preferably also thecommunication gateway 26 in accordance with any of the configurations shown and described with reference toFIGS. 2A-2G . It is appreciated that the data switching facility may comprise a local area network (LAN), a storage area network (SAN), a data router, a data switch, a computer back-plane or any other device providing a similar functionality or any combination thereof. - In accordance with the preferred embodiment of the present invention illustrated in
FIG. 3A , theinformation processing server 90 hosts one or moreinformation processing jobs 106, here specifically designated byreference numerals information processing device 92 hosts one or moreinformation processing jobs 106, here specifically designated byreference numeral 114 and by the letter C. Theinformation processing device 94 hosts one or moreinformation processing jobs 106, here specifically designated byreference numerals - Each of the
information processing jobs 106 has a stream ofdata 120 which flows to thedata switching facility 104. The streams ofdata 120 of thedata processing jobs reference numerals data 120 comprises a sequence ofdata records 132, which are converted bydata switching facility 104 into data records 134. The data records 132 are typically identical to the I/O requests 60 and thedata records 134 are typically identical to the storage I/O requests 62 ofFIGS. 2A-2G . Each data record is specifically designated by a combination of the designation letter of the originatinginformation processing job 106 and a sequential number of the record in the stream ofdata 120. For example, thedata records 132 sent by thedata processing job 110, designated by the letter A, are designated A1, A2, A3 and so on according to the order they are sent, wherein data record A1 precedes data record A2. - It is appreciated that the intra-sequence order of the
data records 132 within a stream ofdata 120 is at least partially a material feature of theprocessing job 106. It is also appreciated that the inter-sequence order ofdata records 132 between some of the streams ofdata 120 may be at least partially a material feature of the correspondinginformation processing jobs 106. Consequently, it is appreciated that the intra-sequence and the inter-sequence order ofdata records 134 may be at least partially a material feature of theinformation processing jobs 106. For example, if thedata records 134 are not written to theinformation storage devices 22 in the appropriate order, the integrity of the information may be adversely affected. It is further appreciated that the transmission time delay betweenrecords 132, within a stream ofdata 120 or between streams ofdata 120, may be variable or even practically random. The overall order in which thedata records 132 are received by thedata switching facility 104 is designated by the letter T followed by a numeral that represent the inter-sequence order of the data records 132. Namely, a data record designated by T7 always follows a data record T6 and precedes a data record T8. For example, data record A3T7 follows the data record B4T6 and precedes the data record D2T8. - As seen in
FIG. 3A , thedata switching facility 104 distributes thedata records 134 to the appropriatedata storage devices 22. To perform the distribution task thedata switching facility 104 has a stream ofdata 138 to each of the fourdata storage devices 22. The streams ofdata 138 to thedata storage devices reference numerals - As seen in
FIG. 3A , thedata processing job 110, also designated by the letter A, sendsdata records 132, converted bydata switching facility 104 intodata records 134, designated with a prefix A, todata storage devices data processing job 112, also designated by the letter B, sendsdata records 132, converted bydata switching facility 104 intodata records 134, designated with a prefix B, todata storage devices data processing job 114, also designated by the letter C, sendsdata records 132, converted bydata switching facility 104 intodata records 134, designated with a prefix C, todata storage devices data processing job 116, also designated by the letter D, sendsdata records 132, converted bydata switching facility 104 intodata records 134, designated with a prefix D, todata storage device 102 anddata processing job 118, also designated by the letter E, sendsdata records 132, converted bydata switching facility 104 intodata records 134, designated with a prefix E, todata storage device - It is appreciated that in order to ensure the integrity of the information in the
information storage devices 22, thedata records 134 must be written to theinformation storage devices 22 in the order they are received by theinterconnection 28. It is especially important that the writing of adata record 134 must be finished before the writing of a related andlater data record 134 is started. This requirement is equally valid for I/O operations in theinformation processing site 12 and for I/O operations in the information backup andrecovery site 14. Preferably, the inter-sequence order values are implemented as time values, where such time value typically represents the time in which therespective data record 132 is received at theinterconnection 28. In a preferred embodiment of the present invention, the monitoringserver 24 creates abackup information record 64 and sends it to the information backup andrecovery site 14 as soon as the correspondingdata record 132 is received byinterconnection 28 and detected by the monitoringserver 24. - Referring now to
FIG. 3B , thedata switching facility 104, typically theapplication servers 54 withininterconnection 28 within thedata switching facility 104, converts eachdata record 132 into a plurality of data records 134. In the embodiment shown inFIG. 3B , thedata records 132, designated by A1, A2 and B1, are converted intodata records 134, A1.1T1, A1.2T3, A1.3T8; A2.1T6, A2.1T9 and B1.1T2, B1.2T7, B1.3T11, respectively. Preferably, the monitoringserver 24 creates abackup information record 64 for eachdata record 134. The monitoringserver 24 then sends the backup information records 64 to the information backup andrecovery site 14, preserving the order in which the backup information records 64 are written to theinformation storage devices 22, as will be discussed hereinbelow with reference toFIGS. 4A-5 . - Reference is now made to
FIGS. 4A, 4B , 4C and 4D.FIGS. 4A and 4B , taken together, are a simplified illustration of the flow of backup data from theinformation processing site 12, via theinterconnection 16, to the information backup andrecovery site 14.FIG. 4A illustrates themonitoring server 24 sending the backup information records 64 via thecommunication gateway 26 to theinterconnection 16 andFIG. 4B illustrates the data backup andrecovery site 14 receiving the backup information records 64 from theinterconnection 16 via thecommunication gateway 34. - As seen in
FIG. 4A , the backup information records 64 are specifically designated byreference numerals 150 to 159 according to the order they are sent by monitoringserver 24. Preferably, the monitoringserver 24 creates abackup information record 64 and sends it as soon as adata record 134 is detected by the monitoringserver 24. - It is appreciated that the order in which the backup information records 64 are received at the information backup and
recovery site 14 may be different from the order in which backup information records 64 are sent by the monitoringserver 24 of theinformation processing site 12, as seen inFIG. 4B . - The backup information records 64 are marked by the monitoring
server 24 withcorresponding order stamps 162. Theorder stamps 162 designate the order in which the corresponding backup information records 64 are received by theinterconnection 28. In the embodiment ofFIGS. 4A and 4B , which corresponds to the embodiment ofFIG. 3A , theorder stamp 162 comprises the designation letter of theinformation processing job 106 that originated the I/O requests 60 for which the specific backup information records 64 is sent, followed by the sequential number of the I/O request 60 in the stream ofdata 120, followed by the letter “T” and the overall sequential number that designates the order of arrival of the I/O request 60 at theinterconnection 28. - In another preferred embodiment of the present invention, the
order stamp 162 comprises a time mark that designates the order of arrival of the I/O requests 60 or the storage I/O requests 62 at theinterconnection 28 and their detection by the monitoringserver 24. -
FIGS. 4C and 4D , taken together, are a simplified illustration of the flow of backup data from theinformation processing site 12, via theinterconnection 16, to the information backup andrecovery site 14 in another preferred embodiment of the present invention. As seen inFIGS. 4C and 4D , theorder stamp 162 comprises an order mark, typically a numerator, designating the order of arrival of the I/O request 60 or the storage I/O requests 62 at theinterconnection 28 and their detection by the monitoringserver 24, and a time mark, designating the time of arrival of the I/O request 60 or the storage I/O requests 62 at theinterconnection 28 and their detection by the monitoringserver 24. The order mark is designated inFIGS. 4C and 4D by the letter N followed by an integer and the time mark is designated by the letter T followed by a time value represented by an integer. - Reference is now made to
FIG. 5 , which is a simplified illustration of the flow of backup data into and within the information backup andrecovery site 14 in accordance with a preferred embodiment of the present invention. As seen inFIG. 5 , the information backup andrecovery site 14 comprises acommunication gateway 34, adata switching facility 170, typically communicating with one or more information backup andrecovery servers 30, here specifically designated byreference numerals information storage devices 32, here specifically designated byreference numerals information switching facility 184. The information backup andrecovery servers 30 have atemporary memory 186, implemented inFIG. 5 as shared redundant disk storage. It is appreciated that thetemporary memory 186 can comprise a RAM memory, a non-volatile memory, a log file stored in the disk storage system, or any other suitable temporary storage device. - In the embodiment shown in
FIG. 5 , theinformation switching facilities - In the embodiment of
FIG. 5 , the two backup andrecovery servers 30 are provided for redundancy and enhanced reliability. It is appreciated that a single information backup andrecovery server 30 as well as more than two information backup andrecovery servers 30 can be used. It is further appreciated that the functionality of thecommunication gateway 34, as well as the functionality of part or all ofinformation storage devices 32, may be embodied in one of the information backup andrecovery servers 30. - As seen in
FIG. 5 , the backup information records 64 are received at the data-switchingdevice 170, which distributes the backup information records 64 to the backup andrecovery servers 30. The backup andrecovery servers 30 distribute the data records to thedata storage devices 32. - In a preferred embodiment of the present invention, the backup and
recovery servers 30 store the backup information records 64 that are received out of sequence in thetemporary memory 186, until the sequence is completed. Typically, the information backup andrecovery site 14 verifies that a sequence is completed by checking theorder stamps 162 of the backup information records 64 in the temporary memory. Preferably, theorder stamps 162 are a sequence of integer numbers and the information backup andrecovery site 14 verifies that a complete sequence of one ormore order stamps 162 exists in the temporary memory. When a complete sequence oforder stamps 162, corresponding to backup information records 64, following the earliestavailable order stamp 162 is found in temporary memory, the information backup andrecovery site 14 writes this sequence of backup information records 64 to thedata storage devices 32. Preferably, the backup information records 64 are written to thedata storage devices 32 in their respective order according to theirorder stamps 162. - For example, as shown in
FIG. 4D , the backup information records 64 designated byreference numerals recovery site 14 in theorder reference numerals order stamps 162 N2T2 and N3T3 respectively, were stored in thetemporary memory 186 until the backup information records 64 designated byreference numeral 151, withorder stamp 162 N1T1 was received and the sequence was completed. Then, as seen inFIG. 5 , the backup information records 64, designated byreference numerals data storage devices 32. In the example shown inFIG. 5 , the backup information records 64 are written to thedata storage devices 32 in the order they have been written to theinformation storage devices 22, namely 151, 152, and 150, according to theircorresponding order stamps 162, N1T1, N2T2 and N3T3. - As also seen in
FIG. 4D , the backup information records 64 designated byreference numerals corresponding order stamps 162 N6T6 and N5T5, are received next. As seen inFIG. 5 , the backup information records 64 designated byreference numerals temporary memory 186 until thebackup information record 64 designated byreference numeral 153 and bearing theorder stamp 162 N4T4 is received. - In a preferred embodiment of the present invention the backup and
recovery servers 30 check the storage addresses where the backup information records 64 are to be written to. The backup information records 64 that are not being sent to the samedata storage devices 32 are written in parallel, not necessarily according to the order of theirorder stamps 162. - In a preferred embodiment of the present invention, the backup and
recovery servers 30 check the storage addresses where the backup information records 64 are to be written to. If more than onebackup information record 64 is to be written to the same place in thedata storage devices 32, the backup andrecovery server 30 writes only the lastbackup information record 64 to be written to that same place. It is appreciated that this procedure enables the backup andrecovery server 30 to quickly purge thetemporary memory 186 to thedata storage devices 32. - It is appreciated that each sequence completion serves as a point of synchronization between the
information processing site 12 and the information backup andrecovery site 14, or as a point of consistency of the backup information received at the information backup andrecovery site 14. - It is appreciated that in case of a failure of the backup and
recovery site 14 during the process of writing backup information records 64 to theinformation storage devices 32 an internal recovery process can employ the information stored in thetemporary memory 186, especially when implemented in non-volatile memory or as a log file in the disk storage system, to recover backup information up and until the latestbackup information record 64 in thetemporary memory 186 for which the sequence oforder stamps 162 is complete. - It is appreciated that the information recovery process, which follows a failure of the
information processing site 12, can recover the information up to the latestbackup information record 64, which may still reside in thetemporary memory 186, provided that information consistency is preserved, for example, up and until the latestbackup information record 64 for which the sequence of order stamps is complete. - In an alternative embodiment of the information backup and
recovery site 14 of the present invention, designated as “log-based backup”, the order by which the backup information records 64 are stored in theinformation storage devices 32 is immaterial, and, for example, can be the order of their arrival at theinformation switching facility 170. In this embodiment, the backup information records 64 and thecorresponding order stamps 162 are stored in the data storage devices. Alternatively, theorder stamps 162 are stored separately from the backup information records 64, for example, in a separate file or even in a separateinformation storage device 32, and are associated with their respective backup information records 64, for example, with a pointer embedded in eachorder stamp 162 pointing to the respectivebackup information record 64. In this embodiment, the backup information records 64 stored in theinformation storage devices 32 of the information backup andrecovery site 14 are used in the recovery process. The recovered data-structure can be rebuilt in theinformation processing site 12 or in the information backup andrecovery site 14. - It is appreciated that in the case of a failure of the
information processing site 12, all the storage I/O requests 62 that have not yet been sent to the backup andrecovery site 14 are lost. - In the preferred embodiment of the present invention, shown and described with reference to
FIGS. 1-5 , the backup processes enable theinformation processing site 12 to transmit the storage I/O requests 62 to the information backup andrecovery site 14 without any delay, greatly reducing the possibility that storage I/O requests 62 are awaiting transmission to the information backup andrecovery site 14 and are thus lost. Additionally, the backup processes described enable the information backup andrecovery site 14 to identify the points of synchronization, or the points of consistency, without requiring theinformation processing site 12 to delay the sending of more I/O requests 62 until the recent point of synchronization is identified. Theinformation processing site 12 also does not wait to receive an acknowledgement from the information backup andrecovery site 14 that a synchronization point has been identified. - Additionally, in the preferred embodiment of the present invention described above, there is no requirement to define the points of synchronization in advance. Advance definition of the points of synchronization typically results in relatively low frequency of points of synchronization. Thus, in the case of a failure of the
information processing site 12, I/O requests 62 that are received at the information backup andrecovery site 14 since the last synchronization point are deemed lost, even if these I/O requests 62 are already written to theinformation storage devices 32. Also, synchronization at theinformation processing site 12 causes delays in the sending of the backup information records 64 and therefore increases the possibility of congestion, and decreases the efficiency, of theinterconnection 16. - Thus, the present invention provides for less potential data loss in the event of a failure of the
information processing site 12, as well as increased efficiency of theinterconnection 16. - Reference is now made to
FIGS. 6 and 7 , which are simplified illustrations of the flow of recovery data within a data backup and recovery system and method constructed and operative in accordance with a preferred embodiment of the present invention. The embodiment ofFIGS. 6 and 7 describes the flow of recovery data from the information backup andrecovery site 14, which enables the recovery of the data-structure at theinformation processing site 12, in the case of a “log-based backup”. As seen inFIGS. 6 and 7 , the backup information records 64 are transmitted to theinformation processing site 12 according to theirrespective order stamps 162, with the backup information records 64 associated with theearlier order stamps 162 being sent first. The backup information records 64 are thus transmitted to theinformation processing site 12 in the order they were originally sent by their originatinginformation processing job 106. In the process of data recovery ofFIGS. 6 and 7 , the data-structure is recovered in theinformation processing site 12 and further processing continues in theinformation processing site 12 after the recovery of the data-structure is completed. Alternatively, the information processing activity continues directly from the data-structure in the information backup andrecovery site 14. - Reference is now made to
FIG. 8 , which is a simplified illustration of the flow of backup information and associated order stamps from a plurality ofmonitoring servers 24 operative in accordance with a preferred embodiment of the present invention. As seen inFIG. 8 , a plurality ofmonitoring servers 24 send backup information records 64 andcorresponding order stamps 162 to backup andrecovery site 14. It is appreciated that themonitoring servers 24 are operative to assignorder stamps 162 to the backup information records 64, wherein theorder stamps 162 comprise a universal order information, typically a time stamp, providing the order of the backup information records 64 across all monitoringservers 24. Additionally and alternatively, theorder stamps 162 may comprise a global order stamp, typically a single numerator that is common to all themonitoring servers 24. The plurality ofmonitoring servers 24 ofFIG. 8 may be part of a singleinformation processing site 12, as is shown and described inFIGS. 2D, 2E and 2G or may be located in multipleinformation processing sites 12. The plurality ofmonitoring servers 24 enables theinformation processing site 12 to send the backup information records 64 in parallel. This configuration decreases the number of storage I/O requests 62 that may be lost in the case of a failure of theinformation processing site 12. - Reference is now made to
FIG. 9 , which is a simplified illustration of the flow of backup information and separate, associated, order stamps, from a plurality of information processing sites operative in accordance with another preferred embodiment of the present invention. As seen in the embodiment ofFIG. 9 , the backup information records 64, bearing theirorder stamps 162, are sent via afirst interconnection 16, here specifically designated byreference numeral 190, and written directly to thetemporary memory 186 of the backup andrecovery site 14. Theorder stamps 162, here specifically designated byreference numeral 192, are also sent to the backup andrecovery site 14, in parallel to the backup information records 64, via asecond interconnection 16, here specifically designated byreference numeral 194, to the information backup andrecovery servers 30. Each of theorder stamps 192 typically comprises a pointer that associates theorder stamp 192 with its correspondingbackup information record 64. Typically, when the information backup andrecovery servers 30 detect a complete sequence oforder stamps 192, the information backup andrecovery servers 30 retrieve the corresponding backup information records 64 from thetemporary memory 186 and write them to theinformation storage devices 32. - Reference is now made to
FIGS. 10A and 10B , which, taken together, form a simplified flow chart of a typical procedure, executed by the information backup andrecovery servers 30 of a data backup and recovery system, comprising a multiplicity ofmonitoring servers 24, as shown and described above with reference toFIGS. 8 and 9 , in accordance with a preferred embodiment of the present invention, to manage thetemporary memory 186. - As seen in
FIG. 10A , insteps recovery server 30 receives abackup information record 64 and stores it in thetemporary memory 186, in a queue associated with themonitoring server 24 from which thebackup information record 64 has been received. Instep 204 the information backup andrecovery server 30 attempts to create a complete sequence of backup information records 64 for thespecific monitoring server 24. If the attempt succeeds (step 206), the backup andrecovery server 30 updates the “last order mark” and the “last time mark” fields that are associated with thespecific monitoring server 24 according to the order mark and the time mark of the last backup information records 64 in the complete sequence (step 208) and proceeds to scan the temporary memory 186 (FIG. 10B ). If the attempt to create a complete sequence fails, the procedure ends. - As seen in
FIG. 10B , the procedure of scanning the temporary memory first checks that all themonitoring servers 24 have a complete sequence (step 210). If all themonitoring servers 24 have a complete sequence the procedure calculates (step 212) the values of “next consistency point”, which is the earliest of the “last time marks” of all the complete sequences. As described hereinabove with reference toFIG. 10A , a “last time mark” is created for each complete sequence. - Optionally, as shown and described in
FIG. 10B , the procedure executessteps information storage device 32 are erased except for the latestbackup information record 64. - The procedure then proceeds to
steps temporary memory 186, with a time mark earlier or equal to the “next consistency point”, are written to theinformation storage devices 32 and then erased from thetemporary memory 186. - Reference is now made to
Appendix 1, which is a computer listing which forms a preferred software embodiment of the present invention. - A preferred method for installing and running the software listing of the CD-
ROM Appendix 1 is as follows: - 1. SANSafe Management Server Installation:
- 1.1. Provide an Intel compatible computer with a minimum of 512 MB RAM, 350 Mhz CPU, 30 Gigabyte Hard disk, and a network interface card. Install a Microsoft Windows 2000 operating system and Microsoft Internet Explorer. Ensure that the Virtual memory page size is configured to allow growth to 4 gigabytes.
- 1.2. Provide connectivity via a Local Area Network and/or a Wide Area Network.
- 1.3. Unhex the computer listing 42541.HEX of
Appendix 1 using HEX IT V1.8 or greater by John Augustine, 3129 Earl St., Laureldale, Pa. 19605 creating file 42541.ZIP. - 1.4. Decompress the file 42541.ZIP using WINZIP version 6.2 or greater, extracting all files into their respective directories utilizing the WINZIP version 6.2 option “Use folder names”.
- 1.5. Open the Windows explorer.
- 1.6. Double click on the Management Server directory labeled “MGMT Server SetUp”.
- 1.7. Double click on the setup icon.
- 1.8. Follow the default prompts provided therein.
- 2. SANSafe Management Client Installation
- 2.1. Provide an Intel compatible computer with a minimum of 128 MB RAM, 350 Mhz CPU, and a network interface card. Install a Microsoft Windows 2000 operating system and Microsoft Internet Explorer.
- 2.2. Provide connectivity via a Local Area Network and/or a Wide Area Network.
- 2.3. Unhex the computer listing 42541.HEX of
Appendix 1 using HEX IT V1.8 or greater by John Augustine, 3129 Earl St., Laureldale, Pa. 19605 creating file 42541.ZIP. - 2.4. Decompress the file 42541.ZIP using WINZIP version 6.2 or greater, extracting all files into their respective directories utilizing the WINZIP version 6.2 option “Use folder names”.
- 2.5. Open the Windows explorer.
- 2.6. Double click on the Management Client directory labeled “MGMT Client SetUp”.
- 2.7. Double click on the setup icon.
- 2.8. Follow the default prompts provided therein.
- 3. Replication Appliance Installation
- 3.1. Provide an Intel compatible computer with a minimum of 512 MB RAM, 350 Mhz CPU, 30 Gigabyte Hard disk, and a network interface card. Install a Microsoft Windows 2000 operating system and Microsoft Internet Explorer. Ensure that the Virtual memory page size is configured to allow growth to 4 gigabytes.
- 3.2. Provide connectivity via a Local Area Network and/or a Wide Area Network.
- 3.3. Unhex the computer listing 42541.HEX of
Appendix 1 using HEX IT V1.8 or greater by John Augustine, 3129 Earl St., Laureldale, Pa. 19605 creating file 42541.ZIP. - 3.4. Decompress the file 42541.ZIP using WINZIP version 6.2 or greater, extracting all files into their respective directories utilizing the WINZIP version 6.2 option “Use folder names”.
- 3.5. Open the Windows explorer.
- 3.6. Double click on the Replication Appliance directory labeled “Replication Appliance SetUp”.
- 3.7. Double click on the setup icon.
- 3.8. Follow the default prompts provided therein.
- 4. Installing the Replication Agent
- 4.1. Provide an Intel compatible computer with a minimum of 512 MB RAM, 350 Mhz CPU, 30 Gigabyte Hard disk, and a network interface card. Install a Microsoft Windows 2000 operating system and Microsoft Internet Explorer. Ensure that the Virtual memory page size is configured to allow growth to 4 gigabytes.
- 4.2. Provide connectivity via a Local Area Network and/or a Wide Area Network.
- 4.3. Unhex the computer listing 42541.HEX of
Appendix 1 using HEX IT V1.8 or greater by John Augustine, 3129 Earl St., Laureldale, Pa. 19605 creating file 42541.ZIP. - 4.4. Decompress the file 42541.ZIP using WINZIP version 6.2 or greater, extracting all files into their respective directories utilizing the WINZIP version 6.2 option “Use folder names”.
- 4.5. Open the Windows explorer.
- 4.6. Double click on the Replication Agent directory labeled “Replication Agent SetUp”.
- 4.7. Double click on the setup icon.
- 4.8. Follow the default prompts provided therein.
- 5. Running the SANSafe Management Server
- 5.1. On the computer terminal referenced in step 1.1:
- 5.1.1. Ensure connectivity via a Local Area Network to the Replication appliance referenced in step 3.
- 5.1.2. Click on “Start”
- 5.1.3. Select “Programs”
- 5.1.4. Click on “SANSafe Management Server”
- 6. Running the SANSafe Management Client
- 6.1. On the computer terminal referenced in step 2.1:
- 6.1.1. Ensure connectivity via a Local Area Network and/or a Wide Area Network to the Management Server machine referenced in
step 1 above. - 6.1.2. Open the Microsoft Internet Explorer Browser.
- 6.1.3. Open MGMT/SANSafe/SanPro.html.
- 7. Running the Replication Appliance
- 7.1. On the computer terminal referenced in step 3.1:
- 7.1.1. Ensure connectivity via a Local Area Network and/or a Wide Area Network to the Replication Agent referenced in step 4 above.
- 7.1.2. Click on “Start”
- 7.1.3. Select “Programs”
- 7.1.4. Click on “SANSafe Replication Appliance”
- 8. Running the Replication Agent
- 8.1. On the computer terminal referenced in step 4.1:
- 8.1.1. Ensure connectivity via a Local Area Network and/or a Wide Area Network to the Replication Appliance machine referenced in step 3 above.
- 8.1.2. Right click on the “my computer” icon
- 8.1.3. Select “Manage”
- 8.1.4. Double Click on “Services and Applications”
- 8.1.5. Double click on “Services”
- 8.1.6. Right click on “SANSafe Replication Agent”
- 8.1.7. Select “Start”
- It is appreciated that the particular embodiment implemented by the appendix is intended only to provide an extremely detailed disclosure of the present invention and is not intended to be limiting.
- It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described herein above. Rather the scope of the present invention includes both combinations and subcombinations of the various features described hereinabove as well as variations and modifications which would occur to persons skilled in the art upon reading the specifications and which are not in the prior art.
Claims (136)
1. A data backup and recovery system for use with at least one server interconnected with at least one storage device, said data backup and recovery system comprising:
at least one data recovery device;
at least one data recovery storage device associated with and controlled by said at least one data recovery device; and
at least one data communication monitor for providing to said at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of said at least one server and said at least one storage device,
said at least one data recovery device being responsive to at least said control information bearing an order stamp for storing data on said at least one data recovery storage device in a manner which enables reconstruction of a representation of said data communications at a given earlier time but does not require that the data be sent to said at least one data recovery device in a given order or stored on said at least one data recovery storage device in a given order.
2. A data backup and recovery system according to claim 1 and wherein said data communication monitors are located other than only at said at least one storage device.
3. A data backup and recovery system according to claim 1 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
4. A data backup and recovery system according to claim 2 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
5. A data backup and recovery system according to claim 1 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.
6. A data backup and recovery system according to claim 1 and wherein said data communications comprise data updates.
7. A data backup and recovery system according to claim 1 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device.
8. A data backup and recovery system according to claim 1 and wherein said data communication monitors are associated with individual ones of said at least one server.
9. A data backup and recovery system according to claim 1 and wherein said data communication monitors are associated with network elements of a storage area network.
10. A data backup and recovery system according to claim 1 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.
11. A data backup and recovery system according to claim 10 and wherein said network is a private network.
12. A data backup and recovery system according to claim 10 and wherein said network is a public network.
13. A data backup and recovery system according to claim 1 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.
14. A data backup and recovery system according to claim 1 and wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.
15. A data backup and recovery system according to claim 1 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.
16. A data backup and recovery system according to claim 15 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.
17. A data backup and recovery system according to claim 16 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.
18. A data backup and recovery system according to claim 17 having said at least one storage device LOG such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.
19. A data backup and recovery system according to claim 18 and wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.
20. A data backup and recovery system according to claim 17 and wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
21. A data backup and recovery system according to claim 18 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.
22. A data backup and recovery system according to claim 21 and wherein said network is a private network.
23. A data backup and recovery system according to claim 21 and wherein said network is a public network.
24. A data backup and recovery system according to claim 18 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
25. A data backup and recovery system according to claim 17 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
26. A data backup and recovery system according to claim 25 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.
27. A data backup and recovery system according to claim 26 and wherein said network is a private network.
28. A data backup and recovery system according to claim 26 and wherein said network is a public network.
29. A data backup and recovery system according to claim 25 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
30. A data backup and recovery system for use with at least one server interconnected with at least one storage device, said data backup and recovery system comprising:
at least one data recovery device;
at least one data recovery storage device associated with and controlled by said at least one data recovery device; and
data communication monitors for providing to said at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of said at least one server and said at least one storage device,
said at least one data recovery device being operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel and not requiring that the data be received by said at least one data recovery device in a given order.
31. A data backup and recovery system according to claim 30 and wherein said data communication monitors are located other than only at said at least one storage device.
32. A data backup and recovery system according to claim 30 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
33. A data backup and recovery system according to claim 31 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
34. A data backup and recovery system according to claim 30 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.
35. A data backup and recovery system according to claim 30 and wherein said data communications comprise data updates.
36. A data backup and recovery system according to claim 30 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device.
37. A data backup and recovery system according to claim 30 and wherein said data communication monitors are associated with individual ones of said at least one server.
38. A data backup and recovery system according to claim 30 and wherein said data communication monitors are associated with network elements of a storage area network.
39. A data backup and recovery system according to claim 30 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.
40. A data backup and recovery system according to claim 39 and wherein said network is a private network.
41. A data backup and recovery system according to claim 39 and wherein said network is a public network.
42. A data backup and recovery system according to claim 30 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.
43. A data backup and recovery system according to claim 30 wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.
44. A data backup and recovery system according to claim 30 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.
45. A data backup and recovery system according to claim 44 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.
46. A data backup and recovery system according to claim 45 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.
47. A data backup and recovery system according to claim 44 having said at least one storage device LOG such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.
48. A data backup and recovery system according to claim 47 wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.
49. A data backup and recovery system according to claim 46 wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
50. A data backup and recovery system according to claim 47 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.
51. A data backup and recovery system according to claim 50 and wherein said network is a private network.
52. A data backup and recovery system according to claim 50 and wherein said network is a public network.
53. A data backup and recovery system according to claim 47 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
54. A data backup and recovery system according to claim 46 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
55. A data backup and recovery system according to claim 54 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.
56. A data backup and recovery system according to claim 55 and wherein said network is a private network.
57. A data backup and recovery system according to claim 55 and wherein said network is a public network.
58. A data backup and recovery system according to claim 54 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
59. A data backup and recovery system according to claim 1 and wherein said reconstruction comprises sending said data communications from said at least one data recovery storage device to said at least one storage device.
60. A data backup and recovery system according to claim 1 and wherein said reconstruction comprises employing said at least one data backup and recovery system as at least one of said at least one server and said at least one storage device.
61. A data backup and recovery system according to claim 1 and wherein said at least one server and said at least one storage device are interconnected via a local area network (LAN).
62. A data backup and recovery system according to claim 1 and wherein said at least one server and said at least one storage device are interconnected via a storage area network (SAN).
63. A data backup and recovery system according to claim 1 and wherein said at least one storage device is a network attached storage (NAS) device.
64. A data backup and recovery system according to claim 61 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said LAN.
65. A data backup and recovery system according to claim 62 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said SAN.
66. A data backup and recovery system according to claim 1 and wherein said at least one server comprises said at least one data communication monitor.
67. A data backup and recovery system according to claim 1 and wherein said at least one storage device comprises said at least one data communication monitor.
68. A data backup and recovery system according to claim 62 and wherein said SAN comprises said at least one data communication monitor.
69. A method for data backup and recovery for use with at least one server interconnected with at least one storage device, the method comprising:
providing at least one data recovery device;
providing at least one data recovery storage device associated with and controlled by said at least one data recovery device; and
providing at least one data communication monitor operative to perform:
monitoring the data communication between said at least one server and said at least one storage device;
creating at least control information bearing an order stamp regarding said data communications between corresponding ones of said at least one server and said at least one storage device; and
sending said monitored data communications and said control information to said at least one data recovery device,
said at least one data recovery device responding to said at least said control information in a manner which enables reconstruction of a representation of said data communications at a given earlier time but not requiring that said sending said monitored data communications and said control information to said at least one data recovery device be in a given order or stored on said at least one data recovery storage device in a given order.
70. A method for data backup and recovery according to claim 69 and wherein said data communication monitors are provided other than only at said at least one storage device.
71. A method for data backup and recovery according to claim 69 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
72. A method for data backup and recovery according to claim 70 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
73. A method for data backup and recovery according to claim 69 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.
74. A method for data backup and recovery according to claim 69 and wherein said data communications comprise data updates.
75. A method for data backup and recovery according to claim 69 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device
76. A method for data backup and recovery according to claim 69 and wherein said data communication monitors are associated with individual ones of said at least one server.
77. A method for data backup and recovery according to claim 69 and wherein said data communication monitors are associated with network elements of a storage area network.
78. A method for data backup and recovery according to claim 69 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.
79. A method for data backup and recovery according to claim 78 and wherein said network is a private network.
80. A method for data backup and recovery according to claim 78 and wherein said network is a public network.
81. A method for data backup and recovery according to claim 69 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.
82. A method for data backup and recovery according to claim 69 wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.
83. A method for data backup and recovery according to claim 69 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.
84. A method for data backup and recovery according to claim 83 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.
85. A method for data backup and recovery according to claim 84 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.
86. A method for data backup and recovery according to claim 85 such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.
87. A method for data backup and recovery according to claim 86 wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.
88. A method for data backup and recovery according to claim 85 wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
89. A method for data backup and recovery according to claim 86 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.
90. A method for data backup and recovery according to claim 89 and wherein said network is a private network.
91. A method for data backup and recovery according to claim 89 and wherein said network is a public network.
92. A method for data backup and recovery according to claim 86 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
93. A method for data backup and recovery according to claim 85 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
94. A method for data backup and recovery according to claim 93 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.
95. A method for data backup and recovery according to claim 94 and wherein said network is a private network.
96. A method for data backup and recovery according to claim 94 and wherein said network is a public network.
97. A method for data backup and recovery according to claim 93 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
98. A method for data backup and recovery for use with at least one server interconnected with at least one storage device, said method comprising:
providing at least one data recovery device;
providing at least one data recovery storage device associated with and controlled by said at least one data recovery device;
providing at least one data communication monitor operative to perform:
monitoring the data communication between said at least one server and said at least one storage device;
creating at least control information bearing an order stamp regarding said data communications between corresponding ones of said at least one server and said at least one storage device; and
sending said monitored data communications and said control information to said at least one data recovery device,
receiving said at least control information by said at least one data recovery device; and
storing said data on said at least one data recovery storage device in parallel and without requiring that the data be received by said at least one data recovery device in a given order.
99. A method for data backup and recovery according to claim 98 and wherein said data communication monitors are located other than only at said at least one storage device.
100. A method for data backup and recovery according to claim 98 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
101. A method for data backup and recovery according to claim 99 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.
102. A method for data backup and recovery according to claim 98 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.
103. A method for data backup and recovery according to claim 98 and wherein said data communications comprise data updates.
104. A method for data backup and recovery according to claim 98 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device.
105. A method for data backup and recovery according to claim 98 and wherein said data communication monitors are associated with individual ones of said at least one server.
106. A method for data backup and recovery according to claim 98 and wherein said data communication monitors are associated with network elements of a storage area network.
107. A method for data backup and recovery according to claim 98 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.
108. A method for data backup and recovery according to claim 107 and wherein said network is a private network.
109. A method for data backup and recovery according to claim 107 and wherein said network is a public network.
110. A method for data backup and recovery according to claim 98 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.
111. A method for data backup and recovery according to claim 98 wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.
112. A method for data backup and recovery according to claim 98 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.
113. A method for data backup and recovery according to claim 112 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.
114. A method for data backup and recovery according to claim 113 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.
115. A method for data backup and recovery according to claim 114 having said at least one storage device LOG such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.
116. A method for data backup and recovery according to claim 115 wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.
117. A method for data backup and recovery according to claim 114 wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
118. A method for data backup and recovery according to claim 115 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.
119. A method for data backup and recovery according to claim 118 and wherein said network is a private network.
120. A method for data backup and recovery according to claim 118 and wherein said network is a public network.
121. A method for data backup and recovery according to claim 115 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
122. A method for data backup and recovery according to claim 114 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.
123. A method for data backup and recovery according to claim 122 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.
124. A method for data backup and recovery according to claim 123 and wherein said network is a private network.
125. A method for data backup and recovery according to claim 123 and wherein said network is a public network.
126. A method for data backup and recovery according to claim 122 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.
127. A method for data backup and recovery according to claim 69 and wherein said reconstruction comprises sending said data communications from said at least one data recovery storage device to said at least one storage device.
128. A method for data backup and recovery according to claim 69 and wherein said reconstruction comprises employing said at least one data backup and recovery system as at least one of said at least one server and said at least one storage device.
129. A method for data backup and recovery according to claim 69 and wherein said at least one server and said at least one storage device are interconnected via a local area network (LAN).
130. A method for data backup and recovery according to claim 69 and wherein said at least one server and said at least one storage device are interconnected via a storage area network (SAN).
131. A method for data backup and recovery according to claim 69 and wherein said at least one storage device is a network attached storage (NAS) device.
132. A method for data backup and recovery according to claim 129 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said LAN.
133. A method for data backup and recovery according to claim 130 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said SAN.
134. A method for data backup and recovery according to claim 69 and wherein said at least one server comprises said at least one data communication monitor.
135. A method for data backup and recovery according to claim 69 and wherein said at least one storage device comprises said at least one data communication monitor.
136. A method for data backup and recovery according to claim 130 and wherein said SAN comprises said at least one data communication monitor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/487,634 US20060259811A1 (en) | 2001-03-05 | 2006-07-17 | System and a method for asynchronous replication for storage area networks |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US27278201P | 2001-03-05 | 2001-03-05 | |
US10/090,488 US7096382B2 (en) | 2001-03-05 | 2002-03-04 | System and a method for asynchronous replication for storage area networks |
US11/487,634 US20060259811A1 (en) | 2001-03-05 | 2006-07-17 | System and a method for asynchronous replication for storage area networks |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/090,488 Continuation US7096382B2 (en) | 2001-03-05 | 2002-03-04 | System and a method for asynchronous replication for storage area networks |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060259811A1 true US20060259811A1 (en) | 2006-11-16 |
Family
ID=23041252
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/090,488 Expired - Lifetime US7096382B2 (en) | 2001-03-05 | 2002-03-04 | System and a method for asynchronous replication for storage area networks |
US11/487,634 Abandoned US20060259811A1 (en) | 2001-03-05 | 2006-07-17 | System and a method for asynchronous replication for storage area networks |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/090,488 Expired - Lifetime US7096382B2 (en) | 2001-03-05 | 2002-03-04 | System and a method for asynchronous replication for storage area networks |
Country Status (3)
Country | Link |
---|---|
US (2) | US7096382B2 (en) |
EP (1) | EP1379949A4 (en) |
WO (1) | WO2002071220A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070168704A1 (en) * | 2005-11-30 | 2007-07-19 | Oracle International Corporation | System and method of configuring a database system with replicated data and automatic failover and recovery |
US20080216156A1 (en) * | 2007-03-02 | 2008-09-04 | Proprietary Controls Systems Corporation | Fault tolerant security system, method and apparatus |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6880101B2 (en) * | 2001-10-12 | 2005-04-12 | Dell Products L.P. | System and method for providing automatic data restoration after a storage device failure |
US7076690B1 (en) | 2002-04-15 | 2006-07-11 | Emc Corporation | Method and apparatus for managing access to volumes of storage |
US7707151B1 (en) | 2002-08-02 | 2010-04-27 | Emc Corporation | Method and apparatus for migrating data |
US7546482B2 (en) * | 2002-10-28 | 2009-06-09 | Emc Corporation | Method and apparatus for monitoring the storage of data in a computer system |
US7376764B1 (en) | 2002-12-10 | 2008-05-20 | Emc Corporation | Method and apparatus for migrating data in a computer system |
JP2004213435A (en) * | 2003-01-07 | 2004-07-29 | Hitachi Ltd | Storage device system |
JP4322511B2 (en) * | 2003-01-27 | 2009-09-02 | 株式会社日立製作所 | Information processing system control method and information processing system |
GB0308264D0 (en) * | 2003-04-10 | 2003-05-14 | Ibm | Recovery from failures within data processing systems |
US7080221B1 (en) | 2003-04-23 | 2006-07-18 | Emc Corporation | Method and apparatus for managing migration of data in a clustered computer system environment |
US7263590B1 (en) | 2003-04-23 | 2007-08-28 | Emc Corporation | Method and apparatus for migrating data in a computer system |
US7415591B1 (en) | 2003-04-23 | 2008-08-19 | Emc Corporation | Method and apparatus for migrating data and automatically provisioning a target for the migration |
US7805583B1 (en) | 2003-04-23 | 2010-09-28 | Emc Corporation | Method and apparatus for migrating data in a clustered computer system environment |
US7469274B1 (en) | 2003-12-19 | 2008-12-23 | Symantec Operating Corporation | System and method for identifying third party copy devices |
US8949395B2 (en) | 2004-06-01 | 2015-02-03 | Inmage Systems, Inc. | Systems and methods of event driven recovery management |
US7472129B2 (en) * | 2004-06-29 | 2008-12-30 | Microsoft Corporation | Lossless recovery for computer systems with map assisted state transfer |
US7360111B2 (en) * | 2004-06-29 | 2008-04-15 | Microsoft Corporation | Lossless recovery for computer systems with remotely dependent data recovery |
JP4920391B2 (en) * | 2006-01-06 | 2012-04-18 | 株式会社日立製作所 | Computer system management method, management server, computer system and program |
US8549240B2 (en) * | 2006-02-16 | 2013-10-01 | Cisco Technology, Inc. | Apparatus and methods for an appliance to recover data from a storage device |
US7519857B2 (en) * | 2006-06-16 | 2009-04-14 | Hewlett-Packard Development Company, L.P. | Method, apparatus, and system for a software based business continuity solution for a computing environment |
US9330190B2 (en) | 2006-12-11 | 2016-05-03 | Swift Creek Systems, Llc | Method and system for providing data handling information for use by a publish/subscribe client |
US7620669B1 (en) | 2006-12-15 | 2009-11-17 | Netapp, Inc. | System and method for enhancing log performance |
US20080209145A1 (en) * | 2007-02-27 | 2008-08-28 | Shyamsundar Ranganathan | Techniques for asynchronous data replication |
US20080270546A1 (en) * | 2007-04-30 | 2008-10-30 | Morris Robert P | Methods And Systems For Communicating Task Information |
US8325724B2 (en) * | 2009-03-31 | 2012-12-04 | Emc Corporation | Data redistribution in data replication systems |
BG1372U1 (en) * | 2010-05-04 | 2010-10-29 | "Терахост" Оод | System for recovery of the operations in a computer centre |
GB2496377B (en) * | 2011-11-02 | 2014-07-30 | Ibm | Message reconciliation during disaster recovery |
CN102724272B (en) * | 2011-12-30 | 2017-12-29 | 新奥特(北京)视频技术有限公司 | A kind of backup method of TV station's service distribution data |
US10255574B2 (en) * | 2012-08-14 | 2019-04-09 | Prashant Kakade | Systems and methods for business impact analysis and disaster recovery |
US9558078B2 (en) | 2014-10-28 | 2017-01-31 | Microsoft Technology Licensing, Llc | Point in time database restore from storage snapshots |
US10318387B1 (en) * | 2017-07-14 | 2019-06-11 | EMC IP Holding Company LLC | Automated charge backup modelling |
Citations (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5446871A (en) * | 1993-03-23 | 1995-08-29 | International Business Machines Corporation | Method and arrangement for multi-system remote data duplexing and recovery |
US5504883A (en) * | 1993-02-01 | 1996-04-02 | Lsc, Inc. | Method and apparatus for insuring recovery of file control information for secondary storage systems |
US5577222A (en) * | 1992-12-17 | 1996-11-19 | International Business Machines Corporation | System for asynchronously duplexing remote data by sending DASD data grouped as a unit periodically established by checkpoint based upon the latest time value |
US5734818A (en) * | 1994-02-22 | 1998-03-31 | International Business Machines Corporation | Forming consistency groups using self-describing record sets for remote data duplexing |
US5737600A (en) * | 1994-09-12 | 1998-04-07 | International Business Machines Corporation | Method and system for log management in a coupled data processing system |
US6065018A (en) * | 1998-03-04 | 2000-05-16 | International Business Machines Corporation | Synchronizing recovery log having time stamp to a remote site for disaster recovery of a primary database having related hierarchial and relational databases |
US6148383A (en) * | 1998-07-09 | 2000-11-14 | International Business Machines Corporation | Storage system employing universal timer for peer-to-peer asynchronous maintenance of consistent mirrored storage |
US6202135B1 (en) * | 1996-12-23 | 2001-03-13 | Emc Corporation | System and method for reconstructing data associated with protected storage volume stored in multiple modules of back-up mass data storage facility |
US6246684B1 (en) * | 1997-12-24 | 2001-06-12 | Nortel Networks Limited | Method and apparatus for re-ordering data packets in a network environment |
US6269431B1 (en) * | 1998-08-13 | 2001-07-31 | Emc Corporation | Virtual storage and block level direct access of secondary storage for recovery of backup data |
US6289355B1 (en) * | 1998-09-16 | 2001-09-11 | International Business Machines Corp. | Fast log apply |
US6301643B1 (en) * | 1998-09-03 | 2001-10-09 | International Business Machines Corporation | Multi-environment data consistency |
US6324654B1 (en) * | 1998-03-30 | 2001-11-27 | Legato Systems, Inc. | Computer network remote data mirroring system |
US6463501B1 (en) * | 1999-10-21 | 2002-10-08 | International Business Machines Corporation | Method, system and program for maintaining data consistency among updates across groups of storage areas using update times |
US6549988B1 (en) * | 1999-01-22 | 2003-04-15 | Ilya Gertner | Data storage system comprising a network of PCs and method using same |
US6658540B1 (en) * | 2000-03-31 | 2003-12-02 | Hewlett-Packard Development Company, L.P. | Method for transaction command ordering in a remote data replication system |
US6658590B1 (en) * | 2000-03-30 | 2003-12-02 | Hewlett-Packard Development Company, L.P. | Controller-based transaction logging system for data recovery in a storage area network |
US20040078399A1 (en) * | 2000-03-31 | 2004-04-22 | Hitachi, Ltd. | Method for duplicating data of storage subsystem and data duplicating system |
US6732124B1 (en) * | 1999-03-30 | 2004-05-04 | Fujitsu Limited | Data processing system with mechanism for restoring file systems based on transaction logs |
US6781992B1 (en) * | 2000-11-30 | 2004-08-24 | Netrake Corporation | Queue engine for reassembling and reordering data packets in a network |
US7039773B2 (en) * | 2003-04-29 | 2006-05-02 | Oracle International Corporation | Method and mechanism for efficient implementation of ordered records |
US7072342B1 (en) * | 2002-03-20 | 2006-07-04 | Applied Micro Circuits Corporation | Reordering of out-of-order packets |
US7080221B1 (en) * | 2003-04-23 | 2006-07-18 | Emc Corporation | Method and apparatus for managing migration of data in a clustered computer system environment |
US7088719B2 (en) * | 2001-12-21 | 2006-08-08 | Agere Systems Inc. | Processor with packet processing order maintenance based on packet flow identifiers |
US7092976B2 (en) * | 2003-06-24 | 2006-08-15 | International Business Machines Corporation | Parallel high speed backup for a storage area network (SAN) file system |
US20060190504A1 (en) * | 2005-02-18 | 2006-08-24 | International Business Machines Corporation | Simulating multi-user activity while maintaining original linear request order for asynchronous transactional events |
US7103796B1 (en) * | 2002-09-03 | 2006-09-05 | Veritas Operating Corporation | Parallel data change tracking for maintaining mirrored data consistency |
US20060218433A1 (en) * | 2005-03-22 | 2006-09-28 | Williams Jeffrey L | Method, apparatus and program storage device for providing intelligent rebuild order selection |
US7120149B2 (en) * | 2001-02-28 | 2006-10-10 | Ericsson Inc. | Methods and system for resequencing out of order data packets |
US7139851B2 (en) * | 2004-02-25 | 2006-11-21 | Hitachi, Ltd. | Method and apparatus for re-synchronizing mirroring pair with data consistency |
US7145869B1 (en) * | 1999-03-17 | 2006-12-05 | Broadcom Corporation | Method for avoiding out-of-ordering of frames in a network switch |
US7197616B2 (en) * | 2003-03-25 | 2007-03-27 | Emc Corporation | Virtual ordered writes |
US20070081558A1 (en) * | 2002-05-16 | 2007-04-12 | Nadim Shaikli | System For Reordering Sequenced Based Packets In A Switching Network |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US573481A (en) * | 1896-12-22 | Rake-tooth | ||
JPH0833857B2 (en) * | 1987-02-18 | 1996-03-29 | 株式会社日立製作所 | System database sharing system system system |
US5553279A (en) * | 1993-10-08 | 1996-09-03 | International Business Machines Corporation | Lossless distribution of time series data in a relational data base network |
US5794252A (en) * | 1995-01-24 | 1998-08-11 | Tandem Computers, Inc. | Remote duplicate database facility featuring safe master audit trail (safeMAT) checkpointing |
US5930824A (en) * | 1997-02-04 | 1999-07-27 | International Business Machines Corporation | System and method for demand-base data recovery |
-
2002
- 2002-03-04 US US10/090,488 patent/US7096382B2/en not_active Expired - Lifetime
- 2002-03-04 EP EP02700560A patent/EP1379949A4/en not_active Withdrawn
- 2002-03-04 WO PCT/IL2002/000166 patent/WO2002071220A1/en not_active Application Discontinuation
-
2006
- 2006-07-17 US US11/487,634 patent/US20060259811A1/en not_active Abandoned
Patent Citations (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5577222A (en) * | 1992-12-17 | 1996-11-19 | International Business Machines Corporation | System for asynchronously duplexing remote data by sending DASD data grouped as a unit periodically established by checkpoint based upon the latest time value |
US5504883A (en) * | 1993-02-01 | 1996-04-02 | Lsc, Inc. | Method and apparatus for insuring recovery of file control information for secondary storage systems |
US5446871A (en) * | 1993-03-23 | 1995-08-29 | International Business Machines Corporation | Method and arrangement for multi-system remote data duplexing and recovery |
US5734818A (en) * | 1994-02-22 | 1998-03-31 | International Business Machines Corporation | Forming consistency groups using self-describing record sets for remote data duplexing |
US5737600A (en) * | 1994-09-12 | 1998-04-07 | International Business Machines Corporation | Method and system for log management in a coupled data processing system |
US6202135B1 (en) * | 1996-12-23 | 2001-03-13 | Emc Corporation | System and method for reconstructing data associated with protected storage volume stored in multiple modules of back-up mass data storage facility |
US6246684B1 (en) * | 1997-12-24 | 2001-06-12 | Nortel Networks Limited | Method and apparatus for re-ordering data packets in a network environment |
US6065018A (en) * | 1998-03-04 | 2000-05-16 | International Business Machines Corporation | Synchronizing recovery log having time stamp to a remote site for disaster recovery of a primary database having related hierarchial and relational databases |
US6324654B1 (en) * | 1998-03-30 | 2001-11-27 | Legato Systems, Inc. | Computer network remote data mirroring system |
US6148383A (en) * | 1998-07-09 | 2000-11-14 | International Business Machines Corporation | Storage system employing universal timer for peer-to-peer asynchronous maintenance of consistent mirrored storage |
US6269431B1 (en) * | 1998-08-13 | 2001-07-31 | Emc Corporation | Virtual storage and block level direct access of secondary storage for recovery of backup data |
US6301643B1 (en) * | 1998-09-03 | 2001-10-09 | International Business Machines Corporation | Multi-environment data consistency |
US6289355B1 (en) * | 1998-09-16 | 2001-09-11 | International Business Machines Corp. | Fast log apply |
US6549988B1 (en) * | 1999-01-22 | 2003-04-15 | Ilya Gertner | Data storage system comprising a network of PCs and method using same |
US7145869B1 (en) * | 1999-03-17 | 2006-12-05 | Broadcom Corporation | Method for avoiding out-of-ordering of frames in a network switch |
US6732124B1 (en) * | 1999-03-30 | 2004-05-04 | Fujitsu Limited | Data processing system with mechanism for restoring file systems based on transaction logs |
US6463501B1 (en) * | 1999-10-21 | 2002-10-08 | International Business Machines Corporation | Method, system and program for maintaining data consistency among updates across groups of storage areas using update times |
US6658590B1 (en) * | 2000-03-30 | 2003-12-02 | Hewlett-Packard Development Company, L.P. | Controller-based transaction logging system for data recovery in a storage area network |
US6658540B1 (en) * | 2000-03-31 | 2003-12-02 | Hewlett-Packard Development Company, L.P. | Method for transaction command ordering in a remote data replication system |
US20040078399A1 (en) * | 2000-03-31 | 2004-04-22 | Hitachi, Ltd. | Method for duplicating data of storage subsystem and data duplicating system |
US6781992B1 (en) * | 2000-11-30 | 2004-08-24 | Netrake Corporation | Queue engine for reassembling and reordering data packets in a network |
US7120149B2 (en) * | 2001-02-28 | 2006-10-10 | Ericsson Inc. | Methods and system for resequencing out of order data packets |
US7088719B2 (en) * | 2001-12-21 | 2006-08-08 | Agere Systems Inc. | Processor with packet processing order maintenance based on packet flow identifiers |
US7072342B1 (en) * | 2002-03-20 | 2006-07-04 | Applied Micro Circuits Corporation | Reordering of out-of-order packets |
US20070081558A1 (en) * | 2002-05-16 | 2007-04-12 | Nadim Shaikli | System For Reordering Sequenced Based Packets In A Switching Network |
US7103796B1 (en) * | 2002-09-03 | 2006-09-05 | Veritas Operating Corporation | Parallel data change tracking for maintaining mirrored data consistency |
US7197616B2 (en) * | 2003-03-25 | 2007-03-27 | Emc Corporation | Virtual ordered writes |
US7080221B1 (en) * | 2003-04-23 | 2006-07-18 | Emc Corporation | Method and apparatus for managing migration of data in a clustered computer system environment |
US7039773B2 (en) * | 2003-04-29 | 2006-05-02 | Oracle International Corporation | Method and mechanism for efficient implementation of ordered records |
US7092976B2 (en) * | 2003-06-24 | 2006-08-15 | International Business Machines Corporation | Parallel high speed backup for a storage area network (SAN) file system |
US7139851B2 (en) * | 2004-02-25 | 2006-11-21 | Hitachi, Ltd. | Method and apparatus for re-synchronizing mirroring pair with data consistency |
US20060190504A1 (en) * | 2005-02-18 | 2006-08-24 | International Business Machines Corporation | Simulating multi-user activity while maintaining original linear request order for asynchronous transactional events |
US20060218433A1 (en) * | 2005-03-22 | 2006-09-28 | Williams Jeffrey L | Method, apparatus and program storage device for providing intelligent rebuild order selection |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070168704A1 (en) * | 2005-11-30 | 2007-07-19 | Oracle International Corporation | System and method of configuring a database system with replicated data and automatic failover and recovery |
US7549079B2 (en) * | 2005-11-30 | 2009-06-16 | Oracle International Corporation | System and method of configuring a database system with replicated data and automatic failover and recovery |
US20080216156A1 (en) * | 2007-03-02 | 2008-09-04 | Proprietary Controls Systems Corporation | Fault tolerant security system, method and apparatus |
US7644299B2 (en) * | 2007-03-02 | 2010-01-05 | Proprietary Controls Systems Corporation | Fault tolerant security system, method and apparatus |
Also Published As
Publication number | Publication date |
---|---|
WO2002071220A1 (en) | 2002-09-12 |
US7096382B2 (en) | 2006-08-22 |
EP1379949A1 (en) | 2004-01-14 |
EP1379949A4 (en) | 2006-09-27 |
US20020133737A1 (en) | 2002-09-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7096382B2 (en) | System and a method for asynchronous replication for storage area networks | |
US8171101B2 (en) | Smart access to a dispersed data storage network | |
US8381024B2 (en) | Arrangement for recovery of data by network nodes based on retrieval of encoded data distributed among the network nodes | |
US7127477B2 (en) | Method and system for access to automatically synchronized remote files | |
US7085819B2 (en) | System and method for distributed network data storage | |
US7424514B2 (en) | Peer-to-peer method and system for performing and managing backups in a network of nodes | |
JP5563220B2 (en) | Method and system for data backup | |
US7836014B2 (en) | Hybrid real-time data replication | |
US7200726B1 (en) | Method and apparatus for reducing network traffic during mass storage synchronization phase of synchronous data mirroring | |
US7120654B2 (en) | System and method for network-free file replication in a storage area network | |
US7752403B1 (en) | Methods and systems for secure dispersed redundant data storage | |
US20040049700A1 (en) | Distributive storage controller and method | |
US20140081919A1 (en) | Distributed backup system for determining access destination based on multiple performance indexes | |
US20050144518A1 (en) | Data backup | |
US20090222509A1 (en) | System and Method for Sharing Storage Devices over a Network | |
US8806617B1 (en) | System and method for maintaining server data integrity | |
EP3620925B1 (en) | Disaster recovery as a service | |
US20060184502A1 (en) | Method for file level remote copy of a storage device | |
KR20020003859A (en) | Web server content replication | |
WO2013030217A1 (en) | Method for data maintenance | |
US7437523B1 (en) | System and method for on-the-fly file folding in a replicated storage system | |
JP2005182251A (en) | Backup system and method, and program | |
JP2017142605A (en) | Backup restoration system and restoration method | |
US20040073681A1 (en) | Method for paralled data transmission from computer in a network and backup system therefor | |
US8458295B1 (en) | Web content distribution devices to stage network device software |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |