US5933653A - Method and apparatus for mirroring data in a remote data storage system - Google Patents
Method and apparatus for mirroring data in a remote data storage system Download PDFInfo
- Publication number
- US5933653A US5933653A US08/657,760 US65776096A US5933653A US 5933653 A US5933653 A US 5933653A US 65776096 A US65776096 A US 65776096A US 5933653 A US5933653 A US 5933653A
- Authority
- US
- United States
- Prior art keywords
- data
- data storage
- storage facility
- operating mode
- buffer memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
- G06F11/2069—Management of state, configuration or failover
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
- G06F11/2071—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using a plurality of controllers
- G06F11/2074—Asynchronous techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
- G06F11/2071—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using a plurality of controllers
- G06F11/2076—Synchronous techniques
Definitions
- This invention generally relates to digital data processing systems with a local data storage facility and one or more geographically remote data storage facilities that mirror the local data storage facility and more particularly to a method and apparatus for transferring data from the local to the remote data storage facility.
- Computer implemented data base management systems are exemplary of systems that operate with what can become two antithetical considerations, namely: (1) maintaining the integrity of the data on the system and (2) maintaining maximum availability of the data on the system for maintenance, as by writing data to the system.
- backup operations preserve data integrity by copying the data to tape or other bulk storage media periodically; i.e., a "tape backup" operation.
- data maintenance operations for maintaining the data base were mutually exclusive with respect to tape backup operations. That is, no data maintenance or update operations could occur while the tape backup operation was in progress.
- two storage devices such as disk storage devices, store data in a form that enables the data to be recovered if one storage device becomes disabled.
- a first disk storage device stores the data and a second disk storage device, at the same location, stores a mirror image of that data. Whenever a transfer is made to the first disk storage device, the data transfers to the second disk storage device essentially simultaneously.
- separate controllers and paths interconnect the two disk storage devices to the remainder of the computer system.
- a computer system with a remote data facility will include a first data processing system with disk storage facility at a local site and one or more duplicate data processing systems at one or more physically or geographically remote locations that operate with other data storage facilities as remote mirrors of the data in the local system.
- the geographical separation can be measured in any range between meters and hundreds or even thousands of kilometers.
- Prior art systems using geographical remote data storage facilities for mirroring data storage facilities at a local site such as a Symmetrix remote data facility manufactured by the assignee of the present invention, maintains synchronism between the data stored at the local site in a local volume with the data located in the mirror on a target volume.
- each writing operation from a host that may contain a single writing command or a sequence of writing commands depending upon the nature of the system, transfer data to the data storage facility at the local site and to the remote site.
- no additional data writing operations can occur until this acknowledgment is received.
- operations other than writing operations may occur; a successive writing operation to that volume will be held in suspension pending acknowledgement of a prior writing operation.
- writing operations are evenly distributed in time and constitute less than a major proportion of the operations.
- the delays encountered in transferring data from the local to the remote site and awaiting the return of an acknowledgement do not affect the overall operation of the system.
- Writing bursts can occur particularly during data transfers resulting from a data reorganization or during the execution of some batch programs. In such situations writing operations can constitute a significant portion of the total number of transactions between the data processing system and the local data storage facility.
- Block transfers can occur during an original installation of a remote data facility and other tasks.
- Another alternative is merely to allow the standard normal writing operations to eventually synchronize the remote site. This is not advantageous because completion of any such transfer requires a writing operation to each and every position on the local disk whether or not it needs to be changed in order to affect a complete copying and synchronization.
- bursts of writing operations can introduce significant delays and affect the response of a data processing system connected to the local data storage facility.
- the transfer of large blocks of data can have the adverse affect of shutting down the system for an intolerable interval. If the blocks are made smaller to minimize any delay interval, the time required to transfer the data and synchronize the system becomes longer and may also become unacceptable.
- Another object of this invention is to provide a method and apparatus for transferring data from a data storage facility at a local site to a data storage facility at a geographically remote location during sequences of repetitive writing operations.
- Still another object of this invention is to provide a method and apparatus for transferring data from a data storage facility at a local site to a storage facility at a geographically remote site when the remote site is being added to the data processing system.
- Still yet another object of this invention is to provide a method and apparatus for transferring of data from a data storage facility at a local site to a data storage facility at a geographical remote location that can operate with controls that enable the systems to operate out of synchronism.
- a data processing network includes a first data storage facility, a geographically remote second data storage facility and a communications link that enable transfers therebetween.
- Each data storage facility includes a data store, typically one or more disk storage devices, and a buffer memory for temporarily storing data whereby data transfers from the buffer memory to the data store.
- the first data storage facility includes a host connection that provides a path to a host data processor. During a writing operation the host data processor effects a transfer of data to the buffer memory.
- the first and second data storage facilities receive that data in accordance with a normal operating mode.
- normal operating mode can be disabled thereby enabling the operation of an alternate operating mode wherein data transfers from the host processor connection transfer to the buffer memory in the first data storage facility and from the buffer memory to the data store therein.
- the system then transfers an acknowledgement signal indicating the successful transfer of the data to the host processor.
- the transfer from the first to the second data storage facility then occurs asynchronously and independently of the operation of the first data storage facility and the host processor.
- FIG. 1 is a block diagram of a data processing network constructed in accordance with this invention
- FIGS. 2A through 2E are flow diagrams that are useful in understanding the operation of the data processing network shown in FIG. 1;
- FIG. 3 depicts the organization of a track status table shown in FIG. 1;
- FIG. 4 is another flow diagram that is useful in understanding this invention.
- FIG. 5 is another flow diagram that is useful in understanding this invention.
- FIG. 1 depicts a data processing network 9 comprising two essentially identical data processing systems that include a local system 10 and a geographically remote system 11.
- a communications link 12 comprising fiber optic cables or high-speed data transmission lines, interconnects the local system 10 and remote system 11.
- the physical separation between the local system 10 and the remote system 11 can be up to hundreds of kilometers or more.
- the local system 10 comprises, as major components, a host system 13 with a host processor and a first data storage facility with a system memory 14 and sets 15 and 16 of multiple data storage devices or data stores.
- the system memory 14 can comprise a buffer or cache memory; the storage devices in the pluralities 15 and 16 can comprise disk storage devices, optical storage devices and the like.
- the sets 15 and 16 represent an array of storage devices in any of a variety of known configurations.
- a channel director (CD) 17 provides communications between the host system 13 and the system memory 14; device controllers (DC) 20 and 21 provide pathways between the system memory 14 and the storage device pluralities 15 and 16.
- a bus 22 interconnects the system memory 14, the channel directors 17 and 18 and the device controllers 20 and 21.
- a system manager 23 enables an operator to transfer information between the various elements of the system, such as a command buffer 24, TRANSFER MODE block 25 and a TRACK STATUS block 26 through one of the device controllers, namely the device controller 21 in FIG. 1.
- Bus access logic not shown but known in the art, controls transfers over the bus.
- the local system 10 operates in response to commands from one or more host systems, such as the host system 13.
- a connected channel director such as channel director 17, receives those commands and translates them into requests, such as write requests.
- the channel directors 17 and 18 transfer these requests to the system memory 14 in locations, such as the command buffer 24.
- the device controllers such as the device controller 20 or 21, respond to requests in the command buffer by effecting a corresponding operation.
- the selected device controller then initiates a data operation. Reading operations transfer data from the storage devices to the system memory 14 through a corresponding device controller and subsequently transfer data from the system memory 14 to the corresponding channel director, such as channel director 17.
- the local system 10 in FIG. 1 additionally includes a remote link director (RLD) 30 for controlling transfers of data between the local system 10 and the remote system 11 over the communications link 12.
- RLD remote link director
- the major components of the remote link director 30 include a control 31 and a buffer memory 32.
- the remote link director 30 connects to the system bus 22 and the communications link 12.
- the remote system 11 includes a remote link director 33 that connects to the communications link 12 and includes a control 34 and a buffer memory 35. Signals received from the remote link director 33 transfer over a system bus 36, like the system bus 22, of the remote system 11.
- the remote system 11, like the local system 10, includes, as its major components, a host system 40, a system memory 41 and storage device sets or data stores 42 and 43.
- the sets 42 and 43 represent an array of storage devices configured to mirror the sets 15 and 16.
- the remote system 11 includes channel directors 44 and 45 for connection to host systems.
- the host system 40 connects to the bus 36 through the channel director 44.
- Device controllers 46 and 47 provide pathways between the system bus 36 and the storage device sets 42 and 43 respectively.
- a system manager 50 enables an operator to transfer information between the various elements of the system, such as a command buffer 51, RLD STATUS block 52 and a TRACK STATUS block 53 that are described in more detail later.
- Bus access logic not shown but known in the art, controls transfers over this bus.
- Each of the local and remote systems 10 and 11 may comprise a Symmetrix integrated cached disk array as manufactured and sold by the assignee of this invention according to known operations as described in Yanai et al., U.S. Pat. No. 5,206,939 issued Apr. 27, 1993. Consequently, the following discussion makes only general references to general operation of such systems.
- the remote system 11 normally acts as a mirror of the local system 10 on a volume-by-volume basis and that the volume can be a physical volume, although a logical volume is a preferred division.
- the system in FIG. 1 operates with an extremely high degree of reliability, even in the event of a natural disaster. In such systems transfers from the local system 10 to the remote system 11 normally occur in response to a writing command issued by a local host system such as the host system 13. The details of such a transfer are discussed later.
- the host system 40 in such an environment, could be limited to performing read operations in order that the remote system 11 exactly mirror the local system 10. Should some catastrophic event prevent any part of the local system 10 from operating, control can be transferred to the remote system 11 through use of the system manager 50 that would disconnect the remote link director 33 and enable the host system 40 to read and write data to the storage device sets 42 and 43.
- Mirroring remote data facilities are also known in the art; and Symmetrix remote data facilities supplied by the assignee of this invention provide such remote mirroring capabilities.
- the local system 10 In a normal operating mode the local system 10 is the active system while the remote system 11 functions solely as a mirror.
- the local system 10 processes all the OLTP applications including those that can effect changes to the data base.
- the host system 13 issues a Channel Control Word (CCW) command including all the necessary parameters from which the system can transfer a data block to or from a particular location in the storage device sets 15 and 16.
- CCW Channel Control Word
- Other operating systems use other procedures, and this invention is readily adapted to operate with such systems.
- a host system such as the host system 13 in FIG. 1 issues a command, it transfers the CCW command or equivalent to the channel director 17 that responds by generating a write request for transfer to the system memory 14.
- the system memory control 24 determines that the pending CCW command will perform an operation other than a writing operation for transferring data to a location in one of the storage device sets 15 or 16, step 60 of FIG. 2A diverts to perform the requested operation in step 61.
- the CCW request defines a write operation
- control transfers from step 60 to step 62 wherein the information comprising the write request and data to be written are stored into a buffer memory in the system memory 14 for subsequent transfer to locations in the storage device sets 15 and 16 in a normal fashion. This operation is also called a destaging operation.
- the RLD STATUS block 25 indicates an ONGOING status because the remote system 11 connects to the local system 10 through the remote link directors 30 and 33 and the communications link 12 and because the local system 10 and remote system 11 are synchronized.
- Step 64 determines whether the system is operating in a "SYNC" operating mode that constitutes one of two normal operating modes.
- a channel director such as the channel director 17 in FIG. 1, generates a write request for the remote system 11 in step 65. This involves loading the data and a write request into the system memory 14 for transfer to an appropriate one of the pluralities of storage devices 42 and 43. This also could be accomplished simultaneously or in conjunction with step 62.
- the alternate operating mode can be implemented with either of two procedures and that the alternate operating mode can be controlled so it operates only under certain conditions or constraints.
- the first is an "ADAPTIVE COPY-WRITE PENDING" procedure.
- Step 66 determines whether this procedure was being processed and interrupted to return to the SYNC operating mode. If it was, step 67 determines whether the number of write requests pending for the remote system are above a maximum. If they are not, system operation advances to FIG. 2D and returns to the ADAPTIVE COPY-WRITE PENDING operating mode. Otherwise the system transfers to await an acknowledgement signal in step 70.
- the other alternating operating mode is an "ADAPTIVE COPY-DISK" operating mode.
- Step 71 determines whether the requested SYNC operation has been initiated by interrupting such an ADAPTIVE COPY-DISK operating mode. If it has, the system tests the number of invalid tracks listed in the TRACK STATUS table 26 of FIG. 1. If the number of marked tracks are above a maximum, step 72 transfers to step 70. Otherwise control transfers to the steps in FIG. 2E and returns the operations to the ADAPTIVE COPY-DISK operating mode.
- Steps 70 and 73 act together to monitor the network for a timely return of an acknowledgement from the remote system 11 within the predetermined time interval. If no such acknowledgement is received, an error condition exists and the RLD 30 generates a UNIT CHECK message in step 74. Whether the acknowledgment is received or not, the initiating channel director, such as channel director 17, sends a CE, or Channel End, signal to the host system 13 in step 75.
- step 76 transfers control to step 77 to send a DE, or Device End, signal to the host system 13. After processing the last CCW command in a sequence step 76 diverts to step 80 to test for any error conditions. If no error has occurred, the channel director 17 uses step 77 to send the DE signal to the host system 13. If an error has occurred, control passes to step 81 to transfer the DE signal with a message identifying the nature of the error.
- one of the device controllers such as device controller 20 or 21, at the local system, responds to the write request by transferring the written data from the system memory 14 to an appropriate location in one of the pluralities of storage devices 15 and 16.
- Step 82 indicates this procedure.
- step 64 in FIG. 2B diverts to step 83 in FIG. 2C.
- Step 83 in FIG. 2C then diverts to step 84 whereupon the channel director generates the write request that transfers to the system memory 14 for transfer to locations in the storage devices 15 and 16 and in the storage devices 42 and 43.
- a series of steps 85, 86, 87 and 88 perform the same function as steps 66, 67, 71 and 72 in FIG. 2B.
- these steps determine whether the system is operating in the SEMI-SYNC operating mode after interrupting either of the ADAPTIVE COPY, WRITE-PENDING or ADAPTIVE COPY-DISK operating modes and determining whether the procedure should revert to those modes.
- steps 91 and 92 perform analogous functions to steps 75 and 76 by sending the DE signal to the host system 13 until the last CCW in a sequence is processed.
- the host system 13 can perform other disk operations. If the channel director 17 issues a second write request before the remote system returns an acknowledgment for the prior write request, the local system effectively disconnects and returns a non-immediate retry message. When the acknowledgement is received, the local system 10 reconnects through the channel director and processes the second write request on a retry.
- step 93 This "delay" procedure is designated by step 93.
- step 94 diverts to step 95 whereby the SEMI-SYNC writing operation is completed. If, however, no acknowledgment signal is received in a predetermined time, established by step 96, step 96 diverts to step 97 whereupon the M2 bit in the corresponding entry of the TRACK STATUS block 26, as shown in FIGS. 1 and 3, is set to an invalid state.
- the storage device sets 42 and 43 or logical volumes therein exactly mirror the corresponding ones of the storage device sets 15 and 16 or logical volumes therein according to configuration information from the system manager 23 and system manager 50.
- FIG. 3 represents the TRACK STATUS block 26 as a matrix in which each row identifies a track in the storage device sets 15 and 16 and in the sets 42 and 43.
- the columns are headed by M1, M2, M3 and M4that establish correspondences between each column position and the local or remote system.
- each entry in the block 26 corresponds to a data block of a minimum transfer size. In Symmetrix systems this is typically a track; however, in other systems a given track might be divided into multiple blocks or a block might even comprise multiple contiguous tracks. Such variations only change the organization of the TRACK STATUS block 26 by increasing or decreasing the number of rows in the TRACK STATUS block 26. Each row will correspond to one data block.
- the M1 column in FIG. 3 indicates whether the data in the corresponding track in the local system 10 is valid while the M2 column indicates whether the data in the corresponding track in the remote system 11 is valid.
- the M3 and M4 columns in FIG. 2 would indicate the whether the data in the corresponding tracks in the remaining two mirrored systems were valid.
- a "0" indicates a valid data track or block; a "1", an invalid data track or block.
- the failure to produce an appropriate transfer within a predetermined time interval causes the local system to set its corresponding TRACK STATUS bit for the corresponding track in the remote system to an invalid state. Thereafter a copy program 100 that, when enabled, monitors the TRACK STATUS will transfer the corresponding track from one of the storage devices 15 and 16 to the corresponding track location of the storage devices 42 and 43.
- the system memory 14 receives and retains a write request and corresponding data until the transfer is complete to the data stores, as the pluralities 15 and 16 and the pluralities 42 and 43 of the storage devices until receiving an acknowledgment that both write requests have been destaged. In this mode all further transfers or operations with the corresponding volume or division through the requesting channel director are blocked.
- the system memory 14 retains a write request and data only until the transfer is made to the appropriate one of the pluralities 15 and 16 of the storage devices and is properly transferred to the remote system 11 within the predetermined time. If not, the system memory 14 no longer retains that data and the track to which the data has been transferred must be copied to the remote system 11.
- the system operator can use the system manager 23 to establish one of two previously described adaptive copy operating modes, namely: an ADAPTIVE COPY-WRITE PENDING operating mode or the ADAPTIVE COPY-DISK operating mode. If the data network 9 for any logical volume is operating in either of these modes, steps 64 in FIG. 2B and steps 83 in FIG. 2C divert to step 101 in FIG. 2D.
- step 101 in FIG. 2D diverts to step 102 wherein the channel director handling a write request determines the number of pending write requests for transfer to the logical volume or other division in the remote system 11. If that number is greater than an allowable maximum, step 103 diverts to step 104 that changes the operating mode to the prior normal operating mode; namely, either the operating mode of FIG. 2B or the operating mode of FIG. 2C as previously indicated.
- the channel director such as the channel director 17, sends the CE signal to the host system in step 105, determines if it is processing the last "CCW" in a sequence in step 106 and then completes the operation by either sending a DE signal in step 107 or a DE signal with a message in step 108 where the message indicates an error that is monitored in step 109.
- FIG. 4 depicts the RLD and remote system response to a write request during the ADAPTIVE COPY-WRITE PENDING operating mode.
- step 111 in FIG. 4 diverts to step 112 if some other operation has been required.
- the RLD 30 retrieves the write request from the buffer memory in the system memory 14 and initiates a transfer of the write request and corresponding data to the system memory 41 in FIG. 1.
- the designated device controller in the remote system 11 destages that write request and generates an acknowledgment in step 114.
- the RLD 33 transfers that acknowledgement to the RLD 30 in step 115.
- the RLD 30 then clears the write request in the system memory 14 in step 116. Consequently at the end of each such operation one write request that had been previously transferred into the system memory 14 has destaged to the remote system 11 independently of subsequent operations in the local system 10.
- this mode data transfers from the local system 10 to the remote system 11 but the local system 10 does not wait for the receipt of any acknowledgment or synchronization from the remote system 11.
- This mode is especially useful when a large amount of data must be transferred to remote devices and performance must not be compromised at the host system 13 or when it is not necessary for the remotely mirrored volumes to be synchronized at all times.
- the data in the remote system 11 remains as current to the data in the local system 10 as possible and as determined by the maximum number of requests pending in the command buffer 24.
- the system memory 14 includes a PEND REQ table 110 into which the system manager 23 transfers the number of permissible write requests to the remote system 11 that can remain pending. This indicates the amount by which the two systems can be out of synchronism.
- the local system 10 informs the host system 13 of each of a successful write operation immediately upon transferring the data into the system memory 14.
- the local system 10 then operates to destage the data into the appropriate one of the local storage devices 15 and 16.
- the RLD 30 subsequently transfers the data to the system memory 41 in the remote system 14 via the communications link and RLD 33. This data transfer occurs while the local system 10 continues to process subsequent input/output commands through the same channel director and even to the same logical volume or division.
- the system manager 23 can fine tune the value in the PEND REQ table 110. That table can contain entries for each logical volume or other division in the network. Each channel director, such as the channel director 17, monitors the value of the number of pending requests for a given volume against corresponding entries in the PEND REQ table 110.
- the other alternate operating mode is the ADAPTIVE COPY-DISK operating mode depicted in FIG. 2E.
- step 101 in FIG. 2D diverts to step 117 in FIG. 2E to establish this operating mode. If still some other operation is designated control passes to step 118 that, for example, could include an error procedure indicative of an illegal command.
- the channel director determines the number of invalid tracks for the remote system 11 in step 120. More specifically, the channel director, such as the channel director 17, looks at the number of bits set in the TRACK STATUS register 26. If that number is greater than an allowable maximum, contained in an INV TRKS table 122 in FIG.
- step 121 diverts to step 123 where, in a fashion analogous to that shown in FIG. 2D, the system transfers to FIG. 2B or FIG. 2C depending upon the prior normal operating mode.
- step 121 diverts to step 124 whereupon the channel director begins a sequence to send the CE and DE signals to the host system 13. More specifically steps 124, 125, 126, 127 and 128 operate in a fashion that is analogous to the operations in similar steps shown in FIGS. 2B, 2C and 2D.
- the INV TRKS table 122 can actually constitute a register corresponding to each logical volume in the system to provide control on a logical-volume-by-logical-volume-basis or corresponding to other divisions of the data storage facilities as may be appropriate.
- This mode is particularly adapted for situations when large amounts of data must be transferred to a remote system and has little impact on the performance between a host system 13 and the local data storage facility.
- This mode keeps the data in the remote system 11 as current to the data in the local system 10 as possible.
- the ADAPTIVE COPY-DISK operating mode enables the local system 10 to acknowledge all write operations as if they were local volumes. In this case, however, the data is not retained in the system memory 14 after it is destaged to the data stores in the local system 10.
- the RLD 30 uses step 130 to transfer to step 131 if the system is operating in an ADAPTIVE COPY-DISK operating mode. If it is not, control transfers to step 131 that determines whether another appropriate operation is necessary.
- step 132 the RLD 30 tests a bit in the TRACK STATUS register 26 and particularly for a track in the M2 column shown in FIG. 3, to determine whether the track in the remote system is valid. If it is invalid and the corresponding track in the local system 10 is valid, step 133 transfers to step 134 whereupon the RLD 30 initiates the copy process 100 to transfer the data in the identified track from the local system 10 to the remote system 11.
- step 135 uses step 135 to identify a next track in the TRACK STATUS register 26 and returns to step 132. If a particular bit is valid, step 133 transfers control to step 135 to identify a next track in the TRACK STATUS register 26.
- This operating mode continues until the system manager 23 returns operations to the normal operating mode or until the number of invalid tracks, or "skew", exceeds a predetermined number in the INV TRKS table 122 assigned to the logical volume or other division. As previously indicated, exceeding the maximum causes step 121 in FIG. 2E to divert to step 123 to return to the normal operating mode. Thereafter the systems 10 and 11 will destage each subsequent write request according to the SYNC or SEMI-SYNC operating modes. However, the copy program 100 will continue to operate, albeit with less priority with respect to the subsequent destaging operations.
Abstract
A data processing network including a local system and a geographically remote system. Each of the local and remote systems includes a data storage facility. The remote data storage facility mirrors the local data storage facility. In a normal operating mode, the local and remote systems operate in near synchronism or in synchronism. In an alternate operating mode, writing operations at the local system immediately update the storage devices in the local data storage facility. Transfers of corresponding data to the remote data storage facility are made independently of and asynchronously with respect to the operation of the local system.
Description
1. Field of the Invention
This invention generally relates to digital data processing systems with a local data storage facility and one or more geographically remote data storage facilities that mirror the local data storage facility and more particularly to a method and apparatus for transferring data from the local to the remote data storage facility.
2. Description of Related Art
Computer implemented data base management systems are exemplary of systems that operate with what can become two antithetical considerations, namely: (1) maintaining the integrity of the data on the system and (2) maintaining maximum availability of the data on the system for maintenance, as by writing data to the system. In some prior art approaches backup operations preserve data integrity by copying the data to tape or other bulk storage media periodically; i.e., a "tape backup" operation. However, data maintenance operations for maintaining the data base were mutually exclusive with respect to tape backup operations. That is, no data maintenance or update operations could occur while the tape backup operation was in progress.
More recently disk redundancy has evolved as an alternative or complement to tape backup operations. Generally speaking, in a redundant system two storage devices, such as disk storage devices, store data in a form that enables the data to be recovered if one storage device becomes disabled. In a basic approach, a first disk storage device stores the data and a second disk storage device, at the same location, stores a mirror image of that data. Whenever a transfer is made to the first disk storage device, the data transfers to the second disk storage device essentially simultaneously. Typically separate controllers and paths interconnect the two disk storage devices to the remainder of the computer system.
More recently the concept of redundancy has come to include remote data facilities. A computer system with a remote data facility will include a first data processing system with disk storage facility at a local site and one or more duplicate data processing systems at one or more physically or geographically remote locations that operate with other data storage facilities as remote mirrors of the data in the local system. The geographical separation can be measured in any range between meters and hundreds or even thousands of kilometers.
Prior art systems using geographical remote data storage facilities for mirroring data storage facilities at a local site, such as a Symmetrix remote data facility manufactured by the assignee of the present invention, maintains synchronism between the data stored at the local site in a local volume with the data located in the mirror on a target volume. In one operating mode each writing operation from a host, that may contain a single writing command or a sequence of writing commands depending upon the nature of the system, transfer data to the data storage facility at the local site and to the remote site. In one variation no additional data writing operations can occur until this acknowledgment is received. In another, operations other than writing operations may occur; a successive writing operation to that volume will be held in suspension pending acknowledgement of a prior writing operation. With this approach, the local and remote storage facilities will be in complete synchronism or at most, to within one writing operation of synchronism on a volume-by-volume basis. This provides maximum protection because under any scenario only minimal data loss is possible should some catastrophic failure occur at one or the other sites or in any communications link therebetween.
In many applications writing operations are evenly distributed in time and constitute less than a major proportion of the operations. The delays encountered in transferring data from the local to the remote site and awaiting the return of an acknowledgement do not affect the overall operation of the system. However, there are two basic types of operations in which these methods do not provide completely satisfactory results. One involves bursts of writing operations; the other block transfers to the remote data facility. Writing bursts can occur particularly during data transfers resulting from a data reorganization or during the execution of some batch programs. In such situations writing operations can constitute a significant portion of the total number of transactions between the data processing system and the local data storage facility.
Block transfers can occur during an original installation of a remote data facility and other tasks. There are some prior art alternatives for making block transfers to the remote data storage facility. The first is to make a tape backup of the data at the local site for transport to the remote site. The alternative is to copy the entire disk directly to the remote site over the interconnecting communications link. Either approach requires termination of any normal operations at the local site. Another alternative is merely to allow the standard normal writing operations to eventually synchronize the remote site. This is not advantageous because completion of any such transfer requires a writing operation to each and every position on the local disk whether or not it needs to be changed in order to affect a complete copying and synchronization.
As will be apparent each of the foregoing conditions can be unacceptable when the data base stored at the local site must be available on a continuous basis. Bursts of writing operations can introduce significant delays and affect the response of a data processing system connected to the local data storage facility. The transfer of large blocks of data can have the adverse affect of shutting down the system for an intolerable interval. If the blocks are made smaller to minimize any delay interval, the time required to transfer the data and synchronize the system becomes longer and may also become unacceptable.
Therefore, it is an object of this invention to provide a method and apparatus for transferring data from one data storage facility to a mirroring data storage facility at a geographically remote location.
Another object of this invention is to provide a method and apparatus for transferring data from a data storage facility at a local site to a data storage facility at a geographically remote location during sequences of repetitive writing operations.
Still another object of this invention is to provide a method and apparatus for transferring data from a data storage facility at a local site to a storage facility at a geographically remote site when the remote site is being added to the data processing system.
Still yet another object of this invention is to provide a method and apparatus for transferring of data from a data storage facility at a local site to a data storage facility at a geographical remote location that can operate with controls that enable the systems to operate out of synchronism.
In accordance with one aspect of this invention, a data processing network includes a first data storage facility, a geographically remote second data storage facility and a communications link that enable transfers therebetween. Each data storage facility includes a data store, typically one or more disk storage devices, and a buffer memory for temporarily storing data whereby data transfers from the buffer memory to the data store. The first data storage facility includes a host connection that provides a path to a host data processor. During a writing operation the host data processor effects a transfer of data to the buffer memory. The first and second data storage facilities receive that data in accordance with a normal operating mode. In accordance with this invention that normal operating mode can be disabled thereby enabling the operation of an alternate operating mode wherein data transfers from the host processor connection transfer to the buffer memory in the first data storage facility and from the buffer memory to the data store therein. The system then transfers an acknowledgement signal indicating the successful transfer of the data to the host processor. The transfer from the first to the second data storage facility then occurs asynchronously and independently of the operation of the first data storage facility and the host processor.
The appended claims particularly point out and distinctly claim the subject matter of this invention. The various objects, advantages and novel features of this invention will be more fully apparent from a reading of the following detailed description in conjunction with the accompanying drawings in which like reference numerals refer to like parts, and in which:
FIG. 1 is a block diagram of a data processing network constructed in accordance with this invention;
FIGS. 2A through 2E are flow diagrams that are useful in understanding the operation of the data processing network shown in FIG. 1;
FIG. 3 depicts the organization of a track status table shown in FIG. 1;
FIG. 4 is another flow diagram that is useful in understanding this invention; and
FIG. 5 is another flow diagram that is useful in understanding this invention.
FIG. 1 depicts a data processing network 9 comprising two essentially identical data processing systems that include a local system 10 and a geographically remote system 11. A communications link 12, comprising fiber optic cables or high-speed data transmission lines, interconnects the local system 10 and remote system 11. The physical separation between the local system 10 and the remote system 11 can be up to hundreds of kilometers or more.
The local system 10 comprises, as major components, a host system 13 with a host processor and a first data storage facility with a system memory 14 and sets 15 and 16 of multiple data storage devices or data stores. The system memory 14 can comprise a buffer or cache memory; the storage devices in the pluralities 15 and 16 can comprise disk storage devices, optical storage devices and the like. The sets 15 and 16 represent an array of storage devices in any of a variety of known configurations.
A channel director (CD) 17 provides communications between the host system 13 and the system memory 14; device controllers (DC) 20 and 21 provide pathways between the system memory 14 and the storage device pluralities 15 and 16. A bus 22 interconnects the system memory 14, the channel directors 17 and 18 and the device controllers 20 and 21. A system manager 23 enables an operator to transfer information between the various elements of the system, such as a command buffer 24, TRANSFER MODE block 25 and a TRACK STATUS block 26 through one of the device controllers, namely the device controller 21 in FIG. 1. Bus access logic, not shown but known in the art, controls transfers over the bus.
Generally speaking, the local system 10 operates in response to commands from one or more host systems, such as the host system 13. A connected channel director, such as channel director 17, receives those commands and translates them into requests, such as write requests. The channel directors 17 and 18 transfer these requests to the system memory 14 in locations, such as the command buffer 24. The device controllers, such as the device controller 20 or 21, respond to requests in the command buffer by effecting a corresponding operation. The selected device controller then initiates a data operation. Reading operations transfer data from the storage devices to the system memory 14 through a corresponding device controller and subsequently transfer data from the system memory 14 to the corresponding channel director, such as channel director 17.
The local system 10 in FIG. 1 additionally includes a remote link director (RLD) 30 for controlling transfers of data between the local system 10 and the remote system 11 over the communications link 12. The major components of the remote link director 30 include a control 31 and a buffer memory 32. The remote link director 30 connects to the system bus 22 and the communications link 12.
The remote system 11 includes a remote link director 33 that connects to the communications link 12 and includes a control 34 and a buffer memory 35. Signals received from the remote link director 33 transfer over a system bus 36, like the system bus 22, of the remote system 11. The remote system 11, like the local system 10, includes, as its major components, a host system 40, a system memory 41 and storage device sets or data stores 42 and 43. The sets 42 and 43 represent an array of storage devices configured to mirror the sets 15 and 16. In the same fashion as in the local system 10, the remote system 11 includes channel directors 44 and 45 for connection to host systems. In this particular embodiment, the host system 40 connects to the bus 36 through the channel director 44. Device controllers 46 and 47 provide pathways between the system bus 36 and the storage device sets 42 and 43 respectively. A system manager 50 enables an operator to transfer information between the various elements of the system, such as a command buffer 51, RLD STATUS block 52 and a TRACK STATUS block 53 that are described in more detail later. Bus access logic, not shown but known in the art, controls transfers over this bus.
Each of the local and remote systems 10 and 11 may comprise a Symmetrix integrated cached disk array as manufactured and sold by the assignee of this invention according to known operations as described in Yanai et al., U.S. Pat. No. 5,206,939 issued Apr. 27, 1993. Consequently, the following discussion makes only general references to general operation of such systems. For purposes of this invention it is sufficient to understand that the remote system 11 normally acts as a mirror of the local system 10 on a volume-by-volume basis and that the volume can be a physical volume, although a logical volume is a preferred division. Given the geographical separation between the local and remote systems 10 and 11, the system in FIG. 1 operates with an extremely high degree of reliability, even in the event of a natural disaster. In such systems transfers from the local system 10 to the remote system 11 normally occur in response to a writing command issued by a local host system such as the host system 13. The details of such a transfer are discussed later.
The host system 40, in such an environment, could be limited to performing read operations in order that the remote system 11 exactly mirror the local system 10. Should some catastrophic event prevent any part of the local system 10 from operating, control can be transferred to the remote system 11 through use of the system manager 50 that would disconnect the remote link director 33 and enable the host system 40 to read and write data to the storage device sets 42 and 43. Mirroring remote data facilities are also known in the art; and Symmetrix remote data facilities supplied by the assignee of this invention provide such remote mirroring capabilities.
With this as background, it will now be possible to describe the various operations of these components during normal mirroring modes and during each of two alternate operating modes.
In a normal operating mode the local system 10 is the active system while the remote system 11 functions solely as a mirror. For example, when the system in FIG. 1 accommodates a database, the local system 10 processes all the OLTP applications including those that can effect changes to the data base. For purposes of this description, it is assumed that the host system 13 issues a Channel Control Word (CCW) command including all the necessary parameters from which the system can transfer a data block to or from a particular location in the storage device sets 15 and 16. Other operating systems use other procedures, and this invention is readily adapted to operate with such systems.
When a host system such as the host system 13 in FIG. 1 issues a command, it transfers the CCW command or equivalent to the channel director 17 that responds by generating a write request for transfer to the system memory 14. If the system memory control 24 determines that the pending CCW command will perform an operation other than a writing operation for transferring data to a location in one of the storage device sets 15 or 16, step 60 of FIG. 2A diverts to perform the requested operation in step 61. If the CCW request defines a write operation, control transfers from step 60 to step 62 wherein the information comprising the write request and data to be written are stored into a buffer memory in the system memory 14 for subsequent transfer to locations in the storage device sets 15 and 16 in a normal fashion. This operation is also called a destaging operation.
During normal mirroring operations, the RLD STATUS block 25 indicates an ONGOING status because the remote system 11 connects to the local system 10 through the remote link directors 30 and 33 and the communications link 12 and because the local system 10 and remote system 11 are synchronized. Under these conditions control transfers from step 62 in FIG. 2A to step 64 in FIG. 2B. Step 64 determines whether the system is operating in a "SYNC" operating mode that constitutes one of two normal operating modes. In this operating mode, a channel director, such as the channel director 17 in FIG. 1, generates a write request for the remote system 11 in step 65. This involves loading the data and a write request into the system memory 14 for transfer to an appropriate one of the pluralities of storage devices 42 and 43. This also could be accomplished simultaneously or in conjunction with step 62.
As will become apparent later, the alternate operating mode can be implemented with either of two procedures and that the alternate operating mode can be controlled so it operates only under certain conditions or constraints. The first is an "ADAPTIVE COPY-WRITE PENDING" procedure. Step 66 determines whether this procedure was being processed and interrupted to return to the SYNC operating mode. If it was, step 67 determines whether the number of write requests pending for the remote system are above a maximum. If they are not, system operation advances to FIG. 2D and returns to the ADAPTIVE COPY-WRITE PENDING operating mode. Otherwise the system transfers to await an acknowledgement signal in step 70. The other alternating operating mode is an "ADAPTIVE COPY-DISK" operating mode. Step 71 determines whether the requested SYNC operation has been initiated by interrupting such an ADAPTIVE COPY-DISK operating mode. If it has, the system tests the number of invalid tracks listed in the TRACK STATUS table 26 of FIG. 1. If the number of marked tracks are above a maximum, step 72 transfers to step 70. Otherwise control transfers to the steps in FIG. 2E and returns the operations to the ADAPTIVE COPY-DISK operating mode.
In the SYNC mode no succeeding operation involving a given logical volume or other memory division will occur unless the prior writing operation to that logical volume or division has been acknowledged within a predetermined time interval. Steps 70 and 73 act together to monitor the network for a timely return of an acknowledgement from the remote system 11 within the predetermined time interval. If no such acknowledgement is received, an error condition exists and the RLD 30 generates a UNIT CHECK message in step 74. Whether the acknowledgment is received or not, the initiating channel director, such as channel director 17, sends a CE, or Channel End, signal to the host system 13 in step 75. If this is the first or an intermediate CCW command in a sequence, step 76 transfers control to step 77 to send a DE, or Device End, signal to the host system 13. After processing the last CCW command in a sequence step 76 diverts to step 80 to test for any error conditions. If no error has occurred, the channel director 17 uses step 77 to send the DE signal to the host system 13. If an error has occurred, control passes to step 81 to transfer the DE signal with a message identifying the nature of the error.
Simultaneously with the foregoing operation, one of the device controllers, such as device controller 20 or 21, at the local system, responds to the write request by transferring the written data from the system memory 14 to an appropriate location in one of the pluralities of storage devices 15 and 16. Step 82 indicates this procedure.
If the network shown in FIG. 1 is operating in a "SEMI-SYNC" operating mode, step 64 in FIG. 2B diverts to step 83 in FIG. 2C. Step 83 in FIG. 2C then diverts to step 84 whereupon the channel director generates the write request that transfers to the system memory 14 for transfer to locations in the storage devices 15 and 16 and in the storage devices 42 and 43. A series of steps 85, 86, 87 and 88 perform the same function as steps 66, 67, 71 and 72 in FIG. 2B. Generally, these steps determine whether the system is operating in the SEMI-SYNC operating mode after interrupting either of the ADAPTIVE COPY, WRITE-PENDING or ADAPTIVE COPY-DISK operating modes and determining whether the procedure should revert to those modes.
Assuming the system is operating in a normal operating mode, control passes to step 90 where the channel director 17 responds to the transfer of the write request to the system memory 14 by transferring the CE signal to the host system 13. As in the SYNC operating mode, steps 91 and 92 perform analogous functions to steps 75 and 76 by sending the DE signal to the host system 13 until the last CCW in a sequence is processed. In this variation, the host system 13 can perform other disk operations. If the channel director 17 issues a second write request before the remote system returns an acknowledgment for the prior write request, the local system effectively disconnects and returns a non-immediate retry message. When the acknowledgement is received, the local system 10 reconnects through the channel director and processes the second write request on a retry. This "delay" procedure is designated by step 93. When an acknowledgment is received from the remote system 11, step 94 diverts to step 95 whereby the SEMI-SYNC writing operation is completed. If, however, no acknowledgment signal is received in a predetermined time, established by step 96, step 96 diverts to step 97 whereupon the M2 bit in the corresponding entry of the TRACK STATUS block 26, as shown in FIGS. 1 and 3, is set to an invalid state.
Consequently during the normal operating mode any change the host system 13 makes to the data in the storage device sets 15 and 16 automatically produces a corresponding change in the mirroring storage device sets 42 and 43. Moreover in normal operation the storage device sets 42 and 43 or logical volumes therein exactly mirror the corresponding ones of the storage device sets 15 and 16 or logical volumes therein according to configuration information from the system manager 23 and system manager 50.
It will be helpful to describe the structure and operation of the TRACK STATUS block 26 in FIG. 1. FIG. 3 represents the TRACK STATUS block 26 as a matrix in which each row identifies a track in the storage device sets 15 and 16 and in the sets 42 and 43. In FIG. 3 the columns are headed by M1, M2, M3 and M4that establish correspondences between each column position and the local or remote system.
It will be apparent that each entry in the block 26 corresponds to a data block of a minimum transfer size. In Symmetrix systems this is typically a track; however, in other systems a given track might be divided into multiple blocks or a block might even comprise multiple contiguous tracks. Such variations only change the organization of the TRACK STATUS block 26 by increasing or decreasing the number of rows in the TRACK STATUS block 26. Each row will correspond to one data block.
In a system as shown FIG. 1 with one mirror, only the data columns identified as the M1 and M2 columns contain relevant TRACK STATUS data. For any given track the M1 column in FIG. 3 indicates whether the data in the corresponding track in the local system 10 is valid while the M2 column indicates whether the data in the corresponding track in the remote system 11 is valid. In an implementation involving two additional remote systems, the M3 and M4 columns in FIG. 2 would indicate the whether the data in the corresponding tracks in the remaining two mirrored systems were valid. Typically and for purposes of this discussion, a "0" indicates a valid data track or block; a "1", an invalid data track or block.
Consequently in the SEMI-SYNC operating mode shown in FIG. 2C, the failure to produce an appropriate transfer within a predetermined time interval causes the local system to set its corresponding TRACK STATUS bit for the corresponding track in the remote system to an invalid state. Thereafter a copy program 100 that, when enabled, monitors the TRACK STATUS will transfer the corresponding track from one of the storage devices 15 and 16 to the corresponding track location of the storage devices 42 and 43.
Thus, as known, in the SYNC operating mode, the system memory 14 receives and retains a write request and corresponding data until the transfer is complete to the data stores, as the pluralities 15 and 16 and the pluralities 42 and 43 of the storage devices until receiving an acknowledgment that both write requests have been destaged. In this mode all further transfers or operations with the corresponding volume or division through the requesting channel director are blocked. During SEMI-SYNC mode operations the system memory 14 retains a write request and data only until the transfer is made to the appropriate one of the pluralities 15 and 16 of the storage devices and is properly transferred to the remote system 11 within the predetermined time. If not, the system memory 14 no longer retains that data and the track to which the data has been transferred must be copied to the remote system 11.
In accordance with this invention, the system operator can use the system manager 23 to establish one of two previously described adaptive copy operating modes, namely: an ADAPTIVE COPY-WRITE PENDING operating mode or the ADAPTIVE COPY-DISK operating mode. If the data network 9 for any logical volume is operating in either of these modes, steps 64 in FIG. 2B and steps 83 in FIG. 2C divert to step 101 in FIG. 2D.
If the ADAPTIVE COPY-WRITE PENDING operating mode has been selected, step 101 in FIG. 2D diverts to step 102 wherein the channel director handling a write request determines the number of pending write requests for transfer to the logical volume or other division in the remote system 11. If that number is greater than an allowable maximum, step 103 diverts to step 104 that changes the operating mode to the prior normal operating mode; namely, either the operating mode of FIG. 2B or the operating mode of FIG. 2C as previously indicated. Otherwise the channel director, such as the channel director 17, sends the CE signal to the host system in step 105, determines if it is processing the last "CCW" in a sequence in step 106 and then completes the operation by either sending a DE signal in step 107 or a DE signal with a message in step 108 where the message indicates an error that is monitored in step 109.
FIG. 4 depicts the RLD and remote system response to a write request during the ADAPTIVE COPY-WRITE PENDING operating mode. Particularly, step 111 in FIG. 4 diverts to step 112 if some other operation has been required. In step 113 the RLD 30 retrieves the write request from the buffer memory in the system memory 14 and initiates a transfer of the write request and corresponding data to the system memory 41 in FIG. 1. The designated device controller in the remote system 11 destages that write request and generates an acknowledgment in step 114. The RLD 33 transfers that acknowledgement to the RLD 30 in step 115. The RLD 30 then clears the write request in the system memory 14 in step 116. Consequently at the end of each such operation one write request that had been previously transferred into the system memory 14 has destaged to the remote system 11 independently of subsequent operations in the local system 10.
As will be apparent, in this mode data transfers from the local system 10 to the remote system 11 but the local system 10 does not wait for the receipt of any acknowledgment or synchronization from the remote system 11. This mode is especially useful when a large amount of data must be transferred to remote devices and performance must not be compromised at the host system 13 or when it is not necessary for the remotely mirrored volumes to be synchronized at all times. Essentially in this operating mode the data in the remote system 11 remains as current to the data in the local system 10 as possible and as determined by the maximum number of requests pending in the command buffer 24.
As previously indicated in some situations it may be desirable to limit the number of write requests that accumulate in this operating mode. To this end the system memory 14 includes a PEND REQ table 110 into which the system manager 23 transfers the number of permissible write requests to the remote system 11 that can remain pending. This indicates the amount by which the two systems can be out of synchronism. Until this limit is reached the local system 10 informs the host system 13 of each of a successful write operation immediately upon transferring the data into the system memory 14. The local system 10 then operates to destage the data into the appropriate one of the local storage devices 15 and 16. The RLD 30 subsequently transfers the data to the system memory 41 in the remote system 14 via the communications link and RLD 33. This data transfer occurs while the local system 10 continues to process subsequent input/output commands through the same channel director and even to the same logical volume or division.
If a burst of writing operations occur and write requests accumulate in the system memory 14 until they reach the maximum, operations revert to the prior normal operating mode as previously indicated. While the write requests remain below the maximum, they remain in the local system memory 14 until the transfer of each to the remote system 11 is complete. The system manager 23 can fine tune the value in the PEND REQ table 110. That table can contain entries for each logical volume or other division in the network. Each channel director, such as the channel director 17, monitors the value of the number of pending requests for a given volume against corresponding entries in the PEND REQ table 110.
The other alternate operating mode is the ADAPTIVE COPY-DISK operating mode depicted in FIG. 2E. In the organization of FIGS. 2A through 2E, step 101 in FIG. 2D diverts to step 117 in FIG. 2E to establish this operating mode. If still some other operation is designated control passes to step 118 that, for example, could include an error procedure indicative of an illegal command. In this operating mode the channel director determines the number of invalid tracks for the remote system 11 in step 120. More specifically, the channel director, such as the channel director 17, looks at the number of bits set in the TRACK STATUS register 26. If that number is greater than an allowable maximum, contained in an INV TRKS table 122 in FIG. 1, step 121 diverts to step 123 where, in a fashion analogous to that shown in FIG. 2D, the system transfers to FIG. 2B or FIG. 2C depending upon the prior normal operating mode. When the number of invalid bits in the TRACK STATUS register 26 is less than the maximum in the INV TRKS table 122, step 121 diverts to step 124 whereupon the channel director begins a sequence to send the CE and DE signals to the host system 13. More specifically steps 124, 125, 126, 127 and 128 operate in a fashion that is analogous to the operations in similar steps shown in FIGS. 2B, 2C and 2D.
As with the PEND REQ table 110, the INV TRKS table 122 can actually constitute a register corresponding to each logical volume in the system to provide control on a logical-volume-by-logical-volume-basis or corresponding to other divisions of the data storage facilities as may be appropriate.
This mode is particularly adapted for situations when large amounts of data must be transferred to a remote system and has little impact on the performance between a host system 13 and the local data storage facility. This mode keeps the data in the remote system 11 as current to the data in the local system 10 as possible. Again in a manner similar to that shown in FIG. 2D, the ADAPTIVE COPY-DISK operating mode enables the local system 10 to acknowledge all write operations as if they were local volumes. In this case, however, the data is not retained in the system memory 14 after it is destaged to the data stores in the local system 10.
As shown in FIG. 5, the RLD 30 uses step 130 to transfer to step 131 if the system is operating in an ADAPTIVE COPY-DISK operating mode. If it is not, control transfers to step 131 that determines whether another appropriate operation is necessary. In step 132 the RLD 30 tests a bit in the TRACK STATUS register 26 and particularly for a track in the M2 column shown in FIG. 3, to determine whether the track in the remote system is valid. If it is invalid and the corresponding track in the local system 10 is valid, step 133 transfers to step 134 whereupon the RLD 30 initiates the copy process 100 to transfer the data in the identified track from the local system 10 to the remote system 11. The RLD 30 then uses step 135 to identify a next track in the TRACK STATUS register 26 and returns to step 132. If a particular bit is valid, step 133 transfers control to step 135 to identify a next track in the TRACK STATUS register 26.
This operating mode continues until the system manager 23 returns operations to the normal operating mode or until the number of invalid tracks, or "skew", exceeds a predetermined number in the INV TRKS table 122 assigned to the logical volume or other division. As previously indicated, exceeding the maximum causes step 121 in FIG. 2E to divert to step 123 to return to the normal operating mode. Thereafter the systems 10 and 11 will destage each subsequent write request according to the SYNC or SEMI-SYNC operating modes. However, the copy program 100 will continue to operate, albeit with less priority with respect to the subsequent destaging operations. If a burst, for example, produces the excessive number of invalid tracks, at the end of the burst copy program 100 will begin to transfer data tracks at a faster rate and eventually reduce the: number of invalidated tracks below the maximum. When that happens, the ADAPTIVE COPY-DISK operating mode is reestablished as shown in FIGS. 2B and 2C.
Therefore in accordance with this invention there have been disclosed two asynchronous procedures by which data can be effectively transferred to a remote data facility operating as a mirror independently of operations between a host processor and a local system. In both approaches write requests are immediately processed for storage at the local system. In one alternative the write requests are transferred to the remote system for destaging independently and asynchronously of subsequent operations in the local system 10. The total number of pending write requests for transfer to the remote system 11 is then handled. Monitoring the total population of such requests against some maximum number enables control over the skew or lack of synchronism that may result. In the alternative, the local system merely destages the write request and indicates that the corresponding track in the remote system no longer contains valid data. A copy program, in an orderly fashion, identifies each track containing valid data in the local system and invalid data in the remote system and copies that track to the remote system.
Each procedure or alternative has certain advantages for particular applications and can be utilized interchangeably. As will also be apparent and as previously indicated, these alternative operating modes can be applied on a volume-by-volume basis. It will also be apparent that many variations and modifications may be made to the invention as disclosed without departing from the true spirit and scope of this invention. For example, a particular embodiment may include only one of the two alternative operating modes. Still other alternative operating modes might be incorporated in a system. The system memory 14 contains PEND REQ table 110 and an INV TRKS table 122. Those two tables could be formed as a single table with one register or position corresponding to each logical volume so that separate skew levels could be established for each such volume. Other modifications might be made to interface the data storage facilities to operate with operating systems of other host processors. Therefore, it is the intent of the appended claims to cover all such variations and modifications as come within the true spirit and scope of this invention.
Claims (18)
1. In a data processing network including a first data storage facility, a geographically remote second data storage facility and intersystem transfer means for effecting transfers between the first and second data storage facilities wherein each of the data storage facilities includes a data store for storing data in a retrievable form, a buffer memory for temporarily storing data and means for transferring data from the buffer memory to the data store and wherein the first data storage facility includes host connection means for connection to a host processor for transferring data to the first data storage facility in response to a writing operation initiated by the host processor, the first and second data storage facilities normally transferring the data to the data storage facilities in both the first and second data storage facilities in accordance with a normal operating mode, the method of transferring data to the second data storage facility in accordance with an alternate operating mode comprising the steps of:
A. enabling the alternate operating mode and thereby disabling the normal operation mode,
B. thereafter responding to each writing operation initiated by the host processor by:
i. transferring the data from the host connection means to the buffer memory in the first data storage facility,
ii. transferring the data from the buffer memory to the data store in the first data storage facility,
iii. transferring an acknowledgment of the transfer into the first data storage facility to the host processor, and
iv. transferring the data from the first data storage facility to the second data storage facility independently of the operations between the first data storage facility and the host processor,
C. monitoring the state of the transfers to the second data storage facility when the second operating mode is enabled, and
D. reverting to the first operating mode when said monitoring indicates a predetermined state exists while allowing previously requested operations during the enablement of the alternate operating mode to complete.
2. A method as recited in claim 1 wherein said monitoring during the alternate operating mode comprises:
A. monitoring the quantity of data in the first data storage facility to be transferred to the second data storage facility, and
B. comparing the monitored quantity to a threshold quantity,
said reverting to the normal operating mode occurring while the monitored quantity exceeds the threshold.
3. A method as recited in claim 1 wherein said step of transferring the data to the second data storage facility includes:
A. transferring the data from the first data storage facility buffer memory to the second data storage facility buffer memory, and
B. transferring the data from the buffer memory in the second data storage facility to the data store therein.
4. A method as recited in claim 3 wherein each of first and second data storage facilities transfers data from its respective buffer memory to its respective data store by a destaging operation, said host connection means, during the alternate operating mode, causing separate write requests to be stored for each of the first and second data stores in the first data storage facility buffer memory, said method comprising the step of transferring the write request and the data to the second data storage facility buffer memory whereby said second data storage facility destages the write request to the data store therein.
5. A method as recited in claim 4 additionally wherein said monitoring comprises the steps of:
i. monitoring the number of write requests in the first data storage facility buffer memory, and
ii. disabling the alternate operating mode when the number of write requests exceeds a predetermined number.
6. A method as recited in claim 3 wherein each data store is defined by storage sections and the first data storage facility includes status means for indicating whether each storage section in the second data storage facility contains valid data, said transfer of data to the second data storage facility including the steps of:
a. setting the status means to an invalid status during each transfer of data to a section in the first data storage facility, and
b. for each section indicated to be invalid, copying the corresponding section from the data store in the first data storage facility to the data store in the second data storage facility.
7. A method as recited in claim 6 wherein the intersystem transfer means includes means for copying data and wherein the copying step includes:
a. monitoring the section status from the intersystem transfer means,
b. selecting a section indicated to be invalid, and
c. enabling the copying means to transfer the data from the first to the second data storage facility.
8. A method as recited in claim 6
wherein said monitoring includes monitoring the number of invalid sections in the first data storage facility buffer memory
and wherein said reverting includes disabling the alternate operating mode when the number of invalid sections exceeds a predetermined number.
9. A method as recited in claim 1 comprising the additional step of reenabling the alternate mode when said monitoring indicates that other than the predetermined state exists.
10. In a data processing network including a first data storage facility, a geographically remote second data storage facility and intersystem transfer means for effecting transfers between the first and second data storage facilities wherein each of the data storage facilities includes a data store for storing data in a retrievable form, a buffer memory for temporarily storing data and means for transferring data from the buffer memory to the data store and wherein the first data storage facility includes host connection means for connection to a host processor for transferring data to the first data storage facility in response to a writing operation initiated by the host processor, the first and second data storage facilities normally transferring the data to the data storage facilities in both the first and second data storage facilities in accordance with a normal operating mode, means for transferring data to the second data storage facility in accordance with an alternate operating mode comprising:
A. means for enabling the alternate operating mode and thereby disabling the normal operation mode,
B. means responsive to said enabling means and to each writing operation initiated by the host processor including:
i. means for transferring the data from the host connection means to the buffer memory in the first data storage facility,
ii. means for transferring the data from the buffer memory to the data store in the first data storage facility,
iii. means for transferring an acknowledgment of the transfer into the first data storage facility to the host processor, and
iv. means for transferring the data from the first data storage facility to the second data storage facility independently of the operations between the first data storage facility and the host processor, and
C. means for monitoring the state of the transfers to the second data storage facility when the second operating mode is enabled,
said enabling means reverting operations to the first operating mode when said monitoring indicates a predetermined state exists while allowing previously requested operations during the enablement of the alternate operating mode to complete.
11. A network as recited in claim 10 wherein said monitoring means operating during the alternate operating mode comprises:
A. means for monitoring the quantity of data in the first data storage facility to be transferred to the second data storage facility, and
B. means for comparing the monitored quantity to a threshold quantity, then reverting of operations to the normal operating mode occurring while the monitored quantity exceeds the threshold.
12. A network as recited in claim 10 wherein said means for transferring data to the second data storage facility includes:
A. first buffer memory transfer means for transferring the data from the first data storage facility buffer memory to the second data storage facility buffer memory, and
B. second buffer memory transfer means for transferring the data from the buffer memory in the second data storage facility to the data store therein.
13. A network as recited in claim 12 wherein each of first and second data storage facilities transfers data from its respective buffer memory to its respective data store by a destaging operation, said host connection means, during the alternate operating mode, causing separate write requests to be stored for each of the first and second data stores in the first data storage facility buffer memory, said first buffer memory transfer means including means for transferring the write request and the data to the second data storage facility buffer memory whereby said second data storage facility destages the write request to the data store therein.
14. A network as recited in claim 13 additionally wherein said monitoring means:
i. means for monitoring the number of write requests in the first data storage facility buffer memory, and
ii. means for disabling the alternate operating mode when the number of write requests exceeds a predetermined number.
15. A network as recited in claim 12 wherein each data store is defined by storage sections and the first data storage facility includes status means for indicating whether each storage section in the second data storage facility contains valid data, said means for transferring data to the second data storage facility including:
a. means for setting the status means to an invalid status during each transfer of data to a section in the first data storage facility, and
b. means for copying, for each section indicated to be invalid, the corresponding section from the data store in the first data storage facility to the data store in the second data storage facility.
16. A network as recited in claim 15 wherein the intersystem transfer means includes means for copying data and wherein the copying means includes:
a. means for monitoring the section status from the intersystem transfer means,
b. means for selecting a section indicated to be invalid, and
c. means for enabling said copying means to transfer the data from the first to the second data storage facility.
17. A network as recited in claim 15 wherein said monitoring means includes means for monitoring the number of invalid sections in the first data storage facility buffer memory, said enabling means terminating the alternate operating mode when the number of invalid sections exceeds a predetermined number thereby to return operations to the normal operating mode.
18. A network as recited in claim 10 comprising means for reenabling the alternate mode when said monitoring means indicates that other than the predetermined state exists.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/657,760 US5933653A (en) | 1996-05-31 | 1996-05-31 | Method and apparatus for mirroring data in a remote data storage system |
US09/267,734 US6477627B1 (en) | 1996-05-31 | 1999-03-15 | Method and apparatus for mirroring data in a remote data storage system |
US10/229,233 US6587935B2 (en) | 1996-05-31 | 2002-08-27 | Method and apparatus for mirroring data in a remote data storage system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/657,760 US5933653A (en) | 1996-05-31 | 1996-05-31 | Method and apparatus for mirroring data in a remote data storage system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/267,734 Continuation-In-Part US6477627B1 (en) | 1996-05-31 | 1999-03-15 | Method and apparatus for mirroring data in a remote data storage system |
Publications (1)
Publication Number | Publication Date |
---|---|
US5933653A true US5933653A (en) | 1999-08-03 |
Family
ID=24638566
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/657,760 Expired - Lifetime US5933653A (en) | 1996-05-31 | 1996-05-31 | Method and apparatus for mirroring data in a remote data storage system |
Country Status (1)
Country | Link |
---|---|
US (1) | US5933653A (en) |
Cited By (109)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6088766A (en) * | 1997-10-06 | 2000-07-11 | Emc Corporation | Method for exchanging data blocks on disk storage devices utilizing disk access statistics and testing for the effect of a change |
US6167531A (en) * | 1998-06-18 | 2000-12-26 | Unisys Corporation | Methods and apparatus for transferring mirrored disk sets during system fail-over |
US6237008B1 (en) * | 1998-07-20 | 2001-05-22 | International Business Machines Corporation | System and method for enabling pair-pair remote copy storage volumes to mirror data in another storage volume |
US6243829B1 (en) * | 1998-05-27 | 2001-06-05 | Hewlett-Packard Company | Memory controller supporting redundant synchronous memories |
US6253209B1 (en) * | 1998-07-07 | 2001-06-26 | International Business Machines Corporation | Method for parallel, remote administration of mirrored and alternate volume groups in a distributed data processing system |
US20010037371A1 (en) * | 1997-04-28 | 2001-11-01 | Ohran Michael R. | Mirroring network data to establish virtual storage area network |
US6317815B1 (en) | 1997-12-30 | 2001-11-13 | Emc Corporation | Method and apparatus for formatting data in a storage device |
US6324654B1 (en) * | 1998-03-30 | 2001-11-27 | Legato Systems, Inc. | Computer network remote data mirroring system |
US20020040369A1 (en) * | 2000-01-25 | 2002-04-04 | Multer David L. | Binary data synchronization engine |
US20020143999A1 (en) * | 2001-03-30 | 2002-10-03 | Kenji Yamagami | Path selection methods for storage based remote copy |
US6496908B1 (en) * | 2001-05-18 | 2002-12-17 | Emc Corporation | Remote mirroring |
US6526419B1 (en) | 2000-06-09 | 2003-02-25 | International Business Machines Corporation | Method, system, and program for remote copy in an open systems environment |
US6543001B2 (en) * | 1998-08-28 | 2003-04-01 | Emc Corporation | Method and apparatus for maintaining data coherency |
US6574704B1 (en) * | 1999-06-23 | 2003-06-03 | Sony Corporation | Information storage management device and method, control device and method |
US20030120699A1 (en) * | 2001-12-24 | 2003-06-26 | Storage Technology Corporation | Variable synchronicity between duplicate transactions |
US20030131281A1 (en) * | 2001-12-22 | 2003-07-10 | Woo-Sug Jung | Apparatus and method for fault-tolerant control using fully distributed common memory |
US20030145168A1 (en) * | 2001-10-16 | 2003-07-31 | Lecrone Douglas E. | Method and apparatus for maintaining data coherency |
US6606690B2 (en) | 2001-02-20 | 2003-08-12 | Hewlett-Packard Development Company, L.P. | System and method for accessing a storage area network as network attached storage |
US6611923B1 (en) * | 1998-03-31 | 2003-08-26 | Madhav Mutalik | System and method for backing up data stored in multiple mirrors on a mass storage subsystem under control of a backup server |
US6615375B1 (en) | 2000-02-03 | 2003-09-02 | International Business Machines Corporation | Method and apparatus for tolerating unrecoverable errors in a multi-processor data processing system |
US20030166588A1 (en) * | 2000-05-04 | 2003-09-04 | Iversen Patrick L. | Splice-region antisense composition and method |
US20030172227A1 (en) * | 2001-11-14 | 2003-09-11 | Emc Corporation | Reversing a communication path between storage devices |
US20030200394A1 (en) * | 2002-04-19 | 2003-10-23 | International Business Machines Corporation | Cache memory arrangement and methods for use in a cache memory system |
US6643795B1 (en) * | 2000-03-30 | 2003-11-04 | Hewlett-Packard Development Company, L.P. | Controller-based bi-directional remote copy system with storage site failover capability |
US6651113B1 (en) * | 1999-12-22 | 2003-11-18 | Intel Corporation | System for writing data on an optical storage medium without interruption using a local write buffer |
US20030233518A1 (en) * | 2002-06-12 | 2003-12-18 | Hitachi, Ltd. | Method and apparatus for managing replication volumes |
US20030236850A1 (en) * | 2002-03-21 | 2003-12-25 | Hitachi, Ltd. | Storage system for content distribution |
US6671823B1 (en) * | 2000-07-14 | 2003-12-30 | Lucent Technologies Inc. | Ultra reliable disk memory for multi-processor platforms |
US6687852B1 (en) * | 2000-07-14 | 2004-02-03 | Lucent Technologies Inc. | Ultra reliable disk memory for duplex processor platforms |
US6701392B1 (en) | 2001-11-14 | 2004-03-02 | Emc Corporation | Hierarchical approach to indentifying changing device characteristics |
US6704886B1 (en) | 2001-01-25 | 2004-03-09 | Emc Corporation | Data backup system having independent data restore execution |
US6711699B1 (en) * | 2000-05-04 | 2004-03-23 | International Business Machines Corporation | Real time backup system for information based on a user's actions and gestures for computer users |
US6718347B1 (en) * | 1999-01-05 | 2004-04-06 | Emc Corporation | Method and apparatus for maintaining coherence among copies of a database shared by multiple computers |
US6721766B1 (en) | 2001-01-25 | 2004-04-13 | Emc Corporation | Restoring multiple work items simultaneously from backup and data restore |
US20040078644A1 (en) * | 2002-10-16 | 2004-04-22 | Hitachi, Ltd. | System and method for bi-directional failure detection of a site in a clustering system |
US6728849B2 (en) | 2001-12-14 | 2004-04-27 | Hitachi, Ltd. | Remote storage system and method |
US6732193B1 (en) | 2000-06-09 | 2004-05-04 | International Business Machines Corporation | Method, system, and program for determining a number of write operations to execute |
US20040098637A1 (en) * | 2002-11-15 | 2004-05-20 | Duncan Kurt A. | Apparatus and method for enhancing data availability by leveraging primary/backup data storage volumes |
US20040153717A1 (en) * | 2002-11-07 | 2004-08-05 | Duncan Kurt A. | Apparatus and method for enhancing data availability by implementing inter-storage-unit communication |
US20040168032A1 (en) * | 2003-02-24 | 2004-08-26 | Lee Whay Sing | Atomic remote memory operations in cache mirroring storage systems |
US20040172509A1 (en) * | 2003-02-27 | 2004-09-02 | Hitachi, Ltd. | Data processing system including storage systems |
US20040181707A1 (en) * | 2003-03-11 | 2004-09-16 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US20040267829A1 (en) * | 2003-06-27 | 2004-12-30 | Hitachi, Ltd. | Storage system |
US6862632B1 (en) | 2001-11-14 | 2005-03-01 | Emc Corporation | Dynamic RDF system for transferring initial data between source and destination volume wherein data maybe restored to either volume at same time other data is written |
US20050055523A1 (en) * | 2003-06-27 | 2005-03-10 | Hitachi, Ltd. | Data processing system |
US6883018B1 (en) | 2001-01-24 | 2005-04-19 | Emc Corporation | Scanning a message-list |
US20050097289A1 (en) * | 2003-11-03 | 2005-05-05 | Burton David A. | Speculative data mirroring apparatus method and system |
US20050216789A1 (en) * | 2004-02-23 | 2005-09-29 | Hewlett-Packard Development Company, L.P. | Command management using task attributes |
US6976186B1 (en) * | 2002-08-27 | 2005-12-13 | At&T Corp. | Asymmetric data mirroring |
US20050278492A1 (en) * | 2004-06-10 | 2005-12-15 | Stakutis Christopher J | Method, system, and program for migrating source data to target data |
US20060031647A1 (en) * | 2004-08-04 | 2006-02-09 | Hitachi, Ltd. | Storage system and data processing system |
US20060101213A1 (en) * | 2004-11-09 | 2006-05-11 | Toshiki Morita | Remote copy system and control method thereof |
US7047377B2 (en) | 2002-08-20 | 2006-05-16 | Gruintine Pueche, Inc. | System and method for conducting an auction-based ranking of search results on a computer network |
US20060117154A1 (en) * | 2003-09-09 | 2006-06-01 | Hitachi, Ltd. | Data processing system |
US7103797B1 (en) | 1998-03-30 | 2006-09-05 | Emc Corporation | Resource allocation throttling in remote data mirroring system |
US7111189B1 (en) * | 2000-03-30 | 2006-09-19 | Hewlett-Packard Development Company, L.P. | Method for transaction log failover merging during asynchronous operations in a data storage network |
US20060224849A1 (en) * | 2005-03-31 | 2006-10-05 | Rezaul Islam Shah M | Storage of data in cache and non-volatile media |
US7137042B2 (en) | 2004-03-17 | 2006-11-14 | Hitachi, Ltd. | Heartbeat apparatus via remote mirroring link on multi-site and method of using same |
US7139885B2 (en) | 2001-12-27 | 2006-11-21 | Hitachi, Ltd. | Method and apparatus for managing storage based replication |
US7152078B2 (en) | 2001-12-27 | 2006-12-19 | Hitachi, Ltd. | Systems, methods and computer program products for backup and restoring storage volumes in a storage area network |
US20070033437A1 (en) * | 2004-01-30 | 2007-02-08 | Hitachi, Ltd. | Data processing system |
US20070053335A1 (en) * | 2005-05-19 | 2007-03-08 | Richard Onyon | Mobile device address book builder |
US7191298B2 (en) | 2002-08-02 | 2007-03-13 | International Business Machines Corporation | Flexible system and method for mirroring data |
US7203732B2 (en) | 1999-11-11 | 2007-04-10 | Miralink Corporation | Flexible remote data mirroring |
US20070101186A1 (en) * | 2005-11-02 | 2007-05-03 | Inventec Corporation | Computer platform cache data remote backup processing method and system |
US7216209B2 (en) | 2003-12-15 | 2007-05-08 | Hitachi, Ltd. | Data processing system having a plurality of storage systems |
US7219201B2 (en) | 2003-09-17 | 2007-05-15 | Hitachi, Ltd. | Remote storage disk control device and method for controlling the same |
US7240197B1 (en) | 2000-07-18 | 2007-07-03 | Hitachi, Ltd. | Method and apparatus for encryption and decryption in remote data storage systems |
US7275100B2 (en) | 2001-01-12 | 2007-09-25 | Hitachi, Ltd. | Failure notification method and system using remote mirroring for clustering systems |
WO2007141684A1 (en) * | 2006-06-08 | 2007-12-13 | Nxp B.V. | Device for remote defragmentation of an embedded device |
US20080134171A1 (en) * | 1999-09-24 | 2008-06-05 | Naoto Matsunami | Computer system and a program install method thereof |
US7398302B2 (en) | 2001-03-30 | 2008-07-08 | Hitachi, Ltd. | Remote copy with path selection and prioritization |
US7404005B1 (en) | 2000-06-09 | 2008-07-22 | International Business Machines Corporation | Method, system, and program for selecting one of multiple paths to communicate with a device |
US20080208617A1 (en) * | 2004-02-27 | 2008-08-28 | Onyon Richard M | Wireless telephone data backup system |
US7499888B1 (en) | 2001-03-16 | 2009-03-03 | Fusionone, Inc. | Transaction authentication system and method |
US7558840B1 (en) | 2001-01-25 | 2009-07-07 | Emc Corporation | Data backup system having a flexible restore architecture |
US7613747B1 (en) * | 2005-06-08 | 2009-11-03 | Sprint Communications Company L.P. | Tiered database storage and replication |
US20090292883A1 (en) * | 2008-05-23 | 2009-11-26 | Nokia Corporation | Apparatus, Method, and Computer Program Product for Memory Validation Operations in a Memory |
US7634509B2 (en) | 2003-11-07 | 2009-12-15 | Fusionone, Inc. | Personal information space management system and method |
US20090313389A1 (en) * | 1999-11-11 | 2009-12-17 | Miralink Corporation | Flexible remote data mirroring |
US20090327805A1 (en) * | 2008-06-26 | 2009-12-31 | Microsoft Corporation | Minimizing data loss in asynchronous replication solution using distributed redundancy |
US7647460B1 (en) * | 1997-09-23 | 2010-01-12 | Emc Corporation | Method and apparatus for implementing a remote mirroring data facility without employing a dedicated leased line to form the link between two remotely disposed storage devices |
US7673107B2 (en) | 2004-10-27 | 2010-03-02 | Hitachi, Ltd. | Storage system and storage control device |
US7680839B1 (en) * | 2004-09-30 | 2010-03-16 | Symantec Operating Corporation | System and method for resynchronizing mirrored volumes |
US7707272B1 (en) * | 2001-01-19 | 2010-04-27 | Datacore Software Corporation | Method and apparatus for asynchronous mirroring using TCP/IP internet protocol |
US20100199038A1 (en) * | 2003-06-27 | 2010-08-05 | Hitachi, Ltd. | Remote copy method and remote copy system |
US7818435B1 (en) | 2000-12-14 | 2010-10-19 | Fusionone, Inc. | Reverse proxy mechanism for retrieving electronic content associated with a local network |
US7895334B1 (en) | 2000-07-19 | 2011-02-22 | Fusionone, Inc. | Remote access communication architecture apparatus and method |
US20110179243A1 (en) * | 2002-08-27 | 2011-07-21 | At&T Intellectual Property Ii, L.P. | Asymmetric Data Mirroring |
US20110185121A1 (en) * | 2010-01-28 | 2011-07-28 | International Business Machines Corporation | Mirroring multiple writeable storage arrays |
US20110188651A1 (en) * | 2010-01-29 | 2011-08-04 | Geoffrey Ignatius Iswandhi | Key rotation for encrypted storage media using a mirrored volume revive operation |
US8073954B1 (en) | 2000-07-19 | 2011-12-06 | Synchronoss Technologies, Inc. | Method and apparatus for a secure remote access system |
US8156074B1 (en) | 2000-01-26 | 2012-04-10 | Synchronoss Technologies, Inc. | Data transfer and synchronization system |
US8181111B1 (en) | 2007-12-31 | 2012-05-15 | Synchronoss Technologies, Inc. | System and method for providing social context to digital activity |
US8255006B1 (en) | 2009-11-10 | 2012-08-28 | Fusionone, Inc. | Event dependent notification system and method |
US8442943B2 (en) | 2000-01-26 | 2013-05-14 | Synchronoss Technologies, Inc. | Data transfer and synchronization between mobile systems using change log |
US8489893B2 (en) | 2010-01-29 | 2013-07-16 | Hewlett-Packard Development Company, L.P. | Encryption key rotation messages written and observed by storage controllers via storage media |
US8611873B2 (en) | 2004-05-12 | 2013-12-17 | Synchronoss Technologies, Inc. | Advanced contact identification system |
US8615566B1 (en) * | 2001-03-23 | 2013-12-24 | Synchronoss Technologies, Inc. | Apparatus and method for operational support of remote network systems |
US8620286B2 (en) | 2004-02-27 | 2013-12-31 | Synchronoss Technologies, Inc. | Method and system for promoting and transferring licensed content and applications |
US8645471B2 (en) | 2003-07-21 | 2014-02-04 | Synchronoss Technologies, Inc. | Device message management system |
US8943428B2 (en) | 2010-11-01 | 2015-01-27 | Synchronoss Technologies, Inc. | System for and method of field mapping |
US8943328B2 (en) | 2010-01-29 | 2015-01-27 | Hewlett-Packard Development Company, L.P. | Key rotation for encrypted storage media |
US9389892B2 (en) | 2010-03-17 | 2016-07-12 | Zerto Ltd. | Multiple points in time disk images for disaster recovery |
US9442748B2 (en) | 2010-03-17 | 2016-09-13 | Zerto, Ltd. | Multi-RPO data protection |
US9489272B2 (en) | 2010-03-17 | 2016-11-08 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US9542076B1 (en) | 2004-05-12 | 2017-01-10 | Synchronoss Technologies, Inc. | System for and method of updating a personal profile |
US9710294B2 (en) | 2010-03-17 | 2017-07-18 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US10459749B2 (en) | 2010-03-17 | 2019-10-29 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4654819A (en) * | 1982-12-09 | 1987-03-31 | Sequoia Systems, Inc. | Memory back-up system |
US4819154A (en) * | 1982-12-09 | 1989-04-04 | Sequoia Systems, Inc. | Memory back up system with one cache memory and two physically separated main memories |
US5206939A (en) * | 1990-09-24 | 1993-04-27 | Emc Corporation | System and method for disk mapping and data retrieval |
US5297265A (en) * | 1987-12-22 | 1994-03-22 | Kendall Square Research Corporation | Shared memory multiprocessor system and method of operation thereof |
US5319766A (en) * | 1992-04-24 | 1994-06-07 | Digital Equipment Corporation | Duplicate tag store for a processor having primary and backup cache memories in a multiprocessor computer system |
US5335222A (en) * | 1990-08-09 | 1994-08-02 | Fujitsu Limited | Traffic control system for asynchronous transfer mode exchange |
US5367698A (en) * | 1991-10-31 | 1994-11-22 | Epoch Systems, Inc. | Network file migration system |
US5432922A (en) * | 1993-08-23 | 1995-07-11 | International Business Machines Corporation | Digital storage system and method having alternating deferred updating of mirrored storage disks |
US5537553A (en) * | 1992-11-13 | 1996-07-16 | Matsushita Electric Industrial Co., Ltd. | Method of and apparatus for bus control and data processor |
US5537533A (en) * | 1994-08-11 | 1996-07-16 | Miralink Corporation | System and method for remote mirroring of digital data from a primary network server to a remote network server |
US5544347A (en) * | 1990-09-24 | 1996-08-06 | Emc Corporation | Data storage system controlled remote data mirroring with respectively maintained data indices |
US5555371A (en) * | 1992-12-17 | 1996-09-10 | International Business Machines Corporation | Data backup copying with delayed directory updating and reduced numbers of DASD accesses at a back up site using a log structured array data storage |
US5564037A (en) * | 1995-03-29 | 1996-10-08 | Cheyenne Software International Sales Corp. | Real time data migration system and method employing sparse files |
US5623599A (en) * | 1994-07-29 | 1997-04-22 | International Business Machines Corporation | Method and apparatus for processing a synchronizing marker for an asynchronous remote data copy |
US5680640A (en) * | 1995-09-01 | 1997-10-21 | Emc Corporation | System for migrating data by selecting a first or second transfer means based on the status of a data element map initialized to a predetermined state |
US5680542A (en) * | 1995-06-07 | 1997-10-21 | Motorola, Inc. | Method and apparatus for synchronizing data in a host memory with data in target MCU memory |
-
1996
- 1996-05-31 US US08/657,760 patent/US5933653A/en not_active Expired - Lifetime
Patent Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4654819A (en) * | 1982-12-09 | 1987-03-31 | Sequoia Systems, Inc. | Memory back-up system |
US4819154A (en) * | 1982-12-09 | 1989-04-04 | Sequoia Systems, Inc. | Memory back up system with one cache memory and two physically separated main memories |
US5297265A (en) * | 1987-12-22 | 1994-03-22 | Kendall Square Research Corporation | Shared memory multiprocessor system and method of operation thereof |
US5335222A (en) * | 1990-08-09 | 1994-08-02 | Fujitsu Limited | Traffic control system for asynchronous transfer mode exchange |
US5206939A (en) * | 1990-09-24 | 1993-04-27 | Emc Corporation | System and method for disk mapping and data retrieval |
US5544347A (en) * | 1990-09-24 | 1996-08-06 | Emc Corporation | Data storage system controlled remote data mirroring with respectively maintained data indices |
US5367698A (en) * | 1991-10-31 | 1994-11-22 | Epoch Systems, Inc. | Network file migration system |
US5319766A (en) * | 1992-04-24 | 1994-06-07 | Digital Equipment Corporation | Duplicate tag store for a processor having primary and backup cache memories in a multiprocessor computer system |
US5537553A (en) * | 1992-11-13 | 1996-07-16 | Matsushita Electric Industrial Co., Ltd. | Method of and apparatus for bus control and data processor |
US5555371A (en) * | 1992-12-17 | 1996-09-10 | International Business Machines Corporation | Data backup copying with delayed directory updating and reduced numbers of DASD accesses at a back up site using a log structured array data storage |
US5432922A (en) * | 1993-08-23 | 1995-07-11 | International Business Machines Corporation | Digital storage system and method having alternating deferred updating of mirrored storage disks |
US5623599A (en) * | 1994-07-29 | 1997-04-22 | International Business Machines Corporation | Method and apparatus for processing a synchronizing marker for an asynchronous remote data copy |
US5537533A (en) * | 1994-08-11 | 1996-07-16 | Miralink Corporation | System and method for remote mirroring of digital data from a primary network server to a remote network server |
US5564037A (en) * | 1995-03-29 | 1996-10-08 | Cheyenne Software International Sales Corp. | Real time data migration system and method employing sparse files |
US5680542A (en) * | 1995-06-07 | 1997-10-21 | Motorola, Inc. | Method and apparatus for synchronizing data in a host memory with data in target MCU memory |
US5680640A (en) * | 1995-09-01 | 1997-10-21 | Emc Corporation | System for migrating data by selecting a first or second transfer means based on the status of a data element map initialized to a predetermined state |
Cited By (225)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7389312B2 (en) * | 1997-04-28 | 2008-06-17 | Emc Corporation | Mirroring network data to establish virtual storage area network |
US20010037371A1 (en) * | 1997-04-28 | 2001-11-01 | Ohran Michael R. | Mirroring network data to establish virtual storage area network |
US7647460B1 (en) * | 1997-09-23 | 2010-01-12 | Emc Corporation | Method and apparatus for implementing a remote mirroring data facility without employing a dedicated leased line to form the link between two remotely disposed storage devices |
US6088766A (en) * | 1997-10-06 | 2000-07-11 | Emc Corporation | Method for exchanging data blocks on disk storage devices utilizing disk access statistics and testing for the effect of a change |
US6317815B1 (en) | 1997-12-30 | 2001-11-13 | Emc Corporation | Method and apparatus for formatting data in a storage device |
US20070028139A1 (en) * | 1998-03-30 | 2007-02-01 | Emc Corporation | Resource allocation throttling in remote data mirroring system |
US6618818B1 (en) | 1998-03-30 | 2003-09-09 | Legato Systems, Inc. | Resource allocation throttling in remote data mirroring system |
US7103797B1 (en) | 1998-03-30 | 2006-09-05 | Emc Corporation | Resource allocation throttling in remote data mirroring system |
US6324654B1 (en) * | 1998-03-30 | 2001-11-27 | Legato Systems, Inc. | Computer network remote data mirroring system |
US7562250B2 (en) * | 1998-03-30 | 2009-07-14 | Emc Corporation | Resource allocation throttling in remote data mirroring system |
US6442706B1 (en) | 1998-03-30 | 2002-08-27 | Legato Systems, Inc. | Resource allocation throttle for remote data mirroring system |
US6611923B1 (en) * | 1998-03-31 | 2003-08-26 | Madhav Mutalik | System and method for backing up data stored in multiple mirrors on a mass storage subsystem under control of a backup server |
US6243829B1 (en) * | 1998-05-27 | 2001-06-05 | Hewlett-Packard Company | Memory controller supporting redundant synchronous memories |
US20010016920A1 (en) * | 1998-05-27 | 2001-08-23 | Jong Chan | Memory controller supporting redundant synchronous memories |
US6978397B2 (en) | 1998-05-27 | 2005-12-20 | Hewlett-Packard Development Company, L.P. | Memory controller supporting redundant synchronous memories |
US6167531A (en) * | 1998-06-18 | 2000-12-26 | Unisys Corporation | Methods and apparatus for transferring mirrored disk sets during system fail-over |
US6253209B1 (en) * | 1998-07-07 | 2001-06-26 | International Business Machines Corporation | Method for parallel, remote administration of mirrored and alternate volume groups in a distributed data processing system |
US6237008B1 (en) * | 1998-07-20 | 2001-05-22 | International Business Machines Corporation | System and method for enabling pair-pair remote copy storage volumes to mirror data in another storage volume |
US6543001B2 (en) * | 1998-08-28 | 2003-04-01 | Emc Corporation | Method and apparatus for maintaining data coherency |
US6718347B1 (en) * | 1999-01-05 | 2004-04-06 | Emc Corporation | Method and apparatus for maintaining coherence among copies of a database shared by multiple computers |
US6574704B1 (en) * | 1999-06-23 | 2003-06-03 | Sony Corporation | Information storage management device and method, control device and method |
US20080134171A1 (en) * | 1999-09-24 | 2008-06-05 | Naoto Matsunami | Computer system and a program install method thereof |
US7203732B2 (en) | 1999-11-11 | 2007-04-10 | Miralink Corporation | Flexible remote data mirroring |
US20090313389A1 (en) * | 1999-11-11 | 2009-12-17 | Miralink Corporation | Flexible remote data mirroring |
US10003647B2 (en) | 1999-11-11 | 2018-06-19 | Intellectual Ventures Ii Llc | Flexible remote data mirroring |
US9270752B2 (en) | 1999-11-11 | 2016-02-23 | Intellectual Ventures Ii Llc | Flexible remote data mirroring |
US7941501B2 (en) | 1999-11-11 | 2011-05-10 | Miralink Corporation | Flexible remote data mirroring |
US8856202B2 (en) | 1999-11-11 | 2014-10-07 | Intellectual Ventures Ii Llc | Flexible remote data mirroring |
US20100049798A1 (en) * | 1999-11-11 | 2010-02-25 | Miralink Corporation | Flexible remote data mirroring |
US8762328B2 (en) | 1999-11-11 | 2014-06-24 | Intellectual Ventures Ii Llc | Flexible remote data mirroring |
US6651113B1 (en) * | 1999-12-22 | 2003-11-18 | Intel Corporation | System for writing data on an optical storage medium without interruption using a local write buffer |
US20020040369A1 (en) * | 2000-01-25 | 2002-04-04 | Multer David L. | Binary data synchronization engine |
US8621025B2 (en) | 2000-01-25 | 2013-12-31 | Synchronoss Technologis, Inc. | Mobile data transfer and synchronization system |
US8315976B2 (en) | 2000-01-26 | 2012-11-20 | Synchronoss Technologies, Inc. | Data transfer and synchronization system |
US8156074B1 (en) | 2000-01-26 | 2012-04-10 | Synchronoss Technologies, Inc. | Data transfer and synchronization system |
US8442943B2 (en) | 2000-01-26 | 2013-05-14 | Synchronoss Technologies, Inc. | Data transfer and synchronization between mobile systems using change log |
US6615375B1 (en) | 2000-02-03 | 2003-09-02 | International Business Machines Corporation | Method and apparatus for tolerating unrecoverable errors in a multi-processor data processing system |
US6643795B1 (en) * | 2000-03-30 | 2003-11-04 | Hewlett-Packard Development Company, L.P. | Controller-based bi-directional remote copy system with storage site failover capability |
US7111189B1 (en) * | 2000-03-30 | 2006-09-19 | Hewlett-Packard Development Company, L.P. | Method for transaction log failover merging during asynchronous operations in a data storage network |
US10275319B2 (en) | 2000-05-04 | 2019-04-30 | International Business Machines Corporation | Real time backup system for computer users |
US7991739B2 (en) | 2000-05-04 | 2011-08-02 | International Business Machines Corporation | Real time backup system for computer users |
US20110191293A1 (en) * | 2000-05-04 | 2011-08-04 | International Business Machines Corporation | Real time backup system for computer users |
US8423510B2 (en) | 2000-05-04 | 2013-04-16 | International Business Machines Corporation | Real time backup system for computer users |
US6711699B1 (en) * | 2000-05-04 | 2004-03-23 | International Business Machines Corporation | Real time backup system for information based on a user's actions and gestures for computer users |
US9292543B2 (en) | 2000-05-04 | 2016-03-22 | International Business Machines Corporation | Real time backup system for computer users |
US20030166588A1 (en) * | 2000-05-04 | 2003-09-04 | Iversen Patrick L. | Splice-region antisense composition and method |
US20080228678A1 (en) * | 2000-05-04 | 2008-09-18 | International Business Machines Corporation | Real time backup system for computer users |
US7499957B2 (en) | 2000-05-04 | 2009-03-03 | International Business Machines Corporation | Real time backup system for computer users |
US20040205390A1 (en) * | 2000-05-04 | 2004-10-14 | International Business Machines Corporation | Real time backup system for computer users |
US8037171B2 (en) | 2000-06-09 | 2011-10-11 | International Business Machines Corporation | System and program for selecting one of multiple paths to communicate with a device |
US6732193B1 (en) | 2000-06-09 | 2004-05-04 | International Business Machines Corporation | Method, system, and program for determining a number of write operations to execute |
US6526419B1 (en) | 2000-06-09 | 2003-02-25 | International Business Machines Corporation | Method, system, and program for remote copy in an open systems environment |
US20080205301A1 (en) * | 2000-06-09 | 2008-08-28 | International Business Machines Corporation | System and program for selecting one of multiple paths to communicate with a device |
US7404005B1 (en) | 2000-06-09 | 2008-07-22 | International Business Machines Corporation | Method, system, and program for selecting one of multiple paths to communicate with a device |
US6687852B1 (en) * | 2000-07-14 | 2004-02-03 | Lucent Technologies Inc. | Ultra reliable disk memory for duplex processor platforms |
US6671823B1 (en) * | 2000-07-14 | 2003-12-30 | Lucent Technologies Inc. | Ultra reliable disk memory for multi-processor platforms |
US7240197B1 (en) | 2000-07-18 | 2007-07-03 | Hitachi, Ltd. | Method and apparatus for encryption and decryption in remote data storage systems |
US7895334B1 (en) | 2000-07-19 | 2011-02-22 | Fusionone, Inc. | Remote access communication architecture apparatus and method |
US8073954B1 (en) | 2000-07-19 | 2011-12-06 | Synchronoss Technologies, Inc. | Method and apparatus for a secure remote access system |
US7818435B1 (en) | 2000-12-14 | 2010-10-19 | Fusionone, Inc. | Reverse proxy mechanism for retrieving electronic content associated with a local network |
US7275100B2 (en) | 2001-01-12 | 2007-09-25 | Hitachi, Ltd. | Failure notification method and system using remote mirroring for clustering systems |
US8195770B1 (en) | 2001-01-19 | 2012-06-05 | DataCore Software Corproration | System, method and computer program product for asynchronous mirroring |
US7707272B1 (en) * | 2001-01-19 | 2010-04-27 | Datacore Software Corporation | Method and apparatus for asynchronous mirroring using TCP/IP internet protocol |
US6883018B1 (en) | 2001-01-24 | 2005-04-19 | Emc Corporation | Scanning a message-list |
US7558840B1 (en) | 2001-01-25 | 2009-07-07 | Emc Corporation | Data backup system having a flexible restore architecture |
US6721766B1 (en) | 2001-01-25 | 2004-04-13 | Emc Corporation | Restoring multiple work items simultaneously from backup and data restore |
US6704886B1 (en) | 2001-01-25 | 2004-03-09 | Emc Corporation | Data backup system having independent data restore execution |
US6606690B2 (en) | 2001-02-20 | 2003-08-12 | Hewlett-Packard Development Company, L.P. | System and method for accessing a storage area network as network attached storage |
US7499888B1 (en) | 2001-03-16 | 2009-03-03 | Fusionone, Inc. | Transaction authentication system and method |
US8615566B1 (en) * | 2001-03-23 | 2013-12-24 | Synchronoss Technologies, Inc. | Apparatus and method for operational support of remote network systems |
US7937448B2 (en) | 2001-03-30 | 2011-05-03 | Hitachi, Ltd. | Remote copy with path selection and prioritization |
US20080263176A1 (en) * | 2001-03-30 | 2008-10-23 | Hitachi, Ltd. | Remote Copy with Path Selection and Prioritization |
US7096269B2 (en) | 2001-03-30 | 2006-08-22 | Hitachi, Ltd. | Path selection methods for storage based remote copy |
US7398302B2 (en) | 2001-03-30 | 2008-07-08 | Hitachi, Ltd. | Remote copy with path selection and prioritization |
US20020143999A1 (en) * | 2001-03-30 | 2002-10-03 | Kenji Yamagami | Path selection methods for storage based remote copy |
US6496908B1 (en) * | 2001-05-18 | 2002-12-17 | Emc Corporation | Remote mirroring |
US6910098B2 (en) | 2001-10-16 | 2005-06-21 | Emc Corporation | Method and apparatus for maintaining data coherency |
US20030145168A1 (en) * | 2001-10-16 | 2003-07-31 | Lecrone Douglas E. | Method and apparatus for maintaining data coherency |
US6976139B2 (en) | 2001-11-14 | 2005-12-13 | Emc Corporation | Reversing a communication path between storage devices |
US6701392B1 (en) | 2001-11-14 | 2004-03-02 | Emc Corporation | Hierarchical approach to indentifying changing device characteristics |
US6862632B1 (en) | 2001-11-14 | 2005-03-01 | Emc Corporation | Dynamic RDF system for transferring initial data between source and destination volume wherein data maybe restored to either volume at same time other data is written |
US20030172227A1 (en) * | 2001-11-14 | 2003-09-11 | Emc Corporation | Reversing a communication path between storage devices |
US6728849B2 (en) | 2001-12-14 | 2004-04-27 | Hitachi, Ltd. | Remote storage system and method |
US7137030B2 (en) * | 2001-12-22 | 2006-11-14 | Electronics And Telecommunications Research Institute | Apparatus and method for fault-tolerant control using fully distributed common memory |
US20030131281A1 (en) * | 2001-12-22 | 2003-07-10 | Woo-Sug Jung | Apparatus and method for fault-tolerant control using fully distributed common memory |
US20030120699A1 (en) * | 2001-12-24 | 2003-06-26 | Storage Technology Corporation | Variable synchronicity between duplicate transactions |
WO2003056426A2 (en) * | 2001-12-24 | 2003-07-10 | Storage Technology Corporation | Variable synchronicity between duplicate transactions |
WO2003056426A3 (en) * | 2001-12-24 | 2004-04-08 | Storage Technology Corp | Variable synchronicity between duplicate transactions |
US7139885B2 (en) | 2001-12-27 | 2006-11-21 | Hitachi, Ltd. | Method and apparatus for managing storage based replication |
US7152078B2 (en) | 2001-12-27 | 2006-12-19 | Hitachi, Ltd. | Systems, methods and computer program products for backup and restoring storage volumes in a storage area network |
US20030236850A1 (en) * | 2002-03-21 | 2003-12-25 | Hitachi, Ltd. | Storage system for content distribution |
US7115919B2 (en) | 2002-03-21 | 2006-10-03 | Hitachi, Ltd. | Storage system for content distribution |
US20030200394A1 (en) * | 2002-04-19 | 2003-10-23 | International Business Machines Corporation | Cache memory arrangement and methods for use in a cache memory system |
US20030233518A1 (en) * | 2002-06-12 | 2003-12-18 | Hitachi, Ltd. | Method and apparatus for managing replication volumes |
US7039777B2 (en) | 2002-06-12 | 2006-05-02 | Hitachi, Ltd. | Method and apparatus for managing replication volumes |
US6925541B2 (en) | 2002-06-12 | 2005-08-02 | Hitachi, Ltd. | Method and apparatus for managing replication volumes |
US20040205310A1 (en) * | 2002-06-12 | 2004-10-14 | Hitachi, Ltd. | Method and apparatus for managing replication volumes |
US7191298B2 (en) | 2002-08-02 | 2007-03-13 | International Business Machines Corporation | Flexible system and method for mirroring data |
US7047377B2 (en) | 2002-08-20 | 2006-05-16 | Gruintine Pueche, Inc. | System and method for conducting an auction-based ranking of search results on a computer network |
US6976186B1 (en) * | 2002-08-27 | 2005-12-13 | At&T Corp. | Asymmetric data mirroring |
US9344502B2 (en) | 2002-08-27 | 2016-05-17 | At&T Intellectual Property Ii, L.P. | Asymmetric data mirroring |
US10887391B2 (en) | 2002-08-27 | 2021-01-05 | At&T Intellectual Property Ii, L.P. | Remote cloud backup of data |
US8443229B2 (en) | 2002-08-27 | 2013-05-14 | At&T Intellectual Property I, L.P. | Asymmetric data mirroring |
US10044805B2 (en) | 2002-08-27 | 2018-08-07 | At&T Intellectual Property Ii, L.P. | Asymmetric data mirroring |
US8819479B2 (en) | 2002-08-27 | 2014-08-26 | At&T Intellectual Property Ii, L.P. | Asymmetric data mirroring |
US20110179243A1 (en) * | 2002-08-27 | 2011-07-21 | At&T Intellectual Property Ii, L.P. | Asymmetric Data Mirroring |
US7076687B2 (en) | 2002-10-16 | 2006-07-11 | Hitachi, Ltd. | System and method for bi-directional failure detection of a site in a clustering system |
US20040078644A1 (en) * | 2002-10-16 | 2004-04-22 | Hitachi, Ltd. | System and method for bi-directional failure detection of a site in a clustering system |
US7039829B2 (en) * | 2002-11-07 | 2006-05-02 | Lsi Logic Corporation | Apparatus and method for enhancing data availability by implementing inter-storage-unit communication |
US20040153717A1 (en) * | 2002-11-07 | 2004-08-05 | Duncan Kurt A. | Apparatus and method for enhancing data availability by implementing inter-storage-unit communication |
US20040098637A1 (en) * | 2002-11-15 | 2004-05-20 | Duncan Kurt A. | Apparatus and method for enhancing data availability by leveraging primary/backup data storage volumes |
US7107483B2 (en) * | 2002-11-15 | 2006-09-12 | Lsi Logic Corporation | Apparatus and method for enhancing data availability by leveraging primary/backup data storage volumes |
US7020743B2 (en) * | 2003-02-24 | 2006-03-28 | Sun Microsystems, Inc. | Atomic remote memory operations in cache mirroring storage systems |
US20040168032A1 (en) * | 2003-02-24 | 2004-08-26 | Lee Whay Sing | Atomic remote memory operations in cache mirroring storage systems |
US20040172509A1 (en) * | 2003-02-27 | 2004-09-02 | Hitachi, Ltd. | Data processing system including storage systems |
US7418565B2 (en) | 2003-02-27 | 2008-08-26 | Hitachi, Ltd. | Remote e copy system and a remote copy method utilizing multiple virtualization apparatuses |
US7076620B2 (en) | 2003-02-27 | 2006-07-11 | Hitachi, Ltd. | Data processing system including storage systems |
US20060174076A1 (en) * | 2003-02-27 | 2006-08-03 | Hitachi, Ltd. | Data processing system including storage systems |
US8103901B2 (en) | 2003-03-11 | 2012-01-24 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US7290167B2 (en) | 2003-03-11 | 2007-10-30 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US20040181707A1 (en) * | 2003-03-11 | 2004-09-16 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US9104741B2 (en) | 2003-03-11 | 2015-08-11 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US20080092053A1 (en) * | 2003-03-11 | 2008-04-17 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US20060041777A1 (en) * | 2003-03-11 | 2006-02-23 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US8412977B2 (en) | 2003-03-11 | 2013-04-02 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US7191358B2 (en) | 2003-03-11 | 2007-03-13 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US20110173487A1 (en) * | 2003-03-11 | 2011-07-14 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US7865768B2 (en) | 2003-03-11 | 2011-01-04 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US20100161560A1 (en) * | 2003-03-11 | 2010-06-24 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US7661019B2 (en) | 2003-03-11 | 2010-02-09 | Hitachi, Ltd. | Method and apparatus for seamless management for disaster recovery |
US9058305B2 (en) | 2003-06-27 | 2015-06-16 | Hitachi, Ltd. | Remote copy method and remote copy system |
US20070168361A1 (en) * | 2003-06-27 | 2007-07-19 | Hitachi, Ltd. | Data replication among storage systems |
US20070168362A1 (en) * | 2003-06-27 | 2007-07-19 | Hitachi, Ltd. | Data replication among storage systems |
US8566284B2 (en) | 2003-06-27 | 2013-10-22 | Hitachi, Ltd. | Data replication among storage systems |
US8943025B2 (en) | 2003-06-27 | 2015-01-27 | Hitachi, Ltd. | Data replication among storage systems |
US20040267829A1 (en) * | 2003-06-27 | 2004-12-30 | Hitachi, Ltd. | Storage system |
US20050055523A1 (en) * | 2003-06-27 | 2005-03-10 | Hitachi, Ltd. | Data processing system |
US8135671B2 (en) | 2003-06-27 | 2012-03-13 | Hitachi, Ltd. | Data replication among storage systems |
US20050073887A1 (en) * | 2003-06-27 | 2005-04-07 | Hitachi, Ltd. | Storage system |
US20100199038A1 (en) * | 2003-06-27 | 2010-08-05 | Hitachi, Ltd. | Remote copy method and remote copy system |
US7130975B2 (en) | 2003-06-27 | 2006-10-31 | Hitachi, Ltd. | Data processing system |
US7725445B2 (en) | 2003-06-27 | 2010-05-25 | Hitachi, Ltd. | Data replication among storage systems |
US8239344B2 (en) | 2003-06-27 | 2012-08-07 | Hitachi, Ltd. | Data replication among storage systems |
US7152079B2 (en) | 2003-06-27 | 2006-12-19 | Hitachi, Ltd. | Data replication among storage systems |
US8234471B2 (en) | 2003-06-27 | 2012-07-31 | Hitachi, Ltd. | Remote copy method and remote copy system |
US9723460B1 (en) | 2003-07-21 | 2017-08-01 | Synchronoss Technologies, Inc. | Device message management system |
US8645471B2 (en) | 2003-07-21 | 2014-02-04 | Synchronoss Technologies, Inc. | Device message management system |
US9615221B1 (en) | 2003-07-21 | 2017-04-04 | Synchronoss Technologies, Inc. | Device message management system |
US20060117154A1 (en) * | 2003-09-09 | 2006-06-01 | Hitachi, Ltd. | Data processing system |
US8495319B2 (en) | 2003-09-09 | 2013-07-23 | Hitachi, Ltd. | Data processing system providing remote copy in a system having first, second and third storage systems and establishing first, second and third copy pairs |
US7143254B2 (en) | 2003-09-09 | 2006-11-28 | Hitachi, Ltd. | Remote copy system |
US8074036B2 (en) | 2003-09-09 | 2011-12-06 | Hitachi, Ltd. | Data processing system having first, second and third storage systems that are arranged to be changeable between a first status and a second status in response to a predetermined condition at the first storage system |
US20070038824A1 (en) * | 2003-09-09 | 2007-02-15 | Kazuhito Suishu | Data processing system |
US20090037436A1 (en) * | 2003-09-09 | 2009-02-05 | Kazuhito Suishu | Data processing system |
US7447855B2 (en) | 2003-09-09 | 2008-11-04 | Hitachi, Ltd. | Data processing method providing remote copy in a system having first, second, and third storage systems |
US7219201B2 (en) | 2003-09-17 | 2007-05-15 | Hitachi, Ltd. | Remote storage disk control device and method for controlling the same |
US20050097289A1 (en) * | 2003-11-03 | 2005-05-05 | Burton David A. | Speculative data mirroring apparatus method and system |
US7254683B2 (en) | 2003-11-03 | 2007-08-07 | International Business Machines Corporation | Speculative data mirroring apparatus method and system |
US7634509B2 (en) | 2003-11-07 | 2009-12-15 | Fusionone, Inc. | Personal information space management system and method |
US7216209B2 (en) | 2003-12-15 | 2007-05-08 | Hitachi, Ltd. | Data processing system having a plurality of storage systems |
US20070033437A1 (en) * | 2004-01-30 | 2007-02-08 | Hitachi, Ltd. | Data processing system |
US7328373B2 (en) | 2004-01-30 | 2008-02-05 | Hitachi, Ltd. | Data processing system |
US20080104135A1 (en) * | 2004-01-30 | 2008-05-01 | Hitachi, Ltd. | Data Processing System |
US7802137B2 (en) | 2004-01-30 | 2010-09-21 | Hitachi, Ltd. | Journaling system switching to another logical volume to store subsequently received update history |
US7363541B2 (en) * | 2004-02-23 | 2008-04-22 | Hewlett-Packard Development Company, L.P. | Command management using task attributes |
US20050216789A1 (en) * | 2004-02-23 | 2005-09-29 | Hewlett-Packard Development Company, L.P. | Command management using task attributes |
US8620286B2 (en) | 2004-02-27 | 2013-12-31 | Synchronoss Technologies, Inc. | Method and system for promoting and transferring licensed content and applications |
US20080208617A1 (en) * | 2004-02-27 | 2008-08-28 | Onyon Richard M | Wireless telephone data backup system |
US7643824B2 (en) | 2004-02-27 | 2010-01-05 | Cooligy Inc | Wireless telephone data backup system |
US7505762B2 (en) | 2004-02-27 | 2009-03-17 | Fusionone, Inc. | Wireless telephone data backup system |
US7308615B2 (en) | 2004-03-17 | 2007-12-11 | Hitachi, Ltd. | Heartbeat apparatus via remote mirroring link on multi-site and method of using same |
US7137042B2 (en) | 2004-03-17 | 2006-11-14 | Hitachi, Ltd. | Heartbeat apparatus via remote mirroring link on multi-site and method of using same |
US20070033447A1 (en) * | 2004-03-17 | 2007-02-08 | Hitachi, Ltd. | Heartbeat apparatus via remote mirroring link on multi-site and method of using same |
US7590895B2 (en) | 2004-03-17 | 2009-09-15 | Hitachi, Ltd. | Heartbeat apparatus via remote mirroring link on multi-site and method of using same |
US20080072105A1 (en) * | 2004-03-17 | 2008-03-20 | Hitachi, Ltd. | Heartbeat apparatus via remote mirroring link on multi-site and method of using same |
US9542076B1 (en) | 2004-05-12 | 2017-01-10 | Synchronoss Technologies, Inc. | System for and method of updating a personal profile |
US8611873B2 (en) | 2004-05-12 | 2013-12-17 | Synchronoss Technologies, Inc. | Advanced contact identification system |
US20050278492A1 (en) * | 2004-06-10 | 2005-12-15 | Stakutis Christopher J | Method, system, and program for migrating source data to target data |
US7613889B2 (en) * | 2004-06-10 | 2009-11-03 | International Business Machines Corporation | System, method, and program for determining if write data overlaps source data within a data migration scheme |
US7313663B2 (en) | 2004-08-04 | 2007-12-25 | Hitachi, Ltd. | Storage system and data processing system |
US20070168630A1 (en) * | 2004-08-04 | 2007-07-19 | Hitachi, Ltd. | Storage system and data processing system |
US20060242373A1 (en) * | 2004-08-04 | 2006-10-26 | Hitachi, Ltd. | Storage system and data processing system |
US7296126B2 (en) | 2004-08-04 | 2007-11-13 | Hitachi, Ltd. | Storage system and data processing system |
US20060031647A1 (en) * | 2004-08-04 | 2006-02-09 | Hitachi, Ltd. | Storage system and data processing system |
US7529901B2 (en) | 2004-08-04 | 2009-05-05 | Hitachi, Ltd. | Storage system and data processing system |
US7159088B2 (en) | 2004-08-04 | 2007-01-02 | Hitachi, Ltd. | Storage system and data processing system |
US7680839B1 (en) * | 2004-09-30 | 2010-03-16 | Symantec Operating Corporation | System and method for resynchronizing mirrored volumes |
US7673107B2 (en) | 2004-10-27 | 2010-03-02 | Hitachi, Ltd. | Storage system and storage control device |
US20060101213A1 (en) * | 2004-11-09 | 2006-05-11 | Toshiki Morita | Remote copy system and control method thereof |
US20060224849A1 (en) * | 2005-03-31 | 2006-10-05 | Rezaul Islam Shah M | Storage of data in cache and non-volatile media |
US7254686B2 (en) | 2005-03-31 | 2007-08-07 | International Business Machines Corporation | Switching between mirrored and non-mirrored volumes |
US20070053335A1 (en) * | 2005-05-19 | 2007-03-08 | Richard Onyon | Mobile device address book builder |
US7613747B1 (en) * | 2005-06-08 | 2009-11-03 | Sprint Communications Company L.P. | Tiered database storage and replication |
US20070101186A1 (en) * | 2005-11-02 | 2007-05-03 | Inventec Corporation | Computer platform cache data remote backup processing method and system |
WO2007141684A1 (en) * | 2006-06-08 | 2007-12-13 | Nxp B.V. | Device for remote defragmentation of an embedded device |
US9229649B2 (en) | 2006-06-08 | 2016-01-05 | Nxp B.V. | Device for remote defragmentation of an embedded device |
US20100262587A1 (en) * | 2006-06-08 | 2010-10-14 | Nxp B.V. | Device for remote defragmentation of an embedded device |
US8181111B1 (en) | 2007-12-31 | 2012-05-15 | Synchronoss Technologies, Inc. | System and method for providing social context to digital activity |
US20090292883A1 (en) * | 2008-05-23 | 2009-11-26 | Nokia Corporation | Apparatus, Method, and Computer Program Product for Memory Validation Operations in a Memory |
US7908514B2 (en) * | 2008-06-26 | 2011-03-15 | Microsoft Corporation | Minimizing data loss in asynchronous replication solution using distributed redundancy |
US20090327805A1 (en) * | 2008-06-26 | 2009-12-31 | Microsoft Corporation | Minimizing data loss in asynchronous replication solution using distributed redundancy |
US8255006B1 (en) | 2009-11-10 | 2012-08-28 | Fusionone, Inc. | Event dependent notification system and method |
US9304696B2 (en) | 2010-01-28 | 2016-04-05 | International Business Machines Corporation | Mirroring multiple writeable storage arrays |
US9766826B2 (en) | 2010-01-28 | 2017-09-19 | International Business Machines Corporation | Mirroring multiple writeable storage arrays |
US8862816B2 (en) | 2010-01-28 | 2014-10-14 | International Business Machines Corporation | Mirroring multiple writeable storage arrays |
US20110185121A1 (en) * | 2010-01-28 | 2011-07-28 | International Business Machines Corporation | Mirroring multiple writeable storage arrays |
US8943328B2 (en) | 2010-01-29 | 2015-01-27 | Hewlett-Packard Development Company, L.P. | Key rotation for encrypted storage media |
US8489893B2 (en) | 2010-01-29 | 2013-07-16 | Hewlett-Packard Development Company, L.P. | Encryption key rotation messages written and observed by storage controllers via storage media |
US20110188651A1 (en) * | 2010-01-29 | 2011-08-04 | Geoffrey Ignatius Iswandhi | Key rotation for encrypted storage media using a mirrored volume revive operation |
US9032218B2 (en) | 2010-01-29 | 2015-05-12 | Hewlett-Packard Development Company, L.P. | Key rotation for encrypted storage media using a mirrored volume revive operation |
US9710294B2 (en) | 2010-03-17 | 2017-07-18 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US10649799B2 (en) | 2010-03-17 | 2020-05-12 | Zerto Ltd. | Hypervisor virtual server system, and method for providing data services within a hypervisor virtual server system |
US9389892B2 (en) | 2010-03-17 | 2016-07-12 | Zerto Ltd. | Multiple points in time disk images for disaster recovery |
US9489272B2 (en) | 2010-03-17 | 2016-11-08 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US10430224B2 (en) | 2010-03-17 | 2019-10-01 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US10459749B2 (en) | 2010-03-17 | 2019-10-29 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US10642637B2 (en) | 2010-03-17 | 2020-05-05 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US11681543B2 (en) | 2010-03-17 | 2023-06-20 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US10649868B2 (en) | 2010-03-17 | 2020-05-12 | Zerto Ltd. | Multiple points in time disk images for disaster recovery |
US10657006B2 (en) | 2010-03-17 | 2020-05-19 | Zerto Ltd. | Multi-RPO data protection |
US9442748B2 (en) | 2010-03-17 | 2016-09-13 | Zerto, Ltd. | Multi-RPO data protection |
US11048545B2 (en) | 2010-03-17 | 2021-06-29 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US11256529B2 (en) | 2010-03-17 | 2022-02-22 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US11650842B2 (en) | 2010-03-17 | 2023-05-16 | Zerto Ltd. | Methods and apparatus for providing hypervisor level data services for server virtualization |
US8943428B2 (en) | 2010-11-01 | 2015-01-27 | Synchronoss Technologies, Inc. | System for and method of field mapping |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5933653A (en) | Method and apparatus for mirroring data in a remote data storage system | |
US6587935B2 (en) | Method and apparatus for mirroring data in a remote data storage system | |
US5857208A (en) | Method and apparatus for performing point in time backup operation in a computer system | |
US6052797A (en) | Remotely mirrored data storage system with a count indicative of data consistency | |
US6092066A (en) | Method and apparatus for independent operation of a remote data facility | |
US6173377B1 (en) | Remote data mirroring | |
US5889935A (en) | Disaster control features for remote data mirroring | |
EP0902923B1 (en) | Method for independent and simultaneous access to a common data set | |
US7293196B2 (en) | Method, apparatus, and system for preserving cache data of redundant storage controllers | |
EP0405926B1 (en) | Method and apparatus for managing a shadow set of storage media | |
JP3655963B2 (en) | Storage controller, data storage system including the same, and dual pair suppression method | |
EP2120147B1 (en) | Data mirroring system using journal data | |
US5870537A (en) | Concurrent switch to shadowed device for storage controller and device errors | |
US5680580A (en) | Remote copy system for setting request interconnect bit in each adapter within storage controller and initiating request connect frame in response to the setting bit | |
US6557079B1 (en) | Remote data facility prefetch | |
US6543001B2 (en) | Method and apparatus for maintaining data coherency | |
EP0747822B1 (en) | External storage system with redundant storage controllers | |
US6910098B2 (en) | Method and apparatus for maintaining data coherency | |
US7167902B1 (en) | Disk subsystems and their integrated system | |
US20030070041A1 (en) | Method and system for caching data in a storage system | |
US5210865A (en) | Transferring data between storage media while maintaining host processor access for I/O operations | |
GB2302428A (en) | Multi-media storage system | |
JP2004355623A (en) | Autonomic power loss recovery for multi-cluster storage subsystem | |
US8942073B1 (en) | Maintaining tape emulation consistency | |
US6687801B1 (en) | Adaptive copy pending off mode |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: EMC CORPORATION, MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OFEK, YUVAL;REEL/FRAME:008076/0392 Effective date: 19960730 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |