WO2003048941A1 - Preserving a snapshot of selected data of a mass storage system - Google Patents

Preserving a snapshot of selected data of a mass storage system Download PDF

Info

Publication number
WO2003048941A1
WO2003048941A1 PCT/US2002/037309 US0237309W WO03048941A1 WO 2003048941 A1 WO2003048941 A1 WO 2003048941A1 US 0237309 W US0237309 W US 0237309W WO 03048941 A1 WO03048941 A1 WO 03048941A1
Authority
WO
WIPO (PCT)
Prior art keywords
data blocks
data
snapshot
mass storage
backup
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2002/037309
Other languages
English (en)
French (fr)
Inventor
Richard S. Ohran
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
EMC Corp
Original Assignee
EMC Corp
Legato Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by EMC Corp, Legato Systems Inc filed Critical EMC Corp
Priority to JP2003550066A priority Critical patent/JP4181044B2/ja
Priority to EP02786751A priority patent/EP1449088A4/en
Priority to AU2002350221A priority patent/AU2002350221A1/en
Priority to KR1020047008199A priority patent/KR100560726B1/ko
Publication of WO2003048941A1 publication Critical patent/WO2003048941A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operations
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/82Solving problems relating to consistency
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84Using snapshots, i.e. a logical point-in-time copy of the data
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99951File or database maintenance
    • Y10S707/99952Coherency, e.g. same view to multiple users
    • Y10S707/99953Recoverability
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99951File or database maintenance
    • Y10S707/99952Coherency, e.g. same view to multiple users
    • Y10S707/99955Archiving or backup

Definitions

  • the present invention relates to the protection of computer data, and more particularly to a system and method for taking a snapshot copy of only certain sectors on one or more mass storage systems.
  • Background and Related Art Computers have become an integral part of most business operations. In some instances, computers have become so vital that when they cease to function, business operations cannot be conducted.
  • Banks, insurance companies, brokerage firms, financial service providers, and a variety of other businesses rely on computer networks to store, manipulate, and display information that is constantly subject to change. The success or failure of a transaction may turn on the availability of information which is both accurate and current.
  • the credibility of the service provider, or its very existence, may depend on the reliability of the information maintained on a computer network. Businesses worldwide recognize the commercial value of their data and are seeking reliable, cost- effective ways to protect the information stored on their computer networks by reliably backing up data.
  • the software layer intercepting all file system commands is an adequate solution when only a few files are tracked.
  • the solution proves unworkable as the number of tracked files increases.
  • the problem is that the software layer essentially performs the work of a file system.
  • each file operation performed by operating system is also performed, in one form or another, by the software layer.
  • the software layer becomes overloaded and degrades performance such that the system is unusable.
  • the software interception layer also overlooks the relationships that may exist between files. As described above, it is not enough that the data stored within a file is consistent. The data stored in one file is likely related to data stored in one or more other files.
  • the prior art's software layer is only able to insure that a file is accessible during a backup process. It makes no provision for insuring a logically consistent set of data across all files comprising a backup operation. Therefore, backups made with a software layer of this type may be less beneficial due to inconsistencies in the stored data. It would, therefore, represent an advancement in the art to have an efficient system for backing up only data that is desired to be backed up while maintaining relationships between files.
  • the backup system and method of the present invention reduces the amount of data needed to make a backup by backing up only those data blocks of the primary mass storage device that changed and have been designated as desirable files for backup.
  • the system and method of the present invention provides for a more efficient use of the storage area since the amount of data for backup is reduced to the absolute minimum through backing up only that which is desirable to back up.
  • the system and method of the present invention emphasizes accuracy of the backup by ensuring that the primary storage device is in a logically consistent state when a backup is made.
  • backup frequency can be increased.
  • the method of the present invention begins with the assumption that the original data and a snapshot copy of that data contain identical data, at least with regard to the data blocks designated for backup. This may be accomplished, for example, by making a complete copy of the original data to the snapshot copy using either traditional backup techniques or traditional disk mirroring techniques.
  • the present invention creates a map or another data structure for listing all data blocks that have been altered, tracks the changes made to the data blocks on the primary mass storage device, identifies the altered data blocks, and designates the data blocks desired for backup from those data blocks that that are not desired for backup.
  • the tracking is done by identifying those storage locations in the original data that have new data written in them from the time that the snapshot copy was in sync with the original data.
  • the identification of those changes that have been made to the original data indicates the changes that need to be made to the snapshot copy in order to bring the backup storage device current with the primary mass storage device.
  • the changes that need to be made to the backup storage device are registered on a listing or table.
  • the system allows for the identification and separation of the listing or table into information that is desirable for backup and information that is undesirable for backup. This separation can be accomplished by either flagging the desirable information or by flagging the undesirable information. Identification and separation of the information in the table reduces the amount of information for backup to only that which is desirable, thus the speed of the backup process is increased and the storage space is more efficiently used by reducing the amount of information to be backed up. Furthermore, the identification and separation prevents undesirable information from being included in the backup.
  • the present invention takes a data block approach to the backing up of a mass storage system, and because only those data block that are designated to be protected are backed up, the present invention minimizes the amount of data that needs to be transferred in making a backup to the absolutely minimum possible. For example, if a large database has five records that change, prior art systems would copy the entire large database. The present invention, however, copies only the five records that have changed. Because the amount of data is minimized, the present invention is particularly well suited to backing up data to a backup system located at a remote site. The present invention can utilize low bandwidth communication links to transfer backup data to a remote backup site. As an example, in many cases conventional dial-up telephone lines with a 56.6k baud modem are entirely adequate.
  • Figure 3 is a system level block diagram of one embodiment of the present invention.
  • FIG 5 illustrates the processing details of one embodiment of the primary backup processing block of Figure 3
  • Figure 6 illustrates the processing details of one embodiment of the backup read processing block of Figure 3;
  • Figures 8A and 8B are diagrams illustrating an example of a method according to one embodiment of the present invention.
  • the present invention extends to both systems and methods for taking a snapshot of only those data sectors that are desirable to be backed up from a mass storage means, rather than taking a snapshot of all the data in that mass storage means. Since a snapshot is taken of only the desirable data, this invention optimizes both time and storage space in providing a back up copy of data located on a mass storage means.
  • Embodiments within the scope of the present invention also include computer- readable media having encoded therein computer-executable instructions or data structures.
  • Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computer.
  • Such computer-readable media can comprise RAM, ROM, EEPROM, CD- ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, magneto-optical storage devices, or any other medium which can be used to store the desired computer-executable instructions and data structures and which can be accessed by a general purpose or special purpose computer. Combinations of the above should also be included within the scope of computer-readable media.
  • Computer-executable instructions comprise, for example, executable instructions and data which cause a general purpose computer or special purpose computer to perform a certain function or a group of functions.
  • data block is used to describe a block of data that is written to or read from a mass storage means.
  • data block is intended to be broadly construed and should include any size or format of data.
  • the data stored in an individual sector on a disk is properly referred to as a data block.
  • the amount of data stored in a group or cluster of sectors may also properly be referred to as a data block.
  • the mass storage means is a RAM or other word or byte addressable storage device, the term data block may be applied to a byte, a word, or multiple word unit of data.
  • the term “desired data block” is used to describe a data block that is designated to be backed up
  • the term “undesired data block” is used to describe a data block that is not designated to be backed up.
  • the system shown generally as 10, comprises a computer system 12 which may be any type of networked or stand alone computer system.
  • computer system 12 may be a network server computer connected to a computer network such as computer network 18.
  • the computer system 12 may also be a stand alone system.
  • Computer system 12 has attached thereto mass storage means for storing a plurality of data blocks in a plurality of storage locations. Each of the storage locations is specified by a unique address or other mechanism.
  • Mass storage means can be any storage mechanism that stores data blocks.
  • such mass storage means may comprise one or more magnetic or magneto-optical disk drives. In Figure 1 , for example, such mass storage means is illustrated by mass storage device 20.
  • the mass storage device 20 includes original data 14 including data blocks that are desirable to be backed up as well as data blocks that are not desirable to be backed up. Examples of data blocks that may not be desired to be backed up are swap files, free sector tables, print buffers, temp files having the ".tmp" extension, and other files not desired to be backed up.
  • the mass storage device 20 may also include a snapshot copy of the data blocks in the original data that are desirable to be backed up as those data blocks existed at a particular point in time. "Snapshot" copy thus refers to the fact that the copy has captured the desirable data blocks as they existed at an instant in time.
  • the snapshot copy 16 is shown as being in a data storage location included within the same mass storage device as the original data, the snapshot copy 16 may instead be located in a data storage location of a different storage device.
  • the computer system 12 writes the snapshot data to the different storage device over a communication medium such as the computer network 18.
  • the snapshot copy 16 is stored on the same mass storage device 20 as the original data 14.
  • Embodiments within the scope of this invention use a snapshot copy of all or part of the mass storage device corresponding to desired data blocks during the backup process.
  • Embodiments within the scope of this invention therefore comprise preservation memory means for temporarily storing data blocks of said mass storage means so as to create a static snapshot of the mass storage means at a particular point in time for the desired data blocks.
  • preservation memory means may comprise any type of writeable storage device such as RAM, EEPROM, magnetic disk storage, and the like.
  • Such preservation memory means may also comprise a portion of mass storage device 20. In Figure 1 , such preservation memory means is illustrated, for example, by snapshot storage device 22.
  • Preservation memory means is discussed in greater detail below.
  • computer system 12 may be any type of general purpose or special purpose computer, computer system 12 may also comprise any other hardware that makes up a general purpose or special purpose computer.
  • computer system 12 may also comprise processor means for executing programmable code means.
  • the processor means may be a microprocessor or other CPU device.
  • the processor means may also comprise various special purpose processors such as digital signal processors and the like.
  • Computer system 12 may also comprise other traditional computer components such as display means for displaying output to a user, input means for inputting data to computer system 12, output means for outputting hard copy printouts, memory means such as RAM, ROM, EEPROM, and the like.
  • FIG 2 an overview of the method used to backup original data such as original data 14 of Figure 1 , to a snapshot copy, such as snapshot copy 16 of Figure 1, is presented.
  • the method illustrated in Figure 2 presumes that, as far as the desired data blocks are concerned, the original data 14 and the snapshot copy 16 are current.
  • "current" means that the snapshot copy contain a current copy of all the desired data blocks of the original data 14.
  • the snapshot copy 16 is assumed to have a current copy of the original data 14 at time TQ.
  • the method summarized in Figure 2 maintains the snapshot copy 16 in a current state with respect to the original data 14.
  • the method summarized in Figure 2 captures successive logically consistent states. This results in the snapshot copy 16 either moving from one logically consistent state to a subsequent logically consistent state or allows the snapshot copy 16 to capture successive logically consistent states. This creates a tremendous advantage over prior art systems which may leave the backup storage device in a logically inconsistent state. By ensuring that the backup device is in a logically consistent state, the present invention ensures that a useable snapshot copy is always available.
  • the changes are preferably tracked by identifying data blocks of the mass storage device that have new data written in them starting at time TQ and which are desired data blocks. As explained in greater detail below, this may be done by keeping a map which identifies those data blocks that have new data written in them starting with time TQ and by keeping a map of desired data blocks
  • the system identifies a logically consistent state of the primary mass storage device and takes a static snapshot of at least the desired data blocks that have been changed since time To- In Figure 2, the logically consistent state is identified as time T ⁇ and a snapshot is taken.
  • a static snapshot is designed to preserve data as it is exists at a particular point in time so that the desired data blocks will be available after the particular point in time in their state as it existed at the snapshot time even though changes are made to the original data after the snapshot time.
  • Many ways exist of creating such a static snapshot Any such method works with the present invention, however, some methods are preferred over others due to various advantages.
  • the details of how a static snapshot is taken and a preferred method for creating a static snapshot is presented below. For this summary, however, it is important to understand that any method which creates a static snapshot can be used with the present invention. It is, however, preferred that the static snapshot be taken without terminating user read or write access to the mass storage device.
  • the data Since the data is preserved by a snapshot at time Tj, the data is available for transfer to the backup storage device even though new data is written to the mass storage device after time Tj .
  • the maps or other mechanisms that were used to track which storage locations had data written therein between time TQ and time T ⁇ and that were used to designate the data blocks that were desired to be backed up are used to identify the data that should be transferred to the backup storage device.
  • only incremental changes to desired data blocks are sent and entire files are not transferred unless the entire file changes.
  • undesired data blocks are not sent even if there are changes to those data blocks.
  • data blocks that are desired for backup are designated during time period 33 using a map or another data structure in the manner described above in reference to time period 29.
  • the same data blocks that have been previously designated to be backed up or, equivalently, not to be backed up can carry over into the new snapshot.
  • the user is not required to repeatedly designate data blocks that are to be backed up.
  • the factors that determine whether the previous designations carry over to new snapshots as described above include the frequency of the snapshots, the preferences of the user, and whether the file structure has changed since the previous snapshot.
  • the present invention only backs up those few data blocks that have been actually changed due to the database modification. Furthermore, as will be explained in further detail below, the present invention allows the data blocks that have been changed to be designated as either desirable or undesirable for backup. Therefore, only the data blocks that have been changed, between a first instant in time and a second instant in time, and are desirable for backup are sent to the snapshot copy 16. Thus, memory, processing cycles and communication bandwidth are not wasted storing backup copies of data blocks that are not desired to be backed up.
  • Embodiments within the scope of this invention therefore comprise means for preserving a static snapshot at a particular instant in time.
  • the use of a static snapshot is preferred because it allows users to continue to access primary mass storage device 20 while the changes are being backed up. Since it takes a period of time to transfer the changes from the original data 14 to the snapshot copy 16, the data that is to be transferred must remain unchanged until it is transferred. If the snapshot copy 16 is not located within the mass storage device 20, one way to ensure that the data remains unchanged is to prevent access to primary mass storage device 20.
  • snapshot processing block 50 the means for preserving a static snapshot is illustrated by snapshot processing block 50. As illustrated in Figure 3, it may make sense to incorporate the snapshot processing mechanism into the mass storage read/write processing block. Although the details of snapshot processing block 50 are presented below, one preferred embodiment preserves a static snapshot by copying a data block of the original data 14 that is to be overwritten from the original data 14 into snapshot storage 22 and then indicating in snapshot map 52 that the block has been preserved in snapshot storage 22. Once a copy has been placed into snapshot storage 22, then the copy of the data block in the original data 14 can be overwritten. As described above in conjunction with Figure 2, if a series of successive backups are to be made, it is necessary to track the changes made to the original data 14, during the time that a backup is being made.
  • the present invention is designed to capture one or more logically consistent backup states at the snapshot copy 16 for desired data blocks.
  • embodiments within the scope of this invention may comprise means for determining when a logically consistent state has been achieved.
  • a logically consistent state is a state where no logical inconsistencies such as improperly terminated files exist on the mass storage system.
  • a logically consistent state may be identified by a number of mechanisms. For example, a logically consistent state may be identified by watching the activity on the mass storage device. When no activity exists on a mass storage device, it may generally be presumed that all internal data buffers have been flushed and their data written to the mass storage system and the mass storage system is not in a state where data blocks are being updated.
  • a preferred method of preserving a static snapshot utilizes a snapshot storage, such as snapshot storage 22 of Figure 3, to preserve data blocks of a mass storage device, such as mass storage device 20 of Figure 3, that are to be overwritten with new data.
  • a snapshot storage such as snapshot storage 22 of Figure 3
  • the data blocks that are to be preserved are first copied into the snapshot storage and a record indicating that the data block has been preserved is updated.
  • Such a record can be stored, for example, in snapshot map 52 of Figure 3. New data may then be written to mass storage device 20 without losing the preserved data blocks.
  • snapshot map 52 of Figure 3 identifies those data blocks that have changed since a static snapshot was preserved at a particular instant in time. Thus, snapshot map 52 can be used as a backup map when a new snapshot is taken.
  • decision block 76 of Figure 4. This decision block tests whether a message received by mass storage read/write processing block 42 is a mass storage read or write request. By the time decision block 78 is reached, the only messages that are possible are either a mass storage read request or mass storage write request. This is because other types of requests are either handled or filtered out before decision block 78 is reached. Decision block 78 distinguishes between a mass storage read request and a mass storage write request. If a request is a mass storage read request, then the next step is to retrieve the requested data block from mass storage device 20 and return the data to the process making the request. This is illustrated in step 80. If, however, the request is a write request, then execution proceeds to decision block 82.
  • Decision block 82 determines whether a snapshot is to be preserved.
  • a snapshot is preserved by copying data blocks that are to be overwritten to a preservation memory such as snapshot storage 22 of Figure 3.
  • the snapshot is in essence preserved incrementally.
  • the snapshot storage is prepared to preserve data blocks as previously described in steps 72 and 74. Thereafter, no data is stored in the snapshot storage until an actual write request occurs that will overwrite data that should be preserved.
  • it is important to determine if a snapshot has been taken or if write requests should occur to the mass storage system without worrying about preserving snapshot data.
  • Decision block 82 tests whether the write request should occur without preserving snapshot data or whether snapshot data should be preserved for write requests. If the write requests should occur without preserving snapshot data, decision block 82 indicates that execution proceeds to step 88 where the data blocks are written to the mass storage device, such as mass storage device 20 of Figure 3. If, however, snapshot data should be preserved, then execution proceeds to decision block 84.
  • a snapshot storage such as snapshot storage 22 of Figure 3.
  • the new data block can be written to the mass storage system.
  • the goal of a snapshot is to preserve the data as it exists on the mass storage system at a particular point in time.
  • the snapshot need only preserve the data as it existed at the time of the snapshot.
  • Decision block 84 tests whether the original data block stored on the mass storage system at the time that the snapshot was taken has previously been preserved in the snapshot storage.
  • Decision block 85 determines whether the data block is marked to be protected. As illustrated in Figure 3 with protection map 53, a user may designate the data blocks as either desirable or undesirable for backup so that only the data blocks that are desirable for back up are actually backed up. Data blocks that are designated as desirable for backup have been and are referred to herein as desired data blocks, whereas data blocks that are not designated as desirable for backup have been and are referred to as undesired data blocks. This feature reduces the amount of time and storage space required for backup. Requests to designate desirable/undesirable data blocks for backup 43 are received by mass storage read/write processing 42.
  • the data blocks on snapshot map 52 indicate the data blocks that are stored in snapshot storage 22 as a result of the most recent static snapshot taken.
  • Mass storage read/write processing 42 indicates on the protection map 53 those data blocks that are desirable for backup.
  • snapshot processing can indicate on protection map 53 those data blocks that are undesirable for backup, preventing their backup by marking them as always being current.
  • snapshot map 52 and protection map 53 can be one map. In other words, the functions performed on protection map 53 can be performed on snapshot map 52. If the data block is not marked to be protected, or in other words are not desirable for backup, then execution proceeds from decision block 85 to step 88 skipping step 86. Alternatively, if the data block is marked to be protected, then execution proceeds to step 86, where the original data blocks are copied into the snapshot storage 22.
  • step 85 can be omitted. Changed data blocks would be preserved independently of whether they were desirable data blocks or not. Then, when sending data blocks to the snapshot copy, backup read processing 56 can filter out any undesirable data blocks using protection map 53 so that only desirable data blocks are sent to the snapshot copy, as step 113 of Figure 6 illustrates.
  • step 86 After the original data has been preserved by step 86, or a determination was made by decision block 84 that the original data had previously been preserved, or a determination was made by decision block 85 that the data block is not marked to be protected, then execution proceeds to step 88 where the write request is fulfilled by writing the data block included with the write request to the designated storage location on the mass storage device.
  • Step 90 identifies the storage location as containing new data. As previously described, this may be accomplished by placing an entry in a snapshot map, such as snapshot map 52 of Figure 3. Step 90 represents but one example of the previously described means for identifying storage locations of a mass storage device that have new data written therein.
  • a response may then be returned to the process making the write request. The sending of such a response is indicated in Figure 4 by step 92.
  • Such responses are typically sent to the process that issues the write request not only to indicate the success or failure of the write operation but also to indicate completion of the write operation. Execution then proceeds back to the start where the next request is handled.
  • step 100 identifies a logically consistent backup state. After a logically consistent state has been identified, then a snapshot of the logically consistent state is preserved so that the backup may proceed.
  • the snapshot is preserved by step 102 which signals the snapshot processing, as for example snapshot processing block 50 incorporated into a mass storage read/write processing block 42 of Figure 3, to take the snapshot. In one embodiment, this results in snapshot request 68 being sent to mass storage read/write processing block 42.
  • this request causes steps 70, 72, and 74 of Figure 4 to be executed, which prepares for the snapshot to be taken. Thereafter, original data for designed data blocks stored in the mass storage device 20 at the time the snapshot was taken is preserved by decision block 84, decision block 85 and step 86 of Figure 4.
  • step 106 sends the assembled data 64 to the snapshot copy 16. This may be accomplished by sending the data to the mass storage read/write processing block 42 for writing into the snapshot copy.
  • the data blocks that are sent to the snapshot copy 16 by step 104 are only those data blocks that have changed since the last backup and are desired to be backed up. Furthermore, the data blocks are transferred as they existed at the moment in time that the snapshot was taken. Thus, only those data blocks that are identified in a backup map, such as backup map 48 of Figure 3, as having changed and identified as protected in a protection map, such as protection map 53 of Figure 3 are transferred.
  • the snapshot preserves those desired data blocks in the state that they were in when the snapshot was taken.
  • Primary backup block 54 therefore needs to retrieve certain data blocks that were preserved by the snapshot.
  • Primary backup processing block 54 may incorporate the functionality needed to retrieve the data blocks from the snapshot and/or mass storage system, or such functionality may be incorporated into a separate processing block. A separate processing block incorporating this functionality is illustrated in Figure 3 by backup read processing block 56.
  • Figure 6 presents one embodiment of backup read processing block 56 designed to recover the data preserved by these snapshots.
  • decision block 112 highlights the fact that backup read processing block 56 only handles read requests that are to retrieve the data as it existed at the moment in time when the snapshot was taken. This decision block may not be necessary if the structure and architecture of the processing guarantees that only such read requests are sent to backup read processing block 56 of Figure 3.
  • decision block 1 13 highlights the fact the backup read processing block 56 only retrieves desired data blocks for eventual transfer to the backup system. The check for whether a data block is a desired data block may be accomplished by referring to protection map 53 of Figure 3.
  • decision block 113 may be omitted.
  • some embodiments of the present invention may preserve only data blocks that have been marked as protected. Where only protected data blocks are placed in snapshot storage, decision block 113 may be eliminated because an indication by decision block 1 14 that a data block has been stored in snapshot storage necessarily means that the data block was marked to be preserved.
  • mass storage write request is processed in the following manner.
  • step 70 the snapshot map is copied to the backup map.
  • step 7A this means that map locations 140 are copied into map locations 142 of backup map 48.
  • map locations 142 indicate that locations 3, 4, and 6 have had new data stored therein.
  • step 72 clears the snapshot map and step 74 clears the snapshot storage as previously described. Execution in Figure 4 then returns to the start to await further processing.
  • Mass storage read/write processing block 42 handles the write of the data blocks to be stored in locations 4 and 6 as previously described with the data blocks 144 stored in those locations after time T] (data block 4b and data block 6a) being stored in snapshot storage 22. New data blocks 4c and 6b then are written to mass storage device 20.
  • the primary system that contains the original data crashes during a write update, it may leave the original data in a logically inconsistent state.
  • the backup copy is tracking every change made to the original data, then when the primary system crashes, the backup copy may also be left in the same logically inconsistent state.
  • This example highlights the problem of leaving a known logically consistent state before a second logically consistent state has been identified.
  • the present invention avoids this problem by maintaining the prior logically consistent state until a new logically consistent state has been identified and then moves the snapshot copy from the previous logically consistent state to the next logically consistent state without transitioning through any logically inconsistent states between the two logically consistent states.
  • Map locations 152 are then updated to indicate that the storage locations that have been changed since time Tj now include storage locations 4 and 6 in addition to storage locations 1 and 3. This is illustrated in Figure 7A by map locations 160 of snapshot storage 52.
  • data blocks that are read are then transmitted to the snapshot copy via mass storage read/write processing block 42 as illustrated in steps 104 and 106 of Figure 5.
  • data blocks 166 are then applied to storage locations 154 in order to arrive at storage locations 168, which are an identical copy of storage locations 158 of the original data ( Figure 7A) except for storage location 3 since it was identified as being undesirable for backup.
  • a snapshot request 68 is sent to mass storage read/write processing block 42.
  • this snapshot request is processed by decision block 66 which results in steps 70, 72, and 74 being executed.
  • step 70 the snapshot map is copied to the backup map.
  • map locations 140 are copied into map locations 142 of backup map 48.
  • map locations 142 indicate that locations 3, 4, and 6 have had new data stored therein.
  • step 72 clears the snapshot map and step 74 clears the snapshot storage as previously described. Execution in Figure 4 then returns to the start and await further processing.
  • Step 88 of Figure 5 then states that the data blocks need to be identified as modified.
  • map locations 152 of snapshot map 52 are modified to indicate that storage location 1 and storage location 3 have new data stored therein.
  • a write request response is then returned as directed by step 92 of Figure 4.
  • Steps 104 and 106 then indicate that the data blocks that were changed before the snapshot was taken should then be assembled and sent to the snapshot copy.
  • the data blocks that should be transferred are indicated by the information contained in backup map 48 and protection map 53.
  • snapshot map is cleared as indicated by map locations 164 of snapshot map 52.
  • Snapshot storage 22 still shows data blocks stored therein. This is to illustrate that the data blocks may still physically reside in snapshot storage 22 as long as the index to snapshot storage 22 is cleared so that snapshot storage 22 appears to contain no data blocks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Retry When Errors Occur (AREA)
PCT/US2002/037309 2001-11-29 2002-11-15 Preserving a snapshot of selected data of a mass storage system Ceased WO2003048941A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2003550066A JP4181044B2 (ja) 2001-11-29 2002-11-15 大容量記憶システムの選択されたデータのスナップショットを保存するためのバックアップ方法
EP02786751A EP1449088A4 (en) 2001-11-29 2002-11-15 OBTAINING A SNAPSHOT OF SELECTED DATA FROM A MASS STORAGE SYSTEM
AU2002350221A AU2002350221A1 (en) 2001-11-29 2002-11-15 Preserving a snapshot of selected data of a mass storage system
KR1020047008199A KR100560726B1 (ko) 2001-11-29 2002-11-15 대용량 기억 시스템의 선택된 데이터의 스냅샷의 보존

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/997,643 2001-11-29
US09/997,643 US7296125B2 (en) 2001-11-29 2001-11-29 Preserving a snapshot of selected data of a mass storage system

Publications (1)

Publication Number Publication Date
WO2003048941A1 true WO2003048941A1 (en) 2003-06-12

Family

ID=25544232

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/037309 Ceased WO2003048941A1 (en) 2001-11-29 2002-11-15 Preserving a snapshot of selected data of a mass storage system

Country Status (7)

Country Link
US (2) US7296125B2 (https=)
EP (1) EP1449088A4 (https=)
JP (1) JP4181044B2 (https=)
KR (1) KR100560726B1 (https=)
CN (1) CN1291320C (https=)
AU (1) AU2002350221A1 (https=)
WO (1) WO2003048941A1 (https=)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007502470A (ja) * 2003-08-14 2007-02-08 コンペレント・テクノロジーズ 仮想ディスク・ドライブのシステムおよび方法
JP2007517340A (ja) * 2003-12-31 2007-06-28 ベリタス オペレーティング コーポレーション 複製環境における協調記憶管理操作
US7363365B2 (en) 2004-07-13 2008-04-22 Teneros Inc. Autonomous service backup and migration
US7363366B2 (en) 2004-07-13 2008-04-22 Teneros Inc. Network traffic routing
CN100405310C (zh) * 2005-07-12 2008-07-23 中国科学院计算技术研究所 一种快照系统及方法
US9146851B2 (en) 2012-03-26 2015-09-29 Compellent Technologies Single-level cell and multi-level cell hybrid solid state drive
US9244625B2 (en) 2006-05-24 2016-01-26 Compellent Technologies System and method for raid management, reallocation, and restriping
US9489150B2 (en) 2003-08-14 2016-11-08 Dell International L.L.C. System and method for transferring data between different raid data storage types for current data and replay data

Families Citing this family (186)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6526418B1 (en) * 1999-12-16 2003-02-25 Livevault Corporation Systems and methods for backing up data files
EP1436873B1 (en) 2001-09-28 2009-04-29 Commvault Systems, Inc. System and method for generating and managing quick recovery volumes
US6826666B2 (en) * 2002-02-07 2004-11-30 Microsoft Corporation Method and system for transporting data content on a storage area network
US7043507B2 (en) * 2002-02-28 2006-05-09 Veritas Operating Corporation System and method for validated indirect data backup using operating system I/O Operations
US6993539B2 (en) 2002-03-19 2006-01-31 Network Appliance, Inc. System and method for determining changes in two snapshots and for transmitting changes to destination snapshot
US7096330B1 (en) * 2002-07-29 2006-08-22 Veritas Operating Corporation Symmetrical data change tracking
CA2508089A1 (en) 2002-10-07 2004-04-22 Commvault Systems, Inc. System and method for managing stored data
US7707184B1 (en) * 2002-10-09 2010-04-27 Netapp, Inc. System and method for snapshot full backup and hard recovery of a database
US7380081B2 (en) * 2003-06-06 2008-05-27 Hewlett-Packard Development Company, L.P. Asynchronous data redundancy technique
US7136974B2 (en) * 2003-06-19 2006-11-14 Pillar Data Systems, Inc. Systems and methods of data migration in snapshot operations
US7165155B1 (en) * 2003-08-29 2007-01-16 Emc Corporation System and method for tracking changes associated with incremental copying
US7702670B1 (en) * 2003-08-29 2010-04-20 Emc Corporation System and method for tracking changes associated with incremental copying
US7225208B2 (en) * 2003-09-30 2007-05-29 Iron Mountain Incorporated Systems and methods for backing up data files
US7529782B2 (en) 2003-11-13 2009-05-05 Commvault Systems, Inc. System and method for performing a snapshot and for restoring data
WO2005050385A2 (en) 2003-11-13 2005-06-02 Commvault Systems, Inc. System and method for performing integrated storage operations
US7636821B2 (en) * 2004-01-15 2009-12-22 International Business Machines Corporation Asynchronous hybrid mirroring system
JP2005235058A (ja) 2004-02-23 2005-09-02 Hitachi Ltd スナップショット取得方法、スナップショット取得装置及びスナップショット取得機能を備えたコンピュータシステム
JP4439960B2 (ja) * 2004-03-22 2010-03-24 株式会社日立製作所 ストレージ装置
US7343449B2 (en) 2004-03-22 2008-03-11 Hitachi, Ltd. Storage subsystem and storage system
US20050223180A1 (en) * 2004-03-31 2005-10-06 Philip Derbeko Accelerating the execution of I/O operations in a storage system
US20060015764A1 (en) * 2004-07-13 2006-01-19 Teneros, Inc. Transparent service provider
US20060015584A1 (en) * 2004-07-13 2006-01-19 Teneros, Inc. Autonomous service appliance
US7380157B2 (en) * 2004-10-27 2008-05-27 Pillar Data Systems, Inc. Staggered writing for data storage systems
US20060106893A1 (en) * 2004-11-02 2006-05-18 Rodger Daniels Incremental backup operations in storage networks
US8959299B2 (en) 2004-11-15 2015-02-17 Commvault Systems, Inc. Using a snapshot as a data source
US20060123211A1 (en) * 2004-12-08 2006-06-08 International Business Machines Corporation Method for optimizing a snapshot operation on a file basis
US7464234B1 (en) * 2005-03-23 2008-12-09 Symantec Corporation Position independent incremental backup
US7159072B2 (en) * 2005-03-24 2007-01-02 Hitachi, Ltd. Method and apparatus for monitoring the quantity of differential data in a storage system
EP1915682A4 (en) * 2005-06-29 2014-10-01 Emc Corp GENERATION OF A SINGLE CLIENT SNAPSHOT USING A CLIENT ASSISTANCE DEVICE
US7506116B2 (en) * 2005-07-19 2009-03-17 International Business Machines Corporation Maintaining and using information on updates to a data group after a logical copy is made of the data group
US20070027938A1 (en) * 2005-07-26 2007-02-01 Scribe Software Inc. Detecting data changes
US7991971B2 (en) * 2005-09-09 2011-08-02 Microsoft Corporation State management for transactional backup consistency
US7325111B1 (en) 2005-11-01 2008-01-29 Network Appliance, Inc. Method and system for single pass volume scanning for multiple destination mirroring
US7617262B2 (en) 2005-12-19 2009-11-10 Commvault Systems, Inc. Systems and methods for monitoring application data in a data replication system
US7606844B2 (en) 2005-12-19 2009-10-20 Commvault Systems, Inc. System and method for performing replication copy storage operations
US7962709B2 (en) 2005-12-19 2011-06-14 Commvault Systems, Inc. Network redirector systems and methods for performing data replication
US7651593B2 (en) 2005-12-19 2010-01-26 Commvault Systems, Inc. Systems and methods for performing data replication
US7636743B2 (en) 2005-12-19 2009-12-22 Commvault Systems, Inc. Pathname translation in a data replication system
US8661216B2 (en) 2005-12-19 2014-02-25 Commvault Systems, Inc. Systems and methods for migrating components in a hierarchical storage network
US7870355B2 (en) 2005-12-19 2011-01-11 Commvault Systems, Inc. Log based data replication system with disk swapping below a predetermined rate
US7509467B2 (en) * 2006-01-13 2009-03-24 Hitachi, Ltd. Storage controller and data management method
JP4800056B2 (ja) * 2006-02-09 2011-10-26 株式会社日立製作所 ストレージシステム及びその制御方法
JP4856955B2 (ja) 2006-01-17 2012-01-18 株式会社日立製作所 Nasシステム及びリモートコピー方法
US7904492B2 (en) * 2006-03-23 2011-03-08 Network Appliance, Inc. Method and apparatus for concurrent read-only access to filesystem
US8726242B2 (en) 2006-07-27 2014-05-13 Commvault Systems, Inc. Systems and methods for continuous data replication
US7594085B1 (en) 2006-09-28 2009-09-22 Emc Corporation Reclaiming data space
US7526623B1 (en) 2006-09-28 2009-04-28 Emc Corporation Optimizing reclamation of data space
US7587431B1 (en) * 2006-09-28 2009-09-08 Emc Corporation Updating snapshots
US7756831B1 (en) 2006-09-28 2010-07-13 Emc Corporation Cooperative locking between multiple independent owners of data space
US7647466B1 (en) 2006-09-28 2010-01-12 Emc Corporation Linear space allocation mechanisms in data space
US9454536B1 (en) 2006-09-28 2016-09-27 Emc Corporation Space compaction and defragmentation mechanisms in data space
US8862639B1 (en) 2006-09-28 2014-10-14 Emc Corporation Locking allocated data space
US8533158B1 (en) 2006-09-28 2013-09-10 Emc Corporation Reclaiming data space by rewriting metadata
US7676510B1 (en) 2006-12-22 2010-03-09 Network Appliance, Inc. Space reservation monitoring in a fractionally reserved data storage system
US7685189B2 (en) * 2006-12-27 2010-03-23 Microsoft Corporation Optimizing backup and recovery utilizing change tracking
US7801867B2 (en) * 2006-12-27 2010-09-21 Microsoft Corporation Optimizing backup and recovery utilizing change tracking
US8290808B2 (en) 2007-03-09 2012-10-16 Commvault Systems, Inc. System and method for automating customer-validated statement of work for a data storage environment
CN100456255C (zh) * 2007-04-29 2009-01-28 华为技术有限公司 一种取快照数据的装置及方法
WO2009031156A2 (en) * 2007-09-09 2009-03-12 Ingrid Networks Ltd Method and apparatus for grid based data protection
US7865475B1 (en) * 2007-09-12 2011-01-04 Netapp, Inc. Mechanism for converting one type of mirror to another type of mirror on a storage system without transferring data
US8489554B2 (en) * 2007-10-05 2013-07-16 Ge Intelligent Platforms, Inc. Methods and systems for operating a sequence of events recorder
US8386733B1 (en) * 2008-02-15 2013-02-26 Symantec Corporation Method and apparatus for performing file-level restoration from a block-based backup file stored on a sequential storage device
US8392675B1 (en) * 2008-04-30 2013-03-05 Netapp, Inc. System and method for reduced-overhead snapshot creation
US8065272B2 (en) * 2008-05-30 2011-11-22 Symantec Corporation Systems and methods for tracking changes to a volume
EP2307975A4 (en) * 2008-07-02 2012-01-18 Hewlett Packard Development Co VERIFYING REMOTE COPIES OF DATA
US8123739B2 (en) * 2008-08-19 2012-02-28 Cook Medical Technologies Llc Drainage catheter and method for catheterizing a patient
US8250033B1 (en) 2008-09-29 2012-08-21 Emc Corporation Replication of a data set using differential snapshots
US8117160B1 (en) 2008-09-30 2012-02-14 Emc Corporation Methods and apparatus for creating point in time copies in a file system using reference counts
US8250035B1 (en) 2008-09-30 2012-08-21 Emc Corporation Methods and apparatus for creating a branch file in a file system
CN102187317B (zh) * 2008-10-30 2013-09-18 国际商业机器公司 闪速拷贝管理
US9495382B2 (en) 2008-12-10 2016-11-15 Commvault Systems, Inc. Systems and methods for performing discrete data replication
US8204859B2 (en) 2008-12-10 2012-06-19 Commvault Systems, Inc. Systems and methods for managing replicated database data
US8296469B2 (en) * 2008-12-31 2012-10-23 Intel Corporation Scalable method and apparatus for link with reconfigurable ports
US8515911B1 (en) 2009-01-06 2013-08-20 Emc Corporation Methods and apparatus for managing multiple point in time copies in a file system
JP5413948B2 (ja) * 2009-01-27 2014-02-12 日本電気株式会社 ストレージシステム
US8918606B1 (en) * 2009-05-01 2014-12-23 Symantec Corporation Techniques for providing incremental backups
US8832684B2 (en) * 2009-06-18 2014-09-09 The Johns Hopkins University Methods for improving atomicity of runtime inspections
US8468292B2 (en) 2009-07-13 2013-06-18 Compellent Technologies Solid state drive data storage system and method
US8645647B2 (en) * 2009-09-02 2014-02-04 International Business Machines Corporation Data storage snapshot with reduced copy-on-write
US8719767B2 (en) 2011-03-31 2014-05-06 Commvault Systems, Inc. Utilizing snapshots to provide builds to developer computing devices
US9092500B2 (en) 2009-09-03 2015-07-28 Commvault Systems, Inc. Utilizing snapshots for access to databases and other applications
US8433682B2 (en) 2009-12-31 2013-04-30 Commvault Systems, Inc. Systems and methods for analyzing snapshots
AU2010339584B2 (en) 2009-12-31 2014-06-26 Commvault Systems, Inc. Systems and methods for performing data management operations using snapshots
US8433867B2 (en) * 2010-01-09 2013-04-30 International Business Machines Corporation Using the change-recording feature for point-in-time-copy technology to perform more effective backups
US8504517B2 (en) 2010-03-29 2013-08-06 Commvault Systems, Inc. Systems and methods for selective data replication
US8352422B2 (en) 2010-03-30 2013-01-08 Commvault Systems, Inc. Data restore systems and methods in a replication environment
US8725698B2 (en) 2010-03-30 2014-05-13 Commvault Systems, Inc. Stub file prioritization in a data replication system
US8504515B2 (en) 2010-03-30 2013-08-06 Commvault Systems, Inc. Stubbing systems and methods in a data replication environment
US20110252208A1 (en) * 2010-04-12 2011-10-13 Microsoft Corporation Express-full backup of a cluster shared virtual machine
US8898508B2 (en) 2010-05-18 2014-11-25 Vmware, Inc. Method and system for enabling checkpointing fault tolerance across remote virtual machines
US8898518B2 (en) 2010-05-18 2014-11-25 Vmware, Inc. Method and system for enabling checkpointing fault tolerance across remote virtual machines
US8898509B2 (en) 2010-05-18 2014-11-25 Vmware, Inc. Policy-based checkpointing fault tolerance across remote virtual machines
US8171338B2 (en) * 2010-05-18 2012-05-01 Vmware, Inc. Method and system for enabling checkpointing fault tolerance across remote virtual machines
US8589347B2 (en) 2010-05-28 2013-11-19 Commvault Systems, Inc. Systems and methods for performing data replication
US9558074B2 (en) * 2010-06-11 2017-01-31 Quantum Corporation Data replica control
KR101651204B1 (ko) 2010-06-15 2016-08-26 삼성전자주식회사 스냅샷 이미지의 동기화 장치 및 방법
US8566640B2 (en) 2010-07-19 2013-10-22 Veeam Software Ag Systems, methods, and computer program products for instant recovery of image level backups
US8595454B1 (en) * 2010-08-31 2013-11-26 Symantec Corporation System and method for caching mapping information for off-host backups
US8756198B2 (en) 2010-09-29 2014-06-17 International Business Machines Corporation Enhancing data store backup times
US8849750B2 (en) * 2010-10-13 2014-09-30 International Business Machines Corporation Synchronization for initialization of a remote mirror storage facility
US8402004B2 (en) 2010-11-16 2013-03-19 Actifio, Inc. System and method for creating deduplicated copies of data by tracking temporal relationships among copies and by ingesting difference data
US8417674B2 (en) 2010-11-16 2013-04-09 Actifio, Inc. System and method for creating deduplicated copies of data by sending difference data between near-neighbor temporal states
US9858155B2 (en) 2010-11-16 2018-01-02 Actifio, Inc. System and method for managing data with service level agreements that may specify non-uniform copying of data
US8843489B2 (en) 2010-11-16 2014-09-23 Actifio, Inc. System and method for managing deduplicated copies of data using temporal relationships among copies
US8904126B2 (en) 2010-11-16 2014-12-02 Actifio, Inc. System and method for performing a plurality of prescribed data management functions in a manner that reduces redundant access operations to primary storage
US8646072B1 (en) * 2011-02-08 2014-02-04 Symantec Corporation Detecting misuse of trusted seals
US8943330B2 (en) 2011-05-10 2015-01-27 Qualcomm Incorporated Apparatus and method for hardware-based secure data processing using buffer memory address range rules
US8688650B2 (en) 2011-08-01 2014-04-01 Actifio, Inc. Data fingerprinting for copy accuracy assurance
US8738624B1 (en) 2011-09-27 2014-05-27 Amazon Technologies, Inc. Increasing distributed database capacity
CA2852607C (en) 2011-10-18 2021-05-04 Institut National De La Recherche Agronomique Use of avermectin derivative for increasing bioavailability and efficacy of macrocylic lactones
US8949664B2 (en) * 2011-11-18 2015-02-03 Nokia Corporation Method and apparatus for providing information consistency in distributed computing environments
CN102622284B (zh) * 2012-02-21 2014-04-16 上海交通大学 面向海量存储系统的数据异步复制方法
US9471578B2 (en) 2012-03-07 2016-10-18 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US9298715B2 (en) 2012-03-07 2016-03-29 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US10417027B1 (en) * 2012-03-30 2019-09-17 EMC IP Holding Company LLC Virtual machine proxy server for hyper-V image backup and recovery
US9342537B2 (en) 2012-04-23 2016-05-17 Commvault Systems, Inc. Integrated snapshot interface for a data storage system
AU2013277351A1 (en) 2012-06-18 2015-01-22 Actifio, Inc. Enhanced data management virtualization system
US20140108588A1 (en) * 2012-10-15 2014-04-17 Dell Products L.P. System and Method for Migration of Digital Assets Leveraging Data Protection
US9235535B1 (en) * 2012-10-31 2016-01-12 Emc Corporation Method and apparatus for reducing overheads of primary storage by transferring modified data in an out-of-order manner
US9471245B1 (en) 2012-10-31 2016-10-18 Emc Corporation Method and apparatus for transferring modified data efficiently
US10176183B1 (en) 2012-10-31 2019-01-08 EMC IP Holding Company LLC Method and apparatus for reducing overheads of primary storage while transferring modified data
KR101451807B1 (ko) * 2012-12-24 2014-10-22 주식회사 케이티 NoSQL 메타 데이터의 백업 및 복원장치 및 방법
US9075762B2 (en) * 2013-01-04 2015-07-07 International Business Machines Corporation Setting copy permissions for target data in a copy relationship
US9336226B2 (en) 2013-01-11 2016-05-10 Commvault Systems, Inc. Criteria-based data synchronization management
US9886346B2 (en) 2013-01-11 2018-02-06 Commvault Systems, Inc. Single snapshot for multiple agents
US9646067B2 (en) 2013-05-14 2017-05-09 Actifio, Inc. Garbage collection predictions
US9690837B1 (en) * 2013-06-28 2017-06-27 EMC IP Holding Company LLC Techniques for preserving redundant copies of metadata in a data storage system employing de-duplication
US9053216B1 (en) 2013-08-09 2015-06-09 Datto, Inc. CPU register assisted virtual machine screenshot capture timing apparatuses, methods and systems
US9690671B2 (en) 2013-11-01 2017-06-27 Cloudera, Inc. Manifest-based snapshots in distributed computing environments
WO2015066698A1 (en) * 2013-11-04 2015-05-07 Falconstor, Inc. Snapshots using copy on predicted write
US9904603B2 (en) 2013-11-18 2018-02-27 Actifio, Inc. Successive data fingerprinting for copy accuracy assurance
US9665306B1 (en) * 2013-12-18 2017-05-30 EMC IP Holding Company LLC Method and system for enhancing data transfer at a storage system
US9632874B2 (en) 2014-01-24 2017-04-25 Commvault Systems, Inc. Database application backup in single snapshot for multiple applications
US9639426B2 (en) 2014-01-24 2017-05-02 Commvault Systems, Inc. Single snapshot for multiple applications
US9753812B2 (en) 2014-01-24 2017-09-05 Commvault Systems, Inc. Generating mapping information for single snapshot for multiple applications
US9495251B2 (en) 2014-01-24 2016-11-15 Commvault Systems, Inc. Snapshot readiness checking and reporting
US9720778B2 (en) 2014-02-14 2017-08-01 Actifio, Inc. Local area network free data movement
US9348827B1 (en) * 2014-03-27 2016-05-24 Emc Corporation File-based snapshots for block-based backups
US9411821B1 (en) * 2014-03-27 2016-08-09 Emc Corporation Block-based backups for sub-file modifications
US9792187B2 (en) 2014-05-06 2017-10-17 Actifio, Inc. Facilitating test failover using a thin provisioned virtual machine created from a snapshot
US9594636B2 (en) 2014-05-30 2017-03-14 Datto, Inc. Management of data replication and storage apparatuses, methods and systems
US9772916B2 (en) 2014-06-17 2017-09-26 Actifio, Inc. Resiliency director
US9542108B2 (en) * 2014-06-30 2017-01-10 Scale Computing, Inc. Efficient migration of virtual storage devices to a remote node using snapshots
US9774672B2 (en) 2014-09-03 2017-09-26 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US10042716B2 (en) 2014-09-03 2018-08-07 Commvault Systems, Inc. Consolidated processing of storage-array commands using a forwarder media agent in conjunction with a snapshot-control media agent
US10089185B2 (en) 2014-09-16 2018-10-02 Actifio, Inc. Multi-threaded smart copy
US10379963B2 (en) 2014-09-16 2019-08-13 Actifio, Inc. Methods and apparatus for managing a large-scale environment of copy data management appliances
US9448731B2 (en) 2014-11-14 2016-09-20 Commvault Systems, Inc. Unified snapshot storage management
US9648105B2 (en) 2014-11-14 2017-05-09 Commvault Systems, Inc. Unified snapshot storage management, using an enhanced storage manager and enhanced media agents
US9880904B2 (en) * 2014-12-12 2018-01-30 Ca, Inc. Supporting multiple backup applications using a single change tracker
US9870289B2 (en) * 2014-12-12 2018-01-16 Ca, Inc. Notifying a backup application of a backup key change
US10445187B2 (en) 2014-12-12 2019-10-15 Actifio, Inc. Searching and indexing of backup data sets
WO2016115135A1 (en) 2015-01-12 2016-07-21 Xiangdong Zhang Disk group based backup
US10311150B2 (en) 2015-04-10 2019-06-04 Commvault Systems, Inc. Using a Unix-based file system to manage and serve clones to windows-based computing clients
US10282201B2 (en) 2015-04-30 2019-05-07 Actifo, Inc. Data provisioning techniques
US10691659B2 (en) 2015-07-01 2020-06-23 Actifio, Inc. Integrating copy data tokens with source code repositories
US10613938B2 (en) 2015-07-01 2020-04-07 Actifio, Inc. Data virtualization using copy data tokens
US10394661B2 (en) * 2015-09-22 2019-08-27 International Business Machines Corporation Policy driven data updates
US11106645B1 (en) * 2015-09-29 2021-08-31 EMC IP Holding Company LLC Multi point in time object store
CN105426269B (zh) * 2015-11-30 2018-10-12 上海爱数信息技术股份有限公司 一种提升Oracle备份性能的装置及方法
US10503753B2 (en) 2016-03-10 2019-12-10 Commvault Systems, Inc. Snapshot replication operations based on incremental block change tracking
US10956270B2 (en) * 2016-03-30 2021-03-23 Acronis International Gmbh System and method for data protection during full data backup
US10445298B2 (en) 2016-05-18 2019-10-15 Actifio, Inc. Vault to object store
US10476955B2 (en) 2016-06-02 2019-11-12 Actifio, Inc. Streaming and sequential data replication
US10152386B1 (en) * 2016-07-29 2018-12-11 Nutanix, Inc. Efficient disaster rollback across heterogeneous storage systems
CN106484321A (zh) * 2016-09-08 2017-03-08 华为数字技术(成都)有限公司 一种数据存储方法及数据中心
CN107577560B (zh) * 2016-09-23 2021-04-02 珠海艾派克微电子有限公司 存储介质、数据处理方法及采用该方法的盒芯片
US10783046B2 (en) 2016-11-22 2020-09-22 Nutanix, Inc. Executing resource management operations in distributed computing systems
US10528015B2 (en) 2016-12-15 2020-01-07 Trane International Inc. Building automation system controller with real time software configuration and database backup
US10191687B1 (en) * 2016-12-15 2019-01-29 EMC IP Holding Company LLC Adaptive snap-based replication in a storage system
US10241869B2 (en) * 2017-03-08 2019-03-26 International Business Machines Corporation Managing a deletion of a volume referenced by a snapshot of a consistency group
US10855554B2 (en) 2017-04-28 2020-12-01 Actifio, Inc. Systems and methods for determining service level agreement compliance
CN107332904A (zh) * 2017-06-29 2017-11-07 郑州云海信息技术有限公司 一种跨存储系统的数据迁移方法、装置及系统
US11403178B2 (en) 2017-09-29 2022-08-02 Google Llc Incremental vault to object store
US10732885B2 (en) 2018-02-14 2020-08-04 Commvault Systems, Inc. Block-level live browsing and private writable snapshots using an ISCSI server
US10452453B1 (en) * 2018-02-22 2019-10-22 Amazon Technologies, Inc. Snapshot lineage preservation for representation-based partitions
US10740156B1 (en) 2018-02-22 2020-08-11 Amazon Technologies, Inc. Reversible representation-based partitioning of distributed computing environments
US11176001B2 (en) 2018-06-08 2021-11-16 Google Llc Automated backup and restore of a disk group
US11042318B2 (en) 2019-07-29 2021-06-22 Commvault Systems, Inc. Block-level data replication
US11151090B2 (en) 2019-10-17 2021-10-19 EMC IP Holding Company LLC Snapshot management based on data churn delta
US11755416B2 (en) * 2020-01-14 2023-09-12 Druva Inc. Storage tiering for backup data
CN113986115B (zh) * 2020-07-27 2024-05-31 伊姆西Ip控股有限责任公司 用于复制数据的方法、电子设备和计算机程序产品
US12321769B1 (en) * 2021-09-14 2025-06-03 Amazon Technologies, Inc. Incremental snapshots of state information in an on-demand network code execution system
US11809285B2 (en) 2022-02-09 2023-11-07 Commvault Systems, Inc. Protecting a management database of a data storage management system to meet a recovery point objective (RPO)
US12056018B2 (en) 2022-06-17 2024-08-06 Commvault Systems, Inc. Systems and methods for enforcing a recovery point objective (RPO) for a production database without generating secondary copies of the production database
US12147315B2 (en) * 2022-11-29 2024-11-19 Juniper Networks, Inc. Using delta snapshots to facilitate intent policy model rollback and deployment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5790773A (en) * 1995-12-29 1998-08-04 Symbios, Inc. Method and apparatus for generating snapshot copies for data backup in a raid subsystem
US6081875A (en) * 1997-05-19 2000-06-27 Emc Corporation Apparatus and method for backup of a disk storage system
US6101585A (en) * 1997-11-04 2000-08-08 Adaptec, Inc. Mechanism for incremental backup of on-line files
US6131148A (en) * 1998-01-26 2000-10-10 International Business Machines Corporation Snapshot copy of a secondary volume of a PPRC pair
US6332177B1 (en) * 1998-10-19 2001-12-18 Lsi Logic Corporation N-way raid 1 on M drives block mapping

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4467421A (en) 1979-10-18 1984-08-21 Storage Technology Corporation Virtual storage system and method
US5038278A (en) 1988-04-01 1991-08-06 Digital Equipment Corporation Cache with at least two fill rates
US5089958A (en) 1989-01-23 1992-02-18 Vortex Systems, Inc. Fault tolerant computer backup system
GB8915875D0 (en) 1989-07-11 1989-08-31 Intelligence Quotient United K A method of operating a data processing system
US5163148A (en) 1989-08-11 1992-11-10 Digital Equipment Corporation File backup system for producing a backup copy of a file which may be updated during backup
US5157663A (en) 1990-09-24 1992-10-20 Novell, Inc. Fault tolerant computer system
US5426747A (en) 1991-03-22 1995-06-20 Object Design, Inc. Method and apparatus for virtual memory mapping and transaction management in an object-oriented database system
US5408642A (en) 1991-05-24 1995-04-18 Symantec Corporation Method for recovery of a computer program infected by a computer virus
US5414850A (en) 1991-08-23 1995-05-09 Stac Electronics, Inc. System for transparently compressing data files in a computer system
US5410667A (en) 1992-04-17 1995-04-25 Storage Technology Corporation Data record copy system for a disk drive array data storage subsystem
US5263154A (en) 1992-04-20 1993-11-16 International Business Machines Corporation Method and system for incremental time zero backup copying of data
US5379398A (en) 1992-04-20 1995-01-03 International Business Machines Corporation Method and system for concurrent access during backup copying of data
US5241669A (en) 1992-04-20 1993-08-31 International Business Machines Corporation Method and system for sidefile status polling in a time zero backup copy process
US5241670A (en) 1992-04-20 1993-08-31 International Business Machines Corporation Method and system for automated backup copy ordering in a time zero backup copy session
US5241668A (en) 1992-04-20 1993-08-31 International Business Machines Corporation Method and system for automated termination and resumption in a time zero backup copy process
US5379412A (en) 1992-04-20 1995-01-03 International Business Machines Corporation Method and system for dynamic allocation of buffer storage space during backup copying
US5448718A (en) 1992-04-20 1995-09-05 International Business Machines Corporation Method and system for time zero backup session security
JPH0827754B2 (ja) 1992-05-21 1996-03-21 インターナショナル・ビジネス・マシーンズ・コーポレイション コンピュータシステムにおけるファイル管理方法及びファイル管理システム
US5403639A (en) 1992-09-02 1995-04-04 Storage Technology Corporation File server having snapshot application data groups
US5375232A (en) 1992-09-23 1994-12-20 International Business Machines Corporation Method and system for asynchronous pre-staging of backup copies in a data processing storage subsystem
WO1995001599A1 (en) 1993-07-01 1995-01-12 Legent Corporation System and method for distributed storage management on networked computer systems
ES2130447T3 (es) 1993-07-19 1999-07-01 Cheyenne Advanced Tech Ltd Sistemas de copias de seguridad de archivos de ordenador.
US5515502A (en) 1993-09-30 1996-05-07 Sybase, Inc. Data backup system with methods for stripe affinity backup to multiple archive devices
US5435004A (en) 1994-07-21 1995-07-18 International Business Machines Corporation Computerized system and method for data backup
US5649152A (en) 1994-10-13 1997-07-15 Vinca Corporation Method and system for providing a static snapshot of data stored on a mass storage system
US5835953A (en) 1994-10-13 1998-11-10 Vinca Corporation Backup system that takes a snapshot of the locations in a mass storage device that has been identified for updating prior to updating
US5588934A (en) * 1995-04-11 1996-12-31 Grand Haven Stamped Products Shifter with means for actuating cable to key mechanism
US5819020A (en) 1995-10-16 1998-10-06 Network Specialists, Inc. Real time backup system
US5719889A (en) 1995-12-20 1998-02-17 International Business Machines Corporation Programmable parity checking and comparison circuit
US6397229B1 (en) * 1998-02-02 2002-05-28 International Business Machines Corporation Storage-controller-managed outboard incremental backup/restore of data
US6205527B1 (en) * 1998-02-24 2001-03-20 Adaptec, Inc. Intelligent backup and restoring system and method for implementing the same
US6269381B1 (en) * 1998-06-30 2001-07-31 Emc Corporation Method and apparatus for backing up data before updating the data and for restoring from the backups
DE69938378T2 (de) * 1998-08-20 2009-04-30 Hitachi, Ltd. Kopieren von Daten in Speichersystemen
US6665779B1 (en) * 1998-12-24 2003-12-16 Roxio, Inc. Image backup method for backing up disk partitions of a storage device
US6434681B1 (en) * 1999-12-02 2002-08-13 Emc Corporation Snapshot copy facility for a data storage system permitting continued host read/write access
US6625623B1 (en) * 1999-12-16 2003-09-23 Livevault Corporation Systems and methods for backing up data files
US6651075B1 (en) * 2000-02-16 2003-11-18 Microsoft Corporation Support for multiple temporal snapshots of same volume
US6618794B1 (en) * 2000-10-31 2003-09-09 Hewlett-Packard Development Company, L.P. System for generating a point-in-time copy of data in a data storage system
US6678809B1 (en) * 2001-04-13 2004-01-13 Lsi Logic Corporation Write-ahead log in directory management for concurrent I/O access for block storage

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5790773A (en) * 1995-12-29 1998-08-04 Symbios, Inc. Method and apparatus for generating snapshot copies for data backup in a raid subsystem
US6081875A (en) * 1997-05-19 2000-06-27 Emc Corporation Apparatus and method for backup of a disk storage system
US6101585A (en) * 1997-11-04 2000-08-08 Adaptec, Inc. Mechanism for incremental backup of on-line files
US6131148A (en) * 1998-01-26 2000-10-10 International Business Machines Corporation Snapshot copy of a secondary volume of a PPRC pair
US6332177B1 (en) * 1998-10-19 2001-12-18 Lsi Logic Corporation N-way raid 1 on M drives block mapping

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1449088A4 *

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9047216B2 (en) 2003-08-14 2015-06-02 Compellent Technologies Virtual disk drive system and method
US10067712B2 (en) 2003-08-14 2018-09-04 Dell International L.L.C. Virtual disk drive system and method
JP2007502470A (ja) * 2003-08-14 2007-02-08 コンペレント・テクノロジーズ 仮想ディスク・ドライブのシステムおよび方法
US9489150B2 (en) 2003-08-14 2016-11-08 Dell International L.L.C. System and method for transferring data between different raid data storage types for current data and replay data
US9436390B2 (en) 2003-08-14 2016-09-06 Dell International L.L.C. Virtual disk drive system and method
US9021295B2 (en) 2003-08-14 2015-04-28 Compellent Technologies Virtual disk drive system and method
JP2007517340A (ja) * 2003-12-31 2007-06-28 ベリタス オペレーティング コーポレーション 複製環境における協調記憶管理操作
US7363366B2 (en) 2004-07-13 2008-04-22 Teneros Inc. Network traffic routing
US8504676B2 (en) 2004-07-13 2013-08-06 Ongoing Operations LLC Network traffic routing
US9448898B2 (en) 2004-07-13 2016-09-20 Ongoing Operations LLC Network traffic routing
US7363365B2 (en) 2004-07-13 2008-04-22 Teneros Inc. Autonomous service backup and migration
CN100405310C (zh) * 2005-07-12 2008-07-23 中国科学院计算技术研究所 一种快照系统及方法
US9244625B2 (en) 2006-05-24 2016-01-26 Compellent Technologies System and method for raid management, reallocation, and restriping
US10296237B2 (en) 2006-05-24 2019-05-21 Dell International L.L.C. System and method for raid management, reallocation, and restripping
US9146851B2 (en) 2012-03-26 2015-09-29 Compellent Technologies Single-level cell and multi-level cell hybrid solid state drive

Also Published As

Publication number Publication date
EP1449088A1 (en) 2004-08-25
CN1596400A (zh) 2005-03-16
JP2005512191A (ja) 2005-04-28
US7296125B2 (en) 2007-11-13
KR100560726B1 (ko) 2006-03-14
KR20040071693A (ko) 2004-08-12
AU2002350221A1 (en) 2003-06-17
JP4181044B2 (ja) 2008-11-12
US20070079089A1 (en) 2007-04-05
US7398366B2 (en) 2008-07-08
CN1291320C (zh) 2006-12-20
US20030101321A1 (en) 2003-05-29
EP1449088A4 (en) 2007-12-26

Similar Documents

Publication Publication Date Title
US7398366B2 (en) Tracking incremental changes in a mass storage system
EP1012716B1 (en) System and method for maintaining a logically consistent backup using minimal data transfer
KR100643179B1 (ko) 주 시스템 및 백업 시스템 간의 데이터 복원 시스템 및 그 방법
US7660953B2 (en) Method and system for mirroring and archiving mass storage
US7167880B2 (en) Method and apparatus for avoiding journal overflow on backup and recovery system using storage based journaling
EP1099165B1 (en) File system image transfer
US6871271B2 (en) Incrementally restoring a mass storage device to a prior state
US8103840B2 (en) Snapshot mechanism and method thereof
JP3043662B2 (ja) データバックアップ方式
GB2378536A (en) A method of logging message activity
AU2002246856A1 (en) Restoring a mass storage device to a prior state in response to processing information

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SC SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003550066

Country of ref document: JP

Ref document number: 20028237064

Country of ref document: CN

Ref document number: 1020047008199

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2002786751

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2002786751

Country of ref document: EP