CA2384020A1 - Apparatus and method for fast backup and restore or large file systems - Google Patents
Apparatus and method for fast backup and restore or large file systems Download PDFInfo
- Publication number
- CA2384020A1 CA2384020A1 CA 2384020 CA2384020A CA2384020A1 CA 2384020 A1 CA2384020 A1 CA 2384020A1 CA 2384020 CA2384020 CA 2384020 CA 2384020 A CA2384020 A CA 2384020A CA 2384020 A1 CA2384020 A1 CA 2384020A1
- Authority
- CA
- Canada
- Prior art keywords
- backup
- restore
- file system
- file systems
- large file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1456—Hardware arrangements for backup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Description
Apparatus and Method for Fast Backup and Restore of Large File Systems CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This is the first application filed for the present invention.
MICROFICHE APPENDIX
[0001] This is the first application filed for the present invention.
MICROFICHE APPENDIX
[0002] Not applicable.
FIELD OF INVENTION
FIELD OF INVENTION
[0003] This invention relates in general to the back up and restoration of large computer file systems BACKGROUND OF THE INVENTION
[0004] To be completed SUMMARY OF THE INVENTION
[0005] To be completed BRIEF DESCRIPTION OF THE DRAWINGS
[0006] To be completed DETAILED DESCRIPTION OF THE PREFERED EMBODIMENT
[0007] The proposed solution addresses shortcomings of using relatively slow tape-based backup devices to create backup copies of large to medium size RAID (Redundant Array of Inexpensive Disk) and non-RAID file system. The proposed method and apparatus uses an inexpensive PC-based file server (a backup server) to take a snap-ahot of the large RAID and non-RAID file system.
This snap-shot file system image is then backed-up to a slower backup media, such as tape-based media. The snap-shot of the file system could be in a form of a full or incremental backup, or other campressed or uncompressed archive file.
This snap-shot file system image is then backed-up to a slower backup media, such as tape-based media. The snap-shot of the file system could be in a form of a full or incremental backup, or other campressed or uncompressed archive file.
[0008] Using the backup server speeds up the initial stage of the backup process of creating the snap-shot image, as the transfer rate at this stage of the backup is only limited by (network or other) connection between the RAID or non-RAID file system and the backup system. A dedicated 1000Base-T link between _2_ the file system and the backup system is preferable. An inexpensive crossed CATS cable may be used to avoid use of a high-speed network hub/switch.
[0009] The snap-shot method also creates a more up-to-date image of the file system that is being protected. Using tape-based storage devices often causes uncertainty of backing up not the most recent data, as tape drives provide transfer rates two- or more orders of magnitude slower than hard disks in the backup server with high-speed network connection and the backup process to a tape can take a large amount of time to complete. In addition, the sheer size of RAID may create huge problerns when backing up or archiving it directly to a tape device, as multiple media are needed. Since a typical backup process is usually done during times of low file system activity, for example overnight, it is often required that the backup process completes without human assistance.
[0010] In the described invention, once the snap-shot of the file system is placed on the backup server, ii: can be conventionally backed-up to a tape media.
Since backups are usually performed every 24 hours, the tape backup of the backup server can be performE~d on a more relaxed schedule, even during times of high activity of the main RAID and non-RAID file system. The time allotted to complete the tape-based backup is now 24 hours minus the time necessary to create the snap-shot image. The described process is such that, disk drives in the backup server are not stressed, if used only, or mostly for the purpose of storing the snap-shot image. This creates a very reliable intermediate storage system. The disks of the backup server should also be automatically powered down through BIOS and/or APIVI settings to reduce the stress and/or mounted only when needed.
Since backups are usually performed every 24 hours, the tape backup of the backup server can be performE~d on a more relaxed schedule, even during times of high activity of the main RAID and non-RAID file system. The time allotted to complete the tape-based backup is now 24 hours minus the time necessary to create the snap-shot image. The described process is such that, disk drives in the backup server are not stressed, if used only, or mostly for the purpose of storing the snap-shot image. This creates a very reliable intermediate storage system. The disks of the backup server should also be automatically powered down through BIOS and/or APIVI settings to reduce the stress and/or mounted only when needed.
[0011] A process for restoring backed-up information uses a procedure with the reversed order of steps taken during the backup operation. First, the content of the backup media, for example tape media is restored to the backup server. This initial restore may be performed over an extended period of time, without disabling access to the file system. Next, the data, restored from backup media to the backup, is transferred at high speed to the file system.
Preferably, a dedicated high speed connection between the backup server and the file system is used, such as 1000Base-T network link. The restore operation is less sensitive to restore time in case of a tatal failure of the file system. However, during a typical restore operation only a damaged or lost fragment of the entire file system needs to be restored. In such ease, use of the invention minimizes the file system downtime and reduces the impact of the file system inaccessibility during the restore operation.
Preferably, a dedicated high speed connection between the backup server and the file system is used, such as 1000Base-T network link. The restore operation is less sensitive to restore time in case of a tatal failure of the file system. However, during a typical restore operation only a damaged or lost fragment of the entire file system needs to be restored. In such ease, use of the invention minimizes the file system downtime and reduces the impact of the file system inaccessibility during the restore operation.
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA 2384020 CA2384020A1 (en) | 2002-05-09 | 2002-05-09 | Apparatus and method for fast backup and restore or large file systems |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA 2384020 CA2384020A1 (en) | 2002-05-09 | 2002-05-09 | Apparatus and method for fast backup and restore or large file systems |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2384020A1 true CA2384020A1 (en) | 2003-11-09 |
Family
ID=29425913
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA 2384020 Abandoned CA2384020A1 (en) | 2002-05-09 | 2002-05-09 | Apparatus and method for fast backup and restore or large file systems |
Country Status (1)
Country | Link |
---|---|
CA (1) | CA2384020A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8204863B2 (en) | 2009-12-21 | 2012-06-19 | International Business Machines Corporation | Multi-phase file system restore with selective on-demand data availability |
US8639665B2 (en) | 2012-04-04 | 2014-01-28 | International Business Machines Corporation | Hybrid backup and restore of very large file system using metadata image backup and traditional backup |
US8805789B2 (en) | 2012-09-12 | 2014-08-12 | International Business Machines Corporation | Using a metadata image of a file system and archive instance to backup data objects in the file system |
US8914334B2 (en) | 2012-09-12 | 2014-12-16 | International Business Machines Corporation | Using a metadata image of a file system and archive instance to restore data objects in the file system |
US9354979B2 (en) | 2014-02-07 | 2016-05-31 | International Business Machines Corporation | Server based disaster recovery by making use of dual write responses |
-
2002
- 2002-05-09 CA CA 2384020 patent/CA2384020A1/en not_active Abandoned
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8204863B2 (en) | 2009-12-21 | 2012-06-19 | International Business Machines Corporation | Multi-phase file system restore with selective on-demand data availability |
US8639665B2 (en) | 2012-04-04 | 2014-01-28 | International Business Machines Corporation | Hybrid backup and restore of very large file system using metadata image backup and traditional backup |
US8805789B2 (en) | 2012-09-12 | 2014-08-12 | International Business Machines Corporation | Using a metadata image of a file system and archive instance to backup data objects in the file system |
US8914334B2 (en) | 2012-09-12 | 2014-12-16 | International Business Machines Corporation | Using a metadata image of a file system and archive instance to restore data objects in the file system |
US9354979B2 (en) | 2014-02-07 | 2016-05-31 | International Business Machines Corporation | Server based disaster recovery by making use of dual write responses |
US10146470B2 (en) | 2014-02-07 | 2018-12-04 | International Business Machines Corporation | Server based disaster recovery by making use of dual write responses |
US10691371B2 (en) | 2014-02-07 | 2020-06-23 | International Business Machines Corporation | Server based disaster recovery by making use of dual write responses |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11199978B2 (en) | Data protection with multiple site replication | |
US8572046B2 (en) | System and method for backing up a computer system | |
US7343460B2 (en) | Data storage system and process | |
US8560790B2 (en) | Incremental backup of source to target storage volume | |
EP2366151B1 (en) | Method and system for managing replicated database data | |
US7284019B2 (en) | Apparatus, system, and method for differential backup using snapshot on-write data | |
AU700681B2 (en) | A method of operating a computer system | |
US9910592B2 (en) | System and method for replicating data stored on non-volatile storage media using a volatile memory as a memory buffer | |
US20020059505A1 (en) | Method and apparatus for differential backup in a computer storage system | |
WO2007103141A2 (en) | Method and apparatus for providing virtual machine backup | |
US8190834B2 (en) | Process for contiguously streaming data from a content addressed storage system | |
CA2384020A1 (en) | Apparatus and method for fast backup and restore or large file systems | |
JP2000305718A (en) | Back-up device | |
JPH11316700A (en) | System and method for data backup |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FZDE | Dead |