US6772177B2 - System and method for parallelizing file archival and retrieval - Google Patents
System and method for parallelizing file archival and retrieval Download PDFInfo
- Publication number
- US6772177B2 US6772177B2 US09/872,088 US87208801A US6772177B2 US 6772177 B2 US6772177 B2 US 6772177B2 US 87208801 A US87208801 A US 87208801A US 6772177 B2 US6772177 B2 US 6772177B2
- Authority
- US
- United States
- Prior art keywords
- copy
- file
- restore
- agents
- queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/113—Details of archiving
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1858—Parallel file systems, i.e. file systems supporting multiple processors
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99938—Concurrency, e.g. lock management in shared database
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99951—File or database maintenance
- Y10S707/99952—Coherency, e.g. same view to multiple users
- Y10S707/99955—Archiving or backup
Abstract
Description
Claims (17)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/872,088 US6772177B2 (en) | 2001-06-01 | 2001-06-01 | System and method for parallelizing file archival and retrieval |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/872,088 US6772177B2 (en) | 2001-06-01 | 2001-06-01 | System and method for parallelizing file archival and retrieval |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020184244A1 US20020184244A1 (en) | 2002-12-05 |
US6772177B2 true US6772177B2 (en) | 2004-08-03 |
Family
ID=25358808
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/872,088 Expired - Fee Related US6772177B2 (en) | 2001-06-01 | 2001-06-01 | System and method for parallelizing file archival and retrieval |
Country Status (1)
Country | Link |
---|---|
US (1) | US6772177B2 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020178233A1 (en) * | 2001-05-25 | 2002-11-28 | International Business Machines Corporation | Method and apparatus for the automatic migration of applications and their associated data and configuration files |
US20020178173A1 (en) * | 2001-05-25 | 2002-11-28 | International Business Machines Corporation | Method and apparatus for performing the identification of files to be backed up using relational meta data |
US20020178436A1 (en) * | 2001-05-25 | 2002-11-28 | International Business Machines Corporation | Method and apparatus for the automatic discovery of the relationships between applications and their associated data and configuration files |
US20060129768A1 (en) * | 2002-09-09 | 2006-06-15 | Thorsten Pferdekaemper | Methods and systems for archiving data |
US20060149696A1 (en) * | 2002-09-09 | 2006-07-06 | Thorsten Pferdekaemper | Method and systems for controlling access to a data object by means of locks |
US20060149736A1 (en) * | 2002-09-09 | 2006-07-06 | Thorsten Pferdekaemper | Electronic data structure for controlling access to data objects using locks |
US20060242203A1 (en) * | 2002-09-09 | 2006-10-26 | Pferdekaeemper Thorsten | Methods and systems for data moving using locks |
US20080114637A1 (en) * | 2006-11-09 | 2008-05-15 | Achtermann Jeffrey M | System and method for implementing database concurrency for allowing multiple agents to coordinate execution of tasks in a cluster |
US20090313280A1 (en) * | 2008-06-12 | 2009-12-17 | Microsoft Corporation | Techniques for extracting data from content databases |
US7693881B2 (en) | 2002-09-09 | 2010-04-06 | Sap Ag | Methods and systems for moving data using locks |
US7693890B2 (en) | 2002-09-09 | 2010-04-06 | Sap Ag | Methods and systems for moving data objects |
US20100281049A1 (en) * | 2008-06-12 | 2010-11-04 | Microsoft Corporation | Exploring attached and unattached content databases |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7346664B2 (en) | 2003-04-24 | 2008-03-18 | Neopath Networks, Inc. | Transparent file migration using namespace replication |
US8539081B2 (en) | 2003-09-15 | 2013-09-17 | Neopath Networks, Inc. | Enabling proxy services using referral mechanisms |
US8195627B2 (en) | 2004-04-23 | 2012-06-05 | Neopath Networks, Inc. | Storage policy monitoring for a storage network |
US8190741B2 (en) | 2004-04-23 | 2012-05-29 | Neopath Networks, Inc. | Customizing a namespace in a decentralized storage environment |
WO2007002855A2 (en) | 2005-06-29 | 2007-01-04 | Neopath Networks, Inc. | Parallel filesystem traversal for transparent mirroring of directories and files |
US7966292B1 (en) * | 2005-06-30 | 2011-06-21 | Emc Corporation | Index processing |
US8161005B1 (en) * | 2005-06-30 | 2012-04-17 | Emc Corporation | Efficient index processing |
US8156079B1 (en) | 2005-06-30 | 2012-04-10 | Emc Corporation | System and method for index processing |
US8131689B2 (en) * | 2005-09-30 | 2012-03-06 | Panagiotis Tsirigotis | Accumulating access frequency and file attributes for supporting policy based storage management |
US7627609B1 (en) | 2005-09-30 | 2009-12-01 | Emc Corporation | Index processing using transformed values |
US7698325B1 (en) | 2005-09-30 | 2010-04-13 | Emc Corporation | Index processing for legacy systems |
US7752211B1 (en) * | 2005-09-30 | 2010-07-06 | Emc Corporation | Adaptive index processing |
US8341127B1 (en) * | 2006-02-02 | 2012-12-25 | Emc Corporation | Client initiated restore |
US8886902B1 (en) | 2006-02-02 | 2014-11-11 | Emc Corporation | Disk backup set access |
US8112396B2 (en) * | 2006-06-07 | 2012-02-07 | Emc Corporation | Backup and recovery of integrated linked databases |
US8930497B1 (en) * | 2008-10-31 | 2015-01-06 | Netapp, Inc. | Centralized execution of snapshot backups in a distributed application environment |
CN103176862B (en) * | 2011-12-20 | 2017-03-01 | 伊姆西公司 | For managing equipment and the method for data backup task |
US8938428B1 (en) | 2012-04-16 | 2015-01-20 | Emc Corporation | Systems and methods for efficiently locating object names in a large index of records containing object names |
US10891304B2 (en) | 2018-07-25 | 2021-01-12 | Commvault Systems, Inc. | Distributed and scalable client-based storage management |
US10893103B2 (en) * | 2018-07-25 | 2021-01-12 | Commvault Systems, Inc. | Distributed and scalable storage management using a storage-microservices server |
JP7300781B1 (en) | 2022-11-15 | 2023-06-30 | Eaglys株式会社 | Data management system, data management method, and data management program |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4996663A (en) | 1988-02-02 | 1991-02-26 | Bell Communications Research, Inc. | Methods and apparatus for decontaminating hash tables |
US5606689A (en) | 1991-12-24 | 1997-02-25 | Fujitsu Limited | Data processing apparatus including external storage previously reserved to be allocated to job groups |
US5668897A (en) * | 1994-03-15 | 1997-09-16 | Stolfo; Salvatore J. | Method and apparatus for imaging, image processing and data compression merge/purge techniques for document image databases |
US5671350A (en) * | 1993-09-30 | 1997-09-23 | Sybase, Inc. | Data backup system with methods for stripe affinity backup to multiple archive devices |
US5673381A (en) | 1994-05-27 | 1997-09-30 | Cheyenne Software International Sales Corp. | System and parallel streaming and data stripping to back-up a network |
US5778395A (en) * | 1995-10-23 | 1998-07-07 | Stac, Inc. | System for backing up files from disk volumes on multiple nodes of a computer network |
US5797016A (en) * | 1996-10-29 | 1998-08-18 | Cheyenne Software Inc. | Regeneration agent for back-up software |
US5893086A (en) | 1997-07-11 | 1999-04-06 | International Business Machines Corporation | Parallel file system and method with extensible hashing |
US5960431A (en) | 1996-12-19 | 1999-09-28 | International Business Machines Corporation | Method and apparatus for adding data storage bins to a stored computer database while minimizing movement of data and balancing data distribution |
US5987462A (en) | 1996-04-26 | 1999-11-16 | Hitachi, Ltd. | Parallel data base record distribution method and parallel data base management system |
US6366987B1 (en) * | 1998-08-13 | 2002-04-02 | Emc Corporation | Computer data storage physical backup and logical restore |
US6484250B1 (en) * | 2000-01-19 | 2002-11-19 | Qualcomm, Incorporated | Hash technique eliminating pointer storage to reduce RAM size |
-
2001
- 2001-06-01 US US09/872,088 patent/US6772177B2/en not_active Expired - Fee Related
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4996663A (en) | 1988-02-02 | 1991-02-26 | Bell Communications Research, Inc. | Methods and apparatus for decontaminating hash tables |
US5606689A (en) | 1991-12-24 | 1997-02-25 | Fujitsu Limited | Data processing apparatus including external storage previously reserved to be allocated to job groups |
US5671350A (en) * | 1993-09-30 | 1997-09-23 | Sybase, Inc. | Data backup system with methods for stripe affinity backup to multiple archive devices |
US5668897A (en) * | 1994-03-15 | 1997-09-16 | Stolfo; Salvatore J. | Method and apparatus for imaging, image processing and data compression merge/purge techniques for document image databases |
US5673381A (en) | 1994-05-27 | 1997-09-30 | Cheyenne Software International Sales Corp. | System and parallel streaming and data stripping to back-up a network |
US5778395A (en) * | 1995-10-23 | 1998-07-07 | Stac, Inc. | System for backing up files from disk volumes on multiple nodes of a computer network |
US5987462A (en) | 1996-04-26 | 1999-11-16 | Hitachi, Ltd. | Parallel data base record distribution method and parallel data base management system |
US5797016A (en) * | 1996-10-29 | 1998-08-18 | Cheyenne Software Inc. | Regeneration agent for back-up software |
US5960431A (en) | 1996-12-19 | 1999-09-28 | International Business Machines Corporation | Method and apparatus for adding data storage bins to a stored computer database while minimizing movement of data and balancing data distribution |
US5893086A (en) | 1997-07-11 | 1999-04-06 | International Business Machines Corporation | Parallel file system and method with extensible hashing |
US6366987B1 (en) * | 1998-08-13 | 2002-04-02 | Emc Corporation | Computer data storage physical backup and logical restore |
US6484250B1 (en) * | 2000-01-19 | 2002-11-19 | Qualcomm, Incorporated | Hash technique eliminating pointer storage to reduce RAM size |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020178233A1 (en) * | 2001-05-25 | 2002-11-28 | International Business Machines Corporation | Method and apparatus for the automatic migration of applications and their associated data and configuration files |
US20020178173A1 (en) * | 2001-05-25 | 2002-11-28 | International Business Machines Corporation | Method and apparatus for performing the identification of files to be backed up using relational meta data |
US20020178436A1 (en) * | 2001-05-25 | 2002-11-28 | International Business Machines Corporation | Method and apparatus for the automatic discovery of the relationships between applications and their associated data and configuration files |
US6976039B2 (en) | 2001-05-25 | 2005-12-13 | International Business Machines Corporation | Method and system for processing backup data associated with application, querying metadata files describing files accessed by the application |
US7016920B2 (en) | 2001-05-25 | 2006-03-21 | International Business Machines Corporation | Method for tracking relationships between specified file name and particular program used for subsequent access in a database |
US7028079B2 (en) * | 2001-05-25 | 2006-04-11 | Lenovo (Singapore) Pte, Ltd. | Method and apparatus for the automatic migration of applications and their associated data and configuration files |
US7693890B2 (en) | 2002-09-09 | 2010-04-06 | Sap Ag | Methods and systems for moving data objects |
US7756814B2 (en) | 2002-09-09 | 2010-07-13 | Sap Ag | Methods and systems for controlling access to a data object |
US20060149736A1 (en) * | 2002-09-09 | 2006-07-06 | Thorsten Pferdekaemper | Electronic data structure for controlling access to data objects using locks |
US20060242203A1 (en) * | 2002-09-09 | 2006-10-26 | Pferdekaeemper Thorsten | Methods and systems for data moving using locks |
US7756813B2 (en) | 2002-09-09 | 2010-07-13 | Sap Ag | Electronic data structure for controlling access to data objects using locks |
US7457933B2 (en) | 2002-09-09 | 2008-11-25 | Sap Ag | Methods and systems for archiving data |
US20060149696A1 (en) * | 2002-09-09 | 2006-07-06 | Thorsten Pferdekaemper | Method and systems for controlling access to a data object by means of locks |
US7653667B2 (en) * | 2002-09-09 | 2010-01-26 | Sap Ag | Methods and systems for data moving using locks |
US7693881B2 (en) | 2002-09-09 | 2010-04-06 | Sap Ag | Methods and systems for moving data using locks |
US20060129768A1 (en) * | 2002-09-09 | 2006-06-15 | Thorsten Pferdekaemper | Methods and systems for archiving data |
US20080114637A1 (en) * | 2006-11-09 | 2008-05-15 | Achtermann Jeffrey M | System and method for implementing database concurrency for allowing multiple agents to coordinate execution of tasks in a cluster |
US7895069B2 (en) | 2006-11-09 | 2011-02-22 | International Business Machines Corporation | System and method for implementing database concurrency for allowing multiple agents to coordinate execution of tasks in a cluster |
US20090313280A1 (en) * | 2008-06-12 | 2009-12-17 | Microsoft Corporation | Techniques for extracting data from content databases |
US20100281049A1 (en) * | 2008-06-12 | 2010-11-04 | Microsoft Corporation | Exploring attached and unattached content databases |
US8635188B2 (en) | 2008-06-12 | 2014-01-21 | Microsoft Corporation | Techniques for extracting data from content databases |
US8788460B2 (en) | 2008-06-12 | 2014-07-22 | Microsoft Corporation | Exploring attached and unattached content databases |
Also Published As
Publication number | Publication date |
---|---|
US20020184244A1 (en) | 2002-12-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6772177B2 (en) | System and method for parallelizing file archival and retrieval | |
US5832508A (en) | Method for deallocating a log in database systems | |
US6857053B2 (en) | Method, system, and program for backing up objects by creating groups of objects | |
EP1430400B1 (en) | Efficient search for migration and purge candidates | |
US7840539B2 (en) | Method and system for building a database from backup data images | |
US6519613B1 (en) | Non-blocking drain method and apparatus for use in processing requests on a resource | |
US5317731A (en) | Intelligent page store for concurrent and consistent access to a database by a transaction processor and a query processor | |
US6567928B1 (en) | Method and apparatus for efficiently recovering from a failure in a database that includes unlogged objects | |
US8386431B2 (en) | Method and system for determining database object associated with tenant-independent or tenant-specific data, configured to store data partition, current version of the respective convertor | |
US6631374B1 (en) | System and method for providing fine-grained temporal database access | |
US7418544B2 (en) | Method and system for log structured relational database objects | |
US6460048B1 (en) | Method, system, and program for managing file names during the reorganization of a database object | |
US6651073B1 (en) | Method and apparatus for insuring database data integrity without data recovery logging | |
CN110209528B (en) | Data backup method, device, server and storage medium | |
WO2007134251A2 (en) | Apparatus and method for read consistency in a log mining system | |
US8640136B2 (en) | Sharing objects between computer systems | |
CN111309794A (en) | Data storage engine | |
Mittra | Internal Level of an Oracle Database | |
Breeden et al. | Use of HSM with Relational Databases | |
Alapati | Introduction to the Oracle Database 10 g Architecture | |
AU2002349890A1 (en) | Efficient management of large files | |
AU2002330129A1 (en) | Sharing objects between computer systems | |
AU2002360252A1 (en) | Efficient search for migration and purge candidates |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HSIAO, HUI-I;MEHTA, KIRAN;SOOD, AJAY;REEL/FRAME:012032/0626 Effective date: 20010601 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
REMI | Maintenance fee reminder mailed | ||
FPAY | Fee payment |
Year of fee payment: 8 |
|
SULP | Surcharge for late payment |
Year of fee payment: 7 |
|
AS | Assignment |
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE INVENTOR'S EXECUTION DATE PREVIOUSLY RECORDED AT REEL: 012032 FRAME: 0626. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:HSIAO, HUI-I;MEHTA, KIRAN;SOOD, AJAY;REEL/FRAME:037963/0230 Effective date: 20010531 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20160803 |