WO2008061897A3 - Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten - Google Patents

Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten Download PDF

Info

Publication number
WO2008061897A3
WO2008061897A3 PCT/EP2007/062093 EP2007062093W WO2008061897A3 WO 2008061897 A3 WO2008061897 A3 WO 2008061897A3 EP 2007062093 W EP2007062093 W EP 2007062093W WO 2008061897 A3 WO2008061897 A3 WO 2008061897A3
Authority
WO
WIPO (PCT)
Prior art keywords
storage system
file
files
server
filed
Prior art date
Application number
PCT/EP2007/062093
Other languages
English (en)
French (fr)
Other versions
WO2008061897A2 (de
Inventor
Stefan Walliser
Oliver Haug
Yu Jiao
Tomaz Beltram
Dejan Volk
Dario Rejc
Igor Lautar
Goran Garevski
Original Assignee
Bdt Solutions Gmbh
Stefan Walliser
Oliver Haug
Yu Jiao
Tomaz Beltram
Dejan Volk
Dario Rejc
Igor Lautar
Goran Garevski
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bdt Solutions Gmbh, Stefan Walliser, Oliver Haug, Yu Jiao, Tomaz Beltram, Dejan Volk, Dario Rejc, Igor Lautar, Goran Garevski filed Critical Bdt Solutions Gmbh
Publication of WO2008061897A2 publication Critical patent/WO2008061897A2/de
Publication of WO2008061897A3 publication Critical patent/WO2008061897A3/de

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1456—Hardware arrangements for backup
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1464—Management of the backup or restore process for networked environments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1469—Backup restoration techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/83—Indexing scheme relating to error detection, to error correction, and to monitoring the solution involving signatures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Verfahren zum Speichern von Daten mit einem ersten Speichersystem und einem zweiten Speichersystem, wobei das zweite Speichersystem zum Sichern der Daten vom ersten Speichersystem dient, wobei das erste Speichersystem mit einem Filesystem versehen ist, auf dem Dateien abgelegt sind, die zu sichern sind, mit einem Client, der das erste Speichersystem überwacht und einem Server, der das zweite Speichersystem verwaltet, umfassend die folgenden Schritte: Überprüfen der Dateien auf dem ersten Speichersystem auf Veränderungen durch den Client in Abhängigkeit von einem oder mehreren Ereignissen; falls Veränderungen festgestellt wurden, Bestimmung eines Hash-Wertes in Bezug auf die Datei, der so ausgebildet ist, dass die Identität der Datei feststellbar ist; Übermitteln des Hash-Wertes an den Server; Überprüfen anhand des Hash-Wertes durch den Server, ob die identische Datei auf dem zweiten Speichersystem abgelegt ist, und falls die Datei bereits vorhanden ist, so wird die Datei nicht angefordert, jedoch vermerkt, dass die Datei auf dem ersten Speichersystem abgelegt ist, und falls die Datei nicht vorhanden ist, Anfordern der gesamten Datei oder Teile der Datei, die sich geändert haben, vom ersten Speichersystem und Ablegen der Datei mit einem Vermerk auf das erste Speichersystem auf dem zweiten Speichersystem.
PCT/EP2007/062093 2006-11-24 2007-11-08 Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten WO2008061897A2 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102006055964A DE102006055964A1 (de) 2006-11-24 2006-11-24 Verfahren und Vorrichtung zur Datensicherung
DE102006055964.9 2006-11-24

Publications (2)

Publication Number Publication Date
WO2008061897A2 WO2008061897A2 (de) 2008-05-29
WO2008061897A3 true WO2008061897A3 (de) 2008-10-16

Family

ID=39262792

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/062093 WO2008061897A2 (de) 2006-11-24 2007-11-08 Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten

Country Status (3)

Country Link
US (1) US7822725B2 (de)
DE (1) DE102006055964A1 (de)
WO (1) WO2008061897A2 (de)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8280926B2 (en) 2003-08-05 2012-10-02 Sepaton, Inc. Scalable de-duplication mechanism
US20100293148A1 (en) * 2008-01-29 2010-11-18 Paul Cesario Network attached storage backup
WO2010002407A1 (en) 2008-07-02 2010-01-07 Hewlett-Packard Development Company, L.P. Performing administrative tasks associated with a network-attached storage system at a client
US8527465B1 (en) * 2008-12-24 2013-09-03 Emc Corporation System and method for modeling data change over time
US8806062B1 (en) * 2009-03-27 2014-08-12 Symantec Corporation Adaptive compression using a sampling based heuristic
US9009429B2 (en) 2009-03-30 2015-04-14 Hewlett-Packard Development Company, L.P. Deduplication of data stored in a copy volume
US8695058B2 (en) * 2009-05-20 2014-04-08 Mobile Iron, Inc. Selective management of mobile device data in an enterprise environment
US8090977B2 (en) * 2009-12-21 2012-01-03 Intel Corporation Performing redundant memory hopping
US8620939B2 (en) * 2010-01-25 2013-12-31 Sepaton, Inc. System and method for summarizing data
US8473463B1 (en) * 2010-03-02 2013-06-25 Symantec Corporation Method of avoiding duplicate backups in a computing system
JP5447092B2 (ja) * 2010-03-30 2014-03-19 富士通株式会社 処理装置，データ移行方法及びデータ移行プログラム
US9122639B2 (en) 2011-01-25 2015-09-01 Sepaton, Inc. Detection and deduplication of backup sets exhibiting poor locality
DE102011016974A1 (de) 2011-04-13 2012-11-15 Continental Automotive Gmbh Verfahren zum Speichern einer sicherheitsrelevanten Dateneinheit
US9383928B2 (en) * 2011-06-13 2016-07-05 Emc Corporation Replication techniques with content addressable storage
US9934229B2 (en) * 2011-10-23 2018-04-03 Microsoft Technology Licensing, Llc Telemetry file hash and conflict detection
US10248582B2 (en) 2011-11-07 2019-04-02 Nexgen Storage, Inc. Primary data storage system with deduplication
DE112012005154T5 (de) * 2011-12-08 2015-03-19 International Business Machines Corporation Verfahren zum Erkennen eines Datenverlusts während einer Datenübertragung zwischen Informationseinheiten
US10324893B1 (en) * 2011-12-15 2019-06-18 Veritas Technologies Llc Backup application catalog analyzer
US9391935B1 (en) * 2011-12-19 2016-07-12 Veritas Technologies Llc Techniques for file classification information retention
US9766832B2 (en) 2013-03-15 2017-09-19 Hitachi Data Systems Corporation Systems and methods of locating redundant data using patterns of matching fingerprints
US9256611B2 (en) 2013-06-06 2016-02-09 Sepaton, Inc. System and method for multi-scale navigation of data
US9678973B2 (en) 2013-10-15 2017-06-13 Hitachi Data Systems Corporation Multi-node hybrid deduplication
JP6439874B2 (ja) * 2015-07-31 2018-12-19 富士通株式会社 情報処理装置、情報処理方法、及び、情報処理プログラム
US10256981B2 (en) * 2016-09-27 2019-04-09 International Business Machines Corporation Secure logging for host security module
KR102067619B1 (ko) * 2018-01-02 2020-02-11 주식회사 한글과컴퓨터 데이터 백업 방법과 이를 이용하는 데이터 백업 장치 및 사용자 단말
DE102018113148A1 (de) * 2018-06-01 2019-12-05 Thorsten Windmann Verfahren zur revisionssicheren Speicherung von Daten
US10936427B2 (en) * 2018-10-09 2021-03-02 International Business Machines Corporation Disaster recovery data fetching control
US11228545B1 (en) * 2021-04-16 2022-01-18 EMC IP Holding Company LLC Cross application granular restore of backed-up email attachments

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050195660A1 (en) * 2004-02-11 2005-09-08 Kavuri Ravi K. Clustered hierarchical file services
WO2005109212A2 (en) * 2004-04-30 2005-11-17 Commvault Systems, Inc. Hierarchical systems providing unified of storage information
US20050283461A1 (en) * 2004-06-02 2005-12-22 Jorg-Stefan Sell Method and apparatus for managing electronic messages
WO2006052872A2 (en) * 2004-11-05 2006-05-18 Commvault Systems, Inc. System and method to support single instance storage operations

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0681721B1 (de) 1993-02-01 2005-03-23 Sun Microsystems, Inc. Archivierungsdateiensystem für datenanbieter in einer verteilten netzwerkumgebung
GB0002019D0 (en) * 2000-01-29 2000-03-22 Ibm Data migration tool
US6704730B2 (en) * 2000-02-18 2004-03-09 Avamar Technologies, Inc. Hash file system and method for use in a commonality factoring system
US6826711B2 (en) 2000-02-18 2004-11-30 Avamar Technologies, Inc. System and method for data protection with multidimensional parity
US6810398B2 (en) 2000-11-06 2004-10-26 Avamar Technologies, Inc. System and method for unorchestrated determination of data sequences using sticky byte factoring to determine breakpoints in digital sequences
US7496604B2 (en) * 2001-12-03 2009-02-24 Aol Llc Reducing duplication of files on a network
US7055008B2 (en) * 2003-01-22 2006-05-30 Falconstor Software, Inc. System and method for backing up data
AU2004214014B2 (en) * 2003-02-21 2009-10-22 Datacore Software Corporation Additional hash functions in content-based addressing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050195660A1 (en) * 2004-02-11 2005-09-08 Kavuri Ravi K. Clustered hierarchical file services
WO2005109212A2 (en) * 2004-04-30 2005-11-17 Commvault Systems, Inc. Hierarchical systems providing unified of storage information
US20050283461A1 (en) * 2004-06-02 2005-12-22 Jorg-Stefan Sell Method and apparatus for managing electronic messages
WO2006052872A2 (en) * 2004-11-05 2006-05-18 Commvault Systems, Inc. System and method to support single instance storage operations

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BLACK J: "Compare-by-hash: a reasoned analysis", PROCEEDINGS OF THE 2006 USENIX ANNUAL TECHNICAL CONFERENCE USENIX ASSOCIATION BERKELEY, CA, USA, June 2006 (2006-06-01), pages 85 - 90, XP002476081 *
BOLOSKY W J ET AL: "SINGLE INSTANCE STORAGE IN WINDOWS(R) 2000", PROCEEDINGS OF THE USENIX WINDOWS SYSTEMS SYMPOSIUM, XX, XX, vol. 4, 2000, pages 13 - 24, XP009069615 *
TOLIA N ET AL: "OPPORTUNISTIC USE OF CONTENT ADDRESSABLE STORAGE FOR DISTRIBUTED FILE SYSTEMS", PROCEEDINGS OF THE USENIX ANNUAL TECHNICAL CONFERENCE, XX, XX, 9 June 2003 (2003-06-09), pages 127 - 140, XP009068169 *

Also Published As

Publication number Publication date
US20080126431A1 (en) 2008-05-29
US7822725B2 (en) 2010-10-26
WO2008061897A2 (de) 2008-05-29
DE102006055964A1 (de) 2008-05-29

Similar Documents

Publication Publication Date Title
WO2008061897A3 (de) Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten
WO2009134772A3 (en) Peer-to-peer redundant file server system and methods
WO2009126771A3 (en) Directed placement of data in a redundant data storage system
EP2104040A3 (de) Verfahren und Vorrichtung zur Prüfung der Integrität archivierter Daten in integrierten Speichersystemen
WO2006052872A3 (en) System and method to support single instance storage operations
WO2007131190A3 (en) Group based complete and incremental computer file backup system, process and apparatus
WO2009154842A3 (en) Controlling access to documents using file locks
US7600133B2 (en) Backing up at least one encrypted computer file
CA2596434A1 (en) File system having variable logical storage block size
WO2007088084A3 (en) Restoring a file to its proper storage tier in an information lifecycle management environment
WO2005078606A3 (en) Clustered hierarchical file services
WO2012036938A3 (en) Directory leasing
WO2012148894A3 (en) Secure data storage
WO2006104698A3 (en) Streaming media content delivery system and method for delivering streaming content
WO2007118243A3 (en) Data compression and storage techniques
WO2010135136A3 (en) Block-level single instancing
WO2009032712A3 (en) Method and system for moving requested files from one storage location to another
WO2007101023A3 (en) Systems and methods for defining and inserting metadata attributes in files
WO2013022582A3 (en) Token based file operations
EP2323061A3 (de) Software-Signaturverfolgung
WO2009023586A3 (en) Storing custom metadata using custom access control entries
WO2009126644A3 (en) Methods and systems for improved throughput performance in a distributed data de-duplication environment
US8886901B1 (en) Policy based storage tiering
WO2007101020A3 (en) System and method for managing files on a file server using embedded metadata and a search engine
GB201307395D0 (en) Systems and methods for storing and verifying security information

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07822395

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07822395

Country of ref document: EP

Kind code of ref document: A2