WO2008061897A3 - Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten - Google Patents

Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten Download PDF

Info

Publication number
WO2008061897A3
WO2008061897A3 PCT/EP2007/062093 EP2007062093W WO2008061897A3 WO 2008061897 A3 WO2008061897 A3 WO 2008061897A3 EP 2007062093 W EP2007062093 W EP 2007062093W WO 2008061897 A3 WO2008061897 A3 WO 2008061897A3
Authority
WO
WIPO (PCT)
Prior art keywords
storage system
file
files
server
filed
Prior art date
Application number
PCT/EP2007/062093
Other languages
English (en)
French (fr)
Other versions
WO2008061897A2 (de
Inventor
Stefan Walliser
Oliver Haug
Yu Jiao
Tomaz Beltram
Dejan Volk
Dario Rejc
Igor Lautar
Goran Garevski
Original Assignee
Bdt Solutions Gmbh
Stefan Walliser
Oliver Haug
Yu Jiao
Tomaz Beltram
Dejan Volk
Dario Rejc
Igor Lautar
Goran Garevski
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bdt Solutions Gmbh, Stefan Walliser, Oliver Haug, Yu Jiao, Tomaz Beltram, Dejan Volk, Dario Rejc, Igor Lautar, Goran Garevski filed Critical Bdt Solutions Gmbh
Publication of WO2008061897A2 publication Critical patent/WO2008061897A2/de
Publication of WO2008061897A3 publication Critical patent/WO2008061897A3/de

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1456Hardware arrangements for backup
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1469Backup restoration techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/83Indexing scheme relating to error detection, to error correction, and to monitoring the solution involving signatures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Verfahren zum Speichern von Daten mit einem ersten Speichersystem und einem zweiten Speichersystem, wobei das zweite Speichersystem zum Sichern der Daten vom ersten Speichersystem dient, wobei das erste Speichersystem mit einem Filesystem versehen ist, auf dem Dateien abgelegt sind, die zu sichern sind, mit einem Client, der das erste Speichersystem überwacht und einem Server, der das zweite Speichersystem verwaltet, umfassend die folgenden Schritte: Überprüfen der Dateien auf dem ersten Speichersystem auf Veränderungen durch den Client in Abhängigkeit von einem oder mehreren Ereignissen; falls Veränderungen festgestellt wurden, Bestimmung eines Hash-Wertes in Bezug auf die Datei, der so ausgebildet ist, dass die Identität der Datei feststellbar ist; Übermitteln des Hash-Wertes an den Server; Überprüfen anhand des Hash-Wertes durch den Server, ob die identische Datei auf dem zweiten Speichersystem abgelegt ist, und falls die Datei bereits vorhanden ist, so wird die Datei nicht angefordert, jedoch vermerkt, dass die Datei auf dem ersten Speichersystem abgelegt ist, und falls die Datei nicht vorhanden ist, Anfordern der gesamten Datei oder Teile der Datei, die sich geändert haben, vom ersten Speichersystem und Ablegen der Datei mit einem Vermerk auf das erste Speichersystem auf dem zweiten Speichersystem.
PCT/EP2007/062093 2006-11-24 2007-11-08 Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten WO2008061897A2 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102006055964.9 2006-11-24
DE102006055964A DE102006055964A1 (de) 2006-11-24 2006-11-24 Verfahren und Vorrichtung zur Datensicherung

Publications (2)

Publication Number Publication Date
WO2008061897A2 WO2008061897A2 (de) 2008-05-29
WO2008061897A3 true WO2008061897A3 (de) 2008-10-16

Family

ID=39262792

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/062093 WO2008061897A2 (de) 2006-11-24 2007-11-08 Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten

Country Status (3)

Country Link
US (1) US7822725B2 (de)
DE (1) DE102006055964A1 (de)
WO (1) WO2008061897A2 (de)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8280926B2 (en) 2003-08-05 2012-10-02 Sepaton, Inc. Scalable de-duplication mechanism
WO2009096946A1 (en) * 2008-01-29 2009-08-06 Hewlett-Packard Development Company, L.P. Network attached storage backup
WO2010002407A1 (en) 2008-07-02 2010-01-07 Hewlett-Packard Development Company, L.P. Performing administrative tasks associated with a network-attached storage system at a client
US8527465B1 (en) * 2008-12-24 2013-09-03 Emc Corporation System and method for modeling data change over time
US8806062B1 (en) * 2009-03-27 2014-08-12 Symantec Corporation Adaptive compression using a sampling based heuristic
CN102378969B (zh) * 2009-03-30 2015-08-05 惠普开发有限公司 拷贝卷中存储的数据的去重复
US8695058B2 (en) * 2009-05-20 2014-04-08 Mobile Iron, Inc. Selective management of mobile device data in an enterprise environment
US8090977B2 (en) * 2009-12-21 2012-01-03 Intel Corporation Performing redundant memory hopping
US8447741B2 (en) * 2010-01-25 2013-05-21 Sepaton, Inc. System and method for providing data driven de-duplication services
US8473463B1 (en) * 2010-03-02 2013-06-25 Symantec Corporation Method of avoiding duplicate backups in a computing system
JP5447092B2 (ja) * 2010-03-30 2014-03-19 富士通株式会社 処理装置,データ移行方法及びデータ移行プログラム
US8688651B2 (en) 2011-01-25 2014-04-01 Sepaton, Inc. Dynamic deduplication
DE102011016974A1 (de) 2011-04-13 2012-11-15 Continental Automotive Gmbh Verfahren zum Speichern einer sicherheitsrelevanten Dateneinheit
US9383928B2 (en) * 2011-06-13 2016-07-05 Emc Corporation Replication techniques with content addressable storage
US9934229B2 (en) * 2011-10-23 2018-04-03 Microsoft Technology Licensing, Llc Telemetry file hash and conflict detection
US10248582B2 (en) 2011-11-07 2019-04-02 Nexgen Storage, Inc. Primary data storage system with deduplication
WO2013084571A1 (ja) * 2011-12-08 2013-06-13 インターナショナル・ビジネス・マシーンズ・コーポレーション 情報機器間のデータ転送のデータ欠落を検出する方法
US10324893B1 (en) * 2011-12-15 2019-06-18 Veritas Technologies Llc Backup application catalog analyzer
US9391935B1 (en) * 2011-12-19 2016-07-12 Veritas Technologies Llc Techniques for file classification information retention
US9766832B2 (en) 2013-03-15 2017-09-19 Hitachi Data Systems Corporation Systems and methods of locating redundant data using patterns of matching fingerprints
US9256611B2 (en) 2013-06-06 2016-02-09 Sepaton, Inc. System and method for multi-scale navigation of data
US9678973B2 (en) 2013-10-15 2017-06-13 Hitachi Data Systems Corporation Multi-node hybrid deduplication
WO2017022034A1 (ja) * 2015-07-31 2017-02-09 富士通株式会社 情報処理装置、情報処理方法、及び、情報処理プログラム
US10256981B2 (en) * 2016-09-27 2019-04-09 International Business Machines Corporation Secure logging for host security module
KR102067619B1 (ko) * 2018-01-02 2020-02-11 주식회사 한글과컴퓨터 데이터 백업 방법과 이를 이용하는 데이터 백업 장치 및 사용자 단말
DE102018113148A1 (de) * 2018-06-01 2019-12-05 Thorsten Windmann Verfahren zur revisionssicheren Speicherung von Daten
US10936427B2 (en) * 2018-10-09 2021-03-02 International Business Machines Corporation Disaster recovery data fetching control
US11228545B1 (en) * 2021-04-16 2022-01-18 EMC IP Holding Company LLC Cross application granular restore of backed-up email attachments

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050195660A1 (en) * 2004-02-11 2005-09-08 Kavuri Ravi K. Clustered hierarchical file services
WO2005109212A2 (en) * 2004-04-30 2005-11-17 Commvault Systems, Inc. Hierarchical systems providing unified of storage information
US20050283461A1 (en) * 2004-06-02 2005-12-22 Jorg-Stefan Sell Method and apparatus for managing electronic messages
WO2006052872A2 (en) * 2004-11-05 2006-05-18 Commvault Systems, Inc. System and method to support single instance storage operations

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0681721B1 (de) 1993-02-01 2005-03-23 Sun Microsystems, Inc. Archivierungsdateiensystem für datenanbieter in einer verteilten netzwerkumgebung
GB0002019D0 (en) * 2000-01-29 2000-03-22 Ibm Data migration tool
US6826711B2 (en) 2000-02-18 2004-11-30 Avamar Technologies, Inc. System and method for data protection with multidimensional parity
US6704730B2 (en) * 2000-02-18 2004-03-09 Avamar Technologies, Inc. Hash file system and method for use in a commonality factoring system
US6810398B2 (en) 2000-11-06 2004-10-26 Avamar Technologies, Inc. System and method for unorchestrated determination of data sequences using sticky byte factoring to determine breakpoints in digital sequences
US7496604B2 (en) * 2001-12-03 2009-02-24 Aol Llc Reducing duplication of files on a network
US7055008B2 (en) * 2003-01-22 2006-05-30 Falconstor Software, Inc. System and method for backing up data
CA2516741C (en) * 2003-02-21 2013-10-08 Caringo, Inc. Additional hash functions in content-based addressing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050195660A1 (en) * 2004-02-11 2005-09-08 Kavuri Ravi K. Clustered hierarchical file services
WO2005109212A2 (en) * 2004-04-30 2005-11-17 Commvault Systems, Inc. Hierarchical systems providing unified of storage information
US20050283461A1 (en) * 2004-06-02 2005-12-22 Jorg-Stefan Sell Method and apparatus for managing electronic messages
WO2006052872A2 (en) * 2004-11-05 2006-05-18 Commvault Systems, Inc. System and method to support single instance storage operations

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BLACK J: "Compare-by-hash: a reasoned analysis", PROCEEDINGS OF THE 2006 USENIX ANNUAL TECHNICAL CONFERENCE USENIX ASSOCIATION BERKELEY, CA, USA, June 2006 (2006-06-01), pages 85 - 90, XP002476081 *
BOLOSKY W J ET AL: "SINGLE INSTANCE STORAGE IN WINDOWS(R) 2000", PROCEEDINGS OF THE USENIX WINDOWS SYSTEMS SYMPOSIUM, XX, XX, vol. 4, 2000, pages 13 - 24, XP009069615 *
TOLIA N ET AL: "OPPORTUNISTIC USE OF CONTENT ADDRESSABLE STORAGE FOR DISTRIBUTED FILE SYSTEMS", PROCEEDINGS OF THE USENIX ANNUAL TECHNICAL CONFERENCE, XX, XX, 9 June 2003 (2003-06-09), pages 127 - 140, XP009068169 *

Also Published As

Publication number Publication date
WO2008061897A2 (de) 2008-05-29
US20080126431A1 (en) 2008-05-29
DE102006055964A1 (de) 2008-05-29
US7822725B2 (en) 2010-10-26

Similar Documents

Publication Publication Date Title
WO2008061897A3 (de) Verfahren und vorrichtung zur datenarchivierung durch vergleich von hash-werten
WO2009134772A3 (en) Peer-to-peer redundant file server system and methods
WO2009126771A3 (en) Directed placement of data in a redundant data storage system
WO2008085708A3 (en) Data backup system and method associated therewith
EP2104040A3 (de) Verfahren und Vorrichtung zur Prüfung der Integrität archivierter Daten in integrierten Speichersystemen
WO2006052872A3 (en) System and method to support single instance storage operations
WO2007131190A3 (en) Group based complete and incremental computer file backup system, process and apparatus
WO2008115670A3 (en) System and method for identifying content
US7600133B2 (en) Backing up at least one encrypted computer file
WO2007088084A3 (en) Restoring a file to its proper storage tier in an information lifecycle management environment
WO2012148894A3 (en) Secure data storage
WO2005078606A3 (en) Clustered hierarchical file services
WO2009032780A3 (en) Method and system for efficiently storing data files
WO2012036938A3 (en) Directory leasing
WO2007082314A3 (en) Digital content metadata registry systems and methods
WO2006104698A3 (en) Streaming media content delivery system and method for delivering streaming content
WO2007118243A3 (en) Data compression and storage techniques
WO2010135136A3 (en) Block-level single instancing
WO2007101023A3 (en) Systems and methods for defining and inserting metadata attributes in files
WO2010096237A3 (en) Font handling for viewing documents on the web
WO2008083267A3 (en) Storing log data efficiently while supporting querying to assist in computer network security
US20120150824A1 (en) Processing System of Data De-Duplication
WO2013022582A3 (en) Token based file operations
US8886901B1 (en) Policy based storage tiering
GB2475992A (en) Analyzing server copies of client files

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07822395

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07822395

Country of ref document: EP

Kind code of ref document: A2