CN105843905B - 用于管理文件系统中的文件系统对象的设备和方法 - Google Patents

用于管理文件系统中的文件系统对象的设备和方法 Download PDF

Info

Publication number
CN105843905B
CN105843905B CN201610169762.3A CN201610169762A CN105843905B CN 105843905 B CN105843905 B CN 105843905B CN 201610169762 A CN201610169762 A CN 201610169762A CN 105843905 B CN105843905 B CN 105843905B
Authority
CN
China
Prior art keywords
file system
snapshot
checkpoint
pointer
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610169762.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN105843905A (zh
Inventor
丹尼尔·J·N·皮肯
尼尔·柏林顿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Vantara LLC
Original Assignee
Hitachi Data System Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Data System Corp filed Critical Hitachi Data System Corp
Publication of CN105843905A publication Critical patent/CN105843905A/zh
Application granted granted Critical
Publication of CN105843905B publication Critical patent/CN105843905B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/178—Techniques for file synchronisation in file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/128—Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G06F16/162—Delete operations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201610169762.3A 2010-11-22 2011-11-21 用于管理文件系统中的文件系统对象的设备和方法 Active CN105843905B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US41592810P 2010-11-22 2010-11-22
US61/415,928 2010-11-22
CN201180056305.9A CN103221924B (zh) 2010-11-22 2011-11-21 数据存储系统中的文件克隆和去克隆

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201180056305.9A Division CN103221924B (zh) 2010-11-22 2011-11-21 数据存储系统中的文件克隆和去克隆

Publications (2)

Publication Number Publication Date
CN105843905A CN105843905A (zh) 2016-08-10
CN105843905B true CN105843905B (zh) 2019-06-11

Family

ID=45420942

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201180056305.9A Active CN103221924B (zh) 2010-11-22 2011-11-21 数据存储系统中的文件克隆和去克隆
CN201610169762.3A Active CN105843905B (zh) 2010-11-22 2011-11-21 用于管理文件系统中的文件系统对象的设备和方法

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201180056305.9A Active CN103221924B (zh) 2010-11-22 2011-11-21 数据存储系统中的文件克隆和去克隆

Country Status (5)

Country Link
US (4) US8738570B2 (enExample)
EP (2) EP2593868B1 (enExample)
JP (1) JP5948340B2 (enExample)
CN (2) CN103221924B (enExample)
WO (1) WO2012071335A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11748300B2 (en) * 2021-11-18 2023-09-05 Vmware, Inc. Reverse deletion of a chain of snapshots
TWI860122B (zh) * 2023-10-12 2024-10-21 技嘉科技股份有限公司 編號式檔案的資料結構、交握方法及交握系統

Families Citing this family (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2593868B1 (en) 2010-11-22 2015-02-18 Hitachi Data Systems Engineering UK Limited Method and apparatus for cloning a filesystem object in a data storage system
US8688636B1 (en) * 2010-12-10 2014-04-01 Netapp, Inc. Rapid cloning of virtual machines
US8832035B2 (en) * 2011-08-30 2014-09-09 Netapp, Inc. System and method for retaining deduplication in a storage object after a clone split operation
JP2013073403A (ja) * 2011-09-27 2013-04-22 Fujitsu Ltd 情報処理装置、情報処理方法、および情報処理プログラム
WO2013096816A1 (en) 2011-12-22 2013-06-27 Biogen Idec Ma Inc. Improved synthesis of amine substituted 4,5,6,7-tetrahydrobenzothiazole compounds
US9141634B2 (en) * 2012-01-21 2015-09-22 Huawei Technologies Co., Ltd. Method for automatic data replication and terminal
CN104641365B (zh) * 2012-09-19 2019-05-31 日立数据管理有限公司 在文件存储系统中使用检查点管理去复制的系统和方法
US10055407B2 (en) * 2012-11-20 2018-08-21 International Business Machines Corporation Maintaining access control lists in non-identity-preserving replicated data repositories
US8924425B1 (en) * 2012-12-06 2014-12-30 Netapp, Inc. Migrating data from legacy storage systems to object storage systems
CN103034587B (zh) * 2012-12-19 2015-09-30 华为技术有限公司 一种复制文件的方法及装置
US20150052112A1 (en) * 2013-01-11 2015-02-19 Hitachi, Ltd. File server, storage apparatus, and data management method
EP2959373B1 (en) * 2013-02-21 2020-07-15 Hitachi Vantara LLC Object-level replication of cloned objects in a data storage system
US9823872B2 (en) 2013-03-15 2017-11-21 Skyera, Llc Apparatus and method for translation from multi-dimensional to linear address space in storage
US20150032982A1 (en) * 2013-07-26 2015-01-29 Fusion-Io, Inc. Systems and methods for storage consistency
US8937562B1 (en) * 2013-07-29 2015-01-20 Sap Se Shared data de-duplication method and system
US9591058B2 (en) * 2013-09-26 2017-03-07 Coriant Operations, Inc. Rapid recovery method for incomplete file transfer from sender to recipient
CN103559103B (zh) * 2013-11-06 2016-08-24 华为技术有限公司 数据复制方法和装置
WO2015110171A1 (en) 2014-01-24 2015-07-30 Hitachi Data Systems Engineering UK Limited Method, system and computer program product for replicating file system objects from a source file system to a target file system and for de-cloning snapshot-files in a file system
US11809451B2 (en) * 2014-02-19 2023-11-07 Snowflake Inc. Caching systems and methods
WO2015134680A1 (en) * 2014-03-05 2015-09-11 Scality, S.A. Snapshots and forks of storage systems using distributed consistent databases implemented within an object store
US10248682B2 (en) 2015-02-20 2019-04-02 Scality, S.A. Object storage system capable of performing snapshots, branches and locking
US9524302B2 (en) 2014-03-05 2016-12-20 Scality, S.A. Distributed consistent database implementation within an object store
US10261960B2 (en) 2014-09-12 2019-04-16 Scality, S.A. Snapshots and forks of storage systems using distributed consistent databases implemented within an object store
WO2015135574A1 (en) 2014-03-11 2015-09-17 Hitachi Data Systems Engineering UK Limited Computer program product, method, apparatus and data storage system for controlling write operations in the data storage system
US10277678B2 (en) 2014-05-14 2019-04-30 Hitachi Data Systems Engineering UK Limited Method and an apparatus, and related computer-program products, for managing access request to one or more file systems
US9400741B1 (en) * 2014-06-30 2016-07-26 Emc Corporation Reclaiming space from file system hosting many primary storage objects and their snapshots
US9727575B2 (en) * 2014-08-29 2017-08-08 Microsoft Technology Licensing, Llc File system with data block sharing
US10417190B1 (en) * 2014-09-25 2019-09-17 Amazon Technologies, Inc. Log-structured file system for zone block devices with small zones
WO2016050315A1 (en) 2014-10-02 2016-04-07 Hitachi Data Systems Engineering UK Limited Method and an apparatus, and related computer-program products, for managing access request in multi-tenancy environments
US9563513B2 (en) 2014-10-09 2017-02-07 International Business Machines Corporation O(1) virtual machine (VM) snapshot management
US10922276B2 (en) * 2014-11-10 2021-02-16 Hewlett Packard Enterprise Development Lp Online file system check
US20160162510A1 (en) * 2014-12-03 2016-06-09 International Business Machines Corporation Clone data management
WO2016124959A1 (en) 2015-02-05 2016-08-11 Hitachi Data Systems Engineering UK Limited Management of cloned objects in file systems
US20160335198A1 (en) * 2015-05-12 2016-11-17 Apple Inc. Methods and system for maintaining an indirection system for a mass storage device
CN104933133B (zh) * 2015-06-12 2018-09-07 中国科学院计算技术研究所 分布式文件系统中的元数据快照存储和访问方法
US10515054B2 (en) 2015-06-19 2019-12-24 Hitachi Vantara Corporation Fast and efficient multi-threaded algorithm for deleting an arbitrarily wide and deep directory tree using limited system resources
WO2017005330A1 (en) 2015-07-09 2017-01-12 Hitachi Data Systems Engineering UK Limited Storage control system managing file-level and block-level storage services, and methods for controlling such storage control system
CN104980591B (zh) * 2015-07-10 2017-08-29 上海斐讯数据通信技术有限公司 一种用于移动终端的多系统切换方法
US10747753B2 (en) 2015-08-28 2020-08-18 Swirlds, Inc. Methods and apparatus for a distributed database within a network
US9390154B1 (en) 2015-08-28 2016-07-12 Swirlds, Inc. Methods and apparatus for a distributed database within a network
US10019193B2 (en) * 2015-11-04 2018-07-10 Hewlett Packard Enterprise Development Lp Checkpointing a journal by virtualization of non-volatile random access memory
CN107046811A (zh) * 2015-12-03 2017-08-15 华为技术有限公司 一种源存储设备发送源文件和源文件的克隆文件至备份存储设备的方法、源存储设备以及备份存储设备
US9413826B1 (en) 2016-01-11 2016-08-09 International Business Machines Corporation Concurrent file and object protocol access using space-efficient cloning
US10606803B2 (en) 2016-06-28 2020-03-31 Netapp, Inc. Data cloning in memory-based file systems
RU2746446C2 (ru) 2016-11-10 2021-04-14 Свирлдз, Инк. Способы и устройство для распределенной базы данных, содержащей анонимные входные данные
AU2017382161B2 (en) 2016-12-19 2022-07-07 Hedera Hashgraph, Llc Methods and apparatus for a distributed database that enables deletion of events
US11169889B1 (en) * 2017-05-05 2021-11-09 Open Invention Network Llc Systems, devices and methods for determining and reclaiming snapshot storage consumption in data storage systems
US11188422B2 (en) 2017-06-02 2021-11-30 Apple Inc. Techniques for preserving clone relationships between files
US10416928B2 (en) 2017-06-15 2019-09-17 Hitachi, Ltd. Data storage system and process for data compression of distributed data in a scalable cluster system and computer program for such data storage system
CN107291883B (zh) * 2017-06-20 2020-09-18 苏州浪潮智能科技有限公司 一种分布式存储系统的快照方法及装置
CN110892396B (zh) 2017-07-11 2023-11-24 海德拉哈希图有限责任公司 用于在网络内高效地实现分布式数据库的方法和设备
US10489385B2 (en) * 2017-11-01 2019-11-26 Swirlds, Inc. Methods and apparatus for efficiently implementing a fast-copyable database
CN107908727B (zh) * 2017-11-14 2021-06-29 郑州云海信息技术有限公司 存储对象克隆方法、装置、设备及计算机可读存储介质
US10671411B2 (en) * 2018-05-29 2020-06-02 Sap Se Cloning for object-oriented environment
CN109445989A (zh) * 2018-10-22 2019-03-08 郑州云海信息技术有限公司 一种文件系统数据备份方法及装置
CN111382006B (zh) * 2018-12-27 2023-04-07 中国移动通信集团四川有限公司 操作系统的恢复方法、装置、设备及介质
CN110109588B (zh) * 2019-04-23 2022-03-11 深圳易帆互动科技有限公司 基于Unity的无限拖拉循环列表显示方法和系统
KR20220011161A (ko) 2019-05-22 2022-01-27 스월즈, 인크. 분산 데이터베이스에서 상태 증명들 및 원장 식별자들을 구현하기 위한 방법들 및 장치
CN110532136B (zh) * 2019-08-30 2023-05-02 四川效率源信息安全技术股份有限公司 一种基于元数据的raid数据恢复方法
CN111007990B (zh) * 2019-12-24 2023-09-19 曙光信息产业(北京)有限公司 一种对快照系统中数据块引用进行快速定位的定位方法
WO2021155857A1 (en) * 2020-02-07 2021-08-12 Huawei Technologies Co., Ltd. Fast file snapshots and clones
US11461281B2 (en) 2020-04-20 2022-10-04 Netapp Inc. Freeing pages within persistent memory
US11847028B2 (en) 2020-07-03 2023-12-19 Vmware, Inc. Efficient export of snapshot changes in a storage system
KR20230107561A (ko) 2020-10-06 2023-07-17 헤데라 하쉬그라프, 엘엘씨 네트워크 내의 분산 데이터베이스를 위한 방법들 및 장치
CN112256481B (zh) * 2020-10-26 2024-09-20 华泰证券股份有限公司 一种敏捷开发中数据恢复方法及系统
US11513899B2 (en) 2020-11-30 2022-11-29 International Business Machines Corporation Selectively capturing snapshots of volumes based on modified capacity
US11494334B2 (en) * 2020-12-11 2022-11-08 Vmware Inc. Embedded reference counts for file clones
US11537555B2 (en) * 2020-12-15 2022-12-27 EMC IP Holding Company LLC Managing network shares utilizing filesystem snapshots comprising metadata characterizing network shares
CN112667580A (zh) * 2021-01-04 2021-04-16 北京同有飞骥科技股份有限公司 一种在GPFS上的worm技术应用方法及系统
US12124417B2 (en) 2021-01-22 2024-10-22 Scality, S.A. Fast and efficient storage system implemented with multiple cloud services
WO2023241116A1 (zh) * 2022-06-16 2023-12-21 华为技术有限公司 数据处理方法及相关装置
US11995042B1 (en) * 2023-01-11 2024-05-28 Dell Products L.P. Fast recovery for replication corruptions
CN116955520B (zh) * 2023-06-16 2025-09-16 珠海亿智电子科技有限公司 一种高性能只读文件系统的创建方法及装置
US12105670B1 (en) * 2023-06-29 2024-10-01 Microsoft Technology Licensing, Llc Performing snapshotting operations using data structures storing weak references
CN117707438B (zh) * 2024-02-06 2024-05-14 成都艾勃科技有限公司 一种分区增量克隆的方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101178677A (zh) * 2007-11-09 2008-05-14 中国科学院计算技术研究所 一种计算机文件系统的快照方法
CN101710323A (zh) * 2008-09-11 2010-05-19 威睿公司 计算机存储去复制操作
CN101743546A (zh) * 2007-08-06 2010-06-16 国际商业机器公司 用于提供快照的文件系统的分层存储管理

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3751018B2 (ja) * 1993-06-03 2006-03-01 ネットワーク・アプライアンス・インコーポレイテッド ライトエニウエアファイルシステムレイアウト
US5963962A (en) * 1995-05-31 1999-10-05 Network Appliance, Inc. Write anywhere file-system layout
US6829617B2 (en) * 2002-02-15 2004-12-07 International Business Machines Corporation Providing a snapshot of a subset of a file system
US6993539B2 (en) * 2002-03-19 2006-01-31 Network Appliance, Inc. System and method for determining changes in two snapshots and for transmitting changes to destination snapshot
US6934822B2 (en) * 2002-08-06 2005-08-23 Emc Corporation Organization of multiple snapshot copies in a data storage system
US7457822B1 (en) * 2002-11-01 2008-11-25 Bluearc Uk Limited Apparatus and method for hardware-based file system
US6883074B2 (en) * 2002-12-13 2005-04-19 Sun Microsystems, Inc. System and method for efficient write operations for repeated snapshots by copying-on-write to most recent snapshot
US7035881B2 (en) * 2003-09-23 2006-04-25 Emc Corporation Organization of read-write snapshot copies in a data storage system
US7133985B1 (en) 2003-09-29 2006-11-07 Emc Corporation System and method for managing data associated with copying and replication procedures in a data storage environment
US7337198B1 (en) 2004-02-10 2008-02-26 Symantec Corporation In-place preservation of file system objects during a disk clone operation
US7334095B1 (en) * 2004-04-30 2008-02-19 Network Appliance, Inc. Writable clone of read-only volume
US7334094B2 (en) * 2004-04-30 2008-02-19 Network Appliance, Inc. Online clone volume splitting technique
US7409511B2 (en) * 2004-04-30 2008-08-05 Network Appliance, Inc. Cloning technique for efficiently creating a copy of a volume in a storage system
US7757056B1 (en) * 2005-03-16 2010-07-13 Netapp, Inc. System and method for efficiently calculating storage required to split a clone volume
US7546431B2 (en) * 2005-03-21 2009-06-09 Emc Corporation Distributed open writable snapshot copy facility using file migration policies
US7159072B2 (en) * 2005-03-24 2007-01-02 Hitachi, Ltd. Method and apparatus for monitoring the quantity of differential data in a storage system
US8549051B2 (en) * 2005-11-04 2013-10-01 Oracle America, Inc. Unlimited file system snapshots and clones
US8112465B2 (en) * 2007-10-12 2012-02-07 Bluearc Uk Limited System, device, and method for validating data structures in a storage system
US9767120B2 (en) * 2008-01-16 2017-09-19 Hitachi Data Systems Engineering UK Limited Multi-way checkpoints in a data storage system
US8548953B2 (en) * 2007-11-12 2013-10-01 F5 Networks, Inc. File deduplication using storage tiers
US20090204650A1 (en) 2007-11-15 2009-08-13 Attune Systems, Inc. File Deduplication using Copy-on-Write Storage Tiers
JP2009181206A (ja) * 2008-01-29 2009-08-13 Hitachi Ltd ストレージシステム及びスナップショット構成の移行方法
US8099572B1 (en) * 2008-09-30 2012-01-17 Emc Corporation Efficient backup and restore of storage objects in a version set
EP2593868B1 (en) 2010-11-22 2015-02-18 Hitachi Data Systems Engineering UK Limited Method and apparatus for cloning a filesystem object in a data storage system
US8832035B2 (en) * 2011-08-30 2014-09-09 Netapp, Inc. System and method for retaining deduplication in a storage object after a clone split operation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101743546A (zh) * 2007-08-06 2010-06-16 国际商业机器公司 用于提供快照的文件系统的分层存储管理
CN101178677A (zh) * 2007-11-09 2008-05-14 中国科学院计算技术研究所 一种计算机文件系统的快照方法
CN101710323A (zh) * 2008-09-11 2010-05-19 威睿公司 计算机存储去复制操作

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11748300B2 (en) * 2021-11-18 2023-09-05 Vmware, Inc. Reverse deletion of a chain of snapshots
TWI860122B (zh) * 2023-10-12 2024-10-21 技嘉科技股份有限公司 編號式檔案的資料結構、交握方法及交握系統

Also Published As

Publication number Publication date
EP2593868A1 (en) 2013-05-22
US9760579B2 (en) 2017-09-12
US8738570B2 (en) 2014-05-27
US20140229443A1 (en) 2014-08-14
US9087072B2 (en) 2015-07-21
CN103221924A (zh) 2013-07-24
JP2014506345A (ja) 2014-03-13
JP5948340B2 (ja) 2016-07-06
CN105843905A (zh) 2016-08-10
US20160246814A1 (en) 2016-08-25
US20120130949A1 (en) 2012-05-24
EP2787439A1 (en) 2014-10-08
WO2012071335A1 (en) 2012-05-31
EP2787439B1 (en) 2016-04-27
EP2593868B1 (en) 2015-02-18
US9336229B2 (en) 2016-05-10
CN103221924B (zh) 2016-03-30
US20150112932A1 (en) 2015-04-23

Similar Documents

Publication Publication Date Title
CN105843905B (zh) 用于管理文件系统中的文件系统对象的设备和方法
EP3814931B1 (en) Fast migration of metadata
US11914485B2 (en) Restoration of specified content from an archive
US8010503B1 (en) System and method for restoring a single data stream file from a snapshot
JP4568115B2 (ja) ハードウェアベースのファイルシステムのための装置および方法
JP5657550B2 (ja) 分散ストレージシステムにおけるデータのアトミックな複合変形
CN110096891B (zh) 对象库中的对象签名
US7475098B2 (en) System and method for managing a plurality of snapshots
JP2719464B2 (ja) ファイル管理システム
US10311152B2 (en) System for queue based object cloning
US9767120B2 (en) Multi-way checkpoints in a data storage system
JPH0769922B2 (ja) メモリ空間再使用管理方法及びシステム
WO2016050315A1 (en) Method and an apparatus, and related computer-program products, for managing access request in multi-tenancy environments
WO2010050943A1 (en) Creating snapshots of a file system
US20250370957A1 (en) Efficient creation of bucket-level snapshots and efficient snapshot protection determination

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20190425

Address after: American California

Applicant after: Hitachi Data Management Co. Ltd.

Address before: Burke County, England

Applicant before: HITACHI DATA SYSTEM ENGINEERING UK LTD.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant