CN105264497A - 一种文件管理方法及文件系统 - Google Patents

一种文件管理方法及文件系统 Download PDF

Info

Publication number
CN105264497A
CN105264497A CN201480001249.2A CN201480001249A CN105264497A CN 105264497 A CN105264497 A CN 105264497A CN 201480001249 A CN201480001249 A CN 201480001249A CN 105264497 A CN105264497 A CN 105264497A
Authority
CN
China
Prior art keywords
file
storage medium
access
management strategy
manage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201480001249.2A
Other languages
English (en)
Other versions
CN105264497B (zh
Inventor
徐君
朱冠宇
罗彩珠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN105264497A publication Critical patent/CN105264497A/zh
Application granted granted Critical
Publication of CN105264497B publication Critical patent/CN105264497B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/122—File system administration, e.g. details of archiving or snapshots using management policies
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1847—File system types specifically adapted to static storage, e.g. adapted to flash memory or SSD
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/185—Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647—Migration mechanisms
    • G06F3/0649—Lifecycle management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0688—Non-volatile semiconductor memory arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Stored Programmes (AREA)
  • Storage Device Security (AREA)

Abstract

一种文件管理方法及文件系统，应用于数据处理技术领域。文件系统会监控对文件操作的IO访问信息，然后确定对该文件的IO访问模式，并根据IO访问模式确定对应的文件管理策略；最后在得到的文件管理策略与文件的当前管理方式不一致时，根据确定的文件管理策略调整文件的当前管理方式，比如存储介质和文件管理粒度，从而实现根据文件的IO访问模式动态调整文件的存储介质和文件管理粒度。

Description

PCT国内申请，说明书已公开。

Claims (1)

  1. PCT国内申请，权利要求书已公开。
CN201480001249.2A 2014-04-22 2014-04-22 一种文件管理方法及文件系统 Active CN105264497B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/075939 WO2015161443A1 (zh) 2014-04-22 2014-04-22 一种文件管理方法及文件系统

Publications (2)

Publication Number Publication Date
CN105264497A true CN105264497A (zh) 2016-01-20
CN105264497B CN105264497B (zh) 2020-04-21

Family

ID=54331584

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480001249.2A Active CN105264497B (zh) 2014-04-22 2014-04-22 一种文件管理方法及文件系统

Country Status (7)

Country Link
US (1) US10339100B2 (zh)
EP (1) EP3125124B1 (zh)
JP (1) JP6378364B2 (zh)
KR (1) KR101914260B1 (zh)
CN (1) CN105264497B (zh)
BR (1) BR112016024412B1 (zh)
WO (1) WO2015161443A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112534415A (zh) * 2018-08-10 2021-03-19 美光科技公司 非易失性存储器中的数据有效性跟踪
CN114816749A (zh) * 2022-04-22 2022-07-29 江苏华存电子科技有限公司 一种用于内存的智能化管理方法及系统

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106294735A (zh) * 2016-08-09 2017-01-04 广州酷狗计算机科技有限公司 一种基于缓存的网页访问方法和装置

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1613064A (zh) * 2002-01-03 2005-05-04 英特尔公司 用于动态调整存储器页面关闭策略的方法
US20050182896A1 (en) * 2004-02-13 2005-08-18 Samsung Electronics Co., Ltd. Method of adaptively controlling data access by data storage system and disk drive using the method
US20060080371A1 (en) * 2004-04-23 2006-04-13 Wong Chi M Storage policy monitoring for a storage network
CN101676857A (zh) * 2005-09-22 2010-03-24 株式会社日立制作所 存储系统
CN102523285A (zh) * 2011-12-15 2012-06-27 杭州电子科技大学 一种基于对象分布式文件系统的存储缓存方法
CN102714047A (zh) * 2009-11-13 2012-10-03 国际商业机器公司 控制数据写入的装置及方法
US20120290779A1 (en) * 2009-09-08 2012-11-15 International Business Machines Corporation Data management in solid-state storage devices and tiered storage systems
CN103049713A (zh) * 2012-12-20 2013-04-17 华为技术有限公司 对存储设备中数据进行巡检的方法、设备及系统
WO2013071882A1 (zh) * 2011-11-17 2013-05-23 华为技术有限公司 用于机群文件系统的元数据存储系统和管理方法
CN103136111A (zh) * 2011-11-29 2013-06-05 群联电子股份有限公司 数据写入方法、存储器控制器与存储器储存装置
US8566549B1 (en) * 2008-12-31 2013-10-22 Emc Corporation Synchronizing performance requirements across multiple storage platforms
US20130283000A1 (en) * 2007-08-21 2013-10-24 Hitachi, Ltd. Storage System Comprising Function for Changing Data Storage Mode Using Logical Volume Pair

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US776967A (en) 1904-05-18 1904-12-06 James H Van Tassel Sharpener for shears.
US5960181A (en) * 1995-12-22 1999-09-28 Ncr Corporation Computer performance modeling system and method
GB9606927D0 (en) 1996-04-02 1996-06-05 Memory Corp Plc Data storage devices
US8099758B2 (en) * 1999-05-12 2012-01-17 Microsoft Corporation Policy based composite file system and method
EP1805665B1 (en) * 2004-09-30 2018-03-28 Cisco Technology, Inc. Storage policy monitoring for a storage network
US7363440B1 (en) * 2004-12-30 2008-04-22 Unisys Corporation System and method for dynamically accessing memory while under normal functional operating conditions
JP4943081B2 (ja) 2006-07-27 2012-05-30 株式会社日立製作所 ファイル格納制御装置及び方法
US7599972B2 (en) 2006-08-25 2009-10-06 Qnx Software Systems Gmbh & Co. Kg File system having variable logical storage block size
US8732800B1 (en) * 2007-03-26 2014-05-20 Jerry Askew Systems and methods for centralized management of policies and access controls
US7853669B2 (en) 2007-05-04 2010-12-14 Microsoft Corporation Mesh-managing data across a distributed set of devices
WO2009102425A1 (en) * 2008-02-12 2009-08-20 Netapp, Inc. Hybrid media storage system architecture
GB2458568B (en) * 2008-03-27 2012-09-19 Covertix Ltd System and method for dynamically enforcing security policies on electronic files
JP5192932B2 (ja) 2008-07-23 2013-05-08 株式会社日立製作所 ストレージシステム内の論理ユニットを論理ボリュームに割り当てる方法及び記憶制御装置
EP2215913A1 (en) * 2009-01-23 2010-08-11 Nutreco Nederland B.V. Animal feed additive and animal feed comprising alkyl esters of medium chain fatty acids, and their use in animal feed
US20100306180A1 (en) * 2009-01-28 2010-12-02 Digitiliti, Inc. File revision management
US9021229B2 (en) 2010-04-14 2015-04-28 International Business Machines Corporation Optimizing a file system for different types of applications in a compute cluster using dynamic block size granularity
JP5600517B2 (ja) * 2010-08-18 2014-10-01 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
US9043530B1 (en) * 2012-04-09 2015-05-26 Netapp, Inc. Data storage within hybrid storage aggregate

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1613064A (zh) * 2002-01-03 2005-05-04 英特尔公司 用于动态调整存储器页面关闭策略的方法
US20050182896A1 (en) * 2004-02-13 2005-08-18 Samsung Electronics Co., Ltd. Method of adaptively controlling data access by data storage system and disk drive using the method
US20060080371A1 (en) * 2004-04-23 2006-04-13 Wong Chi M Storage policy monitoring for a storage network
CN101676857A (zh) * 2005-09-22 2010-03-24 株式会社日立制作所 存储系统
US20130283000A1 (en) * 2007-08-21 2013-10-24 Hitachi, Ltd. Storage System Comprising Function for Changing Data Storage Mode Using Logical Volume Pair
US8566549B1 (en) * 2008-12-31 2013-10-22 Emc Corporation Synchronizing performance requirements across multiple storage platforms
US20120290779A1 (en) * 2009-09-08 2012-11-15 International Business Machines Corporation Data management in solid-state storage devices and tiered storage systems
CN102714047A (zh) * 2009-11-13 2012-10-03 国际商业机器公司 控制数据写入的装置及方法
WO2013071882A1 (zh) * 2011-11-17 2013-05-23 华为技术有限公司 用于机群文件系统的元数据存储系统和管理方法
CN103136111A (zh) * 2011-11-29 2013-06-05 群联电子股份有限公司 数据写入方法、存储器控制器与存储器储存装置
CN102523285A (zh) * 2011-12-15 2012-06-27 杭州电子科技大学 一种基于对象分布式文件系统的存储缓存方法
CN103049713A (zh) * 2012-12-20 2013-04-17 华为技术有限公司 对存储设备中数据进行巡检的方法、设备及系统

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JOSE5 G. DELGADO-F’RIAS, ANDY YU, AND JABULANI NYATHI: "A dynamic content addressable memory using a 4-transistor cell", 《PROCEEDINGS OF THE THIRD INTERNATIONAL WORKSHOP ON DESIGN OF MIXED-MODE INTEGRATED CIRCUITS AND APPLICATIONS (CAT. NO.99EX303)》 *
杨洁冰: "自动分层存储技术及其应用", <<中国优秀硕士论文全文数据库（信息科技辑）>> *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112534415A (zh) * 2018-08-10 2021-03-19 美光科技公司 非易失性存储器中的数据有效性跟踪
CN112534415B (zh) * 2018-08-10 2022-04-01 美光科技公司 非易失性存储器中的数据有效性跟踪
US11586561B2 (en) 2018-08-10 2023-02-21 Micron Technology, Inc. Data validity tracking in a non-volatile memory
CN114816749A (zh) * 2022-04-22 2022-07-29 江苏华存电子科技有限公司 一种用于内存的智能化管理方法及系统

Also Published As

Publication number Publication date
WO2015161443A1 (zh) 2015-10-29
EP3125124B1 (en) 2021-01-13
CN105264497B (zh) 2020-04-21
BR112016024412A2 (pt) 2018-06-26
KR20160145743A (ko) 2016-12-20
US10339100B2 (en) 2019-07-02
EP3125124A1 (en) 2017-02-01
KR101914260B1 (ko) 2019-01-14
EP3125124A4 (en) 2017-04-19
JP6378364B2 (ja) 2018-08-22
US20170039203A1 (en) 2017-02-09
JP2017514234A (ja) 2017-06-01
BR112016024412B1 (pt) 2022-10-18

Similar Documents

Publication Publication Date Title
WO2020038186A1 (zh) 数据迁移方法、装置及存储设备
DE102020106971A1 (de) Datenschreibverwaltung im nichtflüchtigen speicher
US9996557B2 (en) Database storage system based on optical disk and method using the system
US20060218365A1 (en) Method and apparatus for mirroring objects between storage systems
EP2735978A1 (en) Storage system and management method used for metadata of cluster file system
CN107832423B (zh) 一种用于分布式文件系统的文件读写方法
GB2377284A (en) Storage system with a point in time copy function
CN104246722A (zh) 用于基于哈希表排除数据重复的存储系统,存储控制器及方法
JPWO2008072590A1 (ja) ライトワンス記録装置、コントローラ、アクセス装置、及びライトワンス記録システム
DE112012004571T5 (de) Unterstützen von unvollständigen Datensegmenten in Flash-Cache-Speichern
CN108399050B (zh) 一种数据处理方法及装置
WO2015007155A1 (zh) 一种数据存储方法及装置
JP2009003934A (ja) データ管理システム及びデータ管理方法、並びにデータ管理方法を実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体
CN102902709A (zh) 一种固定空间分配的文件存储系统及实现方法
CN102609492B (zh) 一种支持表模式可变的元数据管理方法
CN107122223B (zh) 数据迁移方法及装置
CN107577549A (zh) 一种存储重删功能的测试方法
CN104572492A (zh) 一种烧录数据到fat32分区的方法和装置
CN105264497A (zh) 一种文件管理方法及文件系统
US20090030954A1 (en) Management of multiple virtual data copies
CN107430546A (zh) 一种文件更新方法及存储设备
CN110109866A (zh) 一种文件系统目录的管理方法及设备
US20100217787A1 (en) Controller, information recording device, access device, information recording system, and information recording method
CN115328859A (zh) 一种元数据访问方法、装置、设备及介质
CN113127415B (zh) 实时流文件的处理方法、装置、介质及电子设备

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant