CN110945486A - 一种存储碎片管理方法及终端 - Google Patents

一种存储碎片管理方法及终端 Download PDF

Info

Publication number
CN110945486A
CN110945486A CN201880048691.9A CN201880048691A CN110945486A CN 110945486 A CN110945486 A CN 110945486A CN 201880048691 A CN201880048691 A CN 201880048691A CN 110945486 A CN110945486 A CN 110945486A
Authority
CN
China
Prior art keywords
segment
terminal
aging degree
segments
source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201880048691.9A
Other languages
English (en)
Other versions
CN110945486B (zh
Inventor
俞超
陈浩
童碧峰
郑成亮
周喜渝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN110945486A publication Critical patent/CN110945486A/zh
Application granted granted Critical
Publication of CN110945486B publication Critical patent/CN110945486B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0643—Management of files
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647—Migration mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0674—Disk device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7205—Cleaning, compaction, garbage collection, erase control
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本申请提供一种存储碎片管理方法及终端，可以应用于终端的文件系统中，该文件系统包括至少一个段，该方法包括：终端先根据段的老化程度和段的有效块占比，从该文件系统中确定出源段；然后终端根据源段的老化程度，从所述文件系统中确定出与该源段的老化程度一致的目标段。最后，终端将该源段中的有效块的数据搬移该目标段的空闲块中。该方法用以解决现有日志结构化文件系统对存储碎片进行数据搬移存在功耗大的问题。

Description

PCT国内申请，说明书已公开。

Claims (21)

  1. PCT国内申请，权利要求书已公开。
CN201880048691.9A 2018-06-30 2018-06-30 一种存储碎片管理方法及终端 Active CN110945486B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/093930 WO2020000492A1 (zh) 2018-06-30 2018-06-30 一种存储碎片管理方法及终端

Publications (2)

Publication Number Publication Date
CN110945486A true CN110945486A (zh) 2020-03-31
CN110945486B CN110945486B (zh) 2022-06-10

Family

ID=68984611

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880048691.9A Active CN110945486B (zh) 2018-06-30 2018-06-30 一种存储碎片管理方法及终端

Country Status (4)

Country Link
US (1) US11842046B2 (zh)
EP (1) EP3789883A4 (zh)
CN (1) CN110945486B (zh)
WO (1) WO2020000492A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116049021A (zh) * 2022-08-29 2023-05-02 荣耀终端有限公司 存储空间管理方法、电子设备及计算机可读存储介质
CN116049113A (zh) * 2022-08-29 2023-05-02 荣耀终端有限公司 文件系统的整理方法、电子设备及计算机可读存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113961517A (zh) * 2020-07-21 2022-01-21 中兴通讯股份有限公司 文件系统管理方法、电子设备及存储介质
CN114063886A (zh) * 2020-07-31 2022-02-18 伊姆西Ip控股有限责任公司 用于存储管理的方法、电子设备和计算机程序产品
KR20230106915A (ko) * 2022-01-07 2023-07-14 삼성전자주식회사 스토리지 장치의 구동 방법, 및 스토리지 장치
US11947452B2 (en) * 2022-06-01 2024-04-02 Micron Technology, Inc. Controlling variation of valid data counts in garbage collection source blocks
CN116701298B (zh) * 2022-11-22 2024-06-07 荣耀终端有限公司 一种文件系统管理方法及电子设备

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101013397A (zh) * 2007-02-08 2007-08-08 深圳万利达电子工业有限公司 一种nandflash文件系统实现方法
CN101339808A (zh) * 2008-07-28 2009-01-07 华中科技大学 存储块的擦除方法及装置
CN101364166A (zh) * 2008-09-23 2009-02-11 杭州华三通信技术有限公司 将2048字节页的Nand Flash模拟成硬盘的方法和装置
US20100185802A1 (en) * 2009-01-21 2010-07-22 Micron Technology, Inc. Solid state memory formatting
US20130117501A1 (en) * 2011-11-07 2013-05-09 Samsung Electronics Co., Ltd. Garbage collection method for nonvolatile memory device
CN107025178A (zh) * 2015-09-22 2017-08-08 三星电子株式会社 存储器控制器、非易失性存储器系统及其操作方法
US20170255636A1 (en) * 2016-03-02 2017-09-07 Electronics And Telecommunications Research Institute Method and system for storing metadata of log-structured file system
CN107145452A (zh) * 2017-05-25 2017-09-08 努比亚技术有限公司 碎片整理的方法、终端设备及计算机可读存储介质
CN107533506A (zh) * 2015-05-06 2018-01-02 华为技术有限公司 日志结构化文件系统中的垃圾回收方法和设备

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9767032B2 (en) 2012-01-12 2017-09-19 Sandisk Technologies Llc Systems and methods for cache endurance
US8898376B2 (en) 2012-06-04 2014-11-25 Fusion-Io, Inc. Apparatus, system, and method for grouping data stored on an array of solid-state storage elements
KR102033323B1 (ko) * 2014-03-05 2019-10-17 한국전자통신연구원 플래시 메모리에서 사용하는 로그 구조 파일시스템의 메타데이터 저장 방법
US9600409B2 (en) 2014-08-29 2017-03-21 EMC IP Holding Company LLC Method and system for garbage collection in a storage system based on longevity of stored data
CN106293497B (zh) 2015-05-27 2019-03-19 华为技术有限公司 瓦记录感知文件系统中垃圾数据的回收方法和装置
CN104933169B (zh) 2015-06-29 2018-05-01 南开大学 基于热点文件优先的文件系统碎片整理方法
CN105095529A (zh) 2015-09-30 2015-11-25 深圳天珑无线科技有限公司 软件的垃圾内容清理方法、装置及终端
EP3350703A1 (en) 2015-10-19 2018-07-25 Huawei Technologies Co., Ltd. Method and device for determination of garbage collector thread number and activity management in log-structured file systems
US20170139825A1 (en) * 2015-11-17 2017-05-18 HGST Netherlands B.V. Method of improving garbage collection efficiency of flash-oriented file systems using a journaling approach
CN106502587B (zh) 2016-10-19 2019-10-25 华为技术有限公司 硬盘数据管理方法和硬盘控制装置
CN107885458B (zh) 2017-09-28 2021-03-30 努比亚技术有限公司 一种磁盘碎片的整理方法、终端和计算机可读存储介质

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101013397A (zh) * 2007-02-08 2007-08-08 深圳万利达电子工业有限公司 一种nandflash文件系统实现方法
CN101339808A (zh) * 2008-07-28 2009-01-07 华中科技大学 存储块的擦除方法及装置
CN101364166A (zh) * 2008-09-23 2009-02-11 杭州华三通信技术有限公司 将2048字节页的Nand Flash模拟成硬盘的方法和装置
US20100185802A1 (en) * 2009-01-21 2010-07-22 Micron Technology, Inc. Solid state memory formatting
US20130117501A1 (en) * 2011-11-07 2013-05-09 Samsung Electronics Co., Ltd. Garbage collection method for nonvolatile memory device
CN107533506A (zh) * 2015-05-06 2018-01-02 华为技术有限公司 日志结构化文件系统中的垃圾回收方法和设备
CN107025178A (zh) * 2015-09-22 2017-08-08 三星电子株式会社 存储器控制器、非易失性存储器系统及其操作方法
US20170255636A1 (en) * 2016-03-02 2017-09-07 Electronics And Telecommunications Research Institute Method and system for storing metadata of log-structured file system
CN107145452A (zh) * 2017-05-25 2017-09-08 努比亚技术有限公司 碎片整理的方法、终端设备及计算机可读存储介质

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116049021A (zh) * 2022-08-29 2023-05-02 荣耀终端有限公司 存储空间管理方法、电子设备及计算机可读存储介质
CN116049113A (zh) * 2022-08-29 2023-05-02 荣耀终端有限公司 文件系统的整理方法、电子设备及计算机可读存储介质
CN116049021B (zh) * 2022-08-29 2023-10-20 荣耀终端有限公司 存储空间管理方法、电子设备及计算机可读存储介质
CN116049113B (zh) * 2022-08-29 2023-10-20 荣耀终端有限公司 文件系统的整理方法、电子设备及计算机可读存储介质

Also Published As

Publication number Publication date
CN110945486B (zh) 2022-06-10
EP3789883A1 (en) 2021-03-10
US20210223958A1 (en) 2021-07-22
WO2020000492A1 (zh) 2020-01-02
EP3789883A4 (en) 2021-05-12
US11842046B2 (en) 2023-12-12

Similar Documents

Publication Publication Date Title
CN110945486B (zh) 一种存储碎片管理方法及终端
US8880784B2 (en) Random write optimization techniques for flash disks
CN102782683B (zh) 用于数据库服务器的缓冲池扩展
CN107491523B (zh) 存储数据对象的方法及装置
CN107391774B (zh) 基于重复数据删除的日志文件系统的垃圾回收方法
CN107943718B (zh) 一种清理缓存文件的方法和装置
CN111198856B (zh) 文件管理方法、装置、计算机设备和存储介质
CN108733306B (zh) 一种文件合并方法及装置
TW201301030A (zh) 在一記憶體裝置中減少次要位址表檢查之快速轉譯指示器
CN112131140B (zh) 基于ssd的支持高效存储空间管理的键值分离存储方法
US20170103024A1 (en) Information processing apparatus and cache control method
CN108108089B (zh) 一种图片加载方法及装置
CN111831691B (zh) 一种数据读写方法及装置、电子设备、存储介质
CN105376269A (zh) 虚拟机存储系统及其实现方法和装置
CN112148736A (zh) 缓存数据的方法、设备及存储介质
CN115756317A (zh) 叠瓦式磁盘的存储方法、存储装置、电子设备及存储介质
US9851925B2 (en) Data allocation control apparatus and data allocation control method
CN102981964B (zh) 数据存储空间的管理方法及系统
CN114296630B (zh) 机器可读存储介质、数据存储系统和数据存储系统的方法
CN115421648A (zh) 内存垃圾回收方法、装置、设备、存储介质和程序产品
CN116821076A (zh) 一种基于电子设备的文件查找方法和装置
CN114461405B (zh) 一种内存中锁定页面的存储方法及相关装置
CN117632953B (zh) 数据循环存储方法、装置、服务器及存储介质
CN112997162A (zh) 一种删除内存中索引项的方法、装置
CN110569261A (zh) 一种用于更新高速缓存区中所存储的资源的方法和装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant