CN106874213B - 一种融合多种机器学习算法的固态硬盘热数据识别方法 - Google Patents
一种融合多种机器学习算法的固态硬盘热数据识别方法 Download PDFInfo
- Publication number
- CN106874213B CN106874213B CN201710022404.4A CN201710022404A CN106874213B CN 106874213 B CN106874213 B CN 106874213B CN 201710022404 A CN201710022404 A CN 201710022404A CN 106874213 B CN106874213 B CN 106874213B
- Authority
- CN
- China
- Prior art keywords
- request
- classified
- lpn
- hot data
- neighbor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
- G06F12/023—Free address space management
- G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
- G06F12/023—Free address space management
- G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
- G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- G06F18/232—Non-hierarchical techniques
- G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
- G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
- G06F18/24147—Distances to closest patterns, e.g. nearest neighbour classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Probability & Statistics with Applications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710022404.4A CN106874213B (zh) | 2017-01-12 | 2017-01-12 | 一种融合多种机器学习算法的固态硬盘热数据识别方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710022404.4A CN106874213B (zh) | 2017-01-12 | 2017-01-12 | 一种融合多种机器学习算法的固态硬盘热数据识别方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106874213A CN106874213A (zh) | 2017-06-20 |
CN106874213B true CN106874213B (zh) | 2020-03-20 |
Family
ID=59158508
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710022404.4A Active CN106874213B (zh) | 2017-01-12 | 2017-01-12 | 一种融合多种机器学习算法的固态硬盘热数据识别方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106874213B (zh) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108985373B (zh) * | 2018-07-12 | 2021-09-14 | 中国人民解放军陆军炮兵防空兵学院郑州校区 | 一种多传感器数据加权融合方法 |
CN109284233B (zh) * | 2018-09-18 | 2022-02-18 | 郑州云海信息技术有限公司 | 一种存储系统的垃圾回收方法及相关装置 |
CN109656696B (zh) * | 2018-12-03 | 2020-10-16 | 华南师范大学 | 一种数据api高效调用的处理方法 |
CN110275677B (zh) | 2019-05-22 | 2022-04-12 | 华为技术有限公司 | 硬盘格式转换方法、装置及存储设备 |
US11321636B2 (en) | 2019-07-18 | 2022-05-03 | Innogrit Technologies Co., Ltd. | Systems and methods for a data storage system |
CN111026673B (zh) * | 2019-11-19 | 2023-05-05 | 中国航空工业集团公司西安航空计算技术研究所 | 一种nand flash垃圾回收动态优化方法 |
CN111459900B (zh) * | 2020-04-22 | 2023-07-18 | 广州虎牙科技有限公司 | 大数据生命周期设置方法、装置、存储介质及服务器 |
CN112052190B (zh) * | 2020-09-03 | 2022-08-30 | 杭州电子科技大学 | 一种基于布隆过滤器和二级lru表的固态硬盘热数据识别方法 |
CN112463074B (zh) * | 2020-12-14 | 2023-01-10 | 苏州浪潮智能科技有限公司 | 一种数据分类存储方法、系统、终端及存储介质 |
CN114168824A (zh) * | 2021-12-10 | 2022-03-11 | 中南大学 | 基于机器学习的冷热数据分离方法、系统、设备及介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102073594A (zh) * | 2010-11-26 | 2011-05-25 | 钰创科技股份有限公司 | 衰减热数据的方法 |
CN102799534A (zh) * | 2012-07-18 | 2012-11-28 | 上海宝存信息科技有限公司 | 基于固态存储介质的存储系统及方法、冷热数据识别方法 |
CN103631538A (zh) * | 2013-12-05 | 2014-03-12 | 华为技术有限公司 | 冷热数据识别门限值计算方法、装置和系统 |
CN104881369A (zh) * | 2015-05-11 | 2015-09-02 | 中国人民解放军国防科学技术大学 | 面向混合存储系统的低内存开销热点数据识别方法 |
CN104951403A (zh) * | 2015-07-06 | 2015-09-30 | 中国科学技术大学 | 一种低开销且无差错的冷热数据识别方法 |
CN105556485A (zh) * | 2013-04-04 | 2016-05-04 | 爱思开海力士有限公司 | 基于相邻体和基于动态热阈值的热数据识别 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20130031046A (ko) * | 2011-09-20 | 2013-03-28 | 삼성전자주식회사 | 플래시 메모리 장치 및 플래시 메모리 장치의 데이터 관리 방법 |
-
2017
- 2017-01-12 CN CN201710022404.4A patent/CN106874213B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102073594A (zh) * | 2010-11-26 | 2011-05-25 | 钰创科技股份有限公司 | 衰减热数据的方法 |
CN102799534A (zh) * | 2012-07-18 | 2012-11-28 | 上海宝存信息科技有限公司 | 基于固态存储介质的存储系统及方法、冷热数据识别方法 |
CN105556485A (zh) * | 2013-04-04 | 2016-05-04 | 爱思开海力士有限公司 | 基于相邻体和基于动态热阈值的热数据识别 |
CN103631538A (zh) * | 2013-12-05 | 2014-03-12 | 华为技术有限公司 | 冷热数据识别门限值计算方法、装置和系统 |
CN104881369A (zh) * | 2015-05-11 | 2015-09-02 | 中国人民解放军国防科学技术大学 | 面向混合存储系统的低内存开销热点数据识别方法 |
CN104951403A (zh) * | 2015-07-06 | 2015-09-30 | 中国科学技术大学 | 一种低开销且无差错的冷热数据识别方法 |
Non-Patent Citations (3)
Title |
---|
A novel hot data identification mechanism for NAND flash memory;Liu等;《IEEE Transactions on Consumer Electronics》;20151231;第463-469页 * |
Efficient On-line Identification of Hot Data for Flash-Memory Management;Hsieh等;《 Acm Symposium on Applied Computing. Proceedings of the ACM Symposium on Applied Computing》;20051231;第838-842页 * |
基于队列计数的固态存储器热数据识别方法;张玉芳等;《计算机应用研究》;20111231;第2886-2892页 * |
Also Published As
Publication number | Publication date |
---|---|
CN106874213A (zh) | 2017-06-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106874213B (zh) | 一种融合多种机器学习算法的固态硬盘热数据识别方法 | |
TWI398770B (zh) | 用於快閃記憶體的資料存取方法、儲存系統與控制器 | |
CN102799534B (zh) | 基于固态存储介质的存储系统及方法、冷热数据识别方法 | |
US9098395B2 (en) | Logical block management method for a flash memory and control circuit storage system using the same | |
TWI385518B (zh) | 用於快閃記憶體的資料儲存方法及儲存系統 | |
TWI405209B (zh) | 資料管理方法及使用此方法的快閃儲存系統與控制器 | |
CN108108128A (zh) | 一种混合ssd的磨损均衡方法及ssd | |
TWI660346B (zh) | 記憶體管理方法以及儲存控制器 | |
US11847058B2 (en) | Using a second content-addressable memory to manage memory burst accesses in memory sub-systems | |
CN107025071A (zh) | 非易失性存储器装置及其垃圾收集方法 | |
CN106548789A (zh) | 用于操作叠瓦式磁记录设备的方法和装置 | |
CN101634967B (zh) | 用于闪存的区块管理方法、储存系统与控制器 | |
CN110674056B (zh) | 一种垃圾回收方法及装置 | |
CN102272855A (zh) | 存储器控制器及存储器管理方法 | |
TWI726314B (zh) | 資料儲存裝置與資料處理方法 | |
KR101374065B1 (ko) | 칩 레벨 평행 플래시 메모리를 위한 정보 분별 방법 및 장치 | |
WO2021035555A1 (zh) | 一种固态硬盘的数据存储方法、装置及固态硬盘ssd | |
CN111538675A (zh) | 使用块盖写率进行无用单元收集候选对象选择 | |
KR101480424B1 (ko) | 하이브리드 플래시 메모리의 성능과 수명 최적화 장치 및 방법 | |
TWI692688B (zh) | 快閃記憶體控制器及相關電子裝置 | |
CN112347001B (zh) | 闪存垃圾回收的校验方法、装置及电子设备 | |
KR20210024189A (ko) | 마모 레벨링을 위한 바이어싱된 샘플링 방법 | |
CN111078143B (zh) | 基于段映射进行数据布局和调度的混合存储方法及系统 | |
TWI464585B (zh) | 資料儲存方法、記憶體控制器與記憶體儲存裝置 | |
CN112805692A (zh) | 混合式双列直插式存储器模块中的高速缓存操作 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20201228 Address after: 313000 room 1020, science and Technology Pioneer Park, 666 Chaoyang Road, Nanxun Town, Nanxun District, Huzhou, Zhejiang. Patentee after: Huzhou You Yan Intellectual Property Service Co.,Ltd. Address before: Building loftc, West Greenland Business City, Hanyuan Avenue, Yunlong District, Xuzhou City, Jiangsu Province, 221000 Patentee before: XUZHOU XINNANHU TECHNOLOGY Co.,Ltd. Effective date of registration: 20201228 Address after: Building loftc, West Greenland Business City, Hanyuan Avenue, Yunlong District, Xuzhou City, Jiangsu Province, 221000 Patentee after: XUZHOU XINNANHU TECHNOLOGY Co.,Ltd. Address before: 310018 No. 2 street, Xiasha Higher Education Zone, Hangzhou, Zhejiang Patentee before: HANGZHOU DIANZI University |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220310 Address after: Room 411, Xinsu building, No. 1518, East Ring Road, Suzhou Industrial Park, Suzhou, Jiangsu 215000 Patentee after: Suzhou Yishuo Electronics Co.,Ltd. Address before: 313000 room 1020, science and Technology Pioneer Park, 666 Chaoyang Road, Nanxun Town, Nanxun District, Huzhou, Zhejiang. Patentee before: Huzhou You Yan Intellectual Property Service Co.,Ltd. |
|
TR01 | Transfer of patent right |