TWI804466B - 擷取記憶體中儲存的資料的方法與去重複模組 - Google Patents

擷取記憶體中儲存的資料的方法與去重複模組 Download PDF

Info

Publication number
TWI804466B
TWI804466B TW106116633A TW106116633A TWI804466B TW I804466 B TWI804466 B TW I804466B TW 106116633 A TW106116633 A TW 106116633A TW 106116633 A TW106116633 A TW 106116633A TW I804466 B TWI804466 B TW I804466B
Authority
TW
Taiwan
Prior art keywords
hash
data
bucket
memory
buckets
Prior art date
Application number
TW106116633A
Other languages
English (en)
Chinese (zh)
Other versions
TW201741883A (zh
Inventor
冬岩 姜
林常惠
克里希納 馬拉迪
金鍾民
鄭宏忠
Original Assignee
南韓商三星電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/161,136 external-priority patent/US9983821B2/en
Priority claimed from US15/162,517 external-priority patent/US10496543B2/en
Priority claimed from US15/476,757 external-priority patent/US10678704B2/en
Application filed by 南韓商三星電子股份有限公司 filed Critical 南韓商三星電子股份有限公司
Publication of TW201741883A publication Critical patent/TW201741883A/zh
Application granted granted Critical
Publication of TWI804466B publication Critical patent/TWI804466B/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/0292—User address space allocation, e.g. contiguous or non contiguous base addressing using tables or multilevel address translation means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G06F12/0261—Garbage collection, i.e. reclamation of unreferenced memory using reference counting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Memory System (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
TW106116633A 2016-05-20 2017-05-19 擷取記憶體中儲存的資料的方法與去重複模組 TWI804466B (zh)

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
US15/161,136 2016-05-20
US15/161,136 US9983821B2 (en) 2016-03-29 2016-05-20 Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application
US15/162,517 2016-05-23
US15/162,517 US10496543B2 (en) 2016-03-31 2016-05-23 Virtual bucket multiple hash tables for efficient memory in-line deduplication application
US201662368775P 2016-07-29 2016-07-29
US62/368,775 2016-07-29
US201762450502P 2017-01-25 2017-01-25
US62/450,502 2017-01-25
US201762451157P 2017-01-27 2017-01-27
US62/451,157 2017-01-27
US201762453461P 2017-02-01 2017-02-01
US62/453,461 2017-02-01
US15/476,757 2017-03-31
US15/476,757 US10678704B2 (en) 2016-03-29 2017-03-31 Method and apparatus for enabling larger memory capacity than physical memory size

Publications (2)

Publication Number Publication Date
TW201741883A TW201741883A (zh) 2017-12-01
TWI804466B true TWI804466B (zh) 2023-06-11

Family

ID=60404742

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106116633A TWI804466B (zh) 2016-05-20 2017-05-19 擷取記憶體中儲存的資料的方法與去重複模組

Country Status (4)

Country Link
JP (1) JP6920107B2 (enrdf_load_stackoverflow)
KR (1) KR102190403B1 (enrdf_load_stackoverflow)
CN (1) CN107402889B (enrdf_load_stackoverflow)
TW (1) TWI804466B (enrdf_load_stackoverflow)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9983821B2 (en) * 2016-03-29 2018-05-29 Samsung Electronics Co., Ltd. Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application
US10705969B2 (en) * 2018-01-19 2020-07-07 Samsung Electronics Co., Ltd. Dedupe DRAM cache
KR102540964B1 (ko) * 2018-02-12 2023-06-07 삼성전자주식회사 입출력 장치의 활용도 및 성능을 조절하는 메모리 컨트롤러, 애플리케이션 프로세서 및 메모리 컨트롤러의 동작
CN110765156A (zh) * 2018-07-09 2020-02-07 慧荣科技股份有限公司 链表搜索装置及方法
US11023374B2 (en) 2018-07-09 2021-06-01 Silicon Motion, Inc. Apparatus and method and computer program product for controlling data access
US11079954B2 (en) * 2018-08-21 2021-08-03 Samsung Electronics Co., Ltd. Embedded reference counter and special data pattern auto-detect
US10628072B2 (en) * 2018-08-21 2020-04-21 Samsung Electronics Co., Ltd. Scalable architecture enabling large memory system for in-memory computations
CN109299215B (zh) * 2018-09-28 2024-06-18 平安科技（深圳）有限公司 倒排索引查询的资源分配方法、装置及存储介质、服务器
CN112181242B (zh) * 2019-07-02 2021-11-02 北京百度网讯科技有限公司 页面展示方法及装置
CN114631075A (zh) * 2019-07-30 2022-06-14 华为技术有限公司 基于数据指纹整合的去重
US11721384B2 (en) * 2020-04-17 2023-08-08 Advanced Micro Devices, Inc. Hardware-assisted dynamic random access memory (DRAM) row merging
US12346600B2 (en) 2021-08-26 2025-07-01 SK Hynix Inc. Memory module, memory system including memory module, and method of operating the same
CN114253472B (zh) * 2021-11-29 2023-09-22 郑州云海信息技术有限公司 一种元数据管理方法、设备及存储介质
KR102467372B1 (ko) * 2022-01-06 2022-11-14 삼성전자주식회사 스토리지 장치 및 이의 동작 방법
CN120234258A (zh) * 2023-12-30 2025-07-01 深圳大普微电子股份有限公司 物理地址的查询方法、闪存设备控制器及闪存设备
CN117857468B (zh) * 2024-01-05 2025-04-15 合肥卓讯云网科技有限公司 一种基于dpdk的网络数据包去重方法和装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110258404A1 (en) * 2010-04-14 2011-10-20 Hitachi, Ltd. Method and apparatus to manage groups for deduplication
US20120102260A1 (en) * 2010-10-26 2012-04-26 Hitachi, Ltd. Storage apparatus and data control method
US20130024645A1 (en) * 2010-05-20 2013-01-24 Hicamp Systems, Inc. Structured memory coprocessor
US9069782B2 (en) * 2012-10-01 2015-06-30 The Research Foundation For The State University Of New York System and method for security and privacy aware virtual machine checkpointing
WO2015108931A1 (en) * 2014-01-15 2015-07-23 Cheriton David R Deduplication-based data security
TWI533219B (zh) * 2012-06-15 2016-05-11 萬國商業機器公司 用於控制一異動在一計算環境中之執行之電腦程式產品、電腦系統及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5796939A (en) * 1997-03-10 1998-08-18 Digital Equipment Corporation High frequency sampling of processor performance counters
JP2003030040A (ja) * 2001-07-12 2003-01-31 Nec Commun Syst Ltd オブジェクトデータベースシステムの複数ハッシュインデックスおよび非ユニークインデックス管理方式
JP5026213B2 (ja) * 2007-09-28 2012-09-12 株式会社日立製作所 ストレージ装置及びデータ重複排除方法
CN101655861B (zh) * 2009-09-08 2011-06-01 中国科学院计算技术研究所 基于双计数布鲁姆过滤器的哈希方法和哈希装置
US9047304B2 (en) * 2011-11-28 2015-06-02 International Business Machines Corporation Optimization of fingerprint-based deduplication
US10496543B2 (en) * 2016-03-31 2019-12-03 Samsung Electronics Co., Ltd. Virtual bucket multiple hash tables for efficient memory in-line deduplication application
US9983821B2 (en) * 2016-03-29 2018-05-29 Samsung Electronics Co., Ltd. Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110258404A1 (en) * 2010-04-14 2011-10-20 Hitachi, Ltd. Method and apparatus to manage groups for deduplication
US20130024645A1 (en) * 2010-05-20 2013-01-24 Hicamp Systems, Inc. Structured memory coprocessor
US20120102260A1 (en) * 2010-10-26 2012-04-26 Hitachi, Ltd. Storage apparatus and data control method
TWI533219B (zh) * 2012-06-15 2016-05-11 萬國商業機器公司 用於控制一異動在一計算環境中之執行之電腦程式產品、電腦系統及方法
US9069782B2 (en) * 2012-10-01 2015-06-30 The Research Foundation For The State University Of New York System and method for security and privacy aware virtual machine checkpointing
WO2015108931A1 (en) * 2014-01-15 2015-07-23 Cheriton David R Deduplication-based data security

Also Published As

Publication number Publication date
TW201741883A (zh) 2017-12-01
KR20170131274A (ko) 2017-11-29
JP6920107B2 (ja) 2021-08-18
CN107402889B (zh) 2023-07-11
JP2017208096A (ja) 2017-11-24
CN107402889A (zh) 2017-11-28
KR102190403B1 (ko) 2020-12-11

Similar Documents

Publication Publication Date Title
TWI804466B (zh) 擷取記憶體中儲存的資料的方法與去重複模組
US10318434B2 (en) Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application
US10678704B2 (en) Method and apparatus for enabling larger memory capacity than physical memory size
TWI683217B (zh) 使用去重複dram系統演算法架構的去重複記憶體模組及其方法
US10496543B2 (en) Virtual bucket multiple hash tables for efficient memory in-line deduplication application
US20190095336A1 (en) Host computing arrangement, remote server arrangement, storage system and methods thereof
US20150312366A1 (en) Unified caching of storage blocks and memory pages in a compute-node cluster
CN114341819A (zh) 用于压缩的高速缓存的弹性字典共享
US10628300B2 (en) RAID stripe physical placement
US10528284B2 (en) Method and apparatus for enabling larger memory capacity than physical memory size
CN119597680A (zh) 用改进查找表方案进行存储器压缩
US20190102288A1 (en) Control modules, multi-level data storage devices, multi-level data storage methods, and computer readable media
US10140029B2 (en) Method and apparatus for adaptively managing data in a memory based file system
CN114490441A (zh) 一种内存管理方法及混合内存管理单元
CN120491884A (zh) 易失性存储器的在线去重