KR102190403B1 - 물리적 메모리 크기보다 큰 메모리 용량을 가능하게 하기 위한 방법 및 장치 - Google Patents

물리적 메모리 크기보다 큰 메모리 용량을 가능하게 하기 위한 방법 및 장치 Download PDF

Info

Publication number
KR102190403B1
KR102190403B1 KR1020170062408A KR20170062408A KR102190403B1 KR 102190403 B1 KR102190403 B1 KR 102190403B1 KR 1020170062408 A KR1020170062408 A KR 1020170062408A KR 20170062408 A KR20170062408 A KR 20170062408A KR 102190403 B1 KR102190403 B1 KR 102190403B1
Authority
KR
South Korea
Prior art keywords
hash
data
bucket
memory
stored
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020170062408A
Other languages
English (en)
Korean (ko)
Other versions
KR20170131274A (ko
Inventor
동옌 지앙
창후이 린
크리슈나 말라디
김종민
홍종 정
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/161,136 external-priority patent/US9983821B2/en
Priority claimed from US15/162,517 external-priority patent/US10496543B2/en
Priority claimed from US15/476,757 external-priority patent/US10678704B2/en
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Publication of KR20170131274A publication Critical patent/KR20170131274A/ko
Application granted granted Critical
Publication of KR102190403B1 publication Critical patent/KR102190403B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G06F12/0261—Garbage collection, i.e. reclamation of unreferenced memory using reference counting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/0292—User address space allocation, e.g. contiguous or non contiguous base addressing using tables or multilevel address translation means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Memory System (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
KR1020170062408A 2016-05-20 2017-05-19 물리적 메모리 크기보다 큰 메모리 용량을 가능하게 하기 위한 방법 및 장치 Active KR102190403B1 (ko)

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
US15/161,136 2016-05-20
US15/161,136 US9983821B2 (en) 2016-03-29 2016-05-20 Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application
US15/162,517 2016-05-23
US15/162,517 US10496543B2 (en) 2016-03-31 2016-05-23 Virtual bucket multiple hash tables for efficient memory in-line deduplication application
US201662368775P 2016-07-29 2016-07-29
US62/368,775 2016-07-29
US201762450502P 2017-01-25 2017-01-25
US62/450,502 2017-01-25
US201762451157P 2017-01-27 2017-01-27
US62/451,157 2017-01-27
US201762453461P 2017-02-01 2017-02-01
US62/453,461 2017-02-01
US15/476,757 US10678704B2 (en) 2016-03-29 2017-03-31 Method and apparatus for enabling larger memory capacity than physical memory size
US15/476,757 2017-03-31

Publications (2)

Publication Number Publication Date
KR20170131274A KR20170131274A (ko) 2017-11-29
KR102190403B1 true KR102190403B1 (ko) 2020-12-11

Family

ID=60404742

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170062408A Active KR102190403B1 (ko) 2016-05-20 2017-05-19 물리적 메모리 크기보다 큰 메모리 용량을 가능하게 하기 위한 방법 및 장치

Country Status (4)

Country Link
JP (1) JP6920107B2 (enExample)
KR (1) KR102190403B1 (enExample)
CN (1) CN107402889B (enExample)
TW (1) TWI804466B (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12346600B2 (en) 2021-08-26 2025-07-01 SK Hynix Inc. Memory module, memory system including memory module, and method of operating the same

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9983821B2 (en) * 2016-03-29 2018-05-29 Samsung Electronics Co., Ltd. Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application
US10705969B2 (en) * 2018-01-19 2020-07-07 Samsung Electronics Co., Ltd. Dedupe DRAM cache
KR102540964B1 (ko) * 2018-02-12 2023-06-07 삼성전자주식회사 입출력 장치의 활용도 및 성능을 조절하는 메모리 컨트롤러, 애플리케이션 프로세서 및 메모리 컨트롤러의 동작
CN110765156A (zh) * 2018-07-09 2020-02-07 慧荣科技股份有限公司 链表搜索装置及方法
US11023374B2 (en) 2018-07-09 2021-06-01 Silicon Motion, Inc. Apparatus and method and computer program product for controlling data access
US10628072B2 (en) * 2018-08-21 2020-04-21 Samsung Electronics Co., Ltd. Scalable architecture enabling large memory system for in-memory computations
US11079954B2 (en) * 2018-08-21 2021-08-03 Samsung Electronics Co., Ltd. Embedded reference counter and special data pattern auto-detect
CN109299215B (zh) * 2018-09-28 2024-06-18 平安科技（深圳）有限公司 倒排索引查询的资源分配方法、装置及存储介质、服务器
CN112181242B (zh) * 2019-07-02 2021-11-02 北京百度网讯科技有限公司 页面展示方法及装置
WO2021022274A1 (en) * 2019-07-30 2021-02-04 Futurewei Technologies, Inc. Deduplication based on consolidation of data fingerprints
US11721384B2 (en) * 2020-04-17 2023-08-08 Advanced Micro Devices, Inc. Hardware-assisted dynamic random access memory (DRAM) row merging
CN114579558B (zh) * 2020-11-28 2025-11-14 华为云计算技术有限公司 哈希表的管理方法、装置及系统、计算机存储介质
CN114253472B (zh) * 2021-11-29 2023-09-22 郑州云海信息技术有限公司 一种元数据管理方法、设备及存储介质
KR102467372B1 (ko) * 2022-01-06 2022-11-14 삼성전자주식회사 스토리지 장치 및 이의 동작 방법
CN120234258A (zh) * 2023-12-30 2025-07-01 深圳大普微电子股份有限公司 物理地址的查询方法、闪存设备控制器及闪存设备
CN117857468B (zh) * 2024-01-05 2025-04-15 合肥卓讯云网科技有限公司 一种基于dpdk的网络数据包去重方法和装置
CN119988374B (zh) * 2024-12-31 2025-10-17 深圳大普微电子股份有限公司 哈希表的数据插入方法、系统及电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110258404A1 (en) 2010-04-14 2011-10-20 Hitachi, Ltd. Method and apparatus to manage groups for deduplication
US20120102260A1 (en) 2010-10-26 2012-04-26 Hitachi, Ltd. Storage apparatus and data control method
US20130024645A1 (en) 2010-05-20 2013-01-24 Hicamp Systems, Inc. Structured memory coprocessor
US20160291891A1 (en) 2014-01-15 2016-10-06 Intel Corporation Deduplication-based data security

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5796939A (en) * 1997-03-10 1998-08-18 Digital Equipment Corporation High frequency sampling of processor performance counters
JP2003030040A (ja) * 2001-07-12 2003-01-31 Nec Commun Syst Ltd オブジェクトデータベースシステムの複数ハッシュインデックスおよび非ユニークインデックス管理方式
JP5026213B2 (ja) * 2007-09-28 2012-09-12 株式会社日立製作所 ストレージ装置及びデータ重複排除方法
CN101655861B (zh) * 2009-09-08 2011-06-01 中国科学院计算技术研究所 基于双计数布鲁姆过滤器的哈希方法和哈希装置
US9047304B2 (en) * 2011-11-28 2015-06-02 International Business Machines Corporation Optimization of fingerprint-based deduplication
US8688661B2 (en) * 2012-06-15 2014-04-01 International Business Machines Corporation Transactional processing
US9069782B2 (en) * 2012-10-01 2015-06-30 The Research Foundation For The State University Of New York System and method for security and privacy aware virtual machine checkpointing
US10496543B2 (en) * 2016-03-31 2019-12-03 Samsung Electronics Co., Ltd. Virtual bucket multiple hash tables for efficient memory in-line deduplication application
US9983821B2 (en) * 2016-03-29 2018-05-29 Samsung Electronics Co., Ltd. Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110258404A1 (en) 2010-04-14 2011-10-20 Hitachi, Ltd. Method and apparatus to manage groups for deduplication
US20130024645A1 (en) 2010-05-20 2013-01-24 Hicamp Systems, Inc. Structured memory coprocessor
US20120102260A1 (en) 2010-10-26 2012-04-26 Hitachi, Ltd. Storage apparatus and data control method
US20160291891A1 (en) 2014-01-15 2016-10-06 Intel Corporation Deduplication-based data security

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
John Peter Stevenson, Fine-Grain In-Memory Deduplication for Large-Scale Workloads, Stanford University, 2013

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12346600B2 (en) 2021-08-26 2025-07-01 SK Hynix Inc. Memory module, memory system including memory module, and method of operating the same

Also Published As

Publication number Publication date
KR20170131274A (ko) 2017-11-29
JP2017208096A (ja) 2017-11-24
JP6920107B2 (ja) 2021-08-18
CN107402889B (zh) 2023-07-11
TW201741883A (zh) 2017-12-01
TWI804466B (zh) 2023-06-11
CN107402889A (zh) 2017-11-28

Similar Documents

Publication Publication Date Title
KR102190403B1 (ko) 물리적 메모리 크기보다 큰 메모리 용량을 가능하게 하기 위한 방법 및 장치
US10678704B2 (en) Method and apparatus for enabling larger memory capacity than physical memory size
JP6764362B2 (ja) メモリの重複除去方法及び重複除去ｄｒａｍメモリモジュール
US11010300B2 (en) Optimized record lookups
US9966152B2 (en) Dedupe DRAM system algorithm architecture
US10496543B2 (en) Virtual bucket multiple hash tables for efficient memory in-line deduplication application
WO2019127104A1 (zh) 高速缓存中资源调整方法、数据访问方法及装置
US10528284B2 (en) Method and apparatus for enabling larger memory capacity than physical memory size
CN114341819A (zh) 用于压缩的高速缓存的弹性字典共享
Guo et al. HP-mapper: A high performance storage driver for docker containers
WO2024169158A1 (zh) 一种存储系统、数据访问方法、装置及设备
US20240405971A1 (en) Hash based key value to block translation methods and systems
US20190102288A1 (en) Control modules, multi-level data storage devices, multi-level data storage methods, and computer readable media
US12450161B2 (en) Systems and methods for cache allocation
TW202340934A (zh) 用於具有計算儲存裝置的跨層鍵值儲存體的系統和方法
Boggavarapu Deduplication-aware Page Cache in Linux Kernel for Improved Read Performance

Legal Events

Date Code Title Description
PA0109 Patent application

St.27 status event code: A-0-1-A10-A12-nap-PA0109

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P18-X000 Priority claim added or amended

St.27 status event code: A-2-2-P10-P18-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

A201 Request for examination
A302 Request for accelerated examination
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PA0302 Request for accelerated examination

St.27 status event code: A-1-2-D10-D17-exm-PA0302

St.27 status event code: A-1-2-D10-D16-exm-PA0302

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U11-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 6