HK1200558A1 - Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory - Google Patents

Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory Download PDF

Info

Publication number
HK1200558A1
HK1200558A1 HK15101058.0A HK15101058A HK1200558A1 HK 1200558 A1 HK1200558 A1 HK 1200558A1 HK 15101058 A HK15101058 A HK 15101058A HK 1200558 A1 HK1200558 A1 HK 1200558A1
Authority
HK
Hong Kong
Prior art keywords
memory
record
records
hash functions
segment
Prior art date
Application number
HK15101058.0A
Other languages
English (en)
Chinese (zh)
Inventor
‧比弗森
A‧J‧比弗森
‧鮑登
P‧鲍登
‧曼賈納塔
S‧曼贾纳塔
黃勁松
黄劲松
Original Assignee
Hewlett Packard Enterprise Development Lp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Enterprise Development Lp filed Critical Hewlett Packard Enterprise Development Lp
Publication of HK1200558A1 publication Critical patent/HK1200558A1/xx

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0616—Improving the reliability of storage systems in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G06F16/137—Hash-based
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9014—Indexing; Data structures therefor; Storage structures hash tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/10—Address translation
    • G06F12/1009—Address translation using page tables, e.g. page table structures
    • G06F12/1018—Address translation using page tables, e.g. page table structures involving hashing techniques, e.g. inverted page tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0864—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches using pseudo-associative means, e.g. set-associative or hashing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1032—Reliability improvement, data loss prevention, degraded operation etc
    • G06F2212/1036—Life time enhancement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1041—Resource optimization
    • G06F2212/1044—Space efficiency improvement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7201—Logical to physical mapping or translation of blocks or pages
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7202—Allocation control and policies
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7208—Multiple device management, e.g. distributing data over multiple flash devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
HK15101058.0A 2012-02-24 2013-02-22 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory HK1200558A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/404,640 2012-02-24
US13/404,640 US9165005B2 (en) 2012-02-24 2012-02-24 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory
PCT/US2013/027277 WO2013126665A1 (en) 2012-02-24 2013-02-22 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory

Publications (1)

Publication Number Publication Date
HK1200558A1 true HK1200558A1 (en) 2015-08-07

Family

ID=47833424

Family Applications (1)

Application Number Title Priority Date Filing Date
HK15101058.0A HK1200558A1 (en) 2012-02-24 2013-02-22 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory

Country Status (9)

Country Link
US (2) US9165005B2 (cg-RX-API-DMAC7.html)
EP (1) EP2817741B1 (cg-RX-API-DMAC7.html)
JP (1) JP6205650B2 (cg-RX-API-DMAC7.html)
CN (1) CN104246764B (cg-RX-API-DMAC7.html)
AU (1) AU2013222310B2 (cg-RX-API-DMAC7.html)
BR (1) BR112014020819A8 (cg-RX-API-DMAC7.html)
CA (1) CA2865064A1 (cg-RX-API-DMAC7.html)
HK (1) HK1200558A1 (cg-RX-API-DMAC7.html)
WO (1) WO2013126665A1 (cg-RX-API-DMAC7.html)

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2546562T3 (es) * 2009-06-26 2015-09-24 Simplivity Corporation Sistema de archivos
US8671265B2 (en) 2010-03-05 2014-03-11 Solidfire, Inc. Distributed data storage system providing de-duplication of data using block identifiers
US9054992B2 (en) 2011-12-27 2015-06-09 Solidfire, Inc. Quality of service policy sets
US9838269B2 (en) 2011-12-27 2017-12-05 Netapp, Inc. Proportional quality of service based on client usage and system metrics
US9043334B2 (en) * 2012-12-26 2015-05-26 Industrial Technology Research Institute Method and system for accessing files on a storage system
US9536016B2 (en) * 2013-01-16 2017-01-03 Google Inc. On-disk multimap
US9256549B2 (en) * 2014-01-17 2016-02-09 Netapp, Inc. Set-associative hash table organization for efficient storage and retrieval of data in a storage system
US20150244795A1 (en) 2014-02-21 2015-08-27 Solidfire, Inc. Data syncing in a distributed system
US9361480B2 (en) * 2014-03-26 2016-06-07 Alcatel Lucent Anonymization of streaming data
US9798728B2 (en) 2014-07-24 2017-10-24 Netapp, Inc. System performing data deduplication using a dense tree data structure
US10133511B2 (en) 2014-09-12 2018-11-20 Netapp, Inc Optimized segment cleaning technique
US9671960B2 (en) 2014-09-12 2017-06-06 Netapp, Inc. Rate matching technique for balancing segment cleaning and I/O workload
US9836229B2 (en) 2014-11-18 2017-12-05 Netapp, Inc. N-way merge technique for updating volume metadata in a storage I/O stack
CN105701021B (zh) * 2014-12-10 2021-03-02 慧荣科技股份有限公司 数据储存装置及其数据写入方法
US9720601B2 (en) 2015-02-11 2017-08-01 Netapp, Inc. Load balancing technique for a storage array
US9762460B2 (en) 2015-03-24 2017-09-12 Netapp, Inc. Providing continuous context for operational information of a storage system
US9710317B2 (en) 2015-03-30 2017-07-18 Netapp, Inc. Methods to identify, handle and recover from suspect SSDS in a clustered flash array
US10296219B2 (en) 2015-05-28 2019-05-21 Vmware, Inc. Data deduplication in a block-based storage system
US9740566B2 (en) 2015-07-31 2017-08-22 Netapp, Inc. Snapshot creation workflow
KR20170065374A (ko) 2015-12-03 2017-06-13 영남대학교 산학협력단 버킷 단위의 정렬을 기반으로 하는 해시 충돌 처리 방법
US10706101B2 (en) * 2016-04-14 2020-07-07 Advanced Micro Devices, Inc. Bucketized hash tables with remap entries
US10929022B2 (en) 2016-04-25 2021-02-23 Netapp. Inc. Space savings reporting for storage system supporting snapshot and clones
TWI605378B (zh) * 2016-07-14 2017-11-11 財團法人工業技術研究院 操控記錄方法及自動執行操控方法
US10642763B2 (en) 2016-09-20 2020-05-05 Netapp, Inc. Quality of service policy sets
KR101820017B1 (ko) 2016-10-26 2018-01-18 주식회사 리얼타임테크 데이터베이스 클러스터링 장치 및 그 방법
US20180260155A1 (en) * 2017-03-13 2018-09-13 Reduxio Systems Ltd. System and method for transporting a data container
US10540323B2 (en) * 2017-05-30 2020-01-21 Western Digital Technologies, Inc. Managing I/O operations in a storage network
KR101866697B1 (ko) * 2017-07-28 2018-06-12 영남대학교 산학협력단 버킷 단위의 정렬을 기반으로 하는 해시 충돌 처리 방법
US10628326B2 (en) * 2017-08-21 2020-04-21 Micron Technology, Inc. Logical to physical mapping
US11106588B2 (en) 2017-11-28 2021-08-31 International Business Machines Corporation Deferred method of allocating disk space for lightning segments
CN110109915B (zh) * 2018-01-18 2024-01-05 伊姆西Ip控股有限责任公司 用于管理哈希表的方法、设备和计算机程序产品
US10990532B2 (en) * 2018-03-29 2021-04-27 Intel Corporation Object storage system with multi-level hashing function for storage address determination
US11132141B2 (en) * 2018-07-23 2021-09-28 Ionir Systems Ltd. System and method for synchronization of data containers
US11822489B2 (en) * 2018-12-21 2023-11-21 Micron Technology, Inc. Data integrity protection for relocating data in a memory system
US11520764B2 (en) * 2019-06-27 2022-12-06 International Business Machines Corporation Multicriteria record linkage with surrogate blocking keys
US11169728B2 (en) * 2019-09-10 2021-11-09 Western Digital Technologies, Inc. Replication configuration for multiple heterogeneous data stores
US11321295B2 (en) * 2019-11-14 2022-05-03 Acronis International Gmbh Systems and methods for improving indexer performance by multiplexing data of an underlying index
US11899642B2 (en) * 2019-12-17 2024-02-13 Advanced Micro Devices, Inc. System and method using hash table with a set of frequently-accessed buckets and a set of less frequently-accessed buckets
WO2021163055A1 (en) * 2020-02-10 2021-08-19 2Misses Corporation System and method for a hash table and data storage and access using the same
CN111239529A (zh) * 2020-03-05 2020-06-05 西南交通大学 一种支持机电设备预测性维护的激励测试方法及系统
CN113064558B (zh) * 2021-06-04 2021-09-17 广东汇天航空航天科技有限公司 一种数据存储方法和装置
US12147347B2 (en) 2022-08-18 2024-11-19 Samsung Electronics Co., Ltd System and method for performing caching in hashed storage
US11934704B1 (en) 2022-09-27 2024-03-19 Western Digital Technologies, Inc. Control table set determination in storage devices

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04257062A (ja) * 1991-02-08 1992-09-11 Fujitsu Ltd ハッシュキューを用いるデータ処理装置
US20080209114A1 (en) * 1999-08-04 2008-08-28 Super Talent Electronics, Inc. Reliability High Endurance Non-Volatile Memory Device with Zone-Based Non-Volatile Memory File System
US6434662B1 (en) * 1999-11-02 2002-08-13 Juniper Networks, Inc. System and method for searching an associative memory utilizing first and second hash functions
JP4014155B2 (ja) * 2003-01-27 2007-11-28 インターナショナル・ビジネス・マシーンズ・コーポレーション 情報処理装置及び方法、プログラム、データ構造、並びにコンピュータ読取り可能な記録媒体
JP4068473B2 (ja) * 2003-02-19 2008-03-26 株式会社東芝 ストレージ装置、分担範囲決定方法及びプログラム
US7664927B2 (en) * 2006-03-29 2010-02-16 Microsoft Corporation Hash tables
US7913051B1 (en) * 2006-12-22 2011-03-22 Emc Corporation Methods and apparatus for increasing the storage capacity of a zone of a storage system
TWI368224B (en) * 2007-03-19 2012-07-11 A Data Technology Co Ltd Wear-leveling management and file distribution management of hybrid density memory
US8589392B2 (en) * 2009-01-15 2013-11-19 Microsoft Corporation Indexing and searching dynamically changing search corpora
JP5347753B2 (ja) 2009-06-24 2013-11-20 ソニー株式会社 電源ユニット、処理システム及び制御方法
ES2546562T3 (es) * 2009-06-26 2015-09-24 Simplivity Corporation Sistema de archivos
CN102096679A (zh) * 2009-12-15 2011-06-15 北大方正集团有限公司 一种索引段合并和写入磁盘的方法及装置
US8244701B2 (en) * 2010-02-12 2012-08-14 Microsoft Corporation Using behavior data to quickly improve search ranking
US9275678B2 (en) * 2010-03-25 2016-03-01 International Business Machines Corporation Primary storage media with associated secondary storage media for efficient data management

Also Published As

Publication number Publication date
CN104246764A (zh) 2014-12-24
US20160062682A1 (en) 2016-03-03
EP2817741A1 (en) 2014-12-31
US9684462B2 (en) 2017-06-20
WO2013126665A1 (en) 2013-08-29
US9165005B2 (en) 2015-10-20
CN104246764B (zh) 2017-09-15
JP6205650B2 (ja) 2017-10-04
CA2865064A1 (en) 2013-08-29
JP2015515047A (ja) 2015-05-21
BR112014020819A2 (cg-RX-API-DMAC7.html) 2017-06-20
AU2013222310B2 (en) 2017-10-12
EP2817741B1 (en) 2018-12-26
AU2013222310A1 (en) 2014-09-11
BR112014020819A8 (pt) 2017-10-10
US20130227195A1 (en) 2013-08-29

Similar Documents

Publication Publication Date Title
CN104246764B (zh) 利用非均匀散列函数在非均匀访问存储器中放置记录的方法和装置
US11782632B2 (en) Selective erasure of data in a SSD
US10649910B2 (en) Persistent memory for key-value storage
CN102483754B (zh) 在非均匀存取存储器中的可扩展编制索引
US7395384B2 (en) Method and apparatus for maintaining data on non-volatile memory systems
Chung et al. A survey of flash translation layer
US8312204B2 (en) System and method for wear leveling in a data storage device
US8341340B2 (en) Multi-tier address mapping in flash memory
US10558561B2 (en) Systems and methods for storage metadata management
AU2014226246B2 (en) Methods, devices and systems for two stage power-on map rebuild with free space accounting in a solid state drive
KR20070060070A (ko) 최적화된 순차적인 클러스터 관리용 에프에이티 분석
US20140207997A1 (en) Pregroomer for storage array
KR101077904B1 (ko) 페이지 단위 매핑 기법을 이용한 플래시 메모리 관리 장치 및 방법
US20200104047A1 (en) Container key value store for data storage devices
US20150324281A1 (en) System and method of implementing an object storage device on a computer main memory system
KR20090046567A (ko) 반도체 디스크 및 그것의 동작 방법
KR20070096429A (ko) 빠른 마운팅을 지원하는 낸드 플래시 메모리에 적용되는파일시스템
Lee et al. An efficient buffer management scheme for implementing a B-tree on NAND flash memory
Lim et al. Hashing directory scheme for NAND flash file system
Chowdhur et al. A survey of flash memory design and implementation of database in flash memory