CN104246764B - 利用非均匀散列函数在非均匀访问存储器中放置记录的方法和装置 - Google Patents

利用非均匀散列函数在非均匀访问存储器中放置记录的方法和装置 Download PDF

Info

Publication number
CN104246764B
CN104246764B CN201380017693.9A CN201380017693A CN104246764B CN 104246764 B CN104246764 B CN 104246764B CN 201380017693 A CN201380017693 A CN 201380017693A CN 104246764 B CN104246764 B CN 104246764B
Authority
CN
China
Prior art keywords
memory
record
hash function
area
logic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201380017693.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN104246764A (zh
Inventor
A·J·比弗森
P·鲍登
S·曼贾纳塔
黄劲松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Enterprise Development LP
Original Assignee
Hewlett Packard Enterprise Development LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Enterprise Development LP filed Critical Hewlett Packard Enterprise Development LP
Publication of CN104246764A publication Critical patent/CN104246764A/zh
Application granted granted Critical
Publication of CN104246764B publication Critical patent/CN104246764B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0616—Improving the reliability of storage systems in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G06F16/137—Hash-based
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/10—Address translation
    • G06F12/1009—Address translation using page tables, e.g. page table structures
    • G06F12/1018—Address translation using page tables, e.g. page table structures involving hashing techniques, e.g. inverted page tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9014—Indexing; Data structures therefor; Storage structures hash tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0864—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches using pseudo-associative means, e.g. set-associative or hashing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1032—Reliability improvement, data loss prevention, degraded operation etc
    • G06F2212/1036—Life time enhancement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1041—Resource optimization
    • G06F2212/1044—Space efficiency improvement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7201—Logical to physical mapping or translation of blocks or pages
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7202—Allocation control and policies
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7208—Multiple device management, e.g. distributing data over multiple flash devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201380017693.9A 2012-02-24 2013-02-22 利用非均匀散列函数在非均匀访问存储器中放置记录的方法和装置 Expired - Fee Related CN104246764B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/404,640 US9165005B2 (en) 2012-02-24 2012-02-24 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory
US13/404,640 2012-02-24
PCT/US2013/027277 WO2013126665A1 (en) 2012-02-24 2013-02-22 Method and apparatus utilizing non-uniform hash functions for placing records in non-uniform access memory

Publications (2)

Publication Number Publication Date
CN104246764A CN104246764A (zh) 2014-12-24
CN104246764B true CN104246764B (zh) 2017-09-15

Family

ID=47833424

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380017693.9A Expired - Fee Related CN104246764B (zh) 2012-02-24 2013-02-22 利用非均匀散列函数在非均匀访问存储器中放置记录的方法和装置

Country Status (9)

Country Link
US (2) US9165005B2 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
EP (1) EP2817741B1 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
JP (1) JP6205650B2 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
CN (1) CN104246764B (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
AU (1) AU2013222310B2 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
BR (1) BR112014020819A8 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
CA (1) CA2865064A1 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
HK (1) HK1200558A1 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)
WO (1) WO2013126665A1 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK2433226T3 (en) 2009-06-26 2015-11-02 Simplivity Corp File system
US8819208B2 (en) 2010-03-05 2014-08-26 Solidfire, Inc. Data deletion in a distributed data storage system
US9054992B2 (en) 2011-12-27 2015-06-09 Solidfire, Inc. Quality of service policy sets
US9838269B2 (en) 2011-12-27 2017-12-05 Netapp, Inc. Proportional quality of service based on client usage and system metrics
US9043334B2 (en) * 2012-12-26 2015-05-26 Industrial Technology Research Institute Method and system for accessing files on a storage system
US9536016B2 (en) * 2013-01-16 2017-01-03 Google Inc. On-disk multimap
US9256549B2 (en) 2014-01-17 2016-02-09 Netapp, Inc. Set-associative hash table organization for efficient storage and retrieval of data in a storage system
US20150244795A1 (en) 2014-02-21 2015-08-27 Solidfire, Inc. Data syncing in a distributed system
US9361480B2 (en) * 2014-03-26 2016-06-07 Alcatel Lucent Anonymization of streaming data
US9798728B2 (en) 2014-07-24 2017-10-24 Netapp, Inc. System performing data deduplication using a dense tree data structure
US10133511B2 (en) 2014-09-12 2018-11-20 Netapp, Inc Optimized segment cleaning technique
US9671960B2 (en) 2014-09-12 2017-06-06 Netapp, Inc. Rate matching technique for balancing segment cleaning and I/O workload
US9836229B2 (en) 2014-11-18 2017-12-05 Netapp, Inc. N-way merge technique for updating volume metadata in a storage I/O stack
CN105701021B (zh) * 2014-12-10 2021-03-02 慧荣科技股份有限公司 数据储存装置及其数据写入方法
US9720601B2 (en) 2015-02-11 2017-08-01 Netapp, Inc. Load balancing technique for a storage array
US9762460B2 (en) 2015-03-24 2017-09-12 Netapp, Inc. Providing continuous context for operational information of a storage system
US9710317B2 (en) 2015-03-30 2017-07-18 Netapp, Inc. Methods to identify, handle and recover from suspect SSDS in a clustered flash array
US10296219B2 (en) 2015-05-28 2019-05-21 Vmware, Inc. Data deduplication in a block-based storage system
US9740566B2 (en) 2015-07-31 2017-08-22 Netapp, Inc. Snapshot creation workflow
KR20170065374A (ko) 2015-12-03 2017-06-13 영남대학교 산학협력단 버킷 단위의 정렬을 기반으로 하는 해시 충돌 처리 방법
US10706101B2 (en) * 2016-04-14 2020-07-07 Advanced Micro Devices, Inc. Bucketized hash tables with remap entries
US10929022B2 (en) 2016-04-25 2021-02-23 Netapp. Inc. Space savings reporting for storage system supporting snapshot and clones
TWI605378B (zh) * 2016-07-14 2017-11-11 財團法人工業技術研究院 操控記錄方法及自動執行操控方法
US10642763B2 (en) 2016-09-20 2020-05-05 Netapp, Inc. Quality of service policy sets
KR101820017B1 (ko) 2016-10-26 2018-01-18 주식회사 리얼타임테크 데이터베이스 클러스터링 장치 및 그 방법
US20180260155A1 (en) * 2017-03-13 2018-09-13 Reduxio Systems Ltd. System and method for transporting a data container
US10540323B2 (en) 2017-05-30 2020-01-21 Western Digital Technologies, Inc. Managing I/O operations in a storage network
KR101866697B1 (ko) * 2017-07-28 2018-06-12 영남대학교 산학협력단 버킷 단위의 정렬을 기반으로 하는 해시 충돌 처리 방법
US10628326B2 (en) * 2017-08-21 2020-04-21 Micron Technology, Inc. Logical to physical mapping
US11106588B2 (en) 2017-11-28 2021-08-31 International Business Machines Corporation Deferred method of allocating disk space for lightning segments
CN110109915B (zh) * 2018-01-18 2024-01-05 伊姆西Ip控股有限责任公司 用于管理哈希表的方法、设备和计算机程序产品
US11132141B2 (en) * 2018-07-23 2021-09-28 Ionir Systems Ltd. System and method for synchronization of data containers
US11822489B2 (en) * 2018-12-21 2023-11-21 Micron Technology, Inc. Data integrity protection for relocating data in a memory system
US11520764B2 (en) * 2019-06-27 2022-12-06 International Business Machines Corporation Multicriteria record linkage with surrogate blocking keys
US11169728B2 (en) * 2019-09-10 2021-11-09 Western Digital Technologies, Inc. Replication configuration for multiple heterogeneous data stores
US11321295B2 (en) * 2019-11-14 2022-05-03 Acronis International Gmbh Systems and methods for improving indexer performance by multiplexing data of an underlying index
US11899642B2 (en) 2019-12-17 2024-02-13 Advanced Micro Devices, Inc. System and method using hash table with a set of frequently-accessed buckets and a set of less frequently-accessed buckets
EP4104058A4 (en) * 2020-02-10 2024-03-20 2Misses Corporation SYSTEM AND METHOD FOR A HASH TABLE AND DATA STORAGE AND ACCESS TO DATA USING THE SAME
CN111239529A (zh) * 2020-03-05 2020-06-05 西南交通大学 一种支持机电设备预测性维护的激励测试方法及系统
CN113064558B (zh) * 2021-06-04 2021-09-17 广东汇天航空航天科技有限公司 一种数据存储方法和装置
US12147347B2 (en) 2022-08-18 2024-11-19 Samsung Electronics Co., Ltd System and method for performing caching in hashed storage
US11934704B1 (en) 2022-09-27 2024-03-19 Western Digital Technologies, Inc. Control table set determination in storage devices

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102096679A (zh) * 2009-12-15 2011-06-15 北大方正集团有限公司 一种索引段合并和写入磁盘的方法及装置
CN102282555A (zh) * 2009-01-15 2011-12-14 微软公司 索引和搜索动态地变化的搜索语料库

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04257062A (ja) * 1991-02-08 1992-09-11 Fujitsu Ltd ハッシュキューを用いるデータ処理装置
US20080209114A1 (en) * 1999-08-04 2008-08-28 Super Talent Electronics, Inc. Reliability High Endurance Non-Volatile Memory Device with Zone-Based Non-Volatile Memory File System
US6434662B1 (en) * 1999-11-02 2002-08-13 Juniper Networks, Inc. System and method for searching an associative memory utilizing first and second hash functions
JP4014155B2 (ja) * 2003-01-27 2007-11-28 インターナショナル・ビジネス・マシーンズ・コーポレーション 情報処理装置及び方法、プログラム、データ構造、並びにコンピュータ読取り可能な記録媒体
JP4068473B2 (ja) * 2003-02-19 2008-03-26 株式会社東芝 ストレージ装置、分担範囲決定方法及びプログラム
US7664927B2 (en) * 2006-03-29 2010-02-16 Microsoft Corporation Hash tables
US7913051B1 (en) * 2006-12-22 2011-03-22 Emc Corporation Methods and apparatus for increasing the storage capacity of a zone of a storage system
TWI368224B (en) * 2007-03-19 2012-07-11 A Data Technology Co Ltd Wear-leveling management and file distribution management of hybrid density memory
JP5347753B2 (ja) 2009-06-24 2013-11-20 ソニー株式会社 電源ユニット、処理システム及び制御方法
DK2433226T3 (en) * 2009-06-26 2015-11-02 Simplivity Corp File system
US8244701B2 (en) * 2010-02-12 2012-08-14 Microsoft Corporation Using behavior data to quickly improve search ranking
US9275678B2 (en) * 2010-03-25 2016-03-01 International Business Machines Corporation Primary storage media with associated secondary storage media for efficient data management

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102282555A (zh) * 2009-01-15 2011-12-14 微软公司 索引和搜索动态地变化的搜索语料库
CN102096679A (zh) * 2009-12-15 2011-06-15 北大方正集团有限公司 一种索引段合并和写入磁盘的方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Object-based SCM:An Efficient Interface for Storage Class Memories;Yangwook Kang等;《Mass Storage Systems and Technologies (MSST)》;20110523(第27期);文章第1页-第10页 *

Also Published As

Publication number Publication date
WO2013126665A1 (en) 2013-08-29
US20130227195A1 (en) 2013-08-29
BR112014020819A8 (pt) 2017-10-10
EP2817741A1 (en) 2014-12-31
CN104246764A (zh) 2014-12-24
BR112014020819A2 (GUID-C5D7CC26-194C-43D0-91A1-9AE8C70A9BFF.html) 2017-06-20
JP2015515047A (ja) 2015-05-21
US9165005B2 (en) 2015-10-20
JP6205650B2 (ja) 2017-10-04
AU2013222310A1 (en) 2014-09-11
US9684462B2 (en) 2017-06-20
CA2865064A1 (en) 2013-08-29
US20160062682A1 (en) 2016-03-03
EP2817741B1 (en) 2018-12-26
HK1200558A1 (en) 2015-08-07
AU2013222310B2 (en) 2017-10-12

Similar Documents

Publication Publication Date Title
CN104246764B (zh) 利用非均匀散列函数在非均匀访问存储器中放置记录的方法和装置
CN106548789B (zh) 用于操作叠瓦式磁记录设备的方法和装置
CA2865240C (en) Method and apparatus for content derived data placement in memory
US7921142B2 (en) Method and apparatus for storing and accessing data records on solid state disks
KR20170023734A (ko) 플래시 메모리 플러싱을 개선하는 방법 및 시스템
CN109407985B (zh) 一种数据管理的方法以及相关装置
US20110153674A1 (en) Data storage including storing of page identity and logical relationships between pages
US12175107B2 (en) Method, electronic device and computer program product for processing data
JP2007220107A (ja) 不揮発性メモリのマッピング情報管理装置及び方法
Lee et al. An efficient buffer management scheme for implementing a B-tree on NAND flash memory
US11334482B2 (en) Upgrading on-disk format without service interruption
Liang et al. Enabling sequential-write-constrained B+-Tree index scheme to upgrade shingled magnetic recording storage performance
Fevgas et al. HyR-tree: a spatial index for hybrid flash/3D XPoint storage
Chardin et al. Chronos: a NoSQL system on flash memory for industrial process data
Park Flash-Aware Cost Model for Embedded Database Query Optimizer.
Lam et al. Garbage collection of multi-version indexed data on flash memory
CN104221014B (zh) 内容派生的存储器中数据放置的方法和装置
Fevgas Data structuring techniques for non-volatile memories
Kwon et al. Distribution log buffer scheme for NAND flash memory
No et al. ReHypar: A Recursive Hybrid Chunk Partitioning Method Using NAND‐Flash Memory SSD
Lehtonen Bulk Indexing on Flash Devices
Du et al. The Design of a Logging Approach for B+-Tree Index on Flash-Based DBMS
Rizvi et al. Flash memory SSD based DBMS for high performance computing embedded and multimedia systems
Kim et al. PBGC: Proxy Block-Based Garbage Collection for Index Structures in NAND Flash Memory
Jiang FAR-tree: A spatial index for solid state drives

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1200558

Country of ref document: HK

TA01 Transfer of patent application right

Effective date of registration: 20170811

Address after: Texas, USA

Applicant after: HEWLETT PACKARD ENTERPRISE DEVELOPMENT L.P.

Address before: Massachusetts USA

Applicant before: SIMPLIVITY Corp.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1200558

Country of ref document: HK

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170915

CF01 Termination of patent right due to non-payment of annual fee