US20230017732A1 - Key packing for flash key value store operations - Google Patents

Key packing for flash key value store operations Download PDF

Info

Publication number
US20230017732A1
US20230017732A1 US17/481,897 US202117481897A US2023017732A1 US 20230017732 A1 US20230017732 A1 US 20230017732A1 US 202117481897 A US202117481897 A US 202117481897A US 2023017732 A1 US2023017732 A1 US 2023017732A1
Authority
US
United States
Prior art keywords
register
signal
matched filter
key
local code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US17/481,897
Inventor
Kedar Shrikrishna Patwardhan
Nithya Ramakrishnan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to US17/481,897 priority Critical patent/US20230017732A1/en
Priority to KR1020220062728A priority patent/KR20230012970A/en
Priority to EP22182798.3A priority patent/EP4120088A1/en
Priority to CN202210835484.6A priority patent/CN115620778A/en
Publication of US20230017732A1 publication Critical patent/US20230017732A1/en
Priority to US18/196,185 priority patent/US11892951B2/en
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PATWARDHAN, KEDAR SHRIKRISHNA, RAMAKRISHNAN, NITHYA
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1847File system types specifically adapted to static storage, e.g. adapted to flash memory or SSD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0864Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches using pseudo-associative means, e.g. set-associative or hashing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • G06F16/2255Hash tables
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11CSTATIC STORES
    • G11C16/00Erasable programmable read-only memories
    • G11C16/02Erasable programmable read-only memories electrically programmable
    • G11C16/04Erasable programmable read-only memories electrically programmable using variable threshold transistors, e.g. FAMOS
    • G11C16/0483Erasable programmable read-only memories electrically programmable using variable threshold transistors, e.g. FAMOS comprising cells having several storage transistors connected in series
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/0223User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023Free address space management
    • G06F12/0238Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G06F12/0246Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0877Cache access modes
    • G06F12/0882Page mode
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • G06F16/2272Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/235Update request formulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31Indexing; Data structures therefor; Storage structures
    • G06F16/316Indexing structures
    • G06F16/322Trees
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31Indexing; Data structures therefor; Storage structures
    • G06F16/316Indexing structures
    • G06F16/325Hash tables
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • G06F16/9014Indexing; Data structures therefor; Storage structures hash tables
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • G06F16/9027Trees
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0644Management of space entities, e.g. partitions, extents, pools
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11CSTATIC STORES
    • G11C16/00Erasable programmable read-only memories
    • G11C16/02Erasable programmable read-only memories electrically programmable
    • G11C16/06Auxiliary circuits, e.g. for writing into memory
    • G11C16/10Programming or data input circuits
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72Details relating to flash memory management

Definitions

  • the present disclosure relates generally to key value (KV) store operations, and more particularly to improving KV store operations by storing multiple keys together in a single NAND page.
  • KV key value
  • a KV store or a KV database is a data storage paradigm designed for storing, retrieving, and managing associative arrays, and a data structure more commonly known as a hash table.
  • Hash tables contain a collection of objects, or records, which in turn have many different fields within them, each containing data. These records may be stored and retrieved using a key that uniquely identifies the record, and may be used to find the data within the database.
  • KV stores often use less memory than a relational database.
  • the present disclosure is made to address at least some of the disadvantages described above and to provide at least the advantages described below.
  • An aspect of the present disclosure is to provide a system and method that allows packing of multiple keys inserted with no temporal locality, such that they may be grouped into a bunch of memory pages (e.g. NAND pages) with spatial locality.
  • NAND pages e.g. NAND pages
  • This provides a reduction in the number of NAND pages required to store all keys, and read amplification factor (RAF)/write amplification factor (WAF) reduction due to dense key packing.
  • RAF read amplification factor
  • WAF write amplification factor
  • GC garbage collection
  • the present disclosure may significantly reduce GC overheads by a factor of packing density and reduce lengths of hash-map collision chains, which improves tail latency and lessens the number of NAND page reads that significantly decrease lookup latencies.
  • a KV store may be provided, which includes a key logger;
  • a processor configured to receive a first command for storing a first KV in the KV store, write a first value of the first KV to a first memory page, generate an extent map for identifying the first memory page including the value, write the extent map to a second memory page, append an entry for storing the first KV to the key logger, and update a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.
  • a method of operating a KV store includes receiving a first command for storing a first KV in the KV store; writing a first value of the first KV to a first memory page; generating an extent map for identifying the first memory page including the value; writing the extent map to a second NAND page; appending an entry for storing the first KV to a key logger of the KV store; and updating a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.
  • a storage system which includes a KV store; and a processor configured to receive a first command for storing a first KV in the KV store, write a first value of the first KV to a first memory page, generate an extent map for identifying the first memory page including the value, write the extent map to a second memory page, append an entry for storing the first KV to a key logger of the KV store, and update a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.
  • FIG. 1 illustrates a hash implementation in a KV solid state device (SSD);
  • FIG. 2 illustrates a hash implementation in a KV SSD, according to an embodiment
  • FIG. 3 illustrates a KV store, according to an embodiment
  • FIGS. 4 A and 4 B illustrate a deferred key packing operation in a KV store, according to an embodiment
  • FIG. 5 is a flowchart illustrating a key packing operation of a KV store, according to an embodiment
  • FIG. 6 is flowchart illustrating a Put operation of a KV store, according to an embodiment
  • FIG. 7 is a flowchart illustrating a Delete operation of a KV store, according to an embodiment
  • FIG. 8 is a flowchart illustrating a Get operation of a KV store, according to an embodiment
  • FIG. 9 illustrates a block diagram of an electronic device in a network environment, according to an embodiment.
  • FIG. 10 illustrates a diagram of a storage system, according to an embodiment.
  • first, second, etc. may be used for describing various elements, the structural elements are not restricted by the terms. The terms are only used to distinguish one element from another element. For example, without departing from the scope of the present disclosure, a first structural element may be referred to as a second structural element. Similarly, the second structural element may also be referred to as the first structural element. As used herein, the term “and/or” includes any and all combinations of one or more associated items.
  • An electronic device may be one of various types of electronic devices.
  • the electronic devices may include, for example, a portable communication device (e.g., a smart phone), a computer, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance.
  • a portable communication device e.g., a smart phone
  • a computer e.g., a laptop, a desktop, a tablet, or a portable multimedia device
  • a portable medical device e.g., a portable medical device
  • camera e.g., a camera
  • a wearable device e.g., a smart bracelet
  • terms such as “1 st ,” “2nd,” “first,” and “second” may be used to distinguish a corresponding component from another component, but are not intended to limit the components in other aspects (e.g., importance or order). It is intended that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), it indicates that the element may be coupled with the other element directly (e.g., wired), wirelessly, or via a third element.
  • module may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” and “circuitry.”
  • a module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions.
  • a module may be implemented in a form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • any of the components or any combination of the components described can be used to perform one or more of the operations of the flowcharts.
  • the operations depicted in the flowcharts are exemplary operations and may involve various additional steps not explicitly provided in the flowcharts.
  • the order of the operations depicted in the flowcharts is exemplary and not exclusive, as the order may vary depending on the implementation.
  • An objective of a KV store may be to complete operations (e.g., Put/Get/Delete operations) in the fastest time possible, and in a typical KV store implementation, keys can be hashed and inserted into a hashmap.
  • Reducing tail latency of KV operations may be beneficial for several workloads like artificial intelligence/machine learning (AI/ML), data sciences, etc. Further, it may be beneficial that KV technology will adapt to dense media with lower longevity.
  • AI/ML artificial intelligence/machine learning
  • data sciences data sciences
  • KV technology will adapt to dense media with lower longevity.
  • High performance computing (HPC) storage may be designed to be compatible with media having 50-500 write cycles. Consequently, reducing a WAF caused by application or device induced GC may also be beneficial. For example, reducing device WAF may also decrease an RAF in KV stores, possibly improving overall storage performance.
  • a single NAND page can contain one key, which may result in higher device WAF when processing Delete operations and higher RAF when processing Put/Get/Exist operations.
  • worst case tail latency of a KV store may be proportional to a length of a longest collision chain in buckets of the hashmap. Increasing a number of buckets to reduce collision chains results in extra memory space required to host the buckets.
  • buckets are themselves stored in NAND, when processing Put of a KV, device WAF increases, since for almost each KV insert, the NAND page hosting the bucket may need to be replaced.
  • systems and methods are provided, which allow for the packing of multiple keys together in a single NAND page, which may reduce worst case collision length in a device hashmap.
  • Keys in the device hashmap may be grouped together to have spatial locality even though the keys themselves have no temporal locality.
  • FIG. 1 illustrates a hash implementation in a KV SSD.
  • keys are hashed and inserted into a hashmap.
  • a single NAND page can contain only one key.
  • bucket 2 f 8 in the hashmap incudes a chain for Key1, Key34, and Key21.
  • Each of Key1, Key34, and Key21 is stored on a separate NAND page. As described above, this may result in higher RAF during Puts/Gets/Exists, and higher device WAF during Deletes. Further, the worst case tail latency may be proportional to the length of longest collision chain in buckets of the hashmap, e.g., bucket 467 in FIG. 1 .
  • multiple keys may be packed together in a single NAND page to reduce the worst case collision length in a hashmap by a packing factor P (average number of keys packed per page).
  • FIG. 2 illustrates a hash implementation in a KV SSD, according to an embodiment
  • multiple keys may be packed together in a single NAND page, wherein each key contains an extent pointer.
  • a method includes gathering related keys that have no temporal locality and grouping them together to have spatial locality. That is, keys that are indexed within contiguous buckets of the hashmap may be grouped into bucket groups.
  • the format of the KV entries may be modified such that a value may be written to NAND pages and may be tracked by an extent map.
  • the extent map itself may be written to a NAND page, which may also contain part of the value, if space is available in the NAND page after writing the extent map.
  • a key contains one extent pointer to the NAND page that contains the actual extent map, which in turn locates the pages containing the value for the key.
  • FIG. 3 illustrates a KV store, according to an embodiment.
  • the KV store 300 includes a key logger 301 (e.g., an Auto Operation Logger (AOL)) that may be used to assist in key packing, a Bloom filter 303 to track keys in key logger 301 , and a tail pointer table 305 to create a back linked-list of keys in the key logger 301 .
  • AOL Auto Operation Logger
  • key logger 301 may be device wide and may only have append operations to it. Therefore, it may be implemented internally, like a Zoned namespace.
  • a Bloom filter 303 tracks keys in the key logger 301 and therefore may be compact.
  • the Bloom filter 303 may include as few as 3 pages (each 4K RAM/SRAM/DRAM).
  • a tail pointer table 305 may be so constructed that if the Bloom filter 303 denotes a hit, the number of entries required to be traversed in the key logger 301 may be limited to one or two entries only. For example, if key logger 301 has 10K entries, the tail pointer table 305 may have 5K entries (each pointer being 16 bits only).
  • FIG. 3 illustrates the components of the KV store 300 as separate elements, the disclosure is not limited thereto.
  • at least two of the components may be combined into a single element, such as a processor, integrated circuit (IC), system on chip (SoC), etc., which pay perform the corresponding operations.
  • IC integrated circuit
  • SoC system on chip
  • FIGS. 4 A and 4 B illustrate a deferred key packing operation in a KV store, according to an embodiment. More specifically, FIG. 4 A illustrates an example before processing deferred key packing in KV stores, and FIG. 4 B illustrates an example after processing deferred packing of keys from a key logger.
  • the deferred key packing operation may be based on Store (or Put) and Delete operations on KVs being first written only to the key logger. That is, instead of immediately performing the received Store and Delete operations, the entries may be written in the key logger until a certain threshold is reached and the operation may be performed.
  • the threshold may be a function of the percentage of entries in the key logger and/or a rate at which the key logger is filling up.
  • a bucket group includes 8 buckets B1 to B8 and points to logical NAND pages 6878 and 6784 on which multiple keys are packed with extent pointers (ExtentP).
  • each logical NAND page may include a maximum of 6 keys, and includes a pointer to the next page containing keys of bucket group.
  • Key1 contains an extent pointer to an extent map stored on page 7 .
  • the extent map stored on page 7 identifies the page on which the value corresponding Key1 is stored.
  • Key12 contains an extent pointer to an extent map stored on page 480
  • Key2 contains an extent pointer to an extent map stored on page 21
  • KeyA contains an extent pointer to an extent map stored on page 78
  • Key5 contains an extent pointer to an extent map stored on page 790 .
  • Each of the extent maps identifies the pages on which the values of the corresponding key are stored.
  • FIG. 4 A provides an example of a key logger with two chains of entries. Assuming that certain threshold is reached, the entries in the key logger may then be processed, i.e., deferred key packing may be performed.
  • logical page 6878 receives a new entry for Key1 that contains an extent pointer to page 250 , on which an extent map is stored, which identifies the pages one which the value corresponding to Key1 are stored.
  • old Key1 (as illustrated in FIG. 4 A ) is removed from logical page 6878 , and page 7 , which included the extent map for old Key 1 , and the pages identified by the extent map for old Key1 are queued for erase.
  • logical page 6878 receives a new entry for Key2 that contains an extent pointer to page 310 , on which an extent map is stored, which identifies the pages one which the value corresponding to Key2 are stored.
  • old Key2 (as illustrated in FIG. 4 A ) is removed from logical page 6878 , and page 21 , which included the extent map for old Key2, and the pages identified by the extent map for old Key2 are queued for erase.
  • logical page 6878 receives a new entry for Key3 that contains an extent pointer to page 560 , on which an extent map is stored, which identifies the pages one which the value corresponding to Key3 are stored.
  • FIG. 5 is a flowchart illustrating a key packing operation of a KV store, according to an embodiment.
  • a key logger logs key entries for Store and Delete operations.
  • step 503 After a certain threshold is met in the key logger in step 503 , e.g., the key logger is filled beyond a set threshold, key entries belonging to a group of adjacent buckets in a device hashmap are collated in step 505 .
  • step 507 existing keys in the device hashmap are merged with entries from the key logger to form new packed keys for each group of buckets.
  • step 509 the packed keys are written to at least one NAND page and the device hashmap is updated to point to pages containing the packed keys.
  • step 511 the key logger and its associated Bloom filter are cleared, such that the key logger can log new key entries.
  • Grouping keys that correspond to a group of buckets may be an operation of O (1) complexity.
  • a device can implement two or more independent key loggers.
  • FIG. 6 is flowchart illustrating a Put operation of a KV store, according to an embodiment.
  • step 601 upon receiving Put command for storing a KV, the KV store writes only the value of the KV to NAND pages.
  • step 603 the KV store creates an extent map page that tracks the location of the various NAND pages that contain the value of the KV.
  • the Bloom filter of the key logger is updated.
  • the Bloom filter may be updated such that a pre-determined number of known hash functions may be used to set bits in the Bloom filter bitmap.
  • a slot is selected in the tail pointer table based on the hash of the key of the KV.
  • the KV store notes the contents of the selected slot of the tail pointer table (i.e., the tail entry) and writes a current offset in the key logger to the same slot of the tail pointer table.
  • the tail pointer table may be a hashmap of entries that are present in the key logger such that each bucket pointer of the hashmap points to the latest entry that mapped to the bucket.
  • the tail pointer table may reduce the number of slots to be traversed in the key logger to find a particular key that may be indicated to be likely present in the key logger by an associated Bloom filter.
  • the KV store creates a four way tuple of the key, the NAND page containing the extent map, the opcode, and the tail entry pointer and appends the tuple to the key logger.
  • FIG. 6 utilizes a four way tuple of the key, the disclosure is not limited thereto, and different sized tuples of the keys may be used.
  • step 613 the KV store updates a hashmap of the KVs, after sufficient number of keys are logged into key logger.
  • FIG. 7 is a flowchart illustrating a Delete operation of a KV store, according to an embodiment.
  • step 701 upon receiving a Delete command for deleting a KV from the KV store, the KV store checks a Bloom filter tracking key entries in a key logger for the presence of the key to be deleted.
  • the KV store traverses a hashmap for keys in the key logger in order to check for the presence of a matching keyname in step 705 . For example, if the received Delete command is for deleting a KV for Key33, the KV determines whether the key logger already includes an entry for Key33.
  • step 707 When there is a matching keyname in the key logger in step 707 , the operation proceeds to step 711 .
  • the KV store determines if the key is present in the device hashmap in step 709 .
  • step 709 when the key is present in the device hashmap in step 709 , the operation proceeds to step 711 .
  • a Delete Key Entry tuple contains an indication of the key to be deleted, an address of the NAND page containing an extent map of the key (e.g., as read from the previous entry of the key in key logger), a delete opcode, and a current entry in tail pointer table.
  • step 713 the KV store updates the address of the key entry in tail pointer table to reflect the new Delete key entry.
  • step 715 the KV store defers the actual deletion of the key from the device hashmap. That is, the KV store waits to execute the delete operation until a certain threshold is reached within the key logger, as described above with reference to FIGS. 4 A and 4 B .
  • FIG. 8 is a flowchart illustrating a Get operation of a KV store, according to an embodiment.
  • step 801 upon receiving a Get command for retrieving a stored KV, the KV store checks a Bloom filter tracking key entries in a key logger for the presence of the key to be retrieved.
  • the KV store traverses a hashmap for keys in the key logger in order to check for the presence of a matching keyname in step 805 . For example, if the received Get command is for retrieving a KV for Key77, the KV determines whether the key logger already includes an entry for Key77.
  • the KV stores determines whether the matching keyname in the key logger includes an opcode for delete in step 815 .
  • the Get operation fails in step 817 .
  • the Get command is for retrieving a KV for Key88, but the key logger already includes an command entry to delete the KV for Key88, then the retrieve operation fails.
  • step 815 when the matching keyname in the key logger does not include an opcode for delete in step 815 , e.g., the matching keyname includes an opcode for store, the operation proceeds to step 811 .
  • the KV store determines if the key is present in the device hashmap in step 809 .
  • the Get operation fails in step 813 , as there is no key available to retrieve.
  • step 809 when the key is present in the device hashmap in step 809 , the operation proceeds to step 811 .
  • the KV store reads a NAND page containing an extent map of the key and then reads the value of the key from the NAND page or pages identified by the extent map.
  • the device hashmap stores may store multiple keys and extent pointers, which point NAND pages containing extent maps for the keys, on a single NAND page, the KV may be able to quickly identify the NAND page containing an extent map of the key and then read the value of the key from the NAND page or pages identified by the extent map.
  • FIG. 9 illustrates a block diagram of an electronic device 901 in a network environment 900 , according to one embodiment.
  • the electronic device 901 in the network environment 900 may communicate with an electronic device 902 via a first network 998 (e.g., a short-range wireless communication network), or an electronic device 904 or a server 908 via a second network 999 (e.g., a long-range wireless communication network).
  • the electronic device 901 may communicate with the electronic device 904 via the server 908 .
  • the electronic device 901 may include a processor 920 , a memory 930 , an input device 950 , a sound output device 955 , a display device 960 , an audio module 970 , a sensor module 976 , an interface 977 , a haptic module 979 , a camera module 980 , a power management module 988 , a battery 989 , a communication module 990 , a subscriber identification module (SIM) 996 , or an antenna module 997 .
  • at least one (e.g., the display device 960 or the camera module 980 ) of the components may be omitted from the electronic device 901 , or one or more other components may be added to the electronic device 901 .
  • the components may be implemented as a single integrated circuit (IC).
  • the sensor module 976 e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor
  • the display device 960 e.g., a display
  • the processor 920 may execute, for example, software (e.g., a program 940 ) to control at least one other component (e.g., a hardware or a software component) of the electronic device 901 coupled with the processor 920 , and may perform various data processing or computations. As at least part of the data processing or computations, the processor 920 may load a command or data received from another component (e.g., the sensor module 976 or the communication module 990 ) in volatile memory 932 , process the command or the data stored in the volatile memory 932 , and store resulting data in non-volatile memory 934 .
  • software e.g., a program 940
  • the processor 920 may load a command or data received from another component (e.g., the sensor module 976 or the communication module 990 ) in volatile memory 932 , process the command or the data stored in the volatile memory 932 , and store resulting data in non-volatile memory 934 .
  • the processor 920 may include a main processor 921 (e.g., a central processing unit (CPU) or an application processor (AP)), and an auxiliary processor 923 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 921 . Additionally or alternatively, the auxiliary processor 923 may be adapted to consume less power than the main processor 921 , or execute a particular function. The auxiliary processor 923 may be implemented as being separate from, or a part of, the main processor 921 .
  • auxiliary processor 923 e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)
  • the auxiliary processor 923 may be adapted to consume less power than the main processor 921 , or execute a particular function.
  • the auxiliary processor 923 may be implemented as being separate from, or a
  • the auxiliary processor 923 may control at least some of the functions or states related to at least one component (e.g., the display device 960 , the sensor module 976 , or the communication module 990 ) among the components of the electronic device 901 , instead of the main processor 921 while the main processor 921 is in an inactive (e.g., sleep) state, or together with the main processor 921 while the main processor 921 is in an active state (e.g., executing an application).
  • the auxiliary processor 923 e.g., an image signal processor or a communication processor
  • the memory 930 may store various data used by at least one component (e.g., the processor 920 or the sensor module 976 ) of the electronic device 901 .
  • the various data may include, for example, software (e.g., the program 940 ) and input data or output data for a command related thereto.
  • the memory 930 may include the volatile memory 932 or the non-volatile memory 934 .
  • the program 940 may be stored in the memory 930 as software, and may include, for example, an operating system (OS) 942 , middleware 944 , or an application 946 .
  • OS operating system
  • middleware middleware
  • application application
  • the input device 950 may receive a command or data to be used by other component (e.g., the processor 920 ) of the electronic device 901 , from the outside (e.g., a user) of the electronic device 901 .
  • the input device 950 may include, for example, a microphone, a mouse, or a keyboard.
  • the sound output device 955 may output sound signals to the outside of the electronic device 901 .
  • the sound output device 955 may include, for example, a speaker or a receiver.
  • the speaker may be used for general purposes, such as playing multimedia or recording, and the receiver may be used for receiving an incoming call.
  • the receiver may be implemented as being separate from, or a part of, the speaker.
  • the display device 960 may visually provide information to the outside (e.g., a user) of the electronic device 901 .
  • the display device 960 may include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector.
  • the display device 960 may include touch circuitry adapted to detect a touch, or sensor circuitry (e.g., a pressure sensor) adapted to measure the intensity of force incurred by the touch.
  • the audio module 970 may convert a sound into an electrical signal and vice versa. According to one embodiment, the audio module 970 may obtain the sound via the input device 950 , or output the sound via the sound output device 955 or a headphone of an external electronic device 902 directly (e.g., wired) or wirelessly coupled with the electronic device 901 .
  • the sensor module 976 may detect an operational state (e.g., power or temperature) of the electronic device 901 or an environmental state (e.g., a state of a user) external to the electronic device 901 , and then generate an electrical signal or data value corresponding to the detected state.
  • the sensor module 976 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 977 may support one or more specified protocols to be used for the electronic device 901 to be coupled with the external electronic device 902 directly (e.g., wired) or wirelessly.
  • the interface 977 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD secure digital
  • a connecting terminal 978 may include a connector via which the electronic device 901 may be physically connected with the external electronic device 902 .
  • the connecting terminal 978 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
  • the haptic module 979 may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or an electrical stimulus which may be recognized by a user via tactile sensation or kinesthetic sensation.
  • the haptic module 979 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
  • the camera module 980 may capture a still image or moving images.
  • the camera module 980 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 988 may manage power supplied to the electronic device 901 .
  • the power management module 988 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 989 may supply power to at least one component of the electronic device 901 .
  • the battery 989 may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.
  • the communication module 990 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 901 and the external electronic device (e.g., the electronic device 902 , the electronic device 904 , or the server 908 ) and performing communication via the established communication channel.
  • the communication module 990 may include one or more communication processors that are operable independently from the processor 920 (e.g., the AP) and supports a direct (e.g., wired) communication or a wireless communication.
  • the communication module 990 may include a wireless communication module 992 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 994 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module).
  • a wireless communication module 992 e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
  • GNSS global navigation satellite system
  • wired communication module 994 e.g., a local area network (LAN) communication module or a power line communication (PLC) module.
  • LAN local area network
  • PLC power line communication
  • a corresponding one of these communication modules may communicate with the external electronic device via the first network 998 (e.g., a short-range communication network, such as BluetoothTM, wireless-fidelity (Wi-Fi) direct, or a standard of the Infrared Data Association (IrDA)) or the second network 999 (e.g., a long-range communication network, such as a cellular network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)).
  • the first network 998 e.g., a short-range communication network, such as BluetoothTM, wireless-fidelity (Wi-Fi) direct, or a standard of the Infrared Data Association (IrDA)
  • the second network 999 e.g., a long-range communication network, such as a cellular network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)
  • These various types of communication modules may be implemented as a single component (e.g., a single IC
  • the wireless communication module 992 may identify and authenticate the electronic device 901 in a communication network, such as the first network 998 or the second network 999 , using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module 996 .
  • subscriber information e.g., international mobile subscriber identity (IMSI)
  • the antenna module 997 may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device 901 .
  • the antenna module 997 may include one or more antennas, and, therefrom, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network 998 or the second network 999 , may be selected, for example, by the communication module 990 (e.g., the wireless communication module 992 ).
  • the signal or the power may then be transmitted or received between the communication module 990 and the external electronic device via the selected at least one antenna.
  • At least some of the above-described components may be mutually coupled and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)).
  • an inter-peripheral communication scheme e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)
  • commands or data may be transmitted or received between the electronic device 901 and the external electronic device 904 via the server 908 coupled with the second network 999 .
  • Each of the electronic devices 902 and 904 may be a device of a same type as, or a different type, from the electronic device 901 . All or some of operations to be executed at the electronic device 901 may be executed at one or more of the external electronic devices 902 , 904 , or 908 .
  • the electronic device 901 may request the one or more external electronic devices to perform at least part of the function or the service.
  • the one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device 901 .
  • the electronic device 901 may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request.
  • a cloud computing, distributed computing, or client-server computing technology may be used, for example.
  • One embodiment may be implemented as software (e.g., the program 940 ) including one or more instructions that are stored in a storage medium (e.g., internal memory 936 or external memory 938 ) that is readable by a machine (e.g., the electronic device 901 ).
  • a processor of the electronic device 901 may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor.
  • a machine may be operated to perform at least one function according to the at least one instruction invoked.
  • the one or more instructions may include code generated by a complier or code executable by an interpreter.
  • a machine-readable storage medium may be provided in the form of a non-transitory storage medium.
  • non-transitory indicates that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.
  • a signal e.g., an electromagnetic wave
  • a method of the disclosure may be included and provided in a computer program product.
  • the computer program product may be traded as a product between a seller and a buyer.
  • the computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., Play StoreTM), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.
  • a machine-readable storage medium e.g., a compact disc read only memory (CD-ROM)
  • an application store e.g., Play StoreTM
  • two user devices e.g., smart phones
  • each component e.g., a module or a program of the above-described components may include a single entity or multiple entities. One or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In this case, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. Operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.
  • FIG. 10 illustrates a diagram of a storage system 1000 , according to an embodiment.
  • the storage system 1000 includes a host 1002 and a storage device 1004 . Although one host and one storage device is depicted, the storage system 1000 may include multiple hosts and/or multiple storage devices.
  • the storage device 1004 may be an SSD, a universal flash storage (UFS), etc.
  • the storage device 1004 includes a controller 1006 and a storage medium 1008 connected to the controller 1006 .
  • the controller 1006 may be an SSD controller, a UFS controller, etc.
  • the storage medium 1008 may include a volatile memory, a non-volatile memory, or both, and may include one or more flash memory chips (or other storage media).
  • the controller 1006 may include one or more processors, one or more error correction circuits, one or more field programmable gate arrays (FPGAs), one or more host interfaces, one or more flash bus interfaces, etc., or a combination thereof.
  • the controller 1006 may be configured to facilitate transfer of data/commands between the host 1002 and the storage medium 1008 .
  • the host 1002 sends data/commands to the storage device 1004 to be received by the controller 1006 and processed in conjunction with the storage medium 1008 .
  • the methods, processes and algorithms may be implemented on a storage device controller, such as controller 1006 .
  • the sources and destinations described herein may correspond to elements of the host 1002 (i.e., processors or applications) and the storage medium 1008 .
  • a system and method are provided, which allow for the packing of multiple keys together in a single NAND page in order to reduce the worst case collision length in a device hashmap by a packing factor P (i.e., the average number of keys packed per page).
  • related keys that have no temporal locality may be grouped together to have spatial locality. That is, keys that map to adjacent buckets in a device hashmap can be grouped together even though the keys themselves have no temporal locality.
  • NAND pages may reduce GC to when all keys in a page are invalidated.
  • the present disclosure may significantly reduce GC overheads by a factor of packing density and reduce lengths of hash-map collision chains, which may improve tail latency and lessen the number of NAND page reads that can significantly decrease lookup latencies.

Abstract

A key value (KV) store, a method thereof, and a storage system are provided herein. The KV store may include a key logger; and a processor configured to receive a first command for storing a first KV in the KV store, write a first value of the first KV to a first NAND page, generate an extent map for identifying the first memory page including the first value, write the extent map to a second memory page, append an entry for storing the first KV to the key logger, and update a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.

Description

    PRIORITY
  • This application is based on and claims priority under 35 U.S.C. § 119(e) to U.S. Provisional Patent Application Ser. No. 63/222,685, which was filed in the U.S. Patent and Trademark Office on Jul. 16, 2021, the entire content of which is incorporated herein by reference.
  • TECHNICAL AREA
  • The present disclosure relates generally to key value (KV) store operations, and more particularly to improving KV store operations by storing multiple keys together in a single NAND page.
  • BACKGROUND
  • A KV store or a KV database, is a data storage paradigm designed for storing, retrieving, and managing associative arrays, and a data structure more commonly known as a hash table. Hash tables contain a collection of objects, or records, which in turn have many different fields within them, each containing data. These records may be stored and retrieved using a key that uniquely identifies the record, and may be used to find the data within the database. KV stores often use less memory than a relational database.
  • The above information is presented as background information only to assist with an understanding of the disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the disclosure.
  • SUMMARY
  • The present disclosure is made to address at least some of the disadvantages described above and to provide at least the advantages described below.
  • An aspect of the present disclosure is to provide a system and method that allows packing of multiple keys inserted with no temporal locality, such that they may be grouped into a bunch of memory pages (e.g. NAND pages) with spatial locality. This provides a reduction in the number of NAND pages required to store all keys, and read amplification factor (RAF)/write amplification factor (WAF) reduction due to dense key packing. Further, NAND pages may limit garbage collection (GC) to when all keys in a page are invalidated.
  • Accordingly, the present disclosure may significantly reduce GC overheads by a factor of packing density and reduce lengths of hash-map collision chains, which improves tail latency and lessens the number of NAND page reads that significantly decrease lookup latencies.
  • According to one embodiment, a KV store may be provided, which includes a key logger;
  • and a processor configured to receive a first command for storing a first KV in the KV store, write a first value of the first KV to a first memory page, generate an extent map for identifying the first memory page including the value, write the extent map to a second memory page, append an entry for storing the first KV to the key logger, and update a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.
  • According to one embodiment, a method of operating a KV store may be provided. The method includes receiving a first command for storing a first KV in the KV store; writing a first value of the first KV to a first memory page; generating an extent map for identifying the first memory page including the value; writing the extent map to a second NAND page; appending an entry for storing the first KV to a key logger of the KV store; and updating a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.
  • According to one embodiment, a storage system may be provided, which includes a KV store; and a processor configured to receive a first command for storing a first KV in the KV store, write a first value of the first KV to a first memory page, generate an extent map for identifying the first memory page including the value, write the extent map to a second memory page, append an entry for storing the first KV to a key logger of the KV store, and update a device hashmap of the KV store to include a first key of the first KV, upon a threshold being met within the key logger.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which:
  • FIG. 1 illustrates a hash implementation in a KV solid state device (SSD);
  • FIG. 2 illustrates a hash implementation in a KV SSD, according to an embodiment;
  • FIG. 3 illustrates a KV store, according to an embodiment;
  • FIGS. 4A and 4B illustrate a deferred key packing operation in a KV store, according to an embodiment;
  • FIG. 5 is a flowchart illustrating a key packing operation of a KV store, according to an embodiment;
  • FIG. 6 is flowchart illustrating a Put operation of a KV store, according to an embodiment;
  • FIG. 7 is a flowchart illustrating a Delete operation of a KV store, according to an embodiment;
  • FIG. 8 is a flowchart illustrating a Get operation of a KV store, according to an embodiment;
  • FIG. 9 illustrates a block diagram of an electronic device in a network environment, according to an embodiment; and
  • FIG. 10 illustrates a diagram of a storage system, according to an embodiment.
  • DETAILED DESCRIPTION
  • Hereinafter, embodiments of the present disclosure are described in detail with reference to the accompanying drawings. It should be noted that the same elements will be designated by the same reference numerals although they are shown in different drawings. In the following description, specific details such as detailed configurations and components are merely provided to assist with the overall understanding of the embodiments of the present disclosure. Therefore, it should be apparent to those skilled in the art that various changes and modifications of the embodiments described herein may be made without departing from the scope of the present disclosure. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness. The terms described below are terms defined in consideration of the functions in the present disclosure, and may be different according to users, intentions of the users, or customs. Therefore, the definitions of the terms should be determined based on the contents throughout this specification.
  • The present disclosure may have various modifications and various embodiments, among which embodiments are described below in detail with reference to the accompanying drawings. However, it should be understood that the present disclosure is not limited to the embodiments, but includes all modifications, equivalents, and alternatives within the scope of the present disclosure.
  • Although the terms including an ordinal number such as first, second, etc. may be used for describing various elements, the structural elements are not restricted by the terms. The terms are only used to distinguish one element from another element. For example, without departing from the scope of the present disclosure, a first structural element may be referred to as a second structural element. Similarly, the second structural element may also be referred to as the first structural element. As used herein, the term “and/or” includes any and all combinations of one or more associated items.
  • The terms used herein are merely used to describe various embodiments of the present disclosure but are not intended to limit the present disclosure. Singular forms are intended to include plural forms unless the context clearly indicates otherwise. In the present disclosure, it should be understood that the terms “include” or “have” indicate existence of a feature, a number, a step, an operation, a structural element, parts, or a combination thereof, and do not exclude the existence or probability of the addition of one or more other features, numerals, steps, operations, structural elements, parts, or combinations thereof.
  • Unless defined differently, all terms used herein have the same meanings as those understood by a person skilled in the art to which the present disclosure belongs. Terms such as those defined in a generally used dictionary are to be interpreted to have the same meanings as the contextual meanings in the relevant field of art, and are not to be interpreted to have ideal or excessively formal meanings unless clearly defined in the present disclosure.
  • An electronic device according to one embodiment may be one of various types of electronic devices. The electronic devices may include, for example, a portable communication device (e.g., a smart phone), a computer, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to one embodiment of the disclosure, an electronic device is not limited to those described above.
  • The terms used in the present disclosure are not intended to limit the present disclosure but are intended to include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the descriptions of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. A singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C,” may include all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, terms such as “1st ,” “2nd,” “first,” and “second” may be used to distinguish a corresponding component from another component, but are not intended to limit the components in other aspects (e.g., importance or order). It is intended that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), it indicates that the element may be coupled with the other element directly (e.g., wired), wirelessly, or via a third element.
  • As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” and “circuitry.” A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to one embodiment, a module may be implemented in a form of an application-specific integrated circuit (ASIC).
  • Herein, any of the components or any combination of the components described (i.e., in the device diagrams) can be used to perform one or more of the operations of the flowcharts. The operations depicted in the flowcharts are exemplary operations and may involve various additional steps not explicitly provided in the flowcharts. The order of the operations depicted in the flowcharts is exemplary and not exclusive, as the order may vary depending on the implementation.
  • An objective of a KV store may be to complete operations (e.g., Put/Get/Delete operations) in the fastest time possible, and in a typical KV store implementation, keys can be hashed and inserted into a hashmap.
  • Reducing tail latency of KV operations may be beneficial for several workloads like artificial intelligence/machine learning (AI/ML), data sciences, etc. Further, it may be beneficial that KV technology will adapt to dense media with lower longevity.
  • High performance computing (HPC) storage may be designed to be compatible with media having 50-500 write cycles. Consequently, reducing a WAF caused by application or device induced GC may also be beneficial. For example, reducing device WAF may also decrease an RAF in KV stores, possibly improving overall storage performance.
  • A single NAND page can contain one key, which may result in higher device WAF when processing Delete operations and higher RAF when processing Put/Get/Exist operations.
  • Additionally, worst case tail latency of a KV store may be proportional to a length of a longest collision chain in buckets of the hashmap. Increasing a number of buckets to reduce collision chains results in extra memory space required to host the buckets.
  • Further, if buckets are themselves stored in NAND, when processing Put of a KV, device WAF increases, since for almost each KV insert, the NAND page hosting the bucket may need to be replaced.
  • In accordance with this disclosure, systems and methods are provided, which allow for the packing of multiple keys together in a single NAND page, which may reduce worst case collision length in a device hashmap. Keys in the device hashmap may be grouped together to have spatial locality even though the keys themselves have no temporal locality.
  • FIG. 1 illustrates a hash implementation in a KV SSD.
  • As illustrated in FIG. 1 , keys are hashed and inserted into a hashmap. However, a single NAND page can contain only one key. For example, bucket 2 f 8 in the hashmap incudes a chain for Key1, Key34, and Key21. Each of Key1, Key34, and Key21 is stored on a separate NAND page. As described above, this may result in higher RAF during Puts/Gets/Exists, and higher device WAF during Deletes. Further, the worst case tail latency may be proportional to the length of longest collision chain in buckets of the hashmap, e.g., bucket 467 in FIG. 1 .
  • In accordance with an embodiment of the disclosure, multiple keys may be packed together in a single NAND page to reduce the worst case collision length in a hashmap by a packing factor P (average number of keys packed per page).
  • FIG. 2 illustrates a hash implementation in a KV SSD, according to an embodiment
  • Referring to FIG. 2 , multiple keys may be packed together in a single NAND page, wherein each key contains an extent pointer.
  • A method according to an embodiment of the disclosure includes gathering related keys that have no temporal locality and grouping them together to have spatial locality. That is, keys that are indexed within contiguous buckets of the hashmap may be grouped into bucket groups.
  • Additionally, the format of the KV entries may be modified such that a value may be written to NAND pages and may be tracked by an extent map. The extent map itself may be written to a NAND page, which may also contain part of the value, if space is available in the NAND page after writing the extent map. A key contains one extent pointer to the NAND page that contains the actual extent map, which in turn locates the pages containing the value for the key.
  • This may significantly reduce device WAF/RAF when processing Get/Put/Delete operations by an entire factor of P. For example, if on an average, 4 keys can be packed into a page, the collision chain length reduces by 4 times along with a corresponding device WAF/RAF reduction by 4 times.
  • Key packing, as described above, can be achieved with minimal additional resources consumed within the KV Store.
  • FIG. 3 illustrates a KV store, according to an embodiment.
  • Referring to FIG. 3 , the KV store 300 includes a key logger 301 (e.g., an Auto Operation Logger (AOL)) that may be used to assist in key packing, a Bloom filter 303 to track keys in key logger 301, and a tail pointer table 305 to create a back linked-list of keys in the key logger 301.
  • key logger 301 may be device wide and may only have append operations to it. Therefore, it may be implemented internally, like a Zoned namespace.
  • A Bloom filter 303 tracks keys in the key logger 301 and therefore may be compact.
  • For example, if the key logger 301 contains 10K entries, the Bloom filter 303 may include as few as 3 pages (each 4K RAM/SRAM/DRAM).
  • Given that less than 0.01% of keys are logged in the key logger 301, compared to total keys in KV stores, most of the Get/Put/Delete operations will not include traversing the tail pointer table 305 of entries in the key logger 301.
  • A tail pointer table 305 may be so constructed that if the Bloom filter 303 denotes a hit, the number of entries required to be traversed in the key logger 301 may be limited to one or two entries only. For example, if key logger 301 has 10K entries, the tail pointer table 305 may have 5K entries (each pointer being 16 bits only).
  • Although FIG. 3 illustrates the components of the KV store 300 as separate elements, the disclosure is not limited thereto. For example, at least two of the components may be combined into a single element, such as a processor, integrated circuit (IC), system on chip (SoC), etc., which pay perform the corresponding operations.
  • FIGS. 4A and 4B illustrate a deferred key packing operation in a KV store, according to an embodiment. More specifically, FIG. 4A illustrates an example before processing deferred key packing in KV stores, and FIG. 4B illustrates an example after processing deferred packing of keys from a key logger. The deferred key packing operation may be based on Store (or Put) and Delete operations on KVs being first written only to the key logger. That is, instead of immediately performing the received Store and Delete operations, the entries may be written in the key logger until a certain threshold is reached and the operation may be performed. For example, the threshold may be a function of the percentage of entries in the key logger and/or a rate at which the key logger is filling up.
  • Referring to FIG. 4A, a bucket group includes 8 buckets B1 to B8 and points to logical NAND pages 6878 and 6784 on which multiple keys are packed with extent pointers (ExtentP). In the example illustrated in FIG. 4A, each logical NAND page may include a maximum of 6 keys, and includes a pointer to the next page containing keys of bucket group.
  • On logical page 6878, Key1 contains an extent pointer to an extent map stored on page 7. The extent map stored on page 7 identifies the page on which the value corresponding Key1 is stored. Similarly, Key12 contains an extent pointer to an extent map stored on page 480, Key2 contains an extent pointer to an extent map stored on page 21, KeyA contains an extent pointer to an extent map stored on page 78, and Key5 contains an extent pointer to an extent map stored on page 790. Each of the extent maps identifies the pages on which the values of the corresponding key are stored.
  • Additionally, FIG. 4A provides an example of a key logger with two chains of entries. Assuming that certain threshold is reached, the entries in the key logger may then be processed, i.e., deferred key packing may be performed.
  • Referring to FIG. 4B, among the entries of the chain being processed, there is a Store entry and a Delete entry for Key1/ExtentP 480, which essentially cancel each other out.
  • There is also Store entry for Key1/ExtentP 250. Accordingly, logical page 6878 receives a new entry for Key1 that contains an extent pointer to page 250, on which an extent map is stored, which identifies the pages one which the value corresponding to Key1 are stored.
  • Additionally, the old Key1 (as illustrated in FIG. 4A) is removed from logical page 6878, and page 7, which included the extent map for old Key 1, and the pages identified by the extent map for old Key1 are queued for erase.
  • Similarly, there is a Store entry for Key2/ExtentP 310. Accordingly, logical page 6878 receives a new entry for Key2 that contains an extent pointer to page 310, on which an extent map is stored, which identifies the pages one which the value corresponding to Key2 are stored.
  • Additionally, the old Key2 (as illustrated in FIG. 4A) is removed from logical page 6878, and page 21, which included the extent map for old Key2, and the pages identified by the extent map for old Key2 are queued for erase.
  • There is also a Store entry for Key3/ExtentP 560. Accordingly, logical page 6878 receives a new entry for Key3 that contains an extent pointer to page 560, on which an extent map is stored, which identifies the pages one which the value corresponding to Key3 are stored.
  • There is also a Delete entry for Key12, which results in Key12 being removed from logical page 6878, and page 480, which included the extent map for Key12, and the pages identified by the extent map for Key12 are queued for erase.
  • Similarly, there is a Delete entry for Key5, which results in Key5 being removed from logical page 6878, and page 790, which included the extent map for Key5, and the pages identified by the extent map for Key5 are queued for erase.
  • Because two keys were removed from logical page 6878 (Key12 and Key5) and one new key was added to logical page 6878 (Key3), only 5 keys are left on logical page 6878. Therefore, KeyX is moved from logical page 6784 (as illustrated in FIG. 3 ) to logical page 6878 (as illustrated in FIG. 4B) so that logical page 6878 includes the maximum of 6 keys.
  • FIG. 5 is a flowchart illustrating a key packing operation of a KV store, according to an embodiment.
  • Referring to FIG. 5 , in step 501, a key logger logs key entries for Store and Delete operations.
  • After a certain threshold is met in the key logger in step 503, e.g., the key logger is filled beyond a set threshold, key entries belonging to a group of adjacent buckets in a device hashmap are collated in step 505.
  • In step 507, existing keys in the device hashmap are merged with entries from the key logger to form new packed keys for each group of buckets.
  • In step 509, the packed keys are written to at least one NAND page and the device hashmap is updated to point to pages containing the packed keys.
  • In step 511, the key logger and its associated Bloom filter are cleared, such that the key logger can log new key entries.
  • Grouping keys that correspond to a group of buckets may be an operation of O (1) complexity.
  • Additionally, when adjacent buckets of a bucket group contain just one or two keys, they can end up sharing a packed key NAND page.
  • For continuity of Put/Delete/Get operations when a key logger is being processed, a device according to an embodiment can implement two or more independent key loggers.
  • FIG. 6 is flowchart illustrating a Put operation of a KV store, according to an embodiment.
  • Referring to FIG. 6 , in step 601, upon receiving Put command for storing a KV, the KV store writes only the value of the KV to NAND pages.
  • In step 603, the KV store creates an extent map page that tracks the location of the various NAND pages that contain the value of the KV.
  • In step 605, the Bloom filter of the key logger is updated. For example, the Bloom filter may be updated such that a pre-determined number of known hash functions may be used to set bits in the Bloom filter bitmap.
  • In step 607, a slot is selected in the tail pointer table based on the hash of the key of the KV. For example, the tail pointer table can contain K/2 entries, where K=total number of entries in the key logger.
  • In step 609, the KV store notes the contents of the selected slot of the tail pointer table (i.e., the tail entry) and writes a current offset in the key logger to the same slot of the tail pointer table. Basically, the tail pointer table may be a hashmap of entries that are present in the key logger such that each bucket pointer of the hashmap points to the latest entry that mapped to the bucket. The tail pointer table may reduce the number of slots to be traversed in the key logger to find a particular key that may be indicated to be likely present in the key logger by an associated Bloom filter.
  • In step 611, the KV store creates a four way tuple of the key, the NAND page containing the extent map, the opcode, and the tail entry pointer and appends the tuple to the key logger. Although FIG. 6 utilizes a four way tuple of the key, the disclosure is not limited thereto, and different sized tuples of the keys may be used.
  • In step 613, the KV store updates a hashmap of the KVs, after sufficient number of keys are logged into key logger.
  • FIG. 7 is a flowchart illustrating a Delete operation of a KV store, according to an embodiment.
  • Referring to FIG. 7 , in step 701, upon receiving a Delete command for deleting a KV from the KV store, the KV store checks a Bloom filter tracking key entries in a key logger for the presence of the key to be deleted.
  • When the Bloom filter for the key logger suggests a hit for the key in step 703, the KV store traverses a hashmap for keys in the key logger in order to check for the presence of a matching keyname in step 705. For example, if the received Delete command is for deleting a KV for Key33, the KV determines whether the key logger already includes an entry for Key33.
  • When there is a matching keyname in the key logger in step 707, the operation proceeds to step 711.
  • However, when the Bloom filter for the key logger does not suggest a hit for the key in step 703 or when there is not a matching keyname in the key logger in step 707, the KV store determines if the key is present in the device hashmap in step 709.
  • When the key is not present in the device hashmap in step 709, the operation ends as there is no key available to delete.
  • However, when the key is present in the device hashmap in step 709, the operation proceeds to step 711.
  • In step 711, the KV store creates a Delete key entry and appends it to the key logger. For example, a Delete Key Entry tuple contains an indication of the key to be deleted, an address of the NAND page containing an extent map of the key (e.g., as read from the previous entry of the key in key logger), a delete opcode, and a current entry in tail pointer table.
  • In step 713, the KV store updates the address of the key entry in tail pointer table to reflect the new Delete key entry.
  • In step 715, the KV store defers the actual deletion of the key from the device hashmap. That is, the KV store waits to execute the delete operation until a certain threshold is reached within the key logger, as described above with reference to FIGS. 4A and 4B.
  • FIG. 8 is a flowchart illustrating a Get operation of a KV store, according to an embodiment.
  • Referring to FIG. 8 , in step 801, upon receiving a Get command for retrieving a stored KV, the KV store checks a Bloom filter tracking key entries in a key logger for the presence of the key to be retrieved.
  • When the Bloom filter for the key logger suggests a hit for the key in step 803, the KV store traverses a hashmap for keys in the key logger in order to check for the presence of a matching keyname in step 805. For example, if the received Get command is for retrieving a KV for Key77, the KV determines whether the key logger already includes an entry for Key77.
  • When there is a matching keyname in the key logger in step 807, the KV stores determines whether the matching keyname in the key logger includes an opcode for delete in step 815.
  • When the matching keyname in the key logger includes an opcode for delete in step 815, the Get operation fails in step 817. For example, if the Get command is for retrieving a KV for Key88, but the key logger already includes an command entry to delete the KV for Key88, then the retrieve operation fails.
  • However, when the matching keyname in the key logger does not include an opcode for delete in step 815, e.g., the matching keyname includes an opcode for store, the operation proceeds to step 811.
  • When the Bloom filter for the key logger does not suggest a hit for the key in step 803 or when there is not a matching keyname in the key logger in step 807, the KV store determines if the key is present in the device hashmap in step 809.
  • When the key is not present in the device hashmap in step 809, the Get operation fails in step 813, as there is no key available to retrieve.
  • However, when the key is present in the device hashmap in step 809, the operation proceeds to step 811.
  • In step 811, the KV store reads a NAND page containing an extent map of the key and then reads the value of the key from the NAND page or pages identified by the extent map. As described above, because the device hashmap stores may store multiple keys and extent pointers, which point NAND pages containing extent maps for the keys, on a single NAND page, the KV may be able to quickly identify the NAND page containing an extent map of the key and then read the value of the key from the NAND page or pages identified by the extent map.
  • FIG. 9 illustrates a block diagram of an electronic device 901 in a network environment 900, according to one embodiment.
  • Referring to FIG. 9 , the electronic device 901 in the network environment 900 may communicate with an electronic device 902 via a first network 998 (e.g., a short-range wireless communication network), or an electronic device 904 or a server 908 via a second network 999 (e.g., a long-range wireless communication network). The electronic device 901 may communicate with the electronic device 904 via the server 908. The electronic device 901 may include a processor 920, a memory 930, an input device 950, a sound output device 955, a display device 960, an audio module 970, a sensor module 976, an interface 977, a haptic module 979, a camera module 980, a power management module 988, a battery 989, a communication module 990, a subscriber identification module (SIM) 996, or an antenna module 997. In one embodiment, at least one (e.g., the display device 960 or the camera module 980) of the components may be omitted from the electronic device 901, or one or more other components may be added to the electronic device 901. In one embodiment, some of the components may be implemented as a single integrated circuit (IC). For example, the sensor module 976 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be embedded in the display device 960 (e.g., a display).
  • The processor 920 may execute, for example, software (e.g., a program 940) to control at least one other component (e.g., a hardware or a software component) of the electronic device 901 coupled with the processor 920, and may perform various data processing or computations. As at least part of the data processing or computations, the processor 920 may load a command or data received from another component (e.g., the sensor module 976 or the communication module 990) in volatile memory 932, process the command or the data stored in the volatile memory 932, and store resulting data in non-volatile memory 934. The processor 920 may include a main processor 921 (e.g., a central processing unit (CPU) or an application processor (AP)), and an auxiliary processor 923 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 921. Additionally or alternatively, the auxiliary processor 923 may be adapted to consume less power than the main processor 921, or execute a particular function. The auxiliary processor 923 may be implemented as being separate from, or a part of, the main processor 921.
  • The auxiliary processor 923 may control at least some of the functions or states related to at least one component (e.g., the display device 960, the sensor module 976, or the communication module 990) among the components of the electronic device 901, instead of the main processor 921 while the main processor 921 is in an inactive (e.g., sleep) state, or together with the main processor 921 while the main processor 921 is in an active state (e.g., executing an application). According to one embodiment, the auxiliary processor 923 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 980 or the communication module 990) functionally related to the auxiliary processor 923.
  • The memory 930 may store various data used by at least one component (e.g., the processor 920 or the sensor module 976) of the electronic device 901. The various data may include, for example, software (e.g., the program 940) and input data or output data for a command related thereto. The memory 930 may include the volatile memory 932 or the non-volatile memory 934.
  • The program 940 may be stored in the memory 930 as software, and may include, for example, an operating system (OS) 942, middleware 944, or an application 946.
  • The input device 950 may receive a command or data to be used by other component (e.g., the processor 920) of the electronic device 901, from the outside (e.g., a user) of the electronic device 901. The input device 950 may include, for example, a microphone, a mouse, or a keyboard.
  • The sound output device 955 may output sound signals to the outside of the electronic device 901. The sound output device 955 may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or recording, and the receiver may be used for receiving an incoming call. According to one embodiment, the receiver may be implemented as being separate from, or a part of, the speaker.
  • The display device 960 may visually provide information to the outside (e.g., a user) of the electronic device 901. The display device 960 may include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to one embodiment, the display device 960 may include touch circuitry adapted to detect a touch, or sensor circuitry (e.g., a pressure sensor) adapted to measure the intensity of force incurred by the touch.
  • The audio module 970 may convert a sound into an electrical signal and vice versa. According to one embodiment, the audio module 970 may obtain the sound via the input device 950, or output the sound via the sound output device 955 or a headphone of an external electronic device 902 directly (e.g., wired) or wirelessly coupled with the electronic device 901.
  • The sensor module 976 may detect an operational state (e.g., power or temperature) of the electronic device 901 or an environmental state (e.g., a state of a user) external to the electronic device 901, and then generate an electrical signal or data value corresponding to the detected state. The sensor module 976 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
  • The interface 977 may support one or more specified protocols to be used for the electronic device 901 to be coupled with the external electronic device 902 directly (e.g., wired) or wirelessly. According to one embodiment, the interface 977 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
  • A connecting terminal 978 may include a connector via which the electronic device 901 may be physically connected with the external electronic device 902. According to one embodiment, the connecting terminal 978 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
  • The haptic module 979 may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or an electrical stimulus which may be recognized by a user via tactile sensation or kinesthetic sensation. According to one embodiment, the haptic module 979 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
  • The camera module 980 may capture a still image or moving images. According to one embodiment, the camera module 980 may include one or more lenses, image sensors, image signal processors, or flashes.
  • The power management module 988 may manage power supplied to the electronic device 901. The power management module 988 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
  • The battery 989 may supply power to at least one component of the electronic device 901. According to one embodiment, the battery 989 may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.
  • The communication module 990 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 901 and the external electronic device (e.g., the electronic device 902, the electronic device 904, or the server 908) and performing communication via the established communication channel. The communication module 990 may include one or more communication processors that are operable independently from the processor 920 (e.g., the AP) and supports a direct (e.g., wired) communication or a wireless communication. According to one embodiment, the communication module 990 may include a wireless communication module 992 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 994 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device via the first network 998 (e.g., a short-range communication network, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, or a standard of the Infrared Data Association (IrDA)) or the second network 999 (e.g., a long-range communication network, such as a cellular network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single IC), or may be implemented as multiple components (e.g., multiple ICs) that are separate from each other. The wireless communication module 992 may identify and authenticate the electronic device 901 in a communication network, such as the first network 998 or the second network 999, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module 996.
  • The antenna module 997 may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device 901. According to one embodiment, the antenna module 997 may include one or more antennas, and, therefrom, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network 998 or the second network 999, may be selected, for example, by the communication module 990 (e.g., the wireless communication module 992). The signal or the power may then be transmitted or received between the communication module 990 and the external electronic device via the selected at least one antenna.
  • At least some of the above-described components may be mutually coupled and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)).
  • According to one embodiment, commands or data may be transmitted or received between the electronic device 901 and the external electronic device 904 via the server 908 coupled with the second network 999. Each of the electronic devices 902 and 904 may be a device of a same type as, or a different type, from the electronic device 901. All or some of operations to be executed at the electronic device 901 may be executed at one or more of the external electronic devices 902, 904, or 908. For example, if the electronic device 901 should perform a function or a service automatically, or in response to a request from a user or another device, the electronic device 901, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device 901. The electronic device 901 may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, or client-server computing technology may be used, for example.
  • One embodiment may be implemented as software (e.g., the program 940) including one or more instructions that are stored in a storage medium (e.g., internal memory 936 or external memory 938) that is readable by a machine (e.g., the electronic device 901). For example, a processor of the electronic device 901 may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. Thus, a machine may be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include code generated by a complier or code executable by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term “non-transitory” indicates that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.
  • According to one embodiment, a method of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., Play Store™), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.
  • According to one embodiment, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities. One or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In this case, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. Operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.
  • FIG. 10 illustrates a diagram of a storage system 1000, according to an embodiment.
  • The storage system 1000 includes a host 1002 and a storage device 1004. Although one host and one storage device is depicted, the storage system 1000 may include multiple hosts and/or multiple storage devices. The storage device 1004 may be an SSD, a universal flash storage (UFS), etc. The storage device 1004 includes a controller 1006 and a storage medium 1008 connected to the controller 1006. The controller 1006 may be an SSD controller, a UFS controller, etc. The storage medium 1008 may include a volatile memory, a non-volatile memory, or both, and may include one or more flash memory chips (or other storage media). The controller 1006 may include one or more processors, one or more error correction circuits, one or more field programmable gate arrays (FPGAs), one or more host interfaces, one or more flash bus interfaces, etc., or a combination thereof. The controller 1006 may be configured to facilitate transfer of data/commands between the host 1002 and the storage medium 1008. The host 1002 sends data/commands to the storage device 1004 to be received by the controller 1006 and processed in conjunction with the storage medium 1008. As described herein, the methods, processes and algorithms may be implemented on a storage device controller, such as controller 1006. The sources and destinations described herein may correspond to elements of the host 1002 (i.e., processors or applications) and the storage medium 1008.
  • In accordance with the above-described embodiments, a system and method are provided, which allow for the packing of multiple keys together in a single NAND page in order to reduce the worst case collision length in a device hashmap by a packing factor P (i.e., the average number of keys packed per page).
  • Further, related keys that have no temporal locality may be grouped together to have spatial locality. That is, keys that map to adjacent buckets in a device hashmap can be grouped together even though the keys themselves have no temporal locality.
  • Accordingly, the number of NAND pages required to store all keys, and RAF/WAF reduction due to dense key packing may be reduced. Further, NAND pages may reduce GC to when all keys in a page are invalidated.
  • Accordingly, the present disclosure may significantly reduce GC overheads by a factor of packing density and reduce lengths of hash-map collision chains, which may improve tail latency and lessen the number of NAND page reads that can significantly decrease lookup latencies.
  • Although certain embodiments of the present disclosure have been described in the detailed description of the present disclosure, the present disclosure may be modified in various forms without departing from the scope of the present disclosure. Thus, the scope of the present disclosure shall not be determined merely based on the described embodiments, but rather determined based on the accompanying claims and equivalents thereto.

Claims (20)

1. A method for improving carrier to noise density ratio of a matched filter, the method comprising:
receiving a signal at a signal register of the matched filter;
receiving a local code at a local code register and a nulling register of the matched filter; and
correlating, at an adder tree of the matched filter, the signal register and the local code register with respect to the nulling register to obtain a correlation result, wherein the nulling register prevents high frequency samples of the signal register from affecting the correlation result.
2. The method of claim 1, wherein the matched filter corresponds to a narrowband receiver in a global navigation satellite system (GNSS).
3. The method of claim 2, wherein the signal is a time multiplexed binary offset carrier (TMBOC) transmission.
4. The method of claim 3, wherein the TMBOC transmission comprises an L1-Cp channel having binary offset carrier (BOC)(1,1) and BOC (6,1) spreading symbols.
5. The method of claim 4, wherein the high frequency samples comprise the BOC (6,1) spreading symbols of the L1-Cp channel.
6. The method of claim 1, wherein receiving the signal comprises:
receiving signal samples at a signal processor of the matched filter; and
processing the signal samples using frequencies from a carrier numerically-controlled oscillator (NCO) of the matched filter.
7. The method of claim 6, wherein receiving the signal further comprises:
digitizing the processed signal samples at a quantizer of the matched filter; and
providing the digitized processed signal samples to the signal register.
8. The method of claim 1, wherein receiving the local code comprises:
generating the local code at a local code generator of the matched filter.
9. The method of claim 8, wherein the local code is a 1-bit stream local code.
10. The method of claim 1, wherein the nulling register is aligned with timings of the high frequency samples of the signal register.
11. A matched filter for improving carrier to noise density ratio, the matched filter comprising:
a signal register receiving a signal;
a local code register receiving a local code;
a nulling register receiving the local code; and
an adder tree correlating the signal register and the local code register with respect to the nulling register to obtain a correlation result, wherein the nulling register prevents high frequency samples of the signal register from affecting the correlation result.
12. The matched filter of claim 11, wherein the matched filter corresponds to a narrowband receiver in a global navigation satellite system (GNSS).
13. The matched filter of claim 12, wherein the signal is a time multiplexed binary offset carrier (TMBOC) transmission.
14. The matched filter of claim 13, wherein the TMBOC transmission comprises an L1-Cp channel having binary offset carrier (BOC)(1,1) and BOC (6,1) spreading symbols.
15. The matched filter of claim 14, wherein the high frequency samples comprise the BOC (6,1) spreading symbols of the L1-Cp channel.
16. The matched of claim 11, further comprising:
a carrier numerically-controlled oscillator (NCO) outputting frequencies; and
a signal processor receiving signal samples and processing the signal samples using the frequencies from the carrier NCO.
17. The matched filter of claim 16, further comprising:
a quantizer digitizing the processed signal samples and providing the digitized processed signal samples to the signal register.
18. The matched filter of claim 11, further comprising:
a local code generator generating the local code and providing the local code to the local code register and the nulling register.
19. The matched filter of claim 18, wherein the local code is a 1-bit stream local code.
20. The matched filter of claim 11, wherein the nulling register is aligned with timings of the high frequency samples of the signal register.
US17/481,897 2021-07-16 2021-09-22 Key packing for flash key value store operations Abandoned US20230017732A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US17/481,897 US20230017732A1 (en) 2021-07-16 2021-09-22 Key packing for flash key value store operations
KR1020220062728A KR20230012970A (en) 2021-07-16 2022-05-23 Key packing for flash key value store operations
EP22182798.3A EP4120088A1 (en) 2021-07-16 2022-07-04 Key packing for flash key value store operations
CN202210835484.6A CN115620778A (en) 2021-07-16 2022-07-15 Key packing for flash memory key value storage operations
US18/196,185 US11892951B2 (en) 2021-07-16 2023-05-11 Key packing for flash key value store operations

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202163222685P 2021-07-16 2021-07-16
US17/481,897 US20230017732A1 (en) 2021-07-16 2021-09-22 Key packing for flash key value store operations

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/196,185 Continuation US11892951B2 (en) 2021-07-16 2023-05-11 Key packing for flash key value store operations

Publications (1)

Publication Number Publication Date
US20230017732A1 true US20230017732A1 (en) 2023-01-19

Family

ID=82547340

Family Applications (2)

Application Number Title Priority Date Filing Date
US17/481,897 Abandoned US20230017732A1 (en) 2021-07-16 2021-09-22 Key packing for flash key value store operations
US18/196,185 Active US11892951B2 (en) 2021-07-16 2023-05-11 Key packing for flash key value store operations

Family Applications After (1)

Application Number Title Priority Date Filing Date
US18/196,185 Active US11892951B2 (en) 2021-07-16 2023-05-11 Key packing for flash key value store operations

Country Status (4)

Country Link
US (2) US20230017732A1 (en)
EP (1) EP4120088A1 (en)
KR (1) KR20230012970A (en)
CN (1) CN115620778A (en)

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5490258A (en) 1991-07-29 1996-02-06 Fenner; Peter R. Associative memory for very large key spaces
US9280609B2 (en) 2009-09-08 2016-03-08 Brocade Communications Systems, Inc. Exact match lookup scheme
US9355109B2 (en) 2010-06-11 2016-05-31 The Research Foundation For The State University Of New York Multi-tier caching
US10558705B2 (en) 2010-10-20 2020-02-11 Microsoft Technology Licensing, Llc Low RAM space, high-throughput persistent key-value store using secondary memory
US9529724B2 (en) 2012-07-06 2016-12-27 Seagate Technology Llc Layered architecture for hybrid controller
US9152330B2 (en) 2014-01-09 2015-10-06 Netapp, Inc. NVRAM data organization using self-describing entities for predictable recovery after power-loss
US9438426B2 (en) * 2014-10-03 2016-09-06 Seagate Technology Llc Key-value data storage device with hybrid architecture
CN105700826A (en) 2015-12-31 2016-06-22 华为技术有限公司 Virtualization method and device
US10678457B2 (en) * 2016-11-22 2020-06-09 Nutanix, Inc. Establishing and maintaining data apportioning for availability domain fault tolerance
US10725988B2 (en) 2017-02-09 2020-07-28 Micron Technology, Inc. KVS tree
US10706106B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree modifications for maintenance operations
US10706105B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree garbage metrics
US11275762B2 (en) 2017-03-20 2022-03-15 Samsung Electronics Co., Ltd. System and method for hybrid data reliability for object storage devices
US11113159B2 (en) 2017-06-30 2021-09-07 Intel Corporation Log structure with compressed keys
US10210067B1 (en) 2017-07-28 2019-02-19 EMC IP Holding Company LLC Space accounting in presence of data storage pre-mapper
US10289345B1 (en) 2017-07-28 2019-05-14 EMC IP Holding Company LLC Contention and metadata write amplification reduction in log structured data storage mapping
US10783186B2 (en) 2017-08-31 2020-09-22 Micron Technology, Inc. Heterogenous key-value sets in tree database
US10769064B1 (en) 2017-12-20 2020-09-08 Pliops Ltd Method for retrieving key value pairs and groups of key value pairs
KR102034833B1 (en) 2018-02-09 2019-10-21 연세대학교 산학협력단 Apparatus for Accessing Data Using Internal Parallelism of Flash Storage based on Key-Value and Method thereof
US10831734B2 (en) * 2018-05-07 2020-11-10 Intel Corporation Update-insert for key-value storage interface
JP2022524487A (en) * 2019-03-12 2022-05-06 インテル・コーポレーション Computational data storage system
US11580162B2 (en) 2019-04-18 2023-02-14 Samsung Electronics Co., Ltd. Key value append
KR20210063862A (en) * 2019-11-25 2021-06-02 에스케이하이닉스 주식회사 Key-value storage and a system including the same
US20210334257A1 (en) * 2020-04-27 2021-10-28 Sap Se Pageable hash index for document store
US11403273B1 (en) * 2020-06-17 2022-08-02 Amazon Technologies, Inc. Optimizing hash table searching using bitmasks and linear probing
US20220011948A1 (en) * 2020-07-08 2022-01-13 Samsung Electronics Co., Ltd. Key sorting between key-value solid state drives and hosts
US20220092046A1 (en) * 2020-09-18 2022-03-24 Kioxia Corporation System and method for efficient expansion of key value hash table
US11755555B2 (en) * 2020-10-06 2023-09-12 EMC IP Holding Company LLC Storing an ordered associative array of pairs using an append-only storage medium
US20220382760A1 (en) * 2021-06-01 2022-12-01 Alibaba Singapore Holding Private Limited High-performance key-value store
US11474699B1 (en) * 2021-06-07 2022-10-18 The Florida International University Board Of Trustees Systems and methods for optimizing data management within key value storage

Also Published As

Publication number Publication date
CN115620778A (en) 2023-01-17
US20230281130A1 (en) 2023-09-07
EP4120088A1 (en) 2023-01-18
KR20230012970A (en) 2023-01-26
US11892951B2 (en) 2024-02-06

Similar Documents

Publication Publication Date Title
US11507299B2 (en) Method for processing data and electronic device supporting same
US11176099B2 (en) Lockless synchronization of LSM tree metadata in a distributed system
CN106610790B (en) Method and device for deleting repeated data
US11074225B2 (en) Synchronization of index copies in an LSM tree file system
CN112035410B (en) Log storage method, device, node equipment and storage medium
US10409692B1 (en) Garbage collection: timestamp entries and remove reference counts
CN112100088A (en) Electronic device and method of using memory section of the same
EP3843356A1 (en) Management method for model files and terminal device
US20230244406A1 (en) Electronic device and storage management method using same
US20230017732A1 (en) Key packing for flash key value store operations
US9817852B2 (en) Electronic system with version control mechanism and method of operation thereof
US20230289300A1 (en) System and method for efficiently obtaining information stored in an address space
US11586564B2 (en) Head of line entry processing in a buffer memory device
KR102280443B1 (en) Cloud database system with multi-cash for reducing network cost in processing select query
CN109558387B (en) Method and device for processing identity card number, storage medium and terminal
CN110442569B (en) Apparatus and method for data analysis in key value solid state device
US20230024420A1 (en) Methods and devices for file read latency reduction
EP4325369A1 (en) System and method for performing caching in hashed storage
US20230409733A1 (en) Security data processing method and device
EP4357928A1 (en) Methods and system for efficient access to solid state drive
US11210162B2 (en) Approach to improve decompression performance by scatter gather compression units and also updating checksum mechanism
US20240134801A1 (en) Methods and system for efficient access to solid state drive
US20230305999A1 (en) Method for performing integrity check, and electronic device using same
EP4332789A1 (en) Methods and system for importing data to a graph database using near-storage processing
US20230409471A1 (en) Electronic device including non-volatile memory, and non-volatile memory management method thereof

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PATWARDHAN, KEDAR SHRIKRISHNA;RAMAKRISHNAN, NITHYA;SIGNING DATES FROM 20210922 TO 20211122;REEL/FRAME:064295/0123

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION