CN104636417B - 管理数据的系统和方法 - Google Patents

管理数据的系统和方法 Download PDF

Info

Publication number
CN104636417B
CN104636417B CN201410643041.2A CN201410643041A CN104636417B CN 104636417 B CN104636417 B CN 104636417B CN 201410643041 A CN201410643041 A CN 201410643041A CN 104636417 B CN104636417 B CN 104636417B
Authority
CN
China
Prior art keywords
data
major key
group
kvs
size
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410643041.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN104636417A (zh
Inventor
盐见达之
八重樫淑子
丁洁
吉藤伸幸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CN104636417A publication Critical patent/CN104636417A/zh
Application granted granted Critical
Publication of CN104636417B publication Critical patent/CN104636417B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2255—Hash tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2272—Management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • G06F16/316—Indexing structures
    • G06F16/325—Hash tables

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201410643041.2A 2013-11-06 2014-11-06 管理数据的系统和方法 Active CN104636417B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013230608A JP6025149B2 (ja) 2013-11-06 2013-11-06 データを管理するシステムおよび方法
JP2013-230608 2013-11-06

Publications (2)

Publication Number Publication Date
CN104636417A CN104636417A (zh) 2015-05-20
CN104636417B true CN104636417B (zh) 2017-10-13

Family

ID=53007842

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410643041.2A Active CN104636417B (zh) 2013-11-06 2014-11-06 管理数据的系统和方法

Country Status (3)

Country Link
US (2) US9659048B2 (enExample)
JP (1) JP6025149B2 (enExample)
CN (1) CN104636417B (enExample)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015097774A1 (ja) * 2013-12-25 2015-07-02 株式会社日立製作所 計算機システム及びデータ管理方法
US9779110B2 (en) * 2014-07-11 2017-10-03 Nec Corporation Placement device, placement method and recording medium, that stores placement program information processing device
US10089089B2 (en) * 2015-06-03 2018-10-02 The Mathworks, Inc. Data type reassignment
KR102416004B1 (ko) * 2015-09-02 2022-07-04 삼성전자주식회사 인터페이스 회로들, 메모리 모듈들 및 인터페이스 회로들과 메모리 모듈들을 연결하는 스위치 회로를 포함하는 서버 장치
US10437809B1 (en) * 2015-09-28 2019-10-08 Amazon Technologies, Inc. Projection-based updates
CN105354315B (zh) * 2015-11-11 2018-10-30 华为技术有限公司 分布式数据库中子表分裂的方法、子表节点和系统
US10356174B2 (en) * 2016-05-06 2019-07-16 Masergy Communications, Inc. Multi-layer data storage system
US10198461B2 (en) * 2016-05-06 2019-02-05 Masergy Communications, Inc. Data storage system
US10846024B2 (en) 2016-05-16 2020-11-24 Commvault Systems, Inc. Global de-duplication of virtual disks in a storage platform
US10425483B2 (en) 2016-05-16 2019-09-24 International Business Machines Corporation Distributed client based cache for keys using demand fault invalidation
US10795577B2 (en) 2016-05-16 2020-10-06 Commvault Systems, Inc. De-duplication of client-side data cache for virtual disks
US10248174B2 (en) 2016-05-24 2019-04-02 Hedvig, Inc. Persistent reservations for virtual disk using multiple targets
US11169706B2 (en) 2016-05-26 2021-11-09 Nutanix, Inc. Rebalancing storage I/O workloads by storage controller selection and redirection
US10706106B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree modifications for maintenance operations
US10706105B2 (en) * 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree garbage metrics
US10725988B2 (en) 2017-02-09 2020-07-28 Micron Technology, Inc. KVS tree
US10719495B2 (en) * 2017-02-09 2020-07-21 Micron Technology, Inc. Stream selection for multi-stream storage devices
US10579612B2 (en) * 2017-04-03 2020-03-03 Citrix Systems, Inc. Enforcing uniqueness of property-value pairs in a schemaless data store
CN107145522B (zh) * 2017-04-11 2019-12-31 南京南瑞集团公司 一种数据库数据内容比对方法
US10609172B1 (en) 2017-04-27 2020-03-31 Chicago Mercantile Exchange Inc. Adaptive compression of stored data
WO2019144214A1 (en) * 2017-10-10 2019-08-01 Phemi Systems Corporation Methods and systems for context-specific data set derivation from unstructured data in data storage devices
US10848468B1 (en) 2018-03-05 2020-11-24 Commvault Systems, Inc. In-flight data encryption/decryption for a distributed storage platform
US10915546B2 (en) 2018-10-10 2021-02-09 Micron Technology, Inc. Counter-based compaction of key-value store tree data block
US11100071B2 (en) 2018-10-10 2021-08-24 Micron Technology, Inc. Key-value store tree data block spill with compaction
US10922142B2 (en) 2018-10-31 2021-02-16 Nutanix, Inc. Multi-stage IOPS allocation
US11048755B2 (en) 2018-12-14 2021-06-29 Micron Technology, Inc. Key-value store tree with selective use of key portion
US10852978B2 (en) 2018-12-14 2020-12-01 Micron Technology, Inc. Key-value store using journaling with selective data storage format
US10936661B2 (en) 2018-12-26 2021-03-02 Micron Technology, Inc. Data tree with order-based node traversal
US11580162B2 (en) 2019-04-18 2023-02-14 Samsung Electronics Co., Ltd. Key value append
KR102780301B1 (ko) * 2019-08-07 2025-03-14 삼성전자주식회사 사용자 데이터에 대해 암호화 동작을 수행하는 전자 장치
US11507555B2 (en) * 2019-10-13 2022-11-22 Thoughtspot, Inc. Multi-layered key-value storage
US20210342098A1 (en) * 2020-05-03 2021-11-04 Ionir Systems Ltd. System and method for storing and retrieving data
US12124421B2 (en) * 2020-09-18 2024-10-22 Kioxia Corporation System and method for efficient expansion of key value hash table
US11853563B1 (en) * 2022-06-17 2023-12-26 Western Digital Technologies, Inc. Key value data storage device with tiers
US11966630B2 (en) * 2022-06-27 2024-04-23 Western Digital Technologies, Inc. Key-to-physical table optimization for key value data storage devices

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101483605A (zh) * 2009-02-25 2009-07-15 北京星网锐捷网络技术有限公司 数据报文的存储、查找方法和装置
CN102147798A (zh) * 2010-02-10 2011-08-10 华为技术有限公司 处理哈希查找冲突问题的方法和装置
CN102402622A (zh) * 2011-12-27 2012-04-04 北京人大金仓信息技术股份有限公司 嵌入式内存数据库的内存页面管理调度方法
CN102880628A (zh) * 2012-06-15 2013-01-16 福建星网锐捷网络有限公司 哈希数据存储方法和装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04206586A (ja) 1990-11-30 1992-07-28 Fujitsu Ltd 半導体発光装置及びその製造方法
JP4206586B2 (ja) 1999-11-12 2009-01-14 株式会社日立製作所 データベース管理方法および装置並びにデータベース管理プログラムを記録した記憶媒体
WO2011108021A1 (en) * 2010-03-01 2011-09-09 Hitachi,Ltd. File level hierarchical storage management system, method, and apparatus
US8694703B2 (en) * 2010-06-09 2014-04-08 Brocade Communications Systems, Inc. Hardware-accelerated lossless data compression
JP2013033345A (ja) 2011-08-01 2013-02-14 Internatl Business Mach Corp <Ibm> トランザクション処理システム、方法及びプログラム
JP2013045378A (ja) 2011-08-26 2013-03-04 Fujitsu Ltd ストレージ制御方法、情報処理装置およびプログラム
JP2013050836A (ja) 2011-08-31 2013-03-14 Nec Corp ストレージシステムとデータ・インテグリティのチェック方法並びにプログラム
JP5733124B2 (ja) * 2011-09-12 2015-06-10 富士通株式会社 データ管理装置、データ管理システム、データ管理方法、及びプログラム
JP2013088920A (ja) 2011-10-14 2013-05-13 Hitachi Ltd 計算機システム及びデータ管理方法
US9489429B2 (en) * 2011-11-16 2016-11-08 Hitachi, Ltd. Computer system, data management method, and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101483605A (zh) * 2009-02-25 2009-07-15 北京星网锐捷网络技术有限公司 数据报文的存储、查找方法和装置
CN102147798A (zh) * 2010-02-10 2011-08-10 华为技术有限公司 处理哈希查找冲突问题的方法和装置
CN102402622A (zh) * 2011-12-27 2012-04-04 北京人大金仓信息技术股份有限公司 嵌入式内存数据库的内存页面管理调度方法
CN102880628A (zh) * 2012-06-15 2013-01-16 福建星网锐捷网络有限公司 哈希数据存储方法和装置

Also Published As

Publication number Publication date
US9659048B2 (en) 2017-05-23
CN104636417A (zh) 2015-05-20
US10740308B2 (en) 2020-08-11
US20150127658A1 (en) 2015-05-07
US20170220572A1 (en) 2017-08-03
JP2015090615A (ja) 2015-05-11
JP6025149B2 (ja) 2016-11-16

Similar Documents

Publication Publication Date Title
CN104636417B (zh) 管理数据的系统和方法
CN105989195B (zh) 用于处理数据库数据的方法和系统
US7558802B2 (en) Information retrieving system
US5960431A (en) Method and apparatus for adding data storage bins to a stored computer database while minimizing movement of data and balancing data distribution
WO2018148198A1 (en) Merge tree modifications for maintenance operations
CN102411632B (zh) 基于链表的内存数据库页式存储方法
WO2005062206A2 (en) Extended database engine providing versioning and caching of derived data
CN101763415B (zh) 一种数据库的b树索引的生成方法及装置
CN108027763A (zh) 关系型数据库的调整装置和方法
CN110399333A (zh) 删除快照的方法、设备和计算机程序产品
CN102054000A (zh) 数据查询方法、装置及系统
CN110019199A (zh) 数据存储、查询方法、装置、设备、计算机可读存储介质
CN106599127A (zh) 应用于单机服务器的日志存储和查询方法
Lester et al. Efficient online index construction for text databases
CN102253985A (zh) 一种文件系统数据的管理方法及系统
CN111708894B (zh) 一种知识图谱创建方法
CN108153804A (zh) 一种对称分布式文件系统的元数据日志更新方法
CN109739646A (zh) 一种数据处理方法及装置
JP6098294B2 (ja) 情報秘匿化装置、情報秘匿化方法
CN110457398A (zh) 区块数据存储方法及装置
CN106776704A (zh) 统计信息收集方法和装置
KR20200092710A (ko) 이기종 스토리지 기반의 데이터베이스 관리시스템에서 하이브리드 색인장치
CN112162904A (zh) 订单变更过程整合方法、提取方法、整合装置和提取装置
CN109815244A (zh) 一种数据处理方法和装置
US7162505B2 (en) Classification of data for insertion into a database

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant