SG11201600613UA - Generating a multi-column index for relational databases by interleaving data bits for selectivity - Google Patents

Generating a multi-column index for relational databases by interleaving data bits for selectivity

Info

Publication number
SG11201600613UA
SG11201600613UA SG11201600613UA SG11201600613UA SG11201600613UA SG 11201600613U A SG11201600613U A SG 11201600613UA SG 11201600613U A SG11201600613U A SG 11201600613UA SG 11201600613U A SG11201600613U A SG 11201600613UA SG 11201600613U A SG11201600613U A SG 11201600613UA
Authority
SG
Singapore
Prior art keywords
selectivity
generating
data bits
relational databases
column index
Prior art date
Application number
SG11201600613UA
Other languages
English (en)
Inventor
Anurag Windlass Gupta
Original Assignee
Amazon Tech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Amazon Tech Inc filed Critical Amazon Tech Inc
Publication of SG11201600613UA publication Critical patent/SG11201600613UA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/221Column-oriented storage; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
SG11201600613UA 2013-07-29 2014-07-29 Generating a multi-column index for relational databases by interleaving data bits for selectivity SG11201600613UA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/953,432 US10394848B2 (en) 2013-07-29 2013-07-29 Generating a multi-column index for relational databases by interleaving data bits for selectivity
PCT/US2014/048531 WO2015017361A1 (en) 2013-07-29 2014-07-29 Generating a multi-column index for relational databases by interleaving data bits for selectivity

Publications (1)

Publication Number Publication Date
SG11201600613UA true SG11201600613UA (en) 2016-02-26

Family

ID=52391349

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201600613UA SG11201600613UA (en) 2013-07-29 2014-07-29 Generating a multi-column index for relational databases by interleaving data bits for selectivity

Country Status (8)

Country Link
US (3) US10394848B2 (zh)
EP (1) EP3028137B1 (zh)
JP (1) JP6388655B2 (zh)
KR (1) KR101806055B1 (zh)
CN (1) CN105408857B (zh)
CA (1) CA2920033C (zh)
SG (1) SG11201600613UA (zh)
WO (1) WO2015017361A1 (zh)

Families Citing this family (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9489423B1 (en) * 2013-08-22 2016-11-08 Amazon Technologies, Inc. Query data acquisition and analysis
US9588978B2 (en) 2013-09-30 2017-03-07 International Business Machines Corporation Merging metadata for database storage regions based on overlapping range values
US9400817B2 (en) * 2013-12-31 2016-07-26 Sybase, Inc. In-place index repair
US9715515B2 (en) * 2014-01-31 2017-07-25 Microsoft Technology Licensing, Llc External data access with split index
WO2015138497A2 (en) 2014-03-10 2015-09-17 Interana, Inc. Systems and methods for rapid data analysis
JP6273969B2 (ja) * 2014-03-28 2018-02-07 富士通株式会社 データ加工装置、情報処理装置、方法、およびプログラム
US9519687B2 (en) * 2014-06-16 2016-12-13 International Business Machines Corporation Minimizing index maintenance costs for database storage regions using hybrid zone maps and indices
US10057217B2 (en) * 2014-07-15 2018-08-21 Sap Se System and method to secure sensitive content in a URI
US10599648B2 (en) * 2014-09-26 2020-03-24 Applied Materials, Inc. Optimized storage solution for real-time queries and data modeling
US9747331B2 (en) * 2014-10-06 2017-08-29 International Business Machines Corporation Limiting scans of loosely ordered and/or grouped relations in a database
US9563687B1 (en) 2014-11-13 2017-02-07 Amazon Technologies, Inc. Storage configuration in data warehouses
US9772850B2 (en) * 2014-11-14 2017-09-26 Intel Corporation Morton coordinate adjustment processors, methods, systems, and instructions
US9772849B2 (en) * 2014-11-14 2017-09-26 Intel Corporation Four-dimensional morton coordinate conversion processors, methods, systems, and instructions
US9772848B2 (en) * 2014-11-14 2017-09-26 Intel Corporation Three-dimensional morton coordinate conversion processors, methods, systems, and instructions
US10042887B2 (en) * 2014-12-05 2018-08-07 International Business Machines Corporation Query optimization with zone map selectivity modeling
US10296507B2 (en) * 2015-02-12 2019-05-21 Interana, Inc. Methods for enhancing rapid data analysis
KR101696338B1 (ko) 2015-02-16 2017-01-13 네이버 주식회사 컬럼-인덱스 데이터 포맷을 이용하여 빅데이터를 효율적으로 처리 및 분석하는 시스템 및 방법
JP6241449B2 (ja) * 2015-05-21 2017-12-06 横河電機株式会社 データ管理システム及びデータ管理方法
US10303685B2 (en) 2015-06-08 2019-05-28 International Business Machines Corporation Data table performance optimization
US10241979B2 (en) * 2015-07-21 2019-03-26 Oracle International Corporation Accelerated detection of matching patterns
KR102385908B1 (ko) * 2015-08-11 2022-04-13 삼성전자주식회사 스토리지 장치로부터 데이터를 검색하는 방법
US10282349B2 (en) 2015-08-26 2019-05-07 International Business Machines Corporation Method for storing data elements in a database
US10360233B2 (en) * 2015-11-19 2019-07-23 Oracle International Corporation In-memory key-value store for a multi-model database
US20170220656A1 (en) * 2016-02-03 2017-08-03 Adp, Llc Information Access System
US10572462B2 (en) * 2016-04-10 2020-02-25 International Business Machines Corporation Efficient handling of sort payload in a column organized relational database
CN105956046A (zh) * 2016-04-25 2016-09-21 广州神马移动信息科技有限公司 一种字典的更新方法、系统和服务器
US10346403B2 (en) * 2016-05-06 2019-07-09 International Business Machines Corporation Value range synopsis in column-organized analytical databases
US11392620B2 (en) * 2016-06-14 2022-07-19 Micro Focus Llc Clustering log messages using probabilistic data structures
US10114846B1 (en) * 2016-06-24 2018-10-30 Amazon Technologies, Inc. Balanced distribution of sort order values for a multi-column sort order of a relational database
US10685003B2 (en) * 2016-06-29 2020-06-16 International Business Machines Corporation Building and using an atomic key with partial key searching capability
US10521411B2 (en) * 2016-08-10 2019-12-31 Moonshadow Mobile, Inc. Systems, methods, and data structures for high-speed searching or filtering of large datasets
US10650017B1 (en) 2016-08-29 2020-05-12 Amazon Technologies, Inc. Tiered storage for data processing
US20180165327A1 (en) * 2016-12-14 2018-06-14 Google Inc. Avoiding index-navigation deadlocks in database systems
KR101795564B1 (ko) * 2017-01-09 2017-11-09 네이버 주식회사 컬럼-인덱스 데이터 포맷을 이용하여 빅데이터를 효율적으로 처리 및 분석하는 시스템 및 방법
CN107391525B (zh) * 2017-03-10 2020-08-07 阿里巴巴集团控股有限公司 针对数据库的指令处理方法及装置
CN106997378B (zh) * 2017-03-13 2020-05-15 上海摩库数据技术有限公司 基于Redis的数据库数据聚合同步的方法
US10242037B2 (en) * 2017-04-20 2019-03-26 Servicenow, Inc. Index suggestion engine for relational databases
US20190005082A1 (en) * 2017-07-03 2019-01-03 Infosys Limited Method and system for committing group atomic transaction in non-relational database
US20190050436A1 (en) * 2017-08-14 2019-02-14 International Business Machines Corporation Content-based predictive organization of column families
CN107577436B (zh) * 2017-09-18 2020-07-07 杭州时趣信息技术有限公司 一种数据存储方法及装置
CN108009254A (zh) 2017-12-05 2018-05-08 北京百度网讯科技有限公司 多索引方法及装置、云系统以及计算机可读存储介质
CN110019218B (zh) 2017-12-08 2023-08-25 阿里巴巴集团控股有限公司 数据存储与查询方法及设备
US11073828B2 (en) * 2017-12-08 2021-07-27 Samsung Electronics Co., Ltd. Compression of semantic information for task and motion planning
US11411578B1 (en) * 2017-12-31 2022-08-09 Teradata Us, Inc. Bit reordering compression
US11157496B2 (en) * 2018-06-01 2021-10-26 International Business Machines Corporation Predictive data distribution for parallel databases to optimize storage and query performance
US11163764B2 (en) * 2018-06-01 2021-11-02 International Business Machines Corporation Predictive data distribution for parallel databases to optimize storage and query performance
US11151110B2 (en) * 2018-09-24 2021-10-19 Salesforce.Com, Inc. Identification of records for post-cloning tenant identifier translation
CN109800233A (zh) * 2019-01-24 2019-05-24 博云视觉科技(青岛)有限公司 一种大数据融合搜索方法
JP6702582B2 (ja) * 2019-05-09 2020-06-03 株式会社東芝 データベース管理システムおよびデータベース管理方法
US11106698B2 (en) * 2019-06-11 2021-08-31 Sap Se Multi-master with ownership transfer
US11119999B2 (en) * 2019-07-24 2021-09-14 Sap Se Zero-overhead hash filters
US20210149866A1 (en) 2019-11-20 2021-05-20 Google Llc Universal data index for rapid data exploration
CN111045994B (zh) * 2019-12-25 2023-08-22 山东方寸微电子科技有限公司 一种基于kv数据库的文件分类检索方法及系统
US10769150B1 (en) * 2019-12-26 2020-09-08 Snowflake Inc. Pruning indexes to enhance database query processing
CN111427885B (zh) * 2020-03-03 2023-06-09 中科驭数(北京)科技有限公司 基于查找表的数据库管理方法和装置
US11063601B1 (en) * 2020-04-20 2021-07-13 Netapp, Inc. File system format for persistent memory
CN111752953A (zh) * 2020-06-29 2020-10-09 北京百度网讯科技有限公司 标识生成方法、装置、设备以及存储介质
CN112035413B (zh) * 2020-09-03 2024-02-20 杭州海康威视系统技术有限公司 元数据信息查询方法、装置及存储介质
CN113312313B (zh) * 2021-01-29 2023-09-29 淘宝(中国)软件有限公司 数据查询方法、非易失性存储介质及电子设备
US11294929B1 (en) 2021-06-09 2022-04-05 Aeec Smart water data analytics
US11954134B2 (en) * 2021-12-08 2024-04-09 Sap Se Visualization of complex hierarchy data with interactive adjustments
CN115563103B (zh) * 2022-09-15 2023-12-08 河南星环众志信息科技有限公司 一种多维度聚合方法、系统、电子设备及存储介质

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5918225A (en) * 1993-04-16 1999-06-29 Sybase, Inc. SQL-based database system with improved indexing methodology
US5924088A (en) * 1997-02-28 1999-07-13 Oracle Corporation Index selection for an index access path
US6460026B1 (en) * 1999-03-30 2002-10-01 Microsoft Corporation Multidimensional data ordering
US6421662B1 (en) * 1999-06-04 2002-07-16 Oracle Corporation Generating and implementing indexes based on criteria set forth in queries
US6618720B1 (en) * 2000-06-15 2003-09-09 Ncr Corporation Common spool files for maintaining join indexes
US7450438B1 (en) * 2002-06-20 2008-11-11 Cisco Technology, Inc. Crossbar apparatus for a forwarding table memory in a router
US7158996B2 (en) * 2003-01-27 2007-01-02 International Business Machines Corporation Method, system, and program for managing database operations with respect to a database table
DE60300019D1 (de) 2003-02-18 2004-09-09 Tropf Hermann Datenbank und Methode für das Organisieren der Datenelemente
US20050027692A1 (en) * 2003-07-29 2005-02-03 International Business Machines Corporation. Method, system, and program for accessing data in a database table
US7647291B2 (en) * 2003-12-30 2010-01-12 Microsoft Corporation B-tree compression using normalized index keys
US20130104251A1 (en) * 2005-02-01 2013-04-25 Newsilike Media Group, Inc. Security systems and methods for use with structured and unstructured data
US7822776B2 (en) * 2005-12-31 2010-10-26 Michael Wayne Martin Multidimensional dynamic clustering (MDDC)
US7809759B1 (en) * 2006-08-18 2010-10-05 Unisys Corporation Dynamic preconditioning of A B+tree
US20100018569A1 (en) * 2006-09-28 2010-01-28 B-Pods Holdings Pty. Ltd. Solar Energy Harvesting Apparatus
US7577658B2 (en) * 2006-10-06 2009-08-18 Microsoft Corporation Hierarchical locking in B-tree indexes
US7827218B1 (en) 2006-11-18 2010-11-02 X-Engines, Inc. Deterministic lookup using hashed key in a multi-stride compressed trie structure
US7966343B2 (en) * 2008-04-07 2011-06-21 Teradata Us, Inc. Accessing data in a column store database based on hardware compatible data structures
US8688723B2 (en) 2007-12-21 2014-04-01 Hewlett-Packard Development Company, L.P. Methods and apparatus using range queries for multi-dimensional data in a database
CN102239472B (zh) 2008-09-05 2017-04-12 惠普发展公司,有限责任合伙企业 在支持查询的同时高效地存储日志数据
US20100088309A1 (en) * 2008-10-05 2010-04-08 Microsoft Corporation Efficient large-scale joining for querying of column based data encoded structures
WO2010067897A1 (ja) * 2008-12-12 2010-06-17 日本電気株式会社 データ圧縮装置、データ圧縮方法、データ圧縮プログラム、および、圧縮データ通信システム
US8055687B2 (en) * 2009-01-20 2011-11-08 Hewlett-Packard Development Company, L.P. System and method for determining intervals of a space filling curve in a query box
US9298761B2 (en) * 2009-04-30 2016-03-29 Hewlett Packard Enterprise Development Lp Adaptive merging in database indexes
CN101719141B (zh) * 2009-12-24 2011-09-07 成都市华为赛门铁克科技有限公司 基于目录对象的文件处理方法和系统
CN102117305B (zh) * 2010-01-06 2013-09-11 中国移动通信集团公司 查询数据的系统、方法和数据管理系统
US8359316B2 (en) * 2010-03-01 2013-01-22 International Business Machines Corporation Database table look-up
US9355109B2 (en) * 2010-06-11 2016-05-31 The Research Foundation For The State University Of New York Multi-tier caching
US8935233B2 (en) 2010-09-28 2015-01-13 International Business Machines Corporation Approximate index in relational databases
EP2445049B1 (en) 2010-10-22 2018-06-20 Belenos Clean Power Holding AG Electrode (anode and cathode) performance enhancement by composite formation with graphene oxide
US20120323923A1 (en) * 2011-06-14 2012-12-20 Bank Of America Corporation Sorting Data in Limited Memory
US8554730B2 (en) 2011-07-29 2013-10-08 International Business Machines Corporation Adding a key column to a table to be replicated
US8806160B2 (en) 2011-08-16 2014-08-12 Pure Storage, Inc. Mapping in a storage system
US9043310B2 (en) * 2011-11-08 2015-05-26 International Business Machines Corporation Accessing a dimensional data model when processing a query
US9058357B1 (en) * 2012-05-05 2015-06-16 Paraccel Llc Strategies for prefetching database blocks
US8996544B2 (en) * 2012-09-28 2015-03-31 Oracle International Corporation Pruning disk blocks of a clustered table in a relational database management system
US9430550B2 (en) * 2012-09-28 2016-08-30 Oracle International Corporation Clustering a table in a relational database management system
US9747313B2 (en) * 2012-12-19 2017-08-29 Sap Se Timeline index for managing temporal data
US9323798B2 (en) * 2013-01-14 2016-04-26 International Business Machines Corporation Storing a key value to a deleted row based on key range density
US20140280375A1 (en) * 2013-03-15 2014-09-18 Ryan Rawson Systems and methods for implementing distributed databases using many-core processors
WO2014144889A2 (en) * 2013-03-15 2014-09-18 Amazon Technologies, Inc. Scalable analysis platform for semi-structured data

Also Published As

Publication number Publication date
WO2015017361A1 (en) 2015-02-05
CN105408857B (zh) 2019-04-05
US20150032684A1 (en) 2015-01-29
JP6388655B2 (ja) 2018-09-12
CN105408857A (zh) 2016-03-16
JP2016532199A (ja) 2016-10-13
US11132384B2 (en) 2021-09-28
EP3028137B1 (en) 2020-09-02
KR101806055B1 (ko) 2017-12-06
EP3028137A1 (en) 2016-06-08
US20190377743A1 (en) 2019-12-12
CA2920033A1 (en) 2015-02-05
US20220156289A1 (en) 2022-05-19
US10394848B2 (en) 2019-08-27
KR20160033761A (ko) 2016-03-28
EP3028137A4 (en) 2017-05-17
CA2920033C (en) 2020-08-11

Similar Documents

Publication Publication Date Title
SG11201600613UA (en) Generating a multi-column index for relational databases by interleaving data bits for selectivity
ZA201506401B (en) Process for producing hydrocarbons
GB2510200B (en) A computer generated head
EP2997497A4 (en) Selecting a store for deduplicated data
PL3092356T3 (pl) Sposób wytwarzania desek podłogowych
EP2969180A4 (en) DISTILLATION REACTOR MODULE
GB201417283D0 (en) Background format optimization for enhanced SQL-like queries in hadoop
AU350222S (en) Case for a tablet computer
EP2901372A4 (en) USING DIGITAL FINGERPRINTS TO ASSOCIATE DATA WITH A WORD
GB201320225D0 (en) Processing search queries using a data structure
HUE038344T2 (hu) Eljárás szénhidrogének elõállítására
EP2965227A4 (en) METADATA OF A TEMPLATE
EP2997496A4 (en) Selecting a store for deduplicated data
EP3044706A4 (en) METHOD FOR OPTIMIZING QUERY DESIGN IN A DATA STORAGE
GB2510201B (en) A computer generated head
PT3071670T (pt) Processo integrado para produzir hidrocarbonetos
EP2805266A4 (en) GROUPING SEARCH RESULTS ON A PAGE OF PROFILES
GB201514749D0 (en) A carriage
EP2954433A4 (en) FORMATTING SEMI-STRUCTURED DATA IN A DATABASE
GB2521227B (en) Invalidation of index items for a temporary data store
TWI562728B (en) A process for producing co-crystal
EP2992447A4 (en) TABLE COLUMN COMMENTS IN A DATABASE
GB201603947D0 (en) Document-based search with facet information
GB201309877D0 (en) Information retrieval from a database system
SG11201601607VA (en) Capping stack for use with a subsea well