JP6356675B2 - 集約／グループ化動作：ハッシュテーブル法のハードウェア実装 - Google Patents

集約／グループ化動作：ハッシュテーブル法のハードウェア実装 Download PDF

Info

Publication number
JP6356675B2
JP6356675B2 JP2015528526A JP2015528526A JP6356675B2 JP 6356675 B2 JP6356675 B2 JP 6356675B2 JP 2015528526 A JP2015528526 A JP 2015528526A JP 2015528526 A JP2015528526 A JP 2015528526A JP 6356675 B2 JP6356675 B2 JP 6356675B2
Authority
JP
Japan
Prior art keywords
group
value
access unit
data
column
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015528526A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015528603A (ja
JP2015528603A5 (enExample
Inventor
アンバーグ，フィリップ
シャウアー，ジャスティン
ホプキンス，ロバート・デイビッド，ザ・セカンド
Original Assignee
オラクル・インターナショナル・コーポレイション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オラクル・インターナショナル・コーポレイション filed Critical オラクル・インターナショナル・コーポレイション
Publication of JP2015528603A publication Critical patent/JP2015528603A/ja
Publication of JP2015528603A5 publication Critical patent/JP2015528603A5/ja
Application granted granted Critical
Publication of JP6356675B2 publication Critical patent/JP6356675B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2433—Query languages
    • G06F16/244—Grouping and aggregation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
JP2015528526A 2012-08-20 2013-08-14 集約／グループ化動作：ハッシュテーブル法のハードウェア実装 Active JP6356675B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/590,057 US9563658B2 (en) 2012-08-20 2012-08-20 Hardware implementation of the aggregation/group by operation: hash-table method
US13/590,057 2012-08-20
PCT/US2013/055020 WO2014031416A2 (en) 2012-08-20 2013-08-14 Hardware implementation of the aggregation/group by operation: hash-table method

Publications (3)

Publication Number Publication Date
JP2015528603A JP2015528603A (ja) 2015-09-28
JP2015528603A5 JP2015528603A5 (enExample) 2016-10-06
JP6356675B2 true JP6356675B2 (ja) 2018-07-11

Family

ID=49083762

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015528526A Active JP6356675B2 (ja) 2012-08-20 2013-08-14 集約／グループ化動作：ハッシュテーブル法のハードウェア実装

Country Status (5)

Country Link
US (1) US9563658B2 (enExample)
EP (1) EP2885728B1 (enExample)
JP (1) JP6356675B2 (enExample)
CN (1) CN104685498B (enExample)
WO (1) WO2014031416A2 (enExample)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10127281B2 (en) * 2010-12-23 2018-11-13 Sap Se Dynamic hash table size estimation during database aggregation processing
US10534606B2 (en) 2011-12-08 2020-01-14 Oracle International Corporation Run-length encoding decompression
US9697174B2 (en) 2011-12-08 2017-07-04 Oracle International Corporation Efficient hardware instructions for processing bit vectors for single instruction multiple data processors
US9792117B2 (en) 2011-12-08 2017-10-17 Oracle International Corporation Loading values from a value vector into subregisters of a single instruction multiple data register
US9600522B2 (en) 2012-08-20 2017-03-21 Oracle International Corporation Hardware implementation of the aggregation/group by operation: filter method
US9727606B2 (en) 2012-08-20 2017-08-08 Oracle International Corporation Hardware implementation of the filter/project operations
US9779137B2 (en) 2013-07-09 2017-10-03 Logicblox Inc. Salient sampling for query size estimation
US11113054B2 (en) 2013-09-10 2021-09-07 Oracle International Corporation Efficient hardware instructions for single instruction multiple data processors: fast fixed-length value compression
US9606921B2 (en) 2013-09-21 2017-03-28 Oracle International Corporation Granular creation and refresh of columnar data
KR101642072B1 (ko) * 2014-05-08 2016-07-22 주식회사 알티베이스 하이브리드스토리지장치 및 방법
US11250001B2 (en) 2014-08-01 2022-02-15 International Business Machines Corporation Accurate partition sizing for memory efficient reduction operations
US10007615B1 (en) * 2015-05-01 2018-06-26 Marvell International Ltd. Methods and apparatus for performing fast caching
US10073885B2 (en) 2015-05-29 2018-09-11 Oracle International Corporation Optimizer statistics and cost model for in-memory tables
US9971808B2 (en) 2015-06-24 2018-05-15 International Business Machines Corporation Fast query processing in columnar databases with GPUs
US10067954B2 (en) 2015-07-22 2018-09-04 Oracle International Corporation Use of dynamic dictionary encoding with an associated hash table to support many-to-many joins and aggregations
CN106570022B (zh) * 2015-10-10 2020-06-23 菜鸟智能物流控股有限公司 一种跨数据源查询方法、装置及系统
US11023468B2 (en) * 2015-11-20 2021-06-01 Sap Se First/last aggregation operator on multiple keyfigures with a single table scan
US10061832B2 (en) 2016-11-28 2018-08-28 Oracle International Corporation Database tuple-encoding-aware data partitioning in a direct memory access engine
US10402425B2 (en) 2016-03-18 2019-09-03 Oracle International Corporation Tuple encoding aware direct memory access engine for scratchpad enabled multi-core processors
US10061714B2 (en) 2016-03-18 2018-08-28 Oracle International Corporation Tuple encoding aware direct memory access engine for scratchpad enabled multicore processors
US10055358B2 (en) 2016-03-18 2018-08-21 Oracle International Corporation Run length encoding aware direct memory access filtering engine for scratchpad enabled multicore processors
US10552413B2 (en) 2016-05-09 2020-02-04 Sap Se Database workload capture and replay
US10885009B1 (en) * 2016-06-14 2021-01-05 Amazon Technologies, Inc. Generating aggregate views for data indices
US10599488B2 (en) 2016-06-29 2020-03-24 Oracle International Corporation Multi-purpose events for notification and sequence control in multi-core processor systems
US10380058B2 (en) 2016-09-06 2019-08-13 Oracle International Corporation Processor core to coprocessor interface with FIFO semantics
US10783102B2 (en) * 2016-10-11 2020-09-22 Oracle International Corporation Dynamically configurable high performance database-aware hash engine
US11061876B2 (en) * 2016-11-15 2021-07-13 Sap Se Fast aggregation on compressed data
US10176114B2 (en) 2016-11-28 2019-01-08 Oracle International Corporation Row identification number generation in database direct memory access engine
US10459859B2 (en) 2016-11-28 2019-10-29 Oracle International Corporation Multicast copy ring for database direct memory access filtering engine
US10725947B2 (en) 2016-11-29 2020-07-28 Oracle International Corporation Bit vector gather row count calculation and handling in direct memory access engine
US10324634B2 (en) * 2017-04-07 2019-06-18 Micron Technology, Inc. Methods of bit-flagged sketch-based memory management and memory devices utilizing the same
US10558704B2 (en) * 2017-07-20 2020-02-11 Sap Se Smart rollover
US10698892B2 (en) * 2018-04-10 2020-06-30 Sap Se Order-independent multi-record hash generation and data filtering
CN110442574B (zh) * 2019-07-01 2022-05-03 上海赜睿信息科技有限公司 一种数据处理方法、电子设备和计算机可读存储介质
US11675767B1 (en) * 2020-11-16 2023-06-13 Databricks, Inc. Hash based rollup with passthrough
CN115344760B (zh) * 2022-07-13 2025-08-26 阿里云计算有限公司 数据处理方法及装置和电子设备

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63143627A (ja) * 1986-12-05 1988-06-15 Nippon Telegr & Teleph Corp <Ntt> 連想集約演算装置
JP2568657B2 (ja) * 1988-11-28 1997-01-08 シャープ株式会社 データ駆動型マイクロプロセッサにおけるハッシュ衝突回避方法
US5511190A (en) 1995-01-20 1996-04-23 Tandem Computers, Inc. Hash-based database grouping system and method
US5655080A (en) 1995-08-14 1997-08-05 International Business Machines Corporation Distributed hash group-by cooperative processing
US5706495A (en) 1996-05-07 1998-01-06 International Business Machines Corporation Encoded-vector indices for decision support and warehousing
US5884299A (en) 1997-02-06 1999-03-16 Ncr Corporation Optimization of SQL queries involving aggregate expressions using a plurality of local and global aggregation operations
US5890147A (en) * 1997-03-07 1999-03-30 Microsoft Corporation Scope testing of documents in a search engine using document to folder mapping
JP2000187668A (ja) * 1998-12-22 2000-07-04 Hitachi Ltd グループ化方法と重複排除方法
US6934712B2 (en) * 2000-03-21 2005-08-23 International Business Machines Corporation Tagging XML query results over relational DBMSs
US6598041B1 (en) * 2000-09-07 2003-07-22 International Business Machines Corporation Method, system, and program for processing modifications to data in tables in a database system
US6581055B1 (en) 2000-09-11 2003-06-17 Oracle International Corporation Query optimization with switch predicates
CA2327167C (en) 2000-11-30 2007-10-16 Ibm Canada Limited-Ibm Canada Limitee Method and system for composing a query for a database and traversing the database
US6571233B2 (en) 2000-12-06 2003-05-27 International Business Machines Corporation Optimization of SQL queries using filtering predicates
US6996569B1 (en) 2001-06-20 2006-02-07 Microstrategy Incorporated Systems and methods for custom grouping of data
US6823329B2 (en) 2002-04-02 2004-11-23 Sybase, Inc. Database system providing methodology for acceleration of queries involving functional expressions against columns having enumerated storage
US6957225B1 (en) 2002-05-07 2005-10-18 Oracle International Corporation Automatic discovery and use of column correlations in tables
US7111025B2 (en) 2003-04-30 2006-09-19 International Business Machines Corporation Information retrieval system and method using index ANDing for improving performance
US7433886B2 (en) 2003-10-24 2008-10-07 Microsoft Corporation SQL language extensions for modifying collection-valued and scalar valued columns in a single statement
US7469241B2 (en) 2004-11-30 2008-12-23 Oracle International Corporation Efficient data aggregation operations using hash tables
US20080189251A1 (en) 2006-08-25 2008-08-07 Jeremy Branscome Processing elements of a hardware accelerated reconfigurable processor for accelerating database operations and queries
US7974976B2 (en) 2006-11-09 2011-07-05 Yahoo! Inc. Deriving user intent from a user query
US7870398B2 (en) 2007-01-25 2011-01-11 International Business Machines Corporation Integrity assurance of query result from database service provider
US9524317B2 (en) * 2007-08-24 2016-12-20 International Business Machines Corporation Optimization of aggregate queries in database management systems using an early out join when processing min and max functions
US8078595B2 (en) * 2007-10-09 2011-12-13 Oracle International Corporation Secure normal forms
US8150850B2 (en) 2008-01-07 2012-04-03 Akiban Technologies, Inc. Multiple dimensioned database architecture
US20090216757A1 (en) 2008-02-27 2009-08-27 Robi Sen System and Method for Performing Frictionless Collaboration for Criteria Search
US8275761B2 (en) * 2008-05-15 2012-09-25 International Business Machines Corporation Determining a density of a key value referenced in a database query over a range of rows
US8374986B2 (en) 2008-05-15 2013-02-12 Exegy Incorporated Method and system for accelerated stream processing
US8832112B2 (en) * 2008-06-17 2014-09-09 International Business Machines Corporation Encoded matrix index
SE532252C2 (sv) * 2008-07-18 2009-11-24 Qliktech Internat Ab Förfarande och apparat för extrahering av information från en databas
US20100030728A1 (en) * 2008-07-29 2010-02-04 Oracle International Corporation Computing selectivities for group of columns and expressions
US9430526B2 (en) 2008-09-29 2016-08-30 Teradata Us, Inc. Method and system for temporal aggregation
US8478775B2 (en) 2008-10-05 2013-07-02 Microsoft Corporation Efficient large-scale filtering and/or sorting for querying of column based data encoded structures
US8312038B2 (en) 2008-12-18 2012-11-13 Oracle International Corporation Criteria builder for query builder
US8745031B2 (en) 2009-05-28 2014-06-03 Oracle International Corporation Cache-based predicate handling for queries on XML data using uncorrelated path-based row sources
EP2290562A1 (en) * 2009-08-24 2011-03-02 Amadeus S.A.S. Segmented main-memory stored relational database table system with improved collaborative scan algorithm
US8959070B2 (en) * 2009-09-15 2015-02-17 Factual Inc. Processes and systems for collaborative manipulation of data
US8832142B2 (en) 2010-08-30 2014-09-09 Oracle International Corporation Query and exadata support for hybrid columnar compressed data
US10311105B2 (en) 2010-12-28 2019-06-04 Microsoft Technology Licensing, Llc Filtering queried data on data stores
US8676834B2 (en) 2011-02-16 2014-03-18 International Business Machines Corporation Set-level comparisons in dynamically formed groups
US9600522B2 (en) 2012-08-20 2017-03-21 Oracle International Corporation Hardware implementation of the aggregation/group by operation: filter method
US9727606B2 (en) 2012-08-20 2017-08-08 Oracle International Corporation Hardware implementation of the filter/project operations

Also Published As

Publication number Publication date
WO2014031416A3 (en) 2014-07-24
WO2014031416A2 (en) 2014-02-27
JP2015528603A (ja) 2015-09-28
CN104685498A (zh) 2015-06-03
US20140052726A1 (en) 2014-02-20
US9563658B2 (en) 2017-02-07
CN104685498B (zh) 2018-06-08
EP2885728A2 (en) 2015-06-24
EP2885728B1 (en) 2019-07-31

Similar Documents

Publication Publication Date Title
JP6356675B2 (ja) 集約／グループ化動作：ハッシュテーブル法のハードウェア実装
CN103810237B (zh) 数据管理方法和系统
US10198363B2 (en) Reducing data I/O using in-memory data structures
US10642831B2 (en) Static data caching for queries with a clause that requires multiple iterations to execute
KR102440128B1 (ko) 통합된 객체 인터페이스를 위한 메모리 관리 장치, 시스템 및 그 방법
US9501419B2 (en) Apparatus, systems, and methods for providing a memory efficient cache
US20100257181A1 (en) Dynamic Hash Table for Efficient Data Access In A Relational Database System
CN104426770A (zh) 路由查找方法及装置、B-Tree树结构的构建方法
WO2013152678A1 (zh) 元数据查询方法和装置
US11966356B2 (en) Efficient usage of one-sided RDMA for linear probing
US11977548B2 (en) Allocating partitions for executing operations of a query
CN107239485A (zh) 数据库操作方法、装置及系统
US20240273074A1 (en) Efficient analytical calculations on a data set and method for use therewith
CN103279427A (zh) 存储标识符的基于散列的管理方法和系统
US10339052B2 (en) Massive access request for out-of-core textures by a parallel processor with limited memory
US20200387491A1 (en) Systems and methods for fast bloom filter operations
US20200142836A1 (en) Computing system and method using bit counter
CN117540056B (zh) 数据查询的方法、装置、计算机设备和存储介质
CN118394762B (zh) 分布式存储系统的存储管理方法、设备、程序产品及介质
CN116127135A (zh) 图处理装置和方法
CN112069188A (zh) 一种高性能识别新旧设备id的方法
HK1218980B (zh) 一种缓存管理方法与设备

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150421

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160810

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160810

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170719

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170801

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20171031

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20171205

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180116

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180406

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180522

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180614

R150 Certificate of patent or registration of utility model

Ref document number: 6356675

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250