CN104685499B - 执行过滤和投影操作的方法、系统和计算机可读介质 - Google Patents

执行过滤和投影操作的方法、系统和计算机可读介质 Download PDF

Info

Publication number
CN104685499B
CN104685499B CN201380050949.6A CN201380050949A CN104685499B CN 104685499 B CN104685499 B CN 104685499B CN 201380050949 A CN201380050949 A CN 201380050949A CN 104685499 B CN104685499 B CN 104685499B
Authority
CN
China
Prior art keywords
predicate
predicates
rows
column
result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201380050949.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN104685499A (zh
Inventor
J·施奥尔
P·安博格
R·D·霍博金斯二世
J·勒克索
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corp filed Critical Oracle International Corp
Publication of CN104685499A publication Critical patent/CN104685499A/zh
Application granted granted Critical
Publication of CN104685499B publication Critical patent/CN104685499B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201380050949.6A 2012-08-20 2013-08-13 执行过滤和投影操作的方法、系统和计算机可读介质 Active CN104685499B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/590,032 2012-08-20
US13/590,032 US9727606B2 (en) 2012-08-20 2012-08-20 Hardware implementation of the filter/project operations
PCT/US2013/054808 WO2014031393A1 (en) 2012-08-20 2013-08-13 Hardware implementation of the filter/project operations

Publications (2)

Publication Number Publication Date
CN104685499A CN104685499A (zh) 2015-06-03
CN104685499B true CN104685499B (zh) 2018-12-14

Family

ID=49034238

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380050949.6A Active CN104685499B (zh) 2012-08-20 2013-08-13 执行过滤和投影操作的方法、系统和计算机可读介质

Country Status (5)

Country Link
US (1) US9727606B2 (enExample)
EP (1) EP2885727B1 (enExample)
JP (1) JP6305406B2 (enExample)
CN (1) CN104685499B (enExample)
WO (1) WO2014031393A1 (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9600522B2 (en) 2012-08-20 2017-03-21 Oracle International Corporation Hardware implementation of the aggregation/group by operation: filter method
US9563658B2 (en) 2012-08-20 2017-02-07 Oracle International Corporation Hardware implementation of the aggregation/group by operation: hash-table method
US9176999B2 (en) * 2012-09-13 2015-11-03 International Business Machines Corporation Multiplication-based method for stitching results of predicate evaluation in column stores
US9235564B2 (en) * 2013-07-19 2016-01-12 International Business Machines Corporation Offloading projection of fixed and variable length database columns
US9275168B2 (en) * 2013-07-19 2016-03-01 International Business Machines Corporation Hardware projection of fixed and variable length columns of database tables
US9582540B2 (en) 2014-08-21 2017-02-28 International Business Machines Corporation Feedback mechanism providing row-level filtering earlier in a plan
US20160063050A1 (en) * 2014-08-28 2016-03-03 Joerg Schoen Database Migration Consistency Checker
JP6871504B2 (ja) 2016-12-27 2021-05-12 富士通株式会社 情報処理装置、データロードプログラム及びデータロード方法
US20190378028A1 (en) * 2018-06-08 2019-12-12 Microsoft Technology Licensing, Llc Accelerating machine learning inference with probabilistic predicates
EP3985528A1 (en) * 2020-10-16 2022-04-20 ABB Schweiz AG Negotiation of information contracts between information providers and consumers
US12147432B2 (en) 2021-08-31 2024-11-19 Lemon Inc. Hybrid data processing system and method
US11789936B2 (en) * 2021-08-31 2023-10-17 Lemon Inc. Storage engine for hybrid data processing
US11841845B2 (en) 2021-08-31 2023-12-12 Lemon Inc. Data consistency mechanism for hybrid data processing
US12321593B2 (en) 2021-09-27 2025-06-03 Western Digital Technologies, Inc. Regular expression filter for Unicode transformation format strings
TW202336577A (zh) * 2022-01-05 2023-09-16 以色列商紐羅布萊德有限公司 處理系統
EP4460768A1 (en) 2022-01-05 2024-11-13 Neuroblade, Ltd. Processing systems
US11853239B2 (en) * 2022-04-11 2023-12-26 Western Digital Technologies, Inc. Hardware accelerator circuits for near storage compute systems

Family Cites Families (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2519245B2 (ja) * 1987-05-15 1996-07-31 株式会社日立製作所 情報検索装置
JPH04199275A (ja) * 1990-11-26 1992-07-20 Oki Electric Ind Co Ltd データベース検索装置
JPH04320572A (ja) * 1991-04-19 1992-11-11 Toshiba Corp データ処理装置
US5511190A (en) 1995-01-20 1996-04-23 Tandem Computers, Inc. Hash-based database grouping system and method
US5655080A (en) 1995-08-14 1997-08-05 International Business Machines Corporation Distributed hash group-by cooperative processing
US5706495A (en) 1996-05-07 1998-01-06 International Business Machines Corporation Encoded-vector indices for decision support and warehousing
US5884229A (en) 1996-06-10 1999-03-16 Exxon Production Research Company Method for measuring lateral continuity at a specified subsurface location from seismic data
US5884299A (en) 1997-02-06 1999-03-16 Ncr Corporation Optimization of SQL queries involving aggregate expressions using a plurality of local and global aggregation operations
JP2000132584A (ja) * 1998-10-27 2000-05-12 Hitachi Ltd Ｈｄｌ入力方法及び装置
JP2000187668A (ja) 1998-12-22 2000-07-04 Hitachi Ltd グループ化方法と重複排除方法
US6934712B2 (en) 2000-03-21 2005-08-23 International Business Machines Corporation Tagging XML query results over relational DBMSs
US6598041B1 (en) 2000-09-07 2003-07-22 International Business Machines Corporation Method, system, and program for processing modifications to data in tables in a database system
US6581055B1 (en) * 2000-09-11 2003-06-17 Oracle International Corporation Query optimization with switch predicates
CA2327167C (en) * 2000-11-30 2007-10-16 Ibm Canada Limited-Ibm Canada Limitee Method and system for composing a query for a database and traversing the database
US6571233B2 (en) * 2000-12-06 2003-05-27 International Business Machines Corporation Optimization of SQL queries using filtering predicates
US6996569B1 (en) 2001-06-20 2006-02-07 Microstrategy Incorporated Systems and methods for custom grouping of data
US6823329B2 (en) 2002-04-02 2004-11-23 Sybase, Inc. Database system providing methodology for acceleration of queries involving functional expressions against columns having enumerated storage
US6732354B2 (en) * 2002-04-23 2004-05-04 Quicksilver Technology, Inc. Method, system and software for programming reconfigurable hardware
US6957225B1 (en) * 2002-05-07 2005-10-18 Oracle International Corporation Automatic discovery and use of column correlations in tables
US7111025B2 (en) * 2003-04-30 2006-09-19 International Business Machines Corporation Information retrieval system and method using index ANDing for improving performance
US7433886B2 (en) 2003-10-24 2008-10-07 Microsoft Corporation SQL language extensions for modifying collection-valued and scalar valued columns in a single statement
US7469241B2 (en) 2004-11-30 2008-12-23 Oracle International Corporation Efficient data aggregation operations using hash tables
US20080189251A1 (en) * 2006-08-25 2008-08-07 Jeremy Branscome Processing elements of a hardware accelerated reconfigurable processor for accelerating database operations and queries
US7974976B2 (en) * 2006-11-09 2011-07-05 Yahoo! Inc. Deriving user intent from a user query
US7870398B2 (en) * 2007-01-25 2011-01-11 International Business Machines Corporation Integrity assurance of query result from database service provider
US7925647B2 (en) * 2007-07-27 2011-04-12 Oracle International Corporation Techniques for optimizing SQL statements using user-defined indexes with auxiliary properties
US9524317B2 (en) 2007-08-24 2016-12-20 International Business Machines Corporation Optimization of aggregate queries in database management systems using an early out join when processing min and max functions
US8078595B2 (en) 2007-10-09 2011-12-13 Oracle International Corporation Secure normal forms
US8150850B2 (en) * 2008-01-07 2012-04-03 Akiban Technologies, Inc. Multiple dimensioned database architecture
US20090216757A1 (en) * 2008-02-27 2009-08-27 Robi Sen System and Method for Performing Frictionless Collaboration for Criteria Search
US8275761B2 (en) 2008-05-15 2012-09-25 International Business Machines Corporation Determining a density of a key value referenced in a database query over a range of rows
US8374986B2 (en) 2008-05-15 2013-02-12 Exegy Incorporated Method and system for accelerated stream processing
US8285748B2 (en) * 2008-05-28 2012-10-09 Oracle International Corporation Proactive information security management
US8832112B2 (en) 2008-06-17 2014-09-09 International Business Machines Corporation Encoded matrix index
US20100030728A1 (en) 2008-07-29 2010-02-04 Oracle International Corporation Computing selectivities for group of columns and expressions
US9430526B2 (en) 2008-09-29 2016-08-30 Teradata Us, Inc. Method and system for temporal aggregation
US8478775B2 (en) * 2008-10-05 2013-07-02 Microsoft Corporation Efficient large-scale filtering and/or sorting for querying of column based data encoded structures
US8312038B2 (en) 2008-12-18 2012-11-13 Oracle International Corporation Criteria builder for query builder
US8285709B2 (en) * 2009-05-12 2012-10-09 Teradata Us, Inc. High-concurrency query operator and method
US8745031B2 (en) * 2009-05-28 2014-06-03 Oracle International Corporation Cache-based predicate handling for queries on XML data using uncorrelated path-based row sources
EP2290562A1 (en) 2009-08-24 2011-03-02 Amadeus S.A.S. Segmented main-memory stored relational database table system with improved collaborative scan algorithm
US8832142B2 (en) * 2010-08-30 2014-09-09 Oracle International Corporation Query and exadata support for hybrid columnar compressed data
US10311105B2 (en) 2010-12-28 2019-06-04 Microsoft Technology Licensing, Llc Filtering queried data on data stores
US8676834B2 (en) 2011-02-16 2014-03-18 International Business Machines Corporation Set-level comparisons in dynamically formed groups
US9563658B2 (en) 2012-08-20 2017-02-07 Oracle International Corporation Hardware implementation of the aggregation/group by operation: hash-table method
US9600522B2 (en) 2012-08-20 2017-03-21 Oracle International Corporation Hardware implementation of the aggregation/group by operation: filter method

Also Published As

Publication number Publication date
WO2014031393A1 (en) 2014-02-27
US20140052743A1 (en) 2014-02-20
EP2885727A1 (en) 2015-06-24
EP2885727B1 (en) 2019-10-23
CN104685499A (zh) 2015-06-03
JP2015532748A (ja) 2015-11-12
JP6305406B2 (ja) 2018-04-04
US9727606B2 (en) 2017-08-08

Similar Documents

Publication Publication Date Title
CN104685499B (zh) 执行过滤和投影操作的方法、系统和计算机可读介质
US9600522B2 (en) Hardware implementation of the aggregation/group by operation: filter method
AU2018253523B2 (en) Profiling data with source tracking
CN104685498B (zh) 聚合/分组操作的硬件实现方式：散列表方法
US10162598B2 (en) Flash optimized columnar data layout and data access algorithms for big data query engines
US8285709B2 (en) High-concurrency query operator and method
US9697262B2 (en) Analytical data processing engine
CN104737162B (zh) 用于大规模集群中的分析型查询处理的自动反规范化
CN103250147B (zh) 数据流的连续查询
US20100005077A1 (en) Methods and systems for generating query plans that are compatible for execution in hardware
US20150088919A1 (en) Transforming a query to reuse stored data
US20170116271A1 (en) Static data caching for queries with a clause that requires multiple iterations to execute
CN105144160A (zh) 利用闪存高速缓存中动态生成的替代数据格式加速查询的方法
US20180150515A1 (en) Query Planning and Execution With Source and Sink Operators
CN105283872A (zh) 为sql处理缓存外部数据源
CN105740264A (zh) 一种分布式xml数据库的排序方法及装置
US20230222126A1 (en) Inline data reduction
JP2023090684A (ja) 分散グラフデータベースにおけるｓｐａｒｑｌクエリの最適化
Yu et al. Turbocharging geospatial visualization dashboards via a materialized sampling cube approach
CN114880393A (zh) 基于多维索引的海量时空数据可视化性能优化方法及系统
Zhou et al. A hardware-accelerated solution for hierarchical index-based merge-join
CN115455031A (zh) 一种Doris的数据查询方法、装置、存储介质及设备
Siddiqui et al. Cache-Efficient Top-k Aggregation over High Cardinality Large Datasets

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant