CN111971666B - 优化sql查询计划的维度上下文传播技术 - Google Patents

优化sql查询计划的维度上下文传播技术 Download PDF

Info

Publication number
CN111971666B
CN111971666B CN201980008847.5A CN201980008847A CN111971666B CN 111971666 B CN111971666 B CN 111971666B CN 201980008847 A CN201980008847 A CN 201980008847A CN 111971666 B CN111971666 B CN 111971666B
Authority
CN
China
Prior art keywords
fact
query plan
dimension
plan
predicate condition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980008847.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN111971666A (zh
Inventor
H·布塔尼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corp filed Critical Oracle International Corp
Publication of CN111971666A publication Critical patent/CN111971666A/zh
Application granted granted Critical
Publication of CN111971666B publication Critical patent/CN111971666B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24542—Plan optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/248—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Operations Research (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201980008847.5A 2018-01-16 2019-01-16 优化sql查询计划的维度上下文传播技术 Active CN111971666B (zh)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201862617970P 2018-01-16 2018-01-16
US62/617,970 2018-01-16
US201862747642P 2018-10-18 2018-10-18
US62/747,642 2018-10-18
US16/248,061 US11036735B2 (en) 2018-01-16 2019-01-15 Dimension context propagation techniques for optimizing SQL query plans
US16/248,061 2019-01-15
PCT/US2019/013827 WO2019143705A1 (en) 2018-01-16 2019-01-16 Dimension context propagation techniques for optimizing sql query plans

Publications (2)

Publication Number Publication Date
CN111971666A CN111971666A (zh) 2020-11-20
CN111971666B true CN111971666B (zh) 2024-10-29

Family

ID=67212927

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980008847.5A Active CN111971666B (zh) 2018-01-16 2019-01-16 优化sql查询计划的维度上下文传播技术

Country Status (6)

Country Link
US (1) US11036735B2 (enExample)
EP (1) EP3740880A1 (enExample)
JP (1) JP7273045B2 (enExample)
KR (1) KR102627690B1 (enExample)
CN (1) CN111971666B (enExample)
WO (1) WO2019143705A1 (enExample)

Families Citing this family (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11494378B2 (en) * 2018-06-19 2022-11-08 Salesforce, Inc. Runtime optimization of grouping operators
US11392592B2 (en) * 2018-11-05 2022-07-19 Sindice Limited Method for efficient backend evaluation of aggregates on composite relationships in a relationally mapped ER model
US11599539B2 (en) * 2018-12-26 2023-03-07 Palantir Technologies Inc. Column lineage and metadata propagation
US10970272B2 (en) * 2019-01-31 2021-04-06 Sap Se Data cloud—platform for data enrichment
CN110263105B (zh) * 2019-05-21 2021-09-10 北京百度网讯科技有限公司 查询处理方法、查询处理系统、服务器和计算机可读介质
EP3959635A1 (en) * 2019-05-29 2022-03-02 Sigma Computing, Inc. Row-level worksheet security
US11086894B1 (en) * 2019-06-25 2021-08-10 Amazon Technologies, Inc. Dynamically updated data sheets using row links
US11194793B1 (en) 2019-06-25 2021-12-07 Amazon Technologies, Inc. Dynamically materialized views for sheets based data
EP4014126A4 (en) * 2019-08-15 2023-08-16 Telepathy Labs, Inc. System and method for querying multiple data sources
US12271375B2 (en) 2019-09-10 2025-04-08 Wind Jammer Technologies, LLC Disaggregated query processing utilizing precise, parallel, asynchronous shared storage repository access
JP7383799B2 (ja) * 2019-09-13 2023-11-20 タブロー ソフトウェア，エルエルシー マルチファクトデータセットのデータ視覚化を生成するための適切な測度集計の活用
US11449796B2 (en) * 2019-09-20 2022-09-20 Amazon Technologies, Inc. Machine learning inference calls for database query processing
US11263220B2 (en) 2019-09-27 2022-03-01 Amazon Technologies, Inc. On-demand execution of object transformation code in output path of object storage service
US11656892B1 (en) * 2019-09-27 2023-05-23 Amazon Technologies, Inc. Sequential execution of user-submitted code and native functions
US11550944B2 (en) 2019-09-27 2023-01-10 Amazon Technologies, Inc. Code execution environment customization system for object storage service
CN110968895B (zh) * 2019-11-29 2022-04-05 北京百度网讯科技有限公司 一种数据的处理方法、装置、电子设备及存储介质
US11681708B2 (en) 2019-12-26 2023-06-20 Snowflake Inc. Indexed regular expression search with N-grams
US10769150B1 (en) 2019-12-26 2020-09-08 Snowflake Inc. Pruning indexes to enhance database query processing
US12050605B2 (en) 2019-12-26 2024-07-30 Snowflake Inc. Indexed geospatial predicate search
US11308090B2 (en) * 2019-12-26 2022-04-19 Snowflake Inc. Pruning index to support semi-structured data types
US10997179B1 (en) 2019-12-26 2021-05-04 Snowflake Inc. Pruning index for optimization of pattern matching queries
US11372860B2 (en) * 2019-12-26 2022-06-28 Snowflake Inc. Processing techniques for queries where predicate values are unknown until runtime
US11567939B2 (en) 2019-12-26 2023-01-31 Snowflake Inc. Lazy reassembling of semi-structured data
US11144527B2 (en) * 2020-01-14 2021-10-12 International Business Machines Corporation Optimizing database table scans in the presence of ordered data
US11392607B2 (en) * 2020-01-30 2022-07-19 International Business Machines Corporation Automatic feature engineering during online scoring phase
US20210311942A1 (en) * 2020-04-02 2021-10-07 International Business Machines Corporation Dynamically altering a query access plan
CN111597209B (zh) * 2020-04-30 2023-11-14 清华大学 一种数据库物化视图构建系统、方法以及系统创建方法
US11301517B2 (en) * 2020-05-07 2022-04-12 Ebay Inc. Method and system for identifying, managing, and monitoring data dependencies
US11288271B2 (en) * 2020-05-28 2022-03-29 Microsoft Technology Licensing, Llc Data lake workload optimization through explaining and optimizing index recommendations
US11468102B2 (en) * 2020-06-05 2022-10-11 Teradata Us, Inc. Optimizing limit queries over analytical functions
US12174834B2 (en) * 2020-07-07 2024-12-24 AtScale, Inc. Datacube access connectors
US12026161B2 (en) * 2020-07-07 2024-07-02 AtScale, Inc. Hierarchical datacube query plan generation
US11216462B1 (en) 2020-08-14 2022-01-04 Snowflake Inc. Transient materialized view rewrite
US12216650B2 (en) * 2020-09-25 2025-02-04 Oracle International Corporation System and method for use of a fragmented query model in an analytic applications environment
US11580123B2 (en) * 2020-11-13 2023-02-14 Google Llc Columnar techniques for big metadata management
US11379485B2 (en) * 2020-12-08 2022-07-05 Sap Se Inferred predicates for query optimization
PT116969A (pt) * 2020-12-23 2022-06-23 Altice Labs S A Geração de plano de computação de principais indicadores de desempenho
EP4275133A4 (en) * 2021-01-07 2024-11-13 Telepathy Labs, Inc. SYSTEM AND METHOD FOR ANALYZING DATA FROM MULTIPLE DATA SOURCES
US20220245470A1 (en) * 2021-02-03 2022-08-04 Asserts Inc. Automatically generating an application knowledge graph
CN115599811A (zh) * 2021-07-09 2023-01-13 华为技术有限公司（Cn） 数据处理的方法、装置和计算系统
US20230081212A1 (en) * 2021-08-27 2023-03-16 Oracle International Corporation System and method for providing multi-hub datasets for use with data analytics environments
US11782921B2 (en) * 2021-11-08 2023-10-10 Google Llc Columnar cache query using hybrid query execution plan
CN113792079B (zh) * 2021-11-17 2022-02-08 腾讯科技（深圳）有限公司 数据查询方法、装置、计算机设备和存储介质
DK181649B1 (en) * 2021-12-30 2024-09-04 Agillic As System for and computer-implemented method of large-scale data communication
US12197440B2 (en) 2022-03-24 2025-01-14 International Business Machines Corporation Database query performance improvement
KR102776086B1 (ko) 2022-04-11 2025-03-07 주식회사 이노와이어리스 사용자의 쿼리 패턴을 이용한 쿼리 성능 향상 방법
CN114925086A (zh) * 2022-05-06 2022-08-19 北京天予运通科技有限公司 自服务数据平台
US11960463B2 (en) * 2022-05-23 2024-04-16 Sap Se Multi-fragment index scan
US12222939B2 (en) * 2022-06-06 2025-02-11 Microsoft Technology Licensing, Llc Systems and methods for accelerating and optimizing groupwise comparison in relational databases
US11893016B1 (en) 2022-10-26 2024-02-06 Snowflake Inc. Secure predicate derivation of queries using metadata
US11880369B1 (en) 2022-11-21 2024-01-23 Snowflake Inc. Pruning data based on state of top K operator
KR102649770B1 (ko) * 2023-01-10 2024-03-21 쿠팡 주식회사 정보를 제공하는 방법 및 이를 지원하는 전자 장치
US12417822B2 (en) * 2023-05-04 2025-09-16 Click Therapeutics, Inc. Management and coordination of data for digital therapeutics trials
CN116303833B (zh) * 2023-05-18 2023-07-21 联通沃音乐文化有限公司 一种基于olap的向量化数据混合存储方法
US12380110B2 (en) * 2023-07-11 2025-08-05 Sap Se Table scan predicate with integrated semi-join filter
US12405952B2 (en) * 2023-11-29 2025-09-02 Google Llc Zero knowledge response
CN117520385B (zh) * 2024-01-05 2024-04-16 凯美瑞德（苏州）信息科技股份有限公司 一种基于探索价值和查询代价的数据库查询优化方法
CN117591547B (zh) * 2024-01-18 2024-09-27 中昊芯英(杭州)科技有限公司 数据库的查询方法、装置、终端设备以及存储介质
US12259902B1 (en) * 2024-03-05 2025-03-25 Sap Se Federating multidimensional OLAP data from different sources
US12361000B1 (en) * 2024-03-19 2025-07-15 Paypal, Inc. Automatic query and data retrieval optimization through procedural generation of data tables from query patterns
CN118467669B (zh) * 2024-05-09 2025-02-25 深圳计算科学研究院 索引构建方法、字段搜索方法、装置、设备及介质
US12367195B1 (en) * 2024-06-17 2025-07-22 Visa International Service Association Query record estimator

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6014656A (en) * 1996-06-21 2000-01-11 Oracle Corporation Using overlapping partitions of data for query optimization

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7080062B1 (en) * 1999-05-18 2006-07-18 International Business Machines Corporation Optimizing database queries using query execution plans derived from automatic summary table determining cost based queries
US7133865B1 (en) * 1999-07-21 2006-11-07 Torben Bach Pedersen Method and systems for making OLAP hierarchies summarisable
JP2001243242A (ja) * 2000-02-25 2001-09-07 Hitachi Ltd 問合せ処理方法およびそれを実施するデータベース管理システムその処理プログラムを格納した記録媒体
JP2002007435A (ja) * 2000-06-20 2002-01-11 Nec Corp 対話的分析データベースシステム及び対話的分析プログラムを記録した記録媒体
US6567802B1 (en) * 2000-09-06 2003-05-20 The Trustees Of The University Of Pennsylvania Systematic approach to query optimization
US7383246B2 (en) * 2003-10-31 2008-06-03 International Business Machines Corporation System, method, and computer program product for progressive query processing
US8086598B1 (en) * 2006-08-02 2011-12-27 Hewlett-Packard Development Company, L.P. Query optimizer with schema conversion
US8108399B2 (en) * 2007-05-18 2012-01-31 Microsoft Corporation Filtering of multi attribute data via on-demand indexing
US8352458B2 (en) * 2008-05-07 2013-01-08 Oracle International Corporation Techniques for transforming and loading data into a fact table in a data warehouse
US8161035B2 (en) * 2009-06-04 2012-04-17 Oracle International Corporation Query optimization by specifying path-based predicate evaluation in a path-based query operator
US9043310B2 (en) * 2011-11-08 2015-05-26 International Business Machines Corporation Accessing a dimensional data model when processing a query
US8589382B2 (en) 2011-12-29 2013-11-19 International Business Machines Corporation Multi-fact query processing in data processing system
US8762407B2 (en) 2012-04-17 2014-06-24 Renmin University Of China Concurrent OLAP-oriented database query processing method
US9043309B2 (en) * 2012-06-05 2015-05-26 Oracle International Corporation SQL transformation-based optimization techniques for enforcement of data access control
US20150088919A1 (en) * 2013-09-20 2015-03-26 Oracle International Corporation Transforming a query to reuse stored data
US9477724B2 (en) * 2014-06-23 2016-10-25 Sap Se Framework for visualizing re-written queries to database
US9747331B2 (en) 2014-10-06 2017-08-29 International Business Machines Corporation Limiting scans of loosely ordered and/or grouped relations in a database
US10133778B2 (en) * 2015-11-20 2018-11-20 Sap Se Query optimization using join cardinality
US10762037B2 (en) * 2016-03-25 2020-09-01 Hitachi, Ltd Data processing system
US10528599B1 (en) * 2016-12-16 2020-01-07 Amazon Technologies, Inc. Tiered data processing for distributed data

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6014656A (en) * 1996-06-21 2000-01-11 Oracle Corporation Using overlapping partitions of data for query optimization

Also Published As

Publication number Publication date
KR20200106950A (ko) 2020-09-15
KR102627690B1 (ko) 2024-01-23
JP2021511582A (ja) 2021-05-06
EP3740880A1 (en) 2020-11-25
JP7273045B2 (ja) 2023-05-12
US20190220464A1 (en) 2019-07-18
WO2019143705A1 (en) 2019-07-25
US11036735B2 (en) 2021-06-15
CN111971666A (zh) 2020-11-20

Similar Documents

Publication Publication Date Title
CN111971666B (zh) 优化sql查询计划的维度上下文传播技术
US12282757B2 (en) System and method for automated mapping of data types for use with dataflow environments
JP6617117B2 (ja) 半構造データのためのスケーラブルな分析プラットフォーム
Das et al. Ricardo: integrating R and Hadoop
Naumann Data profiling revisited
US10169433B2 (en) Systems and methods for an SQL-driven distributed operating system
JP6416194B2 (ja) 半構造データのためのスケーラブルな分析プラットフォーム
US20160328432A1 (en) System and method for management of time series data sets
US20130311454A1 (en) Data source analytics
Haelen et al. Delta Lake: Up and Running: Modern Data Lakehouse Architectures with Delta Lake
WO2024011038A1 (en) Cleaning and organizing schemaless semi-structured data for extract, transform, and load processing
Sinthong et al. AFrame: Extending DataFrames for large-scale modern data analysis (Extended Version)
Praveen Foundations of data engineering: concepts, principles and practices
US20250335435A1 (en) Query generation based on natural language question and semantic data
Schildgen et al. Transformations on Graph Databases for Polyglot Persistence with NotaQL
Chaudhuri et al. An Overview of Business Intelligence Technology BI technologies are essential to running today's businesses and this technology is going through sea changes.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant