WO2019047359A1 - Système d'interrogation conjonctive multi-table à base de données croisées et son procédé d'implémentation - Google Patents

Système d'interrogation conjonctive multi-table à base de données croisées et son procédé d'implémentation Download PDF

Info

Publication number
WO2019047359A1
WO2019047359A1 PCT/CN2017/109606 CN2017109606W WO2019047359A1 WO 2019047359 A1 WO2019047359 A1 WO 2019047359A1 CN 2017109606 W CN2017109606 W CN 2017109606W WO 2019047359 A1 WO2019047359 A1 WO 2019047359A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
cache
database
query
dialect
Prior art date
Application number
PCT/CN2017/109606
Other languages
English (en)
Chinese (zh)
Inventor
韩超
季统凯
Original Assignee
国云科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国云科技股份有限公司 filed Critical 国云科技股份有限公司
Publication of WO2019047359A1 publication Critical patent/WO2019047359A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24552—Database cache management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24553—Query execution of query operations
    • G06F16/24558—Binary matching operations
    • G06F16/2456—Join operations

Definitions

  • One of the technical problems solved by the present invention is to provide a cross-database multi-table joint query system; provide applications for systems that need this business scenario, simplify business processes, and improve efficiency.
  • the querier executes standard SQL, finds the required data in the data cache, and if the data is in the data cache, queries the data from the data cache and returns the result; if the data cannot be found, the SQL dialect optimizer will database Dialect optimization, obtaining data from the corresponding database; the final result is placed in the result set;
  • the different database table describes the differences of each database and points to the corresponding database
  • the result set stores the result obtained by the query.
  • the database dialect is sent to the SQL optimizer to optimize the statement to improve the execution of the database Efficiency;
  • the data obtained is stored in the data cache;
  • the data cached data is saved; when there is a new query request, the second cache is first queried whether the same data; if there is, the secondary cache Loaded into the data cache.
  • the L2 cache data replacement algorithm is as follows:
  • n be the number of visits in the last minute
  • m is the number of visits in the last two minutes
  • q is the number of visits in the last five minutes
  • the present invention consists of a compiler, an SQL dialect optimizer, a data cache, a querier, and a result set.
  • the compiler separates the query into the corresponding database dialect and standard SQL statement, executes the corresponding query statement, uses the data cache to get the data locally, and if new data needs to be stored in the data cache, the data is saved to In the secondary cache to increase the hit rate of the data.
  • SQL is sent to the querier for execution, if the data cache is missing or missing the required data, then you need to execute the corresponding database dialect to query the required data from the database; if the data is in the data cache, then from the data cache Query data and return results;
  • the database dialect is sent to the SQL optimizer to optimize the statement and improve the execution efficiency of the database
  • the List structure is used to assist in storing data, which is convenient for traversing data.
  • LinkList should be used to facilitate the modification operation.
  • the L2 cache data replacement algorithm is as follows:

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

L'invention concerne un système d'interrogation conjonctive multi-table à base de données croisées et son procédé d'implémentation, ledit système étant composé d'un compilateur, d'un optimiseur de dialecte SQL, d'une mémoire cache de données, d'un demandeur et d'un ensemble de résultats. Le procédé consiste : à séparer, au moyen du compilateur, une instruction d'interrogation dans des tables de différentes bases de données, de façon à former un dialecte de base de données indépendant ; à optimiser, par l'optimiseur, le SQL, afin d'améliorer son efficacité d'exécution ; puis à exécuter l'instruction SQL afin d'effectuer une interrogation respectivement dans des tables de différentes bases de données, les résultats d'interrogation obtenus étant stockés dans la mémoire cache de données ; et enfin, à exécuter, par le demandeur, l'instruction d'interrogation afin d'obtenir un ensemble de résultats souhaités. Ledit système et ledit procédé protègent les différences des bases de données, sont transparents au fonctionnement de couche supérieure, et peuvent être utilisés pour une interrogation conjonctive de données multi-table de base de données croisées des bases de données.
PCT/CN2017/109606 2017-09-08 2017-11-06 Système d'interrogation conjonctive multi-table à base de données croisées et son procédé d'implémentation WO2019047359A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710803626.XA CN107609091B (zh) 2017-09-08 2017-09-08 一种跨库多表联合查询系统的实现方法
CN201710803626.X 2017-09-08

Publications (1)

Publication Number Publication Date
WO2019047359A1 true WO2019047359A1 (fr) 2019-03-14

Family

ID=61063278

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/109606 WO2019047359A1 (fr) 2017-09-08 2017-11-06 Système d'interrogation conjonctive multi-table à base de données croisées et son procédé d'implémentation

Country Status (2)

Country Link
CN (1) CN107609091B (fr)
WO (1) WO2019047359A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110597849B (zh) * 2018-05-25 2022-03-22 北京国双科技有限公司 数据查询方法及装置
CN109508344B (zh) * 2018-09-29 2024-03-12 中国平安人寿保险股份有限公司 业务数据查询方法、装置、电子设备及存储介质
CN115617859A (zh) * 2022-12-16 2023-01-17 安徽华云安科技有限公司 基于知识图谱集群的数据查询方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1825309A (zh) * 2006-01-18 2006-08-30 王宏源 基于Unicode编码的跨库检索方法
CN102163195A (zh) * 2010-02-22 2011-08-24 北京东方通科技股份有限公司 一种基于分布式、异构数据库统一视图的查询优化方法
EP2463785A1 (fr) * 2010-12-13 2012-06-13 Fujitsu Limited Système de requête pour base de données et moteur de recherche
CN104572676A (zh) * 2013-10-16 2015-04-29 中国银联股份有限公司 一种针对多数据库表的跨库分页查询方法
CN107025298A (zh) * 2017-04-20 2017-08-08 科技谷（厦门）信息技术有限公司 一种大数据实时计算处理系统及方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2307155A1 (fr) * 2000-04-28 2001-10-28 Ibm Canada Limited-Ibm Canada Limitee Execution d'interrogations d'une base de donnees permettant le filtrage
CN100578498C (zh) * 2006-06-07 2010-01-06 华为技术有限公司 数据集成服务系统及方法
CN103268343A (zh) * 2013-05-24 2013-08-28 北京京东尚科信息技术有限公司 将关系数据库和缓存透明结合的系统和方法
CN104112008A (zh) * 2014-07-16 2014-10-22 深圳市国泰安信息技术有限公司 一种多表数据关联查询优化方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1825309A (zh) * 2006-01-18 2006-08-30 王宏源 基于Unicode编码的跨库检索方法
CN102163195A (zh) * 2010-02-22 2011-08-24 北京东方通科技股份有限公司 一种基于分布式、异构数据库统一视图的查询优化方法
EP2463785A1 (fr) * 2010-12-13 2012-06-13 Fujitsu Limited Système de requête pour base de données et moteur de recherche
CN104572676A (zh) * 2013-10-16 2015-04-29 中国银联股份有限公司 一种针对多数据库表的跨库分页查询方法
CN107025298A (zh) * 2017-04-20 2017-08-08 科技谷（厦门）信息技术有限公司 一种大数据实时计算处理系统及方法

Also Published As

Publication number Publication date
CN107609091A (zh) 2018-01-19
CN107609091B (zh) 2020-10-27

Similar Documents

Publication Publication Date Title
US10929398B2 (en) Distributed system with accelerator and catalog
US10726039B2 (en) Systems and methods for updating database indexes
EP3285178B1 (fr) Procédé d'interrogation de données dans une base de données de partition/croisement et dispositif d'interrogation de partition/croisement
US10803066B2 (en) Methods and systems for hardware acceleration of database operations and queries for a versioned database based on multiple hardware accelerators
US20160378826A1 (en) Caching views on historical data
US20160147804A1 (en) Forced ordering of a dictionary storing row identifier values
Hubail et al. Couchbase analytics: NoETL for scalable NoSQL data analysis
US11086868B2 (en) Materialized view rewrite technique for one-sided outer-join queries
JP2015146201A5 (fr)
US20180150515A1 (en) Query Planning and Execution With Source and Sink Operators
KR20170024039A (ko) 유연한 스키마를 사용한 데이터 관리
WO2019047359A1 (fr) Système d'interrogation conjonctive multi-table à base de données croisées et son procédé d'implémentation
US20200183918A1 (en) Management of Transactions Spanning Different Database Types
US9519662B2 (en) Boolean term conversion for null-tolerant disjunctive predicates
Tatemura et al. Partiqle: An elastic SQL engine over key-value stores
JP6157004B2 (ja) 仮想データベースシステム管理装置、管理方法及び管理プログラム
US9229969B2 (en) Management of searches in a database system
US8380701B1 (en) Using a partially built index in a computer database system
Arnold et al. A high-performance distributed relational database system for scalable OLAP processing
US10810116B2 (en) In-memory database with page size adaptation during loading
Sudhir et al. Pando: Enhanced Data Skipping with Logical Data Partitioning
US11194773B2 (en) Integration of existing databases into a sharding environment
WO2020147334A1 (fr) Procédé et système d'interrogation de données reposant sur une architecture de cache ignite
Arnold et al. HRDBMS: Combining the best of modern and traditional relational databases
CN103353891A (zh) 数据库管理系统及其数据处理方法

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17924059

Country of ref document: EP

Kind code of ref document: A1