JP6898320B2 - インデックス確立の方法およびデバイス - Google Patents

インデックス確立の方法およびデバイス Download PDF

Info

Publication number
JP6898320B2
JP6898320B2 JP2018524442A JP2018524442A JP6898320B2 JP 6898320 B2 JP6898320 B2 JP 6898320B2 JP 2018524442 A JP2018524442 A JP 2018524442A JP 2018524442 A JP2018524442 A JP 2018524442A JP 6898320 B2 JP6898320 B2 JP 6898320B2
Authority
JP
Japan
Prior art keywords
index
column
type
time interval
search
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018524442A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019502980A (ja
JP2019502980A5 (enExample
Inventor
ジェン，ボーウェン
パン，ユエ
ウェイ，チュアンシャン
Original Assignee
アリババ グループ ホウルディング リミテッド
アリババ グループ ホウルディング リミテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アリババ グループ ホウルディング リミテッド, アリババ グループ ホウルディング リミテッド filed Critical アリババ グループ ホウルディング リミテッド
Publication of JP2019502980A publication Critical patent/JP2019502980A/ja
Publication of JP2019502980A5 publication Critical patent/JP2019502980A5/ja
Application granted granted Critical
Publication of JP6898320B2 publication Critical patent/JP6898320B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2272—Management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/221—Column-oriented storage; Management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2237—Vectors, bitmaps or matrices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2246—Trees, e.g. B+trees
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2255—Hash tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • G06F16/316—Indexing structures
    • G06F16/319—Inverted lists

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2018524442A 2015-12-01 2016-11-21 インデックス確立の方法およびデバイス Active JP6898320B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201510868254.X 2015-12-01
CN201510868254.XA CN106815260B (zh) 2015-12-01 2015-12-01 一种索引建立方法及设备
PCT/CN2016/106581 WO2017092583A1 (zh) 2015-12-01 2016-11-21 一种索引建立方法及设备

Publications (3)

Publication Number Publication Date
JP2019502980A JP2019502980A (ja) 2019-01-31
JP2019502980A5 JP2019502980A5 (enExample) 2019-12-19
JP6898320B2 true JP6898320B2 (ja) 2021-07-07

Family

ID=58796259

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018524442A Active JP6898320B2 (ja) 2015-12-01 2016-11-21 インデックス確立の方法およびデバイス

Country Status (5)

Country Link
US (1) US11003649B2 (enExample)
EP (1) EP3385864B1 (enExample)
JP (1) JP6898320B2 (enExample)
CN (1) CN106815260B (enExample)
WO (1) WO2017092583A1 (enExample)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106815260B (zh) 2015-12-01 2021-05-04 阿里巴巴集团控股有限公司 一种索引建立方法及设备
US11023439B2 (en) * 2016-09-01 2021-06-01 Morphick, Inc. Variable cardinality index and data retrieval
CN110851438B (zh) * 2018-08-20 2025-03-18 北京京东尚科信息技术有限公司 一种数据库索引优化建议与验证的方法和装置
CN110874358B (zh) * 2018-08-30 2023-05-05 阿里巴巴集团控股有限公司 多属性列的存储、检索方法和装置以及电子设备
US10545960B1 (en) * 2019-03-12 2020-01-28 The Governing Council Of The University Of Toronto System and method for set overlap searching of data lakes
CN111046130B (zh) * 2019-11-08 2023-05-23 杭州安恒信息技术股份有限公司 结合ElasticSearch和FSM的关联检索方法
CN113297454B (zh) * 2020-04-14 2025-01-03 阿里巴巴集团控股有限公司 检索方法、查询方法、装置、系统、电子设备和计算机存储介质
CN113535733B (zh) * 2021-07-26 2024-08-06 北京锐安科技有限公司 数据存储、查询方法、装置、计算机设备及存储介质
CN114168800B (zh) * 2021-11-26 2024-09-13 哈尔滨工程大学 一种基于b+树和位图索引融合树的冲突检测方法
US12182093B2 (en) * 2022-09-27 2024-12-31 Ocient Holdings LLC Applying range-based filtering during query execution based on utilizing an inverted index structure
US12321387B2 (en) * 2023-03-10 2025-06-03 Equifax Inc. Automatically generating search indexes for expediting searching of a computerized database
CN116383144A (zh) * 2023-03-23 2023-07-04 中科星图股份有限公司 一种多源异构遥感数据存储方法和装置
CN116719843B (zh) * 2023-05-31 2025-11-07 中电科金仓(北京)科技股份有限公司 数据库系统的查询方法、存储介质及设备
CN117573680B (zh) * 2024-01-17 2024-04-12 深圳市进择科技有限公司 一种基于大数据的定位数据传输管理系统及方法
CN118467669B (zh) * 2024-05-09 2025-02-25 深圳计算科学研究院 索引构建方法、字段搜索方法、装置、设备及介质

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63201716A (ja) * 1987-02-17 1988-08-19 Nec Corp インデツクス保守方式
US5404510A (en) 1992-05-21 1995-04-04 Oracle Corporation Database index design based upon request importance and the reuse and modification of similar existing indexes
JPH0785093A (ja) * 1993-09-16 1995-03-31 Nissan Motor Co Ltd インデックス自動設定方法
US5907837A (en) * 1995-07-17 1999-05-25 Microsoft Corporation Information retrieval system in an on-line network including separate content and layout of published titles
US7640244B1 (en) * 2004-06-07 2009-12-29 Teredata Us, Inc. Dynamic partition enhanced joining using a value-count index
US7392266B2 (en) * 2005-03-17 2008-06-24 International Business Machines Corporation Apparatus and method for monitoring usage of components in a database index
JP2007122405A (ja) * 2005-10-28 2007-05-17 Hitachi Ltd データベース管理システムの性能チューニングシステム
JP5162215B2 (ja) * 2007-11-22 2013-03-13 株式会社エヌ・ティ・ティ・データ データ処理装置、データ処理方法、および、プログラム
JP4237813B2 (ja) * 2008-05-26 2009-03-11 株式会社東芝 構造化文書管理システム
US8489565B2 (en) * 2009-03-24 2013-07-16 Microsoft Corporation Dynamic integrated database index management
CN101609460B (zh) * 2009-07-22 2011-12-14 中国科学院地理科学与资源研究所 一种支持异构地学数据资源的检索方法及检索系统
US8655867B2 (en) * 2010-05-13 2014-02-18 Salesforce.Com, Inc. Method and system for optimizing queries in a multi-tenant database environment
US8412701B2 (en) * 2010-09-27 2013-04-02 Computer Associates Think, Inc. Multi-dataset global index
CN102467572B (zh) * 2010-11-17 2013-10-02 英业达股份有限公司 支持重复数据删除程序的数据区块查询方法
US8396858B2 (en) * 2011-08-11 2013-03-12 International Business Machines Corporation Adding entries to an index based on use of the index
CN102779180B (zh) * 2012-06-29 2015-09-09 华为技术有限公司 数据存储系统的操作处理方法,数据存储系统
US8825664B2 (en) * 2012-08-17 2014-09-02 Splunk Inc. Indexing preview
CN103810212B (zh) * 2012-11-14 2017-05-24 阿里巴巴集团控股有限公司 一种数据库索引的自动创建方法及系统
US20140317093A1 (en) * 2013-04-22 2014-10-23 Salesforce.Com, Inc. Facilitating dynamic creation of multi-column index tables and management of customer queries in an on-demand services environment
US20150032720A1 (en) * 2013-07-23 2015-01-29 Yahoo! Inc. Optimizing database queries
CN103390066B (zh) * 2013-08-08 2016-02-17 上海新炬网络信息技术有限公司 一种数据库全局性自动化优化预警装置及其处理方法
CN104714984A (zh) 2013-12-17 2015-06-17 中国移动通信集团湖南有限公司 一种数据库优化的方法和装置
CN104112011B (zh) * 2014-07-16 2017-09-15 深圳国泰安教育技术股份有限公司 一种海量数据提取的方法及装置
CN104182460B (zh) * 2014-07-18 2017-06-13 浙江大学 基于倒排索引的时间序列相似性查询方法
US9846746B2 (en) * 2014-11-20 2017-12-19 Facebook, Inc. Querying groups of users based on user attributes for social analytics
CN104834736A (zh) * 2015-05-19 2015-08-12 深圳证券信息有限公司 构建索引库的方法、装置及检索的方法、装置和系统
CN105045851A (zh) * 2015-07-07 2015-11-11 福建天晴数码有限公司 根据日志分析自动创建数据库索引的方法及系统
CN106815260B (zh) 2015-12-01 2021-05-04 阿里巴巴集团控股有限公司 一种索引建立方法及设备
US10601593B2 (en) * 2016-09-23 2020-03-24 Microsoft Technology Licensing, Llc Type-based database confidentiality using trusted computing

Also Published As

Publication number Publication date
JP2019502980A (ja) 2019-01-31
US20180276264A1 (en) 2018-09-27
US11003649B2 (en) 2021-05-11
EP3385864B1 (en) 2024-01-03
WO2017092583A1 (zh) 2017-06-08
EP3385864A1 (en) 2018-10-10
CN106815260A (zh) 2017-06-09
CN106815260B (zh) 2021-05-04
EP3385864A4 (en) 2018-10-10

Similar Documents

Publication Publication Date Title
JP6898320B2 (ja) インデックス確立の方法およびデバイス
CN113227998B (zh) 全面支持自主json文档对象（ajd）云服务的技术
US11372860B2 (en) Processing techniques for queries where predicate values are unknown until runtime
Yang et al. Druid: A real-time analytical data store
US11157473B2 (en) Multisource semantic partitioning
CN106030573B (zh) 半结构化数据作为第一等级数据库元素的实现
CN109815283B (zh) 一种异构数据源可视化查询方法
JP6338817B2 (ja) データベースミドルウェアを用いたデータ管理システム及びその方法
US11275738B2 (en) Prefix N-gram indexing
US10769126B1 (en) Data entropy reduction across stream shard
CN107291770B (zh) 一种分布式系统中海量数据的查询方法及装置
CN102521406A (zh) 海量结构化数据复杂查询任务的分布式查询方法和系统
CN103678520A (zh) 一种基于云计算的多维区间查询方法及其系统
CN102521405A (zh) 支持高速加载的海量结构化数据存储、查询方法和系统
US9405801B2 (en) Processing a data stream
CN114254005B (zh) 分区表的分组聚集查询方法、装置、计算机设备和介质
CN108595624A (zh) 一种大规模分布式函数依赖发现方法
US20240168953A1 (en) Pruning techniques for processing top k queries
CN108319604B (zh) 一种hive中大小表关联的优化方法
CN108228654A (zh) 一种大数据分布式存储方法和系统
Xu et al. Banian: a cross-platform interactive query system for structured big data
MahmoudiNasab et al. AdaptRDF: adaptive storage management for RDF databases
Suganya et al. Efficient fragmentation and allocation in distributed databases
Li et al. The research of performance optimization methods based on Impala cluster
US20170293658A1 (en) Partition aware evaluation of top-n queries

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191106

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191106

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20201126

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201222

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210319

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210518

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210610

R150 Certificate of patent or registration of utility model

Ref document number: 6898320

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250