CN106716400A - 一种数据表的分区管理方法及装置 - Google Patents

一种数据表的分区管理方法及装置 Download PDF

Info

Publication number
CN106716400A
CN106716400A CN201580001180.8A CN201580001180A CN106716400A CN 106716400 A CN106716400 A CN 106716400A CN 201580001180 A CN201580001180 A CN 201580001180A CN 106716400 A CN106716400 A CN 106716400A
Authority
CN
China
Prior art keywords
dimensional
subregion
row copy
data
dimension table
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201580001180.8A
Other languages
English (en)
Other versions
CN106716400B (zh
Inventor
刘哲
沈柯
王铁英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN106716400A publication Critical patent/CN106716400A/zh
Application granted granted Critical
Publication of CN106716400B publication Critical patent/CN106716400B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/221—Column-oriented storage; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种数据表的分区管理方法及装置，包括：确定表组中每个数据表的类型以及关联键，所述数据表的类型包括一维维度表、多维维度表或事实表(S301)；根据所述表组中每个所述数据表的类型，针对每个所述数据表中的关联键对每个所述数据表的行副本空间进行一维分区以及列副本空间进行一维或多维分区(S302)。针对不同类型以及不同维度的数据表采用不同的分区管理方法，从而在一个系统里高效的实现OLTP和OLAP的数据处理机制，节省了资源消耗。

Description

PCT国内申请，说明书已公开。

Claims (21)

  1. PCT国内申请，权利要求书已公开。
CN201580001180.8A 2015-06-26 2015-06-26 一种数据表的分区管理方法及装置 Active CN106716400B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/082513 WO2016206100A1 (zh) 2015-06-26 2015-06-26 一种数据表的分区管理方法及装置

Publications (2)

Publication Number Publication Date
CN106716400A true CN106716400A (zh) 2017-05-24
CN106716400B CN106716400B (zh) 2019-09-27

Family

ID=57584634

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580001180.8A Active CN106716400B (zh) 2015-06-26 2015-06-26 一种数据表的分区管理方法及装置

Country Status (3)

Country Link
US (1) US11226986B2 (zh)
CN (1) CN106716400B (zh)
WO (1) WO2016206100A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491294A (zh) * 2018-03-15 2018-09-04 中国银行股份有限公司 一种数据库备份方法、装置及系统
CN112905596A (zh) * 2021-03-05 2021-06-04 北京中经惠众科技有限公司 数据处理的方法、装置、计算机设备以及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11016969B1 (en) * 2020-11-25 2021-05-25 Coupang Corp. Systems and methods for managing a highly available distributed hybrid transactional and analytical database
CN115292360A (zh) * 2022-09-29 2022-11-04 北京迪力科技有限责任公司 一种副本的数据分区方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101120340A (zh) * 2004-02-21 2008-02-06 数据迅捷股份有限公司 超无共享并行数据库
US7680761B2 (en) * 2001-02-27 2010-03-16 Oracle International Corporation Method and mechanism for database partitioning
CN103210671A (zh) * 2011-09-06 2013-07-17 华为技术有限公司 一种消息发送方法和装置
CN103440245A (zh) * 2013-07-15 2013-12-11 西北工业大学 数据库系统的行列混合存储方法
CN103942342A (zh) * 2014-05-12 2014-07-23 中国人民大学 一种内存数据库oltp&olap并发查询优化方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7035851B1 (en) * 2001-12-07 2006-04-25 Ncr Corp. Reorganization of database records using partition merging
US8782075B2 (en) 2007-05-08 2014-07-15 Paraccel Llc Query handling in databases with replicated data
US20110157194A1 (en) * 2009-12-31 2011-06-30 Omri Eisenbach System, data structure, and method for processing multi-dimensional video data
GB2480599A (en) 2010-05-17 2011-11-30 Tech Universit T Muenchen Hybrid OLTP and OLAP database
WO2012072879A1 (en) * 2010-11-30 2012-06-07 Nokia Corporation Method and apparatus for updating a partitioned index
US8874505B2 (en) 2011-01-11 2014-10-28 Hitachi, Ltd. Data replication and failure recovery method for distributed key-value store
WO2016183539A1 (en) * 2015-05-14 2016-11-17 Walleye Software, LLC Data partitioning and ordering

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7680761B2 (en) * 2001-02-27 2010-03-16 Oracle International Corporation Method and mechanism for database partitioning
CN101120340A (zh) * 2004-02-21 2008-02-06 数据迅捷股份有限公司 超无共享并行数据库
CN103210671A (zh) * 2011-09-06 2013-07-17 华为技术有限公司 一种消息发送方法和装置
CN103440245A (zh) * 2013-07-15 2013-12-11 西北工业大学 数据库系统的行列混合存储方法
CN103942342A (zh) * 2014-05-12 2014-07-23 中国人民大学 一种内存数据库oltp&olap并发查询优化方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491294A (zh) * 2018-03-15 2018-09-04 中国银行股份有限公司 一种数据库备份方法、装置及系统
CN108491294B (zh) * 2018-03-15 2022-11-25 中国银行股份有限公司 一种数据库备份方法、装置及系统
CN112905596A (zh) * 2021-03-05 2021-06-04 北京中经惠众科技有限公司 数据处理的方法、装置、计算机设备以及存储介质
CN112905596B (zh) * 2021-03-05 2024-02-02 北京中经惠众科技有限公司 数据处理的方法、装置、计算机设备以及存储介质

Also Published As

Publication number Publication date
US20180121532A1 (en) 2018-05-03
US11226986B2 (en) 2022-01-18
CN106716400B (zh) 2019-09-27
WO2016206100A1 (zh) 2016-12-29

Similar Documents

Publication Publication Date Title
US11514046B2 (en) Tiering with pluggable storage system for parallel query engines
US9081837B2 (en) Scoped database connections
AU2005201996B2 (en) Combining multidimensional expressions and data mining extensions to mine OLAP cubes
WO2018188666A1 (zh) 信息处理方法及装置
US11030196B2 (en) Method and apparatus for processing join query
EP2380090B1 (en) Data integrity in a database environment through background synchronization
US11226986B2 (en) Data table partitioning management method and apparatus
CN108073696B (zh) 基于分布式内存数据库的gis应用方法
EP2901344A1 (en) System and method for flexible distributed massively parallel processing (mpp) database
CN105900093A (zh) 一种KeyValue数据库的数据表的更新方法与表数据更新装置
CN111221851A (zh) 一种基于Lucene的海量数据查询、存储的方法和装置
CN104133891A (zh) 一种基于关系型数据库的海量结构化数据的存储方法
US10831709B2 (en) Pluggable storage system for parallel query engines across non-native file systems
US8818971B1 (en) Processing bulk deletions in distributed databases
CN117321583A (zh) 用于混合数据处理的存储引擎
US10776368B1 (en) Deriving cardinality values from approximate quantile summaries
WO2018045610A1 (zh) 用于执行分布式计算任务的方法和装置
US20200233870A1 (en) Systems and methods for linking metric data to resources
Arputhamary et al. A review on big data integration
KR20180085633A (ko) 질의 처리 장치 및 방법
US11960488B2 (en) Join queries in data virtualization-based architecture
US11789971B1 (en) Adding replicas to a multi-leader replica group for a data set
Arora et al. Big data technologies: brief overview
CN113868267A (zh) 注入时序数据的方法、查询时序数据的方法及数据库系统
CN110569310A (zh) 一种云计算环境下的关系大数据的管理方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant