WO2015131579A1 - Procédé, appareil, et système de stockage de données - Google Patents

Procédé, appareil, et système de stockage de données Download PDF

Info

Publication number
WO2015131579A1
WO2015131579A1 PCT/CN2014/092508 CN2014092508W WO2015131579A1 WO 2015131579 A1 WO2015131579 A1 WO 2015131579A1 CN 2014092508 W CN2014092508 W CN 2014092508W WO 2015131579 A1 WO2015131579 A1 WO 2015131579A1
Authority
WO
WIPO (PCT)
Prior art keywords
field
dimensional
data storage
data
performance data
Prior art date
Application number
PCT/CN2014/092508
Other languages
English (en)
Chinese (zh)
Inventor
陈波
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015131579A1 publication Critical patent/WO2015131579A1/fr

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Definitions

  • the present invention relates to the field of data storage technologies, and in particular, to a data storage method, apparatus, and system.
  • OLTP On-Line Transaction Processing
  • OLAP On-Line Analytical Processing
  • OLTP and OLAP applications are often difficult to directly integrate.
  • Software developers and users have to spend a lot of manpower and resources to build and support two sets of data processing systems, increasing the cost of the cost.
  • performance data such as TDD (Time Division Duplexing)/FDD (Frequency Division Duplexing) requires different tables for storage, even for 2G (Second Generation, Second generation mobile communication technology), 3G (abbreviation of 3rd Generation, third generation mobile communication technology), and 4G (The 4 Generation mobile communication technology) performance data require different databases for storage As a result, a large amount of hardware and software resources are consumed, and maintenance difficulty is also increased.
  • the technical problem to be solved by the present invention is to provide a data storage method and system to overcome related
  • the technical storage method cannot simultaneously support the unified storage of TDD/FDD multi-dimensional performance data and the problem of supporting OLTP/OLAP hybrid applications.
  • a data storage method comprising:
  • the multi-dimensional performance data is uniformly stored in the database table.
  • the multi-dimensional performance data includes: a field of a time dimension, a field of a location dimension, a field of a multi-model, and a field of a performance counter, wherein the multi-mode field is used to record a time division duplex TDD or Frequency division duplex FDD multimode performance data.
  • the method further includes establishing a plurality of separate indexes or composite indexes on the multi-dimensional fields of the database table according to the actual service application.
  • a data storage device includes a setting unit and a storage unit, wherein:
  • the setting unit is configured to: provide a database table having a column and a row;
  • the storage unit is configured to uniformly store the multi-dimensional performance data in the database table.
  • the multi-dimensional performance data includes: a field of a time dimension, a field of a location dimension, a field of a multi-mode, a field of a performance counter, wherein the multi-mode field is used to record a time division duplex TDD or Frequency division duplex FDD multimode performance data.
  • the apparatus further includes an indexing unit, wherein:
  • the indexing unit is configured to: establish a plurality of individual indexes or composite indexes on the multi-dimensional fields of the database table according to an actual service application.
  • a database system comprising any of the above data storage devices.
  • a computer program comprising program instructions which, when executed by a computer, cause the computer to perform any of the above described data storage methods.
  • a carrier carrying the computer program A carrier carrying the computer program.
  • the technical solution of the present invention can support the mixed application of OLTP/OLAP big data, and the TDD/FDD performance data can be simultaneously stored in one table, and supports multiple dimensions (time, location, standard). )analysis.
  • FIG. 1 is a schematic flowchart of a data storage method according to an embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a data storage device according to an embodiment of the present invention.
  • FIG. 1 shows a data storage method provided by an embodiment of the present invention. Specifically, the method provided by the embodiment of the present invention includes the following specific steps:
  • the multi-dimensional performance data is uniformly stored in one of the database tables.
  • the multi-dimensional fields of the multi-dimensional performance data are uniformly stored in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, which is designed.
  • TDD and FDD data can be processed simultaneously in applications such as OLTP real-time warehousing and OLAP multi-dimensional analysis.
  • the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
  • the multi-dimensional performance data includes: a time dimension field 101, a location dimension field 102, a multi-model field 103, and a performance counter field 104, where The multi-mode field 103 is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  • a plurality of separate indexes or composite indexes are also established for the multi-dimensional fields of the database table according to actual business applications.
  • the index of the time and location dimension is established, such as begintime+sbnid+neid+cellid to establish a composite index; for the dimension field ltefdd, lttedd, if this After the data table needs to support the new dimension, it is not suitable for indexing.
  • multiple multi-dimensional fields of multi-dimensional performance data are uniformly stored in the same database table, and multiple independent indexes or complex multiple multi-dimensional fields are established according to actual business application requirements. Indexing, in this way, OLTP real-time warehousing, OLAP multi-dimensional analysis and other applications can simultaneously process TDD and FDD data.
  • an embodiment of the present invention provides a data storage device, including:
  • the setting unit 100 is configured to: provide a database table having a column and a row;
  • the storage unit 200 is configured to: uniformly store the multi-dimensional performance data in one of the database tables.
  • the setting unit 100 of the present embodiment uniformly stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, so that the storage unit performs OLTP at 200.
  • TDD and FDD data can be processed simultaneously in applications such as real-time storage and OLAP multidimensional analysis.
  • the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
  • the multi-dimensional performance data includes: a field 101 of a time dimension, a field 102 of a location dimension, a field 103 of a multi-model, and a field 104 of a performance counter, wherein the multi-dimensional
  • the molded field 103 is set to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  • the data storage device further includes:
  • the index unit 300 after the setting unit 100 provides a database table having a column and a row, the index unit 300 is configured to: create a plurality of multi-dimensional fields of the database table according to an actual service application. A separate index or composite index. According to the actual business application, such as the demand according to the time and location query, then the index of the time and location dimension is established, such as begintime+sbnid+neid+cellid to establish a composite index; for the dimension field ltefdd, lttedd, if this After the data table needs to support the new dimension, it is not suitable for indexing.
  • the setting unit 100 stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, and the index unit 300 establishes multiple individual indexes or composite indexes for the multi-dimensional fields according to actual business application requirements.
  • the storage unit 200 can simultaneously process TDD and FDD data when performing applications such as real-time OLTP storage and OLAP multi-dimensional analysis.
  • the embodiment of the present invention further provides a database system, including:
  • the storage device is configured to: provide a database table having a column and a row, and further configured to: uniformly store the multi-dimensional performance data in one of the database tables.
  • the storage device uniformly stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, so that OLTP real-time storage and OLAP are performed.
  • TDD and FDD data can be processed simultaneously in applications such as multidimensional analysis. It can be seen that the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
  • the multi-dimensional performance data includes: a field 101 of a time dimension, a field 102 of a location dimension, a field 103 of a multi-model, and a field 104 of a performance counter, wherein the multi-mode
  • the field of 103 is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  • the storage device is further configured to: establish multiple separate indexes on the multi-dimensional field of the database table according to the actual service application. Or composite index.
  • the storage device stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, and establishes multiple independent indexes or composite indexes for the multi-dimensional fields according to actual business application requirements, so that the OLTP is stored in real time.
  • TDD and FDD data can be processed simultaneously in applications such as OLAP multidimensional analysis.
  • the method and the device in the embodiment of the present invention may be based on the OLTP/OLAP hybrid application, and may be based on other applications, as long as the corresponding technical problem or the corresponding technical effect can be solved, and details are not described herein again.
  • the technical solution of the present invention can support the mixed application of OLTP/OLAP big data, and the TDD/FDD performance data can be simultaneously stored in one table, and supports multiple dimensions (time, location, standard). )analysis. Therefore, the present invention has strong industrial applicability.

Abstract

L'invention concerne un procédé, un appareil, et un système de stockage de données. Le procédé consiste à : fournir des tables de base de données comprenant des colonnes et des rangées (S10); et stocker ensemble des données de performances multidimensionnelles dans l'une des tables de base de données (S20). Des applications hybrides de mégadonnées OLTP/OLAP peuvent être prises en charge, des données de performances TDD/FDD peuvent être simultanément stockées dans une table, et une analyse multidimensionnelle (heure, emplacement, système) est prise en charge.
PCT/CN2014/092508 2014-10-15 2014-11-28 Procédé, appareil, et système de stockage de données WO2015131579A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410545015.6A CN105574027B (zh) 2014-10-15 2014-10-15 基于oltp/olap混合应用下多维度性能数据存储方法、装置及系统
CN201410545015.6 2014-10-15

Publications (1)

Publication Number Publication Date
WO2015131579A1 true WO2015131579A1 (fr) 2015-09-11

Family

ID=54054460

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092508 WO2015131579A1 (fr) 2014-10-15 2014-11-28 Procédé, appareil, et système de stockage de données

Country Status (2)

Country Link
CN (1) CN105574027B (fr)
WO (1) WO2015131579A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391666A (zh) * 2017-07-20 2017-11-24 上海达梦数据库有限公司 一种复合索引键值的生成方法及装置

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109635042B (zh) * 2018-12-07 2022-06-14 厦门铅笔头信息科技有限公司 Oltp与olap一体化的汽车金融大数据系统
CN109614402B (zh) * 2018-12-11 2020-09-29 京东数字科技控股有限公司 多维数据查询方法和装置
CN110019251A (zh) * 2019-03-22 2019-07-16 深圳市腾讯计算机系统有限公司 一种数据处理系统、方法及设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6205447B1 (en) * 1997-06-30 2001-03-20 International Business Machines Corporation Relational database management of multi-dimensional data
CN101217755A (zh) * 2007-12-26 2008-07-09 中兴通讯股份有限公司 一种用于数据采集的前置机系统和方法
CN101790257A (zh) * 2009-01-22 2010-07-28 大唐移动通信设备有限公司 一种存储数据的方法和网管系统
CN102497661A (zh) * 2011-12-16 2012-06-13 清华大学 一种基于终端发射功率的异构网络选择方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101968806A (zh) * 2010-10-22 2011-02-09 天津南大通用数据技术有限公司 数据存储方法、查询方法及装置
CN103942342B (zh) * 2014-05-12 2017-02-01 中国人民大学 一种内存数据库oltp&olap并发查询优化方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6205447B1 (en) * 1997-06-30 2001-03-20 International Business Machines Corporation Relational database management of multi-dimensional data
CN101217755A (zh) * 2007-12-26 2008-07-09 中兴通讯股份有限公司 一种用于数据采集的前置机系统和方法
CN101790257A (zh) * 2009-01-22 2010-07-28 大唐移动通信设备有限公司 一种存储数据的方法和网管系统
CN102497661A (zh) * 2011-12-16 2012-06-13 清华大学 一种基于终端发射功率的异构网络选择方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391666A (zh) * 2017-07-20 2017-11-24 上海达梦数据库有限公司 一种复合索引键值的生成方法及装置

Also Published As

Publication number Publication date
CN105574027B (zh) 2020-04-24
CN105574027A (zh) 2016-05-11

Similar Documents

Publication Publication Date Title
US20080201296A1 (en) Partitioning of nested tables
US20070061305A1 (en) System and method of providing date, arithmetic and other relational functions for OLAP sources
WO2015184782A1 (fr) Procédé et dispositif d'interrogation de données
US9244950B2 (en) Method for synthetic data generation for query workloads
WO2015131579A1 (fr) Procédé, appareil, et système de stockage de données
US10956438B2 (en) Catalog with location of variables for data
WO2011090519A1 (fr) Accès à des tables de collecte de grands objets dans une base de données
EP3413214A1 (fr) Estimation de sélectivité pour la planification de requêtes de bases de données
EP2608128A1 (fr) Analyse et représentation des relations interpersonnelles
Jayachandran et al. Combining user interaction, speculative query execution and sampling in the DICE system
US20180365134A1 (en) Core Data Services Test Double Framework Automation Tool
US8694525B2 (en) Systems and methods for performing index joins using auto generative queries
US20180165327A1 (en) Avoiding index-navigation deadlocks in database systems
CN105095436A (zh) 数据源数据自动建模方法
US20080077552A1 (en) Systems and methods for analyzing multiple states in one or more groups of data
CN111078728B (zh) 一种数据库归档模式下跨库查询方法和装置
US11163801B2 (en) Execution of queries in relational databases
WO2023197865A1 (fr) Procédé et appareil de stockage d'informations
CN114490724B (zh) 处理数据库查询语句的方法和装置
RU2515565C1 (ru) Способ обновления структурированных данных в системе управления реляционными базами данных
Chen et al. Octopus: Hybrid big data integration engine
US20210406282A1 (en) Metadata access for distributed data lake users
US20180196858A1 (en) Api driven etl for complex data lakes
Bellatreche et al. Horizontal partitioning of very-large data warehouses under dynamically-changing query workloads via incremental algorithms
CN112948467B (zh) 数据处理方法及装置、计算机设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14884950

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14884950

Country of ref document: EP

Kind code of ref document: A1