WO2015131579A1 - Data storage method, apparatus and system - Google Patents

Data storage method, apparatus and system Download PDF

Info

Publication number
WO2015131579A1
WO2015131579A1 PCT/CN2014/092508 CN2014092508W WO2015131579A1 WO 2015131579 A1 WO2015131579 A1 WO 2015131579A1 CN 2014092508 W CN2014092508 W CN 2014092508W WO 2015131579 A1 WO2015131579 A1 WO 2015131579A1
Authority
WO
WIPO (PCT)
Prior art keywords
field
dimensional
data storage
data
performance data
Prior art date
Application number
PCT/CN2014/092508
Other languages
French (fr)
Chinese (zh)
Inventor
陈波
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015131579A1 publication Critical patent/WO2015131579A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Definitions

  • the present invention relates to the field of data storage technologies, and in particular, to a data storage method, apparatus, and system.
  • OLTP On-Line Transaction Processing
  • OLAP On-Line Analytical Processing
  • OLTP and OLAP applications are often difficult to directly integrate.
  • Software developers and users have to spend a lot of manpower and resources to build and support two sets of data processing systems, increasing the cost of the cost.
  • performance data such as TDD (Time Division Duplexing)/FDD (Frequency Division Duplexing) requires different tables for storage, even for 2G (Second Generation, Second generation mobile communication technology), 3G (abbreviation of 3rd Generation, third generation mobile communication technology), and 4G (The 4 Generation mobile communication technology) performance data require different databases for storage As a result, a large amount of hardware and software resources are consumed, and maintenance difficulty is also increased.
  • the technical problem to be solved by the present invention is to provide a data storage method and system to overcome related
  • the technical storage method cannot simultaneously support the unified storage of TDD/FDD multi-dimensional performance data and the problem of supporting OLTP/OLAP hybrid applications.
  • a data storage method comprising:
  • the multi-dimensional performance data is uniformly stored in the database table.
  • the multi-dimensional performance data includes: a field of a time dimension, a field of a location dimension, a field of a multi-model, and a field of a performance counter, wherein the multi-mode field is used to record a time division duplex TDD or Frequency division duplex FDD multimode performance data.
  • the method further includes establishing a plurality of separate indexes or composite indexes on the multi-dimensional fields of the database table according to the actual service application.
  • a data storage device includes a setting unit and a storage unit, wherein:
  • the setting unit is configured to: provide a database table having a column and a row;
  • the storage unit is configured to uniformly store the multi-dimensional performance data in the database table.
  • the multi-dimensional performance data includes: a field of a time dimension, a field of a location dimension, a field of a multi-mode, a field of a performance counter, wherein the multi-mode field is used to record a time division duplex TDD or Frequency division duplex FDD multimode performance data.
  • the apparatus further includes an indexing unit, wherein:
  • the indexing unit is configured to: establish a plurality of individual indexes or composite indexes on the multi-dimensional fields of the database table according to an actual service application.
  • a database system comprising any of the above data storage devices.
  • a computer program comprising program instructions which, when executed by a computer, cause the computer to perform any of the above described data storage methods.
  • a carrier carrying the computer program A carrier carrying the computer program.
  • the technical solution of the present invention can support the mixed application of OLTP/OLAP big data, and the TDD/FDD performance data can be simultaneously stored in one table, and supports multiple dimensions (time, location, standard). )analysis.
  • FIG. 1 is a schematic flowchart of a data storage method according to an embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a data storage device according to an embodiment of the present invention.
  • FIG. 1 shows a data storage method provided by an embodiment of the present invention. Specifically, the method provided by the embodiment of the present invention includes the following specific steps:
  • the multi-dimensional performance data is uniformly stored in one of the database tables.
  • the multi-dimensional fields of the multi-dimensional performance data are uniformly stored in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, which is designed.
  • TDD and FDD data can be processed simultaneously in applications such as OLTP real-time warehousing and OLAP multi-dimensional analysis.
  • the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
  • the multi-dimensional performance data includes: a time dimension field 101, a location dimension field 102, a multi-model field 103, and a performance counter field 104, where The multi-mode field 103 is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  • a plurality of separate indexes or composite indexes are also established for the multi-dimensional fields of the database table according to actual business applications.
  • the index of the time and location dimension is established, such as begintime+sbnid+neid+cellid to establish a composite index; for the dimension field ltefdd, lttedd, if this After the data table needs to support the new dimension, it is not suitable for indexing.
  • multiple multi-dimensional fields of multi-dimensional performance data are uniformly stored in the same database table, and multiple independent indexes or complex multiple multi-dimensional fields are established according to actual business application requirements. Indexing, in this way, OLTP real-time warehousing, OLAP multi-dimensional analysis and other applications can simultaneously process TDD and FDD data.
  • an embodiment of the present invention provides a data storage device, including:
  • the setting unit 100 is configured to: provide a database table having a column and a row;
  • the storage unit 200 is configured to: uniformly store the multi-dimensional performance data in one of the database tables.
  • the setting unit 100 of the present embodiment uniformly stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, so that the storage unit performs OLTP at 200.
  • TDD and FDD data can be processed simultaneously in applications such as real-time storage and OLAP multidimensional analysis.
  • the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
  • the multi-dimensional performance data includes: a field 101 of a time dimension, a field 102 of a location dimension, a field 103 of a multi-model, and a field 104 of a performance counter, wherein the multi-dimensional
  • the molded field 103 is set to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  • the data storage device further includes:
  • the index unit 300 after the setting unit 100 provides a database table having a column and a row, the index unit 300 is configured to: create a plurality of multi-dimensional fields of the database table according to an actual service application. A separate index or composite index. According to the actual business application, such as the demand according to the time and location query, then the index of the time and location dimension is established, such as begintime+sbnid+neid+cellid to establish a composite index; for the dimension field ltefdd, lttedd, if this After the data table needs to support the new dimension, it is not suitable for indexing.
  • the setting unit 100 stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, and the index unit 300 establishes multiple individual indexes or composite indexes for the multi-dimensional fields according to actual business application requirements.
  • the storage unit 200 can simultaneously process TDD and FDD data when performing applications such as real-time OLTP storage and OLAP multi-dimensional analysis.
  • the embodiment of the present invention further provides a database system, including:
  • the storage device is configured to: provide a database table having a column and a row, and further configured to: uniformly store the multi-dimensional performance data in one of the database tables.
  • the storage device uniformly stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, so that OLTP real-time storage and OLAP are performed.
  • TDD and FDD data can be processed simultaneously in applications such as multidimensional analysis. It can be seen that the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
  • the multi-dimensional performance data includes: a field 101 of a time dimension, a field 102 of a location dimension, a field 103 of a multi-model, and a field 104 of a performance counter, wherein the multi-mode
  • the field of 103 is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  • the storage device is further configured to: establish multiple separate indexes on the multi-dimensional field of the database table according to the actual service application. Or composite index.
  • the storage device stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, and establishes multiple independent indexes or composite indexes for the multi-dimensional fields according to actual business application requirements, so that the OLTP is stored in real time.
  • TDD and FDD data can be processed simultaneously in applications such as OLAP multidimensional analysis.
  • the method and the device in the embodiment of the present invention may be based on the OLTP/OLAP hybrid application, and may be based on other applications, as long as the corresponding technical problem or the corresponding technical effect can be solved, and details are not described herein again.
  • the technical solution of the present invention can support the mixed application of OLTP/OLAP big data, and the TDD/FDD performance data can be simultaneously stored in one table, and supports multiple dimensions (time, location, standard). )analysis. Therefore, the present invention has strong industrial applicability.

Abstract

A data storage method, apparatus and system, the method comprising: providing database tables having columns and rows (S10); and storing together multidimensional performance data in one of the database tables (S20). Hybrid applications of OLTP/OLAP big data can be supported, TDD/FDD performance data can be simultaneously stored in one table, and multidimensional (time, location, system) analysis is supported.

Description

数据存储方法、装置及系统Data storage method, device and system 技术领域Technical field
本发明涉及数据存储技术领域,具体而言,涉及一种数据存储方法、装置及系统。The present invention relates to the field of data storage technologies, and in particular, to a data storage method, apparatus, and system.
背景技术Background technique
随着数据库技术的广泛应用,信息系统产生了大量的数据,如何从这些海量数据中提取对决策分析有用的信息逐渐成为决策管理人员所面临的重要难题。With the wide application of database technology, information systems generate a large amount of data. How to extract useful information from decision-making analysis from these massive data has gradually become an important problem faced by decision-making managers.
当今的数据处理系统大致可以分成两大类:OLTP(On-Line Transaction Processing,联机事务处理系统)以及OLAP(On-Line Analytical Processing,联机分析处理系统)。OLTP是传统的关系型数据库的主要应用,主要是针对基本的、日常的事务处理,例如银行交易。OLAP是数据仓库系统的主要应用,支持复杂的分析操作,侧重决策支持,并且提供直观易懂的查询结果。Today's data processing systems can be broadly divided into two categories: OLTP (On-Line Transaction Processing) and OLAP (On-Line Analytical Processing). OLTP is the primary application of traditional relational databases, primarily for basic, day-to-day transactions, such as banking transactions. OLAP is the primary application of data warehousing systems, supporting complex analysis operations, focusing on decision support, and providing intuitive and understandable query results.
目前,OLTP与OLAP应用往往是难以直接融合的,软件开发方以及用户不得不花费大量的人力物力来建立并支持两套数据处理系统,增加了成本的开支。而且在多模融合的场景下,对于诸如TDD(Time Division Duplexing,时分双工)/FDD(Frequency Division Duplexing,频分双工)的性能数据需要不同的表来存储,甚至对于2G(Second Generation,第二代移动通讯技术)、3G(3rd Generation的缩写,第三代移动通信技术)、以及4G(The 4 Generation mobile Communication,第四代移动通信技术)的性能数据而言需要不同的数据库进行存储,导致在大量消耗软硬件资源的同时也增加了维护难度。At present, OLTP and OLAP applications are often difficult to directly integrate. Software developers and users have to spend a lot of manpower and resources to build and support two sets of data processing systems, increasing the cost of the cost. Moreover, in the scenario of multi-mode fusion, performance data such as TDD (Time Division Duplexing)/FDD (Frequency Division Duplexing) requires different tables for storage, even for 2G (Second Generation, Second generation mobile communication technology), 3G (abbreviation of 3rd Generation, third generation mobile communication technology), and 4G (The 4 Generation mobile communication technology) performance data require different databases for storage As a result, a large amount of hardware and software resources are consumed, and maintenance difficulty is also increased.
因此,如何提供一种支持多维度性能数据存储的方法是亟待解决的一个技术问题。Therefore, how to provide a method for supporting multi-dimensional performance data storage is a technical problem to be solved.
发明内容Summary of the invention
本发明要解决的技术问题是提供一种数据存储方法及系统,以克服相关 技术的存储方法不能同时支持TDD/FDD多维度性能数据统一存储以及支持OLTP/OLAP混合应用的问题。The technical problem to be solved by the present invention is to provide a data storage method and system to overcome related The technical storage method cannot simultaneously support the unified storage of TDD/FDD multi-dimensional performance data and the problem of supporting OLTP/OLAP hybrid applications.
为解决上述技术问题,采用如下技术方案:In order to solve the above technical problems, the following technical solutions are adopted:
一种数据存储方法,包括:A data storage method comprising:
提供一张具有栏位(column)及列位(row)的数据库表;Provide a database table with columns and rows;
将多维度性能数据统一存储于所述数据库表之中。The multi-dimensional performance data is uniformly stored in the database table.
可选地,所述多维度性能数据包括:时间维度的字段、位置维度的字段、多模制式的字段和性能计数器的字段,其中,所述多模制式的字段用于记录时分双工TDD或频分双工FDD多模性能数据。Optionally, the multi-dimensional performance data includes: a field of a time dimension, a field of a location dimension, a field of a multi-model, and a field of a performance counter, wherein the multi-mode field is used to record a time division duplex TDD or Frequency division duplex FDD multimode performance data.
可选地,该方法还包括,根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。Optionally, the method further includes establishing a plurality of separate indexes or composite indexes on the multi-dimensional fields of the database table according to the actual service application.
一种数据存储装置,包括设置单元和存储单元,其中:A data storage device includes a setting unit and a storage unit, wherein:
所述设置单元设置成:提供一张具有栏位(column)及列位(row)的数据库表;The setting unit is configured to: provide a database table having a column and a row;
所述存储单元设置成:将多维度性能数据统一存储于所述数据库表中。The storage unit is configured to uniformly store the multi-dimensional performance data in the database table.
可选地,所述多维度性能数据包括:时间维度的字段、位置维度的字段、多模制式的字段、性能计数器的字段,其中,所述多模制式的字段用于记录时分双工TDD或频分双工FDD多模性能数据。Optionally, the multi-dimensional performance data includes: a field of a time dimension, a field of a location dimension, a field of a multi-mode, a field of a performance counter, wherein the multi-mode field is used to record a time division duplex TDD or Frequency division duplex FDD multimode performance data.
可选地,该装置还包括索引单元,其中:Optionally, the apparatus further includes an indexing unit, wherein:
所述索引单元设置成:根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。 The indexing unit is configured to: establish a plurality of individual indexes or composite indexes on the multi-dimensional fields of the database table according to an actual service application.
一种数据库系统,包括上述任意的数据存储装置。A database system comprising any of the above data storage devices.
一种计算机程序,包括程序指令,当该程序指令被计算机执行时,使得该计算机可执行上述任意的数据存储方法。A computer program comprising program instructions which, when executed by a computer, cause the computer to perform any of the above described data storage methods.
一种载有所述计算机程序的载体。A carrier carrying the computer program.
通过上述本发明实施例的技术方案可以看出,本发明技术方案可以支持OLTP/OLAP大数据的混合应用,TDD/FDD性能数据能够同时存储在一个表中,支持多维度(时间、位置、制式)分析。It can be seen that the technical solution of the present invention can support the mixed application of OLTP/OLAP big data, and the TDD/FDD performance data can be simultaneously stored in one table, and supports multiple dimensions (time, location, standard). )analysis.
附图概述BRIEF abstract
图1为本发明实施例提供的数据存储方法流程示意图;1 is a schematic flowchart of a data storage method according to an embodiment of the present invention;
图2为本发明实施例提供的数据存储装置的功能结构示意图。2 is a schematic structural diagram of a data storage device according to an embodiment of the present invention.
本发明目的的实现、功能特点及优异效果,下面将结合具体实施例以及附图做进一步的说明。The implementation, functional features and excellent effects of the object of the present invention will be further described below in conjunction with the specific embodiments and the accompanying drawings.
本发明的较佳实施方式Preferred embodiment of the invention
下面结合附图和具体实施例对本发明所述技术方案作进一步的详细描述,但所举实施例不作为对本发明的限定。The technical solutions of the present invention are further described in detail below with reference to the accompanying drawings and specific embodiments, but the embodiments are not intended to limit the invention.
如图1所示,其示出了本发明实施例提供的一种数据存储方法,具体地,本发明实施例提供的所述方法包括如下具体步骤:As shown in FIG. 1 , it shows a data storage method provided by an embodiment of the present invention. Specifically, the method provided by the embodiment of the present invention includes the following specific steps:
S10、提供具有栏位(column)及列位(row)的数据库表;S10. Providing a database table having a column and a row;
S20、将多维度性能数据统一存储于一张所述数据库表之中。S20. The multi-dimensional performance data is uniformly stored in one of the database tables.
本实施例将多维度性能数据的多维度字段统一存储在同一张数据库表中,其中对于TDD、FDD多模性能数据作为多模制式的维度字段来设计,这 样进行OLTP实时入库、OLAP多维分析等应用时均能同时处理TDD、FDD数据。可见采用本发明实施例,可以支持OLTP/OLAP大数据的混合应用,支持TDD/FDD多模性能数据统一存储、支持OLTP大数据实时入库,支持OLAP多维数据抽取分析(例如支持多维度时间、位置、制式分析)。In this embodiment, the multi-dimensional fields of the multi-dimensional performance data are uniformly stored in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, which is designed. TDD and FDD data can be processed simultaneously in applications such as OLTP real-time warehousing and OLAP multi-dimensional analysis. It can be seen that the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
本实施例中,如表一所示的数据库表结构,所述多维度性能数据包括:时间维度的字段101、位置维度的字段102、多模制式的字段103、性能计数器的字段104,其中,所述多模制式的字段103用于记录时分双工TDD或频分双工FDD多模性能数据。In this embodiment, as shown in the database table structure shown in Table 1, the multi-dimensional performance data includes: a time dimension field 101, a location dimension field 102, a multi-model field 103, and a performance counter field 104, where The multi-mode field 103 is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
表一Table I
Figure PCTCN2014092508-appb-000001
Figure PCTCN2014092508-appb-000001
可选的实施方式中,在提供具有栏位(column)及列位(row)的数据库表之后,还根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。根据实际业务应用,比如按照时间和位置查询的需求比较多,那么就针对时间和位置维度的字段建立索引,比如begintime+sbnid+neid+cellid建立复合索引;对于维度字段ltefdd、ltetdd,如果这张数据表后续需要支持新的维度,就不适合建立索引;对于计数器字段,同样增减的可能性较大,且计数器个数一般较多,也不常用作查询过滤条件,因此不适合建立索引。对于SybaseIQ等列存储数据库,由于列存储数据库每个字段都缺省带有索引,索引的问题就不太突出。In an optional implementation manner, after providing a database table having columns and rows, a plurality of separate indexes or composite indexes are also established for the multi-dimensional fields of the database table according to actual business applications. According to the actual business application, such as the demand according to the time and location query, then the index of the time and location dimension is established, such as begintime+sbnid+neid+cellid to establish a composite index; for the dimension field ltefdd, lttedd, if this After the data table needs to support the new dimension, it is not suitable for indexing. For the counter field, the possibility of increasing or decreasing is also large, and the number of counters is generally large, and is not often used as a query filtering condition, so it is not suitable for indexing. For column storage databases such as SybaseIQ, since each field of the column storage database has an index by default, the index problem is not very prominent.
本实施例中,通过将多维度性能数据的多维度字段统一存储在同一张数据库表中,并且根据实际业务应用需要对多维度字段建立多个单独索引或复 合索引,这样进行OLTP实时入库、OLAP多维分析等应用时均能同时处理TDD、FDD数据。In this embodiment, multiple multi-dimensional fields of multi-dimensional performance data are uniformly stored in the same database table, and multiple independent indexes or complex multiple multi-dimensional fields are established according to actual business application requirements. Indexing, in this way, OLTP real-time warehousing, OLAP multi-dimensional analysis and other applications can simultaneously process TDD and FDD data.
如图2所示,本发明实施例提供了一种数据存储装置,包括:As shown in FIG. 2, an embodiment of the present invention provides a data storage device, including:
设置单元100,设置成:提供具有栏位(column)及列位(row)的数据库表;The setting unit 100 is configured to: provide a database table having a column and a row;
存储单元200,设置成:将多维度性能数据统一存储于一张所述数据库表之中。The storage unit 200 is configured to: uniformly store the multi-dimensional performance data in one of the database tables.
本实施例设置单元100将多维度性能数据的多维度字段统一存储在同一张数据库表中,其中对于TDD、FDD多模性能数据作为多模制式的维度字段来设计,这样存储单元在200进行OLTP实时入库、OLAP多维分析等应用时均能同时处理TDD、FDD数据。可见采用本发明实施例,可以支持OLTP/OLAP大数据的混合应用,支持TDD/FDD多模性能数据统一存储、支持OLTP大数据实时入库,支持OLAP多维数据抽取分析(例如支持多维度时间、位置、制式分析)。The setting unit 100 of the present embodiment uniformly stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, so that the storage unit performs OLTP at 200. TDD and FDD data can be processed simultaneously in applications such as real-time storage and OLAP multidimensional analysis. It can be seen that the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
本实施例中,继续参考表一所示,所述多维度性能数据包括:时间维度的字段101、位置维度的字段102、多模制式的字段103、性能计数器的字段104,其中,所述多模制式的字段103设置成:记录时分双工TDD或频分双工FDD多模性能数据。In this embodiment, referring to Table 1, the multi-dimensional performance data includes: a field 101 of a time dimension, a field 102 of a location dimension, a field 103 of a multi-model, and a field 104 of a performance counter, wherein the multi-dimensional The molded field 103 is set to record time division duplex TDD or frequency division duplex FDD multimode performance data.
可选的实施方式中,继续参考图2所示,所述的数据存储装置还包括:In an optional implementation manner, with reference to FIG. 2, the data storage device further includes:
索引单元300,在设置单元100提供具有栏位(column)及列位(row)的数据库表之后,所述索引单元300设置成:根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。根据实际业务应用,比如按照时间和位置查询的需求比较多,那么就针对时间和位置维度的字段建立索引,比如begintime+sbnid+neid+cellid建立复合索引;对于维度字段ltefdd、ltetdd,如果这张数据表后续需要支持新的维度,就不适合建立索引;对于计数器字段,同样增减的可能性较大,且计数器个数一般较多,也不常用作查询过滤条件,因此不适合建立索引。对于SybaseIQ等列存储数据库,由于列存储数据库每个字段都缺省带有索引,索引的问题就不太突出。 The index unit 300, after the setting unit 100 provides a database table having a column and a row, the index unit 300 is configured to: create a plurality of multi-dimensional fields of the database table according to an actual service application. A separate index or composite index. According to the actual business application, such as the demand according to the time and location query, then the index of the time and location dimension is established, such as begintime+sbnid+neid+cellid to establish a composite index; for the dimension field ltefdd, lttedd, if this After the data table needs to support the new dimension, it is not suitable for indexing. For the counter field, the possibility of increasing or decreasing is also large, and the number of counters is generally large, and is not often used as a query filtering condition, so it is not suitable for indexing. For column storage databases such as SybaseIQ, since each field of the column storage database has an index by default, the index problem is not very prominent.
本实施例中,设置单元通100过将多维度性能数据的多维度字段统一存储在同一张数据库表中,索引单元300根据实际业务应用需要对多维度字段建立多个单独索引或复合索引,这样存储单元200进行OLTP实时入库、OLAP多维分析等应用时均能同时处理TDD、FDD数据。In this embodiment, the setting unit 100 stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, and the index unit 300 establishes multiple individual indexes or composite indexes for the multi-dimensional fields according to actual business application requirements. The storage unit 200 can simultaneously process TDD and FDD data when performing applications such as real-time OLTP storage and OLAP multi-dimensional analysis.
本发明实施例还相应地提供了一种数据库系统,包括:The embodiment of the present invention further provides a database system, including:
存储装置,设置成:提供具有栏位(column)及列位(row)的数据库表,以及进一步设置成:将多维度性能数据统一存储于一张所述数据库表之中。The storage device is configured to: provide a database table having a column and a row, and further configured to: uniformly store the multi-dimensional performance data in one of the database tables.
所述存储装置将多维度性能数据的多维度字段统一存储在同一张数据库表中,其中对于TDD、FDD多模性能数据作为多模制式的维度字段来设计,这样在进行OLTP实时入库、OLAP多维分析等应用时均能同时处理TDD、FDD数据。可见采用本发明实施例,可以支持OLTP/OLAP大数据的混合应用,支持TDD/FDD多模性能数据统一存储、支持OLTP大数据实时入库,支持OLAP多维数据抽取分析(例如支持多维度时间、位置、制式分析)。The storage device uniformly stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, wherein the TDD and FDD multi-mode performance data are designed as multi-dimensional dimension fields, so that OLTP real-time storage and OLAP are performed. TDD and FDD data can be processed simultaneously in applications such as multidimensional analysis. It can be seen that the embodiment of the present invention can support mixed application of OLTP/OLAP big data, support unified storage of TDD/FDD multi-mode performance data, support real-time OLTP big data storage, and support OLAP multi-dimensional data extraction analysis (for example, support multi-dimensional time, Position, system analysis).
继续参考表一所示,具体地,所述多维度性能数据包括:时间维度的字段101、位置维度的字段102、多模制式的字段103、性能计数器的字段104,其中,所述多模制式103的字段用于记录时分双工TDD或频分双工FDD多模性能数据。Continuing to refer to Table 1, specifically, the multi-dimensional performance data includes: a field 101 of a time dimension, a field 102 of a location dimension, a field 103 of a multi-model, and a field 104 of a performance counter, wherein the multi-mode The field of 103 is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
可选的实施方式中,在提供具有栏位(column)及列位(row)的数据库表之后,存储装置还设置成:根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。In an optional implementation manner, after providing the database table with the column and the row, the storage device is further configured to: establish multiple separate indexes on the multi-dimensional field of the database table according to the actual service application. Or composite index.
所述存储装置通过将多维度性能数据的多维度字段统一存储在同一张数据库表中,并根据实际业务应用需要对多维度字段建立多个单独索引或复合索引,这样在进行OLTP实时入库、OLAP多维分析等应用时均能同时处理TDD、FDD数据。The storage device stores the multi-dimensional fields of the multi-dimensional performance data in the same database table, and establishes multiple independent indexes or composite indexes for the multi-dimensional fields according to actual business application requirements, so that the OLTP is stored in real time. TDD and FDD data can be processed simultaneously in applications such as OLAP multidimensional analysis.
本发明实施例的方法和装置可以基于OLTP/OLAP混合应用,还可以基于其他应用,只要能够解决相应的技术问题或产生相应的技术效果即可,在此不再赘述。The method and the device in the embodiment of the present invention may be based on the OLTP/OLAP hybrid application, and may be based on other applications, as long as the corresponding technical problem or the corresponding technical effect can be solved, and details are not described herein again.
以上所述仅为本发明的可选实施例,并非因此限制本发明的专利范围, 凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above description is only an optional embodiment of the present invention, and thus does not limit the scope of the patent of the present invention. The equivalent structure or equivalent process transformations made by the present specification and the drawings are directly or indirectly applied to other related technical fields, and are included in the scope of patent protection of the present invention.
工业实用性Industrial applicability
通过上述本发明实施例的技术方案可以看出,本发明技术方案可以支持OLTP/OLAP大数据的混合应用,TDD/FDD性能数据能够同时存储在一个表中,支持多维度(时间、位置、制式)分析。因此本发明具有很强的工业实用性。 It can be seen that the technical solution of the present invention can support the mixed application of OLTP/OLAP big data, and the TDD/FDD performance data can be simultaneously stored in one table, and supports multiple dimensions (time, location, standard). )analysis. Therefore, the present invention has strong industrial applicability.

Claims (9)

  1. 一种数据存储方法,包括:A data storage method comprising:
    提供一张具有栏位(column)及列位(row)的数据库表;Provide a database table with columns and rows;
    将多维度性能数据统一存储于所述数据库表之中。The multi-dimensional performance data is uniformly stored in the database table.
  2. 如权利利要求1所述的数据存储方法,其中,所述多维度性能数据包括:时间维度的字段、位置维度的字段、多模制式的字段和性能计数器的字段,其中,所述多模制式的字段用于记录时分双工TDD或频分双工FDD多模性能数据。The data storage method of claim 1, wherein the multi-dimensional performance data comprises: a field of a time dimension, a field of a location dimension, a field of a multi-model, and a field of a performance counter, wherein the multi-mode The fields are used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  3. 如权利利要求2所述的数据存储方法,该方法还包括,根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。The data storage method of claim 2, further comprising establishing a plurality of separate indexes or composite indexes on the multi-dimensional fields of the database table according to actual business applications.
  4. 一种数据存储装置,包括设置单元和存储单元,其中:A data storage device includes a setting unit and a storage unit, wherein:
    所述设置单元设置成:提供一张具有栏位(column)及列位(row)的数据库表;The setting unit is configured to: provide a database table having a column and a row;
    所述存储单元设置成:将多维度性能数据统一存储于所述数据库表中。The storage unit is configured to uniformly store the multi-dimensional performance data in the database table.
  5. 如权利要求4所述的数据存储装置,其中,所述多维度性能数据包括:时间维度的字段、位置维度的字段、多模制式的字段、性能计数器的字段,其中,所述多模制式的字段用于记录时分双工TDD或频分双工FDD多模性能数据。The data storage device of claim 4, wherein the multi-dimensional performance data comprises: a field of a time dimension, a field of a location dimension, a field of a multi-model, a field of a performance counter, wherein the multi-modal The field is used to record time division duplex TDD or frequency division duplex FDD multimode performance data.
  6. 如权利要求5所述的数据存储装置,该装置还包括索引单元,其中:The data storage device of claim 5, further comprising an indexing unit, wherein:
    所述索引单元设置成:根据实际业务应用对所述数据库表的多维度字段建立多个单独索引或复合索引。The indexing unit is configured to: establish a plurality of individual indexes or composite indexes on the multi-dimensional fields of the database table according to an actual service application.
  7. 一种数据库系统,包括如权利要求4-6中任一项所述的数据存储装置。A database system comprising the data storage device of any of claims 4-6.
  8. 一种计算机程序,包括程序指令,当该程序指令被计算机执行时,使得该计算机可执行权利要求1-3中任一项所述的数据存储方法。A computer program comprising program instructions which, when executed by a computer, cause the computer to perform the data storage method of any of claims 1-3.
  9. 一种载有权利要求9所述计算机程序的载体。 A carrier carrying the computer program of claim 9.
PCT/CN2014/092508 2014-10-15 2014-11-28 Data storage method, apparatus and system WO2015131579A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410545015.6 2014-10-15
CN201410545015.6A CN105574027B (en) 2014-10-15 2014-10-15 Multi-dimensional performance data storage method, device and system based on OLTP/OLAP hybrid application

Publications (1)

Publication Number Publication Date
WO2015131579A1 true WO2015131579A1 (en) 2015-09-11

Family

ID=54054460

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092508 WO2015131579A1 (en) 2014-10-15 2014-11-28 Data storage method, apparatus and system

Country Status (2)

Country Link
CN (1) CN105574027B (en)
WO (1) WO2015131579A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391666A (en) * 2017-07-20 2017-11-24 上海达梦数据库有限公司 A kind of generation method and device of composite index key assignments

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109635042B (en) * 2018-12-07 2022-06-14 厦门铅笔头信息科技有限公司 OLTP and OLAP integrated automobile financial big data system
CN109614402B (en) * 2018-12-11 2020-09-29 京东数字科技控股有限公司 Multidimensional data query method and device
CN110019251A (en) * 2019-03-22 2019-07-16 深圳市腾讯计算机系统有限公司 A kind of data processing system, method and apparatus

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6205447B1 (en) * 1997-06-30 2001-03-20 International Business Machines Corporation Relational database management of multi-dimensional data
CN101217755A (en) * 2007-12-26 2008-07-09 中兴通讯股份有限公司 A front-end processor system and method applied for data acquisition
CN101790257A (en) * 2009-01-22 2010-07-28 大唐移动通信设备有限公司 Method for memorizing data and network management system
CN102497661A (en) * 2011-12-16 2012-06-13 清华大学 Heterogeneous network selection method based on transmitting power of terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101968806A (en) * 2010-10-22 2011-02-09 天津南大通用数据技术有限公司 Data storage method, querying method and device
CN103942342B (en) * 2014-05-12 2017-02-01 中国人民大学 Memory database OLTP and OLAP concurrency query optimization method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6205447B1 (en) * 1997-06-30 2001-03-20 International Business Machines Corporation Relational database management of multi-dimensional data
CN101217755A (en) * 2007-12-26 2008-07-09 中兴通讯股份有限公司 A front-end processor system and method applied for data acquisition
CN101790257A (en) * 2009-01-22 2010-07-28 大唐移动通信设备有限公司 Method for memorizing data and network management system
CN102497661A (en) * 2011-12-16 2012-06-13 清华大学 Heterogeneous network selection method based on transmitting power of terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391666A (en) * 2017-07-20 2017-11-24 上海达梦数据库有限公司 A kind of generation method and device of composite index key assignments

Also Published As

Publication number Publication date
CN105574027A (en) 2016-05-11
CN105574027B (en) 2020-04-24

Similar Documents

Publication Publication Date Title
US9424150B2 (en) Fault tolerance based query execution
US20080201296A1 (en) Partitioning of nested tables
US20070061305A1 (en) System and method of providing date, arithmetic and other relational functions for OLAP sources
WO2015184782A1 (en) Data query method and device
US10394805B2 (en) Database management for mobile devices
US9244950B2 (en) Method for synthetic data generation for query workloads
WO2015131579A1 (en) Data storage method, apparatus and system
US10956438B2 (en) Catalog with location of variables for data
WO2011090519A1 (en) Accessing large collection object tables in a database
EP3413214A1 (en) Selectivity estimation for database query planning
EP2608128A1 (en) Analyzing And Representing Interpersonal Relations
Jayachandran et al. Combining user interaction, speculative query execution and sampling in the DICE system
US20180365134A1 (en) Core Data Services Test Double Framework Automation Tool
CN114461603A (en) Multi-source heterogeneous data fusion method and device
US20180165327A1 (en) Avoiding index-navigation deadlocks in database systems
US20120330988A1 (en) Systems And Methods For Performing Index Joins Using Auto Generative Queries
CN105095436A (en) Automatic modeling method for data of data sources
US20080077552A1 (en) Systems and methods for analyzing multiple states in one or more groups of data
CN111078728B (en) Cross-database query method and device in database archiving mode
US11163801B2 (en) Execution of queries in relational databases
WO2023197865A1 (en) Information storage method and apparatus
CN114490724B (en) Method and device for processing database query statement
RU2515565C1 (en) Method of updating structured data in relational database management system
US11782953B2 (en) Metadata access for distributed data lake users
US20180196858A1 (en) Api driven etl for complex data lakes

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14884950

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14884950

Country of ref document: EP

Kind code of ref document: A1