CN109299197A - A kind of partition method of data cube, system and terminal device - Google Patents

A kind of partition method of data cube, system and terminal device Download PDF

Info

Publication number
CN109299197A
CN109299197A CN201810889593.XA CN201810889593A CN109299197A CN 109299197 A CN109299197 A CN 109299197A CN 201810889593 A CN201810889593 A CN 201810889593A CN 109299197 A CN109299197 A CN 109299197A
Authority
CN
China
Prior art keywords
data
cube
dimension
data cube
partition method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810889593.XA
Other languages
Chinese (zh)
Inventor
方小乔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weifutong Technology Co Ltd
Original Assignee
Weifutong Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weifutong Technology Co Ltd filed Critical Weifutong Technology Co Ltd
Priority to CN201810889593.XA priority Critical patent/CN109299197A/en
Publication of CN109299197A publication Critical patent/CN109299197A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention provides a kind of partition method of data cube, system and terminal devices, and wherein method includes: and constructed data cube based on payment platform original service data and filled data to its dynamic;Multidomain treat-ment is carried out to the data cube according to default dimension member information, obtains multiple subdata cubes and corresponding zoning ordinance;The multiple subdata cube is saved in respectively in different storage mediums.The present invention solves the difficulty of mass data storage, while improving the response speed and analysis performance of data cube.

Description

A kind of partition method of data cube, system and terminal device
Technical field
The invention belongs to database technical field more particularly to a kind of partition methods of data cube, system and terminal Equipment.
Background technique
ROLAP indicates that the OLAP based on relational database realizes (Relational OLAP).Using relational database as core The heart, with relational structures carry out data indicate and storage.The structure of database is divided into two class tables by ROLAP: one kind is thing Real table is used to storing data and dimension keyword;Another kind of is dimension table, i.e., at least stores dimension using a table to each dimension The description information of the dimensions such as level, member's classification.Dimension table and true table are linked together by major key and foreign key, shape At " Star Schema ".Its main feature is that the data in the fact that detail data is retained in relevant database table, after polymerization It is stored in the database of relationship type.But when data volume is very big, the tables of data that this mode generates increases, and represents difference The aggregated data of incidence relation between table also increases, it is caused to need to occupy very big memory space, and search efficiency reduces, It is unfavorable for practical application.
Summary of the invention
In view of this, the embodiment of the invention provides a kind of partition method of data cube, system and terminal device, with Solving the problem of that data occupy very big memory space and search efficiency in the prior art reduces.
The first aspect of the embodiment of the present invention provides a kind of partition method of data cube, comprising:
Based on payment platform original service data, constructs data cube and data are filled to its dynamic.
Multidomain treat-ment is carried out to the data cube according to default dimension member information, obtains multiple subdata cubes With corresponding zoning ordinance.
The multiple subdata cube is saved in respectively in different storage mediums.
The second aspect of the embodiment of the present invention provides a kind of partition system of data cube, comprising:
Cubic configuration module constructs data cube and to its dynamic for being based on payment platform original service data Fill data.
Cube division module, for carrying out multidomain treat-ment to the data cube according to default dimension member information, Obtain multiple subdata cubes and corresponding zoning ordinance.
Multidomain treat-ment module, for the multiple subdata cube to be saved in respectively in different storage mediums.
The third aspect of the embodiment of the present invention provides a kind of terminal device, including memory, processor and is stored in In the memory and the computer program that can run on the processor, when the processor executes the computer program The step of realizing the partition method of data cube as described above.
The fourth aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer-readable storage Media storage has computer program, and the computer program realizes the subregion of data cube as described above when being executed by processor The step of method.
Existing beneficial effect is the embodiment of the present invention compared with prior art: payment platform original service data are based on, It constructs data cube and data is filled to its dynamic;Subregion is carried out to the data cube according to default dimension member information Processing, obtains multiple subdata cubes and corresponding zoning ordinance;The multiple subdata cube is saved in not respectively In same storage medium.It solves the difficulty of mass data storage, while improving the response speed and analysis of data cube Performance.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these Attached drawing obtains other attached drawings.
Fig. 1 is the implementation process schematic diagram of the partition method for the data cube that one embodiment of the present of invention provides;
Fig. 2 is the schematic diagram of the data cube in a concrete application scene
Fig. 3 is the implementation process schematic diagram of step S101 in Fig. 1 of one embodiment of the present of invention offer;
Fig. 4 is the exemplary diagram of the dimension table and true table in a concrete application scene;
Fig. 5 is the schematic diagram of the subdata cube in a concrete application scene;
Fig. 6 is the structural schematic diagram of the partition system for the data cube that one embodiment of the present of invention provides;
Fig. 7 is the schematic diagram for the terminal device that one embodiment of the present of invention provides.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific The present invention also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity The detailed description of road and method, in case unnecessary details interferes description of the invention.
It should be appreciated that description and claims of this specification and term " includes " in above-mentioned attached drawing and other What is deformed, and is referred to " including but not limited to ", it is intended that is covered and non-exclusive is included.Such as include a series of steps or units Process, method or system, product or equipment are not limited to listed step or unit, but optionally further comprising do not arrange Out the step of or unit, or optionally further comprising for the intrinsic other steps of these process, methods, product or equipment or list Member.
It is also understood that in the description of the present invention, the meaning of " plurality " is two or more, unless otherwise clear It is specific to limit.
In order to illustrate technical solutions according to the invention, the following is a description of specific embodiments.
Embodiment 1:
Fig. 1 shows a kind of implementation process of the partition method of data cube of one embodiment of the present of invention offer, The process executing subject of the present embodiment can be terminal device, and details are as follows for process:
Step S101 is based on payment platform original service data, constructs data cube and fills data to its dynamic.
In the present embodiment, since payment platform can add new data to payment according to the New Transaction event constantly occurred Platform original service data, therefore, newly added data can also be replenished in time in data cube, to realize data cube The dynamic of body fills data.
Step S102 carries out multidomain treat-ment to the data cube according to default dimension member information, obtains multiple sons Data cube and corresponding zoning ordinance.
In the present embodiment, dimension member information refers to the member variable information of dimension, for identifying some dimension member.In advance If dimension member information is preset dimension member information.
The multiple subdata cube is saved in different storage mediums by step S103 respectively.
In the present embodiment, payment platform original service data mentioned here can derived from any relevant database or Hadoop Hive。
Wherein, Hadoop realizes a distributed file system, abbreviation HDFS.Hadoop, which is one, to be counted to a large amount of According to the software frame for carrying out distributed treatment.Hive is a kind of data warehouse schema of the foundation in Hadoop file system.Number Essence according to warehouse is exactly to collect information as much as possible, the decision support as company, and related operation mainly counts According to inquiry.
As shown in Fig. 2, being a kind of example of data cube.
The data cube constructed completes a variety of E-R model (Entity-Relationship from dispersion Model, entity relationship model) or MAP data structure, the conversion of the data cube of the multidimensional analysis unified to incidence relation, And establish the corresponding incidence relation of the two.
In the embodiment of the present invention, after data cube subregion, the parallel work of subdata cube after multiple strippings and slicings can be allowed Make, significantly improve user and data are carried out with the efficiency of various operations, and improves the response speed of data cube and divide Analyse performance.
Especially in practical applications, the data volume of payment platform original service data generally can be more than 10,000,000,000, true table Data volume can be more than 1,000,000,000 record numbers, it is accordingly required in particular to using the partitioning technique provided in the embodiment of the present invention, to solve magnanimity The difficulty of data storage, while improving the speed of data processing.
As shown in figure 3, in one embodiment of the invention, the step S101 in embodiment corresponding to Fig. 1 is specifically wrapped It includes:
Step S201 is based on payment platform original service data, constructs dimension table.
Step S202 constructs true table according to the dimension table.
Step S203, the incidence relation based on the dimension table and the true table and the two, constructs Star Model.
Step S204, according to the Star Model, data cube described in dynamic construction.
In the present embodiment, it is flat payment can be based on using technologies such as data prediction, extraction, conversion, loaded in parallel, merging The dimension table of platform original service data configuration data warehouse, true table and Star Model.
As shown in figure 4, showing a kind of dimension table and true table using trading activity as a kind of concrete application scene.
Commodity list, Yong Hubiao, Shang Jiabiao, timetable and regional table in Fig. 4 belong to dimension table, these tables have one Unique major key, for example, commodity ID, User ID, Merchant ID etc., then house detailed data information in table.
Each dimension table includes single primary key column.The major key of dimension table can be used as any true table being associated External key, in addition, the description environment of dimension table row should be completely corresponding with true table row.
Order table in Fig. 4 is exactly a true table, and one order of every completion will increase a record in order. It is the set of a pile major key, these ID can be corresponded in dimension table respectively without storing actual content in true table One record.
In true table, occur in manipulation type event in the real world, generated Measure Indexes and mensurable number Value, is stored in true table.The corresponding metrology event of true table row, for example single purchase behavior is it can be understood that be one It is true.
In one embodiment of the invention, before step S201, the partition method of the data cube further include:
The conversion that the payment platform original service data are carried out with data format, obtains the source data of preset format.
In the present embodiment, the conversion of data format includes:
1) data prediction, including but not limited to data encryption, data deciphering, data encoding and data decoding etc..
2) data are revised automatically, including but not limited to deletion messy code, deletion clear data etc..
3) character is handled, including but not limited to the processing of blank class character, spcial character processing and string representation mode Conversion etc..
In the present embodiment by carrying out the processing of data format to original business datum in advance, avoids and be subsequently generated Include wrong data or the messy code data that can not be differentiated in data cube.
In one embodiment of the invention, step S201 includes:
1) rule is selected according to single dimension, corresponding data is read from the source data, obtain dimension data.
2) dimension data newly obtained, is merged into the dimension generated by the loaded in parallel mode for using multinode multithreading Degree obtains the dimension table in.
In the present embodiment, a dimension table corresponds to some aspect or the visual angle of global analysis data, that is, data cube One face of body or axis.
In the present embodiment, corresponding number is read from the source data using dedicated fastening means or class libraries exploitation code According to obtaining dimension data.
In the present embodiment, data are loaded using the loaded in parallel mode of the multinode multithreading of data warehouse.
In the present embodiment, with the update of payment platform original service data, the dimension data generated according to source data Constantly updating, the dimension data newly obtained be merged into the dimension data generated, it is ensured that dimension data it is steady Qualitative and availability.It is slowly varying with data in the dimension table of history trendline, generated dimension data is not deleted, But the dimension data newly obtained is merged into the dimension data generated, improve the maintenance efficiency of dimension table.
In one embodiment of the invention, step S202 includes:
1) external key of the major key of dimension table as the fact that be associated table is obtained.
2) major key of the whole dimension table of set obtains the true table.
In one embodiment, in conjunction with business demand and using aggregate function or window function source data is grouped and Summarize, obtains the dimension member information of data.
True table includes dimension member information and the incidence relation with dimension each in dimension table.
In one embodiment, in step S203, after having constructed suitable dimension table and true table, in conjunction with dimension table and The incidence relation of true table has also got well Star Model with regard to construction.
In one embodiment of the invention, step S204 includes:
1) frame of data cube is constructed in conjunction with the Star Model using multidimensional analysis engine.
2) according to the frame, each coordinate points in data cube are read from the dimension table and the true table Corresponding numerical value dynamically fills the data cube.
In the present embodiment, the frame of data cube includes dimension member information, for example, mechanism shown in Fig. 2, transaction The dimension members information such as the amount of money, time, trade company, area and industry.
Particular content and data based on dimension member information, can build the frame of data cube, for example, three The cubes such as dimension, the four-dimension.
After building the frame of data cube, arbitrary point can be positioned according to every one-dimensional dimension member information Coordinate, obtain corresponding numerical value from dimension table and true table and be added in data cube, just complete data cube Building.
As the data of dimension table and true table update, data cube also can dynamically update the data of filling.
In one embodiment of the invention, after step s 204, the partition method of the data cube further include:
1) cutting is carried out according to the default dimension member information to true table and corresponding dimension table, is based on dynamic construction The principle of data cube, the subdata cube after obtaining multiple strippings and slicings.
2) multiple subdata cube concurrent workings, and balanced be distributed in multiple and different storage mediums.
3) the multidimensional analysis engine based on the application zoning ordinance, executes the data cube after subregion User's operation.
In the present embodiment, since data cube according to the rule construct of Star Model and is moved by dimension table and true table State fills data, once the subregion that subregion is also achieved that data cube is carried out to true table and corresponding dimension table.
After data cube subregion, the subdata cube concurrent working after multiple strippings and slicings can be allowed, significantly improve user Data are carried out with efficiency of various operations, such as inquiry data etc..
The subregion of data cube realizes the text that one or several large capacity files are cut into many capacity very littles Part, and allow these small documents are balanced to be distributed on multiple and different storage mediums, once inquiry, these multiple storages are situated between Small documents concurrent working in matter.
Increase the function of its automatic application partition rule in multidimensional analysis engine, so that user draws in operation multidimensional analysis When holding up analysis cube metadata, the response speed and analysis performance of data cube are improved.
In order to make it easy to understand, dividing according to mechanism the data cube in Fig. 2 by taking a concrete application scene as an example Area, the subdata cube after subregion are as shown in Figure 5.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit It is fixed.
Embodiment 2:
As shown in fig. 6, the partition system 100 for the data cube that one embodiment of the present of invention provides, for executing Fig. 1 Method and step in corresponding embodiment comprising:
Cubic configuration module 110, for being based on payment platform original service data, constructing data cube and being moved to it State fills data.
Cube division module 120, for being carried out at subregion according to default dimension member information to the data cube Reason, obtains multiple subdata cubes and corresponding zoning ordinance.
Multidomain treat-ment module 130, for the multiple subdata cube to be saved in respectively in different storage mediums.
In one embodiment of the invention, cubic configuration module 110 includes:
Dimension table structural unit constructs dimension table for being based on payment platform original service data.
True table structural unit, for constructing true table according to the dimension table.
Star Model structural unit, for the incidence relation based on the dimension table and the true table and the two, structure Make Star Model.
Cubic configuration unit, for according to the Star Model, data cube described in dynamic construction.
In one embodiment of the invention, the partition system 100 of data cube further include: data processing module is used In the conversion that the payment platform original service data are carried out with data format, the source data of preset format is obtained.
In one embodiment of the invention, dimension table structural unit is also used to:
Rule is selected according to single dimension, corresponding data are read from the source data, obtain dimension data.
Using the loaded in parallel mode of multinode multithreading, the dimension data newly obtained is merged into the dimension generated In data, the dimension table is obtained.
In one embodiment of the invention, true table structural unit is also used to:
Obtain external key of the major key of dimension table as the fact that be associated table.
The major key for gathering whole dimension tables obtains the true table.
In one embodiment of the invention, cubic configuration unit is also used to
The frame of data cube is constructed in conjunction with the Star Model using multidimensional analysis engine.
According to the frame, each coordinate points pair in data cube are read from the dimension table and the true table The numerical value answered dynamically fills the data cube.
In one embodiment of the invention, cubic configuration module 110 further include:
Stripping and slicing unit, for carrying out cutting according to the default dimension member information to true table and corresponding dimension table, The subdata cube based on the principle of dynamic construction data cube, after obtaining multiple strippings and slicings.
Zoning unit, is used for multiple subdata cube concurrent workings, and it is balanced be distributed in it is multiple and different In storage medium.
Operating unit, for the multidimensional analysis engine based on the application zoning ordinance, to the number after subregion User's operation is executed according to cube.
In one embodiment, the partition system 100 of data cube further includes other function module/unit, for real Method and step in current embodiment 1 in each embodiment.
It is apparent to those skilled in the art that for convenience and simplicity of description, only with above-mentioned each function The division progress of module can according to need and for example, in practical application by above-mentioned function distribution by different function moulds Block is completed, i.e., the internal structure of the partition system 100 of the described data cube is divided into different functional modules, more than completing The all or part of function of description.Each functional module in embodiment can integrate in one processing unit, be also possible to Each unit physically exists alone, and can also be integrated in one unit with two or more units, above-mentioned integrated module Both it can take the form of hardware realization, can also realize in the form of software functional units.In addition, the tool of each functional module Body title is also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Point of above-mentioned data cube The specific work process of module in sound zone system 100, can be with the corresponding process of method in reference implementation example 1, and details are not described herein.
Embodiment 3:
Fig. 7 is the schematic diagram for the terminal device 7 that one embodiment of the invention provides.As shown in fig. 7, the terminal of the embodiment is set Standby 7 include: processor 71, memory 72 and are stored in the meter that can be run in the memory 72 and on the processor 71 Calculation machine program 73.The processor 71 is realized in each embodiment as described in example 1 above when executing the computer program 73 The step of, such as step S101 to S103 shown in FIG. 1.Alternatively, reality when the processor 71 executes the computer program 73 The function of each module/unit in each system embodiment now as described in example 2 above, such as module 110 to 130 shown in Fig. 6 Function.
The terminal device 7 refers to the terminal with data-handling capacity, including but not limited to computer, work station, clothes Business device, the smart phone more even haveing excellent performance, palm PC, tablet computer, personal digital assistant (PDA), intelligence electricity Depending on (Smart TV) etc..The specific example of terminal device 7 is enumerated in detail above, it will be appreciated by those of skill in the art that intelligence Can terminal be not limited to above-mentioned enumerate example.
The terminal device 7 may include, but be not limited only to, processor 71, memory 72.Those skilled in the art can manage Solution, Fig. 7 is only the example of terminal device 7, does not constitute the restriction to terminal device 7, may include more or more than illustrating Few component perhaps combines certain components or different components, such as the terminal device 7 can also include input and output Equipment, network access equipment, bus etc..
Alleged processor 71 can be central processing unit (Central Processing Unit, CPU), can also be Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field- Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor Deng.
The memory 72 can be the internal storage unit of the terminal device 7, such as the hard disk or interior of terminal device 7 It deposits.The memory 72 is also possible to the External memory equipment of the terminal device 7, such as be equipped on the terminal device 7 Plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card dodge Deposit card (Flash Card) etc..Further, the memory 72 can also both include the storage inside list of the terminal device 7 Member also includes External memory equipment.The memory 72 is for storing needed for the computer program and the terminal device 7 Other programs and data.The memory 72 can be also used for temporarily storing the data that has exported or will export.
Embodiment 4:
The embodiment of the invention also provides a kind of computer readable storage medium, computer-readable recording medium storage has meter Calculation machine program is realized the step in each embodiment as described in example 1 above, such as is schemed when computer program is executed by processor Step S101 shown in 1 to step S103.Alternatively, realizing when the computer program is executed by processor such as institute in embodiment 2 The function of each module/unit in each system embodiment stated, such as the function of module 110 to 130 shown in fig. 6.
The computer program can be stored in a computer readable storage medium, and the computer program is by processor When execution, it can be achieved that the step of above-mentioned each embodiment of the method.Wherein, the computer program includes computer program code, The computer program code can be source code form, object identification code form, executable file or certain intermediate forms etc..Institute State computer-readable medium may include: can carry the computer program code any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory), arbitrary access Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, embodiment 1 to 4 can in any combination, group The new embodiment formed after conjunction is also within the scope of protection of this application.There is no the portion for being described in detail or recording in some embodiment Point, it may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed terminal device and method can pass through it Its mode is realized.For example, system described above/terminal device embodiment is only schematical, for example, the module Or the division of unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple lists Member or component can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, Shown or discussed mutual coupling or direct-coupling or communication connection can be through some interfaces, device or unit INDIRECT COUPLING or communication connection, can be electrical property, mechanical or other forms.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations;Although referring to aforementioned reality Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features;And these are modified Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all It is included within protection scope of the present invention.

Claims (10)

1. a kind of partition method of data cube characterized by comprising
Based on payment platform original service data, constructs data cube and data are filled to its dynamic;
Multidomain treat-ment is carried out to the data cube according to default dimension member information, obtains multiple subdata cubes and phase The zoning ordinance answered;
The multiple subdata cube is saved in respectively in different storage mediums.
2. the partition method of data cube as described in claim 1, which is characterized in that described to be based on the original industry of payment platform Business data, construct data cube, comprising:
Based on payment platform original service data, dimension table is constructed;
According to the dimension table, true table is constructed;
Incidence relation based on the dimension table and the true table and the two, constructs Star Model;
According to the Star Model, data cube described in dynamic construction.
3. the partition method of data cube as claimed in claim 2, which is characterized in that before the construction dimension table, Include:
The conversion that the payment platform original service data are carried out with data format, obtains the source data of preset format.
4. the partition method of data cube as claimed in claim 3, which is characterized in that the construction dimension table, comprising:
Rule is selected according to single dimension, corresponding data are read from the source data, obtain dimension data;
Using the loaded in parallel mode of multinode multithreading, the dimension data newly obtained is merged into the dimension data generated In, obtain the dimension table.
5. the partition method of data cube as claimed in claim 2, which is characterized in that the true table of the construction, comprising:
Obtain external key of the major key of dimension table as the fact that be associated table;
The major key for gathering whole dimension tables obtains the true table.
6. the partition method of data cube as claimed in claim 2, which is characterized in that data described in the dynamic construction are vertical Cube, comprising:
The frame of data cube is constructed in conjunction with the Star Model using multidimensional analysis engine;
According to the frame, from each coordinate points is corresponding in reading data cube in the dimension table and the true table Numerical value dynamically fills the data cube.
7. the partition method of data cube as claimed in claim 6, which is characterized in that further include:
Cutting is carried out according to the default dimension member information to true table and corresponding dimension table, it is vertical based on dynamic construction data The principle of cube, the subdata cube after obtaining multiple strippings and slicings;
Multiple subdata cube concurrent workings, and balanced be distributed in multiple and different storage mediums;
Based on the multidimensional analysis engine of the application zoning ordinance, user behaviour is executed to the data cube after subregion Make.
8. a kind of partition system of data cube characterized by comprising
Cubic configuration module, for being based on payment platform original service data, constructing data cube and being filled to its dynamic Data;
Cube division module is obtained for carrying out multidomain treat-ment to the data cube according to default dimension member information Multiple subdata cubes and corresponding zoning ordinance;
Multidomain treat-ment module, for the multiple subdata cube to be saved in respectively in different storage mediums.
9. a kind of terminal device, including memory, processor and storage are in the memory and can be on the processor The computer program of operation, which is characterized in that the processor realizes such as claim 1 to 7 when executing the computer program The step of partition method of any one data cube.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In the square partition of realization data cube as described in any one of claim 1 to 7 when the computer program is executed by processor The step of method.
CN201810889593.XA 2018-08-07 2018-08-07 A kind of partition method of data cube, system and terminal device Pending CN109299197A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810889593.XA CN109299197A (en) 2018-08-07 2018-08-07 A kind of partition method of data cube, system and terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810889593.XA CN109299197A (en) 2018-08-07 2018-08-07 A kind of partition method of data cube, system and terminal device

Publications (1)

Publication Number Publication Date
CN109299197A true CN109299197A (en) 2019-02-01

Family

ID=65168191

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810889593.XA Pending CN109299197A (en) 2018-08-07 2018-08-07 A kind of partition method of data cube, system and terminal device

Country Status (1)

Country Link
CN (1) CN109299197A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110287213A (en) * 2019-07-03 2019-09-27 中通智新(武汉)技术研发有限公司 Data query method, apparatus and system based on OLAP system
CN110647577A (en) * 2019-08-02 2020-01-03 威富通科技有限公司 Data cube partitioning method and device, computer equipment and storage medium
CN113297333A (en) * 2021-03-17 2021-08-24 无锡极数宝大数据科技有限公司 Data processing method, device, server and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080208874A1 (en) * 2007-02-26 2008-08-28 Microsoft Corporation Handling multi-dimensional data including writeback data
CN101452485A (en) * 2008-12-31 2009-06-10 中国建设银行股份有限公司 Method and device for generating multidimensional cubic based on relational database
CN108346007A (en) * 2018-03-02 2018-07-31 深圳灵虎至真智能科技有限公司 A kind of mobile phone labeling detection data analysis method based on FP-Growth algorithms

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080208874A1 (en) * 2007-02-26 2008-08-28 Microsoft Corporation Handling multi-dimensional data including writeback data
CN101452485A (en) * 2008-12-31 2009-06-10 中国建设银行股份有限公司 Method and device for generating multidimensional cubic based on relational database
CN108346007A (en) * 2018-03-02 2018-07-31 深圳灵虎至真智能科技有限公司 A kind of mobile phone labeling detection data analysis method based on FP-Growth algorithms

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110287213A (en) * 2019-07-03 2019-09-27 中通智新(武汉)技术研发有限公司 Data query method, apparatus and system based on OLAP system
CN110287213B (en) * 2019-07-03 2023-02-17 中通智新(武汉)技术研发有限公司 Data query method, device and system based on OLAP system
CN110647577A (en) * 2019-08-02 2020-01-03 威富通科技有限公司 Data cube partitioning method and device, computer equipment and storage medium
CN113297333A (en) * 2021-03-17 2021-08-24 无锡极数宝大数据科技有限公司 Data processing method, device, server and storage medium

Similar Documents

Publication Publication Date Title
US11789978B2 (en) System and method for load, aggregate and batch calculation in one scan in a multidimensional database environment
US11979433B2 (en) Highly scalable four-dimensional web-rendering geospatial data system for simulated worlds
US20230084389A1 (en) System and method for providing bottom-up aggregation in a multidimensional database environment
CN109241159A (en) A kind of subregion querying method, system and the terminal device of data cube
CA2953969C (en) Interactive interfaces for machine learning model evaluations
CN107766568B (en) Efficient query processing using histograms in columnar databases
US9747128B1 (en) Worldwide distributed file system model
US11075991B2 (en) Partitioning data according to relative differences indicated by a cover tree
CN109614402A (en) Multidimensional data query method and device
CN109299197A (en) A kind of partition method of data cube, system and terminal device
CN111506559A (en) Data storage method and device, electronic equipment and storage medium
CN103577455A (en) Data processing method and system for database aggregating operation
Hashem et al. An Integrative Modeling of BigData Processing.
KR20190008228A (en) A method and system for storing graph information in a database using a B-tree
CN109343962A (en) Data processing method, device and distribution service
Benlachmi et al. A comparative analysis of hadoop and spark frameworks using word count algorithm
CN111708895B (en) Knowledge graph system construction method and device
CN113055476B (en) Cluster type service system, method, medium and computing equipment
CN111949913B (en) Efficient matching method and system for space-time perception publish/subscribe system
Siddesh et al. Driving big data with hadoop technologies
CN114254166A (en) Federated graph database architecture
CN115935016A (en) Multi-source heterogeneous data management method and system, storage medium and electronic equipment
CN112131850A (en) Intelligent bill raising template management method, device, terminal and storage medium
CN116701220A (en) Data synchronization test method and device, electronic equipment and computer readable medium
CN114201487A (en) Storage device and method of intelligent contract

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190201

RJ01 Rejection of invention patent application after publication