CN104657476A - On-line analytical processing method and system - Google Patents

On-line analytical processing method and system Download PDF

Info

Publication number
CN104657476A
CN104657476A CN201510083829.7A CN201510083829A CN104657476A CN 104657476 A CN104657476 A CN 104657476A CN 201510083829 A CN201510083829 A CN 201510083829A CN 104657476 A CN104657476 A CN 104657476A
Authority
CN
China
Prior art keywords
described
model
analysis
module
analytical
Prior art date
Application number
CN201510083829.7A
Other languages
Chinese (zh)
Inventor
孟然
陈小明
李瑾
马俊
肖振全
王雨学
姚娜
Original Assignee
百度在线网络技术(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百度在线网络技术(北京)有限公司 filed Critical 百度在线网络技术(北京)有限公司
Priority to CN201510083829.7A priority Critical patent/CN104657476A/en
Publication of CN104657476A publication Critical patent/CN104657476A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/211Schema design and management
    • G06F16/212Schema design and management with details for data modelling support
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/256Integrating or interfacing systems involving database management systems in federated or virtual databases

Abstract

The invention provides an on-line analytical processing method and system. The method comprises the following steps that a service requirement model is confirmed; service data is confirmed according to the confirmed service requirement model; an analysis model is built according to a virtual physical model according to the confirmed service data; the data is analyzed and displayed according to the built analysis model. When the technical scheme adopted by the method and the system provided by the invention are adopted, the relying on the traditional physical model can be avoided, i.e., a tar-shaped or snowflake-shaped physical structure is replaced by a virtual physical model, so that the expansibility and the adaptation capability to systems with high-complexity structures, high-isomerism structures and the like can be improved, and in addition, the ETL (extract transform and load) process is omitted, so that the implementation period, the resource demands and the implementation cost can be reduced, and the real-time performance is improved.

Description

The method and system of on-line analytical processing

Technical field

The present invention relates to the communications field, specifically, relate to the method and system of on-line analytical processing.

Background technology

On-line analytical processing (OLAP) technology is at effect all the more very important of current software field, but traditional on-line analytical processing mode is all based on schema file, namely support (the star-like or snowflake type of physical model is needed, this part model derives from the physical storage structure preparing data procedures and produce, both resource was needed, also professional knowledge support is needed), therefore there is extendability, the problems such as heterogeneous system adaptive faculty difference, and in traditional on-line analytical processing process, need through ETL (Extract-Transform-Load, extraction-transposition-loading) process and complete data warehouse, the structure of Data Mart, which occupies the most of the time of whole on-line analytical processing flow process, and need user to provide ample resources, along with the variation of business and the lifting of business complexity, need to adjust the structure of data warehouse, thus cause maintenance cost, the increase of resource requirement cost, in addition along with the complexity of system promotes, degree of ripeness based on the system of cloud improves, system isomerism difference enhancing etc., the cost of ETL is more and more higher, cause real-time worse and worse.

Summary of the invention

For effectively solving the problems of the technologies described above, the invention provides a kind of method and system of on-line analytical processing.

On the one hand, embodiments of the present invention provide a kind of method of on-line analytical processing, and described method comprises:

Confirm business demand model;

According to the business demand model validation business datum of described confirmation;

Business datum according to described confirmation passes through virtual physical model creation analysis model;

According to analytical model analysis, the display data of described structure.

On the other hand, embodiments of the present invention additionally provide a kind of system of on-line analytical processing, and described system comprises:

Requirement validation module, for confirming business demand model;

Business datum confirms module, for the business demand model validation business datum confirmed according to described requirement validation module;

Analytical model builds module, for confirming that according to described business datum business datum that module confirms is by virtual physical model creation analysis model;

Analyze and display module, for the analytical model analysis constructed by described analytical model structure module, display data.

The method and system implementing on-line analytical processing provided by the invention can without the need to relying on traditional physical model, namely physical arrangement that is star-like or snowflake type is replaced by virtual physical model, thus improve extendability and the adaptive faculty to high complexity, the isostructural system of high isomery, and owing to eliminating the process of ETL, therefore can reduce implementation cycle, resource requirement and implementation cost, thus improve real-time.

Accompanying drawing explanation

Fig. 1 is the process flow diagram of the method for a kind of on-line analytical processing according to embodiment of the present invention;

Fig. 2 is the process flow diagram of the method for another kind of on-line analytical processing according to embodiment of the present invention;

Fig. 3 shows a kind of embodiment of the treatment S 130 ' shown in Fig. 2;

Fig. 4 shows a kind of embodiment of the treatment S 150 ' shown in Fig. 2;

Fig. 5 is the structural representation of the system of a kind of on-line analytical processing according to embodiment of the present invention;

Fig. 6 is the structural representation of the system of another kind of on-line analytical processing according to embodiment of the present invention;

Fig. 7 shows a kind of embodiment that the analytical model shown in Fig. 6 builds module 130 ';

Fig. 8 shows a kind of embodiment that the analytical model shown in Fig. 6 builds module 150 '.

Embodiment

For making the object of embodiments of the invention, technical scheme and advantage clearly, below in conjunction with accompanying drawing, the present invention is described in detail.

Fig. 1 is the process flow diagram of the method for a kind of on-line analytical processing according to embodiment of the present invention.See Fig. 1, described method comprises:

S110: confirm business demand model;

S120: according to the business demand model validation business datum of described confirmation;

Wherein, in embodiments of the present invention, described business datum comprises: dimension, index and KPI (Key Performance Indicator, crucial efficiency index).

S130: the business datum according to described confirmation passes through virtual physical model creation analysis model;

Wherein, in embodiments of the present invention, described virtual physical model such as can comprise: web (network) serves.

S140: according to analytical model analysis, the display data of described structure.

By above-mentioned embodiment, traditional physical model can be replaced by virtual physical model, thus improve extendability and the adaptive faculty to high complexity, the isostructural system of high isomery, and owing to eliminating the process of ETL, therefore can reduce implementation cycle, resource requirement and implementation cost, thus improve real-time.

Fig. 2 is the process flow diagram of the method for another kind of on-line analytical processing according to embodiment of the present invention.See Fig. 2, described method comprises:

S110 ' is to S130 ': with above-mentioned S110 to S130, does not repeat them here;

S140 ': verify the analytical model of described structure, if be verified, performs S150 ';

S150 ': with above-mentioned S140, do not repeat them here.

Particularly, as shown in Figure 3, described treatment S 130 ' can realize in the following manner:

S131 ': provide consistent web services interface for described business datum;

S132 ': for described web services interface construction logic model;

S133 ': for described logical model creation analysis model.

In embodiments of the present invention, can be front in the described treatment S 140 ' of execution, verify each web services interface quoted in described analytical model respectively, if described analytical model authentication failed, then return the step that each web services interface quoted in described analytical model is verified in execution respectively.

As shown in Figure 4, described treatment S 150 ' can realize in the following manner:

S151 ': the analytical model according to described structure analyzes data;

S152 ': based on the inquiry of web services, display analysis result.

Below in conjunction with concrete example, embodiments of the present invention are specifically described.In embodiments of the present invention, first-selected confirmation business demand model; Again according to the business demand model validation business datum (comprising: dimension, index and KPI etc.) confirmed; Then based on the business datum creation analysis model of web services according to described confirmation, particularly, consistent web services interface is provided for described business datum, for described web services interface construction logic model, for described logical model creation analysis model; Verify each web services interface quoted in the analytical model of described structure respectively, check analysis model again, if described analytical model is verified, then analyze according to this analytical model, show data, if described analytical model authentication failed, then return the step that each web services interface quoted in the analytical model of described structure is verified in execution respectively, in addition in embodiments of the present invention, if user wants current dimension/index to be revised as other sources, need to revise web services address.Wherein, comprise according to the specific implementation of this analytical model analysis, display data: the analytical model according to described structure analyzes data; Based on the inquiry of web services, display analysis result; And the data analyzed can be carried out testing, dispose, reach the standard grade to be integrated in other system.

Fig. 5 is the structural representation of the system of a kind of on-line analytical processing according to embodiment of the present invention.See Fig. 5, this system 100 comprises: requirement validation module 110, business datum confirm that module 120, analytical model build module 130 and analyze and display module 140, particularly:

Requirement validation module 110, for confirming business demand model;

Business datum confirms module 120, for the business demand model validation business datum confirmed according to described requirement validation module 110;

Wherein, in embodiments of the present invention, described business datum comprises: dimension, index and KPI.

Analytical model builds module 130, for confirming that according to described business datum business datum that module 120 confirms is by virtual physical model creation analysis model;

Wherein, in embodiments of the present invention, described virtual physical model such as can comprise: web services.

Analyze and display module 140, for the analytical model analysis constructed by described analytical model structure module 130, display data.

Fig. 6 is the structural representation of the system of another kind of on-line analytical processing according to embodiment of the present invention.See Fig. 6, this system 100 ' comprising: requirement validation module 110 ', business datum confirm that module 120 ', analytical model build module 130 ', analytical model authentication module 140 ' and analyze and display module 150 ', particularly:

Requirement validation module 110 ', business datum confirm that module 120 ' and analytical model build module 130 ' and confirm that module 120 and analytical model build module 130 with above-mentioned requirement validation module 110, business datum respectively, do not repeat them here;

Analytical model authentication module 140 ', verifies for the analytical model built constructed by module 130 ' described analytical model;

Analysis and display module 150 ', with above-mentioned analysis and display module 140, do not repeat them here.

As shown in Figure 7, described analytical model builds module 130 ' and can comprise: interface providing unit 131 ', logic modeling unit 132 ' and analysis modeling unit 133 ', particularly:

Interface providing unit 131 ', for providing consistent web services interface for described business datum;

Logic modeling unit 132 ', for the web services interface construction logic model provided for described interface providing unit 131 ';

Analysis modeling unit 133 ', for for the logical model creation analysis model constructed by described logic modeling unit 132 '.

In embodiments of the present invention, described system 100 ' can also comprise: interface authentication module, for verifying each web services interface quoted in described analytical model respectively.

As shown in Figure 8, described analysis and display module 150 ' can comprise: analytic unit 151 ' and display unit 152 ', particularly:

Analytic unit 151 ', analyzes data for the analytical model according to described structure;

Display unit 152 ', for the inquiry based on web services, shows the analysis result of described analytic unit 151 '.

Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can all be implemented by software, also can realize by the mode of software combined with hardware platform, can certainly all be implemented by hardware.Based on such understanding, what technical scheme of the present invention contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprising some instructions in order to make a computer equipment (can be personal computer, server, smart mobile phone or the network equipment etc.) perform the method described in some part of each embodiment of the present invention or embodiment.

The term used in instructions of the present invention and wording, just to illustrating, are not meaned and are formed restriction.It will be appreciated by those skilled in the art that under the prerequisite of the ultimate principle not departing from disclosed embodiment, can various change be carried out to each details in above-mentioned embodiment.Therefore, scope of the present invention is only determined by claim, and in the claims, except as otherwise noted, all terms should be understood by the most wide in range rational meaning.

Claims (12)

1. a method for on-line analytical processing, is characterized in that, described method comprises:
Confirm business demand model;
According to the business demand model validation business datum of described confirmation;
Business datum according to described confirmation passes through virtual physical model creation analysis model;
According to analytical model analysis, the display data of described structure.
2. the method for claim 1, is characterized in that, described method also comprises:
The analytical model of described structure is verified, if be verified, performs the step of the analytical model analysis according to described structure, display data.
3. method as claimed in claim 1 or 2, is characterized in that,
Described virtual physical model comprises: network web services.
4. method as claimed in claim 3, it is characterized in that, the business datum according to described confirmation is comprised by virtual physical model creation analysis model:
Consistent web services interface is provided for described business datum;
For described web services interface construction logic model;
For described logical model creation analysis model.
5. method as claimed in claim 4, it is characterized in that, described method also comprises:
Before performing the step that the analytical model of described structure is verified, verify each web services interface quoted in described analytical model respectively.
6. method as claimed in claim 5, it is characterized in that, described method also comprises:
If described analytical model authentication failed, then return the step that each web services interface quoted in described analytical model is verified in execution respectively.
7. method as claimed in claim 6, is characterized in that, comprises according to the analytical model analysis of described structure, display data:
Analytical model according to described structure analyzes data;
Based on the inquiry of web services, display analysis result.
8. a system for on-line analytical processing, is characterized in that, described system comprises:
Requirement validation module, for confirming business demand model;
Business datum confirms module, for the business demand model validation business datum confirmed according to described requirement validation module;
Analytical model builds module, for confirming that according to described business datum business datum that module confirms is by virtual physical model creation analysis model;
Analyze and display module, for the analytical model analysis constructed by described analytical model structure module, display data.
9. system as claimed in claim 8, it is characterized in that, described system also comprises:
Analytical model authentication module, for verifying the analytical model of described structure.
10. system as claimed in claim 8 or 9, is characterized in that, described analytical model builds module and comprises:
Interface providing unit, for providing consistent web services interface for described business datum;
Logic modeling unit, for the web services interface construction logic model provided for described interface providing unit;
Analysis modeling unit, for for the logical model creation analysis model constructed by described logic modeling unit.
11. systems as claimed in claim 10, it is characterized in that, described system also comprises:
Interface authentication module, for verifying each web services interface quoted in described analytical model respectively.
12. systems as claimed in claim 11, it is characterized in that, described analysis and display module comprise:
Analytic unit, analyzes data for the analytical model according to described structure;
Display unit, for the inquiry based on web services, shows the analysis result of described analytic unit.
CN201510083829.7A 2015-02-16 2015-02-16 On-line analytical processing method and system CN104657476A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510083829.7A CN104657476A (en) 2015-02-16 2015-02-16 On-line analytical processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510083829.7A CN104657476A (en) 2015-02-16 2015-02-16 On-line analytical processing method and system

Publications (1)

Publication Number Publication Date
CN104657476A true CN104657476A (en) 2015-05-27

Family

ID=53248603

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510083829.7A CN104657476A (en) 2015-02-16 2015-02-16 On-line analytical processing method and system

Country Status (1)

Country Link
CN (1) CN104657476A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106446696A (en) * 2015-08-10 2017-02-22 联想(北京)有限公司 Information processing method and electronic device
CN106933897A (en) * 2015-12-31 2017-07-07 北京国双科技有限公司 Data query method and apparatus
CN106446696B (en) * 2015-08-10 2020-06-23 联想(北京)有限公司 Information processing method and electronic equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1674011A (en) * 2004-03-26 2005-09-28 赖明勇 Electronic business decision-making support system
CN101615192A (en) * 2009-07-09 2009-12-30 河北全通通信有限公司 The implementation method of sharing semantic layer by decision support system
CN101710280A (en) * 2009-11-05 2010-05-19 金蝶软件(中国)有限公司 Packaging method and devices of BI product members
CN102624558A (en) * 2012-03-09 2012-08-01 浪潮通信信息系统有限公司 Method for solving performance bottleneck of network management system in communication industry based on cloud computing technology
CN102693307A (en) * 2012-05-24 2012-09-26 上海克而瑞信息技术有限公司 Website user access behavior recording and analyzing system
US20120290527A1 (en) * 2011-05-12 2012-11-15 Narendar Yalamanchilli Data extraction and testing method and system
CN102918530A (en) * 2010-05-27 2013-02-06 甲骨文国际公司 Data mart automation
CN103455540A (en) * 2012-05-29 2013-12-18 Sap股份公司 System and method of generating in-memory models from data warehouse models
US20140172827A1 (en) * 2012-12-18 2014-06-19 Sap Ag In-memory, columnar database multidimensional analytical view integration
CN104111996A (en) * 2014-07-07 2014-10-22 山大地纬软件股份有限公司 Health insurance outpatient clinic big data extraction system and method based on hadoop platform

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1674011A (en) * 2004-03-26 2005-09-28 赖明勇 Electronic business decision-making support system
CN101615192A (en) * 2009-07-09 2009-12-30 河北全通通信有限公司 The implementation method of sharing semantic layer by decision support system
CN101710280A (en) * 2009-11-05 2010-05-19 金蝶软件(中国)有限公司 Packaging method and devices of BI product members
CN102918530A (en) * 2010-05-27 2013-02-06 甲骨文国际公司 Data mart automation
US20120290527A1 (en) * 2011-05-12 2012-11-15 Narendar Yalamanchilli Data extraction and testing method and system
CN102624558A (en) * 2012-03-09 2012-08-01 浪潮通信信息系统有限公司 Method for solving performance bottleneck of network management system in communication industry based on cloud computing technology
CN102693307A (en) * 2012-05-24 2012-09-26 上海克而瑞信息技术有限公司 Website user access behavior recording and analyzing system
CN103455540A (en) * 2012-05-29 2013-12-18 Sap股份公司 System and method of generating in-memory models from data warehouse models
US20140172827A1 (en) * 2012-12-18 2014-06-19 Sap Ag In-memory, columnar database multidimensional analytical view integration
CN104111996A (en) * 2014-07-07 2014-10-22 山大地纬软件股份有限公司 Health insurance outpatient clinic big data extraction system and method based on hadoop platform

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106446696A (en) * 2015-08-10 2017-02-22 联想(北京)有限公司 Information processing method and electronic device
CN106446696B (en) * 2015-08-10 2020-06-23 联想(北京)有限公司 Information processing method and electronic equipment
CN106933897A (en) * 2015-12-31 2017-07-07 北京国双科技有限公司 Data query method and apparatus
CN106933897B (en) * 2015-12-31 2020-02-07 北京国双科技有限公司 Data query method and device

Similar Documents

Publication Publication Date Title
Jurrus et al. Improvements to the APBS biomolecular solvation software suite
Goloboff Extended implied weighting
Chen et al. A cloud computing platform for ERP applications
JP6521973B2 (en) Pattern matching across multiple input data streams
Saldivar et al. Industry 4.0 with cyber-physical integration: A design and manufacture perspective
Kontopantelis et al. metaan: Random-effects meta-analysis
Zhao et al. Modeling MongoDB with relational model
US9002893B2 (en) Optimizing a clustered virtual computing environment
US9336493B2 (en) Systems and methods for clustering time series data based on forecast distributions
CN104391934A (en) Data calibration method and device
Majeau‐Bettez et al. Unified theory of allocations and constructs in life cycle assessment and input‐output analysis
KR20140074920A (en) Automatic relationship detection for reporting on spreadsheet data
US9691049B2 (en) Master bill of materials creation
US7991800B2 (en) Object oriented system and method for optimizing the execution of marketing segmentations
Ogudo et al. A device performance and data analytics concept for smartphones’ IoT services and machine-type communication in cellular networks
CN102970289B (en) The identity identifying method of sing on web user behavior pattern
US8819038B1 (en) System and method for performing set operations with defined sketch accuracy distribution
CN104572831A (en) Processing method and processing device of demand data of high speed train
US9852212B2 (en) Dynamic clustering for streaming data
Avila et al. SUSSING MERGER TREES: the influence of the halo finder
RU2607621C2 (en) Method, system and computer-readable data medium for grouping in social networks
CN103229177B (en) discrete element method
CN104408179A (en) Method and device for processing data from data table
CN105938557A (en) Image recognition method and image recognition device
US20120066204A1 (en) Providing lightweight multidimensional online data storage for web service usage reporting

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20150527