WO2004036456A2 - Method and system for online analytical processing (olap) - Google Patents
Method and system for online analytical processing (olap) Download PDFInfo
- Publication number
- WO2004036456A2 WO2004036456A2 PCT/EP2003/050620 EP0350620W WO2004036456A2 WO 2004036456 A2 WO2004036456 A2 WO 2004036456A2 EP 0350620 W EP0350620 W EP 0350620W WO 2004036456 A2 WO2004036456 A2 WO 2004036456A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- dimension
- data
- sorting
- sequence
- pivot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/953—Organization of data
- Y10S707/957—Multidimensional
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99941—Database schema or data structure
- Y10S707/99943—Generating database or data structure, e.g. via user interface
Definitions
- the present invention generally concerns database management systems performed by computers, in particular to corresponding OLAP (OnLine Analytical Processing) and Data Warehouse applications. More specifically, the invention relates to a method and system for generating user-defined presentations or views of data records contained in such a database management system. Even more specifically, the invention is related to database management systems with very large number of data records .
- OLAP OnLine Analytical Processing
- OLAP is computer processing that enables a user to easily and selectively extract and view data from different points-of- view. For example, a user can request that data be analyzed to display a spreadsheet showing all of a telecommunication company's mobile phone products sold in a country in a specific month of the year, compare revenue figures with those for the same products in the preceding month, and then see a comparison of other product sales in that country in the same time period.
- OLAP data is stored in a multidimensional database.
- a relational database can be thought of as two-dimensional
- a multidimensional database considers each data attribute, often called “data key”, such as product, geographic sales region, and time period as a separate "dimension.”
- OLAP software can locate the intersection of dimensions, e.g. 'all products sold in the Eastern region above a certain price during a certain time period', and display them. Attributes such as time periods can be broken down into sub-attributes .
- OLAP can be used for data mining or the discovery of previously un-discerned relationships between data items.
- An OLAP database does not need to be as large as a data warehouse, since not all transactional data is needed for trend analysis.
- ODBC Open Database Connectivity
- data records to be presented in a single cell of an underlying matrix presentation are continuously arranged in a subsequence comprising respective of said placeholder values.
- These single cells of said pivot presentation thus are generated using corresponding of said subsequences.
- a data subsequence of the whole sequence of data records can be used.
- Each of these cells needed for the user-specified pivot presentation is particularly defined a starting point in the sequence by which the required data of the facts table to be presented are accessed.
- a particular data record dimension of the database can be used more times in different aggregation stages of a pivot presentation without any runtime problems. Due to use of only vector operations for subsequent different pivot views of a given database, preceding generated sequences of data records for providing a user-defined pivot view are kept valid for the following pivot views and thus subsequently following pivot views are always deduced from an existing pivot view thus not destructing an already existing pivot view.
- pivot presentation mechanism is not limited to 2-dimensional but can also be applied to n-dimensional pivot presentations. In the n-dimensional case, however, the above mentioned sequence vector is (n-1) -dimensional .
- Fig. 4a-c illustrate typical vector operations for generating a sequence vector in accordance with the present invention
- Fig. 5-6g show overview table diagrams for illustrating how real facts data are sorted in order to obtain a desired pivot view in accordance with the present invention
- FIG. 2c and consists of two columns 260, 270, the left column 260 containing continuous numbers from again ,1' to ,20' in the present example and the right column 270 containing the pre-mentioned index values 275 depicted in Fig. 2a in an ordered arrangement that enables sequentially building-up the pivot view of Fig. 2b.
- a first integer vector 410 provides the sorting order of the facts of the underlying facts column, in relation to the respective key dimension and the occurrence of the elements (reference values) within the key dimensions.
- a second integer vector 400 provides a First Block Element (FBE) indicating, for each occurrence of a key dimension element (e.g. 'Brown'), the first element of its corresponding block within the sorting sequence 410.
- FBE First Block Element
- the 'Fact#' column of the 'Sorted Sequence' tabled is filled with the 'Fact' column of the 'Sorted Sequence' table of the corresponding dimension 410, i.e. a right-hand dimension in the corresponding sorting sequence step.
- the contents of 'Result Permutation' are erased after the two pre-mentioned initialization steps so that these fields can be newly filled in during the next sorting step.
- the number of lines in that table equals the number of facts contained in the real facts table.
- the processing steps conducted in the following are determined by the sorting order related to the key dimension 'Article' which is designated 'Sorted Sequence' in the Figures .
- the sorting mechanism itself is illustrated in more detail in the picture sequence shown in Figures 6a - 6g.
- Each of these pictures shows a single sorting step, the whole sequence of sorting steps shown in that sequence thus depicting only part of the entire sorting procedure.
- the whole procedure is based on inter-linkage of the shown four tables.
- the table for the key dimension 'Article' being designated 'Sorted Sequence' resulting from the previous sorting step for the key dimension 'Customer' is processed in the order of the parameter 'Pseq' from '1' to '20'.
- a corresponding index designated 'TmpGrp' is determined for each of the fact numbers contained in column 'Fact#'.
- the overall procedure is to determine a separate sorting sequence for each pivot dimension.
- the overall sequence is generated by applying the sorting procedure on the separately generated sequences starting with the result of the first and taking the next as the input for the "Mapping' table and "Sort position pointer' table as described above.
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004544289A JP4609995B2 (ja) | 2002-10-18 | 2003-09-11 | オンライン分析処理(olap)のための方法およびシステム |
| US10/530,936 US7340476B2 (en) | 2002-10-18 | 2003-09-11 | Method for online analytical processing (OLAP) |
| AU2003286187A AU2003286187A1 (en) | 2002-10-18 | 2003-09-11 | Method and system for online analytical processing (olap) |
| US11/948,033 US7774302B2 (en) | 2002-10-18 | 2007-11-30 | Online analytical processing (OLAP) |
| US12/015,551 US7856458B2 (en) | 2002-10-18 | 2008-01-17 | Online analytical processing (OLAP) |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP02023362.3 | 2002-10-18 | ||
| EP02023362 | 2002-10-18 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US11/948,033 Continuation US7774302B2 (en) | 2002-10-18 | 2007-11-30 | Online analytical processing (OLAP) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2004036456A2 true WO2004036456A2 (en) | 2004-04-29 |
| WO2004036456A3 WO2004036456A3 (en) | 2004-09-30 |
Family
ID=32103886
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2003/050620 Ceased WO2004036456A2 (en) | 2002-10-18 | 2003-09-11 | Method and system for online analytical processing (olap) |
Country Status (6)
| Country | Link |
|---|---|
| US (3) | US7340476B2 (enExample) |
| JP (1) | JP4609995B2 (enExample) |
| CN (1) | CN1688998A (enExample) |
| AU (1) | AU2003286187A1 (enExample) |
| TW (1) | TWI230344B (enExample) |
| WO (1) | WO2004036456A2 (enExample) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7263520B2 (en) * | 2004-02-27 | 2007-08-28 | Sap Ag | Fast aggregation of compressed data using full table scans |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7774298B2 (en) * | 2004-06-30 | 2010-08-10 | Sap Ag | Method and system for data extraction from a transaction system to an analytics system |
| CA2593999C (en) * | 2005-01-12 | 2015-12-08 | West Services, Inc. | Systems, methods, and interfaces for aggregating and providing information regarding legal professionals |
| US8270612B2 (en) * | 2006-12-18 | 2012-09-18 | Sap Ag | Mapping compound keys |
| US20090063458A1 (en) * | 2007-08-31 | 2009-03-05 | International Business Machines Corporation | method and system for minimizing sorting |
| US8495007B2 (en) * | 2008-08-28 | 2013-07-23 | Red Hat, Inc. | Systems and methods for hierarchical aggregation of multi-dimensional data sources |
| US20100076935A1 (en) * | 2008-09-09 | 2010-03-25 | Ahmir Hussain | Method, system, and computer for analytical reporting and archiving of data |
| US9959330B2 (en) | 2011-09-20 | 2018-05-01 | Oracle International Corporation | Mechanism for updating OLAP system structure and OLTP system structure |
| US8549045B2 (en) * | 2010-12-30 | 2013-10-01 | International Business Machines Corporation | Test data generation and scale up for database testing using unique common factor sequencing |
| US8751564B2 (en) * | 2011-04-19 | 2014-06-10 | Echostar Technologies L.L.C. | Reducing latency for served applications by anticipatory preprocessing |
| CN103019951B (zh) * | 2011-09-20 | 2016-12-07 | 阿里巴巴集团控股有限公司 | 有序数据的记录方法和装置、有序数据的访问方法和装置 |
| US8635229B2 (en) | 2011-10-18 | 2014-01-21 | International Business Machines Corporation | Sequenced query processing in data processing system |
| US8938416B1 (en) | 2012-01-13 | 2015-01-20 | Amazon Technologies, Inc. | Distributed storage of aggregated data |
| US8660985B2 (en) * | 2012-04-11 | 2014-02-25 | Renmin University Of China | Multi-dimensional OLAP query processing method oriented to column store data warehouse |
| US9721321B1 (en) * | 2012-04-12 | 2017-08-01 | Farshad Nayeri | Automated interactive dynamic audio/visual performance with integrated data assembly system and methods |
| CN103678420B (zh) * | 2012-09-25 | 2017-02-01 | 北大方正集团有限公司 | 一种建立多维数据集的方法和多维数据集处理装置 |
| US9646072B2 (en) * | 2013-03-03 | 2017-05-09 | Panorama Software Inc. | Multidimensional dataset query processing |
| CN103235793A (zh) * | 2013-04-01 | 2013-08-07 | 华为技术有限公司 | 联机处理数据的方法、设备及系统 |
| US9965512B2 (en) | 2013-06-25 | 2018-05-08 | Sap Se | Operators for constants in aggregated formulas |
| US10037355B2 (en) * | 2015-07-07 | 2018-07-31 | Futurewei Technologies, Inc. | Mechanisms for merging index structures in MOLAP while preserving query consistency |
| CN106775742A (zh) * | 2016-12-27 | 2017-05-31 | 中国建设银行股份有限公司 | 一种用户定制信息的扩展方法及系统 |
| EP3678033A1 (en) | 2019-01-07 | 2020-07-08 | QlikTech International AB | A computer implemented method for indexlet based aggregation |
| GB201916800D0 (en) | 2019-11-19 | 2020-01-01 | Ibm | Detecting errors in spreadsheets |
| GB201916804D0 (en) | 2019-11-19 | 2020-01-01 | Ibm | Generating an OLAP model from a spreadsheet |
| GB201916803D0 (en) | 2019-11-19 | 2020-01-01 | Ibm | Identifying content and structure of olap dimensions from a spreadsheet |
| GB201916801D0 (en) | 2019-11-19 | 2020-01-01 | Ibm | Identifying data relationships from a spreadsheet |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
| US6850252B1 (en) * | 1999-10-05 | 2005-02-01 | Steven M. Hoffberg | Intelligent electronic appliance system and method |
| US5727197A (en) * | 1995-11-01 | 1998-03-10 | Filetek, Inc. | Method and apparatus for segmenting a database |
| US5787279A (en) * | 1995-12-22 | 1998-07-28 | International Business Machines Corporation | System and method for conformationally-flexible molecular recognition |
| US5767854A (en) * | 1996-09-27 | 1998-06-16 | Anwar; Mohammed S. | Multidimensional data display and manipulation system and methods for using same |
| US5978796A (en) * | 1997-06-30 | 1999-11-02 | International Business Machines Corporation | Accessing multi-dimensional data by mapping dense data blocks to rows in a relational database |
| US6003036A (en) * | 1998-02-12 | 1999-12-14 | Martin; Michael W. | Interval-partitioning method for multidimensional data |
| US6957341B2 (en) * | 1998-05-14 | 2005-10-18 | Purdue Research Foundation | Method and system for secure computational outsourcing and disguise |
| US6334125B1 (en) * | 1998-11-17 | 2001-12-25 | At&T Corp. | Method and apparatus for loading data into a cube forest data structure |
| US7272593B1 (en) * | 1999-01-26 | 2007-09-18 | International Business Machines Corporation | Method and apparatus for similarity retrieval from iterative refinement |
| US6427123B1 (en) * | 1999-02-18 | 2002-07-30 | Oracle Corporation | Hierarchical indexing for accessing hierarchically organized information in a relational system |
| US6560594B2 (en) * | 1999-05-13 | 2003-05-06 | International Business Machines Corporation | Cube indices for relational database management systems |
| US20030171876A1 (en) * | 2002-03-05 | 2003-09-11 | Victor Markowitz | System and method for managing gene expression data |
| EP1217540A1 (en) * | 2000-11-29 | 2002-06-26 | Lafayette Software Inc. | Methods of organizing data and processing queries in a database system, and database system and software product for implementing such method |
| EP1211611A1 (en) * | 2000-11-29 | 2002-06-05 | Lafayette Software Inc. | Methods of encoding and combining integer lists |
| EP1211610A1 (en) * | 2000-11-29 | 2002-06-05 | Lafayette Software Inc. | Methods of organising data and processing queries in a database system |
| US20020138316A1 (en) * | 2001-03-23 | 2002-09-26 | Katz Steven Bruce | Value chain intelligence system and methods |
| US20030033179A1 (en) * | 2001-08-09 | 2003-02-13 | Katz Steven Bruce | Method for generating customized alerts related to the procurement, sourcing, strategic sourcing and/or sale of one or more items by an enterprise |
| US8090730B2 (en) * | 2001-12-04 | 2012-01-03 | University Of Southern California | Methods for fast progressive evaluation of polynomial range-sum queries on real-time datacubes |
| US7076505B2 (en) * | 2002-07-11 | 2006-07-11 | Metrobot Llc | Method, apparatus, and computer program product for providing a graphical user interface with a linear map component |
| WO2004029828A2 (en) * | 2002-09-24 | 2004-04-08 | Ismartsoft, Inc. | Method and apparatus for data analysis |
-
2003
- 2003-09-11 WO PCT/EP2003/050620 patent/WO2004036456A2/en not_active Ceased
- 2003-09-11 AU AU2003286187A patent/AU2003286187A1/en not_active Abandoned
- 2003-09-11 US US10/530,936 patent/US7340476B2/en not_active Expired - Fee Related
- 2003-09-11 JP JP2004544289A patent/JP4609995B2/ja not_active Expired - Fee Related
- 2003-09-11 CN CNA038242834A patent/CN1688998A/zh active Pending
- 2003-10-15 TW TW092128546A patent/TWI230344B/zh not_active IP Right Cessation
-
2007
- 2007-11-30 US US11/948,033 patent/US7774302B2/en not_active Expired - Fee Related
-
2008
- 2008-01-17 US US12/015,551 patent/US7856458B2/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7263520B2 (en) * | 2004-02-27 | 2007-08-28 | Sap Ag | Fast aggregation of compressed data using full table scans |
Also Published As
| Publication number | Publication date |
|---|---|
| US7774302B2 (en) | 2010-08-10 |
| TWI230344B (en) | 2005-04-01 |
| JP2006503357A (ja) | 2006-01-26 |
| CN1688998A (zh) | 2005-10-26 |
| TW200413969A (en) | 2004-08-01 |
| US20080082563A1 (en) | 2008-04-03 |
| US20080183740A1 (en) | 2008-07-31 |
| US20060010147A1 (en) | 2006-01-12 |
| AU2003286187A1 (en) | 2004-05-04 |
| WO2004036456A3 (en) | 2004-09-30 |
| US7340476B2 (en) | 2008-03-04 |
| JP4609995B2 (ja) | 2011-01-12 |
| US7856458B2 (en) | 2010-12-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7774302B2 (en) | Online analytical processing (OLAP) | |
| Gray et al. | Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub-totals | |
| US5940818A (en) | Attribute-based access for multi-dimensional databases | |
| Shukla et al. | Storage estimation for multidimensional aggregates in the presence of hierarchies | |
| JP2006503357A5 (enExample) | ||
| US6122636A (en) | Relational emulation of a multi-dimensional database index | |
| US5978796A (en) | Accessing multi-dimensional data by mapping dense data blocks to rows in a relational database | |
| US6205447B1 (en) | Relational database management of multi-dimensional data | |
| US6189004B1 (en) | Method and apparatus for creating a datamart and for creating a query structure for the datamart | |
| US6434557B1 (en) | Online syntheses programming technique | |
| US6418427B1 (en) | Online modifications of dimension structures in multidimensional processing | |
| US20080036767A1 (en) | Apparatus and method for selecting visualizations of multidimensional data | |
| WO2001050246A2 (en) | Online modifications of relations in multidimensional processing | |
| US7243106B2 (en) | Static drill-through modelling | |
| US7328206B2 (en) | Extensions for adding and removing calculated members in a multidimensional database | |
| EP1450274A2 (en) | Dimension-based partitioned cube | |
| Dinter et al. | The OLAP market: state of the art and research issues | |
| US6456998B1 (en) | Efficient processing of parent-child relationships in a relational database management system | |
| US9268817B2 (en) | Efficient evaluation of hierarchical cubes by non-blocking rollups and skipping levels | |
| Ivanova et al. | Multidimensional models: constructing data CUBE. | |
| Breitner | Data Warehousing and OLAP: Delivering Just-In-Time Information for Decision Support | |
| CA2435861C (en) | Static drill-through modelling | |
| Seyed-Abbassi | Teaching Effective Methodologies to Design a Data Warehouse | |
| Kiviniemi | Opportunities of OLAP in Industrial Analysis | |
| Gonzalez Castro | The use of alternative data models in data warehousing environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| ENP | Entry into the national phase |
Ref document number: 2006010147 Country of ref document: US Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 10530936 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004544289 Country of ref document: JP Ref document number: 20038242834 Country of ref document: CN |
|
| 122 | Ep: pct application non-entry in european phase | ||
| WWP | Wipo information: published in national office |
Ref document number: 10530936 Country of ref document: US |