IN2013CH05996A - - Google Patents

Download PDF

Info

Publication number
IN2013CH05996A
IN2013CH05996A IN5996CH2013A IN2013CH05996A IN 2013CH05996 A IN2013CH05996 A IN 2013CH05996A IN 5996CH2013 A IN5996CH2013 A IN 5996CH2013A IN 2013CH05996 A IN2013CH05996 A IN 2013CH05996A
Authority
IN
India
Prior art keywords
query
plan
mapreduce job
parsed
mapreduce
Prior art date
Application number
Inventor
Kumar Doddavula Shyam
Viswanathan Arun
Original Assignee
Infosys Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Infosys Ltd filed Critical Infosys Ltd
Priority to IN5996CH2013 priority Critical patent/IN2013CH05996A/en
Priority to US14/559,642 priority patent/US20150178367A1/en
Publication of IN2013CH05996A publication Critical patent/IN2013CH05996A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The technique relates to a system and method for implementing peta-byte scale online analytical processing solution using MapReduce. The technique involves receiving an OLAP query from a user through an OLAP-QL Driver. After receiving the query it is parsed through the compiler. Then the metadata information is retrieved from the parsed query through the metadata manager. Validating the parsed query using plan generator module for generating a MapReduce job execution plan based on the retrieved metadata information. The next step is to identify the scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope. Then executing the optimized MapReduce job plan using the execution engine and finally storing the output data in the cube specific distributed file system directory. REF FIG: 1
IN5996CH2013 2013-12-20 2013-12-20 IN2013CH05996A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
IN5996CH2013 IN2013CH05996A (en) 2013-12-20 2013-12-20
US14/559,642 US20150178367A1 (en) 2013-12-20 2014-12-03 System and method for implementing online analytical processing (olap) solution using mapreduce

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
IN5996CH2013 IN2013CH05996A (en) 2013-12-20 2013-12-20

Publications (1)

Publication Number Publication Date
IN2013CH05996A true IN2013CH05996A (en) 2015-06-26

Family

ID=53400276

Family Applications (1)

Application Number Title Priority Date Filing Date
IN5996CH2013 IN2013CH05996A (en) 2013-12-20 2013-12-20

Country Status (2)

Country Link
US (1) US20150178367A1 (en)
IN (1) IN2013CH05996A (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11205103B2 (en) 2016-12-09 2021-12-21 The Research Foundation for the State University Semisupervised autoencoder for sentiment analysis
WO2019019958A1 (en) * 2017-07-25 2019-01-31 Beijing DIDI Infinity Technology and Development Co., Ltd Systems and methods for determining an optimal strategy
CN110019440B (en) * 2017-08-30 2021-06-08 北京国双科技有限公司 Data processing method and device
CN113138810A (en) * 2021-04-23 2021-07-20 上海中通吉网络技术有限公司 Method for calculating HiveSql execution progress
CN117111845B (en) * 2023-08-18 2024-07-26 中电云计算技术有限公司 Data compression method, device, equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8886631B2 (en) * 2010-06-04 2014-11-11 Yale University Query execution systems and methods
CN104050202B (en) * 2013-03-15 2019-03-15 伊姆西公司 Method and apparatus for searching for database

Also Published As

Publication number Publication date
US20150178367A1 (en) 2015-06-25

Similar Documents

Publication Publication Date Title
JP2013533995A5 (en)
JP2013517574A5 (en)
JP2014533407A5 (en)
CA2834864C (en) Database system and method
IN2013CH05996A (en)
GB2576654A (en) Method and apparatus for facilitating creation of simulation model
JP2014096164A5 (en)
CN105550268A (en) Big data process modeling analysis engine
JP2014519080A5 (en)
RU2015107237A (en) SYSTEM AND METHODS OF DESIGNING, DISASSEMBLING AND JOINT USE OF RESEARCHES
MX338018B (en) Generating reports based on materialized view.
IN2013CH06086A (en)
RU2014107726A (en) PROJECTION OF OWN INTERFACES OF APPLIED PROGRAMMING OF OPERATION SYSTEM IN OTHER PROGRAMMING LANGUAGES
WO2013071305A3 (en) Systems and methods for manipulating data using natural language commands
CN104331421A (en) High-efficiency processing method and system for big data
WO2016026407A3 (en) System and method for metadata enhanced inventory management of a communications system
GB2547361A (en) System generator module for electronic document and electronic file
CN104899295A (en) Heterogeneous data source data association analysis method
IN2013MU02918A (en)
WO2011084883A3 (en) Task list generation, parallelism templates, and memory management for multi-core systems
RU2014128339A (en) CONTEXTAL INVITATION IN TRIAL VERSION OF THE APPLICATION
CN106777278B (en) Spark-based data processing method and device
WO2014025946A3 (en) Automatic verification of data sources
EP4345705A3 (en) Asset management in a process control system
Valiyev et al. Design of the modern domain specific programming languages