AU2017255561B2 - Learning from historical logs and recommending database operations on a data-asset in an ETL tool - Google Patents

Learning from historical logs and recommending database operations on a data-asset in an ETL tool Download PDF

Info

Publication number
AU2017255561B2
AU2017255561B2 AU2017255561A AU2017255561A AU2017255561B2 AU 2017255561 B2 AU2017255561 B2 AU 2017255561B2 AU 2017255561 A AU2017255561 A AU 2017255561A AU 2017255561 A AU2017255561 A AU 2017255561A AU 2017255561 B2 AU2017255561 B2 AU 2017255561B2
Authority
AU
Australia
Prior art keywords
data
context data
probabilities
database
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
AU2017255561A
Other languages
English (en)
Other versions
AU2017255561A1 (en
Inventor
Atreyee Dey
Udayakumar Dhansingh
Sanjay Kaluskar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Informatica LLC
Original Assignee
Informatica LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Informatica LLC filed Critical Informatica LLC
Publication of AU2017255561A1 publication Critical patent/AU2017255561A1/en
Application granted granted Critical
Publication of AU2017255561B2 publication Critical patent/AU2017255561B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2358—Change logging, detection, and notification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2457—Query processing with adaptation to user needs
    • G06F16/24575—Query processing with adaptation to user needs using context
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9032—Query formulation
    • G06F16/90324—Query formulation using system suggestions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
AU2017255561A 2016-04-26 2017-04-26 Learning from historical logs and recommending database operations on a data-asset in an ETL tool Active AU2017255561B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/139,186 2016-04-26
US15/139,186 US10324947B2 (en) 2016-04-26 2016-04-26 Learning from historical logs and recommending database operations on a data-asset in an ETL tool
PCT/US2017/029583 WO2017189693A1 (en) 2016-04-26 2017-04-26 Learning from historical logs and recommending database operations on a data-asset in an etl tool

Publications (2)

Publication Number Publication Date
AU2017255561A1 AU2017255561A1 (en) 2018-12-13
AU2017255561B2 true AU2017255561B2 (en) 2020-11-26

Family

ID=60090217

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2017255561A Active AU2017255561B2 (en) 2016-04-26 2017-04-26 Learning from historical logs and recommending database operations on a data-asset in an ETL tool

Country Status (6)

Country Link
US (1) US10324947B2 (enExample)
EP (1) EP3449334A4 (enExample)
JP (1) JP6843882B2 (enExample)
AU (1) AU2017255561B2 (enExample)
CA (1) CA3022113A1 (enExample)
WO (1) WO2017189693A1 (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11289200B1 (en) 2017-03-13 2022-03-29 C/Hca, Inc. Authorized user modeling for decision support
US10412028B1 (en) 2013-05-24 2019-09-10 HCA Holdings, Inc. Data derived user behavior modeling
US10073858B2 (en) 2013-05-16 2018-09-11 Oracle International Corporation Systems and methods for tuning a storage system
US10936599B2 (en) 2017-09-29 2021-03-02 Oracle International Corporation Adaptive recommendations
US11269822B2 (en) * 2017-10-09 2022-03-08 Sap Se Generation of automated data migration model
US11222274B2 (en) * 2017-12-01 2022-01-11 At&T Intellectual Property I, L.P. Scalable integrated information structure system
US10783161B2 (en) * 2017-12-15 2020-09-22 International Business Machines Corporation Generating a recommended shaping function to integrate data within a data repository
US11323564B2 (en) * 2018-01-04 2022-05-03 Dell Products L.P. Case management virtual assistant to enable predictive outputs
WO2019156070A1 (ja) * 2018-02-09 2019-08-15 国立大学法人静岡大学 機械学習システム及び機械学習方法
JP7119411B2 (ja) * 2018-02-16 2022-08-17 日本電気株式会社 データベース装置、データ管理方法、及びコンピュータ・プログラム
US12190250B2 (en) * 2018-03-16 2025-01-07 International Business Machines Corporation Contextual intelligence for unified data governance
US11908573B1 (en) 2020-02-18 2024-02-20 C/Hca, Inc. Predictive resource management
US12314327B2 (en) * 2018-10-18 2025-05-27 Oracle International Corporation System and method for next object prediction for ics flow using artificial intelligence/machine learning
US11531929B2 (en) * 2018-11-09 2022-12-20 Citrix Sysiems, Inc. Systems and methods for machine generated training and imitation learning
US11636071B2 (en) * 2020-01-10 2023-04-25 Salesforce.Com, Inc. Database replication error recovery based on supervised learning
CN111324455A (zh) * 2020-02-10 2020-06-23 浙江中智达科技有限公司 工业云平台调度方法、装置及系统
WO2021174104A1 (en) 2020-02-28 2021-09-02 Clumio, Inc. Modification of data in a time-series data lake
US11379500B2 (en) * 2020-03-30 2022-07-05 Sap Se Automated data integration, reconciliation, and self healing using machine learning
US11763178B2 (en) 2020-05-29 2023-09-19 Capital One Services, Llc Predictive scheduling and execution of data analytics applications based on machine learning techniques
CN111931064B (zh) * 2020-08-28 2021-07-06 南京硅基智能科技有限公司 基于大数据和人工智能的信息解析方法及云服务信息平台
US11886891B2 (en) * 2021-09-10 2024-01-30 Sap Se Context-based multiexperience element dynamically generated using natural language processing
CN117055479B (zh) * 2023-07-19 2024-05-24 河南上恒医药科技有限公司 口服溶液药物生产过程中设备状态监控方法及系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8978114B1 (en) * 2012-07-15 2015-03-10 Identropy, Inc. Recommendation engine for unified identity management across internal and shared computing applications
US20160092475A1 (en) * 2014-09-26 2016-03-31 Oracle International Corporation Automated entity correlation and classification across heterogeneous datasets

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7698170B1 (en) * 2004-08-05 2010-04-13 Versata Development Group, Inc. Retail recommendation domain model
US7720720B1 (en) * 2004-08-05 2010-05-18 Versata Development Group, Inc. System and method for generating effective recommendations
JP4958476B2 (ja) * 2006-05-24 2012-06-20 株式会社日立製作所 検索装置
US20090144262A1 (en) * 2007-12-04 2009-06-04 Microsoft Corporation Search query transformation using direct manipulation
JP5049223B2 (ja) * 2008-07-29 2012-10-17 ヤフー株式会社 Ｗｅｂクエリに対する検索要求属性を自動推定する検索装置、検索方法及びプログラム
US8266148B2 (en) * 2008-10-07 2012-09-11 Aumni Data, Inc. Method and system for business intelligence analytics on unstructured data
US20100114976A1 (en) * 2008-10-21 2010-05-06 Castellanos Maria G Method For Database Design
US8200661B1 (en) * 2008-12-18 2012-06-12 Google Inc. Dynamic recommendations based on user actions
US8161077B2 (en) * 2009-10-21 2012-04-17 Delphix Corp. Datacenter workflow automation scenarios using virtual databases
US20120102007A1 (en) * 2010-10-22 2012-04-26 Alpine Consulting, Inc. Managing etl jobs
WO2013130867A1 (en) * 2012-02-29 2013-09-06 Sourcefire, Inc. Method and apparatus for retroactively detecting malicious or otherwise undesirable software
US9646262B2 (en) * 2013-06-17 2017-05-09 Purepredictive, Inc. Data intelligence using machine learning
KR101404710B1 (ko) * 2013-12-16 2014-06-11 김민수 호 기반 광고 서비스 제공 방법
US11227104B2 (en) * 2014-05-11 2022-01-18 Informatica Llc Composite data creation with refinement suggestions
US9881059B2 (en) * 2014-08-08 2018-01-30 Yahoo Holdings, Inc. Systems and methods for suggesting headlines
US9507824B2 (en) * 2014-08-22 2016-11-29 Attivio Inc. Automated creation of join graphs for unrelated data sets among relational databases
US10402749B2 (en) * 2014-08-25 2019-09-03 Shl Us Llc Customizable machine learning models
US20160117087A1 (en) * 2014-10-23 2016-04-28 Microsoft Corporation Job creation and reuse
US10185930B1 (en) * 2014-12-01 2019-01-22 Arimo, Inc. Collaboration using shared documents for processing distributed data
US10430421B2 (en) * 2014-12-29 2019-10-01 Facebook, Inc. Recommending content items in a social network using delayed interaction
US10713587B2 (en) * 2015-11-09 2020-07-14 Xerox Corporation Method and system using machine learning techniques for checking data integrity in a data warehouse feed

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8978114B1 (en) * 2012-07-15 2015-03-10 Identropy, Inc. Recommendation engine for unified identity management across internal and shared computing applications
US20160092475A1 (en) * 2014-09-26 2016-03-31 Oracle International Corporation Automated entity correlation and classification across heterogeneous datasets

Also Published As

Publication number Publication date
US10324947B2 (en) 2019-06-18
CA3022113A1 (en) 2017-11-02
JP2019519027A (ja) 2019-07-04
US20170308595A1 (en) 2017-10-26
JP6843882B2 (ja) 2021-03-17
EP3449334A4 (en) 2019-12-25
AU2017255561A1 (en) 2018-12-13
EP3449334A1 (en) 2019-03-06
WO2017189693A1 (en) 2017-11-02

Similar Documents

Publication Publication Date Title
US10324947B2 (en) Learning from historical logs and recommending database operations on a data-asset in an ETL tool
US12056120B2 (en) Deriving metrics from queries
US11367008B2 (en) Artificial intelligence techniques for improving efficiency
US11227104B2 (en) Composite data creation with refinement suggestions
Phillips-Wren et al. Business analytics in the context of big data: A roadmap for research
US11030258B1 (en) Ranking anomalies associated with populations of users based on relevance
US11966873B2 (en) Data distillery for signal detection
US9798813B2 (en) Extensible person container
US11037096B2 (en) Delivery prediction with degree of delivery reliability
US11379466B2 (en) Data accuracy using natural language processing
US9336286B2 (en) Graphical record matching process replay for a data quality user interface
US20230072607A1 (en) Data augmentation and enrichment
US20190236718A1 (en) Skills-based characterization and comparison of entities
US20240362194A1 (en) System and method for enriching and normalizing data
Bahmani-Oskooee et al. Revisiting purchasing power parity in Latin America: sequential panel selection method
Azuddin et al. Design and implementation of a relational database for an academic information system
EP3905058A1 (en) Systems and methods for monitoring user-defined metrics
US11657063B2 (en) Behavioral analytics in information technology infrasturcture incident management systems
Fajri et al. Implementation of business intelligence to determine evaluation of activities (Case Study Indonesia Stock Exchange)
Serpell Incorporating data quality improvement into supply–use table balancing
US20200342302A1 (en) Cognitive forecasting
Renganathan Business intelligence: an overview
Coelho Business intelligence in a data driven bank: Potentiating compliance
Mishra Introduction to management information system
Kaushikk Data Preparation and Management

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)