AU2021230348B2 - Generation of optimized logic from a schema - Google Patents

Generation of optimized logic from a schema

Info

Publication number
AU2021230348B2
AU2021230348B2 AU2021230348A AU2021230348A AU2021230348B2 AU 2021230348 B2 AU2021230348 B2 AU 2021230348B2 AU 2021230348 A AU2021230348 A AU 2021230348A AU 2021230348 A AU2021230348 A AU 2021230348A AU 2021230348 B2 AU2021230348 B2 AU 2021230348B2
Authority
AU
Australia
Prior art keywords
datasets
data
attributes
dataset
logical data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
AU2021230348A
Other languages
English (en)
Other versions
AU2021230348A1 (en
Inventor
Jonah EGENOLF
Marshall A. Isman
Ian Schechter
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ab Initio Technology LLC
Original Assignee
Ab Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology LLC filed Critical Ab Initio Technology LLC
Publication of AU2021230348A1 publication Critical patent/AU2021230348A1/en
Application granted granted Critical
Publication of AU2021230348B2 publication Critical patent/AU2021230348B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/211—Schema design and management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2423—Interactive query statement specification based on a database schema
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2428—Query predicate definition using graphical user interfaces, including menus and forms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2452—Query translation
    • G06F16/24524—Access plan code generation and invalidation; Reuse of access plans
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2452—Query translation
    • G06F16/24526—Internal representations for queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24542—Plan optimisation
    • G06F16/24544—Join order optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24542—Plan optimisation
    • G06F16/24545—Selectivity estimation or determination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/288—Entity relationship models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • G06F16/81—Indexing, e.g. XML tags; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9027—Trees
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/34—Graphical or visual programming
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/36—Software reuse
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/38—Creation or generation of source code for implementing user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0242—Determining effectiveness of advertisements
    • G06Q30/0243—Comparative campaigns

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Operations Research (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Stored Programmes (AREA)
  • Transmitters (AREA)
  • Error Detection And Correction (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
AU2021230348A 2020-03-06 2021-03-04 Generation of optimized logic from a schema Active AU2021230348B2 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202062986374P 2020-03-06 2020-03-06
US62/986,374 2020-03-06
US17/025,751 US11210285B2 (en) 2020-03-06 2020-09-18 Generation of optimized logic from a schema
US17/025,751 2020-09-18
PCT/US2021/020871 WO2021178665A1 (en) 2020-03-06 2021-03-04 Generation of optimized logic from a schema

Publications (2)

Publication Number Publication Date
AU2021230348A1 AU2021230348A1 (en) 2022-09-08
AU2021230348B2 true AU2021230348B2 (en) 2026-02-05

Family

ID=77555716

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2021230348A Active AU2021230348B2 (en) 2020-03-06 2021-03-04 Generation of optimized logic from a schema

Country Status (8)

Country Link
US (3) US11210285B2 (https=)
EP (1) EP4115301A1 (https=)
JP (2) JP7505014B2 (https=)
CN (2) CN115516443B (https=)
AU (1) AU2021230348B2 (https=)
CA (1) CA3170453A1 (https=)
MX (1) MX2022011037A (https=)
WO (1) WO2021178665A1 (https=)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11210285B2 (en) 2020-03-06 2021-12-28 Ab Initio Technology Llc Generation of optimized logic from a schema
US11663203B2 (en) * 2020-10-01 2023-05-30 Sigma Computing, Inc. Optimizing database statements using a query compiler
US11436237B2 (en) * 2020-12-17 2022-09-06 International Business Machines Corporation Ranking datasets based on data attributes
US11841872B2 (en) * 2021-07-26 2023-12-12 Salesforce, Inc. Interactively building previews of extract, transform, load (ETL) graphs using cached previews of subgraphs
US12380109B2 (en) * 2022-09-07 2025-08-05 Google Llc Database join operations with early filtering
WO2024168203A1 (en) * 2023-02-09 2024-08-15 Ramp Business Corporation Subroutine objects for workflow implementation
JP2026511562A (ja) 2023-03-23 2026-04-14 アビニシオ テクノロジー エルエルシー 拡張ビューのデータセットをプレビューするための論理アクセス
US12339826B2 (en) 2023-04-07 2025-06-24 Ab Initio Technology Llc On-demand integration of records with data catalog identifiers
US12346350B2 (en) 2023-04-12 2025-07-01 Ab Initio Technology Llc Meta-data driven ingestion and data processing
KR20260021724A (ko) * 2023-06-12 2026-02-13 아브 이니티오 테크놀로지 엘엘시 재사용 가능 데이터 처리 프로그램 생성
WO2025029579A1 (en) 2023-07-28 2025-02-06 Ab Initio Technology Llc Machine learning techniques for discovering keys in relational datasets
US12386829B2 (en) * 2023-09-15 2025-08-12 People Center, Inc. Database retrieval and reporting system
WO2025137522A1 (en) * 2023-12-21 2025-06-26 Ab Initio Technology Llc A development environment for automatically generating code using a multi-tiered metadata model

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070226196A1 (en) * 2006-03-23 2007-09-27 Microsoft Corporation Mapping architecture with incremental view maintenance

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2575117A (en) 1950-02-25 1951-11-13 Naken William Sanding device
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US6681383B1 (en) * 2000-04-04 2004-01-20 Sosy, Inc. Automatic software production system
US6859217B2 (en) * 2000-07-19 2005-02-22 Microsoft Corporation System and method to display and manage data within hierarchies and polyarchies of information
US7461077B1 (en) * 2001-07-31 2008-12-02 Nicholas Greenwood Representation of data records
US6944626B2 (en) * 2001-11-26 2005-09-13 Microsoft Corp. Dynamically generated schema representing multiple hierarchies of inter-object relationships
US7574652B2 (en) * 2002-06-20 2009-08-11 Canon Kabushiki Kaisha Methods for interactively defining transforms and for generating queries by manipulating existing query data
EP1798672A1 (de) * 2005-11-23 2007-06-20 Ubs Ag Computer-implementiertes System zur Erzeugung, Bearbeitung und Verwaltung von strukturierten Datensätzen
EP1990760A4 (en) * 2006-02-28 2010-05-19 Fujitsu Ltd OFFICE MANAGEMENT PROGRAM, OFFICE MANAGEMENT DEVICE AND OFFICE MANAGEMENT PROCEDURE
US8069129B2 (en) 2007-04-10 2011-11-29 Ab Initio Technology Llc Editing and compiling business rules
US8375014B1 (en) * 2008-06-19 2013-02-12 BioFortis, Inc. Database query builder
US20100198844A1 (en) * 2009-01-30 2010-08-05 Thales-Raytheon Systems Company, LLC Automatic Code Generation
CA2814835C (en) 2010-10-25 2019-01-08 Ab Initio Technology Llc Managing data set objects in a dataflow graph that represents a computer program
US10754877B2 (en) * 2013-01-15 2020-08-25 Datorama Technologies, Ltd. System and method for providing big data analytics on dynamically-changing data models
US10169378B2 (en) * 2014-09-11 2019-01-01 Oracle International Corporation Automatic generation of logical database schemas from physical database tables and metadata
US10176234B2 (en) * 2014-11-05 2019-01-08 Ab Initio Technology Llc Impact analysis
CN108701257B (zh) * 2016-08-22 2023-01-06 甲骨文国际公司 用于实时可视模拟内的动态、增量推荐的系统和方法
US11423083B2 (en) 2017-10-27 2022-08-23 Ab Initio Technology Llc Transforming a specification into a persistent computer program
US12032631B2 (en) 2018-05-30 2024-07-09 Ab Initio Technology Llc Systems and methods for dataflow graph optimization
US11210285B2 (en) 2020-03-06 2021-12-28 Ab Initio Technology Llc Generation of optimized logic from a schema

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070226196A1 (en) * 2006-03-23 2007-09-27 Microsoft Corporation Mapping architecture with incremental view maintenance

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS, "Oracle9i Developer Suite", ORACLE Developer Suite Technical White Paper, ORACLE, US, 1 December 2001, pages 1 - 51 *

Also Published As

Publication number Publication date
JP7505014B2 (ja) 2024-06-24
CN117891869A (zh) 2024-04-16
JP7813316B2 (ja) 2026-02-12
JP2024133060A (ja) 2024-10-01
CN115516443A (zh) 2022-12-23
CA3170453A1 (en) 2021-09-10
US20240126748A1 (en) 2024-04-18
US11210285B2 (en) 2021-12-28
EP4115301A1 (en) 2023-01-11
BR112022017705A2 (pt) 2022-10-18
US11734264B2 (en) 2023-08-22
MX2022011037A (es) 2022-12-13
JP2023517310A (ja) 2023-04-25
WO2021178665A1 (en) 2021-09-10
US12346312B2 (en) 2025-07-01
US20220147529A1 (en) 2022-05-12
US20210279043A1 (en) 2021-09-09
AU2021230348A1 (en) 2022-09-08
CN115516443B (zh) 2024-01-23

Similar Documents

Publication Publication Date Title
AU2021230348B2 (en) Generation of optimized logic from a schema
AU2019201135B2 (en) Managing interfaces for dataflow graphs composed of sub-graphs
EP2633398B1 (en) Managing data set objects in a dataflow graph that represents a computer program
EP3726375B1 (en) Source code translation
Macko et al. Provenance map orbiter: Interactive exploration of large provenance graphs.
BR112022017705B1 (pt) Método implementado por um sistema de processamento de dados, sistema e meio de armazenamento não transitório legível por computador para geração de lógica otimizada a partir de um esquema
Fitchett et al. CPU-less parallel execution of lambda calculus in digital logic
JP2026511562A (ja) 拡張ビューのデータセットをプレビューするための論理アクセス
Buddelmeijer et al. Automatic optimized discovery, creation and processing of astronomical catalogs
HK40110825A (en) Managing interfaces for dataflow graphs composed of sub-graphs
HK40036906B (en) Source code translation
HK40036906A (en) Source code translation
Burattin Hands-On: Obtaining Test Data
Haynal Professor Forrest D. Brewer, Chairman Professor Tevfik Bultan Professor Malgorzata Marek-Sadowska Professor Louise Moser
HK1183722B (en) Managing data set objects in a dataflow graph that represents a computer program
HK1183722A (en) Managing data set objects in a dataflow graph that represents a computer program