CN115516443B - 根据架构生成优化逻辑 - Google Patents

根据架构生成优化逻辑 Download PDF

Info

Publication number
CN115516443B
CN115516443B CN202180019193.3A CN202180019193A CN115516443B CN 115516443 B CN115516443 B CN 115516443B CN 202180019193 A CN202180019193 A CN 202180019193A CN 115516443 B CN115516443 B CN 115516443B
Authority
CN
China
Prior art keywords
data
attributes
data sets
data set
logical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202180019193.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN115516443A (zh
Inventor
J·埃格诺夫
马歇尔·A·伊斯曼
I.谢克特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ab Initio Technology LLC
Original Assignee
Ab Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology LLC filed Critical Ab Initio Technology LLC
Priority to CN202410025045.8A priority Critical patent/CN117891869A/zh
Publication of CN115516443A publication Critical patent/CN115516443A/zh
Application granted granted Critical
Publication of CN115516443B publication Critical patent/CN115516443B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2423—Interactive query statement specification based on a database schema
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/211—Schema design and management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2428—Query predicate definition using graphical user interfaces, including menus and forms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2452—Query translation
    • G06F16/24524—Access plan code generation and invalidation; Reuse of access plans
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2452—Query translation
    • G06F16/24526—Internal representations for queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24542—Plan optimisation
    • G06F16/24544—Join order optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24542—Plan optimisation
    • G06F16/24545—Selectivity estimation or determination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/288—Entity relationship models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • G06F16/81—Indexing, e.g. XML tags; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9027—Trees
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/34—Graphical or visual programming
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/36—Software reuse
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/38—Creation or generation of source code for implementing user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0242—Determining effectiveness of advertisements
    • G06Q30/0243—Comparative campaigns

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Operations Research (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Stored Programmes (AREA)
  • Transmitters (AREA)
  • Error Detection And Correction (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
CN202180019193.3A 2020-03-06 2021-03-04 根据架构生成优化逻辑 Active CN115516443B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410025045.8A CN117891869A (zh) 2020-03-06 2021-03-04 数据处理系统实施的方法、系统和存储介质

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202062986374P 2020-03-06 2020-03-06
US62/986,374 2020-03-06
US17/025,751 US11210285B2 (en) 2020-03-06 2020-09-18 Generation of optimized logic from a schema
US17/025,751 2020-09-18
PCT/US2021/020871 WO2021178665A1 (en) 2020-03-06 2021-03-04 Generation of optimized logic from a schema

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202410025045.8A Division CN117891869A (zh) 2020-03-06 2021-03-04 数据处理系统实施的方法、系统和存储介质

Publications (2)

Publication Number Publication Date
CN115516443A CN115516443A (zh) 2022-12-23
CN115516443B true CN115516443B (zh) 2024-01-23

Family

ID=77555716

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202180019193.3A Active CN115516443B (zh) 2020-03-06 2021-03-04 根据架构生成优化逻辑
CN202410025045.8A Pending CN117891869A (zh) 2020-03-06 2021-03-04 数据处理系统实施的方法、系统和存储介质

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202410025045.8A Pending CN117891869A (zh) 2020-03-06 2021-03-04 数据处理系统实施的方法、系统和存储介质

Country Status (8)

Country Link
US (3) US11210285B2 (https=)
EP (1) EP4115301A1 (https=)
JP (2) JP7505014B2 (https=)
CN (2) CN115516443B (https=)
AU (1) AU2021230348B2 (https=)
CA (1) CA3170453A1 (https=)
MX (1) MX2022011037A (https=)
WO (1) WO2021178665A1 (https=)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11210285B2 (en) 2020-03-06 2021-12-28 Ab Initio Technology Llc Generation of optimized logic from a schema
US11663203B2 (en) * 2020-10-01 2023-05-30 Sigma Computing, Inc. Optimizing database statements using a query compiler
US11436237B2 (en) * 2020-12-17 2022-09-06 International Business Machines Corporation Ranking datasets based on data attributes
US11841872B2 (en) * 2021-07-26 2023-12-12 Salesforce, Inc. Interactively building previews of extract, transform, load (ETL) graphs using cached previews of subgraphs
US12380109B2 (en) * 2022-09-07 2025-08-05 Google Llc Database join operations with early filtering
WO2024168203A1 (en) * 2023-02-09 2024-08-15 Ramp Business Corporation Subroutine objects for workflow implementation
JP2026511562A (ja) 2023-03-23 2026-04-14 アビニシオ テクノロジー エルエルシー 拡張ビューのデータセットをプレビューするための論理アクセス
US12339826B2 (en) 2023-04-07 2025-06-24 Ab Initio Technology Llc On-demand integration of records with data catalog identifiers
US12346350B2 (en) 2023-04-12 2025-07-01 Ab Initio Technology Llc Meta-data driven ingestion and data processing
KR20260021724A (ko) * 2023-06-12 2026-02-13 아브 이니티오 테크놀로지 엘엘시 재사용 가능 데이터 처리 프로그램 생성
WO2025029579A1 (en) 2023-07-28 2025-02-06 Ab Initio Technology Llc Machine learning techniques for discovering keys in relational datasets
US12386829B2 (en) * 2023-09-15 2025-08-12 People Center, Inc. Database retrieval and reporting system
WO2025137522A1 (en) * 2023-12-21 2025-06-26 Ab Initio Technology Llc A development environment for automatically generating code using a multi-tiered metadata model

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101361088A (zh) * 2005-11-23 2009-02-04 瑞士银行股份有限公司 用于产生、处理并管理结构化数据集的计算机实现的系统
CN107135663A (zh) * 2014-11-05 2017-09-05 起元技术有限责任公司 影响分析
CN108701257A (zh) * 2016-08-22 2018-10-23 甲骨文国际公司 用于实时可视模拟内的动态、增量推荐的系统和方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2575117A (en) 1950-02-25 1951-11-13 Naken William Sanding device
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US6681383B1 (en) * 2000-04-04 2004-01-20 Sosy, Inc. Automatic software production system
US6859217B2 (en) * 2000-07-19 2005-02-22 Microsoft Corporation System and method to display and manage data within hierarchies and polyarchies of information
US7461077B1 (en) * 2001-07-31 2008-12-02 Nicholas Greenwood Representation of data records
US6944626B2 (en) * 2001-11-26 2005-09-13 Microsoft Corp. Dynamically generated schema representing multiple hierarchies of inter-object relationships
US7574652B2 (en) * 2002-06-20 2009-08-11 Canon Kabushiki Kaisha Methods for interactively defining transforms and for generating queries by manipulating existing query data
EP1990760A4 (en) * 2006-02-28 2010-05-19 Fujitsu Ltd OFFICE MANAGEMENT PROGRAM, OFFICE MANAGEMENT DEVICE AND OFFICE MANAGEMENT PROCEDURE
US7680767B2 (en) * 2006-03-23 2010-03-16 Microsoft Corporation Mapping architecture with incremental view maintenance
US8069129B2 (en) 2007-04-10 2011-11-29 Ab Initio Technology Llc Editing and compiling business rules
US8375014B1 (en) * 2008-06-19 2013-02-12 BioFortis, Inc. Database query builder
US20100198844A1 (en) * 2009-01-30 2010-08-05 Thales-Raytheon Systems Company, LLC Automatic Code Generation
CA2814835C (en) 2010-10-25 2019-01-08 Ab Initio Technology Llc Managing data set objects in a dataflow graph that represents a computer program
US10754877B2 (en) * 2013-01-15 2020-08-25 Datorama Technologies, Ltd. System and method for providing big data analytics on dynamically-changing data models
US10169378B2 (en) * 2014-09-11 2019-01-01 Oracle International Corporation Automatic generation of logical database schemas from physical database tables and metadata
US11423083B2 (en) 2017-10-27 2022-08-23 Ab Initio Technology Llc Transforming a specification into a persistent computer program
US12032631B2 (en) 2018-05-30 2024-07-09 Ab Initio Technology Llc Systems and methods for dataflow graph optimization
US11210285B2 (en) 2020-03-06 2021-12-28 Ab Initio Technology Llc Generation of optimized logic from a schema

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101361088A (zh) * 2005-11-23 2009-02-04 瑞士银行股份有限公司 用于产生、处理并管理结构化数据集的计算机实现的系统
CN107135663A (zh) * 2014-11-05 2017-09-05 起元技术有限责任公司 影响分析
CN108701257A (zh) * 2016-08-22 2018-10-23 甲骨文国际公司 用于实时可视模拟内的动态、增量推荐的系统和方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Oracle9i Developer Suite;ANONYMOUS;ORACLE DEVELOPER SUITE TECHNICAL WHITE PAPER;第1-51页 *

Also Published As

Publication number Publication date
JP7505014B2 (ja) 2024-06-24
CN117891869A (zh) 2024-04-16
JP7813316B2 (ja) 2026-02-12
JP2024133060A (ja) 2024-10-01
CN115516443A (zh) 2022-12-23
CA3170453A1 (en) 2021-09-10
US20240126748A1 (en) 2024-04-18
US11210285B2 (en) 2021-12-28
EP4115301A1 (en) 2023-01-11
BR112022017705A2 (pt) 2022-10-18
US11734264B2 (en) 2023-08-22
MX2022011037A (es) 2022-12-13
JP2023517310A (ja) 2023-04-25
WO2021178665A1 (en) 2021-09-10
US12346312B2 (en) 2025-07-01
US20220147529A1 (en) 2022-05-12
AU2021230348B2 (en) 2026-02-05
US20210279043A1 (en) 2021-09-09
AU2021230348A1 (en) 2022-09-08

Similar Documents

Publication Publication Date Title
CN115516443B (zh) 根据架构生成优化逻辑
EP2633398B1 (en) Managing data set objects in a dataflow graph that represents a computer program
US10073867B2 (en) System and method for code generation from a directed acyclic graph using knowledge modules
EP3726375B1 (en) Source code translation
JP6449173B2 (ja) プロセスを構成するためのアプリケーションの構築
US20140344210A1 (en) Use of projector and selector component types for etl map design
BR112022017705B1 (pt) Método implementado por um sistema de processamento de dados, sistema e meio de armazenamento não transitório legível por computador para geração de lógica otimizada a partir de um esquema
CN120335860B (zh) 基于依赖图的实时系统模块化自动构建方法和系统
US20240320224A1 (en) Logical Access for Previewing Expanded View Datasets
JP2026511562A (ja) 拡張ビューのデータセットをプレビューするための論理アクセス
HK40036906B (en) Source code translation
HK1183722A (en) Managing data set objects in a dataflow graph that represents a computer program
HK1183722B (en) Managing data set objects in a dataflow graph that represents a computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant