CA3064561A1 - Automated dependency analyzer for heterogeneously programmed data processing system - Google Patents

Automated dependency analyzer for heterogeneously programmed data processing system Download PDF

Info

Publication number
CA3064561A1
CA3064561A1 CA3064561A CA3064561A CA3064561A1 CA 3064561 A1 CA3064561 A1 CA 3064561A1 CA 3064561 A CA3064561 A CA 3064561A CA 3064561 A CA3064561 A CA 3064561A CA 3064561 A1 CA3064561 A1 CA 3064561A1
Authority
CA
Canada
Prior art keywords
data
dependency
programs
dependencies
data structure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3064561A
Other languages
English (en)
French (fr)
Inventor
Christophe Berg
David Clemens
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AB Initio Technology LLC
Original Assignee
AB Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AB Initio Technology LLC filed Critical AB Initio Technology LLC
Publication of CA3064561A1 publication Critical patent/CA3064561A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/40—Transformation of program code
    • G06F8/41—Compilation
    • G06F8/43—Checking; Contextual analysis
    • G06F8/433—Dependency analysis; Data or control flow analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3604—Analysis of software for verifying properties of programs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Stored Programmes (AREA)
  • Debugging And Monitoring (AREA)
  • Devices For Executing Special Programs (AREA)
CA3064561A 2017-05-22 2018-05-22 Automated dependency analyzer for heterogeneously programmed data processing system Pending CA3064561A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/601,911 US10379825B2 (en) 2017-05-22 2017-05-22 Automated dependency analyzer for heterogeneously programmed data processing system
US15/601,911 2017-05-22
PCT/US2018/033882 WO2018217745A1 (en) 2017-05-22 2018-05-22 Automated dependency analyzer for heterogeneously programmed data processing system

Publications (1)

Publication Number Publication Date
CA3064561A1 true CA3064561A1 (en) 2018-11-29

Family

ID=63592791

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3064561A Pending CA3064561A1 (en) 2017-05-22 2018-05-22 Automated dependency analyzer for heterogeneously programmed data processing system

Country Status (7)

Country Link
US (2) US10379825B2 (enExample)
EP (2) EP3631618B1 (enExample)
JP (2) JP7360328B2 (enExample)
CN (1) CN110998516B (enExample)
AU (1) AU2018272840B2 (enExample)
CA (1) CA3064561A1 (enExample)
WO (1) WO2018217745A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018502390A (ja) * 2014-12-23 2018-01-25 エントイット ソフトウェア エルエルシーＥｎｔｉｔ Ｓｏｆｔｗａｒｅ Ｌｌｃ 負荷テスト
US10795935B2 (en) 2016-02-05 2020-10-06 Sas Institute Inc. Automated generation of job flow definitions
US10642896B2 (en) * 2016-02-05 2020-05-05 Sas Institute Inc. Handling of data sets during execution of task routines of multiple languages
US10650046B2 (en) 2016-02-05 2020-05-12 Sas Institute Inc. Many task computing with distributed file system
USD898059S1 (en) 2017-02-06 2020-10-06 Sas Institute Inc. Display screen or portion thereof with graphical user interface
US10379825B2 (en) 2017-05-22 2019-08-13 Ab Initio Technology Llc Automated dependency analyzer for heterogeneously programmed data processing system
USD898060S1 (en) 2017-06-05 2020-10-06 Sas Institute Inc. Display screen or portion thereof with graphical user interface
US10990364B2 (en) 2018-06-06 2021-04-27 Ab Initio Technology Llc Updating executable graphs
US10877870B2 (en) * 2018-06-11 2020-12-29 Tata Consultancy Services Limited Method and system for verifying properties of source code
US10733075B2 (en) * 2018-08-22 2020-08-04 Fujitsu Limited Data-driven synthesis of fix patterns
EP3850559A4 (en) * 2018-09-20 2021-11-10 Huawei Technologies Co., Ltd. SYSTEMS AND PROCEDURES FOR GRAPH-BASED QUERY ANALYSIS
US10965536B2 (en) 2019-03-30 2021-03-30 Intel Corporation Methods and apparatus to insert buffers in a dataflow graph
US11029927B2 (en) * 2019-03-30 2021-06-08 Intel Corporation Methods and apparatus to detect and annotate backedges in a dataflow graph
US11194845B2 (en) 2019-04-19 2021-12-07 Tableau Software, LLC Interactive lineage analyzer for data assets
US11294894B2 (en) 2019-08-30 2022-04-05 Oracle International Corporation Dynamic resolution of dependencies for database guest languages
US12443449B2 (en) * 2019-11-15 2025-10-14 Nvidia Corporation Techniques for modifying an executable graph to perform a workload associated with a new task graph
LU101480B1 (en) 2019-11-18 2021-05-18 Luxembourg Inst Science & Tech List Data preprocessing for a supervised machine learning process
US11385889B2 (en) * 2019-12-04 2022-07-12 Oracle International Corporation Inferring intra package and module dependencies
US11440190B1 (en) * 2020-02-26 2022-09-13 Trend Micro Incorporated Detecting unsecure data flow in automation task programs
US11360751B2 (en) 2020-03-19 2022-06-14 Codelogic, Inc. Systems and methods for dependency analysis
US11366648B2 (en) * 2020-05-28 2022-06-21 Red Hat, Inc. Compiling monoglot function compositions into a single entity
CN112162776B (zh) * 2020-09-04 2023-07-14 维沃移动通信有限公司 依赖关系获取方法及装置
US12517717B2 (en) 2021-10-08 2026-01-06 Ab Initio Technology Llc Automated modification of computer programs
CN114398039B (zh) * 2021-12-03 2024-07-30 武汉大学 一种自动细粒度的两级并行翻译方法
US12524212B2 (en) * 2022-04-15 2026-01-13 Nvidia Corporation Control of storage aliasing via automatic application of artificial dependences during program compilation
CN114741993B (zh) * 2022-04-18 2023-06-16 山东浪潮科学研究院有限公司 一种基于脚本的数据流图生成方法及装置
CN114611712B (zh) * 2022-05-10 2022-08-26 富算科技(上海)有限公司 基于异构联邦学习的预测方法、模型生成方法及装置
CN114968364B (zh) * 2022-07-12 2022-11-08 飞腾信息技术有限公司 一种条件语句的处理方法、装置及存储介质
CN116737809B (zh) * 2023-04-24 2026-06-16 京东科技控股股份有限公司 衍生变量的生成方法、装置、设备、介质及产品
US12248457B1 (en) 2023-08-23 2025-03-11 International Business Machines Corporation Detecting temporal anomalous data using dependency modeling
US20260080324A1 (en) * 2024-09-17 2026-03-19 Truist Bank Systems and methods for a rules engine without hardcoded rules

Family Cites Families (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4914585A (en) 1988-05-23 1990-04-03 Hewlett-Packard Company Modular complier with a class independent parser and a plurality of class dependent parsers
IL100989A (en) * 1991-02-27 1995-10-31 Digital Equipment Corp Analyzing inductive expressions in a multilanguage optimizing compiler
US5826256A (en) * 1991-10-22 1998-10-20 Lucent Technologies Inc. Apparatus and methods for source code discovery
JP3328056B2 (ja) * 1994-03-01 2002-09-24 新日鉄ソリューションズ株式会社 構文解析木からの情報抽出装置
CA2143145C (en) 1994-04-18 1999-12-28 Premkumar Thomas Devanbu Determining dynamic properties of programs
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US6745384B1 (en) * 1998-05-29 2004-06-01 Microsoft Corporation Anticipatory optimization with composite folding
US6988183B1 (en) * 1998-06-26 2006-01-17 Derek Chi-Lan Wong Methods for increasing instruction-level parallelism in microprocessors and digital system
US7974875B1 (en) 2000-03-21 2011-07-05 Aol Inc. System and method for using voice over a telephone to access, process, and carry out transactions over the internet
US6681383B1 (en) * 2000-04-04 2004-01-20 Sosy, Inc. Automatic software production system
JP2002099561A (ja) 2000-09-21 2002-04-05 Toshiba Corp データ変換方法およびデータ変換システム並びに記憶媒体
US7174536B1 (en) * 2001-02-12 2007-02-06 Iowa State University Research Foundation, Inc. Integrated interactive software visualization environment
WO2003065179A2 (en) 2002-02-01 2003-08-07 John Fairweather A system and method for mining data
US20040010752A1 (en) 2002-07-09 2004-01-15 Lucent Technologies Inc. System and method for filtering XML documents with XPath expressions
US7418734B2 (en) 2003-04-18 2008-08-26 Ounce Labs, Inc. Method and system for detecting privilege escalation vulnerabilities in source code
JP4001286B2 (ja) * 2003-06-23 2007-10-31 インターナショナル・ビジネス・マシーンズ・コーポレーション プログラム保守支援装置、プログラム保守支援方法、およびプログラム
US7707566B2 (en) * 2003-06-26 2010-04-27 Microsoft Corporation Software development infrastructure
US7788652B2 (en) * 2003-06-27 2010-08-31 Microsoft Corporation Representing type information in a compiler and programming tools framework
US7757212B2 (en) * 2004-05-21 2010-07-13 Bea Systems, Inc. System and method for managing cross project dependencies at development time
US7734619B2 (en) 2005-05-27 2010-06-08 International Business Machines Corporation Method of presenting lineage diagrams representing query plans
US7716630B2 (en) 2005-06-27 2010-05-11 Ab Initio Technology Llc Managing parameters for graph-based computations
US7493570B2 (en) 2005-09-12 2009-02-17 International Business Machines Corporation User interface options of a data lineage tool
WO2007084780A2 (en) 2006-01-20 2007-07-26 Aptana, Inc. Type inference system and method
WO2008089362A1 (en) 2007-01-17 2008-07-24 Weidner David P Point of reference directions
US8181167B2 (en) 2008-01-09 2012-05-15 Kan Zhao Method and system for presenting and analyzing software source code through intermediate representation
WO2009108782A1 (en) 2008-02-26 2009-09-03 Ab Initio Software Llc Graphic representations of data relationships
US8347272B2 (en) 2008-07-23 2013-01-01 International Business Machines Corporation Call graph dependency extraction by static source code analysis
US8458654B2 (en) 2008-10-22 2013-06-04 International Business Machines Corporation Identifying impact of database changes on an application
CA2940960C (en) 2008-12-02 2026-01-13 Ab Initio Technology Llc Visualizing relationships between data elements and graphical representations of data element attributes
US20110302563A1 (en) 2010-06-08 2011-12-08 Avaya Inc. Program structure recovery using multiple languages
US8819010B2 (en) 2010-06-28 2014-08-26 International Business Machines Corporation Efficient representation of data lineage information
BR112013008640A2 (pt) * 2010-09-23 2016-06-21 Apple Inc sistemas e métodos para vetorização baseada em compilador de código não foliar
US8775476B2 (en) 2010-12-30 2014-07-08 Skai, Inc. System and method for creating, deploying, integrating, and distributing nodes in a grid of distributed graph databases
KR101894925B1 (ko) 2011-01-07 2018-09-04 아브 이니티오 테크놀로지 엘엘시 흐름 분석 계측
US9202185B2 (en) 2011-04-08 2015-12-01 Ca, Inc. Transaction model with structural and behavioral description of complex transactions
US8782614B2 (en) 2011-04-08 2014-07-15 Ca, Inc. Visualization of JVM and cross-JVM call stacks
US8874525B2 (en) 2011-04-19 2014-10-28 Autodesk, Inc. Hierarchical display and navigation of document revision histories
US9430583B1 (en) 2011-06-10 2016-08-30 Salesforce.Com, Inc. Extracting a portion of a document, such as a web page
US8849824B2 (en) 2011-10-07 2014-09-30 Kabushiki Kaisha Square Enix Database visualization system
JP5775829B2 (ja) * 2012-01-30 2015-09-09 日立オートモティブシステムズ株式会社 ソフトウェアの構造可視化プログラムおよびシステム
US20130283250A1 (en) 2012-04-23 2013-10-24 International Business Machines Corporation Thread Specific Compiler Generated Customization of Runtime Support for Application Programming Interfaces
US9753926B2 (en) 2012-04-30 2017-09-05 Salesforce.Com, Inc. Extracting a portion of a document, such as a web page
US9298453B2 (en) 2012-07-03 2016-03-29 Microsoft Technology Licensing, Llc Source code analytics platform using program analysis and information retrieval
US9182957B2 (en) 2012-07-10 2015-11-10 Loring Craymer Method and system for automated improvement of parallelism in program compilation
US10089335B2 (en) 2012-07-10 2018-10-02 Microsoft Technology Licensing, Llc Data lineage across multiple marketplaces
US9063998B2 (en) 2012-10-18 2015-06-23 Oracle International Corporation Associated information propagation system
US20150012477A1 (en) 2013-07-02 2015-01-08 Bank Of America Corporation Data lineage notification tools
US9256656B2 (en) 2013-08-20 2016-02-09 International Business Machines Corporation Determining reliability of data reports
WO2015039046A1 (en) 2013-09-16 2015-03-19 Metanautix, Inc. Data flow exploration
US9710243B2 (en) 2013-11-07 2017-07-18 Eagle Legacy Modernization, LLC Parser that uses a reflection technique to build a program semantic tree
US9891901B2 (en) * 2013-12-06 2018-02-13 Ab Initio Technology Llc Source code translation
EP3195114B1 (en) 2014-07-18 2020-04-01 AB Initio Technology LLC Managing lineage information
WO2016014615A1 (en) 2014-07-24 2016-01-28 Ab Initio Technology Llc Data lineage summarization
US10025878B1 (en) 2014-11-11 2018-07-17 Google Llc Data lineage analysis
WO2016130615A1 (en) 2015-02-11 2016-08-18 Ab Initio Technology Llc Filtering data lineage diagrams
JP6463845B2 (ja) 2015-02-11 2019-02-06 アビニシオ テクノロジー エルエルシー データ系統図のフィルタリング
US9712554B2 (en) 2015-04-09 2017-07-18 Accenture Global Services Limited Event correlation across heterogeneous operations
US10382566B2 (en) 2015-04-16 2019-08-13 Entit Software Llc Business service discovery
US10120923B2 (en) 2015-11-30 2018-11-06 Bank Of America Corporation Data discovery and analysis tool
US10379825B2 (en) 2017-05-22 2019-08-13 Ab Initio Technology Llc Automated dependency analyzer for heterogeneously programmed data processing system

Also Published As

Publication number Publication date
US10379825B2 (en) 2019-08-13
JP7708828B2 (ja) 2025-07-15
AU2018272840A1 (en) 2019-12-12
EP3631618B1 (en) 2023-03-29
WO2018217745A1 (en) 2018-11-29
CN110998516B (zh) 2024-04-16
US20180336020A1 (en) 2018-11-22
EP4202644A1 (en) 2023-06-28
CN110998516A (zh) 2020-04-10
EP3631618A1 (en) 2020-04-08
JP2023182708A (ja) 2023-12-26
AU2018272840B2 (en) 2023-02-16
JP2020522790A (ja) 2020-07-30
US10817271B2 (en) 2020-10-27
EP4202644B1 (en) 2026-02-18
JP7360328B2 (ja) 2023-10-12
US20190339952A1 (en) 2019-11-07

Similar Documents

Publication Publication Date Title
US10817271B2 (en) Automated dependency analyzer for heterogeneously programmed data processing system
KR102432104B1 (ko) 데이터 요소 간의 관계를 결정하기 위한 시스템 및 방법
KR102539041B1 (ko) 영향 분석
US11341116B2 (en) Techniques for automated data analysis
EP3430529B1 (en) Intelligent metadata management and data lineage tracing
US11847040B2 (en) Systems and methods for detecting data alteration from source to target
KR20230121164A (ko) 신속한 스크리닝을 위한 도메인-특정 언어 해석기 및대화형 시각적 인터페이스
US9684526B2 (en) Techniques for configuring a generic program using controls
US12499120B2 (en) Methods and systems for tracking data lineage from source to target
US20240146769A1 (en) Systems and methods for managing privileges in a data processing system
Doveri et al. FORQ-based language inclusion formal testing
Fathollahzadeh et al. CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines
Saba et al. An empirical comparison of AI assisted software refactoring tools
US11914557B2 (en) Techniques for performing lifecycle operations on a data store
CN118606354A (zh) 程序执行方案的可视化方法、装置、电子设备及存储介质
Grechanik et al. Differencing graphical user interfaces
HK40026585A (en) Automated dependency analyzer for heterogeneously programmed data processing system
CN115879945B (zh) 一种智能合约写后读风险检测方法和电子设备
US20260119255A1 (en) Data processing system for automatic processing of continuous flows or batch data
HK40026585B (en) Automated dependency analyzer for heterogeneously programmed data processing system
WO2025049234A1 (en) Conversion of data lineages

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20220817

D15 Examination report completed

Free format text: ST27 STATUS EVENT CODE: A-2-2-D10-D15-D126 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: EXAMINER'S REPORT

Effective date: 20240807

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-P100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT RECEIVED - RESPONSE TO EXAMINER'S REQUISITION

Effective date: 20241206

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20250205

MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 7TH ANNIV.) - STANDARD

Year of fee payment: 7

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250516

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20250516

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-P102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT DETERMINED COMPLIANT

Effective date: 20250609

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-X000 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: APPLICATION AMENDED

Effective date: 20250609

D00 Search and/or examination requested or commenced

Free format text: ST27 STATUS EVENT CODE: A-2-2-D10-D00-D149 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: EXAMINER'S INTERVIEW

Effective date: 20250919

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-P101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT RECEIVED - VOLUNTARY AMENDMENT

Effective date: 20251007

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-P102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT DETERMINED COMPLIANT

Effective date: 20251120

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-X000 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: APPLICATION AMENDED

Effective date: 20251120

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20251120

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-2-2-D10-D22-D128 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: ALLOWANCE REQUIREMENTS DETERMINED COMPLIANT

Effective date: 20260421

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20260421