CN110998516B - 用于异构编程数据处理系统的自动化依赖性分析器 - Google Patents

用于异构编程数据处理系统的自动化依赖性分析器 Download PDF

Info

Publication number
CN110998516B
CN110998516B CN201880049296.2A CN201880049296A CN110998516B CN 110998516 B CN110998516 B CN 110998516B CN 201880049296 A CN201880049296 A CN 201880049296A CN 110998516 B CN110998516 B CN 110998516B
Authority
CN
China
Prior art keywords
data
dependency
dependencies
programs
data structure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880049296.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN110998516A (zh
Inventor
C·伯格
D·克莱门斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AB Initio Technology LLC
Original Assignee
AB Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AB Initio Technology LLC filed Critical AB Initio Technology LLC
Publication of CN110998516A publication Critical patent/CN110998516A/zh
Application granted granted Critical
Publication of CN110998516B publication Critical patent/CN110998516B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/40—Transformation of program code
    • G06F8/41—Compilation
    • G06F8/43—Checking; Contextual analysis
    • G06F8/433—Dependency analysis; Data or control flow analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3604—Analysis of software for verifying properties of programs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Stored Programmes (AREA)
  • Debugging And Monitoring (AREA)
  • Devices For Executing Special Programs (AREA)
CN201880049296.2A 2017-05-22 2018-05-22 用于异构编程数据处理系统的自动化依赖性分析器 Active CN110998516B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/601,911 US10379825B2 (en) 2017-05-22 2017-05-22 Automated dependency analyzer for heterogeneously programmed data processing system
US15/601,911 2017-05-22
PCT/US2018/033882 WO2018217745A1 (en) 2017-05-22 2018-05-22 Automated dependency analyzer for heterogeneously programmed data processing system

Publications (2)

Publication Number Publication Date
CN110998516A CN110998516A (zh) 2020-04-10
CN110998516B true CN110998516B (zh) 2024-04-16

Family

ID=63592791

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880049296.2A Active CN110998516B (zh) 2017-05-22 2018-05-22 用于异构编程数据处理系统的自动化依赖性分析器

Country Status (7)

Country Link
US (2) US10379825B2 (enExample)
EP (2) EP3631618B1 (enExample)
JP (2) JP7360328B2 (enExample)
CN (1) CN110998516B (enExample)
AU (1) AU2018272840B2 (enExample)
CA (1) CA3064561A1 (enExample)
WO (1) WO2018217745A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018502390A (ja) * 2014-12-23 2018-01-25 エントイット ソフトウェア エルエルシーＥｎｔｉｔ Ｓｏｆｔｗａｒｅ Ｌｌｃ 負荷テスト
US10795935B2 (en) 2016-02-05 2020-10-06 Sas Institute Inc. Automated generation of job flow definitions
US10642896B2 (en) * 2016-02-05 2020-05-05 Sas Institute Inc. Handling of data sets during execution of task routines of multiple languages
US10650046B2 (en) 2016-02-05 2020-05-12 Sas Institute Inc. Many task computing with distributed file system
USD898059S1 (en) 2017-02-06 2020-10-06 Sas Institute Inc. Display screen or portion thereof with graphical user interface
US10379825B2 (en) 2017-05-22 2019-08-13 Ab Initio Technology Llc Automated dependency analyzer for heterogeneously programmed data processing system
USD898060S1 (en) 2017-06-05 2020-10-06 Sas Institute Inc. Display screen or portion thereof with graphical user interface
US10990364B2 (en) 2018-06-06 2021-04-27 Ab Initio Technology Llc Updating executable graphs
US10877870B2 (en) * 2018-06-11 2020-12-29 Tata Consultancy Services Limited Method and system for verifying properties of source code
US10733075B2 (en) * 2018-08-22 2020-08-04 Fujitsu Limited Data-driven synthesis of fix patterns
EP3850559A4 (en) * 2018-09-20 2021-11-10 Huawei Technologies Co., Ltd. SYSTEMS AND PROCEDURES FOR GRAPH-BASED QUERY ANALYSIS
US10965536B2 (en) 2019-03-30 2021-03-30 Intel Corporation Methods and apparatus to insert buffers in a dataflow graph
US11029927B2 (en) * 2019-03-30 2021-06-08 Intel Corporation Methods and apparatus to detect and annotate backedges in a dataflow graph
US11194845B2 (en) 2019-04-19 2021-12-07 Tableau Software, LLC Interactive lineage analyzer for data assets
US11294894B2 (en) 2019-08-30 2022-04-05 Oracle International Corporation Dynamic resolution of dependencies for database guest languages
US12443449B2 (en) * 2019-11-15 2025-10-14 Nvidia Corporation Techniques for modifying an executable graph to perform a workload associated with a new task graph
LU101480B1 (en) 2019-11-18 2021-05-18 Luxembourg Inst Science & Tech List Data preprocessing for a supervised machine learning process
US11385889B2 (en) * 2019-12-04 2022-07-12 Oracle International Corporation Inferring intra package and module dependencies
US11440190B1 (en) * 2020-02-26 2022-09-13 Trend Micro Incorporated Detecting unsecure data flow in automation task programs
US11360751B2 (en) 2020-03-19 2022-06-14 Codelogic, Inc. Systems and methods for dependency analysis
US11366648B2 (en) * 2020-05-28 2022-06-21 Red Hat, Inc. Compiling monoglot function compositions into a single entity
CN112162776B (zh) * 2020-09-04 2023-07-14 维沃移动通信有限公司 依赖关系获取方法及装置
US12517717B2 (en) 2021-10-08 2026-01-06 Ab Initio Technology Llc Automated modification of computer programs
CN114398039B (zh) * 2021-12-03 2024-07-30 武汉大学 一种自动细粒度的两级并行翻译方法
US12524212B2 (en) * 2022-04-15 2026-01-13 Nvidia Corporation Control of storage aliasing via automatic application of artificial dependences during program compilation
CN114741993B (zh) * 2022-04-18 2023-06-16 山东浪潮科学研究院有限公司 一种基于脚本的数据流图生成方法及装置
CN114611712B (zh) * 2022-05-10 2022-08-26 富算科技(上海)有限公司 基于异构联邦学习的预测方法、模型生成方法及装置
CN114968364B (zh) * 2022-07-12 2022-11-08 飞腾信息技术有限公司 一种条件语句的处理方法、装置及存储介质
CN116737809B (zh) * 2023-04-24 2026-06-16 京东科技控股股份有限公司 衍生变量的生成方法、装置、设备、介质及产品
US12248457B1 (en) 2023-08-23 2025-03-11 International Business Machines Corporation Detecting temporal anomalous data using dependency modeling
US20260080324A1 (en) * 2024-09-17 2026-03-19 Truist Bank Systems and methods for a rules engine without hardcoded rules

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5577253A (en) * 1991-02-27 1996-11-19 Digital Equipment Corporation Analyzing inductive expressions in a multilanguage optimizing compiler
CN103119561A (zh) * 2010-09-23 2013-05-22 苹果公司 用于对非叶代码进行基于编译器的矢量化的系统和方法

Family Cites Families (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4914585A (en) 1988-05-23 1990-04-03 Hewlett-Packard Company Modular complier with a class independent parser and a plurality of class dependent parsers
US5826256A (en) * 1991-10-22 1998-10-20 Lucent Technologies Inc. Apparatus and methods for source code discovery
JP3328056B2 (ja) * 1994-03-01 2002-09-24 新日鉄ソリューションズ株式会社 構文解析木からの情報抽出装置
CA2143145C (en) 1994-04-18 1999-12-28 Premkumar Thomas Devanbu Determining dynamic properties of programs
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US6745384B1 (en) * 1998-05-29 2004-06-01 Microsoft Corporation Anticipatory optimization with composite folding
US6988183B1 (en) * 1998-06-26 2006-01-17 Derek Chi-Lan Wong Methods for increasing instruction-level parallelism in microprocessors and digital system
US7974875B1 (en) 2000-03-21 2011-07-05 Aol Inc. System and method for using voice over a telephone to access, process, and carry out transactions over the internet
US6681383B1 (en) * 2000-04-04 2004-01-20 Sosy, Inc. Automatic software production system
JP2002099561A (ja) 2000-09-21 2002-04-05 Toshiba Corp データ変換方法およびデータ変換システム並びに記憶媒体
US7174536B1 (en) * 2001-02-12 2007-02-06 Iowa State University Research Foundation, Inc. Integrated interactive software visualization environment
WO2003065179A2 (en) 2002-02-01 2003-08-07 John Fairweather A system and method for mining data
US20040010752A1 (en) 2002-07-09 2004-01-15 Lucent Technologies Inc. System and method for filtering XML documents with XPath expressions
US7418734B2 (en) 2003-04-18 2008-08-26 Ounce Labs, Inc. Method and system for detecting privilege escalation vulnerabilities in source code
JP4001286B2 (ja) * 2003-06-23 2007-10-31 インターナショナル・ビジネス・マシーンズ・コーポレーション プログラム保守支援装置、プログラム保守支援方法、およびプログラム
US7707566B2 (en) * 2003-06-26 2010-04-27 Microsoft Corporation Software development infrastructure
US7788652B2 (en) * 2003-06-27 2010-08-31 Microsoft Corporation Representing type information in a compiler and programming tools framework
US7757212B2 (en) * 2004-05-21 2010-07-13 Bea Systems, Inc. System and method for managing cross project dependencies at development time
US7734619B2 (en) 2005-05-27 2010-06-08 International Business Machines Corporation Method of presenting lineage diagrams representing query plans
US7716630B2 (en) 2005-06-27 2010-05-11 Ab Initio Technology Llc Managing parameters for graph-based computations
US7493570B2 (en) 2005-09-12 2009-02-17 International Business Machines Corporation User interface options of a data lineage tool
WO2007084780A2 (en) 2006-01-20 2007-07-26 Aptana, Inc. Type inference system and method
WO2008089362A1 (en) 2007-01-17 2008-07-24 Weidner David P Point of reference directions
US8181167B2 (en) 2008-01-09 2012-05-15 Kan Zhao Method and system for presenting and analyzing software source code through intermediate representation
WO2009108782A1 (en) 2008-02-26 2009-09-03 Ab Initio Software Llc Graphic representations of data relationships
US8347272B2 (en) 2008-07-23 2013-01-01 International Business Machines Corporation Call graph dependency extraction by static source code analysis
US8458654B2 (en) 2008-10-22 2013-06-04 International Business Machines Corporation Identifying impact of database changes on an application
CA2940960C (en) 2008-12-02 2026-01-13 Ab Initio Technology Llc Visualizing relationships between data elements and graphical representations of data element attributes
US20110302563A1 (en) 2010-06-08 2011-12-08 Avaya Inc. Program structure recovery using multiple languages
US8819010B2 (en) 2010-06-28 2014-08-26 International Business Machines Corporation Efficient representation of data lineage information
US8775476B2 (en) 2010-12-30 2014-07-08 Skai, Inc. System and method for creating, deploying, integrating, and distributing nodes in a grid of distributed graph databases
KR101894925B1 (ko) 2011-01-07 2018-09-04 아브 이니티오 테크놀로지 엘엘시 흐름 분석 계측
US9202185B2 (en) 2011-04-08 2015-12-01 Ca, Inc. Transaction model with structural and behavioral description of complex transactions
US8782614B2 (en) 2011-04-08 2014-07-15 Ca, Inc. Visualization of JVM and cross-JVM call stacks
US8874525B2 (en) 2011-04-19 2014-10-28 Autodesk, Inc. Hierarchical display and navigation of document revision histories
US9430583B1 (en) 2011-06-10 2016-08-30 Salesforce.Com, Inc. Extracting a portion of a document, such as a web page
US8849824B2 (en) 2011-10-07 2014-09-30 Kabushiki Kaisha Square Enix Database visualization system
JP5775829B2 (ja) * 2012-01-30 2015-09-09 日立オートモティブシステムズ株式会社 ソフトウェアの構造可視化プログラムおよびシステム
US20130283250A1 (en) 2012-04-23 2013-10-24 International Business Machines Corporation Thread Specific Compiler Generated Customization of Runtime Support for Application Programming Interfaces
US9753926B2 (en) 2012-04-30 2017-09-05 Salesforce.Com, Inc. Extracting a portion of a document, such as a web page
US9298453B2 (en) 2012-07-03 2016-03-29 Microsoft Technology Licensing, Llc Source code analytics platform using program analysis and information retrieval
US9182957B2 (en) 2012-07-10 2015-11-10 Loring Craymer Method and system for automated improvement of parallelism in program compilation
US10089335B2 (en) 2012-07-10 2018-10-02 Microsoft Technology Licensing, Llc Data lineage across multiple marketplaces
US9063998B2 (en) 2012-10-18 2015-06-23 Oracle International Corporation Associated information propagation system
US20150012477A1 (en) 2013-07-02 2015-01-08 Bank Of America Corporation Data lineage notification tools
US9256656B2 (en) 2013-08-20 2016-02-09 International Business Machines Corporation Determining reliability of data reports
WO2015039046A1 (en) 2013-09-16 2015-03-19 Metanautix, Inc. Data flow exploration
US9710243B2 (en) 2013-11-07 2017-07-18 Eagle Legacy Modernization, LLC Parser that uses a reflection technique to build a program semantic tree
US9891901B2 (en) * 2013-12-06 2018-02-13 Ab Initio Technology Llc Source code translation
EP3195114B1 (en) 2014-07-18 2020-04-01 AB Initio Technology LLC Managing lineage information
WO2016014615A1 (en) 2014-07-24 2016-01-28 Ab Initio Technology Llc Data lineage summarization
US10025878B1 (en) 2014-11-11 2018-07-17 Google Llc Data lineage analysis
WO2016130615A1 (en) 2015-02-11 2016-08-18 Ab Initio Technology Llc Filtering data lineage diagrams
JP6463845B2 (ja) 2015-02-11 2019-02-06 アビニシオ テクノロジー エルエルシー データ系統図のフィルタリング
US9712554B2 (en) 2015-04-09 2017-07-18 Accenture Global Services Limited Event correlation across heterogeneous operations
US10382566B2 (en) 2015-04-16 2019-08-13 Entit Software Llc Business service discovery
US10120923B2 (en) 2015-11-30 2018-11-06 Bank Of America Corporation Data discovery and analysis tool
US10379825B2 (en) 2017-05-22 2019-08-13 Ab Initio Technology Llc Automated dependency analyzer for heterogeneously programmed data processing system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5577253A (en) * 1991-02-27 1996-11-19 Digital Equipment Corporation Analyzing inductive expressions in a multilanguage optimizing compiler
CN103119561A (zh) * 2010-09-23 2013-05-22 苹果公司 用于对非叶代码进行基于编译器的矢量化的系统和方法

Also Published As

Publication number Publication date
US10379825B2 (en) 2019-08-13
JP7708828B2 (ja) 2025-07-15
AU2018272840A1 (en) 2019-12-12
EP3631618B1 (en) 2023-03-29
WO2018217745A1 (en) 2018-11-29
US20180336020A1 (en) 2018-11-22
EP4202644A1 (en) 2023-06-28
CN110998516A (zh) 2020-04-10
EP3631618A1 (en) 2020-04-08
JP2023182708A (ja) 2023-12-26
AU2018272840B2 (en) 2023-02-16
JP2020522790A (ja) 2020-07-30
US10817271B2 (en) 2020-10-27
EP4202644B1 (en) 2026-02-18
CA3064561A1 (en) 2018-11-29
JP7360328B2 (ja) 2023-10-12
US20190339952A1 (en) 2019-11-07

Similar Documents

Publication Publication Date Title
JP7708828B2 (ja) 異種にプログラムされたデータ処理システムの自動依存性アナライザ
US11487529B2 (en) User interface that integrates plural client portals in plural user interface portions through sharing of one or more log records
US11341116B2 (en) Techniques for automated data analysis
JP7132918B2 (ja) データ要素間の関係を決定するためのシステム及び方法
KR102539041B1 (ko) 영향 분석
US9898280B2 (en) Automatic code review and code reviewer recommendation
US20190079754A1 (en) Automating Identification of Code Snippets for Library Suggestion Models
US20230236830A1 (en) Detecting duplicated code patterns in visual programming language code instances
US20240146769A1 (en) Systems and methods for managing privileges in a data processing system
Arya et al. Information correspondence between types of documentation for APIs
Saba et al. An empirical comparison of AI assisted software refactoring tools
Panahandeh et al. MUPPIT: a method for using proper patterns in model transformations
CN118606354A (zh) 程序执行方案的可视化方法、装置、电子设备及存储介质
Ogunyomi Incremental model-to-text transformation
HK40026585A (en) Automated dependency analyzer for heterogeneously programmed data processing system
CN115879945B (zh) 一种智能合约写后读风险检测方法和电子设备
HK40026585B (en) Automated dependency analyzer for heterogeneously programmed data processing system
WO2025049234A1 (en) Conversion of data lineages
Ryzhov Haskell Financial Data Modeling and Predictive Analytics
WO2025123954A1 (zh) 编程语言的类型推断的方法及装置
CN119149382A (zh) 一种生成测试用例的方法和相关设备
CN118331636A (zh) 基于细粒度格理论模型的纯净性分析方法
CN120974509A (zh) 基于静态分析的软件漏洞确定方法、装置、设备及介质
Ritter et al. Responsible Composition and Optimization of Integration Processes Under Correctness Preserving Guarantees Preserving Guarantees
Le Program Synthesis for Empowering End Users and Stress-Testing Compilers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40026585

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant
TG01 Patent term adjustment
TG01 Patent term adjustment

Free format text: NEW EXPIRY DATE: 20380613