MX2020012906A - Sistemas y métodos para la optimización de grafo de flujo de datos. - Google Patents
Sistemas y métodos para la optimización de grafo de flujo de datos.Info
- Publication number
- MX2020012906A MX2020012906A MX2020012906A MX2020012906A MX2020012906A MX 2020012906 A MX2020012906 A MX 2020012906A MX 2020012906 A MX2020012906 A MX 2020012906A MX 2020012906 A MX2020012906 A MX 2020012906A MX 2020012906 A MX2020012906 A MX 2020012906A
- Authority
- MX
- Mexico
- Prior art keywords
- dataflow graph
- nodes
- data
- representing
- systems
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/43—Checking; Contextual analysis
- G06F8/433—Dependency analysis; Data or control flow analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/44—Encoding
- G06F8/443—Optimisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Complex Calculations (AREA)
- Multi Processors (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Stored Programmes (AREA)
Abstract
Al menos un medio de almacenamiento legible por computadora no transitorio que almacena instrucciones ejecutables por procesador que, cuando son ejecutadas por al menos un procesador de hardware de computadora, hacen que el al menos un procesador de hardware de computadora realice: obtener un grafo de flujo de datos inicial generado automáticamente, el grafo de flujo de datos inicial que comprende una primera pluralidad de nodos que representan una primera pluralidad de operaciones de procesamiento de datos y una primera pluralidad de enlaces que representan flujos de datos entre nodos en la primera pluralidad de nodos; y generar un grafo de flujo de datos actualizado aplicando iterativamente reglas de optimización de grafo de flujo de datos para actualizar el grafo de flujo de datos inicial, el grafo de flujo de datos actualizado que comprende una segunda pluralidad de nodos que representan una segunda pluralidad de operaciones de procesamiento de datos y una segunda pluralidad de enlaces que representan flujos de datos entre nodos de la segunda pluralidad de nodos.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/993,284 US20190370407A1 (en) | 2018-05-30 | 2018-05-30 | Systems and methods for dataflow graph optimization |
| PCT/US2019/033573 WO2019231793A1 (en) | 2018-05-30 | 2019-05-22 | Systems and methods for dataflow graph optimization |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| MX2020012906A true MX2020012906A (es) | 2021-05-27 |
Family
ID=66858007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| MX2020012906A MX2020012906A (es) | 2018-05-30 | 2019-05-22 | Sistemas y métodos para la optimización de grafo de flujo de datos. |
Country Status (11)
| Country | Link |
|---|---|
| US (1) | US20190370407A1 (es) |
| EP (3) | EP4250135A3 (es) |
| JP (1) | JP7487115B2 (es) |
| KR (1) | KR20210025024A (es) |
| CN (1) | CN112534401A (es) |
| AU (3) | AU2019276969B2 (es) |
| CA (1) | CA3102118A1 (es) |
| CL (1) | CL2020003100A1 (es) |
| MX (1) | MX2020012906A (es) |
| SG (1) | SG11202011682SA (es) |
| WO (1) | WO2019231793A1 (es) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10673716B1 (en) * | 2017-10-31 | 2020-06-02 | Amazon Technologies, Inc. | Graph-based generation of dependency-adherent execution plans for data center migrations |
| US11188434B2 (en) | 2017-12-08 | 2021-11-30 | Ab Initio Technology Llc | Systems and methods for monitoring execution of structured query language (SQL) queries |
| WO2020030807A1 (en) * | 2018-08-09 | 2020-02-13 | Inesc Tec Instituto De Engenharia De Sistemas De Computadores, Tecnologia E Ciência | Method and apparatus for optimizing code for field programmable gate arrays |
| US11061596B2 (en) * | 2019-11-04 | 2021-07-13 | Google Llc | Multi-pass distributed data shuffle |
| US11281721B2 (en) * | 2019-11-22 | 2022-03-22 | International Business Machines Corporation | Augmenting relational database engines with graph query capability |
| US10949178B1 (en) * | 2019-12-13 | 2021-03-16 | Intuit Inc. | Method and system for decomposing a global application programming interface (API) graph into an application-specific API subgraph |
| US11593380B2 (en) | 2020-01-28 | 2023-02-28 | Ab Initio Technology Llc | Editor for generating computational graphs |
| US11210285B2 (en) * | 2020-03-06 | 2021-12-28 | Ab Initio Technology Llc | Generation of optimized logic from a schema |
| CA3209125A1 (en) | 2021-01-31 | 2022-08-04 | Ab Initio Technology Llc | Data processing system with manipulation of logical dataset groups |
| US11567998B2 (en) * | 2021-03-25 | 2023-01-31 | Databricks, Inc. | Dataflow graph processing |
| CN113852571B (zh) * | 2021-08-20 | 2023-11-28 | 阿里巴巴（中国）有限公司 | 分配流量的方法以及装置 |
| US20230093911A1 (en) * | 2021-09-30 | 2023-03-30 | Ab Initio Technology Llc | Systems and methods for performing data processing operations using variable level parallelism |
| CN115098093B (zh) * | 2022-08-24 | 2022-12-02 | 湖南云畅网络科技有限公司 | 一种数据流程表达式处理方法及系统 |
| CN115964372B (zh) * | 2023-01-03 | 2023-11-21 | 中国科学院空间应用工程与技术中心 | 一种空间站有效载荷分布式事件提取方法和系统 |
| CN116107154B (zh) * | 2023-04-13 | 2023-09-05 | 长鑫存储技术有限公司 | 掩膜版数据生成方法、装置、设备及介质 |
Family Cites Families (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06161773A (ja) * | 1992-11-20 | 1994-06-10 | Sanyo Electric Co Ltd | 並列処理プログラムの作成装置 |
| US5966072A (en) | 1996-07-02 | 1999-10-12 | Ab Initio Software Corporation | Executing computations expressed as graphs |
| US5918255A (en) * | 1997-08-01 | 1999-06-29 | Ut Automotive Dearborn, Inc. | Method for testing motor armature shafts |
| JP2001222452A (ja) * | 2000-02-10 | 2001-08-17 | Ricoh Co Ltd | リレーショナルデータベースシステムにおける問い合わせ処理最適化装置 |
| US7089172B2 (en) * | 2001-12-28 | 2006-08-08 | Testout Corporation | System and method for simulating a computer environment and evaluating a user's performance within a simulation |
| US7146352B2 (en) * | 2003-06-23 | 2006-12-05 | Microsoft Corporation | Query optimizer system and method |
| JP4331045B2 (ja) * | 2004-04-20 | 2009-09-16 | 株式会社エヌ・ティ・ティ・データ | データベースシステム、および、プログラム |
| US7716630B2 (en) | 2005-06-27 | 2010-05-11 | Ab Initio Technology Llc | Managing parameters for graph-based computations |
| KR101911793B1 (ko) * | 2010-10-25 | 2018-10-25 | 아브 이니티오 테크놀로지 엘엘시 | 컴퓨터 프로그램을 나타내는 데이터플로우 그래프 내의 데이터세트 객체의 관리 |
| US9116955B2 (en) * | 2011-05-02 | 2015-08-25 | Ab Initio Technology Llc | Managing data queries |
| US8838579B2 (en) * | 2012-04-26 | 2014-09-16 | Sap Ag | Data flow graph optimization using adaptive rule chaining |
| US8793243B2 (en) * | 2012-04-26 | 2014-07-29 | Sap Ag | Rule-based extendable query optimizer |
| CN105683940A (zh) * | 2013-06-24 | 2016-06-15 | 惠普发展公司，有限责任合伙企业 | 处理混合流的数据流图 |
| US9990398B2 (en) * | 2013-09-20 | 2018-06-05 | Oracle International Corporation | Inferring dimensional metadata from content of a query |
| WO2016078072A1 (zh) * | 2014-11-21 | 2016-05-26 | 华为技术有限公司 | 一种实现业务优化的方法及系统 |
| WO2017019879A1 (en) * | 2015-07-29 | 2017-02-02 | Algebraix Data Corp. | Multi-query optimization |
| US10133778B2 (en) * | 2015-11-20 | 2018-11-20 | Sap Se | Query optimization using join cardinality |
| US10528599B1 (en) * | 2016-12-16 | 2020-01-07 | Amazon Technologies, Inc. | Tiered data processing for distributed data |
| US9798527B1 (en) * | 2017-01-06 | 2017-10-24 | Google Inc. | Loop and library fusion |
-
2018
- 2018-05-30 US US15/993,284 patent/US20190370407A1/en active Pending
-
2019
- 2019-05-22 KR KR1020207037986A patent/KR20210025024A/ko active Search and Examination
- 2019-05-22 SG SG11202011682SA patent/SG11202011682SA/en unknown
- 2019-05-22 JP JP2020567012A patent/JP7487115B2/ja active Active
- 2019-05-22 AU AU2019276969A patent/AU2019276969B2/en active Active
- 2019-05-22 CN CN201980049799.4A patent/CN112534401A/zh active Pending
- 2019-05-22 WO PCT/US2019/033573 patent/WO2019231793A1/en unknown
- 2019-05-22 EP EP23191246.0A patent/EP4250135A3/en active Pending
- 2019-05-22 EP EP19730617.8A patent/EP3803570B1/en active Active
- 2019-05-22 MX MX2020012906A patent/MX2020012906A/es unknown
- 2019-05-22 CA CA3102118A patent/CA3102118A1/en active Pending
- 2019-05-22 EP EP23191257.7A patent/EP4250136A3/en active Pending
-
2020
- 2020-11-27 CL CL2020003100A patent/CL2020003100A1/es unknown
-
2023
- 2023-11-23 AU AU2023270294A patent/AU2023270294A1/en active Pending
- 2023-11-23 AU AU2023270295A patent/AU2023270295A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| AU2019276969A1 (en) | 2020-12-17 |
| JP7487115B2 (ja) | 2024-05-20 |
| AU2023270295A1 (en) | 2023-12-14 |
| WO2019231793A1 (en) | 2019-12-05 |
| CL2020003100A1 (es) | 2021-05-14 |
| US20190370407A1 (en) | 2019-12-05 |
| CN112534401A (zh) | 2021-03-19 |
| EP4250135A3 (en) | 2023-12-27 |
| EP3803570B1 (en) | 2023-08-30 |
| SG11202011682SA (en) | 2020-12-30 |
| EP4250135A2 (en) | 2023-09-27 |
| AU2023270294A1 (en) | 2023-12-14 |
| EP4250136A3 (en) | 2023-12-20 |
| AU2019276969B2 (en) | 2023-08-24 |
| EP4250136A8 (en) | 2023-12-13 |
| CA3102118A1 (en) | 2019-12-05 |
| KR20210025024A (ko) | 2021-03-08 |
| EP4250136A2 (en) | 2023-09-27 |
| JP2021525925A (ja) | 2021-09-27 |
| EP3803570A1 (en) | 2021-04-14 |
| EP4250135A8 (en) | 2023-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| MX2020012906A (es) | Sistemas y métodos para la optimización de grafo de flujo de datos. | |
| SG10201805974UA (en) | Neural network system and operating method of neural network system | |
| MX2022009221A (es) | Editor para generar graficos computacionales. | |
| SG10201906917QA (en) | Processing data from multiple sources | |
| PH12017550013A1 (en) | Updating language understanding classifier models for a digital personal assistant based on crowd-sourcing | |
| PH12016000485A1 (en) | Document processing | |
| SG10201903485WA (en) | Querying a data source on a network | |
| EP4300381A3 (en) | Systems and methods for distributed training of deep learning models | |
| WO2016036830A4 (en) | Executing graph-based program specifications | |
| GB2553994A (en) | Modeling personal entities | |
| SG11201811389PA (en) | Data processing method and device | |
| GB2575401A (en) | Management of snapshot in blockchain | |
| GB2549208A (en) | System and method for image reconstruction | |
| GB2538457A (en) | High performance distributed computing environment particularly suited for reservoir modelling and simulation | |
| GB2539599A (en) | Processing data sets in a big data repository | |
| JP2016523402A5 (es) | ||
| GB2571841A (en) | Automated mutual improvement of oilfield models | |
| AR110138A1 (es) | Sistema y método de control para determinar automáticamente características para el óptimo desempeño de una máquina | |
| JP2015523629A5 (es) | ||
| SG10201810036QA (en) | Processing queries containing a union-type operation | |
| MX2019004025A (es) | Sistemas y metodos para sincronizar un esquema de base de datos. | |
| SG11201909119YA (en) | Search method and apparatus and non-temporary computer-readable storage medium | |
| WO2014153010A3 (en) | Systems and methods for concurrent online and offline document processing | |
| AU2015364405A8 (en) | Methods for simultaneous source separation | |
| GB2571686A (en) | System and method for analyzing and associating elements of a computer system by shared characteristics |