CA2889884C - System for transform generation - Google Patents

System for transform generation Download PDF

Info

Publication number
CA2889884C
CA2889884C CA2889884A CA2889884A CA2889884C CA 2889884 C CA2889884 C CA 2889884C CA 2889884 A CA2889884 A CA 2889884A CA 2889884 A CA2889884 A CA 2889884A CA 2889884 C CA2889884 C CA 2889884C
Authority
CA
Canada
Prior art keywords
trigger conditions
control structure
row
sequence
execution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2889884A
Other languages
English (en)
French (fr)
Other versions
CA2889884A1 (en
Inventor
Scott Studer
Joseph Skeffington Wholey, Iii
Amit Weisman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ab Initio Technology LLC
Original Assignee
Ab Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology LLC filed Critical Ab Initio Technology LLC
Publication of CA2889884A1 publication Critical patent/CA2889884A1/en
Application granted granted Critical
Publication of CA2889884C publication Critical patent/CA2889884C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Computer Security & Cryptography (AREA)
  • Programmable Controllers (AREA)
  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)
  • Test And Diagnosis Of Digital Computers (AREA)
  • Retry When Errors Occur (AREA)
  • Testing And Monitoring For Control Systems (AREA)
CA2889884A 2012-12-10 2013-12-09 System for transform generation Active CA2889884C (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201261735451P 2012-12-10 2012-12-10
US61/735,451 2012-12-10
US201361751814P 2013-01-11 2013-01-11
US61/751,814 2013-01-11
US13/958,037 US9703822B2 (en) 2012-12-10 2013-08-02 System for transform generation
US13/958,037 2013-08-02
PCT/US2013/073899 WO2014093232A1 (en) 2012-12-10 2013-12-09 System for transform generation

Publications (2)

Publication Number Publication Date
CA2889884A1 CA2889884A1 (en) 2014-06-19
CA2889884C true CA2889884C (en) 2021-02-23

Family

ID=50882152

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2889884A Active CA2889884C (en) 2012-12-10 2013-12-09 System for transform generation

Country Status (10)

Country Link
US (2) US9703822B2 (enExample)
EP (1) EP2929457A4 (enExample)
JP (1) JP6419081B2 (enExample)
KR (1) KR102237167B1 (enExample)
CN (1) CN104919445B (enExample)
AU (1) AU2013359617B2 (enExample)
CA (1) CA2889884C (enExample)
HK (1) HK1209869A1 (enExample)
SG (1) SG11201503470TA (enExample)
WO (1) WO2014093232A1 (enExample)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9703822B2 (en) 2012-12-10 2017-07-11 Ab Initio Technology Llc System for transform generation
US20140279132A1 (en) * 2013-03-13 2014-09-18 Oracle International Corporation Buyer assignment for requisitions lines
US10412415B2 (en) * 2014-10-24 2019-09-10 Lg Electronics Inc. Method and apparatus for decoding/encoding video signal using transform derived from graph template
US10567763B2 (en) * 2015-05-26 2020-02-18 Lg Electronics Inc. Method and device for processing a video signal by using an adaptive separable graph-based transform
US10657120B2 (en) * 2016-10-03 2020-05-19 Bank Of America Corporation Cross-platform digital data movement control utility and method of use thereof
US10929380B2 (en) * 2017-07-25 2021-02-23 Sap Se Definition of programmable conditions applicable to an operation
US11055288B2 (en) 2017-07-25 2021-07-06 Sap Se Evaluation of programmable conditions applicable to an operation
CN111310113B (zh) * 2020-02-13 2021-01-15 北京工业大数据创新中心有限公司 基于时序数据的专家规则系统的反例生成方法及装置
US11928157B2 (en) 2022-06-13 2024-03-12 Snowflake Inc. Projection constraints in a query processing system
US20240303373A1 (en) * 2023-03-06 2024-09-12 Snowflake Inc. Aggregation constraints in a query processing system

Family Cites Families (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01277939A (ja) 1988-04-30 1989-11-08 Meidensha Corp 推論トレース方式
JPH02275539A (ja) 1989-04-17 1990-11-09 Fuji Xerox Co Ltd デバッグ処理方式
JPH04352029A (ja) 1991-05-29 1992-12-07 Hitachi Ltd ソースプログラム自動生成装置
JPH0736706A (ja) * 1993-07-19 1995-02-07 Matsushita Electric Ind Co Ltd 最適化コンパイラ
US5615359A (en) 1994-06-23 1997-03-25 Candle Distributed Solutions, Inc. Data server with data probes employing predicate tests in rule statements
US5734886A (en) 1994-11-16 1998-03-31 Lucent Technologies Inc. Database dependency resolution method and system for identifying related data files
US5832497A (en) 1995-08-10 1998-11-03 Tmp Worldwide Inc. Electronic automated information exchange and management system
US5848393A (en) 1995-12-15 1998-12-08 Ncr Corporation "What if . . . " function for simulating operations within a task workflow management system
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US6560592B1 (en) * 1998-03-19 2003-05-06 Micro Data Base Systems, Inc. Multi-model computer database storage system with integrated rule engine
US6782374B2 (en) 1998-12-22 2004-08-24 Accenture Global Services Gmbh System, method and article of manufacturing for a runtime program analysis tool for a simulation engine
US6477520B1 (en) 1999-02-22 2002-11-05 Yatra Corporation Adaptive travel purchasing optimization system
US6728879B1 (en) 1999-06-02 2004-04-27 Microsoft Corporation Transactional log with multi-sector log block validation
US8332740B2 (en) 2000-01-19 2012-12-11 Graham John D Systems and method for management of intangible assets
US7215637B1 (en) * 2000-04-17 2007-05-08 Juniper Networks, Inc. Systems and methods for processing packets
AU2001259690A1 (en) 2000-05-09 2001-11-20 Hnc Software, Inc. Approach for generating rules
US20020032723A1 (en) * 2000-05-22 2002-03-14 Rani Johnson System and method for network-based automation of advice and selection of objects
US7164422B1 (en) 2000-07-28 2007-01-16 Ab Initio Software Corporation Parameterized graphs with conditional components
US7020869B2 (en) 2000-12-01 2006-03-28 Corticon Technologies, Inc. Business rules user interface for development of adaptable enterprise applications
AU2002332556A1 (en) 2001-08-15 2003-03-03 Visa International Service Association Method and system for delivering multiple services electronically to customers via a centralized portal architecture
JP2003208307A (ja) 2002-01-16 2003-07-25 Hitachi Software Eng Co Ltd ソースプログラム生成システム
US7107285B2 (en) 2002-03-16 2006-09-12 Questerra Corporation Method, system, and program for an improved enterprise spatial system
US7610329B2 (en) 2002-07-30 2009-10-27 Storediq, Inc. Method and apparatus for managing file systems and file-based data storage
US8612404B2 (en) 2002-07-30 2013-12-17 Stored Iq, Inc. Harvesting file system metsdata
US8417678B2 (en) 2002-07-30 2013-04-09 Storediq, Inc. System, method and apparatus for enterprise policy management
US7565642B2 (en) 2002-08-09 2009-07-21 Corticon Technologies, Inc. Rule engine
US7676387B2 (en) 2002-10-31 2010-03-09 Computer Sciences Corporation Graphical display of business rules
US20040085357A1 (en) 2002-10-31 2004-05-06 Childress Allen B. Method of generating a graphical display of a business rule and associated business rule elements
US20040210661A1 (en) 2003-01-14 2004-10-21 Thompson Mark Gregory Systems and methods of profiling, matching and optimizing performance of large networks of individuals
WO2005001627A2 (en) 2003-06-04 2005-01-06 Rulespower, Inc. Relational logic management system
US8122367B2 (en) 2003-07-08 2012-02-21 Us Lynx Llc Automated publishing system that facilitates collaborative editing and accountability through virtual document architecture
WO2005022417A2 (en) 2003-08-27 2005-03-10 Ascential Software Corporation Methods and systems for real time integration services
US7756873B2 (en) 2003-09-15 2010-07-13 Ab Initio Technology Llc Functional dependency data profiling
US7631296B2 (en) 2004-04-30 2009-12-08 Microsoft Corporation Rules framework for definition and execution of end-user rules logic
US20060112061A1 (en) 2004-06-24 2006-05-25 Masurkar Vijay B Rule based engines for diagnosing grid-based computing systems
US7426688B2 (en) 2004-11-02 2008-09-16 Hewlett-Packard Development Company, L.P. Embedded spreadsheet commands
US7899833B2 (en) 2004-11-02 2011-03-01 Ab Initio Technology Llc Managing related data objects
US7461042B2 (en) 2004-11-17 2008-12-02 Long Jeffrey G Method, system, and program for defining and managing complex contingent rules, and exceptions thereto, in a rule-based computer system
US7567975B2 (en) * 2005-03-16 2009-07-28 Oracle International Corporation Incremental evaluation of complex event-condition-action rules in a database system
US8468125B2 (en) 2005-04-12 2013-06-18 International Business Machines Corporation Automatically moving multidimensional data between live datacubes of enterprise software systems
US7877350B2 (en) 2005-06-27 2011-01-25 Ab Initio Technology Llc Managing metadata for graph-based computations
US7716630B2 (en) 2005-06-27 2010-05-11 Ab Initio Technology Llc Managing parameters for graph-based computations
US20070021995A1 (en) 2005-07-20 2007-01-25 Candemir Toklu Discovering patterns of executions in business processes
WO2007046013A2 (en) 2005-10-18 2007-04-26 Koninklijke Philips Electronics, N.V. Patient scan time optimization for pet/spect imaging
JP5135714B2 (ja) * 2006-05-30 2013-02-06 富士通株式会社 タンパク質複合体間相互作用評価プログラム、およびタンパク質複合体間相互作用評価装置
JP2008059135A (ja) * 2006-08-30 2008-03-13 Nec Biglobe Ltd ソフトウェア自動生成装置、ソフトウェア自動生成方法、およびプログラム
GB0617449D0 (en) 2006-09-06 2006-10-18 Ibm An apparatus for providing a visual representation of a sub-set of a visual program
US7836004B2 (en) 2006-12-11 2010-11-16 International Business Machines Corporation Using data mining algorithms including association rules and tree classifications to discover data rules
US8069129B2 (en) * 2007-04-10 2011-11-29 Ab Initio Technology Llc Editing and compiling business rules
US7610294B2 (en) 2007-05-31 2009-10-27 International Business Machines Corporation Multidimensional data cube validation
US8347207B2 (en) 2007-07-16 2013-01-01 International Business Machines Corporation Automatically moving annotations associated with multidimensional data between live datacubes
US8190562B2 (en) 2007-10-31 2012-05-29 Microsoft Corporation Linking framework for information technology management
US8645434B2 (en) 2008-03-18 2014-02-04 Apple Inc. Techniques for schema production and transformation
US8073801B1 (en) 2008-05-30 2011-12-06 The Decision Model Licensing, LLC Business decision modeling and management system and method
US8429614B2 (en) 2008-06-23 2013-04-23 International Business Machines Corporation Method and apparatus of effective functional test data generation for web service testing
US8548954B2 (en) * 2008-10-06 2013-10-01 Sap Ag Archiving system for massive databases using pre-computed data lifecycles
AU2010208112B2 (en) 2009-01-30 2015-05-28 Ab Initio Technology Llc Processing data using vector fields
US8725660B2 (en) 2009-07-30 2014-05-13 Hewlett-Packard Development Company, L.P. Applying non-linear transformation of feature values for training a classifier
US8825695B2 (en) * 2009-09-16 2014-09-02 Ab Initio Technology Llc Mapping dataset elements
US8301413B2 (en) 2009-10-30 2012-10-30 Bank Of America Corporation Testing analytics tool
WO2011053891A2 (en) * 2009-10-31 2011-05-05 Rutgers, The State University Of New Jersey Virtual flow pipelining processing architecture
US20110255794A1 (en) 2010-01-15 2011-10-20 Copanion, Inc. Systems and methods for automatically extracting data by narrowing data search scope using contour matching
US8438533B2 (en) 2010-04-26 2013-05-07 Sag Ag Performance-related decision support for compositions of process modeling environments
US20120005144A1 (en) * 2010-06-30 2012-01-05 Alcatel-Lucent Canada, Inc. Optimization of rule entities
US9703822B2 (en) 2012-12-10 2017-07-11 Ab Initio Technology Llc System for transform generation

Also Published As

Publication number Publication date
KR20150095648A (ko) 2015-08-21
JP2016510442A (ja) 2016-04-07
US20140164410A1 (en) 2014-06-12
SG11201503470TA (en) 2015-06-29
EP2929457A4 (en) 2016-06-01
JP6419081B2 (ja) 2018-11-07
HK1209869A1 (en) 2016-04-08
AU2013359617A1 (en) 2015-05-21
EP2929457A1 (en) 2015-10-14
CN104919445A (zh) 2015-09-16
US10817503B2 (en) 2020-10-27
AU2013359617B2 (en) 2019-04-04
CA2889884A1 (en) 2014-06-19
CN104919445B (zh) 2022-01-11
KR102237167B1 (ko) 2021-04-06
US9703822B2 (en) 2017-07-11
WO2014093232A1 (en) 2014-06-19
US20180067982A1 (en) 2018-03-08

Similar Documents

Publication Publication Date Title
US10817503B2 (en) System for transform generation
US11599337B2 (en) Dataflow graph configuration
US12099470B2 (en) API for implementing scoring functions
EP2909745B1 (en) Profiling data with location information
US20230229735A1 (en) Training and implementing machine-learning models utilizing model container workflows
US9477974B2 (en) Method and systems for flexible and scalable databases
CN117971799B (zh) 一种数据开发平台和数据开发方法
US11042530B2 (en) Data processing with nullable schema information
US20100161676A1 (en) Lifecycle management and consistency checking of object models using application platform tools
CN115080606A (zh) 业务数据查询方法、装置、设备及介质
US20140082627A1 (en) Parallel compute framework
US20240126776A1 (en) System and method for finding segments in a dataset within a data analytics environment
US10554502B1 (en) Scalable web services execution
CN116701152A (zh) 数据库性能确定方法、装置、设备及介质
Han et al. An optimized deterministic concurrency control approach for geo-distributed transaction processing on permissioned blockchains
CN120561112A (zh) 一种数据处理方法、装置、电子设备和计算机可读存储介质
US20220414101A1 (en) Shifting left database degradation detection
Groppe et al. Proceedings of the International Workshop on Big Data in Emergent Distributed Environments
US20230053109A1 (en) Generating data regulation compliant data from application interface data
CN117632254A (zh) 黑盒系统迁移方法、装置、存储介质及计算机设备
Pawar Generating example tuples for Data-Flow programs in Apache Flink
Birje A case study on high scalable data warehouses

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20181207