SG11202003758RA - Key-based logging for processing of structured data items with executable logic - Google Patents

Key-based logging for processing of structured data items with executable logic

Info

Publication number
SG11202003758RA
SG11202003758RA SG11202003758RA SG11202003758RA SG11202003758RA SG 11202003758R A SG11202003758R A SG 11202003758RA SG 11202003758R A SG11202003758R A SG 11202003758RA SG 11202003758R A SG11202003758R A SG 11202003758RA SG 11202003758R A SG11202003758R A SG 11202003758RA
Authority
SG
Singapore
Prior art keywords
key
processing
data items
structured data
executable logic
Prior art date
Application number
SG11202003758RA
Other languages
English (en)
Inventor
Joel Gould
Original Assignee
Ab Initio Technology Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology Llc filed Critical Ab Initio Technology Llc
Publication of SG11202003758RA publication Critical patent/SG11202003758RA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/40Transformation of program code
    • G06F8/41Compilation
    • G06F8/43Checking; Contextual analysis
    • G06F8/433Dependency analysis; Data or control flow analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/34Graphical or visual programming
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1805Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815Journaling file systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/116Details of conversion of file system types or formats
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24568Data stream processing; Continuous queries
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55Detecting local intrusion or implementing counter-measures
    • G06F21/552Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/865Monitoring of software

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
SG11202003758RA 2017-11-13 2018-11-13 Key-based logging for processing of structured data items with executable logic SG11202003758RA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762585362P 2017-11-13 2017-11-13
US15/853,000 US11055074B2 (en) 2017-11-13 2017-12-22 Key-based logging for processing of structured data items with executable logic
PCT/US2018/060670 WO2019094905A1 (en) 2017-11-13 2018-11-13 Key-based logging for processing of structured data items with executable logic

Publications (1)

Publication Number Publication Date
SG11202003758RA true SG11202003758RA (en) 2020-05-28

Family

ID=66433293

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202003758RA SG11202003758RA (en) 2017-11-13 2018-11-13 Key-based logging for processing of structured data items with executable logic

Country Status (9)

Country Link
US (2) US11055074B2 (https=)
EP (1) EP3710969B1 (https=)
JP (2) JP7009643B2 (https=)
CN (2) CN114416684B (https=)
AU (1) AU2018365176B2 (https=)
CA (1) CA3082454A1 (https=)
DE (1) DE112018005452T5 (https=)
SG (1) SG11202003758RA (https=)
WO (1) WO2019094905A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11449495B2 (en) * 2017-02-01 2022-09-20 United Parcel Service Of America, Inc. Indexable database profiles comprising multi-language encoding data and methods for generating the same
US11055074B2 (en) 2017-11-13 2021-07-06 Ab Initio Technology Llc Key-based logging for processing of structured data items with executable logic
WO2020068927A2 (en) 2018-09-25 2020-04-02 Ab Initio Technology Llc A dedicated audit port for implementing recoverability in outputting audit data
US11036700B2 (en) * 2018-12-31 2021-06-15 Microsoft Technology Licensing, Llc Automatic feature generation for machine learning in data-anomaly detection
US11308092B2 (en) * 2019-06-11 2022-04-19 Microsoft Technology Licensing, Llc Stream processing diagnostics
US11531611B2 (en) * 2019-07-29 2022-12-20 Ncr Corporation Auditing-as-a-service
EP4133681A4 (en) 2020-05-28 2023-10-04 Sumo Logic, Inc. Clustering of structured log data by key schema
CN112286895B (zh) * 2020-10-30 2024-11-22 北京深演智能科技股份有限公司 日志实时归因处理方法、装置和平台
US12333283B2 (en) * 2022-03-31 2025-06-17 SambaNova Systems, Inc. Iterative compilation to optimize translation in reconfigurable dataflow architectures
WO2024044041A1 (en) * 2022-08-23 2024-02-29 Ab Initio Technology Llc Operationalizing metadata

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US7266764B1 (en) * 2000-08-16 2007-09-04 Sparta Systems, Inc. Graphical user interface for automated process control
US6748583B2 (en) 2000-12-27 2004-06-08 International Business Machines Corporation Monitoring execution of an hierarchical visual program such as for debugging a message flow
US20050144189A1 (en) * 2002-07-19 2005-06-30 Keay Edwards Electronic item management and archival system and method of operating the same
US7308675B2 (en) * 2003-08-28 2007-12-11 Ricoh Company, Ltd. Data structure used for directory structure navigation in a skeleton code creation tool
US8868580B2 (en) * 2003-09-15 2014-10-21 Ab Initio Technology Llc Data profiling
JP4551096B2 (ja) * 2004-02-03 2010-09-22 株式会社日立製作所 ストレージサブシステム
US7877350B2 (en) 2005-06-27 2011-01-25 Ab Initio Technology Llc Managing metadata for graph-based computations
JP2007065718A (ja) * 2005-08-29 2007-03-15 Hitachi Software Eng Co Ltd プログラム動作過程追跡支援表示方法及びシステム
JP2009038123A (ja) 2007-07-31 2009-02-19 Fujifilm Corp 画像検出装置
US9424266B2 (en) * 2007-10-01 2016-08-23 Microsoft Technology Licensing, Llc Efficient file hash identifier computation
WO2010002919A1 (en) * 2008-06-30 2010-01-07 Ab Initio Software Llc Data logging in graph-based computations
KR101755365B1 (ko) * 2009-11-13 2017-07-10 아브 이니티오 테크놀로지 엘엘시 레코드 포맷 정보의 관리
EP2348416A1 (en) * 2010-01-21 2011-07-27 Software AG Analysis system and method for analyzing continuous queries for data streams
KR101687213B1 (ko) 2010-06-15 2016-12-16 아브 이니티오 테크놀로지 엘엘시 동적으로 로딩하는 그래프 기반 계산
KR20150042872A (ko) * 2010-06-22 2015-04-21 아브 이니티오 테크놀로지 엘엘시 관련 데이터세트의 처리
FR2967275B1 (fr) * 2010-11-10 2012-12-28 Oberthur Technologies Procede, programme d'ordinateur et dispositif de securisation de code intermediaire de programmation pour son execution par une machine virtuelle
US9460277B2 (en) 2010-12-06 2016-10-04 International Business Machines Corporation Identity based auditing in a multi-product environment
US8972952B2 (en) * 2012-02-03 2015-03-03 Apple Inc. Tracer based runtime optimization for dynamic programming languages
US9674249B1 (en) * 2013-03-11 2017-06-06 DataTorrent, Inc. Distributed streaming platform for real-time applications
CN103279840B (zh) * 2013-06-08 2017-02-08 北京首钢自动化信息技术有限公司 基于动态语言与事件处理机制的工作流引擎实现方法
WO2015020811A1 (en) * 2013-08-09 2015-02-12 Fusion-Io, Inc. Persistent data structures
CN106796513B (zh) 2014-07-18 2020-12-11 起元科技有限公司 管理沿袭信息
US10055333B2 (en) * 2014-11-05 2018-08-21 Ab Initio Technology Llc Debugging a graph
US20180101609A1 (en) * 2015-05-08 2018-04-12 Telefonaktiebolaget Lm Ericsson (Publ) Pattern-based Data Collection for a Distributed Stream Data Processing System
US9697018B2 (en) * 2015-05-29 2017-07-04 International Business Machines Corporation Synthesizing inputs to preserve functionality
CN105159818B (zh) * 2015-08-28 2018-01-02 东北大学 内存数据管理中日志恢复方法及其仿真系统
JP6573572B2 (ja) * 2016-04-26 2019-09-11 株式会社日立製作所 ログ情報解析装置およびログ情報解析方法
US10769152B2 (en) * 2016-12-02 2020-09-08 Cisco Technology, Inc. Automated log analysis
US11055074B2 (en) 2017-11-13 2021-07-06 Ab Initio Technology Llc Key-based logging for processing of structured data items with executable logic

Also Published As

Publication number Publication date
JP2022058555A (ja) 2022-04-12
JP2021502658A (ja) 2021-01-28
CA3082454A1 (en) 2019-05-16
EP3710969B1 (en) 2022-10-12
DE112018005452T5 (de) 2020-08-06
CN111837121B (zh) 2021-12-31
EP3710969A1 (en) 2020-09-23
JP7254975B2 (ja) 2023-04-10
AU2018365176B2 (en) 2023-12-07
CN114416684A (zh) 2022-04-29
CN114416684B (zh) 2025-03-14
AU2018365176A1 (en) 2020-05-14
JP7009643B2 (ja) 2022-01-25
US20210263717A1 (en) 2021-08-26
US20190146763A1 (en) 2019-05-16
US12190083B2 (en) 2025-01-07
US11055074B2 (en) 2021-07-06
CN111837121A (zh) 2020-10-27
WO2019094905A1 (en) 2019-05-16

Similar Documents

Publication Publication Date Title
SG11202003758RA (en) Key-based logging for processing of structured data items with executable logic
GB201801093D0 (en) Data processing
IL256218A (en) A classification that can be adapted to data items
SG11201608186RA (en) Processing data from multiple sources
GB2552371B (en) Data processing
SG10201504721WA (en) Seismic data processing
GB201720649D0 (en) Data processing
GB201503424D0 (en) An item of luggage
GB2558394B (en) Data processing
EP3391235A4 (en) INSTRUCTIONS AND LOGIC FOR JUST AND ODD VECTOR GET OPERATIONS
GB2530126B (en) Seismic Data Processing
GB201510552D0 (en) Data processing
IL268321B (en) Data processing
GB2563970B (en) Data processing
GB2561451B8 (en) Data processing
GB2545248B (en) Data processing
GB2540941B (en) Data processing
GB2569785B (en) Data processing
GB2558282B (en) Data processing
GB201713674D0 (en) Data processing
GB2539410B (en) Data processing
GB201706442D0 (en) Data processing
GB2548853B (en) Data processing
GB2539411B (en) Data processing
GB201813078D0 (en) Grouping multivariate data items