JP7009643B2 - 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング - Google Patents

実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング Download PDF

Info

Publication number
JP7009643B2
JP7009643B2 JP2020544375A JP2020544375A JP7009643B2 JP 7009643 B2 JP7009643 B2 JP 7009643B2 JP 2020544375 A JP2020544375 A JP 2020544375A JP 2020544375 A JP2020544375 A JP 2020544375A JP 7009643 B2 JP7009643 B2 JP 7009643B2
Authority
JP
Japan
Prior art keywords
data
key
executable logic
chart
execution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020544375A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021502658A (ja
JP2021502658A5 (https=
Inventor
ジョエル・グールド
Original Assignee
アビニシオ テクノロジー エルエルシー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アビニシオ テクノロジー エルエルシー filed Critical アビニシオ テクノロジー エルエルシー
Publication of JP2021502658A publication Critical patent/JP2021502658A/ja
Publication of JP2021502658A5 publication Critical patent/JP2021502658A5/ja
Priority to JP2022002291A priority Critical patent/JP7254975B2/ja
Application granted granted Critical
Publication of JP7009643B2 publication Critical patent/JP7009643B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/40—Transformation of program code
    • G06F8/41—Compilation
    • G06F8/43—Checking; Contextual analysis
    • G06F8/433—Dependency analysis; Data or control flow analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/34—Graphical or visual programming
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815—Journaling file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3476—Data logging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/116—Details of conversion of file system types or formats
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/285—Clustering or classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55—Detecting local intrusion or implementing counter-measures
    • G06F21/552—Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/865—Monitoring of software

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2020544375A 2017-11-13 2018-11-13 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング Active JP7009643B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022002291A JP7254975B2 (ja) 2017-11-13 2022-01-11 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201762585362P 2017-11-13 2017-11-13
US62/585,362 2017-11-13
US15/853,000 2017-12-22
US15/853,000 US11055074B2 (en) 2017-11-13 2017-12-22 Key-based logging for processing of structured data items with executable logic
PCT/US2018/060670 WO2019094905A1 (en) 2017-11-13 2018-11-13 Key-based logging for processing of structured data items with executable logic

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022002291A Division JP7254975B2 (ja) 2017-11-13 2022-01-11 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング

Publications (3)

Publication Number Publication Date
JP2021502658A JP2021502658A (ja) 2021-01-28
JP2021502658A5 JP2021502658A5 (https=) 2021-12-23
JP7009643B2 true JP7009643B2 (ja) 2022-01-25

Family

ID=66433293

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2020544375A Active JP7009643B2 (ja) 2017-11-13 2018-11-13 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング
JP2022002291A Active JP7254975B2 (ja) 2017-11-13 2022-01-11 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022002291A Active JP7254975B2 (ja) 2017-11-13 2022-01-11 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング

Country Status (9)

Country Link
US (2) US11055074B2 (https=)
EP (1) EP3710969B1 (https=)
JP (2) JP7009643B2 (https=)
CN (2) CN114416684B (https=)
AU (1) AU2018365176B2 (https=)
CA (1) CA3082454A1 (https=)
DE (1) DE112018005452T5 (https=)
SG (1) SG11202003758RA (https=)
WO (1) WO2019094905A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11449495B2 (en) * 2017-02-01 2022-09-20 United Parcel Service Of America, Inc. Indexable database profiles comprising multi-language encoding data and methods for generating the same
US11055074B2 (en) 2017-11-13 2021-07-06 Ab Initio Technology Llc Key-based logging for processing of structured data items with executable logic
WO2020068927A2 (en) 2018-09-25 2020-04-02 Ab Initio Technology Llc A dedicated audit port for implementing recoverability in outputting audit data
US11036700B2 (en) * 2018-12-31 2021-06-15 Microsoft Technology Licensing, Llc Automatic feature generation for machine learning in data-anomaly detection
US11308092B2 (en) * 2019-06-11 2022-04-19 Microsoft Technology Licensing, Llc Stream processing diagnostics
US11531611B2 (en) * 2019-07-29 2022-12-20 Ncr Corporation Auditing-as-a-service
EP4133681A4 (en) 2020-05-28 2023-10-04 Sumo Logic, Inc. Clustering of structured log data by key schema
CN112286895B (zh) * 2020-10-30 2024-11-22 北京深演智能科技股份有限公司 日志实时归因处理方法、装置和平台
US12333283B2 (en) * 2022-03-31 2025-06-17 SambaNova Systems, Inc. Iterative compilation to optimize translation in reconfigurable dataflow architectures
WO2024044041A1 (en) * 2022-08-23 2024-02-29 Ab Initio Technology Llc Operationalizing metadata

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011527052A (ja) 2008-06-30 2011-10-20 アビニシオ テクノロジー エルエルシー グラフベース計算におけるデータ記録
JP2013528884A (ja) 2010-06-15 2013-07-11 アビニシオ テクノロジー エルエルシー グラフに基づく計算の動的ロード
WO2016073746A1 (en) 2014-11-05 2016-05-12 Ab Initio Technology Llc Debugging a graph
JP2017199126A (ja) 2016-04-26 2017-11-02 株式会社日立製作所 ログ情報解析装置およびログ情報解析方法

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US7266764B1 (en) * 2000-08-16 2007-09-04 Sparta Systems, Inc. Graphical user interface for automated process control
US6748583B2 (en) 2000-12-27 2004-06-08 International Business Machines Corporation Monitoring execution of an hierarchical visual program such as for debugging a message flow
US20050144189A1 (en) * 2002-07-19 2005-06-30 Keay Edwards Electronic item management and archival system and method of operating the same
US7308675B2 (en) * 2003-08-28 2007-12-11 Ricoh Company, Ltd. Data structure used for directory structure navigation in a skeleton code creation tool
US8868580B2 (en) * 2003-09-15 2014-10-21 Ab Initio Technology Llc Data profiling
JP4551096B2 (ja) * 2004-02-03 2010-09-22 株式会社日立製作所 ストレージサブシステム
US7877350B2 (en) 2005-06-27 2011-01-25 Ab Initio Technology Llc Managing metadata for graph-based computations
JP2007065718A (ja) * 2005-08-29 2007-03-15 Hitachi Software Eng Co Ltd プログラム動作過程追跡支援表示方法及びシステム
JP2009038123A (ja) 2007-07-31 2009-02-19 Fujifilm Corp 画像検出装置
US9424266B2 (en) * 2007-10-01 2016-08-23 Microsoft Technology Licensing, Llc Efficient file hash identifier computation
KR101755365B1 (ko) * 2009-11-13 2017-07-10 아브 이니티오 테크놀로지 엘엘시 레코드 포맷 정보의 관리
EP2348416A1 (en) * 2010-01-21 2011-07-27 Software AG Analysis system and method for analyzing continuous queries for data streams
KR20150042872A (ko) * 2010-06-22 2015-04-21 아브 이니티오 테크놀로지 엘엘시 관련 데이터세트의 처리
FR2967275B1 (fr) * 2010-11-10 2012-12-28 Oberthur Technologies Procede, programme d'ordinateur et dispositif de securisation de code intermediaire de programmation pour son execution par une machine virtuelle
US9460277B2 (en) 2010-12-06 2016-10-04 International Business Machines Corporation Identity based auditing in a multi-product environment
US8972952B2 (en) * 2012-02-03 2015-03-03 Apple Inc. Tracer based runtime optimization for dynamic programming languages
US9674249B1 (en) * 2013-03-11 2017-06-06 DataTorrent, Inc. Distributed streaming platform for real-time applications
CN103279840B (zh) * 2013-06-08 2017-02-08 北京首钢自动化信息技术有限公司 基于动态语言与事件处理机制的工作流引擎实现方法
WO2015020811A1 (en) * 2013-08-09 2015-02-12 Fusion-Io, Inc. Persistent data structures
CN106796513B (zh) 2014-07-18 2020-12-11 起元科技有限公司 管理沿袭信息
US20180101609A1 (en) * 2015-05-08 2018-04-12 Telefonaktiebolaget Lm Ericsson (Publ) Pattern-based Data Collection for a Distributed Stream Data Processing System
US9697018B2 (en) * 2015-05-29 2017-07-04 International Business Machines Corporation Synthesizing inputs to preserve functionality
CN105159818B (zh) * 2015-08-28 2018-01-02 东北大学 内存数据管理中日志恢复方法及其仿真系统
US10769152B2 (en) * 2016-12-02 2020-09-08 Cisco Technology, Inc. Automated log analysis
US11055074B2 (en) 2017-11-13 2021-07-06 Ab Initio Technology Llc Key-based logging for processing of structured data items with executable logic

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011527052A (ja) 2008-06-30 2011-10-20 アビニシオ テクノロジー エルエルシー グラフベース計算におけるデータ記録
JP2013528884A (ja) 2010-06-15 2013-07-11 アビニシオ テクノロジー エルエルシー グラフに基づく計算の動的ロード
WO2016073746A1 (en) 2014-11-05 2016-05-12 Ab Initio Technology Llc Debugging a graph
JP2017199126A (ja) 2016-04-26 2017-11-02 株式会社日立製作所 ログ情報解析装置およびログ情報解析方法

Also Published As

Publication number Publication date
JP2022058555A (ja) 2022-04-12
JP2021502658A (ja) 2021-01-28
CA3082454A1 (en) 2019-05-16
EP3710969B1 (en) 2022-10-12
DE112018005452T5 (de) 2020-08-06
CN111837121B (zh) 2021-12-31
EP3710969A1 (en) 2020-09-23
JP7254975B2 (ja) 2023-04-10
AU2018365176B2 (en) 2023-12-07
SG11202003758RA (en) 2020-05-28
CN114416684A (zh) 2022-04-29
CN114416684B (zh) 2025-03-14
AU2018365176A1 (en) 2020-05-14
US20210263717A1 (en) 2021-08-26
US20190146763A1 (en) 2019-05-16
US12190083B2 (en) 2025-01-07
US11055074B2 (en) 2021-07-06
CN111837121A (zh) 2020-10-27
WO2019094905A1 (en) 2019-05-16

Similar Documents

Publication Publication Date Title
JP7009643B2 (ja) 実行可能論理を用いて構造化データアイテムを処理するためのキーベースのロギング
US12204593B2 (en) Data search and analysis for distributed data systems
CN113168362B (zh) 用于执行数据流图的数据处理系统、方法、机器可读硬件存储设备和程序产品
CN108171473A (zh) 一种数据分析处理系统及数据分析处理方法
Sfaxi et al. Babel: a generic benchmarking platform for Big Data architectures
CN118261703A (zh) 全链路交易视图构建方法、装置、电子设备及存储介质
Li Performance management of event processing systems
HK40027588B (en) Key-based logging for processing of structured data items with executable logic
HK40027588A (en) Key-based logging for processing of structured data items with executable logic

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211112

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211112

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20211112

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20211213

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220112

R150 Certificate of patent or registration of utility model

Ref document number: 7009643

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250