CN114416684B - 识别可执行逻辑的部分的方法、硬件存储设备和计算系统 - Google Patents

识别可执行逻辑的部分的方法、硬件存储设备和计算系统 Download PDF

Info

Publication number
CN114416684B
CN114416684B CN202111522670.6A CN202111522670A CN114416684B CN 114416684 B CN114416684 B CN 114416684B CN 202111522670 A CN202111522670 A CN 202111522670A CN 114416684 B CN114416684 B CN 114416684B
Authority
CN
China
Prior art keywords
data
key
executable logic
state
portions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111522670.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN114416684A (zh
Inventor
乔尔·古尔德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ab Initio Technology LLC
Original Assignee
Ab Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology LLC filed Critical Ab Initio Technology LLC
Publication of CN114416684A publication Critical patent/CN114416684A/zh
Application granted granted Critical
Publication of CN114416684B publication Critical patent/CN114416684B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815—Journaling file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/40—Transformation of program code
    • G06F8/41—Compilation
    • G06F8/43—Checking; Contextual analysis
    • G06F8/433—Dependency analysis; Data or control flow analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3476—Data logging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/116—Details of conversion of file system types or formats
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/285—Clustering or classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55—Detecting local intrusion or implementing counter-measures
    • G06F21/552—Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/34—Graphical or visual programming
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/865—Monitoring of software

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN202111522670.6A 2017-11-13 2018-11-13 识别可执行逻辑的部分的方法、硬件存储设备和计算系统 Active CN114416684B (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201762585362P 2017-11-13 2017-11-13
US62/585,362 2017-11-13
US15/853,000 2017-12-22
US15/853,000 US11055074B2 (en) 2017-11-13 2017-12-22 Key-based logging for processing of structured data items with executable logic
CN201880081094.6A CN111837121B (zh) 2017-11-13 2018-11-13 利用可执行逻辑来处理结构化数据项的基于键的日志记录
PCT/US2018/060670 WO2019094905A1 (en) 2017-11-13 2018-11-13 Key-based logging for processing of structured data items with executable logic

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201880081094.6A Division CN111837121B (zh) 2017-11-13 2018-11-13 利用可执行逻辑来处理结构化数据项的基于键的日志记录

Publications (2)

Publication Number Publication Date
CN114416684A CN114416684A (zh) 2022-04-29
CN114416684B true CN114416684B (zh) 2025-03-14

Family

ID=66433293

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202111522670.6A Active CN114416684B (zh) 2017-11-13 2018-11-13 识别可执行逻辑的部分的方法、硬件存储设备和计算系统
CN201880081094.6A Active CN111837121B (zh) 2017-11-13 2018-11-13 利用可执行逻辑来处理结构化数据项的基于键的日志记录

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201880081094.6A Active CN111837121B (zh) 2017-11-13 2018-11-13 利用可执行逻辑来处理结构化数据项的基于键的日志记录

Country Status (9)

Country Link
US (2) US11055074B2 (https=)
EP (1) EP3710969B1 (https=)
JP (2) JP7009643B2 (https=)
CN (2) CN114416684B (https=)
AU (1) AU2018365176B2 (https=)
CA (1) CA3082454A1 (https=)
DE (1) DE112018005452T5 (https=)
SG (1) SG11202003758RA (https=)
WO (1) WO2019094905A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11449495B2 (en) * 2017-02-01 2022-09-20 United Parcel Service Of America, Inc. Indexable database profiles comprising multi-language encoding data and methods for generating the same
US11055074B2 (en) 2017-11-13 2021-07-06 Ab Initio Technology Llc Key-based logging for processing of structured data items with executable logic
WO2020068927A2 (en) 2018-09-25 2020-04-02 Ab Initio Technology Llc A dedicated audit port for implementing recoverability in outputting audit data
US11036700B2 (en) * 2018-12-31 2021-06-15 Microsoft Technology Licensing, Llc Automatic feature generation for machine learning in data-anomaly detection
US11308092B2 (en) * 2019-06-11 2022-04-19 Microsoft Technology Licensing, Llc Stream processing diagnostics
US11531611B2 (en) * 2019-07-29 2022-12-20 Ncr Corporation Auditing-as-a-service
EP4133681A4 (en) 2020-05-28 2023-10-04 Sumo Logic, Inc. Clustering of structured log data by key schema
CN112286895B (zh) * 2020-10-30 2024-11-22 北京深演智能科技股份有限公司 日志实时归因处理方法、装置和平台
US12333283B2 (en) * 2022-03-31 2025-06-17 SambaNova Systems, Inc. Iterative compilation to optimize translation in reconfigurable dataflow architectures
WO2024044041A1 (en) * 2022-08-23 2024-02-29 Ab Initio Technology Llc Operationalizing metadata

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101809566A (zh) * 2007-10-01 2010-08-18 微软公司 高效的文件散列标识符计算
CN105159818A (zh) * 2015-08-28 2015-12-16 东北大学 内存数据管理中日志恢复方法及其仿真系统

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5966072A (en) 1996-07-02 1999-10-12 Ab Initio Software Corporation Executing computations expressed as graphs
US7266764B1 (en) * 2000-08-16 2007-09-04 Sparta Systems, Inc. Graphical user interface for automated process control
US6748583B2 (en) 2000-12-27 2004-06-08 International Business Machines Corporation Monitoring execution of an hierarchical visual program such as for debugging a message flow
US20050144189A1 (en) * 2002-07-19 2005-06-30 Keay Edwards Electronic item management and archival system and method of operating the same
US7308675B2 (en) * 2003-08-28 2007-12-11 Ricoh Company, Ltd. Data structure used for directory structure navigation in a skeleton code creation tool
US8868580B2 (en) * 2003-09-15 2014-10-21 Ab Initio Technology Llc Data profiling
JP4551096B2 (ja) * 2004-02-03 2010-09-22 株式会社日立製作所 ストレージサブシステム
US7877350B2 (en) 2005-06-27 2011-01-25 Ab Initio Technology Llc Managing metadata for graph-based computations
JP2007065718A (ja) * 2005-08-29 2007-03-15 Hitachi Software Eng Co Ltd プログラム動作過程追跡支援表示方法及びシステム
JP2009038123A (ja) 2007-07-31 2009-02-19 Fujifilm Corp 画像検出装置
WO2010002919A1 (en) * 2008-06-30 2010-01-07 Ab Initio Software Llc Data logging in graph-based computations
KR101755365B1 (ko) * 2009-11-13 2017-07-10 아브 이니티오 테크놀로지 엘엘시 레코드 포맷 정보의 관리
EP2348416A1 (en) * 2010-01-21 2011-07-27 Software AG Analysis system and method for analyzing continuous queries for data streams
KR101687213B1 (ko) 2010-06-15 2016-12-16 아브 이니티오 테크놀로지 엘엘시 동적으로 로딩하는 그래프 기반 계산
KR20150042872A (ko) * 2010-06-22 2015-04-21 아브 이니티오 테크놀로지 엘엘시 관련 데이터세트의 처리
FR2967275B1 (fr) * 2010-11-10 2012-12-28 Oberthur Technologies Procede, programme d'ordinateur et dispositif de securisation de code intermediaire de programmation pour son execution par une machine virtuelle
US9460277B2 (en) 2010-12-06 2016-10-04 International Business Machines Corporation Identity based auditing in a multi-product environment
US8972952B2 (en) * 2012-02-03 2015-03-03 Apple Inc. Tracer based runtime optimization for dynamic programming languages
US9674249B1 (en) * 2013-03-11 2017-06-06 DataTorrent, Inc. Distributed streaming platform for real-time applications
CN103279840B (zh) * 2013-06-08 2017-02-08 北京首钢自动化信息技术有限公司 基于动态语言与事件处理机制的工作流引擎实现方法
WO2015020811A1 (en) * 2013-08-09 2015-02-12 Fusion-Io, Inc. Persistent data structures
CN106796513B (zh) 2014-07-18 2020-12-11 起元科技有限公司 管理沿袭信息
US10055333B2 (en) * 2014-11-05 2018-08-21 Ab Initio Technology Llc Debugging a graph
US20180101609A1 (en) * 2015-05-08 2018-04-12 Telefonaktiebolaget Lm Ericsson (Publ) Pattern-based Data Collection for a Distributed Stream Data Processing System
US9697018B2 (en) * 2015-05-29 2017-07-04 International Business Machines Corporation Synthesizing inputs to preserve functionality
JP6573572B2 (ja) * 2016-04-26 2019-09-11 株式会社日立製作所 ログ情報解析装置およびログ情報解析方法
US10769152B2 (en) * 2016-12-02 2020-09-08 Cisco Technology, Inc. Automated log analysis
US11055074B2 (en) 2017-11-13 2021-07-06 Ab Initio Technology Llc Key-based logging for processing of structured data items with executable logic

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101809566A (zh) * 2007-10-01 2010-08-18 微软公司 高效的文件散列标识符计算
CN105159818A (zh) * 2015-08-28 2015-12-16 东北大学 内存数据管理中日志恢复方法及其仿真系统

Also Published As

Publication number Publication date
JP2022058555A (ja) 2022-04-12
JP2021502658A (ja) 2021-01-28
CA3082454A1 (en) 2019-05-16
EP3710969B1 (en) 2022-10-12
DE112018005452T5 (de) 2020-08-06
CN111837121B (zh) 2021-12-31
EP3710969A1 (en) 2020-09-23
JP7254975B2 (ja) 2023-04-10
AU2018365176B2 (en) 2023-12-07
SG11202003758RA (en) 2020-05-28
CN114416684A (zh) 2022-04-29
AU2018365176A1 (en) 2020-05-14
JP7009643B2 (ja) 2022-01-25
US20210263717A1 (en) 2021-08-26
US20190146763A1 (en) 2019-05-16
US12190083B2 (en) 2025-01-07
US11055074B2 (en) 2021-07-06
CN111837121A (zh) 2020-10-27
WO2019094905A1 (en) 2019-05-16

Similar Documents

Publication Publication Date Title
CN114416684B (zh) 识别可执行逻辑的部分的方法、硬件存储设备和计算系统
US11392654B2 (en) Data fabric service system
US8447739B2 (en) Systems and methods to create continuous queries via a semantic layer
US9800675B2 (en) Methods for dynamically generating an application interface for a modeled entity and devices thereof
CA2864113C (en) Providing configurable workflow capabilities
CN113168362B (zh) 用于执行数据流图的数据处理系统、方法、机器可读硬件存储设备和程序产品
US20160063072A1 (en) Systems, methods, and apparatuses for detecting activity patterns
CN117555541B (zh) 数据页面展示方法、装置、设备及存储介质
US20140143278A1 (en) Application programming interface layers for analytical applications
US20230222099A1 (en) Policy driven event transformation
HK40027588B (en) Key-based logging for processing of structured data items with executable logic
HK40027588A (en) Key-based logging for processing of structured data items with executable logic
US20260056967A1 (en) System and method for operating an analytics platform
CN120705231A (zh) 数据处理方法及相关产品
Fattal Creation of an Analytics platform for an on-site eCommerce search engine
Pereira BAM framework for OMS using open source technologies

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant