JP7644140B2 - 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法 - Google Patents

機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法 Download PDF

Info

Publication number
JP7644140B2
JP7644140B2 JP2022557900A JP2022557900A JP7644140B2 JP 7644140 B2 JP7644140 B2 JP 7644140B2 JP 2022557900 A JP2022557900 A JP 2022557900A JP 2022557900 A JP2022557900 A JP 2022557900A JP 7644140 B2 JP7644140 B2 JP 7644140B2
Authority
JP
Japan
Prior art keywords
time series
data
values
original
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022557900A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023518866A5 (https=
JP2023518866A (ja
Inventor
ウェザービー，エドワード・アール
バクラフスキー，ケネス・ピィ
ワン，グアン・シィ
グロス，ケニー・シィ
チスティアコバ，アンナ
ガウリック，ディーター
リウ，ジェン・フア
ソンデレッガー，リチャード・ポール
Original Assignee
オラクル・インターナショナル・コーポレイション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オラクル・インターナショナル・コーポレイション filed Critical オラクル・インターナショナル・コーポレイション
Publication of JP2023518866A publication Critical patent/JP2023518866A/ja
Publication of JP2023518866A5 publication Critical patent/JP2023518866A5/ja
Priority to JP2025029274A priority Critical patent/JP2025098009A/ja
Application granted granted Critical
Publication of JP7644140B2 publication Critical patent/JP7644140B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00—Testing or monitoring of control systems or parts thereof
    • G05B23/02—Electric testing or monitoring
    • G05B23/0205—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0218—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
    • G05B23/0224—Process history based detection method, e.g. whereby history implies the availability of large amounts of data
    • G05B23/024—Quantitative history assessment, e.g. mathematical relationships between available data; Functions therefor; Principal component analysis [PCA]; Partial least square [PLS]; Statistical classifiers, e.g. Bayesian networks, linear regression or correlation analysis; Neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/20—Design optimisation, verification or simulation
    • G06F30/27—Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/10—Numerical modelling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Algebra (AREA)
  • Operations Research (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Probability & Statistics with Applications (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Automation & Control Theory (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Testing And Monitoring For Control Systems (AREA)
JP2022557900A 2020-03-23 2021-01-29 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法 Active JP7644140B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025029274A JP2025098009A (ja) 2020-03-23 2025-02-26 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/826,478 US11948051B2 (en) 2020-03-23 2020-03-23 System and method for ensuring that the results of machine learning models can be audited
US16/826,478 2020-03-23
PCT/US2021/015802 WO2021194631A1 (en) 2020-03-23 2021-01-29 System and method for ensuring that the results of machine learning models can be audited

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025029274A Division JP2025098009A (ja) 2020-03-23 2025-02-26 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法

Publications (3)

Publication Number Publication Date
JP2023518866A JP2023518866A (ja) 2023-05-08
JP2023518866A5 JP2023518866A5 (https=) 2023-12-19
JP7644140B2 true JP7644140B2 (ja) 2025-03-11

Family

ID=74672473

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022557900A Active JP7644140B2 (ja) 2020-03-23 2021-01-29 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法
JP2025029274A Pending JP2025098009A (ja) 2020-03-23 2025-02-26 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025029274A Pending JP2025098009A (ja) 2020-03-23 2025-02-26 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法

Country Status (5)

Country Link
US (2) US11948051B2 (https=)
EP (1) EP4128086B1 (https=)
JP (2) JP7644140B2 (https=)
CN (1) CN115176254B (https=)
WO (1) WO2021194631A1 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11948051B2 (en) * 2020-03-23 2024-04-02 Oracle International Corporation System and method for ensuring that the results of machine learning models can be audited
US20240012388A1 (en) * 2020-10-21 2024-01-11 Full Speed Automation, Inc. System and apparatus for optimizing the energy consumption of manufacturing equipment
US20220156574A1 (en) * 2020-11-19 2022-05-19 Kabushiki Kaisha Toshiba Methods and systems for remote training of a machine learning model
US20220261689A1 (en) * 2021-02-12 2022-08-18 Oracle International Corporation Off-duty-cycle-robust machine learning for anomaly detection in assets with random down times
CN113778284B (zh) * 2021-09-24 2024-06-04 北京字跳网络技术有限公司 审核信息显示方法、装置、设备和存储介质
US20230214555A1 (en) * 2021-12-30 2023-07-06 PassiveLogic, Inc. Simulation Training
CN116738143B (zh) * 2023-05-05 2026-02-10 北京云星宇交通科技股份有限公司 一种用于桥梁健康监测系统的智能监测采集站
CN116494816B (zh) * 2023-06-30 2023-09-15 江西驴宝宝通卡科技有限公司 充电桩的充电管理系统及其方法
TWI860054B (zh) * 2023-08-22 2024-10-21 國立清華大學 訓練機器學習模型的方法、裝置和電腦程式產品
US12519838B2 (en) 2024-05-13 2026-01-06 Florida Power & Light Company Substantiating a compliance standard with secondary evidence
CN121098201B (zh) * 2025-11-07 2026-03-27 中国科学院宁波材料技术与工程研究所 一种基于条件流匹配的电机控制参数数据生成方法
CN121256649B (zh) * 2025-12-03 2026-02-27 清华大学深圳国际研究生院 一种时间序列异常检测方法、电子设备及介质

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190197145A1 (en) 2017-12-21 2019-06-27 Oracle International Corporation Mset-based process for certifying provenance of time-series data in a time-series database
US20190286725A1 (en) 2018-03-19 2019-09-19 Oracle International Corporation Intelligent preprocessing of multi-dimensional time-series data

Family Cites Families (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05161265A (ja) * 1991-11-28 1993-06-25 Toshiba Corp 電力系統監視装置
US7020802B2 (en) 2002-10-17 2006-03-28 Sun Microsystems, Inc. Method and apparatus for monitoring and recording computer system performance parameters
US7702485B2 (en) 2006-12-06 2010-04-20 Oracle America, Inc. Method and apparatus for predicting remaining useful life for a computer system
US7613580B2 (en) 2007-04-12 2009-11-03 Sun Microsystems, Inc. Method and apparatus for generating an EMI fingerprint for a computer system
US7613576B2 (en) 2007-04-12 2009-11-03 Sun Microsystems, Inc. Using EMI signals to facilitate proactive fault monitoring in computer systems
US7680624B2 (en) 2007-04-16 2010-03-16 Sun Microsystems, Inc. Method and apparatus for performing a real-time root-cause analysis by analyzing degrading telemetry signals
US8069490B2 (en) 2007-10-16 2011-11-29 Oracle America, Inc. Detecting counterfeit electronic components using EMI telemetric fingerprints
US8055594B2 (en) 2007-11-13 2011-11-08 Oracle America, Inc. Proactive detection of metal whiskers in computer systems
US8200991B2 (en) 2008-05-09 2012-06-12 Oracle America, Inc. Generating a PWM load profile for a computer system
US8457913B2 (en) 2008-06-04 2013-06-04 Oracle America, Inc. Computer system with integrated electromagnetic-interference detectors
US20100023282A1 (en) 2008-07-22 2010-01-28 Sun Microsystem, Inc. Characterizing a computer system using radiating electromagnetic signals monitored through an interface
US7869977B2 (en) 2008-08-08 2011-01-11 Oracle America, Inc. Using multiple antennas to characterize a computer system based on electromagnetic signals
US9152530B2 (en) * 2009-05-14 2015-10-06 Oracle America, Inc. Telemetry data analysis using multivariate sequential probability ratio test
US8275738B2 (en) 2009-05-27 2012-09-25 Oracle America, Inc. Radio frequency microscope for amplifying and analyzing electromagnetic signals by positioning the monitored system at a locus of an ellipsoidal surface
US8543346B2 (en) 2009-05-29 2013-09-24 Oracle America, Inc. Near-isotropic antenna for monitoring electromagnetic signals
US10475754B2 (en) 2011-03-02 2019-11-12 Nokomis, Inc. System and method for physically detecting counterfeit electronics
EP2790604B1 (en) 2011-12-13 2022-10-19 Koninklijke Philips N.V. Distortion fingerprinting for electromagnetic tracking compensation, detection and error correction
US8548497B2 (en) 2011-12-16 2013-10-01 Microsoft Corporation Indoor localization using commercial frequency-modulated signals
US9851386B2 (en) 2012-03-02 2017-12-26 Nokomis, Inc. Method and apparatus for detection and identification of counterfeit and substandard electronics
US9305073B1 (en) 2012-05-24 2016-04-05 Luminix, Inc. Systems and methods for facilitation communications among customer relationship management users
JP5530020B1 (ja) 2013-11-01 2014-06-25 株式会社日立パワーソリューションズ 異常診断システム及び異常診断方法
US10395032B2 (en) 2014-10-03 2019-08-27 Nokomis, Inc. Detection of malicious software, firmware, IP cores and circuitry via unintended emissions
US9594147B2 (en) 2014-10-03 2017-03-14 Apple Inc. Wireless electronic device with calibrated reflectometer
JP7064333B2 (ja) * 2015-03-23 2022-05-10 オラクル・インターナショナル・コーポレイション 知識集約型データ処理システム
US10116675B2 (en) 2015-12-08 2018-10-30 Vmware, Inc. Methods and systems to detect anomalies in computer system behavior based on log-file sampling
US10331802B2 (en) * 2016-02-29 2019-06-25 Oracle International Corporation System for detecting and characterizing seasons
US10859609B2 (en) 2016-07-06 2020-12-08 Power Fingerprinting Inc. Methods and apparatuses for characteristic management with side-channel signature analysis
US10234492B2 (en) 2016-08-31 2019-03-19 Ca, Inc. Data center monitoring based on electromagnetic wave detection
JP6715740B2 (ja) 2016-10-13 2020-07-01 株式会社日立製作所 電力系統の潮流監視装置、電力系統安定化装置および電力系統の潮流監視方法
WO2018101363A1 (ja) * 2016-11-30 2018-06-07 日本電気株式会社 状態推定装置と方法とプログラム
US11429885B1 (en) * 2016-12-21 2022-08-30 Cerner Innovation Computer-decision support for predicting and managing non-adherence to treatment
US10896064B2 (en) 2017-03-27 2021-01-19 International Business Machines Corporation Coordinated, topology-aware CPU-GPU-memory scheduling for containerized workloads
CN107181543B (zh) 2017-05-23 2020-10-27 张一嘉 一种基于传播模型和位置指纹的三维室内无源定位方法
US10817803B2 (en) 2017-06-02 2020-10-27 Oracle International Corporation Data driven methods and systems for what if analysis
US20190102718A1 (en) 2017-09-29 2019-04-04 Oracle International Corporation Techniques for automated signal and anomaly detection
US10452510B2 (en) 2017-10-25 2019-10-22 Oracle International Corporation Hybrid clustering-partitioning techniques that optimizes accuracy and compute cost for prognostic surveillance of sensor data
US10606919B2 (en) 2017-11-29 2020-03-31 Oracle International Corporation Bivariate optimization technique for tuning SPRT parameters to facilitate prognostic surveillance of sensor data from power plants
JP2019117428A (ja) * 2017-12-26 2019-07-18 株式会社クボタ 管理サーバ、監視端末、管理サーバの制御方法、および制御プログラム
US10977110B2 (en) 2017-12-27 2021-04-13 Palo Alto Research Center Incorporated System and method for facilitating prediction data for device based on synthetic data with uncertainties
US11392850B2 (en) 2018-02-02 2022-07-19 Oracle International Corporation Synthesizing high-fidelity time-series sensor signals to facilitate machine-learning innovations
US10496084B2 (en) 2018-04-06 2019-12-03 Oracle International Corporation Dequantizing low-resolution IoT signals to produce high-accuracy prognostic indicators
JP7021010B2 (ja) * 2018-06-06 2022-02-16 株式会社Ｎｔｔドコモ 機械学習システム
US11775873B2 (en) 2018-06-11 2023-10-03 Oracle International Corporation Missing value imputation technique to facilitate prognostic analysis of time-series sensor data
US11188691B2 (en) 2018-12-21 2021-11-30 Utopus Insights, Inc. Scalable system and method for forecasting wind turbine failure using SCADA alarm and event logs
US11409992B2 (en) 2019-06-10 2022-08-09 International Business Machines Corporation Data slicing for machine learning performance testing and improvement
US11055396B2 (en) 2019-07-09 2021-07-06 Oracle International Corporation Detecting unwanted components in a critical asset based on EMI fingerprints generated with a sinusoidal load
US20210081573A1 (en) 2019-09-16 2021-03-18 Oracle International Corporation Merged surface fast scan technique for generating a reference emi fingerprint to detect unwanted components in electronic systems
US11797882B2 (en) 2019-11-21 2023-10-24 Oracle International Corporation Prognostic-surveillance technique that dynamically adapts to evolving characteristics of a monitored asset
US11367018B2 (en) 2019-12-04 2022-06-21 Oracle International Corporation Autonomous cloud-node scoping framework for big-data machine learning use cases
CN110941020B (zh) 2019-12-16 2022-06-10 杭州安恒信息技术股份有限公司 基于电磁泄漏的盗摄器材的检测方法及装置
US11255894B2 (en) 2020-02-28 2022-02-22 Oracle International Corporation High sensitivity detection and identification of counterfeit components in utility power systems via EMI frequency kiviat tubes
US11948051B2 (en) * 2020-03-23 2024-04-02 Oracle International Corporation System and method for ensuring that the results of machine learning models can be audited

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190197145A1 (en) 2017-12-21 2019-06-27 Oracle International Corporation Mset-based process for certifying provenance of time-series data in a time-series database
US20190286725A1 (en) 2018-03-19 2019-09-19 Oracle International Corporation Intelligent preprocessing of multi-dimensional time-series data

Also Published As

Publication number Publication date
US20240265308A1 (en) 2024-08-08
EP4128086B1 (en) 2025-12-24
US12367423B2 (en) 2025-07-22
JP2025098009A (ja) 2025-07-01
US11948051B2 (en) 2024-04-02
WO2021194631A1 (en) 2021-09-30
JP2023518866A (ja) 2023-05-08
EP4128086A1 (en) 2023-02-08
US20210295210A1 (en) 2021-09-23
CN115176254B (zh) 2026-04-17
CN115176254A (zh) 2022-10-11

Similar Documents

Publication Publication Date Title
JP7644140B2 (ja) 機械学習モデルの結果を確実に監査できるようにするためのシステムおよび方法
Wang et al. Variational transformer-based anomaly detection approach for multivariate time series
US11558272B2 (en) Methods and systems for predicting time of server failure using server logs and time-series data
CN111712813B (zh) 多维时间序列数据的智能预处理
EP4396714B1 (en) Passive inferencing of signal following in multivariate anomaly detection
CN120672510B (zh) 基于智能分级的电力数据安全合规管理方法及系统
CN119692980B (zh) 一种基于大数据的光伏电站运维管理系统及方法
CN119917967A (zh) 多维时间序列异常检测方法、装置、电子设备、存储介质及程序产品
CN120145286B (zh) 异常数据识别方法、装置、设备及存储介质
CN120162716A (zh) 基于多维特征的硬盘异常检测方法、装置、介质及设备
WO2025096601A1 (en) Systems and methods for aggregating and generating a single incident profile
US20250138970A1 (en) Systems and methods for aggregating and mapping incident characteristics into daily incident profiling
CN120197126A (zh) 电能计量设备接线关系的异常检测方法、装置和设备
CN118628289A (zh) 基于nlp的全站保护定值管理方法及系统
Wardana et al. Leads: A deep learning approach to revolutionizing gas plant maintenance with advanced anomaly detection technology
John Predictive Maintenance in Service Operations Through Multi-Dimensional Sensor and Usage Data
US20250291900A1 (en) Systems and methods for anomaly detection in network devices
US20250138972A1 (en) Systems and methods for aggregating and generating a daily incident profile
US20260037560A1 (en) Systems and methods of incident resolution using chunking, vector embedding, and clustering techniques
Shi et al. TransEdge: a lightweight transformer-based anomaly detection framework for edge devices
Han et al. Logistics equipment condition monitoring and prediction based on digital twin and machine learning: F. Han et al.
WO2026029831A1 (en) Systems and methods for determining historically similar incidents using multivariate embeddings
Valente Data quality and dependability of IOT Platform for buildings energy assessment
CN120354259A (zh) 一种计算机用服务器故障预警系统及方法
CN119249412A (zh) 智能量测终端的应用程序敏感行为识别方法、装置和设备

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231211

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20231211

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20241001

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241119

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250128

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250227

R150 Certificate of patent or registration of utility model

Ref document number: 7644140

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150