CN115176254B - 确保机器学习模型结果可以被审计的系统和方法 - Google Patents

确保机器学习模型结果可以被审计的系统和方法

Info

Publication number
CN115176254B
CN115176254B CN202180015990.4A CN202180015990A CN115176254B CN 115176254 B CN115176254 B CN 115176254B CN 202180015990 A CN202180015990 A CN 202180015990A CN 115176254 B CN115176254 B CN 115176254B
Authority
CN
China
Prior art keywords
time series
data
values
state
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202180015990.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN115176254A (zh
Inventor
E·R·维瑟比
K·P·贝克劳斯基
G·C·王
K·C·格罗斯
A·奇斯提亚科娃
D·伽乌力克
刘振华
R·P·桑德吉尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corp filed Critical Oracle International Corp
Publication of CN115176254A publication Critical patent/CN115176254A/zh
Application granted granted Critical
Publication of CN115176254B publication Critical patent/CN115176254B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00—Testing or monitoring of control systems or parts thereof
    • G05B23/02—Electric testing or monitoring
    • G05B23/0205—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0218—Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
    • G05B23/0224—Process history based detection method, e.g. whereby history implies the availability of large amounts of data
    • G05B23/024—Quantitative history assessment, e.g. mathematical relationships between available data; Functions therefor; Principal component analysis [PCA]; Partial least square [PLS]; Statistical classifiers, e.g. Bayesian networks, linear regression or correlation analysis; Neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/20—Design optimisation, verification or simulation
    • G06F30/27—Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/10—Numerical modelling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Algebra (AREA)
  • Operations Research (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Probability & Statistics with Applications (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Automation & Control Theory (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Testing And Monitoring For Control Systems (AREA)
CN202180015990.4A 2020-03-23 2021-01-29 确保机器学习模型结果可以被审计的系统和方法 Active CN115176254B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/826,478 US11948051B2 (en) 2020-03-23 2020-03-23 System and method for ensuring that the results of machine learning models can be audited
US16/826,478 2020-03-23
PCT/US2021/015802 WO2021194631A1 (en) 2020-03-23 2021-01-29 System and method for ensuring that the results of machine learning models can be audited

Publications (2)

Publication Number Publication Date
CN115176254A CN115176254A (zh) 2022-10-11
CN115176254B true CN115176254B (zh) 2026-04-17

Family

ID=74672473

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180015990.4A Active CN115176254B (zh) 2020-03-23 2021-01-29 确保机器学习模型结果可以被审计的系统和方法

Country Status (5)

Country Link
US (2) US11948051B2 (https=)
EP (1) EP4128086B1 (https=)
JP (2) JP7644140B2 (https=)
CN (1) CN115176254B (https=)
WO (1) WO2021194631A1 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11948051B2 (en) * 2020-03-23 2024-04-02 Oracle International Corporation System and method for ensuring that the results of machine learning models can be audited
US20240012388A1 (en) * 2020-10-21 2024-01-11 Full Speed Automation, Inc. System and apparatus for optimizing the energy consumption of manufacturing equipment
US20220156574A1 (en) * 2020-11-19 2022-05-19 Kabushiki Kaisha Toshiba Methods and systems for remote training of a machine learning model
US20220261689A1 (en) * 2021-02-12 2022-08-18 Oracle International Corporation Off-duty-cycle-robust machine learning for anomaly detection in assets with random down times
CN113778284B (zh) * 2021-09-24 2024-06-04 北京字跳网络技术有限公司 审核信息显示方法、装置、设备和存储介质
US20230214555A1 (en) * 2021-12-30 2023-07-06 PassiveLogic, Inc. Simulation Training
CN116738143B (zh) * 2023-05-05 2026-02-10 北京云星宇交通科技股份有限公司 一种用于桥梁健康监测系统的智能监测采集站
CN116494816B (zh) * 2023-06-30 2023-09-15 江西驴宝宝通卡科技有限公司 充电桩的充电管理系统及其方法
TWI860054B (zh) * 2023-08-22 2024-10-21 國立清華大學 訓練機器學習模型的方法、裝置和電腦程式產品
US12519838B2 (en) 2024-05-13 2026-01-06 Florida Power & Light Company Substantiating a compliance standard with secondary evidence
CN121098201B (zh) * 2025-11-07 2026-03-27 中国科学院宁波材料技术与工程研究所 一种基于条件流匹配的电机控制参数数据生成方法
CN121256649B (zh) * 2025-12-03 2026-02-27 清华大学深圳国际研究生院 一种时间序列异常检测方法、电子设备及介质

Family Cites Families (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05161265A (ja) * 1991-11-28 1993-06-25 Toshiba Corp 電力系統監視装置
US7020802B2 (en) 2002-10-17 2006-03-28 Sun Microsystems, Inc. Method and apparatus for monitoring and recording computer system performance parameters
US7702485B2 (en) 2006-12-06 2010-04-20 Oracle America, Inc. Method and apparatus for predicting remaining useful life for a computer system
US7613580B2 (en) 2007-04-12 2009-11-03 Sun Microsystems, Inc. Method and apparatus for generating an EMI fingerprint for a computer system
US7613576B2 (en) 2007-04-12 2009-11-03 Sun Microsystems, Inc. Using EMI signals to facilitate proactive fault monitoring in computer systems
US7680624B2 (en) 2007-04-16 2010-03-16 Sun Microsystems, Inc. Method and apparatus for performing a real-time root-cause analysis by analyzing degrading telemetry signals
US8069490B2 (en) 2007-10-16 2011-11-29 Oracle America, Inc. Detecting counterfeit electronic components using EMI telemetric fingerprints
US8055594B2 (en) 2007-11-13 2011-11-08 Oracle America, Inc. Proactive detection of metal whiskers in computer systems
US8200991B2 (en) 2008-05-09 2012-06-12 Oracle America, Inc. Generating a PWM load profile for a computer system
US8457913B2 (en) 2008-06-04 2013-06-04 Oracle America, Inc. Computer system with integrated electromagnetic-interference detectors
US20100023282A1 (en) 2008-07-22 2010-01-28 Sun Microsystem, Inc. Characterizing a computer system using radiating electromagnetic signals monitored through an interface
US7869977B2 (en) 2008-08-08 2011-01-11 Oracle America, Inc. Using multiple antennas to characterize a computer system based on electromagnetic signals
US9152530B2 (en) * 2009-05-14 2015-10-06 Oracle America, Inc. Telemetry data analysis using multivariate sequential probability ratio test
US8275738B2 (en) 2009-05-27 2012-09-25 Oracle America, Inc. Radio frequency microscope for amplifying and analyzing electromagnetic signals by positioning the monitored system at a locus of an ellipsoidal surface
US8543346B2 (en) 2009-05-29 2013-09-24 Oracle America, Inc. Near-isotropic antenna for monitoring electromagnetic signals
US10475754B2 (en) 2011-03-02 2019-11-12 Nokomis, Inc. System and method for physically detecting counterfeit electronics
EP2790604B1 (en) 2011-12-13 2022-10-19 Koninklijke Philips N.V. Distortion fingerprinting for electromagnetic tracking compensation, detection and error correction
US8548497B2 (en) 2011-12-16 2013-10-01 Microsoft Corporation Indoor localization using commercial frequency-modulated signals
US9851386B2 (en) 2012-03-02 2017-12-26 Nokomis, Inc. Method and apparatus for detection and identification of counterfeit and substandard electronics
US9305073B1 (en) 2012-05-24 2016-04-05 Luminix, Inc. Systems and methods for facilitation communications among customer relationship management users
JP5530020B1 (ja) 2013-11-01 2014-06-25 株式会社日立パワーソリューションズ 異常診断システム及び異常診断方法
US10395032B2 (en) 2014-10-03 2019-08-27 Nokomis, Inc. Detection of malicious software, firmware, IP cores and circuitry via unintended emissions
US9594147B2 (en) 2014-10-03 2017-03-14 Apple Inc. Wireless electronic device with calibrated reflectometer
JP7064333B2 (ja) * 2015-03-23 2022-05-10 オラクル・インターナショナル・コーポレイション 知識集約型データ処理システム
US10116675B2 (en) 2015-12-08 2018-10-30 Vmware, Inc. Methods and systems to detect anomalies in computer system behavior based on log-file sampling
US10331802B2 (en) * 2016-02-29 2019-06-25 Oracle International Corporation System for detecting and characterizing seasons
US10859609B2 (en) 2016-07-06 2020-12-08 Power Fingerprinting Inc. Methods and apparatuses for characteristic management with side-channel signature analysis
US10234492B2 (en) 2016-08-31 2019-03-19 Ca, Inc. Data center monitoring based on electromagnetic wave detection
JP6715740B2 (ja) 2016-10-13 2020-07-01 株式会社日立製作所 電力系統の潮流監視装置、電力系統安定化装置および電力系統の潮流監視方法
WO2018101363A1 (ja) * 2016-11-30 2018-06-07 日本電気株式会社 状態推定装置と方法とプログラム
US11429885B1 (en) * 2016-12-21 2022-08-30 Cerner Innovation Computer-decision support for predicting and managing non-adherence to treatment
US10896064B2 (en) 2017-03-27 2021-01-19 International Business Machines Corporation Coordinated, topology-aware CPU-GPU-memory scheduling for containerized workloads
CN107181543B (zh) 2017-05-23 2020-10-27 张一嘉 一种基于传播模型和位置指纹的三维室内无源定位方法
US10817803B2 (en) 2017-06-02 2020-10-27 Oracle International Corporation Data driven methods and systems for what if analysis
US20190102718A1 (en) 2017-09-29 2019-04-04 Oracle International Corporation Techniques for automated signal and anomaly detection
US10452510B2 (en) 2017-10-25 2019-10-22 Oracle International Corporation Hybrid clustering-partitioning techniques that optimizes accuracy and compute cost for prognostic surveillance of sensor data
US10606919B2 (en) 2017-11-29 2020-03-31 Oracle International Corporation Bivariate optimization technique for tuning SPRT parameters to facilitate prognostic surveillance of sensor data from power plants
US10565185B2 (en) 2017-12-21 2020-02-18 Oracle International Corporation MSET-based process for certifying provenance of time-series data in a time-series database
JP2019117428A (ja) * 2017-12-26 2019-07-18 株式会社クボタ 管理サーバ、監視端末、管理サーバの制御方法、および制御プログラム
US10977110B2 (en) 2017-12-27 2021-04-13 Palo Alto Research Center Incorporated System and method for facilitating prediction data for device based on synthetic data with uncertainties
US11392850B2 (en) 2018-02-02 2022-07-19 Oracle International Corporation Synthesizing high-fidelity time-series sensor signals to facilitate machine-learning innovations
US10740310B2 (en) 2018-03-19 2020-08-11 Oracle International Corporation Intelligent preprocessing of multi-dimensional time-series data
US10496084B2 (en) 2018-04-06 2019-12-03 Oracle International Corporation Dequantizing low-resolution IoT signals to produce high-accuracy prognostic indicators
JP7021010B2 (ja) * 2018-06-06 2022-02-16 株式会社Ｎｔｔドコモ 機械学習システム
US11775873B2 (en) 2018-06-11 2023-10-03 Oracle International Corporation Missing value imputation technique to facilitate prognostic analysis of time-series sensor data
US11188691B2 (en) 2018-12-21 2021-11-30 Utopus Insights, Inc. Scalable system and method for forecasting wind turbine failure using SCADA alarm and event logs
US11409992B2 (en) 2019-06-10 2022-08-09 International Business Machines Corporation Data slicing for machine learning performance testing and improvement
US11055396B2 (en) 2019-07-09 2021-07-06 Oracle International Corporation Detecting unwanted components in a critical asset based on EMI fingerprints generated with a sinusoidal load
US20210081573A1 (en) 2019-09-16 2021-03-18 Oracle International Corporation Merged surface fast scan technique for generating a reference emi fingerprint to detect unwanted components in electronic systems
US11797882B2 (en) 2019-11-21 2023-10-24 Oracle International Corporation Prognostic-surveillance technique that dynamically adapts to evolving characteristics of a monitored asset
US11367018B2 (en) 2019-12-04 2022-06-21 Oracle International Corporation Autonomous cloud-node scoping framework for big-data machine learning use cases
CN110941020B (zh) 2019-12-16 2022-06-10 杭州安恒信息技术股份有限公司 基于电磁泄漏的盗摄器材的检测方法及装置
US11255894B2 (en) 2020-02-28 2022-02-22 Oracle International Corporation High sensitivity detection and identification of counterfeit components in utility power systems via EMI frequency kiviat tubes
US11948051B2 (en) * 2020-03-23 2024-04-02 Oracle International Corporation System and method for ensuring that the results of machine learning models can be audited

Also Published As

Publication number Publication date
US20240265308A1 (en) 2024-08-08
EP4128086B1 (en) 2025-12-24
US12367423B2 (en) 2025-07-22
JP2025098009A (ja) 2025-07-01
US11948051B2 (en) 2024-04-02
WO2021194631A1 (en) 2021-09-30
JP2023518866A (ja) 2023-05-08
JP7644140B2 (ja) 2025-03-11
EP4128086A1 (en) 2023-02-08
US20210295210A1 (en) 2021-09-23
CN115176254A (zh) 2022-10-11

Similar Documents

Publication Publication Date Title
CN115176254B (zh) 确保机器学习模型结果可以被审计的系统和方法
CN111712813B (zh) 多维时间序列数据的智能预处理
EP4396714B1 (en) Passive inferencing of signal following in multivariate anomaly detection
CN120672510B (zh) 基于智能分级的电力数据安全合规管理方法及系统
CN119806984A (zh) 一种用户异常行为的监测方法、装置、设备、介质及产品
CN119940715A (zh) 智能会计数据管理与合规系统及方法
CN120429162A (zh) 食品安全抽检数据校验方法、系统及其计算机存储介质
CN120956529A (zh) 基于行为序列分析的安全防御方法、系统及设备
CN120086293A (zh) 一种基于计算机大数据信息采集系统
WO2025096101A1 (en) Systems and methods for aggregating and mapping incident characteristics into daily incident profiles
WO2025096601A1 (en) Systems and methods for aggregating and generating a single incident profile
CN118628289A (zh) 基于nlp的全站保护定值管理方法及系统
US20250086219A1 (en) Systems and methods for identifying alert characteristics from early sequencing
US20260037560A1 (en) Systems and methods of incident resolution using chunking, vector embedding, and clustering techniques
US20260037533A1 (en) Systems and methods for determining historically similar incidents using multivariate embeddings
US20250138972A1 (en) Systems and methods for aggregating and generating a daily incident profile
US20250291900A1 (en) Systems and methods for anomaly detection in network devices
Shi et al. TransEdge: a lightweight transformer-based anomaly detection framework for edge devices
Valente Data quality and dependability of IOT Platform for buildings energy assessment
CN121681507A (zh) 一种面向核电行业的多层级数据清洗方法
CN121881188A (zh) 基于深度学习的信息风险动态评估系统
CN121981493A (en) Hydropower data safety management and compliance circulation method based on hierarchical classification
CN121125456A (zh) 一种基于ai技术的数据容灾验证方法及系统
CN120768532A (zh) 用于延保服务的数据存储管理方法及平台
CN117057711A (zh) 网点运营状态监控方法、装置、设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant