CN113661498B - 用于已部署机器学习模型的置信度度量 - Google Patents

用于已部署机器学习模型的置信度度量

Info

Publication number
CN113661498B
CN113661498B CN202080027009.5A CN202080027009A CN113661498B CN 113661498 B CN113661498 B CN 113661498B CN 202080027009 A CN202080027009 A CN 202080027009A CN 113661498 B CN113661498 B CN 113661498B
Authority
CN
China
Prior art keywords
input data
machine learning
result
model
confidence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080027009.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN113661498A (zh
Inventor
M·伦加
R·威克
T·克林德
M·伯格托尔特
H·卡洛鲁斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN113661498A publication Critical patent/CN113661498A/zh
Application granted granted Critical
Publication of CN113661498B publication Critical patent/CN113661498B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/776—Validation; Performance evaluation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Analysis (AREA)
CN202080027009.5A 2019-02-01 2020-01-21 用于已部署机器学习模型的置信度度量 Active CN113661498B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP19154992.2 2019-02-01
EP19154992.2A EP3690739A1 (en) 2019-02-01 2019-02-01 Confidence measure for a deployed machine learning model
PCT/EP2020/051317 WO2020156864A1 (en) 2019-02-01 2020-01-21 Confidence measure for a deployed machine learning model

Publications (2)

Publication Number Publication Date
CN113661498A CN113661498A (zh) 2021-11-16
CN113661498B true CN113661498B (zh) 2025-11-18

Family

ID=65408873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080027009.5A Active CN113661498B (zh) 2019-02-01 2020-01-21 用于已部署机器学习模型的置信度度量

Country Status (5)

Country Link
US (1) US11880432B2 (https=)
EP (2) EP3690739A1 (https=)
JP (1) JP7479387B2 (https=)
CN (1) CN113661498B (https=)
WO (1) WO2020156864A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210264283A1 (en) * 2020-02-24 2021-08-26 International Business Machines Corporation Dataset creation for deep-learning model
US11775764B2 (en) * 2020-04-20 2023-10-03 International Business Machines Corporation Estimating output confidence for black-box API
EP4156093A4 (en) * 2020-06-30 2023-12-06 Sony Group Corporation Assessment support device, information processing device, and learning method
CN112115997B (zh) * 2020-09-11 2022-12-02 苏州浪潮智能科技有限公司 一种物体识别模型的训练方法、系统及装置
US12585506B2 (en) 2021-01-28 2026-03-24 Oracle International Corporation System and method for determination of model fitness and stability for model deployment in automated model generation
WO2022165253A1 (en) * 2021-01-28 2022-08-04 Oracle International Corporation System and method for determination of model fitness and stability for model deployment in automated model generation
US20220335315A1 (en) * 2021-04-20 2022-10-20 Red Hat, Inc. Application of local interpretable model-agnostic explanations on decision systems without training data
US12505660B2 (en) * 2021-12-29 2025-12-23 Samsung Electronics Co., Ltd. Image processing method and apparatus using convolutional neural network
JP7644881B1 (ja) * 2024-06-03 2025-03-13 株式会社エクサウィザーズ 情報処理方法、プログラム及び情報処理システム

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005001740A2 (en) * 2003-06-25 2005-01-06 Siemens Medical Solutions Usa, Inc. Systems and methods for automated diagnosis and decision support for breast imaging
WO2017001210A1 (en) * 2015-06-30 2017-01-05 Koninklijke Philips N.V. Registration apparatus for registering images

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11319A (ja) * 1997-06-13 1999-01-06 Nec Corp 生体内部活動部位推定装置
US20050004788A1 (en) * 2003-07-03 2005-01-06 Lee Hang Shun Raymond Multi-level confidence measures for task modeling and its application to task-oriented multi-modal dialog management
JP5113797B2 (ja) 2009-04-17 2013-01-09 日本電信電話株式会社 相違度利用型識別的学習装置とその方法、そのプログラム
US10417575B2 (en) * 2012-12-14 2019-09-17 Microsoft Technology Licensing, Llc Resource allocation for machine learning
US9373087B2 (en) * 2012-10-25 2016-06-21 Microsoft Technology Licensing, Llc Decision tree training in machine learning
CN103150578A (zh) * 2013-04-09 2013-06-12 山东师范大学 一种基于半监督学习的支持向量机分类器训练方法
US10055843B2 (en) * 2015-03-31 2018-08-21 Mayo Foundation For Medical Education And Research System and methods for automatic polyp detection using convulutional neural networks
US10510144B2 (en) 2015-09-10 2019-12-17 Magentiq Eye Ltd. System and method for detection of suspicious tissue regions in an endoscopic procedure
US12013395B2 (en) * 2018-10-18 2024-06-18 The Regents Of The University Of California Serodiagnostic testing device and system for early-stage Lyme disease using a multiplexed immunoassay
US11829896B2 (en) * 2019-07-11 2023-11-28 Ghost Autonomy Inc. Uncertainty-based data filtering in a vehicle
US20210209509A1 (en) * 2020-01-07 2021-07-08 Alegion, Inc. System and method for guided synthesis of training data

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005001740A2 (en) * 2003-06-25 2005-01-06 Siemens Medical Solutions Usa, Inc. Systems and methods for automated diagnosis and decision support for breast imaging
WO2017001210A1 (en) * 2015-06-30 2017-01-05 Koninklijke Philips N.V. Registration apparatus for registering images

Also Published As

Publication number Publication date
EP3918521B1 (en) 2023-10-04
WO2020156864A1 (en) 2020-08-06
CN113661498A (zh) 2021-11-16
JP2022520731A (ja) 2022-04-01
EP3918521A1 (en) 2021-12-08
JP7479387B2 (ja) 2024-05-08
US11880432B2 (en) 2024-01-23
EP3690739A1 (en) 2020-08-05
US20220101626A1 (en) 2022-03-31

Similar Documents

Publication Publication Date Title
CN113661498B (zh) 用于已部署机器学习模型的置信度度量
US11244435B2 (en) Method and apparatus for generating vehicle damage information
US11301995B2 (en) Feature identification in medical imaging
US11392792B2 (en) Method and apparatus for generating vehicle damage information
EP3819790A2 (en) Method and apparatus for visual question answering, computer device and medium
US10726555B2 (en) Joint registration and segmentation of images using deep learning
EP3859560A2 (en) Method and apparatus for visual question answering, computer device and medium
CN108171203B (zh) 用于识别车辆的方法和装置
US20170236271A1 (en) Classification apparatus for pathologic diagnosis of medical image, and pathologic diagnosis system using the same
CN113688912B (zh) 基于人工智能的对抗样本生成方法、装置、设备及介质
Guo Local entropy map: A nonparametric approach to detecting spatially varying multivariate relationships
CN109858333A (zh) 图像处理方法、装置、电子设备及计算机可读介质
CN109389169A (zh) 用于处理图像的方法和装置
CN111198945A (zh) 数据处理方法、装置、介质及电子设备
CN118898049B (zh) 基于知识图谱和深度学习的跨模态数据融合方法和系统
Azrul et al. Assessment of IoT-driven predictive maintenance strategies for computed tomography equipment: a machine learning approach
US20210279891A1 (en) Detecting subject motion in medical imaging
Miró-Nicolau et al. Meta-evaluating stability measures: MAX-sensitivity and AVG-sensitivity
US20250037497A1 (en) Pedestrian matching method and apparatus, electronic device, and computer-readable storage medium
CN113781052A (zh) 一种反洗钱监控方法、装置、设备及存储介质
CN114549041B (zh) 交互信息获取方法、装置、计算机可读介质及电子设备
Sathish et al. Boundary-aware uncertainty for automatic caliper placement
Senbi et al. Coherence-Based Segmentation Quality Evaluator Trained on a Large Collection of Annotated Medical Images
CN120689768A (zh) 一种识别地表特征变化的方法、装置、设备和存储介质
CN120782021A (zh) 确定设备的状态的方法、装置、设备、系统和程序产品

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant