ES3040224T3 - Critical component detection using deep learning and attention - Google Patents

Critical component detection using deep learning and attention

Info

Publication number
ES3040224T3
ES3040224T3 ES21873333T ES21873333T ES3040224T3 ES 3040224 T3 ES3040224 T3 ES 3040224T3 ES 21873333 T ES21873333 T ES 21873333T ES 21873333 T ES21873333 T ES 21873333T ES 3040224 T3 ES3040224 T3 ES 3040224T3
Authority
ES
Spain
Prior art keywords
supraimage
components
neural network
image
attention
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
ES21873333T
Other languages
English (en)
Spanish (es)
Inventor
Julianna Ianni
Rajath Soans
Kameswari Ayyagari
Saul Kohn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Proscia Inc
Original Assignee
Proscia Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Proscia Inc filed Critical Proscia Inc
Application granted granted Critical
Publication of ES3040224T3 publication Critical patent/ES3040224T3/es
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10081—Computed x-ray tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10088—Magnetic resonance imaging [MRI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30088—Skin; Dermal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30096—Tumor; Lesion

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Image Analysis (AREA)
  • Confectionery (AREA)
  • Solid-Sorbent Or Filter-Aiding Compositions (AREA)
  • Image Processing (AREA)
ES21873333T 2020-09-23 2021-09-22 Critical component detection using deep learning and attention Active ES3040224T3 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202063082125P 2020-09-23 2020-09-23
PCT/US2021/051506 WO2022066736A1 (en) 2020-09-23 2021-09-22 Critical component detection using deep learning and attention

Publications (1)

Publication Number Publication Date
ES3040224T3 true ES3040224T3 (en) 2025-10-29

Family

ID=80846858

Family Applications (1)

Application Number Title Priority Date Filing Date
ES21873333T Active ES3040224T3 (en) 2020-09-23 2021-09-22 Critical component detection using deep learning and attention

Country Status (7)

Country Link
US (1) US11861881B2 (de)
EP (1) EP4200674B1 (de)
AU (1) AU2021349226C1 (de)
CA (1) CA3196713C (de)
ES (1) ES3040224T3 (de)
IL (1) IL301593B2 (de)
WO (1) WO2022066736A1 (de)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11636924B2 (en) 2016-09-30 2023-04-25 Molecular Devices, Llc Computer device for detecting an optimal candidate compound and methods thereof
US11462032B2 (en) 2019-09-23 2022-10-04 Proscia Inc. Stain normalization for automated whole-slide image classification
US11663838B2 (en) * 2020-10-29 2023-05-30 PAIGE.AI, Inc. Systems and methods for processing images to determine image-based computational biomarkers from liquid specimens
US20240005701A1 (en) * 2021-09-23 2024-01-04 Intel Corporation Methods and apparatus for team classification in sports analysis
CN114782796B (zh) * 2022-06-17 2023-05-02 武汉北大高科软件股份有限公司 一种物品图像防伪的智能验证方法和装置
CN115272419B (zh) * 2022-09-27 2022-12-09 南昌工程学院 基于混合卷积与自注意力的聚合网络目标跟踪方法与系统
CN116012394B (zh) * 2023-01-13 2026-03-06 杭州可帮医学检验实验室有限公司 一种病理切片图像去笔迹的方法、设备及存储介质
CN119068180A (zh) * 2023-05-26 2024-12-03 香港理工大学 自动图像分割系统和方法
CN117216010B (zh) * 2023-08-17 2025-10-10 山东省计算中心（国家超级计算济南中心） 融合元数据和标签相关性的政策文件分类方法及系统
CN119558358A (zh) * 2024-11-12 2025-03-04 电子科技大学(深圳)高等研究院 基于注意力的多任务可解释图神经网络的阿兹海默病分析方法

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9965705B2 (en) * 2015-11-03 2018-05-08 Baidu Usa Llc Systems and methods for attention-based configurable convolutional neural networks (ABC-CNN) for visual question answering
US10970887B2 (en) 2016-06-24 2021-04-06 Rensselaer Polytechnic Institute Tomographic image reconstruction via machine learning
WO2018152248A1 (en) 2017-02-14 2018-08-23 Dignity Health Systems, methods, and media for selectively presenting images captured by confocal laser endomicroscopy
CN110651301A (zh) 2017-05-24 2020-01-03 黑拉有限责任两合公司 用于自动为夜视图像着色的方法和系统
CN108230294B (zh) * 2017-06-14 2020-09-29 北京市商汤科技开发有限公司 图像检测方法、装置、电子设备和存储介质
CA3081643A1 (en) 2017-11-06 2019-05-09 University Health Network Platform, device and process for annotation and classification of tissue specimens using convolutional neural network
EP3709877A4 (de) * 2017-11-17 2021-08-25 Mayo Foundation for Medical Education and Research Verfahren zur verwendung von maschinenlern- und mechanistischen modellen zur biologischen merkmalsabbildung mit multiparametrischer mrt
WO2019108888A1 (en) 2017-11-30 2019-06-06 The Research Foundation For The State University Of New York SYSTEM AND METHOD TO QUANTIFY TUMOR-INFILTRATING LYMPHOCYTES (TILs) FOR CLINICAL PATHOLOGY ANALYSIS
US10460150B2 (en) 2018-03-16 2019-10-29 Proscia Inc. Deep learning automated dermatopathology
CN120014640A (zh) 2018-03-30 2025-05-16 加利福尼亚大学董事会 生成数字染色显微图像的方法
US10991150B2 (en) 2018-05-09 2021-04-27 Massachusetts Institute Of Technology View generation from a single image using fully convolutional neural networks
US11348661B2 (en) * 2018-05-14 2022-05-31 Tempus Labs, Inc. Predicting total nucleic acid yield and dissection boundaries for histology slides
WO2020014477A1 (en) 2018-07-11 2020-01-16 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for image analysis with deep learning to predict breast cancer classes
US10748281B2 (en) * 2018-07-21 2020-08-18 International Business Machines Corporation Negative sample enhanced object detection machine
US10304193B1 (en) 2018-08-17 2019-05-28 12 Sigma Technologies Image segmentation and object detection using fully convolutional neural network
US11508168B2 (en) 2018-10-15 2022-11-22 Upmc Systems and methods for specimen interpretation
EP3909016A1 (de) 2019-01-13 2021-11-17 Lightlab Imaging, Inc. Systeme und verfahren zur klassifizierung von arterienbildbereichen und merkmalen davon
US10453197B1 (en) * 2019-02-18 2019-10-22 Inception Institute of Artificial Intelligence, Ltd. Object counting and instance segmentation using neural network architectures with image-level supervision
WO2020182710A1 (en) 2019-03-12 2020-09-17 F. Hoffmann-La Roche Ag Multiple instance learner for prognostic tissue pattern identification
EP3938951A1 (de) 2019-03-15 2022-01-19 Spintellx, Inc. Erklärbare ai (xai)-plattform für rechnerische pathologie
US12026875B2 (en) 2019-03-28 2024-07-02 Hoffmann-La Roche, Inc. Machine learning using distance-based similarity labels
WO2020232363A1 (en) 2019-05-16 2020-11-19 PAIGE.AI, Inc. Systems and methods for processing images to classify the processed images for digital pathology
EP3739504A1 (de) * 2019-05-16 2020-11-18 Basf Se System und verfahren zur unterstützung der erkennung von pflanzenkrankheiten
WO2020243193A1 (en) 2019-05-28 2020-12-03 PAIGE.AI, Inc. Systems and methods for processing images to prepare slides for processed images for digital pathology
US12094105B2 (en) 2019-06-10 2024-09-17 Datma, Inc. System and method for automatic labeling of pathology images
CN110309832A (zh) * 2019-06-19 2019-10-08 创新奇智(成都)科技有限公司 一种基于图像的物体分类方法、系统及电子设备
US20210027098A1 (en) 2019-07-22 2021-01-28 Shenzhen Malong Technologies Co., Ltd. Weakly Supervised Image Segmentation Via Curriculum Learning
US11462032B2 (en) 2019-09-23 2022-10-04 Proscia Inc. Stain normalization for automated whole-slide image classification
CN111026915B (zh) * 2019-11-25 2023-09-15 Oppo广东移动通信有限公司 视频分类方法、视频分类装置、存储介质与电子设备
CN111126488B (zh) * 2019-12-24 2023-08-18 威创集团股份有限公司 一种基于双重注意力的图像识别方法
CA3162251A1 (en) 2020-01-06 2021-07-15 Jillian SUE Systems and methods for analyzing electronic images for quality control
US12373980B2 (en) * 2020-01-31 2025-07-29 Servicenow, Inc. Method and system for localization with supervision
US11308619B2 (en) * 2020-07-17 2022-04-19 International Business Machines Corporation Evaluating a mammogram using a plurality of prior mammograms and deep learning algorithms
AU2021345220A1 (en) 2020-09-18 2023-04-27 Proscia Inc. Training end-to-end weakly supervised networks at the specimen (supra-image) level
WO2022066725A1 (en) 2020-09-23 2022-03-31 Proscia Inc. Training end-to-end weakly supervised networks in a multi-task fashion at the specimen (supra-image) level

Also Published As

Publication number Publication date
US20230245431A1 (en) 2023-08-03
AU2021349226B2 (en) 2023-05-11
CA3196713A1 (en) 2022-03-31
EP4200674C0 (de) 2025-06-18
IL301593B1 (en) 2024-03-01
IL301593B2 (en) 2024-07-01
EP4200674A1 (de) 2023-06-28
US11861881B2 (en) 2024-01-02
WO2022066736A1 (en) 2022-03-31
IL301593A (en) 2023-05-01
EP4200674B1 (de) 2025-06-18
AU2021349226A9 (en) 2024-05-02
CA3196713C (en) 2023-11-14
AU2021349226A1 (en) 2023-05-04
EP4200674A4 (de) 2024-03-20
AU2021349226C1 (en) 2023-08-24

Similar Documents

Publication Publication Date Title
ES3040224T3 (en) Critical component detection using deep learning and attention
Hayat et al. Hybrid deep learning EfficientNetV2 and vision transformer (EffNetV2-ViT) model for breast cancer histopathological image classification
US12094105B2 (en) System and method for automatic labeling of pathology images
Xie et al. Interpretable classification from skin cancer histology slides using deep learning: A retrospective multicenter study
Banumathy et al. Breast Calcifications and Histopathological Analysis on Tumour Detection by CNN.
WO2022066725A1 (en) Training end-to-end weakly supervised networks in a multi-task fashion at the specimen (supra-image) level
WO2018157381A1 (zh) 病理切片图像智能分类方法及装置
Salvi et al. Deep learning approach for accurate prostate cancer identification and stratification using combined immunostaining of cytokeratin, p63, and racemase
Huang et al. A robust and scalable framework for hallucination detection in virtual tissue staining and digital pathology
Saxena et al. Review of computer‐assisted diagnosis model to classify follicular lymphoma histology
Irmak et al. Deep learning-based histopathological classification of breast tumors: A multi-magnification approach with state-of-the-art models
EP4214626A1 (de) Training von schwach überwachten end-zu-end-netzwerken auf probenebene (supra-bild)
Jin et al. Independent assessment of a deep learning system for lymph node metastasis detection on the Augmented Reality Microscope
US12505543B2 (en) Method for identifying abnormalities in cells of interest in a biological sample
Frías et al. The artificial intelligence challenge in rare disease diagnosis: A case study on collagen VI muscular dystrophy
Sathish et al. Accurate deep learning models for predicting brain cancer at begin stage
US12597133B2 (en) Training end-to-end weakly supervised networks at the specimen (supra-image) level
Reddy et al. Comparative analysis of deep learning models for early skin cancer detection using 3d total body photography
Saidul et al. The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer
Tan et al. Automated Classification Map Generation of Prostate Cancer using Deep Learning
Kononenko et al. Review of cell detection approaches in intelligent systems for antinuclear factor determination
EP4462380A1 (de) Verfahren zur identifizierung von anomalien in zellen von interesse in einer biologischen probe
Brechenmacher et al. Machine Learning Predicts Adequacy of Rapid Onsite Evaluation in Fine Needle Aspirations in Lung Cancer Cytology
Rana et al. High accuracy tumor diagnoses and benchmarking of hematoxylin and eosin stained prostate core biopsy images generated by explainable deep neural networks
Poonawala Using Self-Supervised Learning Models to Predict Invasive Ductal Carcinoma from Histopathological Images