CA2897614C - Whole slide image registration and cross-image annotation devices, systems and methods - Google Patents

Whole slide image registration and cross-image annotation devices, systems and methods Download PDF

Info

Publication number
CA2897614C
CA2897614C CA2897614A CA2897614A CA2897614C CA 2897614 C CA2897614 C CA 2897614C CA 2897614 A CA2897614 A CA 2897614A CA 2897614 A CA2897614 A CA 2897614A CA 2897614 C CA2897614 C CA 2897614C
Authority
CA
Canada
Prior art keywords
image
images
tissue
annotation
digital
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2897614A
Other languages
English (en)
French (fr)
Other versions
CA2897614A1 (en
Inventor
Srinivas Chukka
Bikash Sabata
Anindya SARKAR
Quan Yuan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ventana Medical Systems Inc
Original Assignee
Ventana Medical Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ventana Medical Systems Inc filed Critical Ventana Medical Systems Inc
Publication of CA2897614A1 publication Critical patent/CA2897614A1/en
Application granted granted Critical
Publication of CA2897614C publication Critical patent/CA2897614C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38—Registration of image sequences
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
CA2897614A 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods Active CA2897614C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361781008P 2013-03-14 2013-03-14
US61/781,008 2013-03-14
PCT/EP2014/054781 WO2014140070A2 (en) 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods

Publications (2)

Publication Number Publication Date
CA2897614A1 CA2897614A1 (en) 2014-09-18
CA2897614C true CA2897614C (en) 2019-05-28

Family

ID=50391142

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2897614A Active CA2897614C (en) 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods

Country Status (7)

Country Link
US (1) US9818190B2 (enExample)
EP (1) EP2973396B1 (enExample)
JP (1) JP6378701B2 (enExample)
CN (1) CN105027164B (enExample)
AU (1) AU2014230809B2 (enExample)
CA (1) CA2897614C (enExample)
WO (1) WO2014140070A2 (enExample)

Families Citing this family (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2825612C (en) 2011-01-24 2021-02-16 Nils B. Adey Devices, systems, and methods for extracting a material from a material sample
JP5859771B2 (ja) * 2011-08-22 2016-02-16 ソニー株式会社 情報処理装置、情報処理システム情報処理方法及びプログラム
US9946953B2 (en) * 2013-05-10 2018-04-17 Koninklijke Philips N.V. Apparatus and method for processing images of tissue samples
EP3053139B1 (en) * 2013-10-01 2020-10-21 Ventana Medical Systems, Inc. Line-based image registration and cross-image annotation devices, systems and methods
TW201520906A (zh) * 2013-11-29 2015-06-01 Univ Nat Taiwan Science Tech 影像註冊方法
US9547898B2 (en) * 2014-03-26 2017-01-17 Sectra Ab Automated cytology/histology viewers and related methods
WO2015189264A1 (en) 2014-06-10 2015-12-17 Ventana Medical Systems, Inc. Predicting breast cancer recurrence directly from image features computed from digitized immunohistopathology tissue slides
JP6650453B2 (ja) 2014-12-03 2020-02-19 ベンタナ メディカル システムズ， インコーポレイテッド 早期癌予知のための計算病理学システム及び方法
EP3241180B1 (en) 2014-12-30 2021-06-30 Ventana Medical Systems, Inc. Systems and methods for co-expression analysis in immunoscore computation
CA2973769C (en) * 2015-01-31 2021-05-18 F. Hoffmann-La Roche Ag Systems and methods for meso-dissection
CN107209092A (zh) 2015-01-31 2017-09-26 豪夫迈·罗氏有限公司 用于中间解剖的系统和方法
US10867443B2 (en) 2015-07-16 2020-12-15 Koninklijke Philips N.V. Information transformation in digital pathology
KR101706620B1 (ko) * 2016-02-26 2017-02-20 (주)인스페이스 영상 보정 장치 및 방법
US10489633B2 (en) 2016-09-27 2019-11-26 Sectra Ab Viewers and related methods, systems and circuits with patch gallery user interfaces
CN109791693B (zh) 2016-10-07 2023-09-26 文塔纳医疗系统公司 用于提供可视化全切片图像分析的数字病理学系统及相关工作流程
JP7059295B2 (ja) 2016-11-09 2022-04-25 エフ．ホフマン－ラ ロシュ アーゲー 自動化された組織ダイセクション機器、およびそれを用いる方法
US10885392B2 (en) * 2016-12-08 2021-01-05 Koninklijke Philips N.V. Learning annotation of objects in image
US10663711B2 (en) 2017-01-04 2020-05-26 Corista, LLC Virtual slide stage (VSS) method for viewing whole slide images
US11664114B2 (en) * 2017-05-25 2023-05-30 Enlitic, Inc. Medical scan assisted review system
US10650520B1 (en) 2017-06-06 2020-05-12 PathAI, Inc. Systems and methods for training a statistical model to predict tissue characteristics for a pathology image
US11276165B2 (en) 2017-06-15 2022-03-15 Visiopharm A/S Method for training a deep learning model to obtain histopathological information from images
CN110944571B (zh) * 2017-08-11 2023-09-29 卡尔蔡司医疗技术公司 用于改进眼科成像的系统和方法
EP3724854A1 (en) * 2017-12-15 2020-10-21 Verily Life Sciences LLC Generating virtually stained images of unstained samples
EP3559910B1 (en) * 2018-03-06 2020-05-13 Google LLC Adaptive image alignment using locally optimal transformations
USD875753S1 (en) * 2018-03-06 2020-02-18 Ventana Medical Systems, Inc. Display screen or portion thereof with graphical user interface for biological slide scanning
EP3815040A4 (en) * 2018-05-21 2022-03-02 Corista LLC MULTI-SAMPLE FIELD-FIELD IMAGE PROCESSING IN DIGITAL PATHOLOGY BY MULTI-RESOLUTION REGISTRATION AND MACHINE LEARNING
TWI664424B (zh) * 2018-05-30 2019-07-01 國立臺灣科技大學 應用於協助癌症診斷的跨染色及多生物標記方法
JP7228031B2 (ja) 2018-10-15 2023-02-22 ベンタナ メディカル システムズ， インコーポレイテッド 細胞の分類のためのシステムおよび方法
CN113348356A (zh) 2018-11-20 2021-09-03 文塔纳医疗系统公司 用于针对形态学特征和生物标志物表达而制备和分析细胞样品的方法和系统
US11145059B2 (en) 2018-11-21 2021-10-12 Enlitic, Inc. Medical scan viewing system with enhanced training and methods for use therewith
US11011257B2 (en) 2018-11-21 2021-05-18 Enlitic, Inc. Multi-label heat map display system
US11282198B2 (en) 2018-11-21 2022-03-22 Enlitic, Inc. Heat map generating system and methods for use therewith
US11457871B2 (en) 2018-11-21 2022-10-04 Enlitic, Inc. Medical scan artifact detection system and methods for use therewith
CN109712176A (zh) * 2018-11-28 2019-05-03 众安信息技术服务有限公司 一种多序列图像的标注方法及系统
US10803594B2 (en) * 2018-12-31 2020-10-13 Beijing Didi Infinity Technology And Development Co., Ltd. Method and system of annotation densification for semantic segmentation
EP3953861A1 (en) 2019-04-11 2022-02-16 Agilent Technologies, Inc. User interface configured to facilitate user annotation for instance segmentation within biological sample
CN110246116B (zh) * 2019-04-24 2020-12-25 创新工场(北京)企业管理股份有限公司 数字病理切片由he染色到ihc染色的计算机自动生成方法
WO2020227710A1 (en) * 2019-05-09 2020-11-12 H. Lee Moffitt Cancer Center And Research Institute, Inc. Systems and methods for slide image alignment
EP3761032A1 (en) 2019-07-03 2021-01-06 Xyall B.V. Determining region(s) for tissue dissection in pathology slides
US20210049345A1 (en) * 2019-08-15 2021-02-18 Advanced Solutions Life Sciences, Llc Systems and methods for automating biological structure identification utilizing machine learning
US11354804B1 (en) 2019-09-27 2022-06-07 Verily Life Sciences Llc Transforming multispectral images to enhanced resolution images enabled by machine learning
CN110659640B (zh) * 2019-09-27 2021-11-30 深圳市商汤科技有限公司 文本序列的识别方法及装置、电子设备和存储介质
US11462315B2 (en) 2019-11-26 2022-10-04 Enlitic, Inc. Medical scan co-registration and methods for use therewith
CN111062977B (zh) * 2019-12-13 2021-05-04 推想医疗科技股份有限公司 样本数据生成方法、装置、计算机设备及存储介质
CN111180048B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 肿瘤成分标注方法、装置、设备及存储介质
CN111260699B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 高清病理影像配准方法、装置、设备及存储介质
US12475991B2 (en) * 2020-03-30 2025-11-18 Verily Life Sciences Llc Artificial intelligence-based assistant for concurrent review of needle core prostate biopsies
US11620831B2 (en) * 2020-04-29 2023-04-04 Toyota Research Institute, Inc. Register sets of low-level features without data association
US12061994B2 (en) 2020-08-11 2024-08-13 Enlitic, Inc. Inference process visualization system for medical scans
JP2023538309A (ja) 2020-08-13 2023-09-07 ベンタナ メディカル システムズ， インコーポレイテッド リペルコーディングを使用して学習された細胞局在化および分類のための機械学習モデル
WO2022046539A1 (en) * 2020-08-24 2022-03-03 Ventana Medical Systems, Inc. Whole-slide annotation transfer using geometric features
US11669678B2 (en) 2021-02-11 2023-06-06 Enlitic, Inc. System with report analysis and methods for use therewith
JP2022135392A (ja) * 2021-03-05 2022-09-15 コニカミノルタ株式会社 医用情報管理装置、医用情報管理方法および医用情報管理プログラム
CN117813539A (zh) * 2021-07-23 2024-04-02 基因组健康股份有限公司 用于转移标记的系统和方法
CN117940971A (zh) 2021-09-17 2024-04-26 文塔纳医疗系统公司 用于预测双重数字病理学图像中的表型的机器学习技术
US12136484B2 (en) 2021-11-05 2024-11-05 Altis Labs, Inc. Method and apparatus utilizing image-based modeling in healthcare
WO2023081490A1 (en) * 2021-11-08 2023-05-11 H. Lee Moffitt Cancer Center And Research Institute, Inc. Virtual alignment of pathology image series
EP4453901A1 (en) 2021-12-23 2024-10-30 Ventana Medical Systems, Inc. Adversarial robustness of deep learning models in digital pathology
EP4469972A1 (en) * 2022-01-26 2024-12-04 Koninklijke Philips N.V. Smart annotation tool for pathological structures in brain scans
EP4544511A1 (en) 2022-06-23 2025-04-30 Ventana Medical Systems, Inc. Adaptive learning framework for digital pathology
JP2025541735A (ja) 2022-12-02 2025-12-23 ヴェンタナ メディカル システムズ， インク． デジタル病理画像におけるコンセンサスラベリング
US12217837B2 (en) 2023-05-09 2025-02-04 Pramana, Inc. Systems and methods for digitization of tissue slides based on associations among serial sections
US12380578B2 (en) 2023-06-16 2025-08-05 Pramana, Inc. Apparatus and a method for on-demand registration of whole slide images
EP4549944A1 (en) * 2023-10-30 2025-05-07 Checkcells, Inc. Methods, systems and devices for testing biological sample
US12023817B1 (en) 2023-11-14 2024-07-02 Pramana, Inc. System and method for a slide marking technique for target tissue extraction and downstream application

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061476A (en) * 1997-11-24 2000-05-09 Cognex Corporation Method and apparatus using image subtraction and dynamic thresholding
JP2000342558A (ja) * 1999-06-04 2000-12-12 Konica Corp 画像の位置合わせ処理装置及び画像間演算処理装置
US7171030B2 (en) * 2000-11-30 2007-01-30 University Of Medicine & Denistry Of New Jersey Systems for analyzing microtissue arrays
US9355445B2 (en) * 2007-03-01 2016-05-31 Nec Corporation Breast cancer pathological image diagnosis support system, breast cancer pathological image diagnosis support method, and recording medium recording breast cancer pathological image diagnosis support program
US7787810B2 (en) * 2007-07-27 2010-08-31 Xerox Corporation Active station adaptive image registration
US8787651B2 (en) * 2010-09-28 2014-07-22 Flagship Biosciences, LLC Methods for feature analysis on consecutive tissue sections
CN102298779B (zh) * 2011-08-16 2013-08-21 淮安盈科伟力科技有限公司 全景辅助泊车系统的图像配准方法
US8605972B2 (en) 2012-03-02 2013-12-10 Sony Corporation Automatic image alignment
JP5999359B2 (ja) * 2013-01-30 2016-09-28 富士ゼロックス株式会社 画像処理装置及び画像処理プログラム

Also Published As

Publication number Publication date
AU2014230809A1 (en) 2015-07-23
AU2014230809B2 (en) 2019-05-02
US9818190B2 (en) 2017-11-14
CA2897614A1 (en) 2014-09-18
WO2014140070A2 (en) 2014-09-18
JP6378701B2 (ja) 2018-08-22
CN105027164A (zh) 2015-11-04
EP2973396A2 (en) 2016-01-20
EP2973396B1 (en) 2018-10-10
CN105027164B (zh) 2018-05-18
US20160019695A1 (en) 2016-01-21
JP2016517559A (ja) 2016-06-16
WO2014140070A3 (en) 2014-11-27

Similar Documents

Publication Publication Date Title
CA2897614C (en) Whole slide image registration and cross-image annotation devices, systems and methods
US12211169B2 (en) Line-based image registration and cross-image annotation devices, systems and methods
JP7146886B2 (ja) 包括的なマルチアッセイ組織分析のためのシステムおよび方法
US10643396B2 (en) Methods and software for creating a 3D image from images of multiple histological sections and for mapping anatomical information from a reference atlas to a histological image
EP3345161B1 (en) Image processing systems and methods for displaying multiple images of a biological specimen
US10438381B2 (en) Computer-implemented composite tissue image with real-time adjustable interface

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20180813