AU2014230809B2 - Whole slide image registration and cross-image annotation devices, systems and methods - Google Patents

Whole slide image registration and cross-image annotation devices, systems and methods Download PDF

Info

Publication number
AU2014230809B2
AU2014230809B2 AU2014230809A AU2014230809A AU2014230809B2 AU 2014230809 B2 AU2014230809 B2 AU 2014230809B2 AU 2014230809 A AU2014230809 A AU 2014230809A AU 2014230809 A AU2014230809 A AU 2014230809A AU 2014230809 B2 AU2014230809 B2 AU 2014230809B2
Authority
AU
Australia
Prior art keywords
image
images
annotation
tissue
digital
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
AU2014230809A
Other languages
English (en)
Other versions
AU2014230809A1 (en
Inventor
Srinivas Chukka
Bikash Sabata
Anindya SARKAR
Quan Yuan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ventana Medical Systems Inc
Original Assignee
Ventana Medical Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ventana Medical Systems Inc filed Critical Ventana Medical Systems Inc
Publication of AU2014230809A1 publication Critical patent/AU2014230809A1/en
Application granted granted Critical
Publication of AU2014230809B2 publication Critical patent/AU2014230809B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • G06T7/0014Biomedical image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00Two-dimensional [2D] image generation
    • G06T11/60Creating or editing images; Combining images with text
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38Registration of image sequences
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/24Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30024Cell structures in vitro; Tissue sections in vitro

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Processing (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
AU2014230809A 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods Expired - Fee Related AU2014230809B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361781008P 2013-03-14 2013-03-14
US61/781,008 2013-03-14
PCT/EP2014/054781 WO2014140070A2 (en) 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods

Publications (2)

Publication Number Publication Date
AU2014230809A1 AU2014230809A1 (en) 2015-07-23
AU2014230809B2 true AU2014230809B2 (en) 2019-05-02

Family

ID=50391142

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2014230809A Expired - Fee Related AU2014230809B2 (en) 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods

Country Status (7)

Country Link
US (1) US9818190B2 (https=)
EP (1) EP2973396B1 (https=)
JP (1) JP6378701B2 (https=)
CN (1) CN105027164B (https=)
AU (1) AU2014230809B2 (https=)
CA (1) CA2897614C (https=)
WO (1) WO2014140070A2 (https=)

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2668487B1 (en) 2011-01-24 2024-11-06 Roche Molecular Systems, Inc. Devices, systems, and methods for extracting a material from a material sample
JP5859771B2 (ja) * 2011-08-22 2016-02-16 ソニー株式会社 情報処理装置、情報処理システム情報処理方法及びプログラム
US9946953B2 (en) * 2013-05-10 2018-04-17 Koninklijke Philips N.V. Apparatus and method for processing images of tissue samples
WO2015049233A1 (en) 2013-10-01 2015-04-09 Ventana Medical Systems, Inc. Line-based image registration and cross-image annotation devices, systems and methods
TW201520906A (zh) * 2013-11-29 2015-06-01 國立臺灣科技大學 影像註冊方法
US9547898B2 (en) * 2014-03-26 2017-01-17 Sectra Ab Automated cytology/histology viewers and related methods
EP3155592B1 (en) 2014-06-10 2019-09-11 Leland Stanford Junior University Predicting breast cancer recurrence directly from image features computed from digitized immunohistopathology tissue slides
WO2016087592A1 (en) 2014-12-03 2016-06-09 Ventana Medical Systems, Inc. Systems and methods for early-stage cancer prognosis
CN107111874B (zh) 2014-12-30 2022-04-08 文塔纳医疗系统公司 用于共表达分析的系统和方法
JP2018511036A (ja) 2015-01-31 2018-04-19 エフ.ホフマン−ラ ロシュ アーゲーF. Hoffmann−La Roche Aktiengesellschaft メソダイセクションのためのシステムおよび方法
JP6836994B2 (ja) 2015-01-31 2021-03-03 エフ.ホフマン−ラ ロシュ アーゲーF. Hoffmann−La Roche Aktiengesellschaft メソダイセクションのためのシステム及び方法
RU2716746C2 (ru) * 2015-07-16 2020-03-16 Конинклейке Филипс Н.В. Преобразование информации в цифровой патологии
KR101706620B1 (ko) * 2016-02-26 2017-02-20 (주)인스페이스 영상 보정 장치 및 방법
US10489633B2 (en) 2016-09-27 2019-11-26 Sectra Ab Viewers and related methods, systems and circuits with patch gallery user interfaces
EP3523779B1 (en) 2016-10-07 2026-04-29 Ventana Medical Systems, Inc. Digital pathology system and associated workflow for providing visualized whole-slide image analysis
US10876933B2 (en) 2016-11-09 2020-12-29 Ventana Medical Systems, Inc. Automated tissue dissection instrument and methods of using the same
CN110050281B (zh) * 2016-12-08 2023-06-20 皇家飞利浦有限公司 学习图像中的对象的注释
US10663711B2 (en) 2017-01-04 2020-05-26 Corista, LLC Virtual slide stage (VSS) method for viewing whole slide images
US10152571B1 (en) * 2017-05-25 2018-12-11 Enlitic, Inc. Chest x-ray differential diagnosis system
US10650929B1 (en) 2017-06-06 2020-05-12 PathAI, Inc. Systems and methods for training a model to predict survival time for a patient
US11276165B2 (en) 2017-06-15 2022-03-15 Visiopharm A/S Method for training a deep learning model to obtain histopathological information from images
EP3664689B1 (en) * 2017-08-11 2025-04-16 Carl Zeiss Meditec, Inc. Systems and methods for improved ophthalmic imaging
CN111433817A (zh) * 2017-12-15 2020-07-17 威里利生命科学有限责任公司 生成未染色样本的虚拟染色图像
USD875753S1 (en) * 2018-03-06 2020-02-18 Ventana Medical Systems, Inc. Display screen or portion thereof with graphical user interface for biological slide scanning
EP3559910B1 (en) * 2018-03-06 2020-05-13 Google LLC Adaptive image alignment using locally optimal transformations
EP3815040A4 (en) * 2018-05-21 2022-03-02 Corista LLC MULTI-SAMPLE FIELD-FIELD IMAGE PROCESSING IN DIGITAL PATHOLOGY BY MULTI-RESOLUTION REGISTRATION AND MACHINE LEARNING
TWI664424B (zh) * 2018-05-30 2019-07-01 國立臺灣科技大學 應用於協助癌症診斷的跨染色及多生物標記方法
CN112868024B (zh) 2018-10-15 2025-11-25 文塔纳医疗系统公司 用于细胞分类的系统和方法
CN113348356A (zh) 2018-11-20 2021-09-03 文塔纳医疗系统公司 用于针对形态学特征和生物标志物表达而制备和分析细胞样品的方法和系统
US11145059B2 (en) 2018-11-21 2021-10-12 Enlitic, Inc. Medical scan viewing system with enhanced training and methods for use therewith
US11011257B2 (en) 2018-11-21 2021-05-18 Enlitic, Inc. Multi-label heat map display system
US11457871B2 (en) 2018-11-21 2022-10-04 Enlitic, Inc. Medical scan artifact detection system and methods for use therewith
US11282198B2 (en) 2018-11-21 2022-03-22 Enlitic, Inc. Heat map generating system and methods for use therewith
CN109712176A (zh) * 2018-11-28 2019-05-03 众安信息技术服务有限公司 一种多序列图像的标注方法及系统
EP3721382B1 (en) * 2018-12-31 2022-10-12 Beijing Didi Infinity Technology and Development Co., Ltd. Method and system of annotation densification for semantic segmentation
BR112021019977A2 (pt) 2019-04-11 2021-12-07 Agilent Technologies Inc Interface de usuário configurada para facilitar a anotação de usuário para segmentação de instância dentro de amostra biológica
CN110246116B (zh) * 2019-04-24 2020-12-25 创新工场(北京)企业管理股份有限公司 数字病理切片由he染色到ihc染色的计算机自动生成方法
WO2020227710A1 (en) * 2019-05-09 2020-11-12 H. Lee Moffitt Cancer Center And Research Institute, Inc. Systems and methods for slide image alignment
EP3761032A1 (en) 2019-07-03 2021-01-06 Xyall B.V. Determining region(s) for tissue dissection in pathology slides
US20210049345A1 (en) * 2019-08-15 2021-02-18 Advanced Solutions Life Sciences, Llc Systems and methods for automating biological structure identification utilizing machine learning
US11354804B1 (en) 2019-09-27 2022-06-07 Verily Life Sciences Llc Transforming multispectral images to enhanced resolution images enabled by machine learning
CN110659640B (zh) * 2019-09-27 2021-11-30 深圳市商汤科技有限公司 文本序列的识别方法及装置、电子设备和存储介质
US11462315B2 (en) 2019-11-26 2022-10-04 Enlitic, Inc. Medical scan co-registration and methods for use therewith
CN111062977B (zh) * 2019-12-13 2021-05-04 推想医疗科技股份有限公司 样本数据生成方法、装置、计算机设备及存储介质
CN111180048B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 肿瘤成分标注方法、装置、设备及存储介质
CN111260699B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 高清病理影像配准方法、装置、设备及存储介质
WO2021202482A1 (en) * 2020-03-30 2021-10-07 Verily Life Sciences Llc Artificial intelligence-based assistant for concurrent review of needle core prostate biopsies
US11620831B2 (en) * 2020-04-29 2023-04-04 Toyota Research Institute, Inc. Register sets of low-level features without data association
US12061994B2 (en) 2020-08-11 2024-08-13 Enlitic, Inc. Inference process visualization system for medical scans
JP2023538309A (ja) 2020-08-13 2023-09-07 ベンタナ メディカル システムズ, インコーポレイテッド リペルコーディングを使用して学習された細胞局在化および分類のための機械学習モデル
CN115917594A (zh) * 2020-08-24 2023-04-04 文塔纳医疗系统公司 使用几何特征的整个载玻片注释转移
US11669678B2 (en) 2021-02-11 2023-06-06 Enlitic, Inc. System with report analysis and methods for use therewith
JP2022135392A (ja) * 2021-03-05 2022-09-15 コニカミノルタ株式会社 医用情報管理装置、医用情報管理方法および医用情報管理プログラム
CA3224636A1 (en) * 2021-07-23 2023-01-26 Gabriel Jesus Samuel Perlas MORALEDA Systems and methods for transferring markings
JP7829028B2 (ja) 2021-09-17 2026-03-12 ベンタナ メディカル システムズ, インコーポレイテッド 二重デジタル病理画像における表現型を予測するための機械学習技術
US12136484B2 (en) 2021-11-05 2024-11-05 Altis Labs, Inc. Method and apparatus utilizing image-based modeling in healthcare
WO2023081490A1 (en) * 2021-11-08 2023-05-11 H. Lee Moffitt Cancer Center And Research Institute, Inc. Virtual alignment of pathology image series
CN118414640A (zh) 2021-12-23 2024-07-30 文塔纳医疗系统公司 数字病理学中深度学习模型的对抗鲁棒性
CN118613829A (zh) * 2022-01-26 2024-09-06 皇家飞利浦有限公司 用于脑部扫描中的病理结构的智能注释工具
EP4489011A4 (en) 2022-03-03 2025-08-06 Lunit Inc METHOD AND APPARATUS FOR PATHOLOGICAL SLIDE IMAGE ANALYSIS
CN119404230A (zh) 2022-06-23 2025-02-07 文塔纳医疗系统公司 用于数字病理学的适应性学习框架
CN120283269A (zh) 2022-12-02 2025-07-08 文塔纳医疗系统公司 数字病理学图像中的共识标记
US12217837B2 (en) 2023-05-09 2025-02-04 Pramana, Inc. Systems and methods for digitization of tissue slides based on associations among serial sections
US12380578B2 (en) 2023-06-16 2025-08-05 Pramana, Inc. Apparatus and a method for on-demand registration of whole slide images
EP4549944A1 (en) * 2023-10-30 2025-05-07 Checkcells, Inc. Methods, systems and devices for testing biological sample
US12023817B1 (en) 2023-11-14 2024-07-02 Pramana, Inc. System and method for a slide marking technique for target tissue extraction and downstream application

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030118222A1 (en) * 2000-11-30 2003-06-26 Foran David J. Systems for analyzing microtissue arrays
US20090028614A1 (en) * 2007-07-27 2009-01-29 Xerox Corporation Active station adaptive image registration
US20120076390A1 (en) * 2010-09-28 2012-03-29 Flagship Bio Methods for feature analysis on consecutive tissue sections

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061476A (en) * 1997-11-24 2000-05-09 Cognex Corporation Method and apparatus using image subtraction and dynamic thresholding
JP2000342558A (ja) * 1999-06-04 2000-12-12 Konica Corp 画像の位置合わせ処理装置及び画像間演算処理装置
WO2008108059A1 (ja) * 2007-03-01 2008-09-12 Nec Corporation 乳癌病理画像診断支援システム、乳癌病理画像診断支援方法、乳癌病理画像診断支援プログラム、及び、乳癌病理画像診断支援プログラムを記録した記録媒体
CN102298779B (zh) * 2011-08-16 2013-08-21 淮安盈科伟力科技有限公司 全景辅助泊车系统的图像配准方法
US8605972B2 (en) 2012-03-02 2013-12-10 Sony Corporation Automatic image alignment
JP5999359B2 (ja) * 2013-01-30 2016-09-28 富士ゼロックス株式会社 画像処理装置及び画像処理プログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030118222A1 (en) * 2000-11-30 2003-06-26 Foran David J. Systems for analyzing microtissue arrays
US20090028614A1 (en) * 2007-07-27 2009-01-29 Xerox Corporation Active station adaptive image registration
US20120076390A1 (en) * 2010-09-28 2012-03-29 Flagship Bio Methods for feature analysis on consecutive tissue sections

Also Published As

Publication number Publication date
JP2016517559A (ja) 2016-06-16
CA2897614C (en) 2019-05-28
WO2014140070A2 (en) 2014-09-18
CN105027164A (zh) 2015-11-04
WO2014140070A3 (en) 2014-11-27
EP2973396B1 (en) 2018-10-10
CN105027164B (zh) 2018-05-18
JP6378701B2 (ja) 2018-08-22
AU2014230809A1 (en) 2015-07-23
US9818190B2 (en) 2017-11-14
EP2973396A2 (en) 2016-01-20
US20160019695A1 (en) 2016-01-21
CA2897614A1 (en) 2014-09-18

Similar Documents

Publication Publication Date Title
AU2014230809B2 (en) Whole slide image registration and cross-image annotation devices, systems and methods
US12211169B2 (en) Line-based image registration and cross-image annotation devices, systems and methods
JP7146886B2 (ja) 包括的なマルチアッセイ組織分析のためのシステムおよび方法
US10643396B2 (en) Methods and software for creating a 3D image from images of multiple histological sections and for mapping anatomical information from a reference atlas to a histological image
EP3345161B1 (en) Image processing systems and methods for displaying multiple images of a biological specimen
US10438381B2 (en) Computer-implemented composite tissue image with real-time adjustable interface

Legal Events

Date Code Title Description
MK25 Application lapsed reg. 22.2i(2) - failure to pay acceptance fee