JP6378701B2 - ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法 - Google Patents

ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法 Download PDF

Info

Publication number
JP6378701B2
JP6378701B2 JP2015562106A JP2015562106A JP6378701B2 JP 6378701 B2 JP6378701 B2 JP 6378701B2 JP 2015562106 A JP2015562106 A JP 2015562106A JP 2015562106 A JP2015562106 A JP 2015562106A JP 6378701 B2 JP6378701 B2 JP 6378701B2
Authority
JP
Japan
Prior art keywords
image
images
registration
digital
tissue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015562106A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016517559A (ja
JP2016517559A5 (https=
Inventor
チュッカ，スリニヴァス
サバタ，ビカシュ
サーカー，アニンディア
ユアン，クアン
Original Assignee
ベンタナ メディカル システムズ， インコーポレイテッド
ベンタナ メディカル システムズ， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ベンタナ メディカル システムズ， インコーポレイテッド, ベンタナ メディカル システムズ， インコーポレイテッド filed Critical ベンタナ メディカル システムズ， インコーポレイテッド
Publication of JP2016517559A publication Critical patent/JP2016517559A/ja
Publication of JP2016517559A5 publication Critical patent/JP2016517559A5/ja
Application granted granted Critical
Publication of JP6378701B2 publication Critical patent/JP6378701B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/60—Creating or editing images; Combining images with text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38—Registration of image sequences
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Processing (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
JP2015562106A 2013-03-14 2014-03-12 ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法 Active JP6378701B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361781008P 2013-03-14 2013-03-14
US61/781,008 2013-03-14
PCT/EP2014/054781 WO2014140070A2 (en) 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods

Publications (3)

Publication Number Publication Date
JP2016517559A JP2016517559A (ja) 2016-06-16
JP2016517559A5 JP2016517559A5 (https=) 2017-01-05
JP6378701B2 true JP6378701B2 (ja) 2018-08-22

Family

ID=50391142

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015562106A Active JP6378701B2 (ja) 2013-03-14 2014-03-12 ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法

Country Status (7)

Country Link
US (1) US9818190B2 (https=)
EP (1) EP2973396B1 (https=)
JP (1) JP6378701B2 (https=)
CN (1) CN105027164B (https=)
AU (1) AU2014230809B2 (https=)
CA (1) CA2897614C (https=)
WO (1) WO2014140070A2 (https=)

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2668487B1 (en) 2011-01-24 2024-11-06 Roche Molecular Systems, Inc. Devices, systems, and methods for extracting a material from a material sample
JP5859771B2 (ja) * 2011-08-22 2016-02-16 ソニー株式会社 情報処理装置、情報処理システム情報処理方法及びプログラム
US9946953B2 (en) * 2013-05-10 2018-04-17 Koninklijke Philips N.V. Apparatus and method for processing images of tissue samples
WO2015049233A1 (en) 2013-10-01 2015-04-09 Ventana Medical Systems, Inc. Line-based image registration and cross-image annotation devices, systems and methods
TW201520906A (zh) * 2013-11-29 2015-06-01 國立臺灣科技大學 影像註冊方法
US9547898B2 (en) * 2014-03-26 2017-01-17 Sectra Ab Automated cytology/histology viewers and related methods
EP3155592B1 (en) 2014-06-10 2019-09-11 Leland Stanford Junior University Predicting breast cancer recurrence directly from image features computed from digitized immunohistopathology tissue slides
WO2016087592A1 (en) 2014-12-03 2016-06-09 Ventana Medical Systems, Inc. Systems and methods for early-stage cancer prognosis
CN107111874B (zh) 2014-12-30 2022-04-08 文塔纳医疗系统公司 用于共表达分析的系统和方法
JP2018511036A (ja) 2015-01-31 2018-04-19 エフ．ホフマン−ラ ロシュ アーゲーＦ． Ｈｏｆｆｍａｎｎ−Ｌａ Ｒｏｃｈｅ Ａｋｔｉｅｎｇｅｓｅｌｌｓｃｈａｆｔ メソダイセクションのためのシステムおよび方法
JP6836994B2 (ja) 2015-01-31 2021-03-03 エフ．ホフマン−ラ ロシュ アーゲーＦ． Ｈｏｆｆｍａｎｎ−Ｌａ Ｒｏｃｈｅ Ａｋｔｉｅｎｇｅｓｅｌｌｓｃｈａｆｔ メソダイセクションのためのシステム及び方法
RU2716746C2 (ru) * 2015-07-16 2020-03-16 Конинклейке Филипс Н.В. Преобразование информации в цифровой патологии
KR101706620B1 (ko) * 2016-02-26 2017-02-20 (주)인스페이스 영상 보정 장치 및 방법
US10489633B2 (en) 2016-09-27 2019-11-26 Sectra Ab Viewers and related methods, systems and circuits with patch gallery user interfaces
EP3523779B1 (en) 2016-10-07 2026-04-29 Ventana Medical Systems, Inc. Digital pathology system and associated workflow for providing visualized whole-slide image analysis
US10876933B2 (en) 2016-11-09 2020-12-29 Ventana Medical Systems, Inc. Automated tissue dissection instrument and methods of using the same
CN110050281B (zh) * 2016-12-08 2023-06-20 皇家飞利浦有限公司 学习图像中的对象的注释
US10663711B2 (en) 2017-01-04 2020-05-26 Corista, LLC Virtual slide stage (VSS) method for viewing whole slide images
US10152571B1 (en) * 2017-05-25 2018-12-11 Enlitic, Inc. Chest x-ray differential diagnosis system
US10650929B1 (en) 2017-06-06 2020-05-12 PathAI, Inc. Systems and methods for training a model to predict survival time for a patient
US11276165B2 (en) 2017-06-15 2022-03-15 Visiopharm A/S Method for training a deep learning model to obtain histopathological information from images
EP3664689B1 (en) * 2017-08-11 2025-04-16 Carl Zeiss Meditec, Inc. Systems and methods for improved ophthalmic imaging
CN111433817A (zh) * 2017-12-15 2020-07-17 威里利生命科学有限责任公司 生成未染色样本的虚拟染色图像
USD875753S1 (en) * 2018-03-06 2020-02-18 Ventana Medical Systems, Inc. Display screen or portion thereof with graphical user interface for biological slide scanning
EP3559910B1 (en) * 2018-03-06 2020-05-13 Google LLC Adaptive image alignment using locally optimal transformations
EP3815040A4 (en) * 2018-05-21 2022-03-02 Corista LLC MULTI-SAMPLE FIELD-FIELD IMAGE PROCESSING IN DIGITAL PATHOLOGY BY MULTI-RESOLUTION REGISTRATION AND MACHINE LEARNING
TWI664424B (zh) * 2018-05-30 2019-07-01 國立臺灣科技大學 應用於協助癌症診斷的跨染色及多生物標記方法
CN112868024B (zh) 2018-10-15 2025-11-25 文塔纳医疗系统公司 用于细胞分类的系统和方法
CN113348356A (zh) 2018-11-20 2021-09-03 文塔纳医疗系统公司 用于针对形态学特征和生物标志物表达而制备和分析细胞样品的方法和系统
US11145059B2 (en) 2018-11-21 2021-10-12 Enlitic, Inc. Medical scan viewing system with enhanced training and methods for use therewith
US11011257B2 (en) 2018-11-21 2021-05-18 Enlitic, Inc. Multi-label heat map display system
US11457871B2 (en) 2018-11-21 2022-10-04 Enlitic, Inc. Medical scan artifact detection system and methods for use therewith
US11282198B2 (en) 2018-11-21 2022-03-22 Enlitic, Inc. Heat map generating system and methods for use therewith
CN109712176A (zh) * 2018-11-28 2019-05-03 众安信息技术服务有限公司 一种多序列图像的标注方法及系统
EP3721382B1 (en) * 2018-12-31 2022-10-12 Beijing Didi Infinity Technology and Development Co., Ltd. Method and system of annotation densification for semantic segmentation
BR112021019977A2 (pt) 2019-04-11 2021-12-07 Agilent Technologies Inc Interface de usuário configurada para facilitar a anotação de usuário para segmentação de instância dentro de amostra biológica
CN110246116B (zh) * 2019-04-24 2020-12-25 创新工场(北京)企业管理股份有限公司 数字病理切片由he染色到ihc染色的计算机自动生成方法
WO2020227710A1 (en) * 2019-05-09 2020-11-12 H. Lee Moffitt Cancer Center And Research Institute, Inc. Systems and methods for slide image alignment
EP3761032A1 (en) 2019-07-03 2021-01-06 Xyall B.V. Determining region(s) for tissue dissection in pathology slides
US20210049345A1 (en) * 2019-08-15 2021-02-18 Advanced Solutions Life Sciences, Llc Systems and methods for automating biological structure identification utilizing machine learning
US11354804B1 (en) 2019-09-27 2022-06-07 Verily Life Sciences Llc Transforming multispectral images to enhanced resolution images enabled by machine learning
CN110659640B (zh) * 2019-09-27 2021-11-30 深圳市商汤科技有限公司 文本序列的识别方法及装置、电子设备和存储介质
US11462315B2 (en) 2019-11-26 2022-10-04 Enlitic, Inc. Medical scan co-registration and methods for use therewith
CN111062977B (zh) * 2019-12-13 2021-05-04 推想医疗科技股份有限公司 样本数据生成方法、装置、计算机设备及存储介质
CN111180048B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 肿瘤成分标注方法、装置、设备及存储介质
CN111260699B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 高清病理影像配准方法、装置、设备及存储介质
WO2021202482A1 (en) * 2020-03-30 2021-10-07 Verily Life Sciences Llc Artificial intelligence-based assistant for concurrent review of needle core prostate biopsies
US11620831B2 (en) * 2020-04-29 2023-04-04 Toyota Research Institute, Inc. Register sets of low-level features without data association
US12061994B2 (en) 2020-08-11 2024-08-13 Enlitic, Inc. Inference process visualization system for medical scans
JP2023538309A (ja) 2020-08-13 2023-09-07 ベンタナ メディカル システムズ， インコーポレイテッド リペルコーディングを使用して学習された細胞局在化および分類のための機械学習モデル
CN115917594A (zh) * 2020-08-24 2023-04-04 文塔纳医疗系统公司 使用几何特征的整个载玻片注释转移
US11669678B2 (en) 2021-02-11 2023-06-06 Enlitic, Inc. System with report analysis and methods for use therewith
JP2022135392A (ja) * 2021-03-05 2022-09-15 コニカミノルタ株式会社 医用情報管理装置、医用情報管理方法および医用情報管理プログラム
CA3224636A1 (en) * 2021-07-23 2023-01-26 Gabriel Jesus Samuel Perlas MORALEDA Systems and methods for transferring markings
JP7829028B2 (ja) 2021-09-17 2026-03-12 ベンタナ メディカル システムズ， インコーポレイテッド 二重デジタル病理画像における表現型を予測するための機械学習技術
US12136484B2 (en) 2021-11-05 2024-11-05 Altis Labs, Inc. Method and apparatus utilizing image-based modeling in healthcare
WO2023081490A1 (en) * 2021-11-08 2023-05-11 H. Lee Moffitt Cancer Center And Research Institute, Inc. Virtual alignment of pathology image series
CN118414640A (zh) 2021-12-23 2024-07-30 文塔纳医疗系统公司 数字病理学中深度学习模型的对抗鲁棒性
CN118613829A (zh) * 2022-01-26 2024-09-06 皇家飞利浦有限公司 用于脑部扫描中的病理结构的智能注释工具
EP4489011A4 (en) 2022-03-03 2025-08-06 Lunit Inc METHOD AND APPARATUS FOR PATHOLOGICAL SLIDE IMAGE ANALYSIS
CN119404230A (zh) 2022-06-23 2025-02-07 文塔纳医疗系统公司 用于数字病理学的适应性学习框架
CN120283269A (zh) 2022-12-02 2025-07-08 文塔纳医疗系统公司 数字病理学图像中的共识标记
US12217837B2 (en) 2023-05-09 2025-02-04 Pramana, Inc. Systems and methods for digitization of tissue slides based on associations among serial sections
US12380578B2 (en) 2023-06-16 2025-08-05 Pramana, Inc. Apparatus and a method for on-demand registration of whole slide images
EP4549944A1 (en) * 2023-10-30 2025-05-07 Checkcells, Inc. Methods, systems and devices for testing biological sample
US12023817B1 (en) 2023-11-14 2024-07-02 Pramana, Inc. System and method for a slide marking technique for target tissue extraction and downstream application

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061476A (en) * 1997-11-24 2000-05-09 Cognex Corporation Method and apparatus using image subtraction and dynamic thresholding
JP2000342558A (ja) * 1999-06-04 2000-12-12 Konica Corp 画像の位置合わせ処理装置及び画像間演算処理装置
US7171030B2 (en) * 2000-11-30 2007-01-30 University Of Medicine & Denistry Of New Jersey Systems for analyzing microtissue arrays
WO2008108059A1 (ja) * 2007-03-01 2008-09-12 Nec Corporation 乳癌病理画像診断支援システム、乳癌病理画像診断支援方法、乳癌病理画像診断支援プログラム、及び、乳癌病理画像診断支援プログラムを記録した記録媒体
US7787810B2 (en) * 2007-07-27 2010-08-31 Xerox Corporation Active station adaptive image registration
US8787651B2 (en) * 2010-09-28 2014-07-22 Flagship Biosciences, LLC Methods for feature analysis on consecutive tissue sections
CN102298779B (zh) * 2011-08-16 2013-08-21 淮安盈科伟力科技有限公司 全景辅助泊车系统的图像配准方法
US8605972B2 (en) 2012-03-02 2013-12-10 Sony Corporation Automatic image alignment
JP5999359B2 (ja) * 2013-01-30 2016-09-28 富士ゼロックス株式会社 画像処理装置及び画像処理プログラム

Also Published As

Publication number Publication date
JP2016517559A (ja) 2016-06-16
CA2897614C (en) 2019-05-28
WO2014140070A2 (en) 2014-09-18
CN105027164A (zh) 2015-11-04
WO2014140070A3 (en) 2014-11-27
EP2973396B1 (en) 2018-10-10
CN105027164B (zh) 2018-05-18
AU2014230809B2 (en) 2019-05-02
AU2014230809A1 (en) 2015-07-23
US9818190B2 (en) 2017-11-14
EP2973396A2 (en) 2016-01-20
US20160019695A1 (en) 2016-01-21
CA2897614A1 (en) 2014-09-18

Similar Documents

Publication Publication Date Title
JP6378701B2 (ja) ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法
US12211169B2 (en) Line-based image registration and cross-image annotation devices, systems and methods
US11681418B2 (en) Multi-sample whole slide image processing in digital pathology via multi-resolution registration and machine learning
JP7425145B2 (ja) 包括的なマルチアッセイ組織分析のためのシステムおよび方法
AU2020271905A1 (en) Deep learning based training of instance segmentation via regression layers

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161114

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161114

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20171214

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20171221

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180322

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180608

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180628

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180727

R150 Certificate of patent or registration of utility model

Ref document number: 6378701

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250