JP6378701B2 - ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法 - Google Patents

ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法 Download PDF

Info

Publication number
JP6378701B2
JP6378701B2 JP2015562106A JP2015562106A JP6378701B2 JP 6378701 B2 JP6378701 B2 JP 6378701B2 JP 2015562106 A JP2015562106 A JP 2015562106A JP 2015562106 A JP2015562106 A JP 2015562106A JP 6378701 B2 JP6378701 B2 JP 6378701B2
Authority
JP
Japan
Prior art keywords
image
images
registration
digital
tissue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015562106A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016517559A (ja
JP2016517559A5 (enExample
Inventor
チュッカ，スリニヴァス
サバタ，ビカシュ
サーカー，アニンディア
ユアン，クアン
Original Assignee
ベンタナ メディカル システムズ， インコーポレイテッド
ベンタナ メディカル システムズ， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ベンタナ メディカル システムズ， インコーポレイテッド, ベンタナ メディカル システムズ， インコーポレイテッド filed Critical ベンタナ メディカル システムズ， インコーポレイテッド
Publication of JP2016517559A publication Critical patent/JP2016517559A/ja
Publication of JP2016517559A5 publication Critical patent/JP2016517559A5/ja
Application granted granted Critical
Publication of JP6378701B2 publication Critical patent/JP6378701B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38—Registration of image sequences
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Processing (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • User Interface Of Digital Computer (AREA)
JP2015562106A 2013-03-14 2014-03-12 ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法 Active JP6378701B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361781008P 2013-03-14 2013-03-14
US61/781,008 2013-03-14
PCT/EP2014/054781 WO2014140070A2 (en) 2013-03-14 2014-03-12 Whole slide image registration and cross-image annotation devices, systems and methods

Publications (3)

Publication Number Publication Date
JP2016517559A JP2016517559A (ja) 2016-06-16
JP2016517559A5 JP2016517559A5 (enExample) 2017-01-05
JP6378701B2 true JP6378701B2 (ja) 2018-08-22

Family

ID=50391142

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015562106A Active JP6378701B2 (ja) 2013-03-14 2014-03-12 ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法

Country Status (7)

Country Link
US (1) US9818190B2 (enExample)
EP (1) EP2973396B1 (enExample)
JP (1) JP6378701B2 (enExample)
CN (1) CN105027164B (enExample)
AU (1) AU2014230809B2 (enExample)
CA (1) CA2897614C (enExample)
WO (1) WO2014140070A2 (enExample)

Families Citing this family (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012102779A2 (en) 2011-01-24 2012-08-02 Adey Nils B Devices, systems, and methods for extracting a material from a material sample
JP5859771B2 (ja) * 2011-08-22 2016-02-16 ソニー株式会社 情報処理装置、情報処理システム情報処理方法及びプログラム
US9946953B2 (en) * 2013-05-10 2018-04-17 Koninklijke Philips N.V. Apparatus and method for processing images of tissue samples
JP6499643B2 (ja) 2013-10-01 2019-04-10 ベンタナ メディカル システムズ， インコーポレイテッド ラインベースの画像位置合わせ及び交差画像注釈デバイス、システム、及び方法
TW201520906A (zh) * 2013-11-29 2015-06-01 Univ Nat Taiwan Science Tech 影像註冊方法
US9547898B2 (en) * 2014-03-26 2017-01-17 Sectra Ab Automated cytology/histology viewers and related methods
WO2015189264A1 (en) 2014-06-10 2015-12-17 Ventana Medical Systems, Inc. Predicting breast cancer recurrence directly from image features computed from digitized immunohistopathology tissue slides
AU2015357091A1 (en) 2014-12-03 2017-04-27 Ventana Medical Systems, Inc. Systems and methods for early-stage cancer prognosis
AU2015373423A1 (en) 2014-12-30 2017-05-18 Ventana Medical Systems, Inc. Systems and methods for co-expression analysis in immunoscore computation
CA2973645C (en) * 2015-01-31 2020-09-15 F. Hoffmann-La Roche Ag Systems and methods for meso-dissection
CN115493907A (zh) * 2015-01-31 2022-12-20 豪夫迈·罗氏有限公司 用于中间解剖的系统和方法
WO2017009337A1 (en) * 2015-07-16 2017-01-19 Koninklijke Philips N.V. Information transformation in digital pathology
KR101706620B1 (ko) * 2016-02-26 2017-02-20 (주)인스페이스 영상 보정 장치 및 방법
US10489633B2 (en) 2016-09-27 2019-11-26 Sectra Ab Viewers and related methods, systems and circuits with patch gallery user interfaces
WO2018065434A1 (en) * 2016-10-07 2018-04-12 Ventana Medical Systems, Inc. Digital pathology system and associated workflow for providing visualized whole-slide image analysis
JP7059295B2 (ja) 2016-11-09 2022-04-25 エフ．ホフマン－ラ ロシュ アーゲー 自動化された組織ダイセクション機器、およびそれを用いる方法
WO2018104342A1 (en) * 2016-12-08 2018-06-14 Koninklijke Philips N.V. Learning annotation of objects in image
US10663711B2 (en) 2017-01-04 2020-05-26 Corista, LLC Virtual slide stage (VSS) method for viewing whole slide images
US10152571B1 (en) 2017-05-25 2018-12-11 Enlitic, Inc. Chest x-ray differential diagnosis system
US11080855B1 (en) 2017-06-06 2021-08-03 Path AI, Inc. Systems and methods for predicting tissue characteristics for a pathology image using a statistical model
EP3639191B2 (en) 2017-06-15 2024-07-17 Visiopharm A/S Method for training a deep learning model to obtain histopathological information from images
CN110944571B (zh) * 2017-08-11 2023-09-29 卡尔蔡司医疗技术公司 用于改进眼科成像的系统和方法
US10824847B2 (en) * 2017-12-15 2020-11-03 Verily Life Sciences Llc Generating virtually stained images of unstained samples
USD875753S1 (en) * 2018-03-06 2020-02-18 Ventana Medical Systems, Inc. Display screen or portion thereof with graphical user interface for biological slide scanning
WO2019172890A1 (en) * 2018-03-06 2019-09-12 Google Llc Adaptive image alignment using locally optimal transformations
AU2019275232B2 (en) * 2018-05-21 2024-08-15 Corista, LLC Multi-sample whole slide image processing via multi-resolution registration
TWI664424B (zh) * 2018-05-30 2019-07-01 國立臺灣科技大學 應用於協助癌症診斷的跨染色及多生物標記方法
WO2020081343A1 (en) 2018-10-15 2020-04-23 Ventana Medical Systems, Inc. Systems and methods for cell classification
CN113348356A (zh) 2018-11-20 2021-09-03 文塔纳医疗系统公司 用于针对形态学特征和生物标志物表达而制备和分析细胞样品的方法和系统
US11457871B2 (en) 2018-11-21 2022-10-04 Enlitic, Inc. Medical scan artifact detection system and methods for use therewith
US11145059B2 (en) 2018-11-21 2021-10-12 Enlitic, Inc. Medical scan viewing system with enhanced training and methods for use therewith
US11282198B2 (en) 2018-11-21 2022-03-22 Enlitic, Inc. Heat map generating system and methods for use therewith
US10943681B2 (en) 2018-11-21 2021-03-09 Enlitic, Inc. Global multi-label generating system
CN109712176A (zh) * 2018-11-28 2019-05-03 众安信息技术服务有限公司 一种多序列图像的标注方法及系统
US10803594B2 (en) * 2018-12-31 2020-10-13 Beijing Didi Infinity Technology And Development Co., Ltd. Method and system of annotation densification for semantic segmentation
CN113678142B (zh) * 2019-04-11 2025-10-03 安捷伦科技有限公司 基于深度学习的经由回归层的实例分割训练
CN110246116B (zh) * 2019-04-24 2020-12-25 创新工场(北京)企业管理股份有限公司 数字病理切片由he染色到ihc染色的计算机自动生成方法
WO2020227710A1 (en) * 2019-05-09 2020-11-12 H. Lee Moffitt Cancer Center And Research Institute, Inc. Systems and methods for slide image alignment
EP3761032A1 (en) 2019-07-03 2021-01-06 Xyall B.V. Determining region(s) for tissue dissection in pathology slides
EP4014172A4 (en) * 2019-08-15 2023-07-19 Advanced Solutions Life Sciences, LLC SYSTEMS AND METHODS FOR AUTOMATING BIOLOGICAL STRUCTURE IDENTIFICATION USING MACHINE LEARNING
CN110659640B (zh) * 2019-09-27 2021-11-30 深圳市商汤科技有限公司 文本序列的识别方法及装置、电子设备和存储介质
US11354804B1 (en) 2019-09-27 2022-06-07 Verily Life Sciences Llc Transforming multispectral images to enhanced resolution images enabled by machine learning
US11462315B2 (en) 2019-11-26 2022-10-04 Enlitic, Inc. Medical scan co-registration and methods for use therewith
CN111062977B (zh) * 2019-12-13 2021-05-04 推想医疗科技股份有限公司 样本数据生成方法、装置、计算机设备及存储介质
CN111180048B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 肿瘤成分标注方法、装置、设备及存储介质
CN111260699B (zh) * 2019-12-30 2024-02-06 上海镜观生物科技有限公司 高清病理影像配准方法、装置、设备及存储介质
WO2021202482A1 (en) * 2020-03-30 2021-10-07 Verily Life Sciences Llc Artificial intelligence-based assistant for concurrent review of needle core prostate biopsies
US11620831B2 (en) * 2020-04-29 2023-04-04 Toyota Research Institute, Inc. Register sets of low-level features without data association
US12061994B2 (en) 2020-08-11 2024-08-13 Enlitic, Inc. Inference process visualization system for medical scans
WO2022036086A1 (en) 2020-08-13 2022-02-17 Ventana Medical Systems, Inc. Machine learning models for cell localization and classification learned using repel coding
JP7656691B2 (ja) * 2020-08-24 2025-04-03 ヴェンタナ メディカル システムズ， インク． 幾何学的特徴を使用するホールスライド注釈転送
US11669678B2 (en) 2021-02-11 2023-06-06 Enlitic, Inc. System with report analysis and methods for use therewith
JP2022135392A (ja) * 2021-03-05 2022-09-15 コニカミノルタ株式会社 医用情報管理装置、医用情報管理方法および医用情報管理プログラム
EP4374210A4 (en) * 2021-07-23 2025-06-04 Genomic Health, Inc. SYSTEMS AND METHODS FOR TRANSFERRING MARKINGS
WO2023043709A1 (en) 2021-09-17 2023-03-23 Ventana Medical Systems, Inc. Machine-learning techniques for predicting phenotypes in duplex digital pathology images
US12136484B2 (en) 2021-11-05 2024-11-05 Altis Labs, Inc. Method and apparatus utilizing image-based modeling in healthcare
US20250022149A1 (en) * 2021-11-08 2025-01-16 H. Lee Moffitt Cancer Center And Research Institute, Inc. Virtual alignment of pathology image series
CN118414640A (zh) 2021-12-23 2024-07-30 文塔纳医疗系统公司 数字病理学中深度学习模型的对抗鲁棒性
US20250166795A1 (en) * 2022-01-26 2025-05-22 Koninklijke Philips N.V. Smart annotation tool for pathological structures in brain scans
WO2023250094A1 (en) 2022-06-23 2023-12-28 Ventana Medical Systems, Inc. Adaptive learning framework for digital pathology
JP2025541735A (ja) 2022-12-02 2025-12-23 ヴェンタナ メディカル システムズ， インク． デジタル病理画像におけるコンセンサスラベリング
US12217837B2 (en) 2023-05-09 2025-02-04 Pramana, Inc. Systems and methods for digitization of tissue slides based on associations among serial sections
US12380578B2 (en) 2023-06-16 2025-08-05 Pramana, Inc. Apparatus and a method for on-demand registration of whole slide images
EP4549944A1 (en) * 2023-10-30 2025-05-07 Checkcells, Inc. Methods, systems and devices for testing biological sample
US12023817B1 (en) 2023-11-14 2024-07-02 Pramana, Inc. System and method for a slide marking technique for target tissue extraction and downstream application

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061476A (en) * 1997-11-24 2000-05-09 Cognex Corporation Method and apparatus using image subtraction and dynamic thresholding
JP2000342558A (ja) * 1999-06-04 2000-12-12 Konica Corp 画像の位置合わせ処理装置及び画像間演算処理装置
US7171030B2 (en) * 2000-11-30 2007-01-30 University Of Medicine & Denistry Of New Jersey Systems for analyzing microtissue arrays
WO2008108059A1 (ja) * 2007-03-01 2008-09-12 Nec Corporation 乳癌病理画像診断支援システム、乳癌病理画像診断支援方法、乳癌病理画像診断支援プログラム、及び、乳癌病理画像診断支援プログラムを記録した記録媒体
US7787810B2 (en) * 2007-07-27 2010-08-31 Xerox Corporation Active station adaptive image registration
US8787651B2 (en) * 2010-09-28 2014-07-22 Flagship Biosciences, LLC Methods for feature analysis on consecutive tissue sections
CN102298779B (zh) * 2011-08-16 2013-08-21 淮安盈科伟力科技有限公司 全景辅助泊车系统的图像配准方法
US8605972B2 (en) 2012-03-02 2013-12-10 Sony Corporation Automatic image alignment
JP5999359B2 (ja) * 2013-01-30 2016-09-28 富士ゼロックス株式会社 画像処理装置及び画像処理プログラム

Also Published As

Publication number Publication date
US20160019695A1 (en) 2016-01-21
CA2897614A1 (en) 2014-09-18
AU2014230809B2 (en) 2019-05-02
JP2016517559A (ja) 2016-06-16
CN105027164A (zh) 2015-11-04
WO2014140070A3 (en) 2014-11-27
WO2014140070A2 (en) 2014-09-18
US9818190B2 (en) 2017-11-14
EP2973396B1 (en) 2018-10-10
CA2897614C (en) 2019-05-28
AU2014230809A1 (en) 2015-07-23
EP2973396A2 (en) 2016-01-20
CN105027164B (zh) 2018-05-18

Similar Documents

Publication Publication Date Title
JP6378701B2 (ja) ホール・スライド画像レジストレーションおよび画像間注釈デバイス、システム、ならびに方法
US12211169B2 (en) Line-based image registration and cross-image annotation devices, systems and methods
US11681418B2 (en) Multi-sample whole slide image processing in digital pathology via multi-resolution registration and machine learning
JP7425145B2 (ja) 包括的なマルチアッセイ組織分析のためのシステムおよび方法
AU2020271905A1 (en) Deep learning based training of instance segmentation via regression layers
EP3633543A1 (en) System and method for reviewing and analyzing cytological specimens

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161114

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161114

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20171214

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20171221

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180322

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180608

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180628

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180727

R150 Certificate of patent or registration of utility model

Ref document number: 6378701

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250