CA2773268A1 - System and methods for generating a brightfield image using fluorescent images - Google Patents

System and methods for generating a brightfield image using fluorescent images Download PDF

Info

Publication number
CA2773268A1
CA2773268A1 CA2773268A CA2773268A CA2773268A1 CA 2773268 A1 CA2773268 A1 CA 2773268A1 CA 2773268 A CA2773268 A CA 2773268A CA 2773268 A CA2773268 A CA 2773268A CA 2773268 A1 CA2773268 A1 CA 2773268A1
Authority
CA
Canada
Prior art keywords
image
fluorescent images
brightfield
biological sample
fluorescent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA2773268A
Other languages
English (en)
French (fr)
Inventor
Ali Can
Michael J. Gerdes
Musodiq O. Bello
Qing Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Co
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Publication of CA2773268A1 publication Critical patent/CA2773268A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/645—Specially adapted constructive features of fluorimeters
    • G01N21/6456—Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458—Fluorescence microscopy
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6486—Measuring fluorescence of biological material, e.g. DNA, RNA, cells
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/483—Physical analysis of biological material
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/693—Acquisition
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N2021/6417—Spectrofluorimetric devices
    • G01N2021/6423—Spectral mapping, video display
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10064—Fluorescence image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Immunology (AREA)
  • General Health & Medical Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Theoretical Computer Science (AREA)
  • Molecular Biology (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Biophysics (AREA)
  • Hematology (AREA)
  • Urology & Nephrology (AREA)
  • Food Science & Technology (AREA)
  • Medicinal Chemistry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Processing Or Creating Images (AREA)
CA2773268A 2009-09-29 2010-09-29 System and methods for generating a brightfield image using fluorescent images Abandoned CA2773268A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/569,396 US8269827B2 (en) 2009-09-29 2009-09-29 System and methods for mapping fluorescent images into a bright field color space
US12/569,396 2009-09-29
PCT/SE2010/051046 WO2011040872A1 (en) 2009-09-29 2010-09-29 System and method for generating a brightfield image using fluorescent images

Publications (1)

Publication Number Publication Date
CA2773268A1 true CA2773268A1 (en) 2011-04-07

Family

ID=43779911

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2773268A Abandoned CA2773268A1 (en) 2009-09-29 2010-09-29 System and methods for generating a brightfield image using fluorescent images

Country Status (10)

Country Link
US (1) US8269827B2 (enExample)
EP (1) EP2483668A4 (enExample)
JP (1) JP5631999B2 (enExample)
KR (1) KR20120079080A (enExample)
CN (1) CN102575990B (enExample)
AU (1) AU2010301166A1 (enExample)
CA (1) CA2773268A1 (enExample)
IN (1) IN2012DN02129A (enExample)
RU (1) RU2012111453A (enExample)
WO (1) WO2011040872A1 (enExample)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8184901B2 (en) * 2007-02-12 2012-05-22 Tcms Transparent Beauty Llc System and method for applying a reflectance modifying agent to change a person's appearance based on a digital image
WO2011046807A2 (en) * 2009-10-12 2011-04-21 Ventana Medical Systems, Inc. Multi-modality contrast and brightfield context rendering for enhanced pathology determination and multi-analyte detection in tissue
US8639013B2 (en) * 2011-08-17 2014-01-28 General Electric Company System and methods for generating a brightfield image using fluorescent images
WO2013142366A1 (en) * 2012-03-19 2013-09-26 Genetic Innovations, Inc. Devices, systems, and methods for virtual staining
CN104520713A (zh) * 2012-03-30 2015-04-15 克拉里安特诊断服务公司 在单个样品上的免疫荧光和基于荧光的核酸分析
SG11201406104QA (en) * 2012-03-30 2014-10-30 Clarient Diagnostic Services Inc Methods for generating an image of a biological sample
WO2013164278A1 (en) 2012-04-30 2013-11-07 General Electric Company Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue
WO2013181418A2 (en) 2012-05-30 2013-12-05 Clarient Diagnostic Services, Inc. Multiplexed diagnosis method for classical hodgkin lymphoma
WO2014065889A2 (en) 2012-10-28 2014-05-01 Clarient Diagnostic Services, Inc. Multiplexed method for diagnosing classical hodgkin lymphoma
US9779500B2 (en) 2013-07-03 2017-10-03 Konica Minolta, Inc. Image processing device, pathological diagnosis support system, image processing program, and pathological diagnosis support method
CN113349707A (zh) * 2013-12-31 2021-09-07 纪念斯隆-凯特琳癌症中心 用于荧光源实时多通道成像的系统、方法和设备
US10614287B2 (en) 2014-06-16 2020-04-07 Siemens Healthcare Diagnostics Inc. Virtual staining of cells in digital holographic microscopy images using general adversarial networks
US10706260B2 (en) * 2014-06-16 2020-07-07 Siemens Healthcare Diagnostics Inc. Analyzing digital holographic microscopy data for hematology applications
JP6375925B2 (ja) * 2014-12-15 2018-08-22 コニカミノルタ株式会社 画像処理装置、画像処理システム、画像処理プログラム及び画像処理方法
WO2017110974A1 (ja) * 2015-12-24 2017-06-29 コニカミノルタ株式会社 画像処理装置及びプログラム
JP6755975B2 (ja) * 2016-06-10 2020-09-16 エフ・ホフマン−ラ・ロシュ・アクチェンゲゼルシャフト 明視野像シミュレーションのためのシステム
EP4567728A1 (en) * 2016-12-22 2025-06-11 Ventana Medical Systems, Inc. Computer scoring based on primary stain and immunohistochemistry images
TWI659395B (zh) 2017-07-19 2019-05-11 AcuSolutions Inc. 類ｈ＆ｅ影像之合成方法及採用該方法之光學系統
JP6901072B2 (ja) * 2017-08-30 2021-07-14 学校法人 埼玉医科大学 画像処理装置、画像処理方法、画像処理プログラム
WO2019106946A1 (ja) 2017-12-01 2019-06-06 ソニー株式会社 画像着色装置、画像着色方法、画像学習装置、画像学習方法、プログラム、及び画像着色システム
US10824847B2 (en) 2017-12-15 2020-11-03 Verily Life Sciences Llc Generating virtually stained images of unstained samples
US10665000B2 (en) 2018-01-08 2020-05-26 AcuSolutions Inc. Pseudo H and E image producing method and optical system using same
CN112106061B (zh) 2018-03-30 2025-02-18 加利福尼亚大学董事会 使用深度学习对未标记荧光图像进行数字染色的方法和系统
TWI683283B (zh) 2018-04-03 2020-01-21 薩摩亞商銳準醫光股份有限公司 一種生物樣本之影像合成方法及採用該方法之光學系統
CN110346291A (zh) * 2018-04-03 2019-10-18 锐准医光股份有限公司 一种生物样本的影像合成方法及采用该方法的光学系统
WO2020018154A1 (en) 2018-07-19 2020-01-23 The Regents Of The University Of California Method and system for digital staining of label-free phase images using deep learning
EP3867868B1 (en) * 2018-10-15 2025-03-19 Ventana Medical Systems, Inc. Image enhancement to enable improved nuclei detection and segmentation
CN113439205B (zh) * 2018-12-28 2024-07-23 贝克顿·迪金森公司 用于对样本的荧光团进行光谱解析的方法及其系统
JP7470339B2 (ja) * 2019-03-06 2024-04-18 学校法人 埼玉医科大学 染色画像推定器学習装置、画像処理装置、染色画像推定器学習方法、画像処理方法、染色画像推定器学習プログラム、及び、画像処理プログラム
US12094105B2 (en) * 2019-06-10 2024-09-17 Datma, Inc. System and method for automatic labeling of pathology images
US11354804B1 (en) 2019-09-27 2022-06-07 Verily Life Sciences Llc Transforming multispectral images to enhanced resolution images enabled by machine learning
CN114731364A (zh) * 2019-10-02 2022-07-08 化学影像公司 分子化学成像与rgb成像的融合
WO2021076623A1 (en) * 2019-10-14 2021-04-22 University Of Southern California Systems, methods and assays for outlier clustering unsupervised learning automated report (ocular)
JP2021124861A (ja) * 2020-02-04 2021-08-30 ソニーグループ株式会社 解析装置、解析方法、解析プログラム及び診断支援システム
EP3907497B1 (en) * 2020-05-08 2023-08-02 Leica Microsystems CMS GmbH Apparatus and method for displaying and/or printing images of a specimen including a fluorophore
CN112781958B (zh) * 2021-02-02 2022-07-08 江南大学 一种表征乳液分子特定成分流动性的方法
KR102799248B1 (ko) * 2021-02-24 2025-04-25 한국과학기술원 밀집 염색을 매개로 한 3차원 이미지 정합 및 이를 이용한 초고해상도 멀티 마커 동시 이미징 방법
US12474241B2 (en) * 2021-02-24 2025-11-18 Korea Advanced Institute Of Science And Technology 3D image registration via dense staining and super-resolution multiplexed imaging method using the same
CN120163857B (zh) * 2025-05-20 2025-11-04 中国人民解放军总医院第一医学中心 一种用于自发荧光与he染色图像配准的虚拟染色验证方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2991001A (en) * 1959-04-06 1961-07-04 William L Hughes Resealable container
US5880473A (en) * 1997-07-28 1999-03-09 Applied Imaging, Inc. Multifluor-fluorescence in-situ hybridization (M-FISH) imaging techniques using multiple multiband filters with image registration
US6195451B1 (en) 1999-05-13 2001-02-27 Advanced Pathology Ststems, Inc. Transformation of digital images
US7018614B2 (en) 2002-11-05 2006-03-28 Eastern Isotopes, Inc. Stabilization of radiopharmaceuticals labeled with 18-F
WO2005050563A2 (en) 2003-11-17 2005-06-02 Aureon Biosciences Corporation Pathological tissue mapping
US8320650B2 (en) * 2005-11-30 2012-11-27 Lawrence Livermore National Security, Llc In vivo spectral micro-imaging of tissue
GB0601509D0 (en) 2006-01-26 2006-03-08 Maddison John Method And Apparatus For Aligning Microscope Images
WO2008021681A2 (en) 2006-08-07 2008-02-21 General Electric Company System and methods for analyzing images of tissue samples
US8131476B2 (en) 2006-08-07 2012-03-06 General Electric Company System and method for co-registering multi-channel images of a tissue micro array
US7741045B2 (en) * 2006-11-16 2010-06-22 General Electric Company Sequential analysis of biological samples
JP2008139796A (ja) * 2006-12-05 2008-06-19 Keyence Corp 蛍光顕微鏡、蛍光顕微鏡の操作方法、蛍光顕微鏡操作プログラム及びコンピュータで読み取り可能な記録媒体並びに記録した機器
US8244021B2 (en) * 2006-12-20 2012-08-14 Ventana Medical Systems, Inc. Quantitative, multispectral image analysis of tissue specimens stained with quantum dots
WO2008100555A2 (en) * 2007-02-14 2008-08-21 Drexel University Engineered lung tissue construction for high throughput toxicity screening and drug discovery
US8124749B2 (en) * 2007-06-12 2012-02-28 Case Western Reserve University Targeted cell death
US8791427B2 (en) * 2007-12-26 2014-07-29 Olympus Corporation Biological-specimen observation apparatus
US8712139B2 (en) * 2008-03-21 2014-04-29 General Electric Company Methods and systems for automated segmentation of dense cell populations
US8369600B2 (en) * 2008-03-25 2013-02-05 General Electric Company Method and apparatus for detecting irregularities in tissue microarrays
US20110165566A1 (en) * 2009-07-09 2011-07-07 Wittliff James L Methods of optimizing treatment of breast cancer

Also Published As

Publication number Publication date
CN102575990A (zh) 2012-07-11
KR20120079080A (ko) 2012-07-11
IN2012DN02129A (enExample) 2015-08-21
JP5631999B2 (ja) 2014-11-26
JP2013506129A (ja) 2013-02-21
EP2483668A1 (en) 2012-08-08
CN102575990B (zh) 2015-06-17
AU2010301166A1 (en) 2012-03-29
WO2011040872A1 (en) 2011-04-07
US8269827B2 (en) 2012-09-18
EP2483668A4 (en) 2017-11-15
US20110074944A1 (en) 2011-03-31
RU2012111453A (ru) 2013-11-20

Similar Documents

Publication Publication Date Title
US8269827B2 (en) System and methods for mapping fluorescent images into a bright field color space
US8639013B2 (en) System and methods for generating a brightfield image using fluorescent images
AU2010287027B2 (en) Method and apparatus for antigen retrieval process
JP5496906B2 (ja) 画像から自己蛍光を除去する方法及びシステム
AU2013240127B2 (en) Immunofluorescence and fluorescent-based nucleic acid analysis on a single sample
US20150226743A1 (en) Multiplexed method for diagnosing classical hodgkin lymphoma
US20150141278A1 (en) Multiplexed assay method for lung cancer classification
US20150050650A1 (en) Methods for generating an image of a biological sample
Moeder et al. Quantitative, fluorescence-based in-situ assessment of protein expression
HK1172950A (en) System and method for generating a brightfield image using fluorescent images
Lin et al. Hsien‑Neng Huang, Chun‑Wei Kuo, Yu‑Ling Hung 3, Chia‑Hung Yang 3, Yu‑Han Hsieh 3
HK1173494B (en) Method and apparatus for antigen retrieval process

Legal Events

Date Code Title Description
FZDE Discontinued

Effective date: 20160929