CN102575990B - 使用荧光图像产生明场图像的系统和方法 - Google Patents

使用荧光图像产生明场图像的系统和方法 Download PDF

Info

Publication number
CN102575990B
CN102575990B CN201080044716.1A CN201080044716A CN102575990B CN 102575990 B CN102575990 B CN 102575990B CN 201080044716 A CN201080044716 A CN 201080044716A CN 102575990 B CN102575990 B CN 102575990B
Authority
CN
China
Prior art keywords
image
biological sample
images
light field
mapping parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201080044716.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN102575990A (zh
Inventor
A·肯
M·J·杰德斯
M·O·贝洛
Q·李
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Co
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Publication of CN102575990A publication Critical patent/CN102575990A/zh
Application granted granted Critical
Publication of CN102575990B publication Critical patent/CN102575990B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/645—Specially adapted constructive features of fluorimeters
    • G01N21/6456—Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458—Fluorescence microscopy
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6486—Measuring fluorescence of biological material, e.g. DNA, RNA, cells
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/483—Physical analysis of biological material
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/693—Acquisition
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N2021/6417—Spectrofluorimetric devices
    • G01N2021/6423—Spectral mapping, video display
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10064—Fluorescence image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Immunology (AREA)
  • General Health & Medical Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Theoretical Computer Science (AREA)
  • Molecular Biology (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Biophysics (AREA)
  • Hematology (AREA)
  • Urology & Nephrology (AREA)
  • Food Science & Technology (AREA)
  • Medicinal Chemistry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Processing Or Creating Images (AREA)
CN201080044716.1A 2009-09-29 2010-09-29 使用荧光图像产生明场图像的系统和方法 Expired - Fee Related CN102575990B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/569,396 US8269827B2 (en) 2009-09-29 2009-09-29 System and methods for mapping fluorescent images into a bright field color space
US12/569396 2009-09-29
PCT/SE2010/051046 WO2011040872A1 (en) 2009-09-29 2010-09-29 System and method for generating a brightfield image using fluorescent images

Publications (2)

Publication Number Publication Date
CN102575990A CN102575990A (zh) 2012-07-11
CN102575990B true CN102575990B (zh) 2015-06-17

Family

ID=43779911

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201080044716.1A Expired - Fee Related CN102575990B (zh) 2009-09-29 2010-09-29 使用荧光图像产生明场图像的系统和方法

Country Status (10)

Country Link
US (1) US8269827B2 (enExample)
EP (1) EP2483668A4 (enExample)
JP (1) JP5631999B2 (enExample)
KR (1) KR20120079080A (enExample)
CN (1) CN102575990B (enExample)
AU (1) AU2010301166A1 (enExample)
CA (1) CA2773268A1 (enExample)
IN (1) IN2012DN02129A (enExample)
RU (1) RU2012111453A (enExample)
WO (1) WO2011040872A1 (enExample)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8184901B2 (en) * 2007-02-12 2012-05-22 Tcms Transparent Beauty Llc System and method for applying a reflectance modifying agent to change a person's appearance based on a digital image
WO2011046807A2 (en) * 2009-10-12 2011-04-21 Ventana Medical Systems, Inc. Multi-modality contrast and brightfield context rendering for enhanced pathology determination and multi-analyte detection in tissue
US8639013B2 (en) * 2011-08-17 2014-01-28 General Electric Company System and methods for generating a brightfield image using fluorescent images
WO2013142366A1 (en) * 2012-03-19 2013-09-26 Genetic Innovations, Inc. Devices, systems, and methods for virtual staining
CN104520713A (zh) * 2012-03-30 2015-04-15 克拉里安特诊断服务公司 在单个样品上的免疫荧光和基于荧光的核酸分析
SG11201406104QA (en) * 2012-03-30 2014-10-30 Clarient Diagnostic Services Inc Methods for generating an image of a biological sample
WO2013164278A1 (en) 2012-04-30 2013-11-07 General Electric Company Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue
WO2013181418A2 (en) 2012-05-30 2013-12-05 Clarient Diagnostic Services, Inc. Multiplexed diagnosis method for classical hodgkin lymphoma
WO2014065889A2 (en) 2012-10-28 2014-05-01 Clarient Diagnostic Services, Inc. Multiplexed method for diagnosing classical hodgkin lymphoma
US9779500B2 (en) 2013-07-03 2017-10-03 Konica Minolta, Inc. Image processing device, pathological diagnosis support system, image processing program, and pathological diagnosis support method
CN113349707A (zh) * 2013-12-31 2021-09-07 纪念斯隆-凯特琳癌症中心 用于荧光源实时多通道成像的系统、方法和设备
US10614287B2 (en) 2014-06-16 2020-04-07 Siemens Healthcare Diagnostics Inc. Virtual staining of cells in digital holographic microscopy images using general adversarial networks
US10706260B2 (en) * 2014-06-16 2020-07-07 Siemens Healthcare Diagnostics Inc. Analyzing digital holographic microscopy data for hematology applications
JP6375925B2 (ja) * 2014-12-15 2018-08-22 コニカミノルタ株式会社 画像処理装置、画像処理システム、画像処理プログラム及び画像処理方法
WO2017110974A1 (ja) * 2015-12-24 2017-06-29 コニカミノルタ株式会社 画像処理装置及びプログラム
JP6755975B2 (ja) * 2016-06-10 2020-09-16 エフ・ホフマン−ラ・ロシュ・アクチェンゲゼルシャフト 明視野像シミュレーションのためのシステム
EP4567728A1 (en) * 2016-12-22 2025-06-11 Ventana Medical Systems, Inc. Computer scoring based on primary stain and immunohistochemistry images
TWI659395B (zh) 2017-07-19 2019-05-11 AcuSolutions Inc. 類ｈ＆ｅ影像之合成方法及採用該方法之光學系統
JP6901072B2 (ja) * 2017-08-30 2021-07-14 学校法人 埼玉医科大学 画像処理装置、画像処理方法、画像処理プログラム
WO2019106946A1 (ja) 2017-12-01 2019-06-06 ソニー株式会社 画像着色装置、画像着色方法、画像学習装置、画像学習方法、プログラム、及び画像着色システム
US10824847B2 (en) 2017-12-15 2020-11-03 Verily Life Sciences Llc Generating virtually stained images of unstained samples
US10665000B2 (en) 2018-01-08 2020-05-26 AcuSolutions Inc. Pseudo H and E image producing method and optical system using same
CN112106061B (zh) 2018-03-30 2025-02-18 加利福尼亚大学董事会 使用深度学习对未标记荧光图像进行数字染色的方法和系统
TWI683283B (zh) 2018-04-03 2020-01-21 薩摩亞商銳準醫光股份有限公司 一種生物樣本之影像合成方法及採用該方法之光學系統
CN110346291A (zh) * 2018-04-03 2019-10-18 锐准医光股份有限公司 一种生物样本的影像合成方法及采用该方法的光学系统
WO2020018154A1 (en) 2018-07-19 2020-01-23 The Regents Of The University Of California Method and system for digital staining of label-free phase images using deep learning
EP3867868B1 (en) * 2018-10-15 2025-03-19 Ventana Medical Systems, Inc. Image enhancement to enable improved nuclei detection and segmentation
CN113439205B (zh) * 2018-12-28 2024-07-23 贝克顿·迪金森公司 用于对样本的荧光团进行光谱解析的方法及其系统
JP7470339B2 (ja) * 2019-03-06 2024-04-18 学校法人 埼玉医科大学 染色画像推定器学習装置、画像処理装置、染色画像推定器学習方法、画像処理方法、染色画像推定器学習プログラム、及び、画像処理プログラム
US12094105B2 (en) * 2019-06-10 2024-09-17 Datma, Inc. System and method for automatic labeling of pathology images
US11354804B1 (en) 2019-09-27 2022-06-07 Verily Life Sciences Llc Transforming multispectral images to enhanced resolution images enabled by machine learning
CN114731364A (zh) * 2019-10-02 2022-07-08 化学影像公司 分子化学成像与rgb成像的融合
WO2021076623A1 (en) * 2019-10-14 2021-04-22 University Of Southern California Systems, methods and assays for outlier clustering unsupervised learning automated report (ocular)
JP2021124861A (ja) * 2020-02-04 2021-08-30 ソニーグループ株式会社 解析装置、解析方法、解析プログラム及び診断支援システム
EP3907497B1 (en) * 2020-05-08 2023-08-02 Leica Microsystems CMS GmbH Apparatus and method for displaying and/or printing images of a specimen including a fluorophore
CN112781958B (zh) * 2021-02-02 2022-07-08 江南大学 一种表征乳液分子特定成分流动性的方法
KR102799248B1 (ko) * 2021-02-24 2025-04-25 한국과학기술원 밀집 염색을 매개로 한 3차원 이미지 정합 및 이를 이용한 초고해상도 멀티 마커 동시 이미징 방법
US12474241B2 (en) * 2021-02-24 2025-11-18 Korea Advanced Institute Of Science And Technology 3D image registration via dense staining and super-resolution multiplexed imaging method using the same
CN120163857B (zh) * 2025-05-20 2025-11-04 中国人民解放军总医院第一医学中心 一种用于自发荧光与he染色图像配准的虚拟染色验证方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1349633A (zh) * 1999-05-13 2002-05-15 分析科学公司 数字图像转换
US20080032328A1 (en) * 2006-08-07 2008-02-07 General Electric Company System and method for co-registering multi-channel images of a tissue micro array
US20080118934A1 (en) * 2006-11-16 2008-05-22 General Electric Company Sequential analysis of biological samples
US20090166570A1 (en) * 2007-12-26 2009-07-02 Olympus Corporation Biological-specimen observation apparatus

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2991001A (en) * 1959-04-06 1961-07-04 William L Hughes Resealable container
US5880473A (en) * 1997-07-28 1999-03-09 Applied Imaging, Inc. Multifluor-fluorescence in-situ hybridization (M-FISH) imaging techniques using multiple multiband filters with image registration
US7018614B2 (en) 2002-11-05 2006-03-28 Eastern Isotopes, Inc. Stabilization of radiopharmaceuticals labeled with 18-F
WO2005050563A2 (en) 2003-11-17 2005-06-02 Aureon Biosciences Corporation Pathological tissue mapping
US8320650B2 (en) * 2005-11-30 2012-11-27 Lawrence Livermore National Security, Llc In vivo spectral micro-imaging of tissue
GB0601509D0 (en) 2006-01-26 2006-03-08 Maddison John Method And Apparatus For Aligning Microscope Images
WO2008021681A2 (en) 2006-08-07 2008-02-21 General Electric Company System and methods for analyzing images of tissue samples
JP2008139796A (ja) * 2006-12-05 2008-06-19 Keyence Corp 蛍光顕微鏡、蛍光顕微鏡の操作方法、蛍光顕微鏡操作プログラム及びコンピュータで読み取り可能な記録媒体並びに記録した機器
US8244021B2 (en) * 2006-12-20 2012-08-14 Ventana Medical Systems, Inc. Quantitative, multispectral image analysis of tissue specimens stained with quantum dots
WO2008100555A2 (en) * 2007-02-14 2008-08-21 Drexel University Engineered lung tissue construction for high throughput toxicity screening and drug discovery
US8124749B2 (en) * 2007-06-12 2012-02-28 Case Western Reserve University Targeted cell death
US8712139B2 (en) * 2008-03-21 2014-04-29 General Electric Company Methods and systems for automated segmentation of dense cell populations
US8369600B2 (en) * 2008-03-25 2013-02-05 General Electric Company Method and apparatus for detecting irregularities in tissue microarrays
US20110165566A1 (en) * 2009-07-09 2011-07-07 Wittliff James L Methods of optimizing treatment of breast cancer

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1349633A (zh) * 1999-05-13 2002-05-15 分析科学公司 数字图像转换
US20080032328A1 (en) * 2006-08-07 2008-02-07 General Electric Company System and method for co-registering multi-channel images of a tissue micro array
US20080118934A1 (en) * 2006-11-16 2008-05-22 General Electric Company Sequential analysis of biological samples
US20090166570A1 (en) * 2007-12-26 2009-07-02 Olympus Corporation Biological-specimen observation apparatus

Also Published As

Publication number Publication date
CN102575990A (zh) 2012-07-11
KR20120079080A (ko) 2012-07-11
IN2012DN02129A (enExample) 2015-08-21
JP5631999B2 (ja) 2014-11-26
JP2013506129A (ja) 2013-02-21
CA2773268A1 (en) 2011-04-07
EP2483668A1 (en) 2012-08-08
AU2010301166A1 (en) 2012-03-29
WO2011040872A1 (en) 2011-04-07
US8269827B2 (en) 2012-09-18
EP2483668A4 (en) 2017-11-15
US20110074944A1 (en) 2011-03-31
RU2012111453A (ru) 2013-11-20

Similar Documents

Publication Publication Date Title
CN102575990B (zh) 使用荧光图像产生明场图像的系统和方法
US8639013B2 (en) System and methods for generating a brightfield image using fluorescent images
Mebratie et al. Review of immunohistochemistry techniques: Applications, current status, and future perspectives
CN101932925B (zh) 用于从图像中除去自身荧光的方法和系统
US8067241B2 (en) Method and apparatus for antigen retrieval process
CN110337588B (zh) 用于定量免疫组织化学的方法和系统
US20150141278A1 (en) Multiplexed assay method for lung cancer classification
US20150226743A1 (en) Multiplexed method for diagnosing classical hodgkin lymphoma
EP2972227A1 (en) Digitally enhanced microscopy for multiplexed histology
US8135187B2 (en) Method and apparatus for removing tissue autofluorescence
US20190120845A1 (en) Tissue profiling using multiplexed immunohistochemical consecutive staining
JP5887823B2 (ja) 組織評価方法
JPWO2019172097A1 (ja) 画像処理方法、画像処理装置及びプログラム
KR101969847B1 (ko) 동일 검체에서 여러 항원을 검출하기 위한 순차적 다중 면역염색법
Moeder et al. Quantitative, fluorescence-based in-situ assessment of protein expression
KR102869006B1 (ko) 다중면역형광염색을 이용한 세포 시료에서 표적 단백질을 검출하는 방법
HK1172950A (en) System and method for generating a brightfield image using fluorescent images
EP4249889B1 (en) Methods for analyzing biopsies and biological samples
HK1173494B (en) Method and apparatus for antigen retrieval process

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1172950

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150617

Termination date: 20160929