WO2021076075A3 - Cell viability analysis and counting from holograms by using deep learning and appropriate lensless holographic microscope - Google Patents

Cell viability analysis and counting from holograms by using deep learning and appropriate lensless holographic microscope Download PDF

Info

Publication number
WO2021076075A3
WO2021076075A3 PCT/TR2020/050485 TR2020050485W WO2021076075A3 WO 2021076075 A3 WO2021076075 A3 WO 2021076075A3 TR 2020050485 W TR2020050485 W TR 2020050485W WO 2021076075 A3 WO2021076075 A3 WO 2021076075A3
Authority
WO
WIPO (PCT)
Prior art keywords
viability analysis
deep learning
images
holographic microscope
holograms
Prior art date
Application number
PCT/TR2020/050485
Other languages
French (fr)
Other versions
WO2021076075A2 (en
Inventor
Hüseyin Cumhur TEKİN
Mustafa ÖZUYSAL
Engin ÖZÇİVİCİ
Kerem DELİKOYUN
Ersin ÇİNE
Original Assignee
İzmi̇r Yüksek Teknoloji̇ Ensti̇tüsü
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by İzmi̇r Yüksek Teknoloji̇ Ensti̇tüsü filed Critical İzmi̇r Yüksek Teknoloji̇ Ensti̇tüsü
Publication of WO2021076075A2 publication Critical patent/WO2021076075A2/en
Publication of WO2021076075A3 publication Critical patent/WO2021076075A3/en

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/34—Microscope slides, e.g. mounting specimens on microscope slides
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/005—Adaptation of holography to specific applications in microscopy, e.g. digital holographic microscope [DHM]
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G03H2001/0447—In-line recording arrangement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30242—Counting objects in image

Abstract

The invention is a holographic microscope (1) which detects the difference between the dead and live cells directly from the hologram images by training the deep learning based convolutional neural network and then makes predictions for viability analysis from the cell holograms obtained from the new samples (A) that were not used for training, and does not contain lens, mirror and similar optical elements, characterized in that, it comprises the following; a light source (10) which can be a laser or a light emitting diode (LED), an image sensor (30) which captures the images, a microfluidic chip (20) where the sample (A) located, a convolutional neural network which is formed in a server, is trained by predefining the hologram and/or phase images of dead and live cells, which are stained with Trypan blue or not and are stationary or flowing, and enable to make viability analysis to the samples (A).
PCT/TR2020/050485 2019-10-14 2020-06-04 Cell viability analysis and counting from holograms by using deep learning and appropriate lensless holographic microscope WO2021076075A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2019/15794A TR201915794A2 (en) 2019-10-14 2019-10-14
TR2019/15794 2019-10-14

Publications (2)

Publication Number Publication Date
WO2021076075A2 WO2021076075A2 (en) 2021-04-22
WO2021076075A3 true WO2021076075A3 (en) 2021-06-17

Family

ID=75538214

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2020/050485 WO2021076075A2 (en) 2019-10-14 2020-06-04 Cell viability analysis and counting from holograms by using deep learning and appropriate lensless holographic microscope

Country Status (2)

Country Link
TR (1) TR201915794A2 (en)
WO (1) WO2021076075A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114414850B (en) * 2021-12-13 2024-03-19 中国科学院深圳先进技术研究院 Bacterial activity detection method, apparatus, device and storage medium thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019171546A1 (en) * 2018-03-08 2019-09-12 株式会社島津製作所 Cellular image analysis method, cellular image analysis device, and learning model creation method
WO2019180848A1 (en) * 2018-03-20 2019-09-26 株式会社島津製作所 Cell image analysis device, cell image analysis system, learning data generation method, learning model generation method, learning data generation program, and learning data production method
WO2019191697A1 (en) * 2018-03-30 2019-10-03 The Regents Of The University Of California Method and system for digital staining of label-free fluorescence images using deep learning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019171546A1 (en) * 2018-03-08 2019-09-12 株式会社島津製作所 Cellular image analysis method, cellular image analysis device, and learning model creation method
WO2019180848A1 (en) * 2018-03-20 2019-09-26 株式会社島津製作所 Cell image analysis device, cell image analysis system, learning data generation method, learning model generation method, learning data generation program, and learning data production method
WO2019191697A1 (en) * 2018-03-30 2019-10-03 The Regents Of The University Of California Method and system for digital staining of label-free fluorescence images using deep learning

Also Published As

Publication number Publication date
WO2021076075A2 (en) 2021-04-22
TR201915794A2 (en) 2021-04-21

Similar Documents

Publication Publication Date Title
Gӧrӧcs et al. A deep learning-enabled portable imaging flow cytometer for cost-effective, high-throughput, and label-free analysis of natural water samples
Sasagawa et al. Highly sensitive lens-free fluorescence imaging device enabled by a complementary combination of interference and absorption filters
CN112352158A (en) Portable imaging flow cytometer capable of deep learning for label-free analysis of water samples
Shao et al. Machine learning holography for 3D particle field imaging
Zhang et al. Analyzing complex single-molecule emission patterns with deep learning
Zheng et al. Microscopy refocusing and dark-field imaging by using a simple LED array
Tian et al. Real-time quantitative phase imaging based on transport of intensity equation with dual simultaneously recorded field of view
Therrien et al. Wide-field multiphoton imaging of cellular dynamics in thick tissue by temporal focusing and patterned illumination
Yanagawa et al. Three-dimensional mapping of fluorescent nanoparticles using incoherent digital holography
Linder et al. On-chip imaging of Schistosoma haematobium eggs in urine for diagnosis by computer vision
Jaferzadeh et al. No-search focus prediction at the single cell level in digital holographic imaging with deep convolutional neural network
US20140333723A1 (en) Observation system, observation program, and observation method
WO2021076075A3 (en) Cell viability analysis and counting from holograms by using deep learning and appropriate lensless holographic microscope
CN112020856B (en) Camera module and method for extracting depth information by camera module
Lertvilai The In situ Plankton Assemblage eXplorer (IPAX): An inexpensive underwater imaging system for zooplankton study
Kwak et al. A simple and low-cost biofilm quantification method using LED and CMOS image sensor
WO2022137243A1 (en) Optical technique for analyzing insects, shrimp and fish
Göröcs et al. Label-free detection of Giardia lamblia cysts using a deep learning-enabled portable imaging flow cytometer
Farthing et al. Simultaneous two-color imaging in digital holographic microscopy
AU2016232975B2 (en) Method and apparatus for microscopy
Castanares et al. Efficient multi-site two-photon functional imaging of neuronal circuits
Saragadam et al. Programmable spectrometry: Per-pixel material classification using learned spectral filters
Maibohm et al. Interference patterns and extinction ratio of the diatom Coscinodiscus granii
Jaques et al. Temporal super-resolution microscopy using a hue-encoded shutter
WO2017147957A1 (en) Telecentric illumination and image capturing system for testing marine microorganism

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20877345

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20877345

Country of ref document: EP

Kind code of ref document: A2