EP3669227B8 - Identifying the quality of the cell images acquired with digital holographic microscopy using convolutional neural networks - Google Patents

Identifying the quality of the cell images acquired with digital holographic microscopy using convolutional neural networks Download PDF

Info

Publication number
EP3669227B8
EP3669227B8 EP18748860.6A EP18748860A EP3669227B8 EP 3669227 B8 EP3669227 B8 EP 3669227B8 EP 18748860 A EP18748860 A EP 18748860A EP 3669227 B8 EP3669227 B8 EP 3669227B8
Authority
EP
European Patent Office
Prior art keywords
identifying
quality
convolutional neural
neural networks
images acquired
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP18748860.6A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3669227B1 (en
EP3669227A1 (en
EP3669227C0 (en
Inventor
Noha Youssry El-Zehiry
Ali Kamen
Saikiran Rapaka
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens Healthineers AG
Original Assignee
Siemens Healthineers AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Healthineers AG filed Critical Siemens Healthineers AG
Publication of EP3669227A1 publication Critical patent/EP3669227A1/en
Publication of EP3669227B1 publication Critical patent/EP3669227B1/en
Publication of EP3669227C0 publication Critical patent/EP3669227C0/en
Application granted granted Critical
Publication of EP3669227B8 publication Critical patent/EP3669227B8/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0866—Digital holographic imaging, i.e. synthesizing holobjects from holograms
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/241—Devices for focusing
    • G02B21/244—Devices for focusing using image analysis techniques
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2431—Multiple classes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
    • G06V10/993—Evaluation of the quality of the acquired pattern
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/695—Preprocessing, e.g. image segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/698—Matching; Classification
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/005—Adaptation of holography to specific applications in microscopy, e.g. digital holographic microscope [DHM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20112—Image segmentation details
    • G06T2207/20132—Image cropping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20216—Image averaging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20224—Image subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30168—Image quality inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Quality & Reliability (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Image Analysis (AREA)
  • Microscoopes, Condenser (AREA)
EP18748860.6A 2017-08-15 2018-07-06 Identifying the quality of the cell images acquired with digital holographic microscopy using convolutional neural networks Active EP3669227B8 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762545517P 2017-08-15 2017-08-15
PCT/EP2018/068345 WO2019034328A1 (en) 2017-08-15 2018-07-06 IDENTIFYING THE QUALITY OF CELLULAR IMAGES ACQUIRED USING DIGITAL HOLOGRAPHIC MICROSCOPY USING CONVOLUTIONAL NEURAL NETWORKS

Publications (4)

Publication Number Publication Date
EP3669227A1 EP3669227A1 (en) 2020-06-24
EP3669227B1 EP3669227B1 (en) 2023-12-20
EP3669227C0 EP3669227C0 (en) 2023-12-20
EP3669227B8 true EP3669227B8 (en) 2024-02-28

Family

ID=63077840

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18748860.6A Active EP3669227B8 (en) 2017-08-15 2018-07-06 Identifying the quality of the cell images acquired with digital holographic microscopy using convolutional neural networks

Country Status (5)

Country Link
US (2) US11227386B2 (ja)
EP (1) EP3669227B8 (ja)
JP (1) JP7072049B2 (ja)
CN (1) CN111051955B (ja)
WO (1) WO2019034328A1 (ja)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11222415B2 (en) * 2018-04-26 2022-01-11 The Regents Of The University Of California Systems and methods for deep learning microscopy
US10706328B2 (en) * 2018-05-07 2020-07-07 Google Llc Focus-weighted, machine learning disease classifier error prediction for microscope slide images
EP3644228B1 (en) * 2018-10-23 2024-08-14 The Chinese University Of Hong Kong Method and apparatus for segmenting cellular image
DE102018133188A1 (de) * 2018-12-20 2020-06-25 Carl Zeiss Microscopy Gmbh Abstandbestimmung einer probenebene in einem mikroskopsystem
US11405547B2 (en) * 2019-02-01 2022-08-02 Electronics And Telecommunications Research Institute Method and apparatus for generating all-in-focus image using multi-focus image
AU2020262090A1 (en) * 2019-04-22 2021-11-11 The Regents Of The University Of California System and method for deep learning-based color holographic microscopy
EP3757648B1 (en) * 2019-06-28 2023-08-30 Associação Fraunhofer Portugal Optical system attachable to a mobile device for scanning biological sample slides and operating method thereof
CN110516561B (zh) * 2019-08-05 2022-12-06 西安电子科技大学 基于dcgan和cnn的sar图像目标识别方法
CN110736747B (zh) * 2019-09-03 2022-08-19 深思考人工智能机器人科技（北京）有限公司 一种细胞液基涂片镜下定位的方法及系统
CN111091539B (zh) * 2019-12-09 2024-03-26 上海联影智能医疗科技有限公司 网络模型训练、医学图像处理方法、装置、介质及设备
DE102020106857A1 (de) * 2020-03-12 2021-09-16 Carl Zeiss Microscopy Gmbh Mikroskopiesystem und verfahren zum verarbeiten von mikroskopbildern
GB2595873B (en) * 2020-06-09 2023-01-25 Ffei Ltd A method for analysing scanning efficacy
EP4177332A1 (en) * 2020-07-02 2023-05-10 FUJIFILM Corporation Information processing device, information processing method, and program
GB2596864A (en) * 2020-07-10 2022-01-12 Graphcore Ltd Machine learning computer
WO2022032126A1 (en) * 2020-08-07 2022-02-10 Nanotronics Imaging, Inc. Deep learning model for auto-focusing microscope systems
CN111709390A (zh) * 2020-08-11 2020-09-25 山东省食品药品检验研究院 基于显微图像的草酸钙晶体智能鉴别方法和系统
JP7495301B2 (ja) 2020-08-28 2024-06-04 浜松ホトニクス株式会社 学習モデル生成方法、識別方法、学習モデル生成システム、識別システム、学習モデル生成プログラム、識別プログラム及び記録媒体
JP7452702B2 (ja) 2020-11-30 2024-03-19 株式会社ニコン 学習済みモデルを生成する方法、画像処理方法、画像変換装置、プログラム
KR102449858B1 (ko) * 2021-07-08 2022-09-30 가톨릭대학교 산학협력단 암 세포 판정을 위한 핵이미지 선별 장치 및 핵이미지 선별 방법
WO2023008428A1 (ja) * 2021-07-29 2023-02-02 株式会社島津製作所 細胞画像解析方法
TWI828009B (zh) * 2021-11-19 2024-01-01 財團法人工業技術研究院 免標記式細胞活性檢測的方法及訓練人工智慧執行免標記式細胞活性檢測的方法
US11906433B2 (en) * 2021-12-14 2024-02-20 Instituto Potosino de Investigación Científica y Tecnológica A.C. System and method for three-dimensional imaging of unstained samples using bright field microscopy
CN118435233A (zh) * 2021-12-17 2024-08-02 贝克曼库尔特有限公司 通过多层处理的聚焦质量确定
KR102436267B1 (ko) * 2021-12-24 2022-08-26 (주)힉스컴퍼니 병렬 처리 방법 및 이를 이용한 고속 프로세싱 시스템
WO2024181593A1 (ko) * 2023-02-27 2024-09-06 가톨릭대학교 산학협력단 암 세포 판정을 위한 핵이미지 선별 장치 및 핵이미지 선별 방법
CN116563735A (zh) * 2023-05-15 2023-08-08 国网电力空间技术有限公司 一种基于深度人工智能的输电杆塔巡检图像对焦判断方法

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4998284A (en) * 1987-11-17 1991-03-05 Cell Analysis Systems, Inc. Dual color camera microscope and methodology for cell staining and analysis
US5655028A (en) * 1991-12-30 1997-08-05 University Of Iowa Research Foundation Dynamic image analysis system
WO1996010237A1 (en) * 1994-09-20 1996-04-04 Neopath, Inc. Biological specimen analysis system processing integrity checking apparatus
JPH09311102A (ja) * 1996-05-24 1997-12-02 Hitachi Ltd フロー式粒子画像解析方法および装置
US7034883B1 (en) 1999-08-10 2006-04-25 Cellavision Ab Automatic focusing
ATE484000T1 (de) * 1999-08-10 2010-10-15 Cellavision Ab Verfahren und vorrichtungen in einem optischen system
US20030143524A1 (en) * 2002-01-31 2003-07-31 Boaz Lerner Method and system for determining the amount, distribution and conformation of genetic material in a cell
US7760927B2 (en) * 2003-09-10 2010-07-20 Bioimagene, Inc. Method and system for digital image based tissue independent simultaneous nucleus cytoplasm and membrane quantitation
US20060178833A1 (en) 2005-02-04 2006-08-10 Bauer Kenneth D System for and method of providing diagnostic information through microscopic imaging
SE530750C2 (sv) * 2006-07-19 2008-09-02 Hemocue Ab En mätapparat, en metod och ett datorprogram
US8143600B2 (en) * 2008-02-18 2012-03-27 Visiongate, Inc. 3D imaging of live cells with ultraviolet radiation
US8326029B1 (en) * 2008-03-21 2012-12-04 Hewlett-Packard Development Company, L.P. Background color driven content retrieval
US7761250B2 (en) * 2008-06-18 2010-07-20 Tokyo Electron Limited Optical metrology system optimized with design goals
JP5476879B2 (ja) * 2008-09-29 2014-04-23 ソニー株式会社 画像処理装置および係数学習装置。
US8049811B2 (en) * 2009-01-28 2011-11-01 Board Of Regents, The University Of Texas System Automatic focusing apparatus and method for digital images using automatic filter switching
EP2430454B1 (en) * 2009-08-22 2013-01-23 The Board Of Trustees Of The University Of the Leland Stanford Junior University Imaging and evaluating embryos, oocytes, and stem cells
US20110059861A1 (en) 2009-09-08 2011-03-10 Nodality, Inc. Analysis of cell networks
WO2011052036A1 (ja) * 2009-10-27 2011-05-05 富士通株式会社 生体情報処理装置、生体情報処理方法及び生体情報処理用コンピュータプログラム
US8744164B2 (en) * 2010-04-06 2014-06-03 Institute For Systems Biology Automated analysis of images using bright field microscopy
CN102411715A (zh) 2010-09-21 2012-04-11 张云超 有监督学习功能的细胞图像自动分类方法和系统
US8503801B2 (en) * 2010-09-21 2013-08-06 Adobe Systems Incorporated System and method for classifying the blur state of digital image pixels
US9562861B2 (en) 2011-04-05 2017-02-07 Nalco Company Method of monitoring macrostickies in a recycling and paper or tissue making process involving recycled pulp
US20140192178A1 (en) * 2011-08-12 2014-07-10 Agency For Science, Technology And Research Method and system for tracking motion of microscopic objects within a three-dimensional volume
US8885941B2 (en) * 2011-09-16 2014-11-11 Adobe Systems Incorporated System and method for estimating spatially varying defocus blur in a digital image
US8902328B2 (en) * 2013-03-14 2014-12-02 Konica Minolta Laboratory U.S.A., Inc. Method of selecting a subset from an image set for generating high dynamic range image
AU2015261891A1 (en) 2014-05-23 2016-10-13 Ventana Medical Systems, Inc. Systems and methods for detection of biological structures and/or patterns in images
EP3364341B1 (en) 2014-06-16 2024-07-24 Siemens Healthcare Diagnostics Inc. Analyzing digital holographic microscopy data for hematology applications
US9927604B2 (en) * 2014-09-12 2018-03-27 Research Foundation Of The City University Of New York Biologically inspired algorithm based method for near real-time tracking of moving objects in three dimensional environment
US9524450B2 (en) * 2015-03-04 2016-12-20 Accenture Global Services Limited Digital image processing using convolutional neural networks
US9836839B2 (en) * 2015-05-28 2017-12-05 Tokitae Llc Image analysis systems and related methods
US10957042B2 (en) 2015-09-22 2021-03-23 Siemens Healthcare Gmbh Auto-referencing in digital holographic microscopy reconstruction
US10460231B2 (en) 2015-12-29 2019-10-29 Samsung Electronics Co., Ltd. Method and apparatus of neural network based image signal processor
EP3220130B1 (en) 2016-03-16 2023-03-01 Siemens Healthcare GmbH High accuracy 5-part differential with digital holographic microscopy and untouched leukocytes from peripheral blood
US20180018757A1 (en) * 2016-07-13 2018-01-18 Kenji Suzuki Transforming projection data in tomography by means of machine learning
US10573003B2 (en) * 2017-02-13 2020-02-25 Amit Sethi Systems and methods for computational pathology using points-of-interest
WO2018176017A1 (en) * 2017-03-24 2018-09-27 Revealit Corporation Method, system, and apparatus for identifying and revealing selected objects from video

Also Published As

Publication number Publication date
JP7072049B2 (ja) 2022-05-19
CN111051955B (zh) 2022-04-15
US20200184637A1 (en) 2020-06-11
WO2019034328A1 (en) 2019-02-21
EP3669227B1 (en) 2023-12-20
JP2020531971A (ja) 2020-11-05
EP3669227A1 (en) 2020-06-24
CN111051955A (zh) 2020-04-21
US20220092773A1 (en) 2022-03-24
EP3669227C0 (en) 2023-12-20
US11227386B2 (en) 2022-01-18
US11580640B2 (en) 2023-02-14

Similar Documents

Publication Publication Date Title
EP3669227B8 (en) Identifying the quality of the cell images acquired with digital holographic microscopy using convolutional neural networks
EP3292512A4 (en) Full reference image quality assessment based on convolutional neural network
EP3834135A4 (en) IMAGE ENHANCEMENT ARTIFICIAL INTELLIGENCE TECHNIQUES
EP3568773A4 (en) IMAGE-BASED PATHOLOGY PREDICTION USING ARTIFICIAL INTELLIGENCE
EP3820753A4 (en) VEHICLE DATA ANALYTICS
EP3465459A4 (en) ARTIFICIAL INTELLIGENCE-BASED NETWORK ADVISOR
EP3877936A4 (en) DIGITAL FIDUCIARY CURRENCY
EP3596543A4 (en) CAMERA WITH PANORAMIC SCAN
EP3593357A4 (en) MACHINE LEARNING FOR DIGITAL PATHOLOGY
EP3861481A4 (en) QUANTUM CONVOLUTED NEURAL NETWORKS
EP3465540A4 (en) EVALUATION OF DOCUMENT IMAGE QUALITY
EP3400557A4 (en) WEBINTERFACE PRODUCTION AND INSPECTION USING ARTIFICIAL NEURONAL NETWORKS
EP3607488A4 (en) METHODS AND SYSTEMS WITH IMPROVED NEURAL FOLDING NETWORKS FOR IMAGE PROCESSING
EP3642662A4 (en) MAGNIFICATION GLASSES WITH MULTIPLE CAMERAS
EP3518731A4 (en) NEURONAL NETWORK FOR EYE IMAGE SEGMENTATION AND IMAGE QUALITY ESTIMATION
EP3727674A4 (en) FLOW CELLS WITH HYDROGEL COATING
EP3432320A4 (en) SOLID ELECTROLYTE, AND METHOD OF MANUFACTURING THE SAME
EP3874413A4 (en) AUTOMATED GENERATION OF NEURAL NETWORKS
EP3734616A4 (en) SOLID ELECTROLYTE
EP3548998A4 (en) DIGITAL PENS WITH CAMERAS FOR VIDEO CONFERENCES
EP3333959A4 (en) Solid polymer electrolyte and method for producing same
EP3809425A4 (en) SOLID ELECTROLYTE BASED ON LGPS AND MANUFACTURING METHOD
EP3834424A4 (en) PROVISION OF VIDEO RECOMMENDATION
EP3678149A4 (en) METHOD FOR PRODUCING A LGPS-BASED SOLID ELECTROLYTE
EP3676849A4 (en) LAYERED RECORDING NETWORKS

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200212

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210915

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602018062909

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G02B0021240000

Ipc: G06V0020690000

Ref country code: DE

Free format text: PREVIOUS MAIN CLASS: G02B0021240000

RIC1 Information provided on ipc code assigned before grant

Ipc: G06V 10/764 20220101ALI20230717BHEP

Ipc: G06V 10/82 20220101ALI20230717BHEP

Ipc: G06V 10/98 20220101ALI20230717BHEP

Ipc: G06V 20/69 20220101AFI20230717BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230829

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018062909

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: PK

Free format text: BERICHTIGUNG B8

U01 Request for unitary effect filed

Effective date: 20240104

RAP2 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: SIEMENS HEALTHINEERS AG

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20240112

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240321

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240321

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240320

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

U1N Appointed representative for the unitary patent procedure changed [after the registration of the unitary effect]

Representative=s name: SIEMENS HEALTHINEERS PATENT ATTORNEYS; DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240420

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240420

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220

U20 Renewal fee paid [unitary effect]

Year of fee payment: 7

Effective date: 20240719

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231220