AU2019397494B2 - Multi-channel orthogonal convolutional neural networks - Google Patents

Multi-channel orthogonal convolutional neural networks Download PDF

Info

Publication number
AU2019397494B2
AU2019397494B2 AU2019397494A AU2019397494A AU2019397494B2 AU 2019397494 B2 AU2019397494 B2 AU 2019397494B2 AU 2019397494 A AU2019397494 A AU 2019397494A AU 2019397494 A AU2019397494 A AU 2019397494A AU 2019397494 B2 AU2019397494 B2 AU 2019397494B2
Authority
AU
Australia
Prior art keywords
tissue
plaque
image
neural network
features
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
AU2019397494A
Other languages
English (en)
Other versions
AU2019397494A1 (en
Inventor
Nitesh Katta
Austin MCELROY
Thomas E. Milner
Aydin ZAHEDIVASH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Research Development Foundation
Original Assignee
Research Development Foundation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research Development Foundation filed Critical Research Development Foundation
Publication of AU2019397494A1 publication Critical patent/AU2019397494A1/en
Application granted granted Critical
Publication of AU2019397494B2 publication Critical patent/AU2019397494B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062—Arrangements for scanning
    • A61B5/0066—Optical coherence imaging
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/02007—Evaluating blood vessel condition, e.g. elasticity, compliance
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
    • A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
    • A61B5/6852—Catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/42—Arrangements for detecting radiation specially adapted for radiation diagnosis
    • A61B6/4208—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector
    • A61B6/4241—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector using energy resolving detectors, e.g. photon counting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T12/00—Tomographic reconstruction from projections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0233—Special features of optical sensors or probes classified in A61B5/00
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10068—Endoscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10101—Optical tomography; Optical coherence tomography [OCT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Pathology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Physiology (AREA)
  • Quality & Reliability (AREA)
  • Vascular Medicine (AREA)
  • Cardiology (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Signal Processing (AREA)
AU2019397494A 2018-12-14 2019-12-12 Multi-channel orthogonal convolutional neural networks Active AU2019397494B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862779888P 2018-12-14 2018-12-14
US62/779,888 2018-12-14
PCT/US2019/065850 WO2020123739A1 (en) 2018-12-14 2019-12-12 Multi-channel orthogonal convolutional neural networks

Publications (2)

Publication Number Publication Date
AU2019397494A1 AU2019397494A1 (en) 2021-06-03
AU2019397494B2 true AU2019397494B2 (en) 2025-05-08

Family

ID=71073798

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2019397494A Active AU2019397494B2 (en) 2018-12-14 2019-12-12 Multi-channel orthogonal convolutional neural networks

Country Status (5)

Country Link
US (1) US11779220B2 (https=)
EP (1) EP3893734A4 (https=)
JP (2) JP7467466B2 (https=)
AU (1) AU2019397494B2 (https=)
WO (1) WO2020123739A1 (https=)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11189171B2 (en) * 2018-03-13 2021-11-30 Nec Corporation Traffic prediction with reparameterized pushforward policy for autonomous vehicles
CN119762473A (zh) * 2019-01-13 2025-04-04 光实验成像公司 用于动脉图像区域及其特征的分类的系统和方法
GB201906103D0 (en) * 2019-05-01 2019-06-12 Cambridge Entpr Ltd Method and apparatus for analysing intracoronary images
US11030743B2 (en) * 2019-05-16 2021-06-08 Tencent America LLC System and method for coronary calcium deposits detection and labeling
KR102068279B1 (ko) * 2019-10-04 2020-01-20 주식회사 루닛 이미지 분석 방법 및 시스템
WO2021183138A1 (en) * 2020-03-13 2021-09-16 Hewlett-Packard Development Company, L.P. Media classification
US12458778B2 (en) 2020-08-06 2025-11-04 Canon U.S.A., Inc. Optimized catheter sheath for Rx catheter
CN114792374A (zh) * 2021-01-23 2022-07-26 富泰华工业（深圳）有限公司 基于纹理分类的图像识别方法、电子装置及存储介质
KR102527241B1 (ko) * 2021-03-30 2023-04-28 한국과학기술원 다중 모달 융합 영상을 이용한 동맥경화반 조직분석 방법 및 장치
WO2023077239A1 (en) * 2021-11-05 2023-05-11 Daskalopoulou Styliani Stella Method and system for detection of histopathological plaque features in medical images using deep neural networks
CN114387464B (zh) * 2021-12-01 2024-11-08 杭州脉流科技有限公司 基于ivus影像的易损斑块识别方法、计算机设备、可读存储介质和程序产品
CN115005772B (zh) * 2022-05-23 2025-01-24 深圳市中科微光医疗器械技术有限公司 一种基于oct图像的斑块检测方法、装置及终端设备
CN115281825A (zh) * 2022-08-12 2022-11-04 天津恒宇医疗科技有限公司 基于神经网络的可调谐激光斑块识别消蚀系统及识别方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017214421A1 (en) * 2016-06-08 2017-12-14 Research Development Foundation Systems and methods for automated coronary plaque characterization and risk assessment using intravascular optical coherence tomography

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995651A (en) 1996-07-11 1999-11-30 Duke University Image content classification methods, systems and computer programs using texture patterns
WO2002088705A2 (en) 2001-05-01 2002-11-07 The General Hospital Corporation Method and apparatus for determination of atherosclerotic plaque type by measurement of tissue optical properties
US7016048B2 (en) * 2002-04-09 2006-03-21 The Regents Of The University Of California Phase-resolved functional optical coherence tomography: simultaneous imaging of the stokes vectors, structure, blood flow velocity, standard deviation and birefringence in biological samples
DE102005010076A1 (de) 2005-03-04 2006-09-07 Siemens Ag Bildbearbeitungsverfahren für ein digitales medizinisches Untersuchungsbild und zugehörige Untersuchungseinrichtung
WO2009121067A1 (en) * 2008-03-28 2009-10-01 Volcano Corporation Method and apparatus for simultaneous hemoglobin reflectivity measurement
US20120022360A1 (en) * 2008-03-28 2012-01-26 Volcano Corporation Methods for intravascular imaging and flushing
WO2009149131A1 (en) 2008-06-02 2009-12-10 Lightlab Imaging, Inc. Quantitative methods for obtaining tissue characteristics from optical coherence tomography images
US20120163693A1 (en) 2010-04-20 2012-06-28 Suri Jasjit S Non-Invasive Imaging-Based Prostate Cancer Prediction
US9482513B2 (en) 2013-03-14 2016-11-01 Research Development Foundation Apparatus and methods for optical coherence tomography and two-photon luminescence imaging
US10542954B2 (en) * 2014-07-14 2020-01-28 Volcano Corporation Devices, systems, and methods for improved accuracy model of vessel anatomy
US9633277B2 (en) * 2014-09-12 2017-04-25 Research Development Foundation Apparatus and methods for identifying and evaluating bright spot indications observed through optical coherence tomography
US10478130B2 (en) * 2015-02-13 2019-11-19 Siemens Healthcare Gmbh Plaque vulnerability assessment in medical imaging

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017214421A1 (en) * 2016-06-08 2017-12-14 Research Development Foundation Systems and methods for automated coronary plaque characterization and risk assessment using intravascular optical coherence tomography

Also Published As

Publication number Publication date
AU2019397494A1 (en) 2021-06-03
EP3893734A4 (en) 2022-08-10
JP7467466B2 (ja) 2024-04-15
JP2024023852A (ja) 2024-02-21
WO2020123739A1 (en) 2020-06-18
JP2022513200A (ja) 2022-02-07
US20200187790A1 (en) 2020-06-18
EP3893734A1 (en) 2021-10-20
US11779220B2 (en) 2023-10-10

Similar Documents

Publication Publication Date Title
JP7383070B2 (ja) 血管内光干渉断層撮影法を用いた冠動脈プラークの自動特徴分析およびリスク評価のためのシステムおよび方法
AU2019397494B2 (en) Multi-channel orthogonal convolutional neural networks
US9633277B2 (en) Apparatus and methods for identifying and evaluating bright spot indications observed through optical coherence tomography
US10495440B2 (en) Apparatus and methods for optical coherence tomography and two-photon luminescence imaging
Leitgeb et al. Multimodal optical medical imaging concepts based on optical coherence tomography
US11259702B2 (en) Fiber optic imaging probe having cladding mode pullback trigger, and control method therefor
Lee et al. Comprehensive intravascular imaging of atherosclerotic plaque in vivo using optical coherence tomography and fluorescence lifetime imaging
Marcu Fluorescence lifetime in cardiovascular diagnostics
US12541843B2 (en) System and method for identifying potential false positive and blind spot locations in catheter-based multimodal images
Poneros et al. Diagnosis of Barrett's esophagus using optical coherence tomography
Villiger et al. Future development
Wilson Medical Diagnostics
Phipps et al. Endoscopic fluorescence lifetime imaging microscopy (FLIM) images of aortic plaque: an automated classification method
Ko et al. Conference 8207E: Diagnostic and Therapeutic Applications of Light in Cardiology
Thomas Detection of Atherosclerotic Coronary Plaques by Fluorescence Lifetime Imaging Angioscopy
HK1217227B (zh) 用於光学相干断层扫描和双光子荧光成像的设备和方法

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)