JP7467466B2 - マルチチャネル直交畳み込みニューラルネットワーク - Google Patents

マルチチャネル直交畳み込みニューラルネットワーク Download PDF

Info

Publication number
JP7467466B2
JP7467466B2 JP2021533203A JP2021533203A JP7467466B2 JP 7467466 B2 JP7467466 B2 JP 7467466B2 JP 2021533203 A JP2021533203 A JP 2021533203A JP 2021533203 A JP2021533203 A JP 2021533203A JP 7467466 B2 JP7467466 B2 JP 7467466B2
Authority
JP
Japan
Prior art keywords
tissue
image
plaque
features
neural network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021533203A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020123739A5 (enExample
JP2022513200A (ja
Inventor
トーマス イー． ミルナー，
オースティン マッケルロイ，
エイディン ザヘディヴァシュ，
ニテシュ カッタ，
Original Assignee
リサーチ ディベロップメント ファウンデーション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by リサーチ ディベロップメント ファウンデーション filed Critical リサーチ ディベロップメント ファウンデーション
Publication of JP2022513200A publication Critical patent/JP2022513200A/ja
Publication of JPWO2020123739A5 publication Critical patent/JPWO2020123739A5/ja
Priority to JP2023217939A priority Critical patent/JP2024023852A/ja
Application granted granted Critical
Publication of JP7467466B2 publication Critical patent/JP7467466B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062—Arrangements for scanning
    • A61B5/0066—Optical coherence imaging
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/02007—Evaluating blood vessel condition, e.g. elasticity, compliance
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
    • A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
    • A61B5/6852—Catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/42—Arrangements for detecting radiation specially adapted for radiation diagnosis
    • A61B6/4208—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector
    • A61B6/4241—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector using energy resolving detectors, e.g. photon counting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/003—Reconstruction from projections, e.g. tomography
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0233—Special features of optical sensors or probes classified in A61B5/00
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10068—Endoscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10101—Optical tomography; Optical coherence tomography [OCT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Physiology (AREA)
  • Quality & Reliability (AREA)
  • Vascular Medicine (AREA)
  • Cardiology (AREA)
  • Optics & Photonics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Fuzzy Systems (AREA)
JP2021533203A 2018-12-14 2019-12-12 マルチチャネル直交畳み込みニューラルネットワーク Active JP7467466B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2023217939A JP2024023852A (ja) 2018-12-14 2023-12-25 マルチチャネル直交畳み込みニューラルネットワーク

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862779888P 2018-12-14 2018-12-14
US62/779,888 2018-12-14
PCT/US2019/065850 WO2020123739A1 (en) 2018-12-14 2019-12-12 Multi-channel orthogonal convolutional neural networks

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023217939A Division JP2024023852A (ja) 2018-12-14 2023-12-25 マルチチャネル直交畳み込みニューラルネットワーク

Publications (3)

Publication Number Publication Date
JP2022513200A JP2022513200A (ja) 2022-02-07
JPWO2020123739A5 JPWO2020123739A5 (enExample) 2022-12-19
JP7467466B2 true JP7467466B2 (ja) 2024-04-15

Family

ID=71073798

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021533203A Active JP7467466B2 (ja) 2018-12-14 2019-12-12 マルチチャネル直交畳み込みニューラルネットワーク
JP2023217939A Withdrawn JP2024023852A (ja) 2018-12-14 2023-12-25 マルチチャネル直交畳み込みニューラルネットワーク

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2023217939A Withdrawn JP2024023852A (ja) 2018-12-14 2023-12-25 マルチチャネル直交畳み込みニューラルネットワーク

Country Status (5)

Country Link
US (1) US11779220B2 (enExample)
EP (1) EP3893734A4 (enExample)
JP (2) JP7467466B2 (enExample)
AU (1) AU2019397494B2 (enExample)
WO (1) WO2020123739A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11189171B2 (en) * 2018-03-13 2021-11-30 Nec Corporation Traffic prediction with reparameterized pushforward policy for autonomous vehicles
US11250294B2 (en) 2019-01-13 2022-02-15 Lightlab Imaging, Inc. Systems and methods for classification of arterial image regions and features thereof
GB201906103D0 (en) * 2019-05-01 2019-06-12 Cambridge Entpr Ltd Method and apparatus for analysing intracoronary images
US11030743B2 (en) 2019-05-16 2021-06-08 Tencent America LLC System and method for coronary calcium deposits detection and labeling
KR102068279B1 (ko) * 2019-10-04 2020-01-20 주식회사 루닛 이미지 분석 방법 및 시스템
WO2021183138A1 (en) * 2020-03-13 2021-09-16 Hewlett-Packard Development Company, L.P. Media classification
US12458778B2 (en) 2020-08-06 2025-11-04 Canon U.S.A., Inc. Optimized catheter sheath for Rx catheter
CN114792374A (zh) * 2021-01-23 2022-07-26 富泰华工业（深圳）有限公司 基于纹理分类的图像识别方法、电子装置及存储介质
KR102527241B1 (ko) * 2021-03-30 2023-04-28 한국과학기술원 다중 모달 융합 영상을 이용한 동맥경화반 조직분석 방법 및 장치
WO2023077239A1 (en) * 2021-11-05 2023-05-11 Daskalopoulou Styliani Stella Method and system for detection of histopathological plaque features in medical images using deep neural networks
CN114387464B (zh) * 2021-12-01 2024-11-08 杭州脉流科技有限公司 基于ivus影像的易损斑块识别方法、计算机设备、可读存储介质和程序产品
CN115005772B (zh) * 2022-05-23 2025-01-24 深圳市中科微光医疗器械技术有限公司 一种基于oct图像的斑块检测方法、装置及终端设备
CN115281825A (zh) * 2022-08-12 2022-11-04 天津恒宇医疗科技有限公司 基于神经网络的可调谐激光斑块识别消蚀系统及识别方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160078309A1 (en) 2014-09-12 2016-03-17 Research Development Foundation Apparatus and methods for identifying and evaluating bright spot indications observed through optical coherence tomography
WO2017214421A1 (en) 2016-06-08 2017-12-14 Research Development Foundation Systems and methods for automated coronary plaque characterization and risk assessment using intravascular optical coherence tomography

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995651A (en) 1996-07-11 1999-11-30 Duke University Image content classification methods, systems and computer programs using texture patterns
DE10297689B4 (de) 2001-05-01 2007-10-18 The General Hospital Corp., Boston Verfahren und Gerät zur Bestimmung von atherosklerotischem Belag durch Messung von optischen Gewebeeigenschaften
US7016048B2 (en) * 2002-04-09 2006-03-21 The Regents Of The University Of California Phase-resolved functional optical coherence tomography: simultaneous imaging of the stokes vectors, structure, blood flow velocity, standard deviation and birefringence in biological samples
DE102005010076A1 (de) 2005-03-04 2006-09-07 Siemens Ag Bildbearbeitungsverfahren für ein digitales medizinisches Untersuchungsbild und zugehörige Untersuchungseinrichtung
WO2009121067A1 (en) * 2008-03-28 2009-10-01 Volcano Corporation Method and apparatus for simultaneous hemoglobin reflectivity measurement
US20120022360A1 (en) * 2008-03-28 2012-01-26 Volcano Corporation Methods for intravascular imaging and flushing
EP2293714B1 (en) 2008-06-02 2014-08-13 Lightlab Imaging, Inc. Quantitative methods for obtaining tissue characteristics from optical coherence tomography images
US20120163693A1 (en) 2010-04-20 2012-06-28 Suri Jasjit S Non-Invasive Imaging-Based Prostate Cancer Prediction
US9482513B2 (en) 2013-03-14 2016-11-01 Research Development Foundation Apparatus and methods for optical coherence tomography and two-photon luminescence imaging
US10542954B2 (en) * 2014-07-14 2020-01-28 Volcano Corporation Devices, systems, and methods for improved accuracy model of vessel anatomy
US10478130B2 (en) * 2015-02-13 2019-11-19 Siemens Healthcare Gmbh Plaque vulnerability assessment in medical imaging

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160078309A1 (en) 2014-09-12 2016-03-17 Research Development Foundation Apparatus and methods for identifying and evaluating bright spot indications observed through optical coherence tomography
WO2017214421A1 (en) 2016-06-08 2017-12-14 Research Development Foundation Systems and methods for automated coronary plaque characterization and risk assessment using intravascular optical coherence tomography
JP2019518581A (ja) 2016-06-08 2019-07-04 リサーチ ディヴェロプメント ファウンデーション 血管内光干渉断層撮影法を用いた冠動脈プラークの自動特徴分析およびリスク評価のためのシステムおよび方法

Also Published As

Publication number Publication date
AU2019397494B2 (en) 2025-05-08
AU2019397494A1 (en) 2021-06-03
US11779220B2 (en) 2023-10-10
EP3893734A1 (en) 2021-10-20
JP2024023852A (ja) 2024-02-21
JP2022513200A (ja) 2022-02-07
WO2020123739A1 (en) 2020-06-18
US20200187790A1 (en) 2020-06-18
EP3893734A4 (en) 2022-08-10

Similar Documents

Publication Publication Date Title
JP7467466B2 (ja) マルチチャネル直交畳み込みニューラルネットワーク
JP7383070B2 (ja) 血管内光干渉断層撮影法を用いた冠動脈プラークの自動特徴分析およびリスク評価のためのシステムおよび方法
US11890077B2 (en) Apparatus, devices and methods for in vivo imaging and diagnosis
US11766176B2 (en) Apparatus, devices and methods for obtaining omnidirectional viewing by a catheter
US7539530B2 (en) Method and system for spectral examination of vascular walls through blood during cardiac motion
JP4241038B2 (ja) 組織分析のための光学的な方法及びシステム
Poneros Diagnosis of Barrett's esophagus using optical coherence tomography
JP2011516865A (ja) 化学分析モダリティーを補正する血管内構造分析のためのシステムおよび方法
JP7135050B2 (ja) 血管内画像処理のための血管内画像処理装置、方法及び非一時的記憶媒体
KR101746763B1 (ko) 망막 또는 맥락막 내 혈관조영 광가간섭 단층촬영 장치 및 이를 이용한 질병 진단방법
US11972561B2 (en) Auto-pullback triggering method for intracoronary imaging apparatuses or systems using blood clearing
Poneros et al. Diagnosis of Barrett's esophagus using optical coherence tomography
US20230289956A1 (en) System and Method for identifying potential false positive and blind spot locations in catheter-based multimodal images
JP2021168920A (ja) 低コヒーレンス干渉法のための方法及び装置
CN108604377B (zh) 处理光学相干断层成像扫描图
Villiger et al. Future development
Flueraru et al. Improved arterial tissue differentiation by spectroscopic optical coherence tomography
Dana et al. Conference 9303E: Diagnostic and Therapeutic Applications of Light in Cardiology

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221209

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221209

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230927

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231002

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231225

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240313

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240403

R150 Certificate of patent or registration of utility model

Ref document number: 7467466

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150