JP2023513646A - 内視鏡を用いた大腸検査ガイド装置及び方法 - Google Patents
内視鏡を用いた大腸検査ガイド装置及び方法 Download PDFInfo
- Publication number
- JP2023513646A JP2023513646A JP2021568482A JP2021568482A JP2023513646A JP 2023513646 A JP2023513646 A JP 2023513646A JP 2021568482 A JP2021568482 A JP 2021568482A JP 2021568482 A JP2021568482 A JP 2021568482A JP 2023513646 A JP2023513646 A JP 2023513646A
- Authority
- JP
- Japan
- Prior art keywords
- fold
- image
- visual effect
- endoscope
- large intestine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 210000001072 colon Anatomy 0.000 title claims description 21
- 210000002429 large intestine Anatomy 0.000 claims abstract description 74
- 230000000007 visual effect Effects 0.000 claims abstract description 69
- 210000004204 blood vessel Anatomy 0.000 claims description 25
- 238000002052 colonoscopy Methods 0.000 claims description 17
- 239000003550 marker Substances 0.000 claims description 16
- 238000013136 deep learning model Methods 0.000 claims description 15
- 230000008859 change Effects 0.000 claims description 9
- 238000004891 communication Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 238000011176 pooling Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 238000005286 illumination Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 230000004397 blinking Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 208000037062 Polyps Diseases 0.000 description 5
- 238000013527 convolutional neural network Methods 0.000 description 5
- 206010009944 Colon cancer Diseases 0.000 description 2
- 208000001333 Colorectal Neoplasms Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000013145 classification model Methods 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 230000002792 vascular Effects 0.000 description 2
- 208000035984 Colonic Polyps Diseases 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 239000002243 precursor Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/005—Flexible endoscopes
- A61B1/01—Guiding arrangements therefore
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000095—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope for image enhancement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000096—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
- G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Optics & Photonics (AREA)
- Radiology & Medical Imaging (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computational Linguistics (AREA)
- Endoscopes (AREA)
Abstract
Description
Claims (5)
- 装置により行われる方法において、
被検者の大腸に投入された内視鏡から撮影された画像をリアルタイムに受信する段階と、
前記画像内で前記大腸内の少なくとも1つのヒダが含まれている各区間の画像を認識する段階と、
前記各区間の画像内に前記ヒダを表す第1視覚効果を表示する段階と、
前記各区間の画像毎に前記ヒダの裏面部が撮影されているか否かを判断する段階と、
前記判断の結果、前記各区間の画像のうち、前記ヒダの裏面部が撮影されていない少なくとも1つの区間の画像内に、該当ヒダの裏面部が撮影されていないことを表す第2視覚効果を表示する段階と、
を含む、内視鏡を用いた大腸検査ガイド方法。 - 前記認識段階は、
前記内視鏡によって前記大腸の内部に照射される光に基づいて行われることを特徴とする請求項1に記載の内視鏡を用いた大腸検査ガイド方法。 - 前記認識段階は、ディープラーニングモデルにより前記各区間の画像を認識し、
前記ディープラーニングモデルは、外部のアノテータから得られた複数の被検者についての大腸画像内のヒダデータと、前記大腸内の前記照射された光による陰影変化量及び血管に基づいて機械学習されたモデルであることを特徴とする請求項1に記載の内視鏡を用いた大腸検査ガイド方法。 - 前記第1視覚効果は、前記各区間の画像内における該当ヒダ上に、それぞれのマーカが表示される視覚効果を含み、
前記それぞれのマーカの大きさは、該当ヒダの大きさに基づいて決定されることを特徴とする請求項1に記載の内視鏡を用いた大腸検査ガイド方法。 - 前記該当ヒダの裏面部が撮影された場合、前記第2視覚効果を削除する段階を更に含むことを特徴とする請求項1に記載の内視鏡を用いた大腸検査ガイド方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2023182618A JP2023178415A (ja) | 2021-01-14 | 2023-10-24 | 内視鏡を用いた大腸検査ガイド装置及び方法 |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020210005413A KR102464091B1 (ko) | 2021-01-14 | 2021-01-14 | 내시경을 이용한 대장 검사 가이드 장치 및 방법 |
KR10-2021-0005413 | 2021-01-14 | ||
PCT/KR2021/000929 WO2022154152A1 (ko) | 2021-01-14 | 2021-01-22 | 내시경을 이용한 대장 검사 가이드 장치 및 방법 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2023182618A Division JP2023178415A (ja) | 2021-01-14 | 2023-10-24 | 内視鏡を用いた大腸検査ガイド装置及び方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2023513646A true JP2023513646A (ja) | 2023-04-03 |
JP7374224B2 JP7374224B2 (ja) | 2023-11-06 |
Family
ID=82323446
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2021568482A Active JP7374224B2 (ja) | 2021-01-14 | 2021-01-22 | 内視鏡を用いた大腸検査ガイド装置 |
JP2023182618A Pending JP2023178415A (ja) | 2021-01-14 | 2023-10-24 | 内視鏡を用いた大腸検査ガイド装置及び方法 |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2023182618A Pending JP2023178415A (ja) | 2021-01-14 | 2023-10-24 | 内視鏡を用いた大腸検査ガイド装置及び方法 |
Country Status (2)
Country | Link |
---|---|
US (1) | US20220218185A1 (ja) |
JP (2) | JP7374224B2 (ja) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011136150A (ja) * | 2009-12-31 | 2011-07-14 | National Yunlin Univ Of Science & Technology | 内視鏡ナビゲーション方法、及び、内視鏡ナビゲーションシステム |
WO2019087969A1 (ja) * | 2017-10-31 | 2019-05-09 | 富士フイルム株式会社 | 内視鏡システム、報知方法、及びプログラム |
WO2019245009A1 (ja) * | 2018-06-22 | 2019-12-26 | 株式会社Aiメディカルサービス | 消化器官の内視鏡画像による疾患の診断支援方法、診断支援システム、診断支援プログラム及びこの診断支援プログラムを記憶したコンピュータ読み取り可能な記録媒体 |
WO2021166103A1 (ja) * | 2020-02-19 | 2021-08-26 | オリンパス株式会社 | 内視鏡システム、管腔構造算出装置及び管腔構造情報の作成方法 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016017695A1 (ja) * | 2014-07-30 | 2016-02-04 | オリンパス株式会社 | 画像処理装置 |
WO2017115442A1 (ja) * | 2015-12-28 | 2017-07-06 | オリンパス株式会社 | 画像処理装置、画像処理方法および画像処理プログラム |
US10163241B2 (en) * | 2016-12-09 | 2018-12-25 | Microsoft Technology Licensing, Llc | Automatic generation of fundus drawings |
US10646288B2 (en) * | 2017-04-12 | 2020-05-12 | Bio-Medical Engineering (HK) Limited | Automated steering systems and methods for a robotic endoscope |
US10796481B2 (en) * | 2018-04-20 | 2020-10-06 | Siemens Healthcare Gmbh | Visualization of lung fissures in medical imaging |
EP3841953B1 (en) * | 2018-08-20 | 2024-02-07 | FUJIFILM Corporation | Medical image processing system |
JP7143436B2 (ja) * | 2018-11-01 | 2022-09-28 | 富士フイルム株式会社 | 医療画像処理装置、医療画像処理装置の作動方法及びプログラム、診断支援装置 |
CN113498323A (zh) * | 2019-02-26 | 2021-10-12 | 富士胶片株式会社 | 医用图像处理装置、处理器装置、内窥镜系统、医用图像处理方法、及程序 |
US10957043B2 (en) * | 2019-02-28 | 2021-03-23 | Endosoftllc | AI systems for detecting and sizing lesions |
CN113518576A (zh) * | 2019-03-25 | 2021-10-19 | 奥林巴斯株式会社 | 移动辅助系统、移动辅助方法以及移动辅助程序 |
WO2021048925A1 (ja) * | 2019-09-10 | 2021-03-18 | オリンパス株式会社 | 内視鏡制御装置、内視鏡制御装置の作動方法及びプログラム |
US11620745B2 (en) * | 2020-01-17 | 2023-04-04 | Ping An Technology (Shenzhen) Co., Ltd. | Method and system for harvesting lesion annotations |
JP7441934B2 (ja) * | 2020-02-27 | 2024-03-01 | オリンパス株式会社 | 処理装置、内視鏡システム及び処理装置の作動方法 |
-
2021
- 2021-01-22 JP JP2021568482A patent/JP7374224B2/ja active Active
- 2021-03-03 US US17/190,518 patent/US20220218185A1/en active Pending
-
2023
- 2023-10-24 JP JP2023182618A patent/JP2023178415A/ja active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011136150A (ja) * | 2009-12-31 | 2011-07-14 | National Yunlin Univ Of Science & Technology | 内視鏡ナビゲーション方法、及び、内視鏡ナビゲーションシステム |
WO2019087969A1 (ja) * | 2017-10-31 | 2019-05-09 | 富士フイルム株式会社 | 内視鏡システム、報知方法、及びプログラム |
WO2019245009A1 (ja) * | 2018-06-22 | 2019-12-26 | 株式会社Aiメディカルサービス | 消化器官の内視鏡画像による疾患の診断支援方法、診断支援システム、診断支援プログラム及びこの診断支援プログラムを記憶したコンピュータ読み取り可能な記録媒体 |
WO2021166103A1 (ja) * | 2020-02-19 | 2021-08-26 | オリンパス株式会社 | 内視鏡システム、管腔構造算出装置及び管腔構造情報の作成方法 |
Also Published As
Publication number | Publication date |
---|---|
JP7374224B2 (ja) | 2023-11-06 |
JP2023178415A (ja) | 2023-12-14 |
US20220218185A1 (en) | 2022-07-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Ali et al. | Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy | |
Nguyen et al. | Deep learning models for tuberculosis detection from chest X-ray images | |
JP7152513B2 (ja) | 画像認識方法、装置、端末機器及び医療システム、並びにそのコンピュータプログラム | |
AU2019431299B2 (en) | AI systems for detecting and sizing lesions | |
TWI696145B (zh) | 大腸鏡影像電腦輔助辨識系統及方法 | |
de Souza Jr et al. | Convolutional Neural Networks for the evaluation of cancer in Barrett's esophagus: Explainable AI to lighten up the black-box | |
JP6707131B2 (ja) | 画像処理装置、学習装置、画像処理方法、識別基準の作成方法、学習方法およびプログラム | |
CN112164026A (zh) | 一种内窥镜息肉实时检测方法、系统及终端 | |
US20240087113A1 (en) | Recording Medium, Learning Model Generation Method, and Support Apparatus | |
CN113570592A (zh) | 肠胃病检测和模型训练方法、装置、设备及介质 | |
CN113538344A (zh) | 区分萎缩性胃炎和胃癌的图像识别系统、设备及介质 | |
JP2023513646A (ja) | 内視鏡を用いた大腸検査ガイド装置及び方法 | |
Garcia-Peraza-Herrera et al. | Interpretable fully convolutional classification of intrapapillary capillary loops for real-time detection of early squamous neoplasia | |
KR102487104B1 (ko) | 딥러닝 모델 기반의 마커를 활용한 대장 내의 영상 표시 장치, 방법 및 프로그램 | |
KR102007656B1 (ko) | 모션 센서를 활용한 길이 측정 방법 및 장치 | |
Bulut et al. | Polyp Segmentation in Colonoscopy Images using U-Net and Cyclic Learning Rate | |
US20220202284A1 (en) | Endoscope processor, training device, information processing method, training method and program | |
JP7465409B2 (ja) | 人工知能基盤の血管学習による大腸ポリープ検出方法及び装置 | |
US20230122280A1 (en) | Systems and methods for providing visual indicators during colonoscopy | |
WO2022185369A1 (ja) | 画像処理装置、画像処理方法及び記憶媒体 | |
KR102648922B1 (ko) | 인공지능 기반의 혈관 학습을 통한 대장 용종 검출 방법 및 장치 | |
WO2024095673A1 (ja) | 医療支援装置、内視鏡、医療支援方法、及びプログラム | |
US20240021103A1 (en) | Endoscopic training system | |
US20230351592A1 (en) | Clinical decision support system having a multi-ordered hierarchy of classification modules | |
US20230172428A1 (en) | Endoscope image processing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20211112 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20211112 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230418 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230630 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230926 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20231024 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7374224 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |