JP7337124B2 - 眼底検査画像用の画像前処理方法及び画像処理装置 - Google Patents
眼底検査画像用の画像前処理方法及び画像処理装置 Download PDFInfo
- Publication number
- JP7337124B2 JP7337124B2 JP2021119515A JP2021119515A JP7337124B2 JP 7337124 B2 JP7337124 B2 JP 7337124B2 JP 2021119515 A JP2021119515 A JP 2021119515A JP 2021119515 A JP2021119515 A JP 2021119515A JP 7337124 B2 JP7337124 B2 JP 7337124B2
- Authority
- JP
- Japan
- Prior art keywords
- image
- pixel
- processor
- value
- interest
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 33
- 238000012545 processing Methods 0.000 title claims description 22
- 238000007781 pre-processing Methods 0.000 title claims description 20
- 210000005252 bulbus oculi Anatomy 0.000 claims description 17
- 238000009499 grossing Methods 0.000 claims description 13
- 238000001514 detection method Methods 0.000 claims description 8
- 238000012549 training Methods 0.000 claims description 5
- 238000010801 machine learning Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 7
- 238000001914 filtration Methods 0.000 description 4
- 230000003902 lesion Effects 0.000 description 4
- 206010025421 Macule Diseases 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 3
- 210000001508 eye Anatomy 0.000 description 3
- 210000003462 vein Anatomy 0.000 description 3
- 210000001367 artery Anatomy 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 208000010412 Glaucoma Diseases 0.000 description 1
- 208000032843 Hemorrhage Diseases 0.000 description 1
- 206010030113 Oedema Diseases 0.000 description 1
- 208000017442 Retinal disease Diseases 0.000 description 1
- 206010038923 Retinopathy Diseases 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 210000000416 exudates and transudate Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 208000038015 macular disease Diseases 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20004—Adaptive image processing
- G06T2207/20012—Locally adaptive
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20182—Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20192—Edge enhancement; Edge preservation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30041—Eye; Retina; Ophthalmic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
- Eye Examination Apparatus (AREA)
- Image Processing (AREA)
- Color Image Communication Systems (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Description
110 記憶装置
130 プロセッサ
S210、S230、S250 ステップ
Claims (8)
- 眼底検査画像から、該眼底検査画像中の眼球の中心を特定し、前記中心に従って前記眼球に絞られた関心領域を決定して第1画像を生成するステップと、
前記第1画像に対して平滑化処理を行って第2画像を生成するステップと、
前記第2画像の画素ごとに、前記画素の値と隣接画素の値との差である画素値の差と基準値との間の距離を比較するステップと、
前記第2画像の前記画素ごとに、前記距離に基づいて前記画素値の差を更新して、検出モデルのトレーニングフェーズ及び/又は推論フェーズにおける前処理で用いられ得る第3画像を生成するステップと、を含み、
前記第2画像の前記画素ごとに、前記距離に基づいて前記画素値の差を更新して前記第3画像を生成するステップにおいて、
前記距離が増大する場合に前記画素値の差を増やすように前記画素の値を変更する画像前処理方法。 - 請求項1に記載の画像前処理方法において、前記第1画像を生成することは、
前記眼底検査画像から前記関心領域を切り出すことと、
前記関心領域外に背景色を加えて前記第1画像を形成することと
を含む画像前処理方法。 - 請求項1に記載の画像前処理方法において、前記平滑化処理は、ガウスぼかしであり、
前記第1画像に対して前記平滑化処理を行うことは、前記第1画像に対して前記ガウスぼかしを行うことを含む、画像前処理方法。 - 請求項1に記載の画像前処理方法において、前記第3画像の生成後に、機械学習アルゴリズムに基づく検出モデルに前記第3画像を入力することを更に含む画像前処理方法。
- コードを記憶する記憶装置と、
前記記憶装置に結合され、
眼底検査画像から、前記眼底検査画像中の眼球の中心を特定し、前記中心に従って前記眼球に絞られた関心領域を決定して第1画像を生成し、
前記第1画像に対して平滑化処理を行って第2画像を生成し、
前記第2画像の画素ごとに、前記画素の値と隣接画素の値との差である画素値の差と基準値との間の距離を比較し、
前記第2画像の前記画素ごとに、前記距離が増大する場合に前記画素値の差を増やすように前記画素の値を変更することにより、検出モデルのトレーニングフェーズ及び/又は推論フェーズにおける前処理で用いられ得る第3画像を生成するよう構成されるようにコードをロードし実行するプロセッサと、
を備える画像処理装置。 - 請求項5に記載の画像処理装置において、前記プロセッサはさらに、
前記眼底検査画像から前記関心領域を切り出し、
前記関心領域外に背景色を加えて前記第1画像を形成するよう構成される、画像処理装置。 - 請求項5に記載の画像処理装置において、前記平滑化処理は、ガウスぼかしであり、
前記プロセッサはさらに、前記第1画像に対して前記ガウスぼかしを行うよう構成される、画像処理装置。 - 請求項5に記載の画像処理装置において、前記プロセッサはさらに、機械学習アルゴリズムに基づく検出モデルに前記第3画像を入力するよう構成される、画像処理装置。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110109989 | 2021-03-19 | ||
TW110109989A TWI775356B (zh) | 2021-03-19 | 2021-03-19 | 用於眼底圖的影像前處理方法及影像處理裝置 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2022145411A JP2022145411A (ja) | 2022-10-04 |
JP7337124B2 true JP7337124B2 (ja) | 2023-09-01 |
Family
ID=77739002
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2021119515A Active JP7337124B2 (ja) | 2021-03-19 | 2021-07-20 | 眼底検査画像用の画像前処理方法及び画像処理装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US11954824B2 (ja) |
EP (1) | EP4060601A1 (ja) |
JP (1) | JP7337124B2 (ja) |
CN (1) | CN115115528A (ja) |
TW (1) | TWI775356B (ja) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004046329A (ja) | 2002-07-09 | 2004-02-12 | Pentax Corp | 画像輪郭強調装置 |
JP2006095009A (ja) | 2004-09-29 | 2006-04-13 | Canon Inc | 眼科画像撮影装置 |
JP2006263127A (ja) | 2005-03-24 | 2006-10-05 | Gifu Univ | 眼底画像診断支援システム、及び眼底画像診断支援プログラム |
JP2007117154A (ja) | 2005-10-25 | 2007-05-17 | Pentax Corp | 電子内視鏡システム |
JP2015051054A (ja) | 2013-09-05 | 2015-03-19 | キヤノン株式会社 | 画像処理装置、画像処理システム及び画像処理方法 |
CN111833334A (zh) | 2020-07-16 | 2020-10-27 | 上海志唐健康科技有限公司 | 一种基于孪生网络架构的眼底影像特征处理分析方法 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3618877B2 (ja) | 1996-02-05 | 2005-02-09 | キヤノン株式会社 | 眼科画像処理装置 |
US6915024B1 (en) * | 2000-09-29 | 2005-07-05 | Hewlett-Packard Development Company, L.P. | Image sharpening by variable contrast mapping |
KR20050025927A (ko) * | 2003-09-08 | 2005-03-14 | 유웅덕 | 홍채인식을 위한 동공 검출 방법 및 형상기술자 추출방법과 그를 이용한 홍채 특징 추출 장치 및 그 방법과홍채인식 시스템 및 그 방법 |
US8320641B2 (en) * | 2004-10-28 | 2012-11-27 | DigitalOptics Corporation Europe Limited | Method and apparatus for red-eye detection using preview or other reference images |
US20070248277A1 (en) * | 2006-04-24 | 2007-10-25 | Scrofano Michael A | Method And System For Processing Image Data |
JP2011035477A (ja) * | 2009-07-29 | 2011-02-17 | Kyocera Corp | 画像処理装置、撮像装置、ノイズ除去方法、並びにプログラム |
US9454804B2 (en) * | 2012-03-27 | 2016-09-27 | Hitachi Medical Corporation | Image processing device and image processing method |
US8879813B1 (en) * | 2013-10-22 | 2014-11-04 | Eyenuk, Inc. | Systems and methods for automated interest region detection in retinal images |
JP6416438B2 (ja) * | 2015-09-11 | 2018-10-31 | アイベリファイ インコーポレイテッド | 眼球血管および顔認識のための画像および特徴品質、画像強化および特徴抽出、ならびにバイオメトリックシステムのための眼球血管と顔領域および/またはサブ顔領域との融合 |
CN108229252B (zh) * | 2016-12-15 | 2020-12-15 | 腾讯科技(深圳)有限公司 | 一种瞳孔定位方法及系统 |
US20190014982A1 (en) * | 2017-07-12 | 2019-01-17 | iHealthScreen Inc. | Automated blood vessel feature detection and quantification for retinal image grading and disease screening |
CN108537155B (zh) * | 2018-03-29 | 2021-01-26 | Oppo广东移动通信有限公司 | 图像处理方法、装置、电子设备及计算机可读存储介质 |
-
2021
- 2021-03-19 TW TW110109989A patent/TWI775356B/zh active
- 2021-04-16 CN CN202110411128.7A patent/CN115115528A/zh active Pending
- 2021-04-21 US US17/235,938 patent/US11954824B2/en active Active
- 2021-07-20 JP JP2021119515A patent/JP7337124B2/ja active Active
- 2021-09-13 EP EP21196275.8A patent/EP4060601A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004046329A (ja) | 2002-07-09 | 2004-02-12 | Pentax Corp | 画像輪郭強調装置 |
JP2006095009A (ja) | 2004-09-29 | 2006-04-13 | Canon Inc | 眼科画像撮影装置 |
JP2006263127A (ja) | 2005-03-24 | 2006-10-05 | Gifu Univ | 眼底画像診断支援システム、及び眼底画像診断支援プログラム |
JP2007117154A (ja) | 2005-10-25 | 2007-05-17 | Pentax Corp | 電子内視鏡システム |
JP2015051054A (ja) | 2013-09-05 | 2015-03-19 | キヤノン株式会社 | 画像処理装置、画像処理システム及び画像処理方法 |
CN111833334A (zh) | 2020-07-16 | 2020-10-27 | 上海志唐健康科技有限公司 | 一种基于孪生网络架构的眼底影像特征处理分析方法 |
Also Published As
Publication number | Publication date |
---|---|
CN115115528A (zh) | 2022-09-27 |
US11954824B2 (en) | 2024-04-09 |
TW202238514A (zh) | 2022-10-01 |
JP2022145411A (ja) | 2022-10-04 |
TWI775356B (zh) | 2022-08-21 |
US20220301111A1 (en) | 2022-09-22 |
EP4060601A1 (en) | 2022-09-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Adem | Exudate detection for diabetic retinopathy with circular Hough transformation and convolutional neural networks | |
Girish et al. | Segmentation of intra-retinal cysts from optical coherence tomography images using a fully convolutional neural network model | |
BahadarKhan et al. | A morphological hessian based approach for retinal blood vessels segmentation and denoising using region based otsu thresholding | |
EP3674968A1 (en) | Image classifying method, server and computer readable storage medium | |
Melinscak et al. | Retinal Vessel Segmentation using Deep Neural Networks. | |
Iqbal et al. | Recent trends and advances in fundus image analysis: A review | |
Mayya et al. | Automated microaneurysms detection for early diagnosis of diabetic retinopathy: A Comprehensive review | |
JP2020518915A (ja) | 自動眼底画像分析用のシステムおよび方法 | |
Kumar et al. | Deep transfer learning approaches to predict glaucoma, cataract, choroidal neovascularization, diabetic macular edema, drusen and healthy eyes: an experimental review | |
EP4057215A1 (en) | Systems and methods for automated analysis of retinal images | |
Hsu et al. | Chronic wound assessment and infection detection method | |
Naqvi et al. | Automatic optic disk detection and segmentation by variational active contour estimation in retinal fundus images | |
WO2015066297A1 (en) | System and method for assessing wound | |
Adem et al. | Detection of hemorrhage in retinal images using linear classifiers and iterative thresholding approaches based on firefly and particle swarm optimization algorithms | |
CN111882566B (zh) | 视网膜图像的血管分割方法、装置、设备及存储介质 | |
WO2021136368A1 (zh) | 钼靶图像中胸大肌区域自动检测方法及装置 | |
ter Haar Romeny et al. | Brain-inspired algorithms for retinal image analysis | |
WO2020001236A1 (zh) | 提取医学图像标注的方法及装置 | |
Montaha et al. | A shallow deep learning approach to classify skin cancer using down-scaling method to minimize time and space complexity | |
Erwin et al. | Detection of blood vessels in optic disc with maximum principal curvature and wolf thresholding algorithms for vessel segmentation and Prewitt Edge Detection and circular Hough transform for optic disc detection | |
JP7337124B2 (ja) | 眼底検査画像用の画像前処理方法及び画像処理装置 | |
KR20200129440A (ko) | 안저 이미지를 이용한 시신경병증 예측 장치 및 시신경병증 예측 결과 제공 방법 | |
Daanouni et al. | Automated end-to-end Architecture for Retinal Layers and Fluids Segmentation on OCT B-scans | |
Sathananthavathi et al. | Improvement of thin retinal vessel extraction using mean matting method | |
Yadav | Retinal blood vessels detection for diabetic retinopathy with Ridgelet transform and convolution neural network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20210820 |
|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20220310 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20220310 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220614 |
|
A524 | Written submission of copy of amendment under article 19 pct |
Free format text: JAPANESE INTERMEDIATE CODE: A524 Effective date: 20220906 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20221025 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230116 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230207 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230428 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230801 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20230822 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7337124 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |