JP2021001917A - 画像取得装置および画像処理方法 - Google Patents
画像取得装置および画像処理方法 Download PDFInfo
- Publication number
- JP2021001917A JP2021001917A JP2019113881A JP2019113881A JP2021001917A JP 2021001917 A JP2021001917 A JP 2021001917A JP 2019113881 A JP2019113881 A JP 2019113881A JP 2019113881 A JP2019113881 A JP 2019113881A JP 2021001917 A JP2021001917 A JP 2021001917A
- Authority
- JP
- Japan
- Prior art keywords
- subject
- image
- speckle
- pixel
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/174—Segmentation; Edge detection involving the use of two or more images
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/063—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
- A61B1/0669—Endoscope light sources at proximal end of an endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/07—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/48—Laser speckle optics
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/02—Diffusing elements; Afocal elements
- G02B5/0205—Diffusing elements; Afocal elements characterised by the diffusing properties
- G02B5/0263—Diffusing elements; Afocal elements characterised by the diffusing properties with positional variation of the diffusing properties, e.g. gradient or patterned diffuser
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/02—Diffusing elements; Afocal elements
- G02B5/0273—Diffusing elements; Afocal elements characterized by the use
- G02B5/0278—Diffusing elements; Afocal elements characterized by the use used in transmission
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10141—Special mode during image acquisition
- G06T2207/10152—Varying illumination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
- G06T2207/30104—Vascular flow; Blood flow; Perfusion
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Optics & Photonics (AREA)
- Radiology & Medical Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Animal Behavior & Ethology (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
Abstract
Description
以下、本開示の実施形態における画像取得装置および画像処理方法を説明する。
C=σ/J ・・・(式1)
ここで、Cはスペックルコントラスト、Jは光強度の空間平均値、σは光強度の標準偏差である。
Claims (13)
- 被写体を照明する照明光を出射する照明光源と、
前記被写体の少なくとも一部の領域が吸収または反射する波長域に含まれるピーク波長を有するレーザ光を出射するレーザ光源と、
前記被写体を撮像する撮像装置と、
前記撮像装置が取得する画像に含まれるスペックルパターンを時間的に変化させるスペックル可変装置と、
前記撮像装置によって取得される画像を処理する画像処理装置と、
を備え、
前記画像処理装置は、前記画像を構成する各画素における強度信号の時間変化を測定し、前記強度信号の時間変化の波形に基づいて、前記被写体の被撮像領域を複数の部分に分類する、画像取得装置。 - 前記画像処理装置は、前記強度信号の時間変化の波形から1個または複数個の画素単位でスペックル信号の特徴量を算出し、前記特徴量に基づいて、各画素を前記複数の部分のいずれかに割り当てる、請求項1に記載の画像取得装置。
- 前記特徴量は、スペックルコントラストである、請求項2に記載の画像取得装置。
- 前記画像処理装置は、前記特徴量に基づく強調画像データを生成し、前記被写体の被撮像領域の画像データとともに出力する、請求項2または3に記載の画像取得装置。
- 前記レーザ光のピーク波長は可視光の範囲に含まれる、請求項1から4のいずれかに記載の画像取得装置。
- 前記撮像装置は、各画素がRサブ画素、Gサブ画素、およびBサブ画素を含むカラーイメージセンサであり、
前記画像処理装置は、前記Rサブ画素、Gサブ画素、およびBサブ画素のうち、前記レーザ光の前記ピーク波長が属する波長域の色のサブ画素を含む一色または複数色のサブ画素から出力された信号を、前記各画素における強度信号として選択する、請求項5に記載の画像取得装置。 - 前記レーザ光源は、レーザダイオードであり、
前記スペックル可変装置は、前記レーザ光を変調するように前記レーザダイオードを駆動する駆動回路を有する、請求項1から6のいずれかに記載の画像取得装置。 - 前記被写体は生体組織である、請求項1から7のいずれかに記載の画像取得装置。
- 前記スペックル可変装置は、
前記レーザ光の光路上に配置される拡散素子と、
前記拡散素子を運動させ、前記拡散素子における前記レーザ光の入射位置を変化させるアクチュエータと、
を有する、請求項1から8のいずれかに記載の画像取得装置。 - 前記スペックル可変装置は、前記被写体に対する前記レーザ光源および/または前記撮像装置の相対配置関係を変化させる移動装置を有する、請求項1から9のいずれかに記載の画像取得装置。
- 前記照明光および前記レーザ光を前記被写体に向けて照射する光出射部と、前記被写体から反射された光を前記撮像装置に導く受光部とを含む内視鏡と、
前記内視鏡に接続され、前記画像処理装置として機能する演算処理回路と、
前記演算処理回路に接続され、前記複数の部分に分類された前記被写体の被撮像画像を表示する表示装置と、
を備える、請求項1から10のいずれかに記載の画像取得装置。 - 被写体の少なくとも一部の領域が吸収または反射する波長域に含まれるピーク波長を有するレーザ光で前記被写体を照射する工程と、
前記被写体を撮像する工程と、
前記撮像装置が取得する画像に含まれるスペックルパターンに基づいて、前記被写体の被撮像領域を複数の領域に分割する工程と、
を含む、画像処理方法。 - 前記被写体の被撮像領域を複数の領域に分割する工程は、
前記スペックルパターンの時間的変化に応じて前記撮像装置が出力する画素の強度信号の変動量を求める工程と、
前記変動量に応じて前記画素を前記複数の領域のいずれかに分類する工程と
を含む、請求項12に記載の画像処理方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019113881A JP7071650B2 (ja) | 2019-06-19 | 2019-06-19 | 画像取得装置 |
US16/902,522 US11593946B2 (en) | 2019-06-19 | 2020-06-16 | Image-capturing device and image processing method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019113881A JP7071650B2 (ja) | 2019-06-19 | 2019-06-19 | 画像取得装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2021001917A true JP2021001917A (ja) | 2021-01-07 |
JP7071650B2 JP7071650B2 (ja) | 2022-05-19 |
Family
ID=73993880
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019113881A Active JP7071650B2 (ja) | 2019-06-19 | 2019-06-19 | 画像取得装置 |
Country Status (2)
Country | Link |
---|---|
US (1) | US11593946B2 (ja) |
JP (1) | JP7071650B2 (ja) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3838110A4 (en) * | 2018-08-13 | 2021-09-08 | Sony Group Corporation | MEDICAL SYSTEM, MEDICAL LIGHT SOURCE DEVICE, AND METHOD FOR MEDICAL LIGHT SOURCE DEVICE |
KR20210112525A (ko) * | 2020-03-05 | 2021-09-15 | 에스케이하이닉스 주식회사 | 이미지 센서 및 3차원 센서를 갖는 카메라 모듈 |
US20220092805A1 (en) * | 2020-09-23 | 2022-03-24 | Smith & Nephew, Inc. | Optical caliper for 3-d endoscopic imaging and measurement |
CN117147024A (zh) * | 2023-09-01 | 2023-12-01 | 天津大学 | 一种力传感触头及光纤末端力传感装置与三维力解算方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002165757A (ja) * | 2000-11-30 | 2002-06-11 | Olympus Optical Co Ltd | 診断支援装置 |
WO2015167005A1 (ja) * | 2014-05-02 | 2015-11-05 | 興和株式会社 | 画像処理装置、画像処理方法及び画像処理プログラム |
JP2016007336A (ja) * | 2014-06-24 | 2016-01-18 | オリンパス株式会社 | 内視鏡装置 |
US20160104292A1 (en) * | 2014-10-10 | 2016-04-14 | Edan Instruments, Inc. | Systems and methods of dynamic image segmentation |
JP2016221299A (ja) * | 2016-07-15 | 2016-12-28 | ソニー株式会社 | 内視鏡用アダプタ |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7304731B2 (en) * | 2005-09-02 | 2007-12-04 | Kla-Tencor Technologies Corp. | Systems and methods for providing illumination of a specimen for inspection |
JP2007125144A (ja) | 2005-11-02 | 2007-05-24 | Omega Wave Kk | レーザー血流画像装置 |
JP5087771B2 (ja) | 2007-12-04 | 2012-12-05 | 富士フイルム株式会社 | 撮像システム、内視鏡システム、およびプログラム |
US20220007997A1 (en) * | 2008-07-30 | 2022-01-13 | Vanderbilt University | Combined fluorescence and laser speckle contrast imaging system and applications of same |
US8585206B2 (en) * | 2010-06-29 | 2013-11-19 | Corning Incorporated | Methods for operating scanning laser projectors to reduce speckle and image flicker |
JP2014032371A (ja) | 2012-08-06 | 2014-02-20 | Oxide Corp | スペックルコントラスト発生器及びスペックルコントラスト評価装置 |
JP6507509B2 (ja) * | 2014-07-18 | 2019-05-08 | ソニー株式会社 | 流路撮像装置及び流路撮像方法 |
EP4235268A3 (en) * | 2015-10-09 | 2023-10-04 | Vasoptic Medical, Inc. | System and method for rapid examination of vasculature and particulate flow using laser speckle contrast imaging |
JP6798511B2 (ja) * | 2016-02-18 | 2020-12-09 | ソニー株式会社 | 撮像装置及び撮像システム |
WO2017175470A1 (ja) | 2016-04-05 | 2017-10-12 | ソニー株式会社 | スペックル測定装置およびスペックル測定方法 |
US11589801B2 (en) * | 2016-12-27 | 2023-02-28 | Vanderbilt University | Methods and apparatus for intraoperative assessment of parathyroid gland vascularity using laser speckle contrast imaging and applications of same |
EP3562386A4 (en) * | 2016-12-29 | 2020-08-26 | Vanderbilt University | METHODS AND APPARATUS FOR PEROPERATIVE ASSESSMENT OF PARATHYROID GLAND VASCULARITY USING LASER GRANULARITY CONTRAST IMAGING AND THEIR APPLICATIONS |
US10735675B2 (en) * | 2018-04-13 | 2020-08-04 | Cornell University | Configurable image processing system and methods for operating a configurable image processing system for multiple applications |
-
2019
- 2019-06-19 JP JP2019113881A patent/JP7071650B2/ja active Active
-
2020
- 2020-06-16 US US16/902,522 patent/US11593946B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002165757A (ja) * | 2000-11-30 | 2002-06-11 | Olympus Optical Co Ltd | 診断支援装置 |
WO2015167005A1 (ja) * | 2014-05-02 | 2015-11-05 | 興和株式会社 | 画像処理装置、画像処理方法及び画像処理プログラム |
JP2016007336A (ja) * | 2014-06-24 | 2016-01-18 | オリンパス株式会社 | 内視鏡装置 |
US20160104292A1 (en) * | 2014-10-10 | 2016-04-14 | Edan Instruments, Inc. | Systems and methods of dynamic image segmentation |
JP2016221299A (ja) * | 2016-07-15 | 2016-12-28 | ソニー株式会社 | 内視鏡用アダプタ |
Also Published As
Publication number | Publication date |
---|---|
US11593946B2 (en) | 2023-02-28 |
US20200397269A1 (en) | 2020-12-24 |
JP7071650B2 (ja) | 2022-05-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7071650B2 (ja) | 画像取得装置 | |
US7583380B2 (en) | Spectroscopic analysis apparatus and method with excitation system and focus monitoring system | |
US7623907B2 (en) | Endoscope for observing scattered light from living body tissue and method of observing scattered light from living body tissue | |
JP5628839B2 (ja) | 眼球表面疾患を検出するシステムおよび眼球表面検査装置 | |
EP2550640B1 (en) | Optical tomographic imaging apparatus | |
US9517009B2 (en) | Structured illumination ophthalmoscope | |
WO2004111621A1 (en) | Analysis apparatus and method comprising auto-focusing means | |
JP7025661B2 (ja) | 光源装置および画像取得装置 | |
JP2022508237A (ja) | 生物医学的パラメータを遠隔監視するためのシステムおよび方法 | |
JP2016049255A (ja) | 検眼装置 | |
US9398849B2 (en) | Ophthalmic apparatus, analysis program, optic media opacity acquiring method, and fluorescence intensity acquiring method | |
US10321817B2 (en) | Image display apparatus, method of processing, and processing apparatus | |
KR20100010899A (ko) | 피검체 관측 장치 및 피검체 관측 방법 | |
JP2021191551A (ja) | 眼科検査装置 | |
JP2008237432A (ja) | 眼底血流画像化装置 | |
WO2020250922A1 (ja) | 眼科装置 | |
TW201827914A (zh) | 觀察裝置及觀察方法 | |
JP2022093867A (ja) | 光源装置および画像取得装置 | |
WO2021039441A1 (ja) | 生体組織の識別方法、生体組織識別装置、および生体組織識別プログラム | |
JP2012225826A (ja) | 干渉光計測装置 | |
EP4166065A1 (en) | Ophthalmic device, method for controlling ophthalmic device, and program | |
JP2023048189A (ja) | 試料観察方法、試料観察装置、及び顕微鏡 | |
JP6916006B2 (ja) | 眼科装置 | |
JP2022066299A (ja) | 眼科撮影装置 | |
JP2021154160A (ja) | 眼科撮影装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20200819 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20210921 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20211116 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220111 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220124 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20220405 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20220418 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7071650 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |