JP6837376B2 - 画像処理装置および方法並びにプログラム - Google Patents
画像処理装置および方法並びにプログラム Download PDFInfo
- Publication number
- JP6837376B2 JP6837376B2 JP2017077256A JP2017077256A JP6837376B2 JP 6837376 B2 JP6837376 B2 JP 6837376B2 JP 2017077256 A JP2017077256 A JP 2017077256A JP 2017077256 A JP2017077256 A JP 2017077256A JP 6837376 B2 JP6837376 B2 JP 6837376B2
- Authority
- JP
- Japan
- Prior art keywords
- cross
- sectional
- image
- pixel
- classification process
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 93
- 238000012545 processing Methods 0.000 title claims description 64
- 230000003902 lesion Effects 0.000 claims description 65
- 238000012937 correction Methods 0.000 claims description 35
- 230000005484 gravity Effects 0.000 claims description 8
- 230000005856 abnormality Effects 0.000 claims description 6
- 238000010801 machine learning Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 2
- 238000003672 processing method Methods 0.000 claims description 2
- 208000031513 cyst Diseases 0.000 description 37
- 206010011732 Cyst Diseases 0.000 description 32
- 238000011156 evaluation Methods 0.000 description 24
- 210000004072 lung Anatomy 0.000 description 14
- 238000013528 artificial neural network Methods 0.000 description 11
- 210000000621 bronchi Anatomy 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000013507 mapping Methods 0.000 description 9
- 238000003745 diagnosis Methods 0.000 description 7
- 238000002591 computed tomography Methods 0.000 description 6
- 208000002151 Pleural effusion Diseases 0.000 description 5
- 238000002595 magnetic resonance imaging Methods 0.000 description 4
- 210000003484 anatomy Anatomy 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 208000029523 Interstitial Lung disease Diseases 0.000 description 2
- 208000019693 Lung disease Diseases 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 2
- 210000004204 blood vessel Anatomy 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000003211 malignant effect Effects 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 208000024891 symptom Diseases 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000003176 fibrotic effect Effects 0.000 description 1
- 239000005337 ground glass Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012916 structural analysis Methods 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5217—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data extracting a diagnostic or physiological parameter from medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
- G06F18/24133—Distances to prototypes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
- G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
- G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
- G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30061—Lung
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/03—Recognition of patterns in medical or anatomical images
- G06V2201/031—Recognition of patterns in medical or anatomical images of internal organs
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Public Health (AREA)
- Molecular Biology (AREA)
- Multimedia (AREA)
- Pathology (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- High Energy & Nuclear Physics (AREA)
- Heart & Thoracic Surgery (AREA)
- Optics & Photonics (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Physiology (AREA)
- Evolutionary Biology (AREA)
- Biodiversity & Conservation Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Image Analysis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Description
11 断面画像取得部
12 一次分類部
13 二次分類部
14 補正部
15 表示制御部
20 表示装置
30 入力装置
40 3次元画像保管サーバ
50 多層ニューラルネットワーク
51 入力層
52 出力層
L 重心位置を結ぶ線
P 画素
r1,r2,r3,r4,r5,r6 嚢胞と分類された領域
S1,S2,S3,S4,S5,S6 断面画像
Claims (11)
- 複数の異なる断面方向のそれぞれの方向に対して、被検体の複数の断面画像を取得する断面画像取得部と、
前記複数の異なる断面方向に対して取得した前記複数の断面画像のそれぞれについて、前記各断面画像の各画素が属する組織または病変の種類を特定する一次分類処理を行う一次分類部と、
前記各画素を通る前記複数の異なる断面方向の断面画像の各々に対して行われた前記一次分類処理の複数の結果を前記各画素ごとに評価することによって、前記複数の断面画像が通る各画素が属する組織または病変の種類を再度特定する二次分類処理を行う二次分類部と、
前記組織または病変の解剖学上の特徴または画像特徴量に基づいて、前記二次分類処理が行われた各画素について前記二次分類処理の結果を補正する補正部とを備えた画像処理装置。 - 前記補正部が、前記各画素を通る前記複数の異なる断面方向の断面画像のうち特定の断面方向の断面画像を用いて、前記各画素の前記二次分類処理の結果を補正する請求項1に記載の画像処理装置。
- 前記特定の断面方向が、前記被検体の撮影におけるスライス方向である請求項2に記載の画像処理装置。
- 前記特定の断面方向の断面画像が、前記複数の断面方向の断面画像のうち最も解像度が高い断面画像である請求項2または3に記載の画像処理装置。
- 前記補正部が、前記特定の断面方向の断面画像の各画素の信号値に基づいて、前記二次分類処理の結果を補正する請求項2から4いずれか1項に記載の画像処理装置。
- 前記補正部が、前記組織または病変の形状または位置の解剖学上の特徴に基づいて、前記二次分類処理の結果を補正する請求項1に記載の画像処理装置。
- 前記補正部が、前記二次分類処理によって分類された各画素によって特定される組織または病変の辺縁または重心位置の3次元空間上の連続性に異常がある場合に、前記各画素の前記二次分類処理の結果を補正する請求項1から6いずれか1項に記載の画像処理装置。
- 前記二次分類部が、前記二次分類処理を行う際、前記各画素を通る前記複数の異なる断面方向の断面画像の各断面画像の解像度に応じた重み付けを前記各断面画像の一次分類処理の結果に付加して評価する請求項1から7いずれか1項に記載の画像処理装置。
- 前記一次分類部が、機械学習によって各画素が属する前記組織または病変の種類を特定可能な判別器を用いて前記一次分類処理を行う請求項1から8いずれか1項に記載の画像処理装置。
- 複数の異なる断面方向のそれぞれの方向に対して、被検体の複数の断面画像を取得し、
前記複数の異なる断面方向に対して取得した前記複数の前記断面画像のそれぞれについて、前記各断面画像の各画素が属する組織または病変の種類を特定する一次分類処理を行い、
前記各画素を通る前記複数の異なる断面方向の断面画像の各々に対して行われた前記一次分類処理の複数の結果を前記各画素ごとに評価することによって、前記複数の断面画像が通る各画素が属する組織または病変の種類を再度特定する二次分類処理を行い、
前記組織または病変の解剖学上の特徴または画像特徴量に基づいて、前記二次分類処理が行われた各画素について前記二次分類処理の結果を補正する画像処理方法。 - コンピュータを、
複数の異なる断面方向のそれぞれの方向に対して、被検体の複数の断面画像を取得する断面画像取得部と、
前記複数の異なる断面方向に対して取得した前記複数の前記断面画像のそれぞれについて、前記各断面画像の各画素が属する組織または病変の種類を特定する一次分類処理を行う一次分類部と、
前記各画素を通る前記複数の異なる断面方向の断面画像の各々に対して行われた前記一次分類処理の複数の結果を前記各画素ごとに評価することによって、前記複数の断面画像が通る各画素が属する組織または病変の種類を再度特定する二次分類処理を行う二次分類部と、
前記組織または病変の解剖学上の特徴または画像特徴量に基づいて、前記二次分類処理が行われた各画素について前記二次分類処理の結果を補正する補正部として機能させる画像処理プログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017077256A JP6837376B2 (ja) | 2017-04-10 | 2017-04-10 | 画像処理装置および方法並びにプログラム |
US15/946,141 US10628941B2 (en) | 2017-04-10 | 2018-04-05 | Image processing apparatus, image processing method, and image processing program |
DE102018108310.6A DE102018108310A1 (de) | 2017-04-10 | 2018-04-09 | Bildverarbeitungsvorrichtung, Bildverarbeitungsverfahren und Bildverarbeitungsprogramm |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017077256A JP6837376B2 (ja) | 2017-04-10 | 2017-04-10 | 画像処理装置および方法並びにプログラム |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2018175217A JP2018175217A (ja) | 2018-11-15 |
JP2018175217A5 JP2018175217A5 (ja) | 2019-10-03 |
JP6837376B2 true JP6837376B2 (ja) | 2021-03-03 |
Family
ID=63587725
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2017077256A Active JP6837376B2 (ja) | 2017-04-10 | 2017-04-10 | 画像処理装置および方法並びにプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US10628941B2 (ja) |
JP (1) | JP6837376B2 (ja) |
DE (1) | DE102018108310A1 (ja) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107690659B (zh) * | 2016-12-27 | 2021-08-10 | 达闼机器人有限公司 | 一种图像识别系统及图像识别方法 |
EP3646240A4 (en) | 2017-06-26 | 2021-03-17 | The Research Foundation for The State University of New York | SYSTEM, PROCEDURE AND COMPUTER-ACCESSIBLE MEDIUM FOR VIRTUAL PANCREATOGRAPHY |
JP6914233B2 (ja) * | 2018-08-31 | 2021-08-04 | 富士フイルム株式会社 | 類似度決定装置、方法およびプログラム |
WO2020110776A1 (ja) * | 2018-11-28 | 2020-06-04 | 富士フイルム株式会社 | 分類装置、分類方法及びプログラム、分類結果表示装置 |
KR102198359B1 (ko) * | 2019-01-23 | 2021-01-04 | 이언주 | UBT에 적용할 딥러닝을 사용한 이미지 Auto Tagging 관리 시스템 및 방법 |
KR102199480B1 (ko) * | 2019-01-31 | 2021-01-06 | (주)엔에스데블 | 멀티 라벨 분류를 통한 의료 이미지 태깅 및 분류 시스템 및 방법 |
JPWO2022168400A1 (ja) * | 2021-02-05 | 2022-08-11 | ||
JP2024077825A (ja) | 2022-11-29 | 2024-06-10 | 富士通株式会社 | 病変検出方法および病変検出プログラム |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5319549A (en) * | 1992-11-25 | 1994-06-07 | Arch Development Corporation | Method and system for determining geometric pattern features of interstitial infiltrates in chest images |
US7058210B2 (en) * | 2001-11-20 | 2006-06-06 | General Electric Company | Method and system for lung disease detection |
JP2004135867A (ja) * | 2002-10-17 | 2004-05-13 | Fuji Photo Film Co Ltd | 異常陰影候補検出方法及び異常陰影候補検出装置 |
JP4599191B2 (ja) * | 2005-03-01 | 2010-12-15 | 国立大学法人神戸大学 | 画像診断処理装置および画像診断処理プログラム |
JP5390080B2 (ja) * | 2007-07-25 | 2014-01-15 | 株式会社東芝 | 医用画像表示装置 |
JP5993653B2 (ja) * | 2012-08-03 | 2016-09-14 | キヤノン株式会社 | 画像処理装置、画像処理方法およびプログラム |
KR102204437B1 (ko) | 2013-10-24 | 2021-01-18 | 삼성전자주식회사 | 컴퓨터 보조 진단 방법 및 장치 |
US9700284B2 (en) * | 2013-11-13 | 2017-07-11 | Siemens Medical Solutions Usa, Inc. | Three-dimensional ultrasound reconstruction with confidence information |
JP6099592B2 (ja) * | 2014-03-27 | 2017-03-22 | 富士フイルム株式会社 | 類似症例検索装置及び類似症例検索プログラム |
-
2017
- 2017-04-10 JP JP2017077256A patent/JP6837376B2/ja active Active
-
2018
- 2018-04-05 US US15/946,141 patent/US10628941B2/en active Active
- 2018-04-09 DE DE102018108310.6A patent/DE102018108310A1/de active Pending
Also Published As
Publication number | Publication date |
---|---|
JP2018175217A (ja) | 2018-11-15 |
US20180293729A1 (en) | 2018-10-11 |
US10628941B2 (en) | 2020-04-21 |
DE102018108310A1 (de) | 2018-10-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6837376B2 (ja) | 画像処理装置および方法並びにプログラム | |
JP6955303B2 (ja) | 医用画像処理装置および方法並びにプログラム | |
da Silva Sousa et al. | Methodology for automatic detection of lung nodules in computerized tomography images | |
JP5081390B2 (ja) | 腫瘍量を監視する方法及びシステム | |
El-Baz et al. | Three-dimensional shape analysis using spherical harmonics for early assessment of detected lung nodules | |
JP6906347B2 (ja) | 医用画像分類装置、方法およびプログラム | |
US9014456B2 (en) | Computer aided diagnostic system incorporating appearance analysis for diagnosing malignant lung nodules | |
El-Baz et al. | A novel level set-based computer-aided detection system for automatic detection of lung nodules in low dose chest computed tomography scans | |
US11357400B2 (en) | Image processing method for glaucoma detection and computer program products thereof | |
EP2987114B1 (en) | Method and system for determining a phenotype of a neoplasm in a human or animal body | |
CN112712493A (zh) | 使用多参数磁共振成像减少恶性病变的假阳性检测 | |
CN110838114B (zh) | 肺结节检测方法、装置及计算机存储介质 | |
JP2011526508A (ja) | 医療用画像の領域分割 | |
EP2208183B1 (en) | Computer-aided detection (cad) of a disease | |
US11854190B2 (en) | Similarity determination apparatus, similarity determination method, and similarity determination program | |
JP6987721B2 (ja) | 画像処理装置、方法およびプログラム | |
EP3929936A1 (en) | Automatic detection of covid-19 in chest ct images | |
Yoshiyasu et al. | Radiomics technology for identifying early-stage lung adenocarcinomas suitable for sublobar resection | |
KR100998630B1 (ko) | 폐질환 자동 분류 방법 | |
NJSRF et al. | Anaylsis and Detection of Community-acquired pneumonia using pspnet with complex Daubechies wavelets | |
WO2022225794A1 (en) | Systems and methods for detecting and characterizing covid-19 | |
Giv et al. | Lung segmentation using active shape model to detect the disease from chest radiography | |
Benrabha et al. | Automatic ROI detection and classification of the achilles tendon ultrasound images | |
US11574727B2 (en) | Method for filtering normal medical image, method for interpreting medical image, and computing device implementing the methods | |
Kareem et al. | Prediction of renal cell carcinoma neuroblastoma using machine learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20170519 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20170908 |
|
RD04 | Notification of resignation of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7424 Effective date: 20170908 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20190826 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190826 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20200819 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200825 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201023 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20210119 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20210209 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6837376 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |