JP6198839B2 - 超音波画像のエンハンスメント - Google Patents

超音波画像のエンハンスメント Download PDF

Info

Publication number
JP6198839B2
JP6198839B2 JP2015540251A JP2015540251A JP6198839B2 JP 6198839 B2 JP6198839 B2 JP 6198839B2 JP 2015540251 A JP2015540251 A JP 2015540251A JP 2015540251 A JP2015540251 A JP 2015540251A JP 6198839 B2 JP6198839 B2 JP 6198839B2
Authority
JP
Japan
Prior art keywords
image
ultrasound
ray
target object
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015540251A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015533329A5 (enExample
JP2015533329A (ja
Inventor
オリビエ ピエール ネムポント
オリビエ ピエール ネムポント
パスカル イヴス フランソワ カティエ
パスカル イヴス フランソワ カティエ
ラウル フローレント
ラウル フローレント
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2015533329A publication Critical patent/JP2015533329A/ja
Publication of JP2015533329A5 publication Critical patent/JP2015533329A5/ja
Application granted granted Critical
Publication of JP6198839B2 publication Critical patent/JP6198839B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/08—Volume rendering
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/12—Arrangements for detecting or locating foreign bodies
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4417—Constructional features of apparatus for radiation diagnosis related to combined acquisition of different diagnostic modalities
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/467—Arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B6/469—Arrangements for interfacing with the operator or the patient characterised by special input means for selecting a region of interest [ROI]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
    • A61B6/5247—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0833—Clinical applications involving detecting or locating foreign bodies or organic structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0833—Clinical applications involving detecting or locating foreign bodies or organic structures
    • A61B8/0841—Clinical applications involving detecting or locating foreign bodies or organic structures for locating instruments
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4416—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B8/469—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means for selection of a region of interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0007—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4429—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units
    • A61B6/4435—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure
    • A61B6/4441—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure the rigid structure being a C-arm or U-arm
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/48—Diagnostic techniques
    • A61B6/486—Diagnostic techniques involving generating temporal series of image data
    • A61B6/487—Diagnostic techniques involving generating temporal series of image data involving fluoroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/466—Displaying means of special interest adapted to display 3D data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G06T2207/10121—Fluoroscopy
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/12—Shadow map, environment map

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Analysis (AREA)
JP2015540251A 2012-11-06 2013-10-30 超音波画像のエンハンスメント Active JP6198839B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP12306368 2012-11-06
EP12306368.7 2012-11-06
PCT/IB2013/059793 WO2014072890A1 (en) 2012-11-06 2013-10-30 Enhancing ultrasound images

Publications (3)

Publication Number Publication Date
JP2015533329A JP2015533329A (ja) 2015-11-24
JP2015533329A5 JP2015533329A5 (enExample) 2016-12-22
JP6198839B2 true JP6198839B2 (ja) 2017-09-20

Family

ID=47429693

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015540251A Active JP6198839B2 (ja) 2012-11-06 2013-10-30 超音波画像のエンハンスメント

Country Status (7)

Country Link
US (1) US11373361B2 (enExample)
EP (1) EP2916740B1 (enExample)
JP (1) JP6198839B2 (enExample)
CN (2) CN113855059A (enExample)
BR (1) BR112015009947A2 (enExample)
RU (1) RU2015121699A (enExample)
WO (1) WO2014072890A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106456080B (zh) * 2014-05-16 2020-10-27 皇家飞利浦有限公司 用于修改x射线数据中的对tee探头的成像的设备
EP3517174B1 (en) * 2014-08-27 2025-12-31 Fusmobile, Inc. PORTABLE DEVICES FOR THE PROJECTION OF FOCUSED ULTRASOUND
EP3349660B1 (en) * 2015-11-25 2019-03-27 Koninklijke Philips N.V. System for tracking an ultrasonic probe in a body part
US11266377B2 (en) 2016-05-17 2022-03-08 Canon Medical Systems Corporation Support apparatus and support method
CN114224386B (zh) * 2016-09-30 2025-01-24 深圳迈瑞生物医疗电子股份有限公司 一种成像方法和系统
EP3554383B1 (en) * 2016-12-16 2020-04-22 Koninklijke Philips N.V. System for providing images for guiding surgery
WO2018119718A1 (zh) * 2016-12-28 2018-07-05 深圳迈瑞生物医疗电子股份有限公司 在超声扫描中的图像提取方法、装置及超声成像系统
EP3406195A1 (en) * 2017-05-24 2018-11-28 Koninklijke Philips N.V. Device and a corresponding method for providing spatial information of an interventional device in a live 2d x-ray image
EP3659514A1 (en) * 2018-11-29 2020-06-03 Koninklijke Philips N.V. Image-based device identification and localization
EP3703011A1 (en) * 2019-02-26 2020-09-02 Koninklijke Philips N.V. Interventional device tracking
JP7098835B2 (ja) * 2019-05-28 2022-07-11 富士フイルム株式会社 マッチング装置、方法およびプログラム
US11464464B2 (en) * 2020-07-24 2022-10-11 International Business Machines Corporation Internal and external proximate scanning
WO2023283273A1 (en) * 2021-07-08 2023-01-12 Evalve, Inc. Augmented imaging for valve repair

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6006126A (en) * 1991-01-28 1999-12-21 Cosman; Eric R. System and method for stereotactic registration of image scan data
JP3461509B2 (ja) 1993-10-29 2003-10-27 ユナイテッド ステイツ サージカル コーポレイション ソノマモグラフィーおよびよりよいｘ線撮影を行う装置
US5531227A (en) * 1994-01-28 1996-07-02 Schneider Medical Technologies, Inc. Imaging device and method
US6019725A (en) * 1997-03-07 2000-02-01 Sonometrics Corporation Three-dimensional tracking and imaging system
WO2004042546A1 (en) 2002-11-04 2004-05-21 V-Target Technologies Ltd. Apparatus and methods for imaging and attenuation correction
US6549802B2 (en) 2001-06-07 2003-04-15 Varian Medical Systems, Inc. Seed localization system and method in ultrasound by fluoroscopy and ultrasound fusion
WO2005009220A2 (en) 2003-07-21 2005-02-03 Johns Hopkins University Registration of ultrasound to fluoroscopy for real time optimization of radiation implant procedures
US9237929B2 (en) * 2003-12-22 2016-01-19 Koninklijke Philips N.V. System for guiding a medical instrument in a patient body
US20080199059A1 (en) 2004-05-14 2008-08-21 Koninklijke Philips Electronics, N.V. Information Enhanced Image Guided Interventions
KR20080034447A (ko) 2005-08-09 2008-04-21 코닌클리케 필립스 일렉트로닉스 엔.브이. 2차원 ｘ－선 영상과 3차원 초음파 영상의 선택적인 혼합을위한 시스템 및 방법
US7817835B2 (en) 2006-03-31 2010-10-19 Siemens Medical Solutions Usa, Inc. Cross reference measurement for diagnostic medical imaging
US20070247454A1 (en) * 2006-04-19 2007-10-25 Norbert Rahn 3D visualization with synchronous X-ray image display
US20080146919A1 (en) 2006-09-29 2008-06-19 Estelle Camus Method for implanting a cardiac implant with real-time ultrasound imaging guidance
EP2358269B1 (en) * 2007-03-08 2019-04-10 Sync-RX, Ltd. Image processing and tool actuation for medical procedures
US8364242B2 (en) 2007-05-17 2013-01-29 General Electric Company System and method of combining ultrasound image acquisition with fluoroscopic image acquisition
US20090088628A1 (en) 2007-09-27 2009-04-02 Klaus Klingenbeck-Regn Efficient workflow for afib treatment in the ep lab
BRPI0819439A8 (pt) * 2007-11-16 2015-11-10 Koninklijke Philips Electronics Nv Método e sistema para navegação intervencional usando formação de imagem por ultrassom realçada por contraste em 3d
TWI380419B (en) 2008-01-16 2012-12-21 Raydium Semiconductor Corp Integrated circuit package and the method for fabricating thereof
US20100063400A1 (en) * 2008-09-05 2010-03-11 Anne Lindsay Hall Method and apparatus for catheter guidance using a combination of ultrasound and x-ray imaging
US9521994B2 (en) * 2009-05-11 2016-12-20 Siemens Healthcare Gmbh System and method for image guided prostate cancer needle biopsy
CN102548478B (zh) * 2009-09-29 2014-12-03 皇家飞利浦电子股份有限公司 血管处置的实况配准
WO2011070492A1 (en) * 2009-12-09 2011-06-16 Koninklijke Philips Electronics N.V. Visualization of ultrasound in x-ray images
RU2556783C2 (ru) 2009-12-09 2015-07-20 Конинклейке Филипс Электроникс Н.В. Комбинация ультразвуковой и рентгеновской систем
JP5661453B2 (ja) * 2010-02-04 2015-01-28 株式会社東芝 画像処理装置、超音波診断装置、及び画像処理方法

Also Published As

Publication number Publication date
US20150294454A1 (en) 2015-10-15
RU2015121699A (ru) 2016-12-27
CN113855059A (zh) 2021-12-31
EP2916740B1 (en) 2019-09-04
CN104780845A (zh) 2015-07-15
WO2014072890A9 (en) 2014-11-27
BR112015009947A2 (pt) 2017-07-11
JP2015533329A (ja) 2015-11-24
WO2014072890A1 (en) 2014-05-15
EP2916740A1 (en) 2015-09-16
US11373361B2 (en) 2022-06-28

Similar Documents

Publication Publication Date Title
JP6198839B2 (ja) 超音波画像のエンハンスメント
JP6360052B2 (ja) 器具ガイダンスを可能にするイメージングシステム及び方法
US10172574B2 (en) Interventional X-ray system with automatic iso-centering
JP6166663B2 (ja) ナビゲーションガイダンスのための視覚化
US9904978B2 (en) Pairing of an anatomy representation with live images
JP6559532B2 (ja) Ｘ線透視画像のリアルタイムシミュレーション
US20170065206A1 (en) Device for determining a specific position of a catheter
CN105873538B (zh) 用于将成像设备与跟踪设备进行配准的配准系统和方法
WO2013102880A1 (en) Real-time display of vasculature views for optimal device navigation
RU2662871C2 (ru) Ослабление костей при рентгеновской визуализации
CN108523998B (zh) 图像支持的方法、x射线装置、计算机程序和数据载体
JP2014509895A (ja) 血管インターベンションプロシージャにおいてインターベンション装置の正確な誘導を支援する画像表示を提供する画像診断システム及び方法
US10786220B2 (en) Device for imaging an object
JP2019505271A (ja) 投影データセットの提供
KR101525040B1 (ko) 시술 전 영상의 촬영 범위를 결정하기 위한 레퍼런스 영상 생성 방법 및 그 장치
CN109310386B (zh) 无校准断层合成
US20220096165A1 (en) Interventional device tracking
JP6327695B2 (ja) 手術支援プログラム及び手術支援システムの作動方法
RU2574374C2 (ru) Определение конкретной ориентации объекта
WO2025073380A1 (en) Stitchless panorama in medical image acquisition

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161027

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161027

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170712

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170724

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170822

R150 Certificate of patent or registration of utility model

Ref document number: 6198839

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250