JP6198839B2 - 超音波画像のエンハンスメント - Google Patents

超音波画像のエンハンスメント Download PDF

Info

Publication number
JP6198839B2
JP6198839B2 JP2015540251A JP2015540251A JP6198839B2 JP 6198839 B2 JP6198839 B2 JP 6198839B2 JP 2015540251 A JP2015540251 A JP 2015540251A JP 2015540251 A JP2015540251 A JP 2015540251A JP 6198839 B2 JP6198839 B2 JP 6198839B2
Authority
JP
Japan
Prior art keywords
image
ultrasound
ray
target object
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015540251A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015533329A5 (https=
JP2015533329A (ja
Inventor
オリビエ ピエール ネムポント
オリビエ ピエール ネムポント
パスカル イヴス フランソワ カティエ
パスカル イヴス フランソワ カティエ
ラウル フローレント
ラウル フローレント
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2015533329A publication Critical patent/JP2015533329A/ja
Publication of JP2015533329A5 publication Critical patent/JP2015533329A5/ja
Application granted granted Critical
Publication of JP6198839B2 publication Critical patent/JP6198839B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/08—Volume rendering
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/12—Arrangements for detecting or locating foreign bodies
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4417—Constructional features of apparatus for radiation diagnosis related to combined acquisition of different diagnostic modalities
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/467—Arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B6/469—Arrangements for interfacing with the operator or the patient characterised by special input means for selecting a region of interest [ROI]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
    • A61B6/5247—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0833—Clinical applications involving detecting or locating foreign bodies or organic structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0833—Clinical applications involving detecting or locating foreign bodies or organic structures
    • A61B8/0841—Clinical applications involving detecting or locating foreign bodies or organic structures for locating instruments
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4416—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B8/469—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means for selection of a region of interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0007—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4429—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units
    • A61B6/4435—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure
    • A61B6/4441—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure the rigid structure being a C-arm or U-arm
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/48—Diagnostic techniques
    • A61B6/486—Diagnostic techniques involving generating temporal series of image data
    • A61B6/487—Diagnostic techniques involving generating temporal series of image data involving fluoroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/466—Displaying means of special interest adapted to display 3D data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G06T2207/10121—Fluoroscopy
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/12—Shadow map, environment map

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Analysis (AREA)
JP2015540251A 2012-11-06 2013-10-30 超音波画像のエンハンスメント Active JP6198839B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP12306368 2012-11-06
EP12306368.7 2012-11-06
PCT/IB2013/059793 WO2014072890A1 (en) 2012-11-06 2013-10-30 Enhancing ultrasound images

Publications (3)

Publication Number Publication Date
JP2015533329A JP2015533329A (ja) 2015-11-24
JP2015533329A5 JP2015533329A5 (https=) 2016-12-22
JP6198839B2 true JP6198839B2 (ja) 2017-09-20

Family

ID=47429693

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015540251A Active JP6198839B2 (ja) 2012-11-06 2013-10-30 超音波画像のエンハンスメント

Country Status (7)

Country Link
US (1) US11373361B2 (https=)
EP (1) EP2916740B1 (https=)
JP (1) JP6198839B2 (https=)
CN (2) CN113855059A (https=)
BR (1) BR112015009947A2 (https=)
RU (1) RU2015121699A (https=)
WO (1) WO2014072890A1 (https=)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11850083B2 (en) * 2014-05-16 2023-12-26 Koninklijke Philips N.V. Device for modifying an imaging of a tee probe in X-ray data
US10639503B2 (en) * 2014-08-27 2020-05-05 Fusmobile Inc. Handheld devices for projecting focused ultrasound and related methods
EP3349660B1 (en) * 2015-11-25 2019-03-27 Koninklijke Philips N.V. System for tracking an ultrasonic probe in a body part
US11266377B2 (en) 2016-05-17 2022-03-08 Canon Medical Systems Corporation Support apparatus and support method
CN109310388B (zh) * 2016-09-30 2022-04-15 深圳迈瑞生物医疗电子股份有限公司 一种成像方法和系统
US11571180B2 (en) * 2016-12-16 2023-02-07 Koninklijke Philips N.V. Systems providing images guiding surgery
WO2018119718A1 (zh) * 2016-12-28 2018-07-05 深圳迈瑞生物医疗电子股份有限公司 在超声扫描中的图像提取方法、装置及超声成像系统
EP3406195A1 (en) * 2017-05-24 2018-11-28 Koninklijke Philips N.V. Device and a corresponding method for providing spatial information of an interventional device in a live 2d x-ray image
EP3659514A1 (en) * 2018-11-29 2020-06-03 Koninklijke Philips N.V. Image-based device identification and localization
EP3703011A1 (en) * 2019-02-26 2020-09-02 Koninklijke Philips N.V. Interventional device tracking
WO2020240995A1 (ja) * 2019-05-28 2020-12-03 富士フイルム株式会社 マッチング装置、方法およびプログラム
US11464464B2 (en) * 2020-07-24 2022-10-11 International Business Machines Corporation Internal and external proximate scanning
ES3062691T3 (en) * 2021-07-08 2026-04-13 Evalve Inc Augmented imaging for valve repair
CN121053008B (zh) * 2025-10-31 2026-03-13 汕头市超声仪器研究所股份有限公司 一种融合dr影像和超声图像的方法、装置、设备及介质

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6006126A (en) * 1991-01-28 1999-12-21 Cosman; Eric R. System and method for stereotactic registration of image scan data
ATE191136T1 (de) 1993-10-29 2000-04-15 United States Surgical Corp Vorrichtung zur kombinierten ultraschall- abbildung und röntgen-abbildung
US5531227A (en) * 1994-01-28 1996-07-02 Schneider Medical Technologies, Inc. Imaging device and method
US6019725A (en) * 1997-03-07 2000-02-01 Sonometrics Corporation Three-dimensional tracking and imaging system
WO2004042546A1 (en) 2002-11-04 2004-05-21 V-Target Technologies Ltd. Apparatus and methods for imaging and attenuation correction
US6549802B2 (en) 2001-06-07 2003-04-15 Varian Medical Systems, Inc. Seed localization system and method in ultrasound by fluoroscopy and ultrasound fusion
WO2005009220A2 (en) 2003-07-21 2005-02-03 Johns Hopkins University Registration of ultrasound to fluoroscopy for real time optimization of radiation implant procedures
JP4758355B2 (ja) * 2003-12-22 2011-08-24 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 患者の体内に医療用機器を案内するためのシステム
EP1751712A2 (en) 2004-05-14 2007-02-14 Philips Intellectual Property & Standards GmbH Information enhanced image guided interventions
CA2618294A1 (en) 2005-08-09 2007-02-15 Koninklijke Philips Electronics, N.V. System and method for selective blending of 2d x-ray images and 3d ultrasound images
US7817835B2 (en) * 2006-03-31 2010-10-19 Siemens Medical Solutions Usa, Inc. Cross reference measurement for diagnostic medical imaging
US20070247454A1 (en) * 2006-04-19 2007-10-25 Norbert Rahn 3D visualization with synchronous X-ray image display
US20080146919A1 (en) 2006-09-29 2008-06-19 Estelle Camus Method for implanting a cardiac implant with real-time ultrasound imaging guidance
US8781193B2 (en) * 2007-03-08 2014-07-15 Sync-Rx, Ltd. Automatic quantitative vessel analysis
US8364242B2 (en) 2007-05-17 2013-01-29 General Electric Company System and method of combining ultrasound image acquisition with fluoroscopic image acquisition
US20090088628A1 (en) * 2007-09-27 2009-04-02 Klaus Klingenbeck-Regn Efficient workflow for afib treatment in the ep lab
US9651662B2 (en) * 2007-11-16 2017-05-16 Koninklijke Philips N.V. Interventional navigation using 3D contrast-enhanced ultrasound
TWI380419B (en) 2008-01-16 2012-12-21 Raydium Semiconductor Corp Integrated circuit package and the method for fabricating thereof
US20100063400A1 (en) * 2008-09-05 2010-03-11 Anne Lindsay Hall Method and apparatus for catheter guidance using a combination of ultrasound and x-ray imaging
US9521994B2 (en) * 2009-05-11 2016-12-20 Siemens Healthcare Gmbh System and method for image guided prostate cancer needle biopsy
RU2535608C2 (ru) * 2009-09-29 2014-12-20 Конинклейке Филипс Электроникс Н.В. Совмещение в реальном времени для лечения сосудов
US10238361B2 (en) 2009-12-09 2019-03-26 Koninklijke Philips N.V. Combination of ultrasound and x-ray systems
WO2011070492A1 (en) * 2009-12-09 2011-06-16 Koninklijke Philips Electronics N.V. Visualization of ultrasound in x-ray images
JP5661453B2 (ja) * 2010-02-04 2015-01-28 株式会社東芝 画像処理装置、超音波診断装置、及び画像処理方法

Also Published As

Publication number Publication date
US11373361B2 (en) 2022-06-28
CN104780845A (zh) 2015-07-15
BR112015009947A2 (pt) 2017-07-11
WO2014072890A1 (en) 2014-05-15
WO2014072890A9 (en) 2014-11-27
US20150294454A1 (en) 2015-10-15
EP2916740B1 (en) 2019-09-04
RU2015121699A (ru) 2016-12-27
EP2916740A1 (en) 2015-09-16
JP2015533329A (ja) 2015-11-24
CN113855059A (zh) 2021-12-31

Similar Documents

Publication Publication Date Title
JP6198839B2 (ja) 超音波画像のエンハンスメント
EP2754126B1 (en) Pairing of an anatomy representation with live images
US10172574B2 (en) Interventional X-ray system with automatic iso-centering
JP6166663B2 (ja) ナビゲーションガイダンスのための視覚化
JP6559532B2 (ja) Ｘ線透視画像のリアルタイムシミュレーション
US20170065206A1 (en) Device for determining a specific position of a catheter
CN105873538B (zh) 用于将成像设备与跟踪设备进行配准的配准系统和方法
WO2013102880A1 (en) Real-time display of vasculature views for optimal device navigation
CN108523998B (zh) 图像支持的方法、x射线装置、计算机程序和数据载体
RU2662871C2 (ru) Ослабление костей при рентгеновской визуализации
JP2014509895A (ja) 血管インターベンションプロシージャにおいてインターベンション装置の正確な誘導を支援する画像表示を提供する画像診断システム及び方法
JP5847163B2 (ja) 関心対象の角度付きビューを生成する医用表示システム及び方法
US10786220B2 (en) Device for imaging an object
JP2019505271A (ja) 投影データセットの提供
KR101525040B1 (ko) 시술 전 영상의 촬영 범위를 결정하기 위한 레퍼런스 영상 생성 방법 및 그 장치
JP6615388B2 (ja) 較正フリーのトモシンセシス
WO2025073380A1 (en) Stitchless panorama in medical image acquisition
US20220096165A1 (en) Interventional device tracking
JP6327695B2 (ja) 手術支援プログラム及び手術支援システムの作動方法
RU2574374C2 (ru) Определение конкретной ориентации объекта

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161027

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161027

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170712

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170724

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170822

R150 Certificate of patent or registration of utility model

Ref document number: 6198839

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250