JP6902547B2 - 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング - Google Patents

融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング Download PDF

Info

Publication number
JP6902547B2
JP6902547B2 JP2018536234A JP2018536234A JP6902547B2 JP 6902547 B2 JP6902547 B2 JP 6902547B2 JP 2018536234 A JP2018536234 A JP 2018536234A JP 2018536234 A JP2018536234 A JP 2018536234A JP 6902547 B2 JP6902547 B2 JP 6902547B2
Authority
JP
Japan
Prior art keywords
view
imaging
annotation
annotations
robot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018536234A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019501728A5 (enExample
JP2019501728A (ja
Inventor
ジョン アラン ブラッケン
ジョン アラン ブラッケン
デイヴィッド ポール ノーナン
デイヴィッド ポール ノーナン
アレクサンドラ ポポヴィッヒ
アレクサンドラ ポポヴィッヒ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2019501728A publication Critical patent/JP2019501728A/ja
Publication of JP2019501728A5 publication Critical patent/JP2019501728A5/ja
Application granted granted Critical
Publication of JP6902547B2 publication Critical patent/JP6902547B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B8/468—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means allowing annotation or message recording
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4417—Constructional features of apparatus for radiation diagnosis related to combined acquisition of different diagnostic modalities
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/467—Arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B6/468—Arrangements for interfacing with the operator or the patient characterised by special input means allowing annotation or message recording
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
    • A61B6/5235—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0883—Clinical applications for diagnosis of the heart
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/12—Diagnosis using ultrasonic, sonic or infrasonic waves in body cavities or body tracts, e.g. by using catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4209—Details of probe positioning or probe attachment to the patient by using holders, e.g. positioning frames
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4416—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
    • A61B6/501—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of the head, e.g. neuroimaging or craniography

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Cardiology (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
JP2018536234A 2016-01-15 2017-01-09 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング Active JP6902547B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662279297P 2016-01-15 2016-01-15
US62/279,297 2016-01-15
PCT/IB2017/050075 WO2017122109A1 (en) 2016-01-15 2017-01-09 Automated probe steering to clinical views using annotations in a fused image guidance system

Publications (3)

Publication Number Publication Date
JP2019501728A JP2019501728A (ja) 2019-01-24
JP2019501728A5 JP2019501728A5 (enExample) 2020-02-13
JP6902547B2 true JP6902547B2 (ja) 2021-07-14

Family

ID=57868299

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018536234A Active JP6902547B2 (ja) 2016-01-15 2017-01-09 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング

Country Status (5)

Country Link
US (1) US20190021699A1 (enExample)
EP (1) EP3402408B1 (enExample)
JP (1) JP6902547B2 (enExample)
CN (1) CN108471998B (enExample)
WO (1) WO2017122109A1 (enExample)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3294221B1 (en) 2015-05-14 2024-03-06 Cephea Valve Technologies, Inc. Replacement mitral valves
EP3294220B1 (en) 2015-05-14 2023-12-06 Cephea Valve Technologies, Inc. Cardiac valve delivery devices and systems
EP3471665B1 (en) 2016-06-17 2023-10-11 Cephea Valve Technologies, Inc. Cardiac valve delivery devices
WO2018089461A1 (en) * 2016-11-08 2018-05-17 Henry Ford Health System Selecting a medical device for use in a medical procedure
AU2018203053B2 (en) 2017-01-23 2020-03-05 Cephea Valve Technologies, Inc. Replacement mitral valves
CR20190381A (es) 2017-01-23 2019-09-27 Cephea Valve Tech Inc Valvulas mitrales de reemplazo
US20180235701A1 (en) * 2017-02-21 2018-08-23 General Electric Company Systems and methods for intervention guidance using pre-operative planning with ultrasound
CN111093564B (zh) * 2017-07-25 2022-06-14 科菲瓣膜技术有限公司 用于定位心脏瓣膜的系统和方法
WO2019045144A1 (ko) * 2017-08-31 2019-03-07 (주)레벨소프트 의료용 항법 장치를 위한 의료 영상 처리 장치 및 의료 영상 처리 방법
CN107693047A (zh) * 2017-10-18 2018-02-16 飞依诺科技(苏州)有限公司 超声成像中基于对称组织的体标设置方法及系统
US20200359994A1 (en) * 2017-11-13 2020-11-19 Koninklijke Philips N.V. System and method for guiding ultrasound probe
WO2019174953A1 (en) * 2018-03-12 2019-09-19 Koninklijke Philips N.V. Ultrasound imaging dataset acquisition for neural network training and associated devices, systems, and methods
JP7401447B2 (ja) * 2018-03-12 2023-12-19 コーニンクレッカ フィリップス エヌ ヴェ ニューラルネットワークを使用した超音波撮像平面整列並びに関連するデバイス、システム、及び方法
EP3613351A1 (en) * 2018-08-22 2020-02-26 Koninklijke Philips N.V. Coronary circulation using intra-cardiac echo
WO2021050976A1 (en) * 2019-09-12 2021-03-18 EchoNous, Inc. Systems and methods for automated ultrasound image labeling and quality grading
US11189375B1 (en) * 2020-05-27 2021-11-30 GE Precision Healthcare LLC Methods and systems for a medical image annotation tool
US20240024037A1 (en) * 2020-12-08 2024-01-25 Koninklijke Philips N.V. Systems and methods of generating reconstructed images for interventional medical procedures
US20230190382A1 (en) * 2021-12-20 2023-06-22 Biosense Webster (Israel) Ltd. Directing an ultrasound probe using known positions of anatomical structures
EP4468953A2 (en) * 2022-01-28 2024-12-04 Shifamed Holdings, LLC Systems and methods for imaging and anatomical modeling

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5622174A (en) * 1992-10-02 1997-04-22 Kabushiki Kaisha Toshiba Ultrasonic diagnosis apparatus and image displaying system
US6856827B2 (en) * 2000-04-28 2005-02-15 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
EP1680024A2 (en) * 2003-10-21 2006-07-19 The Board Of Trustees Of The Leland Stanford Junior University Systems and methods for intraoperative targetting
US7963288B2 (en) * 2005-05-03 2011-06-21 Hansen Medical, Inc. Robotic catheter system
US8398541B2 (en) * 2006-06-06 2013-03-19 Intuitive Surgical Operations, Inc. Interactive user interfaces for robotic minimally invasive surgical systems
US20070106147A1 (en) * 2005-11-01 2007-05-10 Altmann Andres C Controlling direction of ultrasound imaging catheter
US8303505B2 (en) * 2005-12-02 2012-11-06 Abbott Cardiovascular Systems Inc. Methods and apparatuses for image guided medical procedures
ATE497729T1 (de) * 2006-10-02 2011-02-15 Hansen Medical Inc System für dreidimensionale ultraschall-abbildung
US8126239B2 (en) * 2006-10-20 2012-02-28 Siemens Aktiengesellschaft Registering 2D and 3D data using 3D ultrasound data
WO2008076910A1 (en) * 2006-12-15 2008-06-26 The Board Of Trustees Of The Leland Stanford Junior University Image mosaicing systems and methods
US9757036B2 (en) * 2007-05-08 2017-09-12 Mediguide Ltd. Method for producing an electrophysiological map of the heart
CN101301192B (zh) * 2007-05-10 2010-06-23 中国科学院自动化研究所 一种多模态自发荧光断层分子影像仪器及重建方法
JP5127371B2 (ja) * 2007-08-31 2013-01-23 キヤノン株式会社 超音波画像診断システム、及びその制御方法
US8195271B2 (en) * 2007-11-06 2012-06-05 Siemens Aktiengesellschaft Method and system for performing ablation to treat ventricular tachycardia
US8986246B2 (en) * 2008-01-16 2015-03-24 Catheter Robotics Inc. Remotely controlled catheter insertion system
US11627904B2 (en) * 2008-10-23 2023-04-18 Koninklijke Philips N.V. Cardiac and or respiratory gated image acquisition system and method for virtual anatomy enriched real time 2D imaging in interventional radiofrequency ablation or pace maker replacement procecure
WO2011062035A1 (ja) * 2009-11-17 2011-05-26 オリンパスメディカルシステムズ株式会社 生検支援システム
CN102651999B (zh) * 2009-12-09 2015-07-22 皇家飞利浦电子股份有限公司 超声和x射线系统的组合
DE102010020350B4 (de) * 2010-05-12 2017-02-23 Siemens Healthcare Gmbh Verfahren zur Positionierung des Fokus eines Gradientenfeldes und Behandlungsvorrichtung
JP2012152436A (ja) * 2011-01-27 2012-08-16 Fujifilm Corp 撮影用補助具および放射線画像撮影方法
US9687204B2 (en) * 2011-05-20 2017-06-27 Siemens Healthcare Gmbh Method and system for registration of ultrasound and physiological models to X-ray fluoroscopic images
BR112014013073A2 (pt) * 2011-12-03 2017-06-13 Koninklijke Philips Nv sistema e método para orientação robótica cirúrgica
US9684972B2 (en) * 2012-02-03 2017-06-20 Koninklijke Philips N.V. Imaging apparatus for imaging an object
US20130211230A1 (en) * 2012-02-08 2013-08-15 Convergent Life Sciences, Inc. System and method for using medical image fusion
US9247880B2 (en) * 2012-02-23 2016-02-02 Siemens Aktiengesellschaft Image fusion for interventional guidance
CN102860841B (zh) * 2012-09-25 2014-10-22 陈颀潇 超声图像引导下穿刺手术的辅助导航系统
JP6310464B2 (ja) * 2012-10-05 2018-04-11 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 改善されたｘ線画像を供する医療撮像システム及び方法
US9259282B2 (en) * 2012-12-10 2016-02-16 Intuitive Surgical Operations, Inc. Collision avoidance during controlled movement of image capturing device and manipulatable device movable arms
US10157491B2 (en) * 2012-12-28 2018-12-18 Koninklijke Philips N.V. Real-time scene-modeling combining 3D ultrasound and 2D X-ray imagery
US10588597B2 (en) * 2012-12-31 2020-03-17 Intuitive Surgical Operations, Inc. Systems and methods for interventional procedure planning
US20150223773A1 (en) * 2014-02-11 2015-08-13 Siemens Medical Solutions Usa, Inc. Method and Apparatus for Image Fusion Based Planning of C-Arm Angulation for Structural Heart Disease
US9498170B2 (en) * 2013-05-23 2016-11-22 Louis Eliot Schwarzbach Apparatus for holding and positioning X-ray film, photostimulable phosphor plates or digital sensors while taking dental radiographs
US9283048B2 (en) * 2013-10-04 2016-03-15 KB Medical SA Apparatus and systems for precise guidance of surgical tools
US9230331B2 (en) * 2013-10-21 2016-01-05 Samsung Electronics Co., Ltd. Systems and methods for registration of ultrasound and CT images
JP6568084B2 (ja) * 2014-01-24 2019-08-28 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 光学式形状検知を用いてデバイスを撮像するロボット制御
CN106102592B (zh) * 2014-03-12 2021-01-22 皇家飞利浦有限公司 用于经食道超声心动图超声换能器探头的触觉反馈的系统和方法
CN104257342B (zh) * 2014-10-21 2016-09-21 深圳英美达医疗技术有限公司 一种内窥成像探头及利用上述成像探头进行的成像方法
US10515449B2 (en) * 2016-11-04 2019-12-24 Siemens Medical Solutions Usa, Inc. Detection of 3D pose of a TEE probe in x-ray medical imaging

Also Published As

Publication number Publication date
EP3402408A1 (en) 2018-11-21
WO2017122109A1 (en) 2017-07-20
CN108471998B (zh) 2022-07-19
CN108471998A (zh) 2018-08-31
EP3402408B1 (en) 2020-09-02
US20190021699A1 (en) 2019-01-24
JP2019501728A (ja) 2019-01-24

Similar Documents

Publication Publication Date Title
JP6902547B2 (ja) 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング
US11642173B2 (en) Image-based navigation system and method of using same
CN105979879B (zh) 具有光学形状感测设备视角的虚拟图像
CN104411248B (zh) 在内窥镜外科手术中用于最佳图像采集的c型臂轨迹规划
CN106691580B (zh) 用于超声图像引导的消融天线放置的系统和方法
US11690683B2 (en) Vision-based position and orientation determination for endovascular tools
EP2642917B1 (en) System and method for interactive three dimensional operation guidance system for soft organs based on anatomic map
JP2022523445A (ja) 動的な介入的３次元モデル変形
CN103957772B (zh) 形状感测辅助的医疗过程
JP2020503134A (ja) 形状検知デバイスを使用した医療ナビゲーションシステム及びその動作方法
JP2007083038A (ja) 医療装置を管腔内の選択位置に搬送するための方法及びシステム
JP2017511728A (ja) 同時ｘ平面撮像を用いた画像レジストレーション及び誘導
CN113661544A (zh) 基于图像的探针定位
US11707332B2 (en) Image space control for endovascular tools
CN115804652A (zh) 手术操作系统及方法
CN116056654A (zh) 导航操作指令
CN116636927A (zh) 用于跟踪和可视化医疗设备的方法和系统
JP6612873B2 (ja) 追跡型インターベンショナルプロシージャにおける最適なキャリブレーションの自動選択
JP2023505466A (ja) 超音波プローブをガイドするためのシステム及び方法
EP3389539B1 (en) Navigation assistance system
US12121307B2 (en) Vision-based position and orientation determination for endovascular tools
US20240000517A1 (en) Image space control for endovascular tools
CN118742265A (zh) 使用解剖结构的已知位置来引导超声探头
CN118742266A (zh) 在四维超声图像中使医疗探头可视化
HK1190056B (en) System and method for interactive three dimensional operation guidance system for soft organs based on anatomic map

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200106

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200106

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20201028

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201105

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210203

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210302

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210524

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210615

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210621

R150 Certificate of patent or registration of utility model

Ref document number: 6902547

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250