JP6902547B2 - 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング - Google Patents

融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング Download PDF

Info

Publication number
JP6902547B2
JP6902547B2 JP2018536234A JP2018536234A JP6902547B2 JP 6902547 B2 JP6902547 B2 JP 6902547B2 JP 2018536234 A JP2018536234 A JP 2018536234A JP 2018536234 A JP2018536234 A JP 2018536234A JP 6902547 B2 JP6902547 B2 JP 6902547B2
Authority
JP
Japan
Prior art keywords
view
imaging
annotation
annotations
robot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2018536234A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019501728A5 (https=
JP2019501728A (ja
Inventor
ジョン アラン ブラッケン
ジョン アラン ブラッケン
デイヴィッド ポール ノーナン
デイヴィッド ポール ノーナン
アレクサンドラ ポポヴィッヒ
アレクサンドラ ポポヴィッヒ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2019501728A publication Critical patent/JP2019501728A/ja
Publication of JP2019501728A5 publication Critical patent/JP2019501728A5/ja
Application granted granted Critical
Publication of JP6902547B2 publication Critical patent/JP6902547B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B8/468—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means allowing annotation or message recording
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4417—Constructional features of apparatus for radiation diagnosis related to combined acquisition of different diagnostic modalities
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/467—Arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B6/468—Arrangements for interfacing with the operator or the patient characterised by special input means allowing annotation or message recording
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
    • A61B6/5235—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0883—Clinical applications for diagnosis of the heart
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/12—Diagnosis using ultrasonic, sonic or infrasonic waves in body cavities or body tracts, e.g. by using catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4209—Details of probe positioning or probe attachment to the patient by using holders, e.g. positioning frames
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4416—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
    • A61B6/501—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of the head, e.g. neuroimaging or craniography

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Cardiology (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
JP2018536234A 2016-01-15 2017-01-09 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング Expired - Fee Related JP6902547B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662279297P 2016-01-15 2016-01-15
US62/279,297 2016-01-15
PCT/IB2017/050075 WO2017122109A1 (en) 2016-01-15 2017-01-09 Automated probe steering to clinical views using annotations in a fused image guidance system

Publications (3)

Publication Number Publication Date
JP2019501728A JP2019501728A (ja) 2019-01-24
JP2019501728A5 JP2019501728A5 (https=) 2020-02-13
JP6902547B2 true JP6902547B2 (ja) 2021-07-14

Family

ID=57868299

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018536234A Expired - Fee Related JP6902547B2 (ja) 2016-01-15 2017-01-09 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング

Country Status (5)

Country Link
US (1) US20190021699A1 (https=)
EP (1) EP3402408B1 (https=)
JP (1) JP6902547B2 (https=)
CN (1) CN108471998B (https=)
WO (1) WO2017122109A1 (https=)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016183526A1 (en) 2015-05-14 2016-11-17 Cephea Valve Technologies, Inc. Replacement mitral valves
WO2016183523A1 (en) 2015-05-14 2016-11-17 Cephea Valve Technologies, Inc. Cardiac valve delivery devices and systems
WO2017218877A1 (en) 2016-06-17 2017-12-21 Cephea Valve Technologies, Inc. Cardiac valve delivery devices and systems
JP7019694B2 (ja) 2016-11-08 2022-02-15 ヘンリー フォード ヘルス システム 医療処置で使用するための医療装置の選択
AU2018203053B2 (en) 2017-01-23 2020-03-05 Cephea Valve Technologies, Inc. Replacement mitral valves
CA3051272C (en) 2017-01-23 2023-08-22 Cephea Valve Technologies, Inc. Replacement mitral valves
US20180235701A1 (en) * 2017-02-21 2018-08-23 General Electric Company Systems and methods for intervention guidance using pre-operative planning with ultrasound
US11648112B2 (en) 2017-07-25 2023-05-16 Cephea Valve Technologies, Inc. Method for positioning a heart valve
WO2019045144A1 (ko) * 2017-08-31 2019-03-07 (주)레벨소프트 의료용 항법 장치를 위한 의료 영상 처리 장치 및 의료 영상 처리 방법
CN107693047A (zh) * 2017-10-18 2018-02-16 飞依诺科技(苏州)有限公司 超声成像中基于对称组织的体标设置方法及系统
CN111491567A (zh) * 2017-11-13 2020-08-04 皇家飞利浦有限公司 用于引导超声探头的系统和方法
EP3764913A1 (en) * 2018-03-12 2021-01-20 Koninklijke Philips N.V. Ultrasound imaging plane alignment using neural networks and associated devices, systems, and methods
CN112106070A (zh) * 2018-03-12 2020-12-18 皇家飞利浦有限公司 用于神经网络训练的超声成像数据集获取及相关装置、系统和方法
EP3613351A1 (en) * 2018-08-22 2020-02-26 Koninklijke Philips N.V. Coronary circulation using intra-cardiac echo
AU2020346911A1 (en) * 2019-09-12 2022-03-24 EchoNous, Inc. Systems and methods for automated ultrasound image labeling and quality grading
US11189375B1 (en) * 2020-05-27 2021-11-30 GE Precision Healthcare LLC Methods and systems for a medical image annotation tool
EP4259001A1 (en) * 2020-12-08 2023-10-18 Koninklijke Philips N.V. Systems and methods of generating reconstructed images for interventional medical procedures
US20230190382A1 (en) * 2021-12-20 2023-06-22 Biosense Webster (Israel) Ltd. Directing an ultrasound probe using known positions of anatomical structures
US20250182883A1 (en) * 2022-01-28 2025-06-05 Shifamed Holdings, Llc Systems and methods for imaging and anatomical modeling

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5622174A (en) * 1992-10-02 1997-04-22 Kabushiki Kaisha Toshiba Ultrasonic diagnosis apparatus and image displaying system
US6856827B2 (en) * 2000-04-28 2005-02-15 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
JP2007508913A (ja) * 2003-10-21 2007-04-12 ザ ボード オブ トラスティーズ オブ ザ リーランド スタンフォード ジュニア ユニヴァーシティ 術中ターゲティングのシステムおよび方法
JP2008541797A (ja) * 2005-05-03 2008-11-27 ハンセン メディカル，インク． ロボットガイドカテーテルシステム
US8398541B2 (en) * 2006-06-06 2013-03-19 Intuitive Surgical Operations, Inc. Interactive user interfaces for robotic minimally invasive surgical systems
US20070106147A1 (en) * 2005-11-01 2007-05-10 Altmann Andres C Controlling direction of ultrasound imaging catheter
US8303505B2 (en) * 2005-12-02 2012-11-06 Abbott Cardiovascular Systems Inc. Methods and apparatuses for image guided medical procedures
EP2068716B1 (en) * 2006-10-02 2011-02-09 Hansen Medical, Inc. Systems for three-dimensional ultrasound mapping
US8126239B2 (en) * 2006-10-20 2012-02-28 Siemens Aktiengesellschaft Registering 2D and 3D data using 3D ultrasound data
WO2008076910A1 (en) * 2006-12-15 2008-06-26 The Board Of Trustees Of The Leland Stanford Junior University Image mosaicing systems and methods
US9757036B2 (en) * 2007-05-08 2017-09-12 Mediguide Ltd. Method for producing an electrophysiological map of the heart
CN101301192B (zh) * 2007-05-10 2010-06-23 中国科学院自动化研究所 一种多模态自发荧光断层分子影像仪器及重建方法
JP5127371B2 (ja) * 2007-08-31 2013-01-23 キヤノン株式会社 超音波画像診断システム、及びその制御方法
US8195271B2 (en) * 2007-11-06 2012-06-05 Siemens Aktiengesellschaft Method and system for performing ablation to treat ventricular tachycardia
US8986246B2 (en) * 2008-01-16 2015-03-24 Catheter Robotics Inc. Remotely controlled catheter insertion system
JP5662326B2 (ja) * 2008-10-23 2015-01-28 コーニンクレッカ フィリップス エヌ ヴェ インターベンション・ラジオ波焼灼療法またはペースメーカー設置手順における、仮想的な解剖学的構造を豊かにしたリアルタイム２ｄ撮像のための、心臓および／または呼吸同期画像取得システム
WO2011062035A1 (ja) * 2009-11-17 2011-05-26 オリンパスメディカルシステムズ株式会社 生検支援システム
CN102651999B (zh) * 2009-12-09 2015-07-22 皇家飞利浦电子股份有限公司 超声和x射线系统的组合
DE102010020350B4 (de) * 2010-05-12 2017-02-23 Siemens Healthcare Gmbh Verfahren zur Positionierung des Fokus eines Gradientenfeldes und Behandlungsvorrichtung
JP2012152436A (ja) * 2011-01-27 2012-08-16 Fujifilm Corp 撮影用補助具および放射線画像撮影方法
US9687204B2 (en) * 2011-05-20 2017-06-27 Siemens Healthcare Gmbh Method and system for registration of ultrasound and physiological models to X-ray fluoroscopic images
BR112014013073A8 (pt) * 2011-12-03 2017-06-13 Koninklijke Philips Nv sistema e método para orientação robótica cirúrgica
CN104272348B (zh) * 2012-02-03 2017-11-17 皇家飞利浦有限公司 用于对对象进行成像的成像装置和方法
WO2013141974A1 (en) * 2012-02-08 2013-09-26 Convergent Life Sciences, Inc. System and method for using medical image fusion
US9247880B2 (en) * 2012-02-23 2016-02-02 Siemens Aktiengesellschaft Image fusion for interventional guidance
CN102860841B (zh) * 2012-09-25 2014-10-22 陈颀潇 超声图像引导下穿刺手术的辅助导航系统
DE112013004898B4 (de) * 2012-10-05 2019-09-05 Koninklijke Philips N.V. Medizinisches Bilddarstellungssystem und Verfahren zur Bereitstellung eines verbesserten Röntgenstrahlbildes
US9259282B2 (en) * 2012-12-10 2016-02-16 Intuitive Surgical Operations, Inc. Collision avoidance during controlled movement of image capturing device and manipulatable device movable arms
WO2014102718A1 (en) * 2012-12-28 2014-07-03 Koninklijke Philips N.V. Real-time scene-modeling combining 3d ultrasound and 2d x-ray imagery
US20140188440A1 (en) * 2012-12-31 2014-07-03 Intuitive Surgical Operations, Inc. Systems And Methods For Interventional Procedure Planning
US20150223773A1 (en) * 2014-02-11 2015-08-13 Siemens Medical Solutions Usa, Inc. Method and Apparatus for Image Fusion Based Planning of C-Arm Angulation for Structural Heart Disease
US9498170B2 (en) * 2013-05-23 2016-11-22 Louis Eliot Schwarzbach Apparatus for holding and positioning X-ray film, photostimulable phosphor plates or digital sensors while taking dental radiographs
US9283048B2 (en) * 2013-10-04 2016-03-15 KB Medical SA Apparatus and systems for precise guidance of surgical tools
US9230331B2 (en) * 2013-10-21 2016-01-05 Samsung Electronics Co., Ltd. Systems and methods for registration of ultrasound and CT images
CN105934215B (zh) * 2014-01-24 2019-11-26 皇家飞利浦有限公司 具有光学形状感测的成像设备的机器人控制
EP3116406A1 (en) * 2014-03-12 2017-01-18 Koninklijke Philips N.V. System and method of haptic feedback for transesophageal echocardiogram ultrasound transducer probe
CN104257342B (zh) * 2014-10-21 2016-09-21 深圳英美达医疗技术有限公司 一种内窥成像探头及利用上述成像探头进行的成像方法
US10515449B2 (en) * 2016-11-04 2019-12-24 Siemens Medical Solutions Usa, Inc. Detection of 3D pose of a TEE probe in x-ray medical imaging

Also Published As

Publication number Publication date
WO2017122109A1 (en) 2017-07-20
US20190021699A1 (en) 2019-01-24
CN108471998B (zh) 2022-07-19
EP3402408B1 (en) 2020-09-02
JP2019501728A (ja) 2019-01-24
CN108471998A (zh) 2018-08-31
EP3402408A1 (en) 2018-11-21

Similar Documents

Publication Publication Date Title
JP6902547B2 (ja) 融合画像ガイダンスシステムの注釈を使用した臨床ビューに対する自動化されたプローブステアリング
US11642173B2 (en) Image-based navigation system and method of using same
US11690683B2 (en) Vision-based position and orientation determination for endovascular tools
CN105979879B (zh) 具有光学形状感测设备视角的虚拟图像
CN104411248B (zh) 在内窥镜外科手术中用于最佳图像采集的c型臂轨迹规划
CN106691580B (zh) 用于超声图像引导的消融天线放置的系统和方法
JP5285270B2 (ja) 自動ガイドワイヤ操作システム
EP2642917B1 (en) System and method for interactive three dimensional operation guidance system for soft organs based on anatomic map
JP2022523445A (ja) 動的な介入的３次元モデル変形
CN103957772B (zh) 形状感测辅助的医疗过程
JP2020503134A (ja) 形状検知デバイスを使用した医療ナビゲーションシステム及びその動作方法
CN113661544A (zh) 基于图像的探针定位
JP2007083038A (ja) 医療装置を管腔内の選択位置に搬送するための方法及びシステム
JP2017511728A (ja) 同時ｘ平面撮像を用いた画像レジストレーション及び誘導
US20230000566A1 (en) Image space control for endovascular tools
CN115804652A (zh) 手术操作系统及方法
CN116056654A (zh) 导航操作指令
CN118742265A (zh) 使用解剖结构的已知位置来引导超声探头
JP6612873B2 (ja) 追跡型インターベンショナルプロシージャにおける最適なキャリブレーションの自動選択
CN116636927A (zh) 用于跟踪和可视化医疗设备的方法和系统
JP2023505466A (ja) 超音波プローブをガイドするためのシステム及び方法
EP3389539B1 (en) Navigation assistance system
US12121307B2 (en) Vision-based position and orientation determination for endovascular tools
US20240000517A1 (en) Image space control for endovascular tools
Li A Dual-Arm Robotic Platform for Prostate Brachytherapy: System Integration and Ultrasound-Guided Needle Tracking

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200106

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200106

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20201028

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201105

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210203

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210302

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210524

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210615

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210621

R150 Certificate of patent or registration of utility model

Ref document number: 6902547

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees