JP6713987B2 - 整形外科用ナビゲーションのための形状検知 - Google Patents

整形外科用ナビゲーションのための形状検知 Download PDF

Info

Publication number
JP6713987B2
JP6713987B2 JP2017512923A JP2017512923A JP6713987B2 JP 6713987 B2 JP6713987 B2 JP 6713987B2 JP 2017512923 A JP2017512923 A JP 2017512923A JP 2017512923 A JP2017512923 A JP 2017512923A JP 6713987 B2 JP6713987 B2 JP 6713987B2
Authority
JP
Japan
Prior art keywords
shape sensing
optical shape
fiber
bone
sensing fiber
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017512923A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017529914A5 (OSRAM
JP2017529914A (ja
Inventor
シンチ へ
シンチ へ
アレクサンドラ ポポヴィッチ
アレクサンドラ ポポヴィッチ
モリー ララ フレックスマン
モリー ララ フレックスマン
ポール ティエンファラパ
ポール ティエンファラパ
デイビッド ポール ヌーナン
デイビッド ポール ヌーナン
ロン クルーン
ロン クルーン
アリー リーブ レインスティン
アリー リーブ レインスティン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2017529914A publication Critical patent/JP2017529914A/ja
Publication of JP2017529914A5 publication Critical patent/JP2017529914A5/ja
Application granted granted Critical
Publication of JP6713987B2 publication Critical patent/JP6713987B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/02—Prostheses implantable into the body
    • A61F2/30—Joints
    • A61F2/46—Special tools for implanting artificial joints
    • A61F2/4657—Measuring instruments used for implanting artificial joints
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/0042—Surgical instruments, devices or methods with special provisions for gripping
    • A61B2017/00438—Surgical instruments, devices or methods with special provisions for gripping connectable to a finger
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/108—Computer aided selection or customisation of medical implants or cutting guides
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2061—Tracking techniques using shape-sensors, e.g. fiber shape sensors with Bragg gratings
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70—Manipulators specially adapted for use in surgery
    • A61B34/74—Manipulators with manual electric input means
    • A61B2034/741—Glove like input devices, e.g. "data gloves"
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06—Measuring instruments not otherwise provided for
    • A61B2090/067—Measuring instruments not otherwise provided for for measuring angles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/374—NMR or MRI
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
    • A61B2090/3762—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/378—Surgical systems with images on a monitor during operation using ultrasound
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/02—Prostheses implantable into the body
    • A61F2/30—Joints
    • A61F2/46—Special tools for implanting artificial joints
    • A61F2/4657—Measuring instruments used for implanting artificial joints
    • A61F2002/4663—Measuring instruments used for implanting artificial joints for measuring volumes or other three-dimensional shapes

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Public Health (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Robotics (AREA)
  • Transplantation (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Cardiology (AREA)
  • Biophysics (AREA)
  • Vascular Medicine (AREA)
  • Gynecology & Obstetrics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Pathology (AREA)
  • Surgical Instruments (AREA)
  • Length Measuring Devices By Optical Means (AREA)
JP2017512923A 2014-09-08 2015-08-31 整形外科用ナビゲーションのための形状検知 Active JP6713987B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462047338P 2014-09-08 2014-09-08
US62/047,338 2014-09-08
PCT/IB2015/056595 WO2016038499A2 (en) 2014-09-08 2015-08-31 Shape sensing for orthopedic navigation

Publications (3)

Publication Number Publication Date
JP2017529914A JP2017529914A (ja) 2017-10-12
JP2017529914A5 JP2017529914A5 (OSRAM) 2018-10-11
JP6713987B2 true JP6713987B2 (ja) 2020-06-24

Family

ID=54252351

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017512923A Active JP6713987B2 (ja) 2014-09-08 2015-08-31 整形外科用ナビゲーションのための形状検知

Country Status (5)

Country Link
US (1) US11219487B2 (OSRAM)
EP (1) EP3191010A2 (OSRAM)
JP (1) JP6713987B2 (OSRAM)
CN (2) CN107124867A (OSRAM)
WO (1) WO2016038499A2 (OSRAM)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9860477B2 (en) 2013-12-23 2018-01-02 Echostar Technologies L.L.C. Customized video mosaic
CN107635503B (zh) 2015-05-12 2021-09-07 纳维斯国际有限公司 通过介电性质分析进行损伤估计
WO2016181320A1 (en) 2015-05-12 2016-11-17 Navix International Limited Fiducial marking for image-electromagnetic field registration
US10849550B2 (en) * 2016-06-03 2020-12-01 RoboDiagnostics LLC Robotic joint testing apparatus and coordinate systems for joint evaluation and testing
EP3484362A1 (en) 2016-07-14 2019-05-22 Navix International Limited Characteristic track catheter navigation
WO2018092070A1 (en) 2016-11-16 2018-05-24 Navix International Limited Esophagus position detection by electrical mapping
CN110177500B (zh) 2016-11-16 2022-03-04 纳维斯国际有限公司 组织模型动态视觉渲染
WO2018092062A1 (en) * 2016-11-16 2018-05-24 Navix International Limited Real-time display of tissue deformation by interactions with an intra-body probe
US10709507B2 (en) * 2016-11-16 2020-07-14 Navix International Limited Real-time display of treatment-related tissue changes using virtual material
US11622713B2 (en) 2016-11-16 2023-04-11 Navix International Limited Estimators for ablation effectiveness
WO2018175737A1 (en) * 2017-03-22 2018-09-27 Intuitive Surgical Operations, Inc. Systems and methods for intelligently seeding registration
US11065069B2 (en) * 2017-05-10 2021-07-20 Mako Surgical Corp. Robotic spine surgery system and methods
US11033341B2 (en) 2017-05-10 2021-06-15 Mako Surgical Corp. Robotic spine surgery system and methods
CN110944595B (zh) * 2017-06-28 2023-11-24 直观外科手术操作公司 用于将内窥镜图像数据集映射到三维体积上的系统
CN107669349A (zh) * 2017-10-11 2018-02-09 余江 一种对股骨头中心、髌骨中点和第二趾骨进行定位的装置和定位设备
US11129679B2 (en) 2017-11-14 2021-09-28 Mako Surgical Corp. Fiber optic tracking system
TR201722919A2 (tr) * 2017-12-29 2019-07-22 Erhan Ilhan Konukseven Fi̇ber bragg izgara tabanli opti̇k sensörler i̇le cerrahi̇ branşlarda konum beli̇rleme si̇stemi̇
EP3518010A1 (en) * 2018-01-30 2019-07-31 Koninklijke Philips N.V. Optical shape sensor, optical shape sensing console and system, and optical shape sensing method
EP3758640A4 (en) * 2018-02-27 2022-06-01 Mako Surgical Corp. Registration tools, systems, and methods
SG11202009535TA (en) * 2018-04-02 2020-10-29 Saranas Inc Directional and regional bioimpedance bleed detection technique
US20190310819A1 (en) * 2018-04-10 2019-10-10 Carto Technologies, LLC Augmented reality image display systems and methods
GB2577719B (en) * 2018-10-03 2023-04-26 Cmr Surgical Ltd Navigational aid
GB2577718B (en) 2018-10-03 2022-08-24 Cmr Surgical Ltd Feature identification
JP2022507106A (ja) * 2018-11-15 2022-01-18 センターライン バイオメディカル，インコーポレイテッド 解剖学的計測ワイヤを用いた対応付けのためのシステムおよび方法
CN110123452A (zh) * 2019-05-08 2019-08-16 上海电气集团股份有限公司 机器人的导航方法及系统
CN110960321B (zh) 2019-12-18 2021-07-02 苏州微创畅行机器人有限公司 注册靶标、注册方法、装置、电子设备和存储介质
GB202011995D0 (en) * 2020-07-31 2020-09-16 Zaman Tariq A system for monitoring strain
US20230289976A1 (en) * 2022-03-09 2023-09-14 Claire SooHoo Multi-component system for computerized x-ray vision to track motion during surgery
WO2025019758A1 (en) * 2023-07-20 2025-01-23 The Cleveland Clinic Foundation System for automated surface contour matching for surgical navigation

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7169141B2 (en) * 1998-02-24 2007-01-30 Hansen Medical, Inc. Surgical instrument
US8010180B2 (en) * 2002-03-06 2011-08-30 Mako Surgical Corp. Haptic guidance system and method
US7657298B2 (en) 2004-03-11 2010-02-02 Stryker Leibinger Gmbh & Co. Kg System, device, and method for determining a position of an object
US7742802B2 (en) * 2004-03-11 2010-06-22 Howmedica Osteonics Corp. System for determining a position of a point on an object
US7772541B2 (en) 2004-07-16 2010-08-10 Luna Innnovations Incorporated Fiber optic position and/or shape sensing based on rayleigh scatter
US9492237B2 (en) * 2006-05-19 2016-11-15 Mako Surgical Corp. Method and apparatus for controlling a haptic device
EP2240111B1 (en) * 2008-06-18 2019-07-24 Mako Surgical Corp. Fiber optic tracking system
JP5185773B2 (ja) * 2008-10-28 2013-04-17 オリンパスメディカルシステムズ株式会社 形状測定装置
WO2011086432A2 (en) * 2010-01-14 2011-07-21 Koninklijke Philips Electronics N.V. Flexible instrument channel insert for scope with real-time position tracking
US9226799B2 (en) 2010-06-23 2016-01-05 Mako Surgical Corp. Inertially tracked objects
EP2608720B1 (en) * 2010-08-23 2019-07-31 Koninklijke Philips N.V. Mapping system for medical procedures
CN103415255B (zh) * 2011-02-24 2020-02-07 皇家飞利浦电子股份有限公司 利用血管内装置形状对血管图像进行非刚性体变形
EP2723240B1 (en) * 2011-06-27 2018-08-08 Koninklijke Philips N.V. Live 3d angiogram using registration of a surgical tool curve to an x-ray image
JP6114748B2 (ja) * 2011-08-16 2017-04-12 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 光学ファイバー形状データを用いる湾曲マルチプラナ再構成
EP2744409A1 (en) * 2011-10-20 2014-06-25 Koninklijke Philips N.V. Shape sensing devices for real-time mechanical function assessment of an internal organ
IN2014CN03100A (OSRAM) * 2011-10-26 2015-07-03 Koninkl Philips Nv
US10653320B2 (en) 2012-10-02 2020-05-19 Koninklijke Philips N.V. Volume mapping using optical shape sensors
BR112015013510A2 (pt) * 2012-12-14 2017-07-11 Koninklijke Philips Nv aparelho para determinação de posição para determinar a posição de um elemento de trabalho, sistema de intervenção, método para determinação de posição e programa de computador para determinar a posição de um elemento de trabalho

Also Published As

Publication number Publication date
WO2016038499A2 (en) 2016-03-17
EP3191010A2 (en) 2017-07-19
WO2016038499A3 (en) 2016-05-06
JP2017529914A (ja) 2017-10-12
CN107124867A (zh) 2017-09-01
US11219487B2 (en) 2022-01-11
US20170281281A1 (en) 2017-10-05
CN117323001A (zh) 2024-01-02

Similar Documents

Publication Publication Date Title
JP6713987B2 (ja) 整形外科用ナビゲーションのための形状検知
US11793578B2 (en) Optical shape sensing for instrument tracking in orthopedics
CN105555205B (zh) 用于定位可移动目标的形状传感器系统
US11172993B2 (en) Sensored surgical tool and surgical intraoperative tracking and imaging system incorporating same
JP6706576B2 (ja) 最小侵襲性のインターベンションのための形状センスされるロボット超音波
Caversaccio et al. Computer assistance for intraoperative navigation in ENT surgery
US11819297B2 (en) Light guided digitization method to register a bone
JP2009537230A (ja) 外科装置の較正を検証するためのシステムおよび方法
KR20180071328A (ko) 추적된 뼈의 정합을 확인하기 위한 방법
US20170273746A1 (en) Optical shape sensing for soft tissue balancing in orthopedics
EP2785237B1 (en) Surgical port localization
JP2017500935A5 (OSRAM)
US20200337534A1 (en) Surgical port localization
JP2022537891A (ja) 追跡システム視野を配置するシステムおよび方法
US20240065776A1 (en) Light guided digitization method to register a bone

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180830

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20180830

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190521

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20190517

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20190814

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191113

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20191210

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200305

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200309

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20200508

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20200604

R150 Certificate of patent or registration of utility model

Ref document number: 6713987

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250