JP7080228B6 - 磁気共鳴イメージングのための知的モデルベースの患者ポジショニングシステム - Google Patents

磁気共鳴イメージングのための知的モデルベースの患者ポジショニングシステム Download PDF

Info

Publication number
JP7080228B6
JP7080228B6 JP2019519744A JP2019519744A JP7080228B6 JP 7080228 B6 JP7080228 B6 JP 7080228B6 JP 2019519744 A JP2019519744 A JP 2019519744A JP 2019519744 A JP2019519744 A JP 2019519744A JP 7080228 B6 JP7080228 B6 JP 7080228B6
Authority
JP
Japan
Prior art keywords
human
reference point
model
distance image
reference frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019519744A
Other languages
English (en)
Japanese (ja)
Other versions
JP7080228B2 (ja
JP2019532728A5 (enExample
JP2019532728A (ja
Inventor
ラマン シヴァラマクリシュナン クリシュネイエール
ギリシュ ボガディ エスワラ プラサド
クマール ラジャ ガッタマネニ
ギリッシュ クマール チェグ
シヴァムルシー プラシャンス ホンネマラダハリ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2019532728A publication Critical patent/JP2019532728A/ja
Publication of JP2019532728A5 publication Critical patent/JP2019532728A5/ja
Application granted granted Critical
Publication of JP7080228B2 publication Critical patent/JP7080228B2/ja
Publication of JP7080228B6 publication Critical patent/JP7080228B6/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1113Local tracking of patients, e.g. in a hospital or private home
    • A61B5/1114Tracking parts of the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/04Positioning of patients; Tiltable beds or the like
    • A61B6/0492Positioning of patients; Tiltable beds or the like using markers or indicia for aiding patient positioning
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/28Details of apparatus provided for in groups G01R33/44 - G01R33/64
    • G01R33/283Intercom or optical viewing arrangements, structurally associated with NMR apparatus
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/543Control of the operation of the MR system, e.g. setting of acquisition parameters prior to or during MR data acquisition, dynamic shimming, use of one or more scout images for scan plane prescription
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/18Image warping, e.g. rearranging pixels individually
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/344Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/60Static or dynamic means for assisting the user to position a body part for biometric acquisition
    • G06V40/67Static or dynamic means for assisting the user to position a body part for biometric acquisition by interactive indications to the user
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient; User input means
    • A61B5/742Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/7445Display arrangements, e.g. multiple display units
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computed tomography [CT]
    • A61B6/032Transmission computed tomography [CT]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computed tomography [CT]
    • A61B6/037Emission tomography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/04Positioning of patients; Tiltable beds or the like
    • A61B6/0407Supports, e.g. tables or beds, for the body or parts of the body
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10088Magnetic resonance imaging [MRI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20092Interactive image processing based on input by user
    • G06T2207/20101Interactive definition of point of interest, landmark or seed
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20092Interactive image processing based on input by user
    • G06T2207/20104Interactive definition of region of interest [ROI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radiology & Medical Imaging (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Human Computer Interaction (AREA)
  • Condensed Matter Physics & Semiconductors (AREA)
  • Multimedia (AREA)
  • Physiology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Quality & Reliability (AREA)
  • Optics & Photonics (AREA)
  • Signal Processing (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
JP2019519744A 2016-10-12 2017-10-12 磁気共鳴イメージングのための知的モデルベースの患者ポジショニングシステム Active JP7080228B6 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
IN201641034779 2016-10-12
IN201641034779 2016-10-12
PCT/EP2017/076137 WO2018069479A1 (en) 2016-10-12 2017-10-12 An intelligent model based patient positioning system for magnetic resonance imaging

Publications (4)

Publication Number Publication Date
JP2019532728A JP2019532728A (ja) 2019-11-14
JP2019532728A5 JP2019532728A5 (enExample) 2020-11-19
JP7080228B2 JP7080228B2 (ja) 2022-06-03
JP7080228B6 true JP7080228B6 (ja) 2022-06-23

Family

ID=60245036

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019519744A Active JP7080228B6 (ja) 2016-10-12 2017-10-12 磁気共鳴イメージングのための知的モデルベースの患者ポジショニングシステム

Country Status (5)

Country Link
US (1) US11647917B2 (enExample)
EP (1) EP3525662B1 (enExample)
JP (1) JP7080228B6 (enExample)
CN (1) CN109862825B (enExample)
WO (1) WO2018069479A1 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3633622A1 (en) 2018-10-02 2020-04-08 Koninklijke Philips N.V. Generation of pseudo radiographic images from optical images
EP3646794A1 (en) 2018-11-02 2020-05-06 Koninklijke Philips N.V. Positioning of a patient carrier
EP3669942B1 (en) * 2018-12-17 2022-01-05 Shanghai United Imaging Healthcare Co., Ltd. Systems and methods for determining a region of interest of a subject
CN110286343B (zh) * 2019-07-10 2021-06-25 苏州众志医疗科技有限公司 一种磁共振射频接收线圈和图像后处理方法
JP7443965B2 (ja) * 2020-07-13 2024-03-06 オムロン株式会社 情報処理装置、補正方法、プログラム
CN112401919B (zh) * 2020-11-17 2023-04-21 上海联影医疗科技股份有限公司 一种基于摆位模型的辅助摆位方法及系统
US12308108B2 (en) * 2021-08-20 2025-05-20 GE Precision Healthcare LLC Automatically detecting characteristics of a medical image series
EP4455704A1 (de) * 2023-04-25 2024-10-30 Siemens Healthineers AG Verfahren zu einem bereitstellen eines kollisionsvermeidungsmodells für eine bewegung eines patiententischs in einem patientenaufnahmebereich einer magnetresonanzvorrichtung

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003310592A (ja) 2002-04-22 2003-11-05 Toshiba Corp 遠隔x線撮像方法、遠隔x線撮像システム、医用画像診断装置のシミュレーション方法、情報処理サービス方法、及びモダリティシミュレータシステム
JP2006288908A (ja) 2005-04-14 2006-10-26 Hitachi Medical Corp 医用画像診断装置
US20150035942A1 (en) 2013-08-02 2015-02-05 Varian Medical Systems, Inc. Camera systems and methods for use in one or more areas in a medical facility
JP2015167008A (ja) 2013-07-30 2015-09-24 キヤノン株式会社 姿勢推定装置、姿勢推定方法およびプログラム
JP2016053900A (ja) 2014-09-04 2016-04-14 株式会社東芝 画像処理装置、画像処理システム、画像処理方法及びプログラム

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6405072B1 (en) * 1991-01-28 2002-06-11 Sherwood Services Ag Apparatus and method for determining a location of an anatomical target with reference to a medical apparatus
DE10346410A1 (de) 2003-10-07 2005-05-04 Martin Tank Verfahren zur Bestimmung von patientenbezogenen Informationen zur Position und Orientierung von Schnittbildaufnahmen bei magnetresonanztomographischen Untersuchungen
DE102005053488A1 (de) * 2005-11-09 2007-05-16 Siemens Ag Bildgebungsvorrichtung und Therapieanlage mit einer solchen
US20070225588A1 (en) * 2006-03-17 2007-09-27 Michael Steckner Automated Patient Localization in a Medical Imaging System
CN100536770C (zh) * 2007-03-29 2009-09-09 新奥博为技术有限公司 一种磁共振图像引导下的手术系统及手术导航方法
EP2252215A1 (en) 2008-03-12 2010-11-24 Philips Intellectual Property & Standards GmbH Model based self-positioning patient table for x- ray systems
EP2189945A1 (en) * 2008-11-21 2010-05-26 A&P ip B.V. Method of and arrangement for linking image coordinates to coordinates of reference model
FR2970638B1 (fr) * 2011-01-26 2014-03-07 Inst Nat Rech Inf Automat Procede et systeme d'aide au positionnement d'un outil medical sur la tete d'un sujet
KR20130057653A (ko) * 2011-11-24 2013-06-03 삼성전자주식회사 의료영상기기
CN103181764B (zh) * 2011-12-30 2015-03-11 上海爱立峰医疗科技有限公司 磁共振扫描定位系统及指向性定位扫描方法
US10925564B2 (en) * 2012-04-20 2021-02-23 Siemens Medical Solutions Usa, Inc. Medical imaging system with range imaging-based control
GB2506903A (en) 2012-10-12 2014-04-16 Vision Rt Ltd Positioning patient for radio-therapy using 3D models and reflective markers
US20150002419A1 (en) * 2013-06-26 2015-01-01 Microsoft Corporation Recognizing interactions with hot zones
CN103431863B (zh) 2013-09-03 2015-11-18 奥泰医疗系统有限责任公司 用于磁共振的定位方法
WO2015104075A2 (en) 2013-11-27 2015-07-16 Koninklijke Philips N.V. Interventional x-ray system with automatic iso-centering
WO2015134953A1 (en) 2014-03-06 2015-09-11 Virtual Reality Medical Applications, Inc. Virtual reality medical application system
DE102014218557B4 (de) * 2014-09-16 2023-04-27 Siemens Healthcare Gmbh Benutzerschnittstelle und Verfahren zur automatisierten Positionierung eines Patiententisches relativ zu einer medizintechnischen Anlage
WO2016120073A1 (en) * 2015-01-29 2016-08-04 Koninklijke Philips N.V. Camera system for automated measurement of patient biometric and physiological parameters for use in a medical imaging modality
US9886534B2 (en) * 2016-02-03 2018-02-06 Varian Medical Systems, Inc. System and method for collision avoidance in medical systems

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003310592A (ja) 2002-04-22 2003-11-05 Toshiba Corp 遠隔x線撮像方法、遠隔x線撮像システム、医用画像診断装置のシミュレーション方法、情報処理サービス方法、及びモダリティシミュレータシステム
JP2006288908A (ja) 2005-04-14 2006-10-26 Hitachi Medical Corp 医用画像診断装置
JP2015167008A (ja) 2013-07-30 2015-09-24 キヤノン株式会社 姿勢推定装置、姿勢推定方法およびプログラム
US20150035942A1 (en) 2013-08-02 2015-02-05 Varian Medical Systems, Inc. Camera systems and methods for use in one or more areas in a medical facility
JP2016053900A (ja) 2014-09-04 2016-04-14 株式会社東芝 画像処理装置、画像処理システム、画像処理方法及びプログラム

Also Published As

Publication number Publication date
JP7080228B2 (ja) 2022-06-03
CN109862825B (zh) 2023-02-03
US20200178839A1 (en) 2020-06-11
CN109862825A (zh) 2019-06-07
US11647917B2 (en) 2023-05-16
EP3525662A1 (en) 2019-08-21
EP3525662B1 (en) 2024-07-31
WO2018069479A1 (en) 2018-04-19
JP2019532728A (ja) 2019-11-14

Similar Documents

Publication Publication Date Title
JP7080228B6 (ja) 磁気共鳴イメージングのための知的モデルベースの患者ポジショニングシステム
CN113573641B (zh) 使用二维图像投影的跟踪系统与图像的空间配准
CN106981098B (zh) 虚拟场景组分的视角表示
CN107016717B (zh) 用于患者的透视视图的系统和方法
US9895131B2 (en) Method and system of scanner automation for X-ray tube with 3D camera
US10799119B2 (en) Method and apparatus for provision of preparatory information for magnetic resonance imaging
CN105027163B (zh) 扫描区域确定装置
EP3073926B1 (en) Interventional x-ray system with automatic iso-centering
EP3406196A1 (en) X-ray system and method for standing subject
US20170032527A1 (en) Method and system for head digitization and co-registration of medical imaging data
EP4301229B1 (en) Image-based planning of tomographic scan
US10830850B2 (en) Optical camera for patient position monitoring
Pycinski et al. Time-of-flight camera, optical tracker and computed tomography in pairwise data registration
US20250072977A1 (en) Automated registration of preoperative volume image data, using a search image
CN109171789A (zh) 一种用于影像诊断设备的校准方法和校准系统
CN109907833B (zh) 医学成像中的标记描绘
CN118615020B (zh) 一种牙科手术导航中导航板与牙齿的相对位置标定方法、系统和存储介质
Ahmadian et al. An efficient method for estimating soft tissue deformation based on intraoperative stereo image features and point‐based registration
CN118476820A (zh) 预览图像生成方法和装置、设备、介质及产品
Marreiros et al. Superficial vessel reconstruction with a multiview camera system
CN116269455B (zh) 在spect中自动获取人体轮廓的检测方法和系统
EP4586215A1 (en) Accurate body keypoint detection using purely synthetic data for workflow support
CN107092774A (zh) 一种提供参考信息的方法及装置
CN119270169A (zh) 磁共振摄像装置及多通道接收线圈的自动通道选择方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190926

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201009

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201009

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210726

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210805

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20211029

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220131

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220519

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220524

R150 Certificate of patent or registration of utility model

Ref document number: 7080228

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250