JP6882977B2 - 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム - Google Patents

超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム Download PDF

Info

Publication number
JP6882977B2
JP6882977B2 JP2017519493A JP2017519493A JP6882977B2 JP 6882977 B2 JP6882977 B2 JP 6882977B2 JP 2017519493 A JP2017519493 A JP 2017519493A JP 2017519493 A JP2017519493 A JP 2017519493A JP 6882977 B2 JP6882977 B2 JP 6882977B2
Authority
JP
Japan
Prior art keywords
motion
tracking model
complex
motion tracking
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017519493A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017536862A (ja
JP2017536862A5 (enExample
Inventor
ニコラ フランソワ ヴィラン
ニコラ フランソワ ヴィラン
パスカル アラン
パスカル アラン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2017536862A publication Critical patent/JP2017536862A/ja
Publication of JP2017536862A5 publication Critical patent/JP2017536862A5/ja
Priority to JP2021037903A priority Critical patent/JP7216131B2/ja
Application granted granted Critical
Publication of JP6882977B2 publication Critical patent/JP6882977B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Clinical applications
    • A61B8/0883—Clinical applications for diagnosis of the heart
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/13—Tomography
    • A61B8/14—Echo-tomography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/466—Displaying means of special interest adapted to display 3D data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/48—Diagnostic techniques
    • A61B8/483—Diagnostic techniques involving the acquisition of a 3D volume of data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5223—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for extracting a diagnostic or physiological parameter from medical diagnostic data
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88—Sonar systems specially adapted for specific applications
    • G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
    • G01S15/8906—Short-range imaging systems; Acoustic microscope systems using pulse-echo techniques
    • G01S15/8993—Three dimensional imaging systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52053—Display arrangements
    • G01S7/52057—Cathode ray tube displays
    • G01S7/52073—Production of cursor lines, markers or indicia by electronic means
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52053—Display arrangements
    • G01S7/52057—Cathode ray tube displays
    • G01S7/52074—Composite displays, e.g. split-screen displays; Combination of multiple images or of images and alphanumeric tabular information
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/523—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for generating planar views from image data in a user selectable plane not corresponding to the acquisition plane
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30048—Heart; Cardiac

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Acoustics & Sound (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
JP2017519493A 2014-10-27 2015-10-21 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム Active JP6882977B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021037903A JP7216131B2 (ja) 2014-10-27 2021-03-10 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP14306703.1 2014-10-27
EP14306703 2014-10-27
PCT/EP2015/074397 WO2016066497A1 (en) 2014-10-27 2015-10-21 Method of visualizing a sequence of ultrasound images, computer program product and ultrasound system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2021037903A Division JP7216131B2 (ja) 2014-10-27 2021-03-10 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム

Publications (3)

Publication Number Publication Date
JP2017536862A JP2017536862A (ja) 2017-12-14
JP2017536862A5 JP2017536862A5 (enExample) 2018-11-29
JP6882977B2 true JP6882977B2 (ja) 2021-06-02

Family

ID=51870952

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2017519493A Active JP6882977B2 (ja) 2014-10-27 2015-10-21 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム
JP2021037903A Active JP7216131B2 (ja) 2014-10-27 2021-03-10 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2021037903A Active JP7216131B2 (ja) 2014-10-27 2021-03-10 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム

Country Status (5)

Country Link
US (1) US10881379B2 (enExample)
EP (1) EP3212089B1 (enExample)
JP (2) JP6882977B2 (enExample)
CN (1) CN107072638B (enExample)
WO (1) WO2016066497A1 (enExample)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6835587B2 (ja) * 2014-02-19 2021-02-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 医用４ｄイメージングにおける動き適応型可視化
US10713800B2 (en) * 2017-05-26 2020-07-14 Cardioinsight Technologies, Inc. Ultrasound-based geometry determination for electrophysiological mapping
CN112106146A (zh) * 2018-03-08 2020-12-18 皇家飞利浦有限公司 用于高风险斑块负担评估的交互式自我改进注释系统
EP4114272A1 (en) * 2020-03-05 2023-01-11 Koninklijke Philips N.V. Contextual multiplanar reconstruction of three-dimensional ultrasound imaging data and associated devices, systems, and methods
US20250017557A1 (en) * 2023-07-14 2025-01-16 Siemens Medical Solutions Usa, Inc. Multi-plane-based cardiac wall motion detection in medical ultrasound

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06285064A (ja) * 1993-04-07 1994-10-11 Toshiba Corp 超音波診断装置
US6589176B2 (en) 2001-12-05 2003-07-08 Koninklijke Philips Electronics N.V. Ultrasonic image stabilization system and method
US7421101B2 (en) * 2003-10-02 2008-09-02 Siemens Medical Solutions Usa, Inc. System and method for local deformable motion analysis
JP2006061581A (ja) * 2004-08-30 2006-03-09 Toshiba Corp 医用運動解析装置、医用運動解析方法および医用運動解析プログラム
WO2006038188A2 (en) 2004-10-07 2006-04-13 Koninklijke Philips Electronics N.V. Method and system for maintaining consistent anatomic views in displayed image data
JP2006285064A (ja) 2005-04-04 2006-10-19 Matsushita Electric Ind Co Ltd 画像表示装置
US8187186B2 (en) * 2005-11-08 2012-05-29 Koninklijke Philips Electronics N.V. Ultrasonic diagnosis of myocardial synchronization
JP4745133B2 (ja) 2006-05-30 2011-08-10 株式会社東芝 超音波診断装置、医用画像処理装置及び医用画像処理プログラム
US7803113B2 (en) * 2006-06-14 2010-09-28 Siemens Medical Solutions Usa, Inc. Ultrasound imaging of rotation
US20080146942A1 (en) * 2006-12-13 2008-06-19 Ep Medsystems, Inc. Catheter Position Tracking Methods Using Fluoroscopy and Rotational Sensors
JP5624258B2 (ja) * 2007-04-26 2014-11-12 株式会社東芝 超音波診断装置、超音波画像処理装置及び超音波画像処理プログラム
JP5443719B2 (ja) 2007-09-07 2014-03-19 株式会社東芝 超音波診断装置、超音波画像処理装置及び超音波画像処理プログラム
RU2468435C2 (ru) 2007-11-14 2012-11-27 Конинклейке Филипс Электроникс, Н.В. Система и способ количественного трехмерного исследования ceus
US8170312B2 (en) 2008-06-17 2012-05-01 Siemens Medical Solutions Usa, Inc. Respiratory motion compensated cardiac wall motion determination system
JP5259267B2 (ja) 2008-06-19 2013-08-07 株式会社東芝 超音波診断装置、超音波画像処理装置及び超音波画像処理プログラム
JP5438936B2 (ja) 2008-08-29 2014-03-12 株式会社東芝 超音波診断装置、画像処理装置及び画像処理プログラム
JP5491836B2 (ja) * 2009-01-30 2014-05-14 株式会社東芝 超音波診断装置、超音波画像処理装置、医用画像診断装置及び医用画像処理装置
US8265363B2 (en) 2009-02-04 2012-09-11 General Electric Company Method and apparatus for automatically identifying image views in a 3D dataset
US8538103B2 (en) * 2009-02-10 2013-09-17 Hitachi Medical Corporation Medical image processing device, medical image processing method, medical image diagnostic apparatus, operation method of medical image diagnostic apparatus, and medical image display method
US8224053B2 (en) * 2009-03-31 2012-07-17 General Electric Company Methods and systems for displaying quantitative segmental data in 4D rendering
SE534636C2 (sv) * 2009-12-12 2011-11-01 Anna Bjaellmark Ett system för kvantifiering och visualisering av hjärtats rotationsmönster
US20130338501A1 (en) 2012-06-13 2013-12-19 Seno Medical Instruments, Inc. System and method for storing data associated with the operation of a dual modality optoacoustic/ultrasound system
JP5386001B2 (ja) * 2012-03-26 2014-01-15 雅彦 中田 超音波診断装置
US9392995B2 (en) 2012-07-25 2016-07-19 General Electric Company Ultrasound imaging system and method
JP2015198672A (ja) * 2012-08-10 2015-11-12 日立アロカメディカル株式会社 医用画像診断装置

Also Published As

Publication number Publication date
JP2017536862A (ja) 2017-12-14
JP2021102064A (ja) 2021-07-15
WO2016066497A1 (en) 2016-05-06
CN107072638B (zh) 2020-11-06
CN107072638A (zh) 2017-08-18
US10881379B2 (en) 2021-01-05
JP7216131B2 (ja) 2023-01-31
EP3212089B1 (en) 2020-09-23
EP3212089A1 (en) 2017-09-06
US20170238905A1 (en) 2017-08-24

Similar Documents

Publication Publication Date Title
US11094138B2 (en) Systems for linking features in medical images to anatomical models and methods of operation thereof
JP7216131B2 (ja) 超音波画像のシーケンスを視覚化する方法、コンピュータプログラム製品及び超音波システム
US10515452B2 (en) System for monitoring lesion size trends and methods of operation thereof
CN110381845B (zh) 具有用于导出成像数据和组织信息的神经网络的超声成像系统
JP5543469B2 (ja) ３次元超音波画像データを検討するための標準プロトコルの生成
US8494250B2 (en) Animation for conveying spatial relationships in three-dimensional medical imaging
US9196092B2 (en) Multiple volume renderings in three-dimensional medical imaging
JP2018140276A (ja) 超音波診断装置及び画像処理装置
CN110022774B (zh) 超声成像系统和方法
JP2021045561A (ja) 医用４ｄイメージングにおける動き適応型可視化
JP2010094181A (ja) 超音波診断装置および超音波診断装置のデータ処理プログラム
CN106028946B (zh) 用于监测病变尺寸趋势的系统及其操作方法
CN101036162A (zh) 在显示的图像数据中保持一致的解剖视图的方法和系统
CN116263948A (zh) 用于图像融合的系统和方法
CN115153621B (zh) 用于超声图像的基于模型的自动导航系统和方法
JP5921610B2 (ja) 超音波診断装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20181016

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20181016

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20190531

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190625

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20190925

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191224

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200206

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20200430

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200806

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20201110

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210310

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20210310

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20210318

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20210323

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210427

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210507

R150 Certificate of patent or registration of utility model

Ref document number: 6882977

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250