JP6138162B2 - 非侵襲的療法中の参照ベースの動き追跡 - Google Patents

非侵襲的療法中の参照ベースの動き追跡 Download PDF

Info

Publication number
JP6138162B2
JP6138162B2 JP2014555333A JP2014555333A JP6138162B2 JP 6138162 B2 JP6138162 B2 JP 6138162B2 JP 2014555333 A JP2014555333 A JP 2014555333A JP 2014555333 A JP2014555333 A JP 2014555333A JP 6138162 B2 JP6138162 B2 JP 6138162B2
Authority
JP
Japan
Prior art keywords
image
treatment
target
images
anatomical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2014555333A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015511139A (ja
JP2015511139A5 (OSRAM
Inventor
ヨアフ レヴィ，
ヨアフ レヴィ，
ヨアフ メダン，
ヨアフ メダン，
コビ ボートマン，
コビ ボートマン，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of JP2015511139A publication Critical patent/JP2015511139A/ja
Publication of JP2015511139A5 publication Critical patent/JP2015511139A5/ja
Application granted granted Critical
Publication of JP6138162B2 publication Critical patent/JP6138162B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00—Ultrasound therapy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00—Ultrasound therapy
    • A61N7/02—Localised ultrasound hyperthermia
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00022—Sensing or detecting at the treatment site
    • A61B2017/00084—Temperature
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/374—NMR or MRI
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A61B5/015—By temperature mapping of body part
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00—Ultrasound therapy
    • A61N2007/0056—Beam shaping elements
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F04—POSITIVE - DISPLACEMENT MACHINES FOR LIQUIDS; PUMPS FOR LIQUIDS OR ELASTIC FLUIDS
    • F04C—ROTARY-PISTON, OR OSCILLATING-PISTON, POSITIVE-DISPLACEMENT MACHINES FOR LIQUIDS; ROTARY-PISTON, OR OSCILLATING-PISTON, POSITIVE-DISPLACEMENT PUMPS
    • F04C2270/00—Control; Monitoring or safety arrangements
    • F04C2270/04—Force
    • F04C2270/041—Controlled or regulated
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10088—Magnetic resonance imaging [MRI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30096—Tumor; Lesion

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Multimedia (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Surgical Instruments (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Radiation-Therapy Devices (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
JP2014555333A 2012-02-06 2013-02-06 非侵襲的療法中の参照ベースの動き追跡 Expired - Fee Related JP6138162B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261595341P 2012-02-06 2012-02-06
US201261595338P 2012-02-06 2012-02-06
US61/595,341 2012-02-06
US61/595,338 2012-02-06
PCT/IB2013/000321 WO2013117991A1 (en) 2012-02-06 2013-02-06 Reference-based motion tracking during non-invasive therapy

Publications (3)

Publication Number Publication Date
JP2015511139A JP2015511139A (ja) 2015-04-16
JP2015511139A5 JP2015511139A5 (OSRAM) 2016-01-28
JP6138162B2 true JP6138162B2 (ja) 2017-05-31

Family

ID=48143323

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2014555333A Expired - Fee Related JP6138162B2 (ja) 2012-02-06 2013-02-06 非侵襲的療法中の参照ベースの動き追跡
JP2014555335A Expired - Fee Related JP6249491B2 (ja) 2012-02-06 2013-02-06 移動する器官の撮像中の参照ライブラリ拡張

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2014555335A Expired - Fee Related JP6249491B2 (ja) 2012-02-06 2013-02-06 移動する器官の撮像中の参照ライブラリ拡張

Country Status (5)

Country Link
US (2) US9814909B2 (OSRAM)
EP (2) EP2811901B1 (OSRAM)
JP (2) JP6138162B2 (OSRAM)
CN (2) CN104219996B (OSRAM)
WO (2) WO2013117992A1 (OSRAM)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8256430B2 (en) 2001-06-15 2012-09-04 Monteris Medical, Inc. Hyperthermia treatment and probe therefor
US8979871B2 (en) 2009-08-13 2015-03-17 Monteris Medical Corporation Image-guided therapy of a tissue
US9649508B2 (en) 2012-09-13 2017-05-16 Emory University Methods, systems and computer readable storage media storing instructions for determining patient specific treatment planning margins
DE102012216292B4 (de) * 2012-09-13 2021-02-18 Siemens Healthcare Gmbh Magnetresonanzbaueinheit, eine Magnetresonanzvorrichtung mit der Magnetresonanzbaueinheit sowie ein Verfahren zu einem Bestimmen einer Bewegung eines Patienten während einer Magnetresonanzuntersuchung
US9672187B2 (en) * 2013-03-15 2017-06-06 Electric Power Research Institute System and method for directing guided waves through structures
JP2016539703A (ja) 2013-12-03 2016-12-22 ビューレイ・テクノロジーズ・インコーポレイテッドＶｉｅｗＲａｙ Ｔｅｃｈｎｏｌｏｇｉｅｓ， Ｉｎｃ． 位相相関を用いた非剛体変形の存在下での医用画像のシングル及びマルチのモダリティ位置合わせ
US9715726B2 (en) * 2013-12-05 2017-07-25 Siemens Healthcare Gmbh Method and system for B0 drift and respiratory motion compensation in echo-planar based magnetic resonance imaging
WO2015134530A1 (en) * 2014-03-03 2015-09-11 Semanticmd, Inc. Personalized content-based patient retrieval system
US20150265353A1 (en) 2014-03-18 2015-09-24 Monteris Medical Corporation Image-guided therapy of a tissue
US9433383B2 (en) 2014-03-18 2016-09-06 Monteris Medical Corporation Image-guided therapy of a tissue
US10675113B2 (en) 2014-03-18 2020-06-09 Monteris Medical Corporation Automated therapy of a three-dimensional tissue region
US10405773B2 (en) * 2014-12-19 2019-09-10 General Electric Company Tissue delineation and characterization in magnetic resonance imaging
CN104587612A (zh) * 2015-01-10 2015-05-06 管勇 超声颅内肿瘤治疗仪
US9542761B2 (en) * 2015-02-25 2017-01-10 Siemens Healthcare Gmbh Generalized approximate message passing algorithms for sparse magnetic resonance imaging reconstruction
US10327830B2 (en) 2015-04-01 2019-06-25 Monteris Medical Corporation Cryotherapy, thermal therapy, temperature modulation therapy, and probe apparatus therefor
US10537253B2 (en) * 2016-02-25 2020-01-21 Samsung Electronics Company, Ltd. Detecting live tissues using signal analysis
US10475192B2 (en) * 2016-06-10 2019-11-12 Insightec, Ltd. Motion tracking during non-invasive therapy
JP7098539B2 (ja) 2016-06-22 2022-07-11 ビューレイ・テクノロジーズ・インコーポレイテッド 磁気共鳴イメージング
US11284811B2 (en) * 2016-06-22 2022-03-29 Viewray Technologies, Inc. Magnetic resonance volumetric imaging
US11272842B2 (en) * 2016-07-08 2022-03-15 Insightec, Ltd. Systems and methods for ensuring coherence between multiple ultrasound transducer arrays
US11103731B2 (en) * 2017-01-12 2021-08-31 Insightec, Ltd. Overcoming acoustic field and skull non-uniformities
US12179042B2 (en) 2017-02-23 2024-12-31 Oron Zachar Transcranial ultrasound focusing
US11123150B2 (en) 2017-03-07 2021-09-21 Sony Corporation Information processing apparatus, assistance system, and information processing method
JP7119080B2 (ja) * 2017-10-05 2022-08-16 インサイテック・リミテッド 超音波手技の間にリアルタイムで標的運動を追跡するためのシステムおよび方法
JP6976869B2 (ja) 2018-01-15 2021-12-08 キヤノンメディカルシステムズ株式会社 超音波診断装置及びその制御プログラム
US20190351261A1 (en) * 2018-05-18 2019-11-21 Yoav Levy Selective resampling during non-invasive therapy
IL263097B2 (en) * 2018-11-18 2024-01-01 Inspekto A M V Ltd Optimizing a set-up stage in an automatic visual inspection process
US10677866B1 (en) * 2018-11-28 2020-06-09 Insightec, Ltd. Systems and methods for correcting measurement artifacts in MR thermometry
CN109784379B (zh) * 2018-12-27 2021-03-30 广州华迅网络科技有限公司 纺织品图片特征库的更新方法和装置
US11684807B2 (en) * 2018-12-27 2023-06-27 Insightec Ltd. Optimization of transducer configurations in ultrasound procedures
CN113853162B (zh) * 2019-05-17 2024-07-30 皇家飞利浦有限公司 用于跟踪对象的运动的超声系统和方法
EP3757940B1 (de) 2019-06-26 2025-04-16 Siemens Healthineers AG Ermittlung einer patientenbewegung während einer medizinischen bildgebungsmessung
EP4021295B1 (en) * 2019-08-27 2025-10-15 4DMedical Limited System and apparatus for assessing an effect of a medical treatment on organ function
CN111936946A (zh) * 2019-09-10 2020-11-13 北京航迹科技有限公司 一种定位系统和方法
CN112365971B (zh) * 2020-11-09 2021-06-11 罗鑫龙 一种基于5g的远程互联网大数据智慧医疗系统
US11995849B2 (en) * 2021-05-24 2024-05-28 Biosense Webster (Israel) Ltd. Automatic registration of an anatomical map to a previous anatomical map
WO2023278199A1 (en) 2021-06-30 2023-01-05 Carnegie Mellon University Systems and methods for personalized ultrasound neuromodulation
US11493583B1 (en) * 2021-11-03 2022-11-08 Siemens Healthcare Gmbh Image-based retrospective gating of MR images for PRF thermometry
US20240252271A1 (en) * 2023-02-01 2024-08-01 Procept Biorobotics Corporation Tissue protection systems and methods
US12514557B2 (en) 2023-03-31 2026-01-06 GE Precision Healthcare LLC Drug delivery system with real-time motion compensation and dose accumulation

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0747079A (ja) * 1993-08-05 1995-02-21 Toshiba Corp 超音波治療装置
JPH07303656A (ja) * 1994-05-12 1995-11-21 Toshiba Corp 結石破砕装置
DE19515748A1 (de) * 1995-04-28 1996-10-31 Siemens Ag Gerät zur Behandlung mit akustischen Wellen
US7158610B2 (en) * 2003-09-05 2007-01-02 Varian Medical Systems Technologies, Inc. Systems and methods for processing x-ray images
GB0109892D0 (en) * 2001-04-20 2001-06-13 Secr Defence Method and apparatus for reducing the effects of motion in an image
US7046823B2 (en) * 2002-08-01 2006-05-16 Raytheon Company Correlation tracker breaklock detection
JP4127640B2 (ja) * 2002-09-19 2008-07-30 株式会社東芝 超音波治療装置
US6928142B2 (en) * 2002-10-18 2005-08-09 Koninklijke Philips Electronics N.V. Non-invasive plaque detection using combined nuclear medicine and x-ray system
US7853308B2 (en) * 2004-02-17 2010-12-14 Siemens Medical Solutions Usa, Inc. System and method for patient positioning for radiotherapy in the presence of respiratory motion
US20050215904A1 (en) * 2004-03-23 2005-09-29 Siemens Medical Solutions Usa, Inc. Ultrasound breathing waveform detection system and method
US8801701B2 (en) * 2005-03-09 2014-08-12 Sunnybrook Health Sciences Centre Method and apparatus for obtaining quantitative temperature measurements in prostate and other tissue undergoing thermal therapy treatment
JP5047960B2 (ja) * 2005-07-08 2012-10-10 ウイスコンシン アラムナイ リサーチ ファウンデーシヨン 高度に限定されたイメージの再構成法
FR2891153B1 (fr) * 2005-09-28 2008-08-22 Centre Nat Rech Scient Dispositif de traitement thermique de tissus biologiques en mouvement
ATE466538T1 (de) * 2006-12-08 2010-05-15 Koninkl Philips Electronics Nv System, verfahren und computerlesbares medium sowie verwendung zur programmierung einer kombinationstherapie
US8478380B2 (en) * 2007-05-04 2013-07-02 Wisconsin Alumni Research Foundation Magnetic resonance thermometry in the presence of water and fat
CN101053531A (zh) * 2007-05-17 2007-10-17 上海交通大学 基于多模式增敏成像融合的早期肿瘤定位跟踪方法
WO2008151202A2 (en) * 2007-06-03 2008-12-11 The Regents Of The University Of California Elastic deformable heart and torso phantom for nuclear imaging of heart with realistic modes of cardiac and respiratory motion
US8251908B2 (en) * 2007-10-01 2012-08-28 Insightec Ltd. Motion compensated image-guided focused ultrasound therapy system
US20100061596A1 (en) 2008-09-05 2010-03-11 Varian Medical Systems Technologies, Inc. Video-Based Breathing Monitoring Without Fiducial Tracking
US8396248B2 (en) * 2008-09-16 2013-03-12 Varian Medical Systems, Inc. Sequential stereo imaging for estimating trajectory and monitoring target position
JP5476534B2 (ja) * 2008-09-17 2014-04-23 公益財団法人ヒューマンサイエンス振興財団 超音波画像処理による集束超音波自動照射システム並びに集束超音波自動照射プログラム及びこれを記録したコンピュータ読み取り可能な記録媒体
US8368401B2 (en) 2009-11-10 2013-02-05 Insightec Ltd. Techniques for correcting measurement artifacts in magnetic resonance thermometry
US8715186B2 (en) * 2009-11-24 2014-05-06 Guided Therapy Systems, Llc Methods and systems for generating thermal bubbles for improved ultrasound imaging and therapy
US8379947B2 (en) * 2010-05-28 2013-02-19 International Business Machines Corporation Spatio-temporal image reconstruction using sparse regression and secondary information
US9254112B2 (en) * 2011-03-23 2016-02-09 Siemens Corporation Respiratory interval-based correlation and processing of dynamic imaging data
US9028470B2 (en) * 2011-06-17 2015-05-12 University Of Utah Research Foundation Image-guided renal nerve ablation
CN102890824B (zh) * 2011-07-19 2015-07-29 株式会社东芝 运动对象轮廓跟踪方法和装置
DE102012216327B4 (de) * 2012-09-13 2021-01-14 Siemens Healthcare Gmbh Verfahren zur Erfassung einer Bewegung eines Patienten während einer medizinischen Bildgebungsuntersuchung

Also Published As

Publication number Publication date
EP2811901A1 (en) 2014-12-17
US20150016682A1 (en) 2015-01-15
EP2811901B1 (en) 2016-06-08
EP2811900B1 (en) 2017-03-29
JP6249491B2 (ja) 2017-12-20
CN104219996B (zh) 2017-04-05
CN104244818A (zh) 2014-12-24
US9814909B2 (en) 2017-11-14
JP2015511139A (ja) 2015-04-16
CN104244818B (zh) 2017-04-12
JP2015507951A (ja) 2015-03-16
WO2013117991A1 (en) 2013-08-15
CN104219996A (zh) 2014-12-17
EP2811900A1 (en) 2014-12-17
US10307619B2 (en) 2019-06-04
US20150025360A1 (en) 2015-01-22
WO2013117992A1 (en) 2013-08-15

Similar Documents

Publication Publication Date Title
CN104244818B (zh) 在非侵入式治疗期间的基于参考的运动跟踪
US10475192B2 (en) Motion tracking during non-invasive therapy
CN114040706B (zh) 加速的磁共振温度测量
US20190351261A1 (en) Selective resampling during non-invasive therapy
CN102908144B (zh) 用于治疗计划的磁共振成像
JP2022510217A (ja) 磁気共鳴温度測定における測定アーチファクトを補正するためのシステムおよび方法
US10573009B2 (en) In vivo movement tracking apparatus
US20130346050A1 (en) Method and apparatus for determining focus of high-intensity focused ultrasound
de Senneville et al. A direct PCA-based approach for real-time description of physiological organ deformations
Li et al. Respiratory motion prediction using fusion-based multi-rate Kalman filtering and real-time golden-angle radial MRI
An et al. An Ultrasound-Guided Robotic HIFU Ablation System with Respiration Induced Displacement and Time Delay Compensation: CY An et al.
US9471985B2 (en) Template-less method for arbitrary radiopaque object tracking in dynamic imaging
US20110152666A1 (en) Targeted thermal treatment of human tissue through respiratory cycles using arma modeling
Roujol et al. Motion correction techniques for MR-guided HIFU ablation of abdominal organs
Yates et al. A Comparison of Phase and Speckle Tracking Registration Methods for Motion Correction during HIFU Treatment

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20151203

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20151203

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20161012

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20161111

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170131

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170403

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170425

R150 Certificate of patent or registration of utility model

Ref document number: 6138162

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees