AU2018295521B2 - Tools for tracking the gum line and displaying periodontal measurements using intra-oral 3D scans - Google Patents

Tools for tracking the gum line and displaying periodontal measurements using intra-oral 3D scans Download PDF

Info

Publication number
AU2018295521B2
AU2018295521B2 AU2018295521A AU2018295521A AU2018295521B2 AU 2018295521 B2 AU2018295521 B2 AU 2018295521B2 AU 2018295521 A AU2018295521 A AU 2018295521A AU 2018295521 A AU2018295521 A AU 2018295521A AU 2018295521 B2 AU2018295521 B2 AU 2018295521B2
Authority
AU
Australia
Prior art keywords
digital
model
gingiva
gum line
displaying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2018295521A
Other languages
English (en)
Other versions
AU2018295521A1 (en
Inventor
Alexandra R. CUNLIFFE
Steven D. LASTAVICH
Peter See
Guruprasad Somasundaram
Kelly L. STEIN
Benjamin D. ZIMMER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
3M Innovative Properties Co
Original Assignee
3M Innovative Properties Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 3M Innovative Properties Co filed Critical 3M Innovative Properties Co
Publication of AU2018295521A1 publication Critical patent/AU2018295521A1/en
Application granted granted Critical
Publication of AU2018295521B2 publication Critical patent/AU2018295521B2/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/45For evaluating or diagnosing the musculoskeletal system or teeth
    • A61B5/4538Evaluating a particular part of the muscoloskeletal system or a particular medical condition
    • A61B5/4542Evaluating the mouth, e.g. the jaw
    • A61B5/4552Evaluating soft tissue within the mouth, e.g. gums or tongue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0088Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for oral or dental tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1077Measuring of profiles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1077Measuring of profiles
    • A61B5/1078Measuring of profiles by moulding
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4842Monitoring progression or stage of a disease
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271Specific aspects of physiological measurement analysis
    • A61B5/7275Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient; User input means
    • A61B5/742Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/7425Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient; User input means
    • A61B5/742Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/743Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61CDENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C19/00Dental auxiliary appliances
    • A61C19/04Measuring instruments specially adapted for dentistry
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61CDENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C19/00Dental auxiliary appliances
    • A61C19/04Measuring instruments specially adapted for dentistry
    • A61C19/043Depth measuring of periodontal pockets; Probes therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61CDENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C9/00Impression cups, i.e. impression trays; Impression methods
    • A61C9/004Means or methods for taking digitized impressions
    • A61C9/0046Data acquisition means or methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61CDENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C9/00Impression cups, i.e. impression trays; Impression methods
    • A61C9/004Means or methods for taking digitized impressions
    • A61C9/0046Data acquisition means or methods
    • A61C9/0053Optical means or methods, e.g. scanning the teeth by a laser or light beam
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1079Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Rheumatology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)
AU2018295521A 2017-07-07 2018-06-26 Tools for tracking the gum line and displaying periodontal measurements using intra-oral 3D scans Ceased AU2018295521B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/643,646 2017-07-07
US15/643,646 US10327693B2 (en) 2017-07-07 2017-07-07 Tools for tracking the gum line and displaying periodontal measurements using intra-oral 3D scans
PCT/IB2018/054713 WO2019008468A1 (en) 2017-07-07 2018-06-26 TOOLS FOR FOLLOWING THE LINE OF GENCIVES AND DISPLAYING PERIODONTAL MEASUREMENTS USING INTRA-ORAL 3D SCANS

Publications (2)

Publication Number Publication Date
AU2018295521A1 AU2018295521A1 (en) 2020-01-30
AU2018295521B2 true AU2018295521B2 (en) 2021-06-10

Family

ID=64904316

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2018295521A Ceased AU2018295521B2 (en) 2017-07-07 2018-06-26 Tools for tracking the gum line and displaying periodontal measurements using intra-oral 3D scans

Country Status (6)

Country Link
US (2) US10327693B2 (enExample)
EP (1) EP3648660A4 (enExample)
JP (1) JP2020526302A (enExample)
CN (1) CN110868913B (enExample)
AU (1) AU2018295521B2 (enExample)
WO (1) WO2019008468A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3092427B1 (fr) * 2019-02-04 2022-07-08 Borea procédé de segmentation automatique de dents
EP3709305A1 (en) * 2019-03-11 2020-09-16 3Shape A/S Method for graphically presenting a plurality of scans
CN111260672B (zh) * 2019-12-26 2023-09-05 北京大学口腔医学院 一种利用形态学数据引导分割牙齿的方法
US10751149B1 (en) 2020-02-18 2020-08-25 Oxilio Ltd Method of determining deformation of gingiva
WO2021202347A1 (en) * 2020-04-01 2021-10-07 Easyrx Llc. System and method for removing brackets from customized orthodontic appliances and products
CN113538437B (zh) * 2020-04-21 2025-02-18 杭州朝厚信息科技有限公司 牙颌三维数字模型分割结果的检测方法
US12370016B2 (en) * 2020-09-11 2025-07-29 Align Technology, Inc. Automatic segmentation quality assessment for secondary treatment plans
US20220262007A1 (en) * 2021-02-12 2022-08-18 Align Technology, Inc. Machine learning dental segmentation system and methods using graph-based approaches
CN112700447B (zh) * 2021-03-24 2021-06-18 南京佳和牙科技术有限公司 基于数字化牙齿模型的牙龈线自动提取方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140348405A1 (en) * 2013-05-21 2014-11-27 Carestream Health, Inc. Method and system for user interaction in 3-d cephalometric analysis
US20160135925A1 (en) * 2014-11-13 2016-05-19 Align Technology, Inc. Method for tracking, predicting, and proactively correcting malocclusion and related issues
EP3050534A1 (en) * 2015-01-30 2016-08-03 Dental Imaging Technologies Corporation Dental variation tracking and prediction

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6201880B1 (en) * 1996-12-31 2001-03-13 Electro-Optical Sciences Method and apparatus for electronically imaging a tooth through transillumination by light
US6514074B1 (en) * 1999-05-14 2003-02-04 Align Technology, Inc. Digitally modeling the deformation of gingival
US7160110B2 (en) 1999-11-30 2007-01-09 Orametrix, Inc. Three-dimensional occlusal and interproximal contact detection and display using virtual tooth models
US7471821B2 (en) 2000-04-28 2008-12-30 Orametrix, Inc. Method and apparatus for registering a known digital object to scanned 3-D model
US7040896B2 (en) 2000-08-16 2006-05-09 Align Technology, Inc. Systems and methods for removing gingiva from computer tooth models
DE10129694C1 (de) * 2001-06-22 2003-02-06 Sirona Dental Systems Gmbh Verfahren und eine Vorrichtung zum Erkennen von krankhaften Veränderungen wie Karies, Plaque, Konkrementen oder bakteriellem Befall an einer Gewebeoberfläche, insbesondere an Zähnen
US7156661B2 (en) * 2002-08-22 2007-01-02 Align Technology, Inc. Systems and methods for treatment analysis by teeth matching
US7077647B2 (en) 2002-08-22 2006-07-18 Align Technology, Inc. Systems and methods for treatment analysis by teeth matching
US7695278B2 (en) 2005-05-20 2010-04-13 Orametrix, Inc. Method and system for finding tooth features on a virtual three-dimensional model
US8126726B2 (en) * 2004-02-27 2012-02-28 Align Technology, Inc. System and method for facilitating automated dental measurements and diagnostics
US7324661B2 (en) * 2004-04-30 2008-01-29 Colgate-Palmolive Company Computer-implemented system and method for automated and highly accurate plaque analysis, reporting, and visualization
JP2005199084A (ja) * 2005-03-01 2005-07-28 Align Technology Inc 歯から歯肉を除去するためのシステムおよび方法
US7605817B2 (en) 2005-11-09 2009-10-20 3M Innovative Properties Company Determining camera motion
DE602006044294C5 (de) * 2005-11-30 2019-10-31 3Shape A/S Herstellung eines Dentalmodells
MX2009000294A (es) * 2006-07-06 2009-02-25 Smithkline Beecham Corp Sistema y metodo para fabricar dentaduras completas y parciales.
DE102007012584A1 (de) * 2007-03-13 2008-09-18 Paul Weigl Verfahren zur Kontrolle einer Präparation eines präparierten Zahns mit CAD-Verfahren
US8275180B2 (en) 2007-08-02 2012-09-25 Align Technology, Inc. Mapping abnormal dental references
US8075306B2 (en) 2007-06-08 2011-12-13 Align Technology, Inc. System and method for detecting deviations during the course of an orthodontic treatment to gradually reposition teeth
US7942672B2 (en) * 2008-02-15 2011-05-17 Align Technology, Inc. Gingiva modeling
WO2009140582A2 (en) * 2008-05-16 2009-11-19 Geodigm Corporation Method and apparatus for combining 3d dental scans with other 3d data sets
CN100581461C (zh) * 2008-05-23 2010-01-20 宁波思达利光电科技有限公司 用于测量牙齿几何形状的装置
KR101730696B1 (ko) * 2010-04-20 2017-04-26 이미징 사이언시즈 인터내셔널 엘엘씨 표면 스캔 정보를 이용한 3차원 치과용 x 레이 데이터 세트로부터의 아티팩트의 감소 및 제거
US8244028B2 (en) 2010-04-30 2012-08-14 Align Technology, Inc. Virtual cephalometric imaging
US9211166B2 (en) * 2010-04-30 2015-12-15 Align Technology, Inc. Individualized orthodontic treatment index
EP2452652A1 (en) * 2010-11-10 2012-05-16 Straumann Holding AG Non-invasive method for semi-automatic detection and measurement of periodontal bone defects
DE102012201193B3 (de) * 2012-01-27 2013-06-13 Sirona Dental Systems Gmbh Verfahren und Referenzmodell zur Überprüfung eines Vermessungssystems
JP6015501B2 (ja) * 2012-06-01 2016-10-26 ソニー株式会社 歯用装置及び医療用装置
WO2014013950A1 (ja) * 2012-07-19 2014-01-23 独立行政法人 国立長寿医療研究センター 歯垢、歯肉及び歯槽骨の計測表示方法及び計測表示装置
US11122180B2 (en) * 2014-05-02 2021-09-14 Dentsply Sirona Inc. Systems, methods, apparatuses, and computer-readable storage media for collecting color information about an object undergoing a 3D scan
US9510757B2 (en) * 2014-05-07 2016-12-06 Align Technology, Inc. Identification of areas of interest during intraoral scans
US9626462B2 (en) * 2014-07-01 2017-04-18 3M Innovative Properties Company Detecting tooth wear using intra-oral 3D scans
US10192003B2 (en) * 2014-09-08 2019-01-29 3M Innovative Properties Company Method of aligning intra-oral digital 3D models
US9737257B2 (en) 2015-01-30 2017-08-22 3M Innovative Properties Company Estimating and predicting tooth wear using intra-oral 3D scans
US10032271B2 (en) 2015-12-10 2018-07-24 3M Innovative Properties Company Method for automatic tooth type recognition from 3D scans
CN106037979B (zh) * 2016-05-16 2017-12-12 杭州美齐科技有限公司 一种数字化牙龈线提取方法
US10842594B2 (en) * 2016-05-24 2020-11-24 Clearcorrect Operating, Llc Virtual modeling of gingiva adaptations to progressive orthodontic correction and associated methodology of appliance manufacture
CN105919684A (zh) * 2016-05-27 2016-09-07 穆檬檬 一种建立三维牙颌融合模型的方法
CN106228549B (zh) * 2016-07-14 2019-04-19 嘉兴学院 一种基于路径规划的三角网格牙齿分割方法
CN106204739A (zh) * 2016-07-19 2016-12-07 上海爱圣美科技有限公司 一种三维牙齿模型中牙龈重建的方法
US10499793B2 (en) * 2017-02-17 2019-12-10 Align Technology, Inc. Longitudinal analysis and visualization under limited accuracy system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140348405A1 (en) * 2013-05-21 2014-11-27 Carestream Health, Inc. Method and system for user interaction in 3-d cephalometric analysis
US20160135925A1 (en) * 2014-11-13 2016-05-19 Align Technology, Inc. Method for tracking, predicting, and proactively correcting malocclusion and related issues
EP3050534A1 (en) * 2015-01-30 2016-08-03 Dental Imaging Technologies Corporation Dental variation tracking and prediction
US20160220200A1 (en) * 2015-01-30 2016-08-04 Dental Imaging Technologies Corporation Dental variation tracking and prediction

Also Published As

Publication number Publication date
CN110868913A (zh) 2020-03-06
US10327693B2 (en) 2019-06-25
EP3648660A1 (en) 2020-05-13
WO2019008468A1 (en) 2019-01-10
US20190008446A1 (en) 2019-01-10
CN110868913B (zh) 2023-02-10
US10758171B2 (en) 2020-09-01
AU2018295521A1 (en) 2020-01-30
EP3648660A4 (en) 2021-04-28
US20190254588A1 (en) 2019-08-22
JP2020526302A (ja) 2020-08-31

Similar Documents

Publication Publication Date Title
AU2018295521B2 (en) Tools for tracking the gum line and displaying periodontal measurements using intra-oral 3D scans
AU2015284524B2 (en) Detecting tooth wear using intra-oral 3D scans
AU2018250487B2 (en) Method of aligning intra-oral digital 3D models
US10405796B2 (en) Estimating and predicting tooth wear using intra-oral 3D scans
US11058514B2 (en) Method and system for dentition mesh braces removal
JP2022549281A (ja) 口腔内測定値をレジストレーションするための方法、システムおよびコンピュータ可読記憶媒体
Xie et al. Tooth Motion Monitoring in Orthodontic Treatment by Mobile Device-based Multi-view Stereo
Ahn et al. Automatic subtraction radiography algorithm for detection of periodontal disease in internet environment
US8284196B2 (en) Method and system for reconstructing a model of an object
CN118799374B (zh) 尺寸测量方法、电子设备、存储介质及程序产品
EP4393449A1 (en) Method and system for tooth wear detection
CN119762574A (zh) 一种基于人体三维重建的表面积体积快速计算方法
Ahn et al. Marginal bone destructions in dental radiography using multi-template based on internet services

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired