DE69829345D1 - Verfahren zur Verminderung des Verarbeitungsleistungsbedarfs eines Videodekoders - Google Patents

Verfahren zur Verminderung des Verarbeitungsleistungsbedarfs eines Videodekoders

Info

Publication number
DE69829345D1
DE69829345D1 DE69829345T DE69829345T DE69829345D1 DE 69829345 D1 DE69829345 D1 DE 69829345D1 DE 69829345 T DE69829345 T DE 69829345T DE 69829345 T DE69829345 T DE 69829345T DE 69829345 D1 DE69829345 D1 DE 69829345D1
Authority
DE
Germany
Prior art keywords
reducing
video decoder
processing power
power requirements
requirements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
DE69829345T
Other languages
English (en)
Other versions
DE69829345T2 (de
Inventor
William Brent Wilson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Application granted granted Critical
Publication of DE69829345D1 publication Critical patent/DE69829345D1/de
Publication of DE69829345T2 publication Critical patent/DE69829345T2/de
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/127—Prioritisation of hardware or computational resources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/527—Global motion vector estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Color Television Systems (AREA)
DE1998629345 1997-10-16 1998-10-08 Verfahren zur Verminderung des Verarbeitungsleistungsbedarfs eines Videodekoders Expired - Fee Related DE69829345T2 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP28364097 1997-10-16
JP28364097A JPH11122624A (ja) 1997-10-16 1997-10-16 ビデオデコーダ処理量を低減する方法および装置

Publications (2)

Publication Number Publication Date
DE69829345D1 true DE69829345D1 (de) 2005-04-21
DE69829345T2 DE69829345T2 (de) 2006-04-06

Family

ID=17668146

Family Applications (1)

Application Number Title Priority Date Filing Date
DE1998629345 Expired - Fee Related DE69829345T2 (de) 1997-10-16 1998-10-08 Verfahren zur Verminderung des Verarbeitungsleistungsbedarfs eines Videodekoders

Country Status (11)

Country Link
US (2) US6389071B1 (de)
EP (1) EP0910219B1 (de)
JP (1) JPH11122624A (de)
KR (1) KR100322056B1 (de)
CN (1) CN1154344C (de)
BR (1) BR9804444A (de)
DE (1) DE69829345T2 (de)
ES (1) ES2239375T3 (de)
ID (1) ID21114A (de)
SG (1) SG72874A1 (de)
TW (1) TW390090B (de)

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6262906A (ja) * 1985-09-13 1987-03-19 Toray Ind Inc 溶融樹脂の押出装置
JPH11122624A (ja) * 1997-10-16 1999-04-30 Matsushita Electric Ind Co Ltd ビデオデコーダ処理量を低減する方法および装置
JP3639517B2 (ja) * 2000-10-04 2005-04-20 三洋電機株式会社 動画像復号化装置および動画像復号化方法
TW567728B (en) * 2001-02-20 2003-12-21 Sanyo Electric Co Method and apparatus for decoding graphic image
US6882685B2 (en) * 2001-09-18 2005-04-19 Microsoft Corporation Block transform and quantization for image and video coding
US8284844B2 (en) 2002-04-01 2012-10-09 Broadcom Corporation Video decoding system supporting multiple standards
US7391812B2 (en) * 2002-07-14 2008-06-24 Apple Inc. Adaptively post filtering encoded video
KR100865034B1 (ko) 2002-07-18 2008-10-23 엘지전자 주식회사 모션 벡터 예측 방법
AU2003242920A1 (en) * 2002-07-29 2004-02-25 Koninklijke Philips Electronics N.V. Irregular processing of media data with continuous output
US9038096B2 (en) 2002-10-03 2015-05-19 Nagra France Sas System and method of adaptive and progressive descrambling of digital image content
US8695029B2 (en) * 2002-10-03 2014-04-08 Nagra France System and method of adaptive and progressive descrambling of streaming video
WO2004073315A1 (en) * 2003-02-14 2004-08-26 Koninklijke Philips Electronics N.V. Processing signals for a color sequential display
US7502415B2 (en) * 2003-07-18 2009-03-10 Microsoft Corporation Range reduction
US8625680B2 (en) 2003-09-07 2014-01-07 Microsoft Corporation Bitstream-controlled post-processing filtering
US8014450B2 (en) 2003-09-07 2011-09-06 Microsoft Corporation Flexible range reduction
JP4119470B2 (ja) * 2003-10-30 2008-07-16 Ｎｅｃエレクトロニクス株式会社 画像復号装置及び画像復号化方法
US7649539B2 (en) * 2004-03-10 2010-01-19 Microsoft Corporation Image formats for video capture, processing and display
US7639743B2 (en) * 2004-03-25 2009-12-29 Sony Corporation Image decoder and image decoding method and program
US8320464B2 (en) 2004-05-04 2012-11-27 Qualcomm Incorporated Method and apparatus to construct bi-directional predicted frames for temporal scalability
US7487193B2 (en) * 2004-05-14 2009-02-03 Microsoft Corporation Fast video codec transform implementations
JP2006101321A (ja) * 2004-09-30 2006-04-13 Toshiba Corp 情報処理装置および同装置で用いられるプログラム
DE602005015067D1 (de) 2004-09-30 2009-08-06 Toshiba Kk Informationsbearbeitungsgerät und Programm
CN1319384C (zh) * 2005-01-27 2007-05-30 浙江大学 硬件计算能力资源在运动估计中的优化分配方法
JP2008532405A (ja) * 2005-03-03 2008-08-14 エヌエックスピー ビー ヴィ Ｍｐｅｇデコーダのための適応型フォールバックシステム
JP2006254232A (ja) * 2005-03-11 2006-09-21 Toshiba Corp 情報処理装置およびプログラム
JP2006254231A (ja) * 2005-03-11 2006-09-21 Toshiba Corp 情報処理装置および同装置で用いられるプログラム
US8929464B2 (en) * 2005-03-25 2015-01-06 Sharp Laboratories Of America, Inc. Video entropy decoding with graceful degradation
EP1727369A1 (de) * 2005-05-23 2006-11-29 TELEFONAKTIEBOLAGET LM ERICSSON (publ) Adaptive Postfilterung
WO2006125588A1 (en) * 2005-05-23 2006-11-30 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive post-filtering
US7689052B2 (en) * 2005-10-07 2010-03-30 Microsoft Corporation Multimedia signal processing using fixed-point approximations of linear transforms
FR2892883B1 (fr) 2005-11-02 2008-01-25 Streamezzo Sa Procede d'optimisation de rendu d'une scene multimedia, programme, signal, support de donnees, terminal et procede de reception correspondants.
JP2007174196A (ja) * 2005-12-21 2007-07-05 Toshiba Corp 情報処理装置、制御方法およびプログラム
JP2007195117A (ja) * 2006-01-23 2007-08-02 Toshiba Corp 動画像復号装置
JP4987322B2 (ja) * 2006-02-28 2012-07-25 株式会社東芝 動画像復号装置及び動画像復号方法
US8880571B2 (en) * 2006-05-05 2014-11-04 Microsoft Corporation High dynamic range data format conversions for digital media
JP5030495B2 (ja) * 2006-07-14 2012-09-19 ソニー株式会社 再生装置、再生方法、プログラム、および記録媒体
JP4712642B2 (ja) * 2006-08-17 2011-06-29 富士通セミコンダクター株式会社 デブロッキングフィルタ、画像符号化装置および画像復号化装置
US7804435B2 (en) * 2006-08-31 2010-09-28 Ati Technologies Ulc Video decoder with reduced power consumption and method thereof
JP2008067205A (ja) * 2006-09-08 2008-03-21 Toshiba Corp フレーム補間回路、フレーム補間方法、表示装置
KR100842544B1 (ko) * 2006-09-11 2008-07-01 삼성전자주식회사 스케일러블 영상 코딩을 이용한 전송 방법 및 이를 이용한이동통신 시스템
US7456760B2 (en) 2006-09-11 2008-11-25 Apple Inc. Complexity-aware encoding
WO2008079330A1 (en) * 2006-12-22 2008-07-03 Inlet Technologies Video compression with complexity throttling
TWI327866B (en) * 2006-12-27 2010-07-21 Realtek Semiconductor Corp Apparatus and related method for decoding video blocks in video pictures
US8942289B2 (en) * 2007-02-21 2015-01-27 Microsoft Corporation Computational complexity and precision control in transform-based digital media codec
US8054886B2 (en) * 2007-02-21 2011-11-08 Microsoft Corporation Signaling and use of chroma sample positioning information
US8718129B2 (en) * 2007-10-03 2014-05-06 Apple Inc. Power saving decoder architecture
US8228992B2 (en) * 2007-10-12 2012-07-24 Broadcom Corporation Method and system for power-aware motion estimation for video processing
KR101372418B1 (ko) * 2007-10-19 2014-03-12 (주)휴맥스 비트스트림 디코딩 장치 및 방법
US20090304086A1 (en) * 2008-06-06 2009-12-10 Apple Inc. Method and system for video coder and decoder joint optimization
US8199829B2 (en) 2008-08-25 2012-06-12 Qualcomm Incorporated Decoding system and method
WO2010104432A1 (en) * 2009-03-13 2010-09-16 Telefonaktiebolaget Lm Ericsson (Publ) Methods of and arrangements for processing an encoded bit stream
US20100246679A1 (en) * 2009-03-24 2010-09-30 Aricent Inc. Video decoding in a symmetric multiprocessor system
GB2471323B (en) * 2009-06-25 2014-10-22 Advanced Risc Mach Ltd Motion vector estimator
US8533496B1 (en) 2009-11-10 2013-09-10 Marvell International Ltd. Power management of iterative data processing systems
US8976856B2 (en) 2010-09-30 2015-03-10 Apple Inc. Optimized deblocking filters
KR20120088488A (ko) * 2011-01-31 2012-08-08 한국전자통신연구원 시간적 움직임 벡터 저장 방법 및 그 장치
MX353235B (es) 2011-09-29 2018-01-08 Sharp Kk Star Dispositivo de decodificación de imágenes, método de decodificación de imágenes y dispositivo de codificación de imágenes.
BR112014007494B1 (pt) 2011-09-29 2022-05-31 Sharp Kabushiki Kaisha Dispositivo de decodificação de imagem, método de decodificação de imagem, e dispositivo de codificação de imagem
WO2014203351A1 (ja) * 2013-06-19 2014-12-24 株式会社 東芝 画像処理装置、画像処理方法
FR3027480B1 (fr) * 2014-10-17 2020-10-23 Institut Nat Des Sciences Appliquees De Rennes Decodeur, procede et systeme de decodage de flux multimedia
KR101676788B1 (ko) 2014-10-17 2016-11-16 삼성전자주식회사 멀티코어 시스템 기반 비디오 병렬 복호화 방법 및 그 장치
EP3057318A1 (de) * 2015-02-13 2016-08-17 Alcatel Lucent Anpassung von kodierungsparametern basierend auf bildbetrachtungserlebnis und systemeinschränkungen
US10873760B2 (en) 2017-04-07 2020-12-22 Futurewei Technologies, Inc. Motion vector (MV) constraints and transformation constraints in video coding

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4633462A (en) * 1983-07-18 1986-12-30 The Board Of Trustees Of The University Of Illinois Multiple access communication on a CATV reverse channel
US5325126A (en) * 1992-04-01 1994-06-28 Intel Corporation Method and apparatus for real time compression and decompression of a digital motion video signal
KR0134871B1 (ko) * 1992-07-17 1998-04-22 사또오 후미오 고능률 부호화 복호화 시스템
KR960010469B1 (ko) * 1992-10-07 1996-08-01 대우전자 주식회사 Pip 기능을 갖는 디지탈방식 고선명 텔레비젼
US5614952A (en) * 1994-10-11 1997-03-25 Hitachi America, Ltd. Digital video decoder for decoding digital high definition and/or digital standard definition television signals
AU7519594A (en) * 1993-08-02 1995-02-28 Aware, Inc. Multimedia playblack system
US5889561A (en) * 1994-11-04 1999-03-30 Rca Thomson Licensing Corporation Method and apparatus for scaling a compressed video bitstream
US5802211A (en) * 1994-12-30 1998-09-01 Harris Corporation Method and apparatus for transmitting and utilizing analog encoded information
EP0721286A3 (de) 1995-01-09 2000-07-26 Matsushita Electric Industrial Co., Ltd. Einrichtung zur Dekodierung von Videosignalen mit Verminderung von Artefakten
US5596369A (en) * 1995-01-24 1997-01-21 Lsi Logic Corporation Statistically derived method and system for decoding MPEG motion compensation and transform coded video data
US5903313A (en) * 1995-04-18 1999-05-11 Advanced Micro Devices, Inc. Method and apparatus for adaptively performing motion compensation in a video processing apparatus
US5680482A (en) * 1995-05-17 1997-10-21 Advanced Micro Devices, Inc. Method and apparatus for improved video decompression by adaptive selection of video input buffer parameters
US5812788A (en) * 1995-07-21 1998-09-22 Intel Corporation Encoding/decoding video signals using quantization tables based on explicitly encoded base and scale matrices
US5745375A (en) * 1995-09-29 1998-04-28 Intel Corporation Apparatus and method for controlling power usage
US5768429A (en) 1995-11-27 1998-06-16 Sun Microsystems, Inc. Apparatus and method for accelerating digital video decompression by performing operations in parallel
US5760794A (en) * 1996-01-02 1998-06-02 Intel Corporation Method for storing video data in a plurality of video data buffers on a host
US5822005A (en) * 1996-01-11 1998-10-13 Tektronix, Inc. Pre-oddification
JP3575508B2 (ja) 1996-03-04 2004-10-13 Ｋｄｄｉ株式会社 符号化動画像再生装置
US5703697A (en) * 1996-03-20 1997-12-30 Lg Electronics, Inc. Method of lossy decoding of bitstream data
US5818532A (en) * 1996-05-03 1998-10-06 Lsi Logic Corporation Micro architecture of video core for MPEG-2 decoder
JPH1023375A (ja) 1996-07-04 1998-01-23 Matsushita Electric Ind Co Ltd 順次ディジタルビデオ復号化装置
KR100239349B1 (ko) * 1996-12-20 2000-01-15 구자홍 역이산 코사인 변환기의 데이타 포멧 변환 회로
GB9700226D0 (en) 1997-01-08 1997-02-26 Glaxo Group Ltd Inhalation device
JPH11122624A (ja) * 1997-10-16 1999-04-30 Matsushita Electric Ind Co Ltd ビデオデコーダ処理量を低減する方法および装置

Also Published As

Publication number Publication date
CN1215282A (zh) 1999-04-28
EP0910219A2 (de) 1999-04-21
DE69829345T2 (de) 2006-04-06
US7248631B2 (en) 2007-07-24
EP0910219B1 (de) 2005-03-16
BR9804444A (pt) 1999-11-03
KR100322056B1 (ko) 2002-06-20
TW390090B (en) 2000-05-11
US20020080874A1 (en) 2002-06-27
ID21114A (id) 1999-04-22
JPH11122624A (ja) 1999-04-30
CN1154344C (zh) 2004-06-16
US6389071B1 (en) 2002-05-14
KR19990037165A (ko) 1999-05-25
ES2239375T3 (es) 2005-09-16
SG72874A1 (en) 2000-05-23
EP0910219A3 (de) 2002-01-09

Similar Documents

Publication Publication Date Title
DE69829345D1 (de) Verfahren zur Verminderung des Verarbeitungsleistungsbedarfs eines Videodekoders
DE69715815D1 (de) Verfahren zur bilddekodierung
DE69705552D1 (de) Verfahren zur Plasmaverarbeitung
DE69420250D1 (de) Verbessertes verfahren zur nachhallunterdrückung
DE69712676T2 (de) Verfahren zur Videokodierung
DE69512445D1 (de) Audio-Video Dekodierungssystem und Verfahren
DE69513987T2 (de) Verfahren zur transesterifikation
DE69524420D1 (de) Videoverarbeitung und verfahren zur umsetzung von videosignalen
DE69521448T2 (de) Verfahren zur Bildelementkorrektur und -glättung
DE59510488D1 (de) Verfahren zur arithmetischen Decodierung
DE69739867D1 (de) Verfahren zur Bildcodierung
DE69430617T2 (de) Dekoder und verfahren zur dekodierung
DE69811802D1 (de) Verfahren zur Transesterification
DE69635637D1 (de) Abtastverfahren und -vorrichtung zur Unterdrückung des Bandeffekts
DE69527078D1 (de) Verfahren zur vektorkodierung und entsprechender kodierer/dekodierer
DE69838226D1 (de) Verfahren zur plasmabehandlung
AP2000001780A0 (en) Apparatus and method for the purification of water
DE69811083D1 (de) Verfahren zur herstellung von l-carnitin
DE69828144D1 (de) Verfahren und vorrichtung zur videocodierung und -decodierung
DE69526841T2 (de) Verfahren zur Wiedergabe
PL334798A1 (en) Method of overesterifying alpha-ketocarboxylic esters
DE69522100T2 (de) Verfahren zur abdeckung
DE69718588T2 (de) Verfahren zur Bildkodierung
PL319301A1 (en) Method of processing acid waste waters
PL330406A1 (en) Method of hydrocarboxylating pentenic acids

Legal Events

Date Code Title Description
8364 No opposition during term of opposition
8339 Ceased/non-payment of the annual fee