CN101023681B - 一种多视点视频位流的解码方法和解码装置 - Google Patents

一种多视点视频位流的解码方法和解码装置 Download PDF

Info

Publication number
CN101023681B
CN101023681B CN2005800248006A CN200580024800A CN101023681B CN 101023681 B CN101023681 B CN 101023681B CN 2005800248006 A CN2005800248006 A CN 2005800248006A CN 200580024800 A CN200580024800 A CN 200580024800A CN 101023681 B CN101023681 B CN 101023681B
Authority
CN
China
Prior art keywords
picture
view
pictures
sequence
viewpoint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2005800248006A
Other languages
English (en)
Chinese (zh)
Other versions
CN101023681A (zh
Inventor
孙光熏
林廷恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Industry Academic Cooperation Foundation of Yonsei University
Original Assignee
LG Electronics Inc
Industry Academic Cooperation Foundation of Yonsei University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc, Industry Academic Cooperation Foundation of Yonsei University filed Critical LG Electronics Inc
Publication of CN101023681A publication Critical patent/CN101023681A/zh
Application granted granted Critical
Publication of CN101023681B publication Critical patent/CN101023681B/zh
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
CN2005800248006A 2004-06-25 2005-06-24 一种多视点视频位流的解码方法和解码装置 Expired - Fee Related CN101023681B (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR1020040048340A KR100679740B1 (ko) 2004-06-25 2004-06-25 시점 선택이 가능한 다시점 동영상 부호화/복호화 방법
KR10-2004-0048340 2004-06-25
KR1020040048340 2004-06-25
PCT/KR2005/001969 WO2006001653A1 (en) 2004-06-25 2005-06-24 Method of coding and decoding multiview sequence and method of displaying thereof

Related Child Applications (2)

Application Number Title Priority Date Filing Date
CN2010101357573A Division CN101902656A (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法及其解码装置
CN2010101357554A Division CN101895768A (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法及其解码装置

Publications (2)

Publication Number Publication Date
CN101023681A CN101023681A (zh) 2007-08-22
CN101023681B true CN101023681B (zh) 2010-10-06

Family

ID=35782029

Family Applications (3)

Application Number Title Priority Date Filing Date
CN2005800248006A Expired - Fee Related CN101023681B (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法和解码装置
CN2010101357554A Pending CN101895768A (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法及其解码装置
CN2010101357573A Pending CN101902656A (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法及其解码装置

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN2010101357554A Pending CN101895768A (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法及其解码装置
CN2010101357573A Pending CN101902656A (zh) 2004-06-25 2005-06-24 一种多视点视频位流的解码方法及其解码装置

Country Status (6)

Country Link
US (1) US20090103619A1 (https=)
EP (1) EP1772022A1 (https=)
JP (2) JP2008503973A (https=)
KR (1) KR100679740B1 (https=)
CN (3) CN101023681B (https=)
WO (1) WO2006001653A1 (https=)

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100811649B1 (ko) * 2006-01-11 2008-03-11 연세대학교 산학협력단 다시점 부호화 방법과 그에 사용되는 비트율 제어 방법
WO2007043775A1 (en) * 2005-10-07 2007-04-19 Electronics And Telecommunications Research Institute Method and apparatus for encoding and decoding hopping default view for multiple cameras system
KR100667830B1 (ko) * 2005-11-05 2007-01-11 삼성전자주식회사 다시점 동영상을 부호화하는 방법 및 장치
US7903737B2 (en) * 2005-11-30 2011-03-08 Mitsubishi Electric Research Laboratories, Inc. Method and system for randomly accessing multiview videos with known prediction dependency
KR100829857B1 (ko) 2005-12-08 2008-05-16 한국전자통신연구원 다시점 영상을 이용한 홈쇼핑 서비스 시스템 및 그 방법
WO2007077942A1 (ja) * 2006-01-05 2007-07-12 Nippon Telegraph And Telephone Corporation 映像符号化方法及び復号方法、それらの装置、及びそれらのプログラム並びにプログラムを記録した記憶媒体
EP1972141A4 (en) * 2006-01-07 2017-04-05 Electronics and Telecommunications Research Institute Method and apparatus for inter-viewing reference in multi-viewpoint video coding
KR101276847B1 (ko) 2006-01-12 2013-06-18 엘지전자 주식회사 다시점 비디오의 처리
EP1982518A4 (en) * 2006-01-12 2010-06-16 Lg Electronics Inc PROCESSING MORE VIEW VIDEO
KR100754205B1 (ko) 2006-02-07 2007-09-03 삼성전자주식회사 다시점 동영상 부호화 장치 및 방법
JP5255558B2 (ja) * 2006-03-29 2013-08-07 トムソン ライセンシング マルチビュービデオ符号化方法および装置
WO2007114612A1 (en) * 2006-03-30 2007-10-11 Lg Electronics Inc. A method and apparatus for decoding/encoding a video signal
RU2395174C1 (ru) * 2006-03-30 2010-07-20 ЭлДжи ЭЛЕКТРОНИКС ИНК. Способ и устройство для декодирования/кодирования сигнала видео
KR100780844B1 (ko) * 2006-04-28 2007-11-29 광주과학기술원 다시점 화상 복호화기, 다시점 화상 데이터 처리 시스템,다시점 화상 데이터 처리 방법 및 이를 수행하는프로그램을 기록한 기록매체
JP5590881B2 (ja) * 2006-05-03 2014-09-17 テレフオンアクチーボラゲット エル エム エリクソン（パブル） メディア表現からメディアを再構成する方法及び装置
KR100813064B1 (ko) * 2006-05-19 2008-03-14 엘지전자 주식회사 비디오 영상 복호화/부호화 방법 및 장치, 데이터 포맷
KR101039204B1 (ko) * 2006-06-08 2011-06-03 경희대학교 산학협력단 다시점 비디오 코딩에서의 움직임 벡터 예측 방법 및 이를이용한 다시점 영상의 부호화/복호화 방법 및 장치
WO2007148906A1 (en) 2006-06-19 2007-12-27 Lg Electronics, Inc. Method and apparatus for processing a vedeo signal
CN100438632C (zh) * 2006-06-23 2008-11-26 清华大学 一种交互式多视点视频的编码方法
KR101450921B1 (ko) * 2006-07-05 2014-10-15 톰슨 라이센싱 멀티뷰 비디오 엔코딩 및 디코딩을 위한 방법 및 장치
KR101350591B1 (ko) * 2006-07-06 2014-01-14 톰슨 라이센싱 멀티뷰 비디오 인코딩 및 디코딩을 위해 프레임 넘버 및/또는 픽쳐 오더 카운트를 분리시키는 방법 및 장치
CN101611633B (zh) * 2006-07-06 2012-10-03 汤姆逊许可证公司 用于针对多视角视频编码和解码解耦合帧号和/或图像顺序计数（poc）的方法和装置
TWI344791B (en) 2006-07-12 2011-07-01 Lg Electronics Inc A method and apparatus for processing a signal
EP3179725B1 (en) * 2006-07-20 2024-05-08 InterDigital VC Holdings, Inc. Method and apparatus for signaling view scalability in multi-view video coding
WO2008023967A1 (en) 2006-08-25 2008-02-28 Lg Electronics Inc A method and apparatus for decoding/encoding a video signal
WO2008048499A2 (en) 2006-10-13 2008-04-24 Thomson Licensing Reference picture list management syntax for multiple view video coding
WO2008048515A2 (en) 2006-10-13 2008-04-24 Thomson Licensing Method for reference picture management involving multiview video coding
KR101366092B1 (ko) * 2006-10-13 2014-02-21 삼성전자주식회사 다시점 영상의 부호화, 복호화 방법 및 장치
CN101523920B (zh) * 2006-10-16 2013-12-04 汤姆森许可贸易公司 在视频操作期间使用网络抽象层单元以信号方式指示即时解码刷新的方法
BRPI0718272A2 (pt) 2006-10-30 2013-11-12 Nippon Telegraph & Telephone Método de codificação e decodificação de vídeo, aparelho para os mesmos, programas para os mesmos, e meio de armazenamento o qual armazena os programas,
KR101366289B1 (ko) * 2006-12-13 2014-02-21 엘지전자 주식회사 비디오 신호의 디코딩/인코딩 방법 및 장치
KR100823287B1 (ko) * 2007-01-03 2008-04-21 삼성전자주식회사 전역 차이 벡터를 이용한 다시점 영상의 부호화, 복호화방법 및 장치
JP2010516102A (ja) * 2007-01-04 2010-05-13 トムソン ライセンシング マルチビュー符号化ビデオにおいてビデオ・エラー補正を行う方法および装置
KR101420894B1 (ko) 2007-01-04 2014-07-17 톰슨 라이센싱 고레벨 신택스를 이용한 멀티 뷰 코딩된 비디오 내의 비디오 에러 은닉을 위한 방법 및 장치
PL3182708T3 (pl) * 2007-01-04 2019-07-31 Interdigital Madison Patent Holdings Sposoby i urządzenie dla informacji o wielu-widokach przenoszonych w składni wysokiego poziomu
US8548261B2 (en) 2007-04-11 2013-10-01 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding multi-view image
SI2887671T1 (sl) * 2007-04-12 2018-10-30 Dolby International Ab Razporejanje v kodiranju in dekodiranju videa
CN101291434A (zh) * 2007-04-17 2008-10-22 华为技术有限公司 多视编解码方法及装置
JP2009004939A (ja) * 2007-06-20 2009-01-08 Victor Co Of Japan Ltd 多視点画像復号方法、多視点画像復号装置及び多視点画像復号プログラム
JP2009004940A (ja) * 2007-06-20 2009-01-08 Victor Co Of Japan Ltd 多視点画像符号化方法、多視点画像符号化装置及び多視点画像符号化プログラム
JP2011502375A (ja) * 2007-10-10 2011-01-20 韓國電子通信研究院 ステレオスコピックデータの保存および再生のためのメタデータ構造ならびにこれを利用するステレオスコピックコンテンツファイルの保存方法
WO2009131287A1 (en) * 2008-04-23 2009-10-29 Lg Electronics Inc. Method for encoding and decoding image of ftv
AU2008362821A1 (en) * 2008-10-07 2010-04-15 Telefonaktiebolaget Lm Ericsson (Publ) Multi-view media data
AU2010206977B2 (en) 2009-01-26 2016-02-25 Interdigital Vc Holdings, Inc. Frame packing for video coding
KR101287458B1 (ko) * 2009-02-12 2013-07-19 니폰덴신뎅와 가부시키가이샤 다시점 화상 부호화 방법, 다시점 화상 복호 방법, 다시점 화상 부호화 장치, 다시점 화상 복호 장치, 다시점 화상 부호화 프로그램 및 다시점 화상 복호 프로그램
WO2010096189A1 (en) 2009-02-19 2010-08-26 Thomson Licensing 3d video formats
JP2011087195A (ja) * 2009-10-16 2011-04-28 Sony Corp 画像処理装置および画像処理方法
EP2529557A1 (en) 2010-01-29 2012-12-05 Thomson Licensing Block-based interleaving
JP5237500B2 (ja) * 2010-02-23 2013-07-17 日本電信電話株式会社 動きベクトル推定方法、多視点映像符号化方法、多視点映像復号方法、動きベクトル推定装置、多視点映像符号化装置、多視点映像復号装置、動きベクトル推定プログラム、多視点映像符号化プログラム、及び多視点映像復号プログラム
JP4746702B1 (ja) * 2010-03-16 2011-08-10 シャープ株式会社 多視点画像符号化装置
JP2011216965A (ja) * 2010-03-31 2011-10-27 Sony Corp 情報処理装置、情報処理方法、再生装置、再生方法、およびプログラム
KR101599042B1 (ko) * 2010-06-24 2016-03-03 삼성전자주식회사 다시점 깊이 영상 부호화 장치 및 그 방법, 그리고, 다시점 깊이 영상 복호화 장치 및 그 방법
JP5549476B2 (ja) * 2010-08-24 2014-07-16 ソニー株式会社 画像処理装置と画像処理方法
KR20130105814A (ko) * 2010-09-03 2013-09-26 소니 주식회사 부호화 장치 및 부호화 방법, 및 복호 장치 및 복호 방법
KR101512255B1 (ko) * 2010-12-17 2015-04-14 후지쯔 가부시끼가이샤 입체시 동화상 생성 장치 및 입체시 동화상 생성 방법
US9131217B2 (en) * 2011-12-09 2015-09-08 Qualcomm Incorporated Reference picture list modification for view synthesis reference pictures
PL3624447T3 (pl) 2012-01-19 2021-11-22 Vid Scale, Inc. Sposób i urządzenie do sygnalizowania i tworzenia list obrazów referencyjnych kodowania wideo
JP2013211776A (ja) * 2012-03-30 2013-10-10 Sharp Corp 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法およびプログラム
US10009628B2 (en) * 2013-06-07 2018-06-26 Apple Inc. Tuning video compression for high frame rate and variable frame rate capture
NL2014986B1 (en) * 2015-06-18 2017-01-23 Filigrade B V Waste separation method.
KR20170029244A (ko) * 2015-09-07 2017-03-15 삼성전자주식회사 전자 장치 및 전자 장치의 이미지 관리 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1197571A (zh) * 1995-09-29 1998-10-28 松下电器产业株式会社 位流的多视角连接编码方法及其装置
CN1239566A (zh) * 1997-07-11 1999-12-22 皇家菲利浦电子有限公司 视听数据解码方法
CN1329441A (zh) * 2001-04-29 2002-01-02 王林 视点分离式立体电视机

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0698312A (ja) * 1992-09-16 1994-04-08 Fujitsu Ltd 画像高能率符号化方式
US5619256A (en) * 1995-05-26 1997-04-08 Lucent Technologies Inc. Digital 3D/stereoscopic video compression technique utilizing disparity and motion compensated predictions
US6055012A (en) * 1995-12-29 2000-04-25 Lucent Technologies Inc. Digital multi-view video compression with complexity and compatibility constraints
JPH09200715A (ja) * 1996-01-19 1997-07-31 Canon Inc 通信装置、通信方法及び通信システム
JP3776595B2 (ja) * 1998-07-03 2006-05-17 日本放送協会 多視点画像の圧縮符号化装置および伸長復号化装置
JP2001008232A (ja) 1999-06-25 2001-01-12 Matsushita Electric Ind Co Ltd 全方位映像出力方法と装置
KR100397511B1 (ko) 2001-11-21 2003-09-13 한국전자통신연구원 양안식/다시점 3차원 동영상 처리 시스템 및 그 방법
KR100481732B1 (ko) 2002-04-20 2005-04-11 전자부품연구원 다 시점 동영상 부호화 장치
JP2004007266A (ja) * 2002-05-31 2004-01-08 Sony Corp 画像符号化装置及び方法、画像復号装置及び方法、並びにプログラム及び記録媒体
JP2004048116A (ja) * 2002-07-08 2004-02-12 Monolith Co Ltd 画像データ符号化および復号のための方法および装置
KR100475060B1 (ko) * 2002-08-07 2005-03-10 한국전자통신연구원 다시점 3차원 동영상에 대한 사용자 요구가 반영된 다중화장치 및 방법

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1197571A (zh) * 1995-09-29 1998-10-28 松下电器产业株式会社 位流的多视角连接编码方法及其装置
CN1239566A (zh) * 1997-07-11 1999-12-22 皇家菲利浦电子有限公司 视听数据解码方法
CN1329441A (zh) * 2001-04-29 2002-01-02 王林 视点分离式立体电视机

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CN 1329441 A,全文.

Also Published As

Publication number Publication date
CN101902656A (zh) 2010-12-01
KR20050122717A (ko) 2005-12-29
US20090103619A1 (en) 2009-04-23
JP2008503973A (ja) 2008-02-07
WO2006001653A1 (en) 2006-01-05
EP1772022A1 (en) 2007-04-11
KR100679740B1 (ko) 2007-02-07
JP2011109690A (ja) 2011-06-02
CN101023681A (zh) 2007-08-22
CN101895768A (zh) 2010-11-24

Similar Documents

Publication Publication Date Title
CN101023681B (zh) 一种多视点视频位流的解码方法和解码装置
Ho et al. Overview of multi-view video coding
US6055012A (en) Digital multi-view video compression with complexity and compatibility constraints
CN101390396B (zh) 编码和解码多视角视频以提供均匀画面质量的方法和装置
US8644386B2 (en) Method of estimating disparity vector, and method and apparatus for encoding and decoding multi-view moving picture using the disparity vector estimation method
KR100667830B1 (ko) 다시점 동영상을 부호화하는 방법 및 장치
EP2538675A1 (en) Apparatus for universal coding for multi-view video
WO2009155827A1 (zh) 立体视频编解码方法、装置及系统
Lim et al. A multiview sequence CODEC with view scalability
KR100728009B1 (ko) 다시점 동영상을 부호화하는 방법 및 장치
WO2009052730A1 (fr) Procédé et dispositif de codage/décodage vidéo et codec vidéo
WO2007035054A1 (en) Method of estimating disparity vector, and method and apparatus for encoding and decoding multi-view moving picture using the disparity vector estimation method
JP2013098986A (ja) 映像符号化方法及び装置、並びに映像復号化方法及び装置
CN101248670A (zh) 估计视差矢量的方法以及使用该视差矢量估计方法对多视角运动图像编码和解码的方法和设备
CN101243692B (zh) 对多视角视频进行编码的方法和设备
CN101494778B (zh) 一种多视点可伸缩编码框架
KR20140035065A (ko) 다시점 비디오 인코딩 및 디코딩 방법 및 이를 이용한 인코딩 및 디코딩 장치
KR100783722B1 (ko) 다양한 수신환경을 고려한 스테레오 비디오 부호화방법 및 장치
Lim et al. Motion/disparity compensated multiview sequence coding
Yang et al. Efficient multiview video coding based on MPEG-4

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CI01 Publication of corrected invention patent application

Correction item: Claims

Correct: Correct

False: Error (item 20)

Number: 40

Volume: 26

CI03 Correction of invention patent

Correction item: Claims

Correct: Correct

False: Error (item 20)

Number: 40

Page: Description

Volume: 26

ERR Gazette correction

Free format text: CORRECT: CLAIM OF RIGHT; FROM: ERROR (20) TO: CORRECT

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20101006

CF01 Termination of patent right due to non-payment of annual fee