TWI355205B - A method and an apparatus for processing a video s - Google Patents
A method and an apparatus for processing a video s Download PDFInfo
- Publication number
- TWI355205B TWI355205B TW097102726A TW97102726A TWI355205B TW I355205 B TWI355205 B TW I355205B TW 097102726 A TW097102726 A TW 097102726A TW 97102726 A TW97102726 A TW 97102726A TW I355205 B TWI355205 B TW I355205B
- Authority
- TW
- Taiwan
- Prior art keywords
- block
- motion
- viewpoint
- video signal
- motion information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 55
- 238000012545 processing Methods 0.000 title claims description 33
- 230000033001 locomotion Effects 0.000 claims description 285
- 239000013598 vector Substances 0.000 claims description 95
- 238000003672 processing method Methods 0.000 claims description 9
- 210000000887 face Anatomy 0.000 claims 1
- 210000001747 pupil Anatomy 0.000 claims 1
- 230000000875 corresponding effect Effects 0.000 description 110
- 238000010586 diagram Methods 0.000 description 16
- 238000005286 illumination Methods 0.000 description 16
- 230000008569 process Effects 0.000 description 15
- 230000004048 modification Effects 0.000 description 9
- 238000012986 modification Methods 0.000 description 9
- 238000013507 mapping Methods 0.000 description 8
- 230000006835 compression Effects 0.000 description 7
- 238000007906 compression Methods 0.000 description 7
- 238000011084 recovery Methods 0.000 description 6
- 230000002123 temporal effect Effects 0.000 description 6
- 238000012546 transfer Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000013139 quantization Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 239000012634 fragment Substances 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000005556 hormone Substances 0.000 description 1
- 229940088597 hormone Drugs 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000008267 milk Substances 0.000 description 1
- 210000004080 milk Anatomy 0.000 description 1
- 235000013336 milk Nutrition 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 102220142792 rs61735307 Human genes 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000004575 stone Substances 0.000 description 1
- 230000009012 visual motion Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/527—Global motion vector estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US88635007P | 2007-01-24 | 2007-01-24 | |
| US90958207P | 2007-04-02 | 2007-04-02 | |
| US90796407P | 2007-04-25 | 2007-04-25 | |
| US92469307P | 2007-05-29 | 2007-05-29 | |
| US94797907P | 2007-07-04 | 2007-07-04 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW200845767A TW200845767A (en) | 2008-11-16 |
| TWI355205B true TWI355205B (en) | 2011-12-21 |
Family
ID=39644660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW097102726A TWI355205B (en) | 2007-01-24 | 2008-01-24 | A method and an apparatus for processing a video s |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US8923399B2 (enExample) |
| EP (1) | EP2123042A4 (enExample) |
| JP (1) | JP5249242B2 (enExample) |
| KR (1) | KR20090113281A (enExample) |
| CN (1) | CN101647279A (enExample) |
| TW (1) | TWI355205B (enExample) |
| WO (1) | WO2008091117A1 (enExample) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI501611B (zh) * | 2012-08-16 | 2015-09-21 | Qualcomm Inc | 用於3d視訊之視圖間預測之運動向量 |
Families Citing this family (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8854486B2 (en) * | 2004-12-17 | 2014-10-07 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for processing multiview videos for view synthesis using skip and direct modes |
| US8917775B2 (en) * | 2007-05-02 | 2014-12-23 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding and decoding multi-view video data |
| KR101560182B1 (ko) * | 2008-01-07 | 2015-10-15 | 삼성전자주식회사 | 다시점 비디오 부호화 방법과 그 장치 및 다시점 비디오 복호화 방법과 그 장치 |
| US20090219985A1 (en) * | 2008-02-28 | 2009-09-03 | Vasanth Swaminathan | Systems and Methods for Processing Multiple Projections of Video Data in a Single Video File |
| CN101901493B (zh) * | 2010-06-21 | 2011-11-30 | 清华大学 | 基于压缩采样的多视点图像联合重构方法和系统 |
| KR101484281B1 (ko) * | 2010-07-09 | 2015-01-21 | 삼성전자주식회사 | 블록 병합을 이용한 비디오 부호화 방법 및 그 장치, 블록 병합을 이용한 비디오 복호화 방법 및 그 장치 |
| DK2897365T3 (da) | 2010-07-09 | 2017-02-13 | Samsung Electronics Co Ltd | Apparat til at afkode video ved at anvende bloksammenlægning |
| JP2012023652A (ja) * | 2010-07-16 | 2012-02-02 | Sony Corp | 画像処理装置と画像処理方法 |
| CN103039076B (zh) * | 2010-09-24 | 2016-03-16 | 松下电器(美国)知识产权公司 | 图像编码方法、图像解码方法、图像编码装置及图像解码装置 |
| KR101893559B1 (ko) * | 2010-12-14 | 2018-08-31 | 삼성전자주식회사 | 다시점 비디오 부호화/복호화 장치 및 방법 |
| US8755437B2 (en) | 2011-03-17 | 2014-06-17 | Mediatek Inc. | Method and apparatus for derivation of spatial motion vector candidate and motion vector prediction candidate |
| WO2012121575A2 (ko) * | 2011-03-10 | 2012-09-13 | 한국전자통신연구원 | 인트라 예측 방법 및 그 장치 |
| EP2687014B1 (en) | 2011-03-14 | 2021-03-10 | HFI Innovation Inc. | Method and apparatus for derivation of motion vector candidate and motion vector prediction candidate |
| US9008170B2 (en) | 2011-05-10 | 2015-04-14 | Qualcomm Incorporated | Offset type and coefficients signaling method for sample adaptive offset |
| CA2833032C (en) * | 2011-06-15 | 2016-08-30 | Mediatek Inc. | Method and apparatus of texture image compression in 3d video coding |
| WO2013001749A1 (ja) | 2011-06-29 | 2013-01-03 | パナソニック株式会社 | 画像符号化方法、画像復号方法、画像符号化装置、画像復号装置および画像符号化復号装置 |
| MX2014000159A (es) | 2011-07-02 | 2014-02-19 | Samsung Electronics Co Ltd | Metodo y aparato para la codificacion de video, y metodo y aparato para la decodificacion de video acompañada por inter prediccion utilizando imagen co-localizada. |
| WO2013055148A2 (ko) * | 2011-10-12 | 2013-04-18 | 엘지전자 주식회사 | 영상 인코딩 방법 및 디코딩 방법 |
| US9357161B1 (en) * | 2011-10-17 | 2016-05-31 | Pixelworks, Inc. | Motion vector interpolation for motion compensation |
| BR122015021735A2 (pt) * | 2011-11-08 | 2019-08-27 | Samsung Electronics Co Ltd | aparelho para decodificar uma imagem |
| US9445076B2 (en) * | 2012-03-14 | 2016-09-13 | Qualcomm Incorporated | Disparity vector construction method for 3D-HEVC |
| US9525861B2 (en) * | 2012-03-14 | 2016-12-20 | Qualcomm Incorporated | Disparity vector prediction in video coding |
| WO2013144144A1 (en) * | 2012-03-30 | 2013-10-03 | Panasonic Corporation | Syntax and semantics for adaptive loop filter and sample adaptive offset |
| EP2839639A4 (en) * | 2012-04-19 | 2016-01-06 | Intel Corp | THREE-DIMENSIONAL VIDEO CODING (3D) INCLUDING DEPARTIVITY VECTOR CALIBRATION BASED ON DEPTH |
| US9549180B2 (en) | 2012-04-20 | 2017-01-17 | Qualcomm Incorporated | Disparity vector generation for inter-view prediction for video coding |
| US9952840B2 (en) * | 2012-05-15 | 2018-04-24 | International Business Machines Corporation | Conditional sequential selection of external reference resolutions |
| US9998726B2 (en) * | 2012-06-20 | 2018-06-12 | Nokia Technologies Oy | Apparatus, a method and a computer program for video coding and decoding |
| RU2673846C1 (ru) * | 2012-07-02 | 2018-11-30 | Самсунг Электроникс Ко., Лтд. | Способ и устройство для прогнозирования вектора движения для кодирования видео или декодирования видео |
| KR101966920B1 (ko) | 2012-07-10 | 2019-04-08 | 삼성전자주식회사 | 다시점 영상의 시차 정보를 이용하여 영상의 움직임을 추정하는 방법 및 장치 |
| WO2014058210A1 (ko) | 2012-10-08 | 2014-04-17 | 삼성전자 주식회사 | 다시점 비디오의 인터 레이어 예측 구조에 따른 비디오 스트림 부호화 방법 및 그 장치, 다시점 비디오의 인터 레이어 예측 구조에 따른 비디오 스트림 복호화 방법 및 그 장치 |
| BR112015013034A2 (pt) * | 2012-12-11 | 2017-07-11 | Sony Corp | dispositivos de codificação e decodificação, e, métodos de codificação usando um dispositivo de codificação e de decodificação usando um dispositivo de decodificação |
| US9521389B2 (en) * | 2013-03-06 | 2016-12-13 | Qualcomm Incorporated | Derived disparity vector in 3D video coding |
| US9667990B2 (en) | 2013-05-31 | 2017-05-30 | Qualcomm Incorporated | Parallel derived disparity vector for 3D video coding with neighbor-based disparity vector derivation |
| WO2015006922A1 (en) * | 2013-07-16 | 2015-01-22 | Mediatek Singapore Pte. Ltd. | Methods for residual prediction |
| WO2015006984A1 (en) * | 2013-07-19 | 2015-01-22 | Mediatek Singapore Pte. Ltd. | Reference view selection for 3d video coding |
| WO2015057032A1 (ko) * | 2013-10-18 | 2015-04-23 | 엘지전자 주식회사 | 멀티 뷰를 포함하는 비디오 부호화/복호화 방법 및 장치 |
| EP3958572B1 (en) * | 2014-01-02 | 2024-02-07 | Dolby Laboratories Licensing Corporation | Method for encoding multi-view video, method for decoding multi-view video and recording medium therefore |
| WO2015100710A1 (en) * | 2014-01-02 | 2015-07-09 | Mediatek Singapore Pte. Ltd. | Existence of inter-view reference picture and availability of 3dvc coding tools |
| CN110381317B (zh) | 2014-01-03 | 2022-12-02 | 庆熙大学校产学协力团 | 导出子预测单元的时间点之间的运动信息的方法和装置 |
| CN115134593B (zh) * | 2015-06-05 | 2024-07-23 | 杜比实验室特许公司 | 用于执行帧间预测的图像编解码方法、比特流存储方法 |
| US11665365B2 (en) * | 2018-09-14 | 2023-05-30 | Google Llc | Motion prediction coding with coframe motion vectors |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4015934B2 (ja) * | 2002-04-18 | 2007-11-28 | 株式会社東芝 | 動画像符号化方法及び装置 |
| US7970058B2 (en) * | 2002-07-15 | 2011-06-28 | Hitachi Consumer Electronics Co., Ltd. | Moving picture encoding method and decoding method |
| US7489342B2 (en) * | 2004-12-17 | 2009-02-10 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for managing reference pictures in multiview videos |
| US7286689B2 (en) | 2003-06-07 | 2007-10-23 | Hewlett-Packard Development Company, L.P. | Motion estimation for compression of calibrated multi-view image sequences |
| JP4355914B2 (ja) | 2003-10-01 | 2009-11-04 | 日本電気株式会社 | 多視点画像伝送システムと方法、多視点画像圧縮装置と方法、多視点画像伸長装置と方法およびプログラム |
| US8854486B2 (en) * | 2004-12-17 | 2014-10-07 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for processing multiview videos for view synthesis using skip and direct modes |
| US7468745B2 (en) | 2004-12-17 | 2008-12-23 | Mitsubishi Electric Research Laboratories, Inc. | Multiview video decomposition and encoding |
| KR101246915B1 (ko) * | 2005-04-18 | 2013-03-25 | 삼성전자주식회사 | 동영상 부호화 또는 복호화 방법 및 장치 |
| US8228994B2 (en) * | 2005-05-20 | 2012-07-24 | Microsoft Corporation | Multi-view video coding based on temporal and view decomposition |
| KR101276720B1 (ko) * | 2005-09-29 | 2013-06-19 | 삼성전자주식회사 | 카메라 파라미터를 이용하여 시차 벡터를 예측하는 방법,그 방법을 이용하여 다시점 영상을 부호화 및 복호화하는장치 및 이를 수행하기 위한 프로그램이 기록된 기록 매체 |
| JP5199124B2 (ja) * | 2006-01-12 | 2013-05-15 | エルジー エレクトロニクス インコーポレイティド | 多視点ビデオの処理 |
| KR20080066522A (ko) * | 2007-01-11 | 2008-07-16 | 삼성전자주식회사 | 다시점 영상의 부호화, 복호화 방법 및 장치 |
-
2008
- 2008-01-24 KR KR1020097016427A patent/KR20090113281A/ko not_active Withdrawn
- 2008-01-24 JP JP2009547172A patent/JP5249242B2/ja active Active
- 2008-01-24 WO PCT/KR2008/000444 patent/WO2008091117A1/en not_active Ceased
- 2008-01-24 EP EP08704944A patent/EP2123042A4/en not_active Withdrawn
- 2008-01-24 US US12/449,062 patent/US8923399B2/en active Active
- 2008-01-24 CN CN200880008776A patent/CN101647279A/zh active Pending
- 2008-01-24 TW TW097102726A patent/TWI355205B/zh not_active IP Right Cessation
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI501611B (zh) * | 2012-08-16 | 2015-09-21 | Qualcomm Inc | 用於3d視訊之視圖間預測之運動向量 |
| US9357195B2 (en) | 2012-08-16 | 2016-05-31 | Qualcomm Incorporated | Inter-view predicted motion vector for 3D video |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2008091117A1 (en) | 2008-07-31 |
| CN101647279A (zh) | 2010-02-10 |
| TW200845767A (en) | 2008-11-16 |
| EP2123042A4 (en) | 2010-03-10 |
| JP2010517409A (ja) | 2010-05-20 |
| US8923399B2 (en) | 2014-12-30 |
| EP2123042A1 (en) | 2009-11-25 |
| JP5249242B2 (ja) | 2013-07-31 |
| KR20090113281A (ko) | 2009-10-29 |
| US20100091858A1 (en) | 2010-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI355205B (en) | A method and an apparatus for processing a video s | |
| US7817865B2 (en) | Processing multiview video | |
| JP5156088B2 (ja) | ビデオ信号のデコーディング/エンコーディング方法及び装置 | |
| JP5021739B2 (ja) | 信号処理方法及び装置 | |
| JP2010515400A (ja) | 全域差ベクトルを利用した多視点映像の符号化、復号化方法及び装置 | |
| CN101375594A (zh) | 处理多视图视频 | |
| JP7717902B2 (ja) | 符号化及び復号化方法並びに装置 | |
| WO2013159330A1 (en) | An apparatus, a method and a computer program for video coding and decoding | |
| CN114303375B (zh) | 使用双向预测的视频解码方法和用于该方法的装置 | |
| JP4663792B2 (ja) | 多視点動映像を符号化及び復号化する装置及び方法 | |
| CN101243692B (zh) | 对多视角视频进行编码的方法和设备 | |
| CN119922328A (zh) | 解码和编码设备以及数据存储和发送设备 | |
| GB2499831A (en) | Determining missing coding units while decoding a video bitstream | |
| CN119697387A (zh) | 图像解码和编码方法及用于图像的数据的发送方法 | |
| KR20080006494A (ko) | 비디오 신호의 디코딩 방법 및 장치 | |
| KR101366288B1 (ko) | 비디오 신호의 디코딩 방법 및 장치 | |
| CN119520824A (zh) | 图像编码/解码方法和数据发送方法 | |
| KR101407719B1 (ko) | 가변적 화면 그룹 예측 구조를 이용한 다시점 영상 부호화방법 및 장치, 영상 복호화 장치 그리고 상기 방법을수행하는 프로그램이 기록된 기록 매체 | |
| KR20070098429A (ko) | 비디오 신호의 디코딩 방법 | |
| KR20080029788A (ko) | 비디오 신호의 디코딩 방법 및 장치 | |
| KR20080007177A (ko) | 비디오 신호 처리 방법 및 장치 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |