TWI856066B - 解碼器側運動向量精緻化之限制 - Google Patents
解碼器側運動向量精緻化之限制 Download PDFInfo
- Publication number
- TWI856066B TWI856066B TW109106792A TW109106792A TWI856066B TW I856066 B TWI856066 B TW I856066B TW 109106792 A TW109106792 A TW 109106792A TW 109106792 A TW109106792 A TW 109106792A TW I856066 B TWI856066 B TW I856066B
- Authority
- TW
- Taiwan
- Prior art keywords
- prediction
- block
- motion vector
- video
- predicted
- Prior art date
Links
- 239000013598 vector Substances 0.000 title claims abstract description 355
- 238000000034 method Methods 0.000 claims abstract description 240
- 230000008569 process Effects 0.000 claims abstract description 39
- 230000002457 bidirectional effect Effects 0.000 claims description 104
- 230000002146 bilateral effect Effects 0.000 claims description 31
- 238000003860 storage Methods 0.000 claims description 20
- 238000004891 communication Methods 0.000 claims description 19
- 238000012545 processing Methods 0.000 description 42
- 238000013139 quantization Methods 0.000 description 28
- 238000010586 diagram Methods 0.000 description 24
- 238000000638 solvent extraction Methods 0.000 description 24
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 description 19
- 230000006870 function Effects 0.000 description 18
- 241000023320 Luma <angiosperm> Species 0.000 description 16
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 16
- 230000003287 optical effect Effects 0.000 description 16
- 238000005192 partition Methods 0.000 description 12
- 230000002123 temporal effect Effects 0.000 description 12
- 230000005540 biological transmission Effects 0.000 description 10
- 238000009795 derivation Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 230000011664 signaling Effects 0.000 description 8
- VBRBNWWNRIMAII-WYMLVPIESA-N 3-[(e)-5-(4-ethylphenoxy)-3-methylpent-3-enyl]-2,2-dimethyloxirane Chemical compound C1=CC(CC)=CC=C1OC\C=C(/C)CCC1C(C)(C)O1 VBRBNWWNRIMAII-WYMLVPIESA-N 0.000 description 7
- 239000000872 buffer Substances 0.000 description 7
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 6
- 238000013138 pruning Methods 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 238000010276 construction Methods 0.000 description 3
- 238000007670 refining Methods 0.000 description 3
- 230000002441 reversible effect Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 101100537098 Mus musculus Alyref gene Proteins 0.000 description 2
- 101150095908 apex1 gene Proteins 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000012804 iterative process Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 239000011449 brick Substances 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000001364 causal effect Effects 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012432 intermediate storage Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005549 size reduction Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201962812828P | 2019-03-01 | 2019-03-01 | |
| US62/812,828 | 2019-03-01 | ||
| US16/803,520 US11190797B2 (en) | 2019-03-01 | 2020-02-27 | Constraints on decoder-side motion vector refinement based on weights for bi-predicted prediction |
| US16/803,520 | 2020-02-27 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW202041002A TW202041002A (zh) | 2020-11-01 |
| TWI856066B true TWI856066B (zh) | 2024-09-21 |
Family
ID=72236396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW109106792A TWI856066B (zh) | 2019-03-01 | 2020-03-02 | 解碼器側運動向量精緻化之限制 |
Country Status (9)
| Country | Link |
|---|---|
| US (1) | US11190797B2 (https=) |
| EP (1) | EP3932068A1 (https=) |
| JP (1) | JP7507166B2 (https=) |
| KR (1) | KR102662462B1 (https=) |
| CN (1) | CN113678452B (https=) |
| BR (1) | BR112021015658A2 (https=) |
| SG (1) | SG11202108316QA (https=) |
| TW (1) | TWI856066B (https=) |
| WO (1) | WO2020180685A1 (https=) |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2019293670B2 (en) | 2018-06-29 | 2023-06-08 | Beijing Bytedance Network Technology Co., Ltd. | Update of look up table: FIFO, constrained FIFO |
| KR20240005239A (ko) | 2018-06-29 | 2024-01-11 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Lut와 amvp 사이의 상호작용 |
| MX392418B (es) | 2018-06-29 | 2025-03-24 | Beijing Bytedance Network Tech Co Ltd | Poda parcial/total cuando se añade un candidato a hmvp para fusión/amvp. |
| WO2020143741A1 (en) * | 2019-01-10 | 2020-07-16 | Beijing Bytedance Network Technology Co., Ltd. | Invoke of lut updating |
| WO2020147773A1 (en) | 2019-01-16 | 2020-07-23 | Beijing Bytedance Network Technology Co., Ltd. | Inserting order of motion candidates in lut |
| WO2020177684A1 (en) * | 2019-03-03 | 2020-09-10 | Beijing Bytedance Network Technology Co., Ltd. | Enabling dmvr based on the information in the picture header |
| CN120529070A (zh) * | 2019-03-07 | 2025-08-22 | 数字洞察力有限公司 | 图像编码/解码方法和传输比特流的方法 |
| CN113557740B (zh) | 2019-03-08 | 2025-10-31 | 夏普株式会社 | 运动图像解码装置、运动图像编码装置以及运动图像解码方法 |
| CN113615193B (zh) | 2019-03-22 | 2024-06-25 | 北京字节跳动网络技术有限公司 | Merge列表构建和其他工具之间的交互 |
| EP4697720A3 (en) * | 2019-06-14 | 2026-04-29 | LG Electronics Inc. | Image decoding method and device for deriving weight index information for generation of prediction sample |
| WO2020256405A1 (ko) * | 2019-06-17 | 2020-12-24 | 한국전자통신연구원 | 화면 내 블록 복사 기반 부호화/복호화 방법, 장치 및 비트스트림 저장매체 |
| US11399188B2 (en) * | 2020-01-01 | 2022-07-26 | Tencent America LLC | Method for mixed NAL unit type support in a coded picture |
| US11936899B2 (en) * | 2021-03-12 | 2024-03-19 | Lemon Inc. | Methods and systems for motion candidate derivation |
| US11671616B2 (en) | 2021-03-12 | 2023-06-06 | Lemon Inc. | Motion candidate derivation |
| US12219166B2 (en) | 2021-03-12 | 2025-02-04 | Lemon Inc. | Motion candidate derivation with search order and coding mode |
| CN117337567A (zh) * | 2021-04-21 | 2024-01-02 | 抖音视界有限公司 | 用于视频处理的方法、设备和介质 |
| US12212736B2 (en) * | 2021-06-30 | 2025-01-28 | Qualcomm Incorporated | Using unrefined motion vectors for performing decoder-side motion vector derivation |
| US12108076B2 (en) * | 2021-11-01 | 2024-10-01 | Tencent America LLC | Index reordering of bi-prediction with CU-level weight (BCW) by using template-matching |
| WO2023131248A1 (en) * | 2022-01-05 | 2023-07-13 | Beijing Bytedance Network Technology Co., Ltd. | Method, apparatus, and medium for video processing |
| KR20240134300A (ko) * | 2022-01-09 | 2024-09-09 | 엘지전자 주식회사 | 영상 인코딩/디코딩 방법 및 장치, 그리고 비트스트림을 저장한 기록 매체 |
| KR20240137016A (ko) * | 2022-01-13 | 2024-09-19 | 엘지전자 주식회사 | 영상 인코딩/디코딩 방법 및 장치, 그리고 비트스트림을 저장한 기록 매체 |
| WO2023171912A1 (ko) * | 2022-03-07 | 2023-09-14 | 현대자동차주식회사 | 비디오 프레임 경계에서의 예측블록 생성 |
| US20250211779A1 (en) * | 2022-03-31 | 2025-06-26 | Mediatek Inc. | Bilateral template with multipass decoder side motion vector refinement |
| EP4606112A1 (en) * | 2022-10-20 | 2025-08-27 | Douyin Vision Co., Ltd. | Method, apparatus, and medium for video processing |
| CN120548704A (zh) * | 2023-01-20 | 2025-08-26 | Oppo广东移动通信有限公司 | 编解码方法、码流、编码器、解码器以及存储介质 |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105939475A (zh) * | 2016-06-06 | 2016-09-14 | 中国矿业大学 | 一种高质量边信息生成方法 |
| US20180241998A1 (en) * | 2017-02-21 | 2018-08-23 | Qualcomm Incorporated | Deriving motion vector information at a video decoder |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4060992B1 (en) * | 2016-05-13 | 2025-07-02 | InterDigital VC Holdings, Inc. | Systems and methods for generalized multi-hypothesis prediction for video coding |
| US10750203B2 (en) * | 2016-12-22 | 2020-08-18 | Mediatek Inc. | Method and apparatus of adaptive bi-prediction for video coding |
| US12063387B2 (en) * | 2017-01-05 | 2024-08-13 | Hfi Innovation Inc. | Decoder-side motion vector restoration for video coding |
| US10701391B2 (en) * | 2017-03-23 | 2020-06-30 | Qualcomm Incorporated | Motion vector difference (MVD) prediction |
| US10602180B2 (en) | 2017-06-13 | 2020-03-24 | Qualcomm Incorporated | Motion vector prediction |
| EP4351140A1 (en) * | 2018-06-07 | 2024-04-10 | Beijing Bytedance Network Technology Co., Ltd. | Partial cost calculation |
| TWI719519B (zh) * | 2018-07-02 | 2021-02-21 | 大陸商北京字節跳動網絡技術有限公司 | 對於dmvr的塊尺寸限制 |
| TW202029755A (zh) * | 2018-09-26 | 2020-08-01 | 美商Ｖｉｄ衡器股份有限公司 | 視訊編碼雙預測 |
| CN112913240B (zh) * | 2018-10-22 | 2024-08-06 | 北京字节跳动网络技术有限公司 | 解码器侧运动矢量推导和其他编解码工具之间的并置 |
| US11153590B2 (en) * | 2019-01-11 | 2021-10-19 | Tencent America LLC | Method and apparatus for video coding |
| US11140409B2 (en) * | 2019-03-22 | 2021-10-05 | Lg Electronics Inc. | DMVR and BDOF based inter prediction method and apparatus thereof |
| US11039150B2 (en) * | 2019-04-19 | 2021-06-15 | Tencent America LLC | Method and apparatus for video coding |
-
2020
- 2020-02-27 US US16/803,520 patent/US11190797B2/en active Active
- 2020-02-28 KR KR1020217027205A patent/KR102662462B1/ko active Active
- 2020-02-28 CN CN202080016719.8A patent/CN113678452B/zh active Active
- 2020-02-28 BR BR112021015658-5A patent/BR112021015658A2/pt unknown
- 2020-02-28 SG SG11202108316QA patent/SG11202108316QA/en unknown
- 2020-02-28 JP JP2021549850A patent/JP7507166B2/ja active Active
- 2020-02-28 EP EP20714428.8A patent/EP3932068A1/en active Pending
- 2020-02-28 WO PCT/US2020/020392 patent/WO2020180685A1/en not_active Ceased
- 2020-03-02 TW TW109106792A patent/TWI856066B/zh active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105939475A (zh) * | 2016-06-06 | 2016-09-14 | 中国矿业大学 | 一种高质量边信息生成方法 |
| US20180241998A1 (en) * | 2017-02-21 | 2018-08-23 | Qualcomm Incorporated | Deriving motion vector information at a video decoder |
Non-Patent Citations (1)
| Title |
|---|
| 網路文獻 Chih-Wei Hsu, Ching-Yeh Chen, Tzu-Der Chuang, Han Huang, Shih-Ta Hsiang, Chun-Chia Chen, Man-Shu Chiang, Chen-Yen Lai, Chia-Ming Tsai, Yu-Chi Su, Zhi-Yi Lin, Yu-Ling Hsiao, Jan Klopp, I-Hsiang Wang, Yu-Wen Huang, Shaw-Min Lei, Description of SDR video coding technology proposal by MediaTek, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-J0018 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3932068A1 (en) | 2022-01-05 |
| BR112021015658A2 (pt) | 2021-10-05 |
| SG11202108316QA (en) | 2021-09-29 |
| US11190797B2 (en) | 2021-11-30 |
| TW202041002A (zh) | 2020-11-01 |
| JP2022521979A (ja) | 2022-04-13 |
| WO2020180685A1 (en) | 2020-09-10 |
| KR20210130154A (ko) | 2021-10-29 |
| CN113678452A (zh) | 2021-11-19 |
| CN113678452B (zh) | 2024-09-13 |
| JP7507166B2 (ja) | 2024-06-27 |
| US20200280736A1 (en) | 2020-09-03 |
| KR102662462B1 (ko) | 2024-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI856066B (zh) | 解碼器側運動向量精緻化之限制 | |
| CN113039787B (zh) | 解码器侧运动矢量细化 | |
| CN112703740B (zh) | 用于仿射模式的基于历史的运动矢量预测 | |
| TWI859189B (zh) | 用於視訊寫碼中之區塊內複製模式之運動向量預測器清單產生 | |
| TWI856085B (zh) | 用於視訊寫碼之以梯度為基礎的預測細化 | |
| TW202025767A (zh) | 具有適應性方向性資訊集合之最終動作向量表示 | |
| TW202038614A (zh) | 用於視訊寫碼之空間時間運動向量預測圖案 | |
| US20210014524A1 (en) | Motion vector prediction with motion information collecting buffer | |
| CN118433403A (zh) | 用于对视频数据进行译码的方法、设备以及可读存储介质 | |
| US20250220208A1 (en) | Search area refinement for decoder motion refinement | |
| US12244840B2 (en) | Searching techniques for template matching for video coding | |
| TW202512734A (zh) | 仿射模型化區塊的雙向光流子區塊細化 | |
| KR20260025784A (ko) | 아핀 모델링된 블록에 대한 양방향 광학 플로우 서브블록 정세화 | |
| HK40064400A (en) | Constraints on decoder-side motion vector refinement | |
| WO2025144573A1 (en) | Search area refinement for decoder motion refinement | |
| HK40064400B (zh) | 对解码器侧运动矢量细化的约束 | |
| HK40049597A (en) | Decoder-side motion vector refinement | |
| HK40113292A (zh) | 解码器侧运动矢量细化 | |
| TW202243475A (zh) | 視頻譯碼中的雙向光流 | |
| HK40049597B (zh) | 解码器侧运动矢量细化 |