KR102568199B1 - 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 - Google Patents
디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 Download PDFInfo
- Publication number
- KR102568199B1 KR102568199B1 KR1020207035308A KR20207035308A KR102568199B1 KR 102568199 B1 KR102568199 B1 KR 102568199B1 KR 1020207035308 A KR1020207035308 A KR 1020207035308A KR 20207035308 A KR20207035308 A KR 20207035308A KR 102568199 B1 KR102568199 B1 KR 102568199B1
- Authority
- KR
- South Korea
- Prior art keywords
- motion vector
- integer
- vector displacement
- pixel
- displacement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000033001 locomotion Effects 0.000 title claims abstract description 385
- 239000013598 vector Substances 0.000 title claims abstract description 346
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000006073 displacement reaction Methods 0.000 claims description 123
- 238000004364 calculation method Methods 0.000 claims description 10
- 230000002146 bilateral effect Effects 0.000 abstract description 23
- 238000009795 derivation Methods 0.000 abstract description 14
- 238000011156 evaluation Methods 0.000 abstract description 13
- 230000006870 function Effects 0.000 description 111
- 230000000875 corresponding effect Effects 0.000 description 34
- 238000010586 diagram Methods 0.000 description 21
- 239000000872 buffer Substances 0.000 description 20
- 230000011664 signaling Effects 0.000 description 20
- 230000002123 temporal effect Effects 0.000 description 16
- 230000009471 action Effects 0.000 description 13
- 238000013139 quantization Methods 0.000 description 13
- 238000012545 processing Methods 0.000 description 10
- 230000008901 benefit Effects 0.000 description 8
- 230000006835 compression Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 description 6
- 238000007906 compression Methods 0.000 description 6
- 238000001914 filtration Methods 0.000 description 6
- 230000014509 gene expression Effects 0.000 description 6
- 238000005286 illumination Methods 0.000 description 6
- 230000009466 transformation Effects 0.000 description 6
- 238000013459 approach Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 241000023320 Luma <angiosperm> Species 0.000 description 3
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000011524 similarity measure Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000010420 art technique Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/533—Motion estimation using multistep search, e.g. 2D-log search or one-at-a-time search [OTS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/56—Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020237027427A KR102701434B1 (ko) | 2018-07-02 | 2019-06-20 | 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IN201831024666 | 2018-07-02 | ||
| IN201831024666 | 2018-07-02 | ||
| PCT/CN2019/092114 WO2020007199A1 (en) | 2018-07-02 | 2019-06-20 | An error surface based sub-pixel accurate refinement method for decoder side motion vector refinement |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020237027427A Division KR102701434B1 (ko) | 2018-07-02 | 2019-06-20 | 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| KR20210008046A KR20210008046A (ko) | 2021-01-20 |
| KR102568199B1 true KR102568199B1 (ko) | 2023-08-22 |
Family
ID=69060580
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020207035308A Active KR102568199B1 (ko) | 2018-07-02 | 2019-06-20 | 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 |
| KR1020237027427A Active KR102701434B1 (ko) | 2018-07-02 | 2019-06-20 | 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020237027427A Active KR102701434B1 (ko) | 2018-07-02 | 2019-06-20 | 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 |
Country Status (10)
| Country | Link |
|---|---|
| US (3) | US11310521B2 (enExample) |
| EP (1) | EP3794826A1 (enExample) |
| JP (2) | JP7652354B2 (enExample) |
| KR (2) | KR102568199B1 (enExample) |
| CN (3) | CN115052162A (enExample) |
| BR (1) | BR112020026988A2 (enExample) |
| MX (1) | MX2020013844A (enExample) |
| MY (1) | MY201618A (enExample) |
| SG (1) | SG11202011320SA (enExample) |
| WO (1) | WO2020007199A1 (enExample) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2563943B (en) * | 2017-06-30 | 2021-02-24 | Canon Kk | Method and apparatus for encoding or decoding video data in FRUC mode with reduced memory accesses |
| JP7242861B2 (ja) * | 2018-09-04 | 2023-03-20 | 華為技術有限公司 | 二方向インター予測に適用される参照フレーム取得方法および装置 |
| MY207229A (en) * | 2019-02-28 | 2025-02-07 | Huawei Tech Co Ltd | An encoder, a decoder and corresponding methods for inter prediction |
| CN120455657A (zh) * | 2019-03-08 | 2025-08-08 | 交互数字Vc控股公司 | 用于编码或解码的方法和装置 |
| EP4557732A1 (en) * | 2022-07-13 | 2025-05-21 | LG Electronics Inc. | Image coding/decoding method based on movement information refinement, method for transmitting bitstream, and recording medium storing bitstream |
| US20240223776A1 (en) * | 2023-01-03 | 2024-07-04 | Alibaba (China) Co., Ltd. | Intra template matching prediction mode for motion prediction |
| US20250260831A1 (en) * | 2024-02-14 | 2025-08-14 | Tencent America LLC | Implicit sub-pel position derivation for template matching-based intra prediction |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180146208A1 (en) * | 2016-11-24 | 2018-05-24 | Ecole De Technologie Superieure | Method and system for parallel rate-constrained motion estimation in video coding |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6876703B2 (en) * | 2000-05-11 | 2005-04-05 | Ub Video Inc. | Method and apparatus for video coding |
| KR100746022B1 (ko) * | 2005-06-14 | 2007-08-06 | 삼성전자주식회사 | 서브픽셀 움직임 추정시 모델 스위칭을 통한 압축 효율을증가시키는 인코딩 방법 및 장치 |
| KR101403343B1 (ko) * | 2007-10-04 | 2014-06-09 | 삼성전자주식회사 | 부화소 움직임 추정을 이용한 인터 예측 부호화, 복호화방법 및 장치 |
| WO2009113787A2 (en) * | 2008-03-09 | 2009-09-17 | Lg Electronics Inc. | A method and an apparatus for encoding or decoding a video signal |
| EP2362655B1 (en) * | 2010-02-10 | 2013-07-17 | Telefonaktiebolaget L M Ericsson (Publ) | Motion-vector estimation |
| EP3314894B1 (en) * | 2015-06-25 | 2024-03-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Refinement of a low-pel resolution motion estimation vector |
| EP3171595A1 (en) * | 2015-11-18 | 2017-05-24 | Thomson Licensing | Enhanced search strategies for hierarchical motion estimation |
| KR102746463B1 (ko) * | 2016-08-17 | 2024-12-23 | 세종대학교산학협력단 | 비디오 신호의 부호화 또는 복호화 방법 및 장치 |
| AU2016266019A1 (en) * | 2016-11-30 | 2018-06-14 | Canon Kabushiki Kaisha | Image registration method |
| CN106878737B (zh) * | 2017-03-02 | 2019-10-08 | 西安电子科技大学 | 高效视频编码中的运动估计加速方法 |
-
2019
- 2019-06-20 KR KR1020207035308A patent/KR102568199B1/ko active Active
- 2019-06-20 JP JP2020572451A patent/JP7652354B2/ja active Active
- 2019-06-20 WO PCT/CN2019/092114 patent/WO2020007199A1/en not_active Ceased
- 2019-06-20 CN CN202210547968.0A patent/CN115052162A/zh active Pending
- 2019-06-20 BR BR112020026988-3A patent/BR112020026988A2/pt unknown
- 2019-06-20 MX MX2020013844A patent/MX2020013844A/es unknown
- 2019-06-20 KR KR1020237027427A patent/KR102701434B1/ko active Active
- 2019-06-20 EP EP19829878.8A patent/EP3794826A1/en active Pending
- 2019-06-20 CN CN202210544150.3A patent/CN115442619B/zh active Active
- 2019-06-20 MY MYPI2020005963A patent/MY201618A/en unknown
- 2019-06-20 CN CN201980040320.0A patent/CN112292861B/zh active Active
- 2019-06-20 SG SG11202011320SA patent/SG11202011320SA/en unknown
-
2020
- 2020-11-22 US US17/100,924 patent/US11310521B2/en active Active
-
2022
- 2022-01-11 US US17/573,331 patent/US12003754B2/en active Active
-
2023
- 2023-12-22 JP JP2023217242A patent/JP2024038060A/ja active Pending
-
2024
- 2024-05-06 US US18/655,369 patent/US12477142B2/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180146208A1 (en) * | 2016-11-24 | 2018-05-24 | Ecole De Technologie Superieure | Method and system for parallel rate-constrained motion estimation in video coding |
Non-Patent Citations (2)
| Title |
|---|
| Cheng Du, et. al., "PPHPS: a parabolic prediction-based, fast half-pixel search algorithm for very low bit-rate moving-picture coding", IEEE Transactions on Circuits and Systems for Video Technology (Volume: 13, Issue: 6, June 2003), 2003.06.25, Page(s): 514 - 518.* |
| Jianle Chen, et. al., "Algorithm Description of Joint Exploration Test Model 7 (JEM 7)", Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting: Torino, IT, 2017.08.19, Document: JVET-G1001-v1.* |
Also Published As
| Publication number | Publication date |
|---|---|
| US12003754B2 (en) | 2024-06-04 |
| WO2020007199A1 (en) | 2020-01-09 |
| JP2024038060A (ja) | 2024-03-19 |
| KR20210008046A (ko) | 2021-01-20 |
| CN115442619A (zh) | 2022-12-06 |
| KR20230122686A (ko) | 2023-08-22 |
| JP7652354B2 (ja) | 2025-03-27 |
| US12477142B2 (en) | 2025-11-18 |
| US20220132158A1 (en) | 2022-04-28 |
| JP2021530144A (ja) | 2021-11-04 |
| CN112292861B (zh) | 2022-05-17 |
| CN115052162A (zh) | 2022-09-13 |
| US20240364914A1 (en) | 2024-10-31 |
| US20210076059A1 (en) | 2021-03-11 |
| KR102701434B1 (ko) | 2024-09-04 |
| EP3794826A4 (en) | 2021-03-24 |
| EP3794826A1 (en) | 2021-03-24 |
| MX2020013844A (es) | 2021-03-25 |
| CN115442619B (zh) | 2025-01-07 |
| BR112020026988A2 (pt) | 2021-03-30 |
| US11310521B2 (en) | 2022-04-19 |
| SG11202011320SA (en) | 2020-12-30 |
| MY201618A (en) | 2024-03-05 |
| CN112292861A (zh) | 2021-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7682967B2 (ja) | マルチリファレンス予測のための動きベクトルの精密化 | |
| JP7783373B2 (ja) | 動きベクトル精密化および動き補償のためのメモリアクセスウィンドウおよびパディング | |
| KR102568199B1 (ko) | 디코더 측 모션 벡터 정제를 위한 에러 표면 기반 서브 픽셀 정밀 정제 방법 | |
| CN115118988B (zh) | 用于运动向量细化的搜索区域 | |
| KR102642784B1 (ko) | 모션 벡터 리파인먼트를 위한 제한된 메모리 액세스 윈도우 | |
| NZ760521B2 (en) | Motion vector refinement for multi-reference prediction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PA0105 | International application |
Patent event date: 20201208 Patent event code: PA01051R01D Comment text: International Patent Application |
|
| PA0201 | Request for examination | ||
| PG1501 | Laying open of application | ||
| E902 | Notification of reason for refusal | ||
| PE0902 | Notice of grounds for rejection |
Comment text: Notification of reason for refusal Patent event date: 20221114 Patent event code: PE09021S01D |
|
| E701 | Decision to grant or registration of patent right | ||
| PE0701 | Decision of registration |
Patent event code: PE07011S01D Comment text: Decision to Grant Registration Patent event date: 20230515 |
|
| GRNT | Written decision to grant | ||
| PR0701 | Registration of establishment |
Comment text: Registration of Establishment Patent event date: 20230814 Patent event code: PR07011E01D |
|
| PR1002 | Payment of registration fee |
Payment date: 20230816 End annual number: 3 Start annual number: 1 |
|
| PG1601 | Publication of registration |