ES3072395T3 - Complexity reduction and bit-width control for bi-directional optical flow - Google Patents
Complexity reduction and bit-width control for bi-directional optical flowInfo
- Publication number
- ES3072395T3 ES3072395T3 ES19780070T ES19780070T ES3072395T3 ES 3072395 T3 ES3072395 T3 ES 3072395T3 ES 19780070 T ES19780070 T ES 19780070T ES 19780070 T ES19780070 T ES 19780070T ES 3072395 T3 ES3072395 T3 ES 3072395T3
- Authority
- ES
- Spain
- Prior art keywords
- horizontal
- vertical
- calculate
- gradients
- prediction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/563—Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862734763P | 2018-09-21 | 2018-09-21 | |
| US201862738655P | 2018-09-28 | 2018-09-28 | |
| US201962789331P | 2019-01-07 | 2019-01-07 | |
| PCT/US2019/051560 WO2020061082A1 (en) | 2018-09-21 | 2019-09-17 | Complexity reduction and bit-width control for bi-directional optical flow |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| ES3072395T3 true ES3072395T3 (en) | 2026-07-01 |
Family
ID=68104762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| ES19780070T Active ES3072395T3 (en) | 2018-09-21 | 2019-09-17 | Complexity reduction and bit-width control for bi-directional optical flow |
Country Status (9)
| Country | Link |
|---|---|
| US (5) | US11470308B2 (enExample) |
| EP (2) | EP4746411A3 (enExample) |
| JP (3) | JP7311589B2 (enExample) |
| KR (2) | KR102708989B1 (enExample) |
| CN (2) | CN112715030B (enExample) |
| ES (1) | ES3072395T3 (enExample) |
| IL (1) | IL281581B2 (enExample) |
| TW (3) | TWI866421B (enExample) |
| WO (1) | WO2020061082A1 (enExample) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112715030B (zh) | 2018-09-21 | 2024-04-23 | Vid拓展公司 | 用于双向光流的复杂度降低和位宽控制 |
| CN112889284B (zh) * | 2018-10-22 | 2024-12-13 | 北京字节跳动网络技术有限公司 | 基于子块的解码器侧运动矢量推导 |
| CN117880513A (zh) | 2018-10-22 | 2024-04-12 | 北京字节跳动网络技术有限公司 | 基于编解码信息的解码器侧运动矢量推导的限制 |
| CN112970259B (zh) | 2018-11-05 | 2024-06-28 | 北京字节跳动网络技术有限公司 | 视频处理中具有细化的帧间预测 |
| CN113228681B (zh) | 2018-12-21 | 2025-02-25 | 韩国电子通信研究院 | 图像编码/解码方法和装置以及存储比特流的记录介质 |
| KR102489605B1 (ko) | 2019-01-09 | 2023-01-17 | 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 | 조합된 인터 및 인트라 예측을 위한 시스템 및 방법 |
| JP7303255B2 (ja) * | 2019-01-09 | 2023-07-04 | ベイジン ダジア インターネット インフォメーション テクノロジー カンパニー リミテッド | ビデオコーディングの方法、ビデオコーディングデバイス、コンピュータ可読記憶媒体およびコンピュータプログラム |
| PT3909247T (pt) * | 2019-02-08 | 2024-05-13 | Beijing Dajia Internet Information Tech Co Ltd | Método e dispositivo para aplicação seletiva de refinamento de vetor de movimento do lado do descodificador para codificação de vídeo |
| WO2020184526A1 (ja) * | 2019-03-11 | 2020-09-17 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | 符号化装置、復号装置、符号化方法、及び復号方法 |
| CN121691717A (zh) * | 2019-03-15 | 2026-03-17 | 北京达佳互联信息技术有限公司 | 用于双向光流的比特宽度控制的方法和设备 |
| GB2585039A (en) * | 2019-06-25 | 2020-12-30 | Sony Corp | Image data encoding and decoding |
| US11736720B2 (en) * | 2019-09-03 | 2023-08-22 | Tencent America LLC | Motion vector refinement methods for video encoding |
| EP4032300A4 (en) | 2019-09-20 | 2022-11-09 | Telefonaktiebolaget Lm Ericsson (Publ) | Methods of video encoding and/or decoding with bidirectional optical flow simplification on shift operations and related apparatus |
| CN121262368A (zh) * | 2019-12-30 | 2026-01-02 | Oppo广东移动通信有限公司 | 帧间预测方法、编码器、解码器及存储介质 |
| CN114079784A (zh) * | 2020-08-20 | 2022-02-22 | Oppo广东移动通信有限公司 | 帧间预测方法、编码器、解码器以及计算机存储介质 |
| EP4418758A3 (en) * | 2023-02-17 | 2024-10-16 | Industrial Technology Research Institute | Method of power control for wireless communication, and communication device and network element using the same |
| EP4723623A1 (en) * | 2024-10-03 | 2026-04-08 | InterDigital CE Patent Holdings, SAS | Rate-distortion optimization with motion information |
Family Cites Families (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06168239A (ja) | 1992-11-27 | 1994-06-14 | Toshiba Corp | 文書作成装置 |
| JP2991878B2 (ja) * | 1992-11-27 | 1999-12-20 | 三菱電機株式会社 | オプティカルフロー演算回路 |
| EP2375751A1 (en) | 2010-04-12 | 2011-10-12 | Panasonic Corporation | Complexity reduction of edge-detection based spatial interpolation |
| US9172972B2 (en) | 2011-01-05 | 2015-10-27 | Qualcomm Incorporated | Low complexity interpolation filtering with adaptive tap size |
| WO2016200984A1 (en) * | 2015-06-08 | 2016-12-15 | Vid Scale, Inc. | Intra block copy mode for screen content coding |
| US20180242004A1 (en) | 2015-08-23 | 2018-08-23 | Lg Electronics Inc. | Inter prediction mode-based image processing method and apparatus therefor |
| US10341659B2 (en) | 2016-10-05 | 2019-07-02 | Qualcomm Incorporated | Systems and methods of switching interpolation filters |
| WO2018084339A1 (ko) | 2016-11-04 | 2018-05-11 | 엘지전자(주) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 |
| EP3556096B1 (en) * | 2016-12-22 | 2024-05-22 | HFI Innovation Inc. | Method and apparatus of motion refinement for video coding |
| US10931969B2 (en) * | 2017-01-04 | 2021-02-23 | Qualcomm Incorporated | Motion vector reconstructions for bi-directional optical flow (BIO) |
| US10701366B2 (en) * | 2017-02-21 | 2020-06-30 | Qualcomm Incorporated | Deriving motion vector information at a video decoder |
| WO2018166357A1 (en) | 2017-03-16 | 2018-09-20 | Mediatek Inc. | Method and apparatus of motion refinement based on bi-directional optical flow for video coding |
| CN116866581A (zh) * | 2017-05-17 | 2023-10-10 | 株式会社Kt | 对视频解码和编码的方法以及存储压缩视频数据的装置 |
| CN122395370A (zh) * | 2017-06-09 | 2026-07-14 | 英迪股份有限公司 | 对图像进行编码/解码的方法以及包含比特流的存储介质 |
| US10904565B2 (en) * | 2017-06-23 | 2021-01-26 | Qualcomm Incorporated | Memory-bandwidth-efficient design for bi-directional optical flow (BIO) |
| BR112020000032A2 (pt) * | 2017-07-03 | 2020-07-14 | Vid Scale, Inc. | dispositivo e método de codificação de dados de vídeo. |
| CN111052742A (zh) * | 2017-09-30 | 2020-04-21 | 深圳市大疆创新科技有限公司 | 图像处理 |
| US10776688B2 (en) * | 2017-11-06 | 2020-09-15 | Nvidia Corporation | Multi-frame video interpolation using optical flow |
| US11109053B2 (en) * | 2018-03-05 | 2021-08-31 | Panasonic Intellectual Property Corporation Of America | Encoding method, decoding method, encoder, and decoder |
| EP3777159A1 (en) | 2018-04-06 | 2021-02-17 | VID SCALE, Inc. | A bi-directional optical flow method with simplified gradient derivation |
| KR102596104B1 (ko) | 2018-06-11 | 2023-10-30 | 에이치에프아이 이노베이션 인크. | 비디오 코딩을 위한 양방향 광학 흐름의 방법 및 장치 |
| MX2021001833A (es) | 2018-08-17 | 2021-05-12 | Hfi Innovation Inc | Metodos y aparatos de procesamiento de video con prediccion bidireccional en sistemas de codificacion de video. |
| CN112715030B (zh) | 2018-09-21 | 2024-04-23 | Vid拓展公司 | 用于双向光流的复杂度降低和位宽控制 |
-
2019
- 2019-09-17 CN CN201980060852.0A patent/CN112715030B/zh active Active
- 2019-09-17 US US17/276,448 patent/US11470308B2/en active Active
- 2019-09-17 IL IL281581A patent/IL281581B2/en unknown
- 2019-09-17 ES ES19780070T patent/ES3072395T3/es active Active
- 2019-09-17 EP EP26170119.7A patent/EP4746411A3/en active Pending
- 2019-09-17 KR KR1020217008062A patent/KR102708989B1/ko active Active
- 2019-09-17 KR KR1020247030758A patent/KR102937491B1/ko active Active
- 2019-09-17 CN CN202410474083.1A patent/CN118474345A/zh active Pending
- 2019-09-17 JP JP2021515221A patent/JP7311589B2/ja active Active
- 2019-09-17 WO PCT/US2019/051560 patent/WO2020061082A1/en not_active Ceased
- 2019-09-17 EP EP19780070.9A patent/EP3854089B1/en active Active
- 2019-09-18 TW TW112132633A patent/TWI866421B/zh active
- 2019-09-18 TW TW108133511A patent/TWI834722B/zh active
- 2019-09-18 TW TW113143196A patent/TW202516922A/zh unknown
-
2022
- 2022-10-10 US US17/962,918 patent/US12003703B2/en active Active
- 2022-10-10 US US17/962,928 patent/US11968358B2/en active Active
-
2023
- 2023-07-06 JP JP2023111403A patent/JP7553659B2/ja active Active
-
2024
- 2024-02-09 US US18/438,202 patent/US12464117B2/en active Active
- 2024-09-05 JP JP2024153291A patent/JP7744485B2/ja active Active
-
2025
- 2025-10-13 US US19/356,614 patent/US20260039801A1/en active Pending