TWI866421B - 雙向光流複雜度降低及位元寬度控制的裝置及方法 - Google Patents

雙向光流複雜度降低及位元寬度控制的裝置及方法 Download PDF

Info

Publication number
TWI866421B
TWI866421B TW112132633A TW112132633A TWI866421B TW I866421 B TWI866421 B TW I866421B TW 112132633 A TW112132633 A TW 112132633A TW 112132633 A TW112132633 A TW 112132633A TW I866421 B TWI866421 B TW I866421B
Authority
TW
Taiwan
Prior art keywords
array
prediction
horizontal
gradient
vertical
Prior art date
Application number
TW112132633A
Other languages
English (en)
Chinese (zh)
Other versions
TW202402055A (zh
Inventor
修曉宇
賀玉文
言 葉
羅健聰
Original Assignee
美商內數位Ｖｃ控股公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商內數位Ｖｃ控股公司 filed Critical 美商內數位Ｖｃ控股公司
Publication of TW202402055A publication Critical patent/TW202402055A/zh
Application granted granted Critical
Publication of TWI866421B publication Critical patent/TWI866421B/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/563—Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
TW112132633A 2018-09-21 2019-09-18 雙向光流複雜度降低及位元寬度控制的裝置及方法 TWI866421B (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201862734763P 2018-09-21 2018-09-21
US62/734763 2018-09-21
US201862738655P 2018-09-28 2018-09-28
US62/738655 2018-09-28
US201962789331P 2019-01-07 2019-01-07
US62/789331 2019-01-07

Publications (2)

Publication Number Publication Date
TW202402055A TW202402055A (zh) 2024-01-01
TWI866421B true TWI866421B (zh) 2024-12-11

Family

ID=68104762

Family Applications (3)

Application Number Title Priority Date Filing Date
TW112132633A TWI866421B (zh) 2018-09-21 2019-09-18 雙向光流複雜度降低及位元寬度控制的裝置及方法
TW108133511A TWI834722B (zh) 2018-09-21 2019-09-18 雙向光流複雜度降低及位元寬度控制的裝置及方法
TW113143196A TW202516922A (zh) 2018-09-21 2019-09-18 雙向光流複雜度降低及位元寬度控制的裝置及方法

Family Applications After (2)

Application Number Title Priority Date Filing Date
TW108133511A TWI834722B (zh) 2018-09-21 2019-09-18 雙向光流複雜度降低及位元寬度控制的裝置及方法
TW113143196A TW202516922A (zh) 2018-09-21 2019-09-18 雙向光流複雜度降低及位元寬度控制的裝置及方法

Country Status (9)

Country Link
US (5) US11470308B2 (enExample)
EP (2) EP4746411A3 (enExample)
JP (3) JP7311589B2 (enExample)
KR (2) KR102708989B1 (enExample)
CN (2) CN112715030B (enExample)
ES (1) ES3072395T3 (enExample)
IL (1) IL281581B2 (enExample)
TW (3) TWI866421B (enExample)
WO (1) WO2020061082A1 (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112715030B (zh) 2018-09-21 2024-04-23 Vid拓展公司 用于双向光流的复杂度降低和位宽控制
CN112889284B (zh) * 2018-10-22 2024-12-13 北京字节跳动网络技术有限公司 基于子块的解码器侧运动矢量推导
CN117880513A (zh) 2018-10-22 2024-04-12 北京字节跳动网络技术有限公司 基于编解码信息的解码器侧运动矢量推导的限制
CN112970259B (zh) 2018-11-05 2024-06-28 北京字节跳动网络技术有限公司 视频处理中具有细化的帧间预测
CN113228681B (zh) 2018-12-21 2025-02-25 韩国电子通信研究院 图像编码/解码方法和装置以及存储比特流的记录介质
KR102489605B1 (ko) 2019-01-09 2023-01-17 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 조합된 인터 및 인트라 예측을 위한 시스템 및 방법
JP7303255B2 (ja) * 2019-01-09 2023-07-04 ベイジン ダジア インターネット インフォメーション テクノロジー カンパニー リミテッド ビデオコーディングの方法、ビデオコーディングデバイス、コンピュータ可読記憶媒体およびコンピュータプログラム
PT3909247T (pt) * 2019-02-08 2024-05-13 Beijing Dajia Internet Information Tech Co Ltd Método e dispositivo para aplicação seletiva de refinamento de vetor de movimento do lado do descodificador para codificação de vídeo
WO2020184526A1 (ja) * 2019-03-11 2020-09-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法、及び復号方法
CN121691717A (zh) * 2019-03-15 2026-03-17 北京达佳互联信息技术有限公司 用于双向光流的比特宽度控制的方法和设备
GB2585039A (en) * 2019-06-25 2020-12-30 Sony Corp Image data encoding and decoding
US11736720B2 (en) * 2019-09-03 2023-08-22 Tencent America LLC Motion vector refinement methods for video encoding
EP4032300A4 (en) 2019-09-20 2022-11-09 Telefonaktiebolaget Lm Ericsson (Publ) Methods of video encoding and/or decoding with bidirectional optical flow simplification on shift operations and related apparatus
CN121262368A (zh) * 2019-12-30 2026-01-02 Oppo广东移动通信有限公司 帧间预测方法、编码器、解码器及存储介质
CN114079784A (zh) * 2020-08-20 2022-02-22 Oppo广东移动通信有限公司 帧间预测方法、编码器、解码器以及计算机存储介质
EP4418758A3 (en) * 2023-02-17 2024-10-16 Industrial Technology Research Institute Method of power control for wireless communication, and communication device and network element using the same
EP4723623A1 (en) * 2024-10-03 2026-04-08 InterDigital CE Patent Holdings, SAS Rate-distortion optimization with motion information

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018166357A1 (en) * 2017-03-16 2018-09-20 Mediatek Inc. Method and apparatus of motion refinement based on bi-directional optical flow for video coding

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06168239A (ja) 1992-11-27 1994-06-14 Toshiba Corp 文書作成装置
JP2991878B2 (ja) * 1992-11-27 1999-12-20 三菱電機株式会社 オプティカルフロー演算回路
EP2375751A1 (en) 2010-04-12 2011-10-12 Panasonic Corporation Complexity reduction of edge-detection based spatial interpolation
US9172972B2 (en) 2011-01-05 2015-10-27 Qualcomm Incorporated Low complexity interpolation filtering with adaptive tap size
WO2016200984A1 (en) * 2015-06-08 2016-12-15 Vid Scale, Inc. Intra block copy mode for screen content coding
US20180242004A1 (en) 2015-08-23 2018-08-23 Lg Electronics Inc. Inter prediction mode-based image processing method and apparatus therefor
US10341659B2 (en) 2016-10-05 2019-07-02 Qualcomm Incorporated Systems and methods of switching interpolation filters
WO2018084339A1 (ko) 2016-11-04 2018-05-11 엘지전자(주) 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
EP3556096B1 (en) * 2016-12-22 2024-05-22 HFI Innovation Inc. Method and apparatus of motion refinement for video coding
US10931969B2 (en) * 2017-01-04 2021-02-23 Qualcomm Incorporated Motion vector reconstructions for bi-directional optical flow (BIO)
US10701366B2 (en) * 2017-02-21 2020-06-30 Qualcomm Incorporated Deriving motion vector information at a video decoder
CN116866581A (zh) * 2017-05-17 2023-10-10 株式会社Kt 对视频解码和编码的方法以及存储压缩视频数据的装置
CN122395370A (zh) * 2017-06-09 2026-07-14 英迪股份有限公司 对图像进行编码/解码的方法以及包含比特流的存储介质
US10904565B2 (en) * 2017-06-23 2021-01-26 Qualcomm Incorporated Memory-bandwidth-efficient design for bi-directional optical flow (BIO)
BR112020000032A2 (pt) * 2017-07-03 2020-07-14 Vid Scale, Inc. dispositivo e método de codificação de dados de vídeo.
CN111052742A (zh) * 2017-09-30 2020-04-21 深圳市大疆创新科技有限公司 图像处理
US10776688B2 (en) * 2017-11-06 2020-09-15 Nvidia Corporation Multi-frame video interpolation using optical flow
US11109053B2 (en) * 2018-03-05 2021-08-31 Panasonic Intellectual Property Corporation Of America Encoding method, decoding method, encoder, and decoder
EP3777159A1 (en) 2018-04-06 2021-02-17 VID SCALE, Inc. A bi-directional optical flow method with simplified gradient derivation
KR102596104B1 (ko) 2018-06-11 2023-10-30 에이치에프아이 이노베이션 인크. 비디오 코딩을 위한 양방향 광학 흐름의 방법 및 장치
MX2021001833A (es) 2018-08-17 2021-05-12 Hfi Innovation Inc Metodos y aparatos de procesamiento de video con prediccion bidireccional en sistemas de codificacion de video.
CN112715030B (zh) 2018-09-21 2024-04-23 Vid拓展公司 用于双向光流的复杂度降低和位宽控制

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018166357A1 (en) * 2017-03-16 2018-09-20 Mediatek Inc. Method and apparatus of motion refinement based on bi-directional optical flow for video coding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
網路文獻 A. Alshin and E. Alshina Bi-directional Optical Flow for Future Video Codec 2016 Data Compression Conference (DCC) pp. 83-90, doi: 10.1109/DCC.2016.125 2016 Data Compression Conference (DCC) 2016/04/01 https://ieeexplore.ieee.org/document/7786152/ *

Also Published As

Publication number Publication date
WO2020061082A1 (en) 2020-03-26
JP2022501906A (ja) 2022-01-06
EP4746411A3 (en) 2026-07-08
JP2024166257A (ja) 2024-11-28
US20260039801A1 (en) 2026-02-05
JP7553659B2 (ja) 2024-09-18
US20230053233A1 (en) 2023-02-16
ES3072395T3 (en) 2026-07-01
IL281581B1 (en) 2025-01-01
KR20210071958A (ko) 2021-06-16
KR20240142584A (ko) 2024-09-30
TW202516922A (zh) 2025-04-16
EP4746411A2 (en) 2026-05-20
KR102708989B1 (ko) 2024-09-23
US20240205389A1 (en) 2024-06-20
US11968358B2 (en) 2024-04-23
IL281581A (en) 2021-05-31
US20220038679A1 (en) 2022-02-03
CN112715030B (zh) 2024-04-23
TW202025751A (zh) 2020-07-01
US20230050213A1 (en) 2023-02-16
EP3854089C0 (en) 2026-05-13
US11470308B2 (en) 2022-10-11
CN118474345A (zh) 2024-08-09
JP7311589B2 (ja) 2023-07-19
JP7744485B2 (ja) 2025-09-25
US12003703B2 (en) 2024-06-04
CN112715030A (zh) 2021-04-27
EP3854089A1 (en) 2021-07-28
EP3854089B1 (en) 2026-05-13
US12464117B2 (en) 2025-11-04
IL281581B2 (en) 2025-05-01
TWI834722B (zh) 2024-03-11
KR102937491B1 (ko) 2026-03-10
JP2023118924A (ja) 2023-08-25
TW202402055A (zh) 2024-01-01

Similar Documents

Publication Publication Date Title
TWI834722B (zh) 雙向光流複雜度降低及位元寬度控制的裝置及方法
JP7700337B2 (ja) オプティカルフローによる動き補償のための精度精緻化
US20250168350A1 (en) Methods and systems for post-reconstruction filtering
US12177452B2 (en) Inter prediction bandwidth reduction method with optical flow compensation