CN118945317B - 对仿射译码块进行光流预测修正的方法及装置 - Google Patents

对仿射译码块进行光流预测修正的方法及装置

Info

Publication number
CN118945317B
CN118945317B CN202410918815.1A CN202410918815A CN118945317B CN 118945317 B CN118945317 B CN 118945317B CN 202410918815 A CN202410918815 A CN 202410918815A CN 118945317 B CN118945317 B CN 118945317B
Authority
CN
China
Prior art keywords
block
prediction
affine
sample
current
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202410918815.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN118945317A (zh
Inventor
陈焕浜
杨海涛
陈建乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN118945317A publication Critical patent/CN118945317A/zh
Application granted granted Critical
Publication of CN118945317B publication Critical patent/CN118945317B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/527—Global motion vector estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/521—Processing of motion vectors for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/55—Motion estimation with spatial constraints, e.g. at image or region borders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
CN202410918815.1A 2019-03-20 2020-03-20 对仿射译码块进行光流预测修正的方法及装置 Active CN118945317B (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201962821440P 2019-03-20 2019-03-20
US62/821,440 2019-03-20
US201962839765P 2019-04-28 2019-04-28
US62/839,765 2019-04-28
PCT/CN2020/080412 WO2020187316A1 (en) 2019-03-20 2020-03-20 Method and apparatus for prediction refinement with optical flow for an affine coded block
CN202080023321.7A CN113615173A (zh) 2019-03-20 2020-03-20 对仿射译码块进行光流预测修正的方法及装置

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN202080023321.7A Division CN113615173A (zh) 2019-03-20 2020-03-20 对仿射译码块进行光流预测修正的方法及装置

Publications (2)

Publication Number Publication Date
CN118945317A CN118945317A (zh) 2024-11-12
CN118945317B true CN118945317B (zh) 2025-08-26

Family

ID=72519643

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202410918815.1A Active CN118945317B (zh) 2019-03-20 2020-03-20 对仿射译码块进行光流预测修正的方法及装置
CN202080023321.7A Pending CN113615173A (zh) 2019-03-20 2020-03-20 对仿射译码块进行光流预测修正的方法及装置

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202080023321.7A Pending CN113615173A (zh) 2019-03-20 2020-03-20 对仿射译码块进行光流预测修正的方法及装置

Country Status (11)

Country Link
US (3) US12003733B2 (enExample)
EP (2) EP3932054B1 (enExample)
JP (3) JP7590337B2 (enExample)
KR (2) KR20250153324A (enExample)
CN (2) CN118945317B (enExample)
BR (1) BR112021018644A2 (enExample)
ES (1) ES2992659T3 (enExample)
HU (1) HUE066834T2 (enExample)
MX (1) MX2021011370A (enExample)
PL (1) PL3932054T3 (enExample)
WO (1) WO2020187316A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111418206B (zh) * 2018-10-05 2023-12-01 Lg电子株式会社 使用mpm列表的基于帧内预测的视频编码方法及其装置
US11272203B2 (en) * 2019-07-23 2022-03-08 Tencent America LLC Method and apparatus for video coding
CN120128700B (zh) * 2019-09-12 2026-05-26 阿里巴巴创新公司 计算机实现的编解码方法、解码装置及计算机可读存储介质
CN116233466B (zh) * 2019-09-17 2025-08-19 北京达佳互联信息技术有限公司 光流预测细化(prof)的方法和装置
CN112135126B (zh) * 2019-11-05 2021-09-21 杭州海康威视数字技术股份有限公司 一种编解码方法、装置、设备及机器可读存储介质
WO2022257954A1 (en) * 2021-06-10 2022-12-15 Beijing Bytedance Network Technology Co., Ltd. Method, device, and medium for video processing
WO2023078449A1 (en) * 2021-11-08 2023-05-11 Beijing Bytedance Network Technology Co., Ltd. Method, apparatus, and medium for video processing
CN113793259B (zh) * 2021-11-15 2022-02-15 深圳思谋信息科技有限公司 图像变焦方法、计算机设备和存储介质
WO2024149035A1 (en) * 2023-01-13 2024-07-18 Mediatek Inc. Methods and apparatus of affine motion compensation for block boundaries and motion refinement in video coding
US20240380913A1 (en) * 2023-05-09 2024-11-14 Microsoft Technology Licensing, Llc Motion compensation via inertial tracking and optical flow
US12489891B2 (en) * 2023-06-16 2025-12-02 Zoom Communications, Inc. Reducing grid artifacts in video frames
US12627829B2 (en) * 2023-12-18 2026-05-12 Tencent America LLC Systems and methods for optical flow-based motion vector refinement
US20250267274A1 (en) * 2024-02-20 2025-08-21 Tencent America LLC Uni-directional optical flow

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104717501A (zh) * 2012-09-28 2015-06-17 英特尔公司 层间像素样本预测
US10595017B2 (en) * 2015-10-22 2020-03-17 Lg Electronics Inc. Modeling-based image decoding method and device in image coding system
CN105847804B (zh) * 2016-05-18 2017-12-15 信阳师范学院 一种基于稀疏冗余表示模型的视频帧率上转换方法
EP3556096B1 (en) * 2016-12-22 2024-05-22 HFI Innovation Inc. Method and apparatus of motion refinement for video coding
US10904565B2 (en) * 2017-06-23 2021-01-26 Qualcomm Incorporated Memory-bandwidth-efficient design for bi-directional optical flow (BIO)
BR112020000032A2 (pt) * 2017-07-03 2020-07-14 Vid Scale, Inc. dispositivo e método de codificação de dados de vídeo.
CN120730076A (zh) 2019-02-07 2025-09-30 交互数字Vc控股公司 用于利用光流的帧间预测细化的系统、装置和方法
PL4459986T3 (pl) * 2019-02-24 2026-06-15 Lg Electronics Inc. Urządzenie do predykcji międzyramkowej na podstawie dmvr
JP6867611B2 (ja) * 2019-03-11 2021-04-28 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
KR102659481B1 (ko) 2019-03-17 2024-04-23 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 광학 흐름에 기초한 예측 정제의 계산
US11343525B2 (en) 2019-03-19 2022-05-24 Tencent America LLC Method and apparatus for video coding by constraining sub-block motion vectors and determining adjustment values based on constrained sub-block motion vectors

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CE2-related: Prediction refinement with optical flow for affine mode;Jiancong (Daniel) Luo等;JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11;20190315;1-7 *
Non-CE9 : Mismatch between text specification and reference software on BDOF and DMVR;Naeri Park等;JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11;20190313;1-4 *

Also Published As

Publication number Publication date
CN113615173A (zh) 2021-11-05
KR20210134400A (ko) 2021-11-09
EP4344205A3 (en) 2024-05-22
US20240364895A1 (en) 2024-10-31
BR112021018644A2 (pt) 2021-11-23
PL3932054T3 (pl) 2024-07-29
HUE066834T2 (hu) 2024-09-28
JP2025184871A (ja) 2025-12-18
ES2992659T3 (en) 2024-12-16
US20220078442A1 (en) 2022-03-10
JP2022527701A (ja) 2022-06-03
EP3932054A4 (en) 2022-07-13
EP3932054A1 (en) 2022-01-05
JP7871480B2 (ja) 2026-06-08
KR20250153324A (ko) 2025-10-24
US20250254323A1 (en) 2025-08-07
KR102873144B1 (ko) 2025-10-16
EP3932054B1 (en) 2024-04-24
EP4344205A2 (en) 2024-03-27
JP2024019406A (ja) 2024-02-09
MX2021011370A (es) 2021-11-12
JP7736764B2 (ja) 2025-09-09
US12003733B2 (en) 2024-06-04
US12273532B2 (en) 2025-04-08
CN118945317A (zh) 2024-11-12
JP7590337B2 (ja) 2024-11-26
WO2020187316A1 (en) 2020-09-24

Similar Documents

Publication Publication Date Title
CN112823518B (zh) 用于译码块的几何划分块的帧间预测的装置及方法
KR102712842B1 (ko) 인코더, 디코더 및 해당 방법
JP7736764B2 (ja) アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置
US12363284B2 (en) Encoder, a decoder and corresponding methods for merge mode
CN119766999B (zh) 用于视频信号帧中的块的解码方法、解码器、计算机程序产品和可读存储介质
JP7528286B2 (ja) オプティカルフローベースのビデオフレーム間予測
CN114450958B (zh) 用于减小增强插值滤波器的内存带宽的仿射运动模型限制
CN113597761A (zh) 帧内预测方法和装置
CN114930840B (zh) 增强型插值滤波器的运动矢量范围的推导
CN113508592A (zh) 编码器、解码器及相应的帧间预测方法
CA3112373C (en) An encoder, a decoder and corresponding methods for merge mode

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant