JP7590337B2 - アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置 - Google Patents

アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置 Download PDF

Info

Publication number
JP7590337B2
JP7590337B2 JP2021556816A JP2021556816A JP7590337B2 JP 7590337 B2 JP7590337 B2 JP 7590337B2 JP 2021556816 A JP2021556816 A JP 2021556816A JP 2021556816 A JP2021556816 A JP 2021556816A JP 7590337 B2 JP7590337 B2 JP 7590337B2
Authority
JP
Japan
Prior art keywords
block
prediction
current
affine
sample
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021556816A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022527701A (ja
Inventor
フアンバン・チェン
ハイタオ・ヤン
ジエンレ・チェン
Original Assignee
ホアウェイ・テクノロジーズ・カンパニー・リミテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ホアウェイ・テクノロジーズ・カンパニー・リミテッド filed Critical ホアウェイ・テクノロジーズ・カンパニー・リミテッド
Publication of JP2022527701A publication Critical patent/JP2022527701A/ja
Priority to JP2023199242A priority Critical patent/JP7736764B2/ja
Application granted granted Critical
Publication of JP7590337B2 publication Critical patent/JP7590337B2/ja
Priority to JP2025141524A priority patent/JP2025184871A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/527—Global motion vector estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/521—Processing of motion vectors for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/55—Motion estimation with spatial constraints, e.g. at image or region borders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
JP2021556816A 2019-03-20 2020-03-20 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置 Active JP7590337B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023199242A JP7736764B2 (ja) 2019-03-20 2023-11-24 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置
JP2025141524A JP2025184871A (ja) 2019-03-20 2025-08-27 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962821440P 2019-03-20 2019-03-20
US62/821,440 2019-03-20
US201962839765P 2019-04-28 2019-04-28
US62/839,765 2019-04-28
PCT/CN2020/080412 WO2020187316A1 (en) 2019-03-20 2020-03-20 Method and apparatus for prediction refinement with optical flow for an affine coded block

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023199242A Division JP7736764B2 (ja) 2019-03-20 2023-11-24 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置

Publications (2)

Publication Number Publication Date
JP2022527701A JP2022527701A (ja) 2022-06-03
JP7590337B2 true JP7590337B2 (ja) 2024-11-26

Family

ID=72519643

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2021556816A Active JP7590337B2 (ja) 2019-03-20 2020-03-20 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置
JP2023199242A Active JP7736764B2 (ja) 2019-03-20 2023-11-24 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置
JP2025141524A Pending JP2025184871A (ja) 2019-03-20 2025-08-27 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2023199242A Active JP7736764B2 (ja) 2019-03-20 2023-11-24 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置
JP2025141524A Pending JP2025184871A (ja) 2019-03-20 2025-08-27 アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置

Country Status (11)

Country Link
US (3) US12003733B2 (https=)
EP (2) EP3932054B1 (https=)
JP (3) JP7590337B2 (https=)
KR (2) KR102873144B1 (https=)
CN (2) CN113615173A (https=)
BR (1) BR112021018644A2 (https=)
ES (1) ES2992659T3 (https=)
HU (1) HUE066834T2 (https=)
MX (1) MX2021011370A (https=)
PL (1) PL3932054T3 (https=)
WO (1) WO2020187316A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102822624B1 (ko) * 2018-10-05 2025-06-18 엘지전자 주식회사 Mpm 리스트를 사용하는 인트라 예측 기반 영상 코딩 방법 및 그 장치
US11272203B2 (en) * 2019-07-23 2022-03-08 Tencent America LLC Method and apparatus for video coding
CN120128701B (zh) * 2019-09-12 2026-02-17 阿里巴巴（中国）有限公司 计算机实现的编解码方法及非暂时性计算机可读存储介质
KR102502614B1 (ko) * 2019-09-17 2023-02-23 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 광학 흐름을 사용한 예측 미세조정을 위한 방법 및 장치
CN112770113B (zh) * 2019-11-05 2024-08-23 杭州海康威视数字技术股份有限公司 一种编解码方法、装置及其设备
WO2022257954A1 (en) * 2021-06-10 2022-12-15 Beijing Bytedance Network Technology Co., Ltd. Method, device, and medium for video processing
CN113793259B (zh) * 2021-11-15 2022-02-15 深圳思谋信息科技有限公司 图像变焦方法、计算机设备和存储介质
WO2024149035A1 (en) * 2023-01-13 2024-07-18 Mediatek Inc. Methods and apparatus of affine motion compensation for block boundaries and motion refinement in video coding
US20240380913A1 (en) * 2023-05-09 2024-11-14 Microsoft Technology Licensing, Llc Motion compensation via inertial tracking and optical flow
US12489891B2 (en) * 2023-06-16 2025-12-02 Zoom Communications, Inc. Reducing grid artifacts in video frames
US20250267274A1 (en) * 2024-02-20 2025-08-21 Tencent America LLC Uni-directional optical flow

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104717501A (zh) * 2012-09-28 2015-06-17 英特尔公司 层间像素样本预测
KR20180058224A (ko) * 2015-10-22 2018-05-31 엘지전자 주식회사 영상 코딩 시스템에서 모델링 기반 영상 디코딩 방법 및 장치
CN105847804B (zh) * 2016-05-18 2017-12-15 信阳师范学院 一种基于稀疏冗余表示模型的视频帧率上转换方法
WO2018113658A1 (en) * 2016-12-22 2018-06-28 Mediatek Inc. Method and apparatus of motion refinement for video coding
US10904565B2 (en) * 2017-06-23 2021-01-26 Qualcomm Incorporated Memory-bandwidth-efficient design for bi-directional optical flow (BIO)
EP3649780B1 (en) * 2017-07-03 2025-06-25 InterDigital VC Holdings, Inc. Motion-compensation prediction based on bi-directional optical flow
IL285212B2 (en) 2019-02-07 2024-06-01 Vid Scale Inc Systems, means and methods for refining Internet prediction with optical flow
KR102783514B1 (ko) * 2019-02-24 2025-03-19 엘지전자 주식회사 Dmvr 기반의 인터 예측 방법 및 장치
JP6867611B2 (ja) * 2019-03-11 2021-04-28 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
JP7669278B2 (ja) 2019-03-17 2025-04-28 北京字節跳動網絡技術有限公司 オプティカルフローベースの予測精緻化の計算
US11343525B2 (en) 2019-03-19 2022-05-24 Tencent America LLC Method and apparatus for video coding by constraining sub-block motion vectors and determining adjustment values based on constrained sub-block motion vectors

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Ｊｉａｎｃｏｎｇ（Ｄａｎｉｅｌ）Ｌｕｏ ｅｔ ａｌ．、"ＣＥ２－ｒｅｌａｔｅｄ：Ｐｒｅｄｉｃｔｉｏｎ ｒｅｆｉｎｅｍｅｎｔ ｗｉｔｈ ｏｐｔｉｃａｌ ｆｌｏｗ ｆｏｒ ａｆｆｉｎｅ ｍｏｄｅ"、Ｊｏｉｎｔ Ｖｉｄｅｏ Ｅｘｐｅｒｔｓ Ｔｅａｍ（ＪＶＥＴ）、２０１９．０３．１９［ＪＶＥＴ－Ｎ０２３６－ｒ２］（ｖｅｒｓｉｏｎ ３）

Also Published As

Publication number Publication date
KR20210134400A (ko) 2021-11-09
US12003733B2 (en) 2024-06-04
EP4344205A2 (en) 2024-03-27
EP3932054A1 (en) 2022-01-05
HUE066834T2 (hu) 2024-09-28
EP3932054A4 (en) 2022-07-13
JP2025184871A (ja) 2025-12-18
US20240364895A1 (en) 2024-10-31
MX2021011370A (es) 2021-11-12
EP3932054B1 (en) 2024-04-24
WO2020187316A1 (en) 2020-09-24
KR20250153324A (ko) 2025-10-24
JP2024019406A (ja) 2024-02-09
US20250254323A1 (en) 2025-08-07
KR102873144B1 (ko) 2025-10-16
CN118945317A (zh) 2024-11-12
EP4344205A3 (en) 2024-05-22
ES2992659T3 (en) 2024-12-16
PL3932054T3 (pl) 2024-07-29
US12273532B2 (en) 2025-04-08
CN118945317B (zh) 2025-08-26
US20220078442A1 (en) 2022-03-10
CN113615173A (zh) 2021-11-05
JP7736764B2 (ja) 2025-09-09
JP2022527701A (ja) 2022-06-03
BR112021018644A2 (pt) 2021-11-23

Similar Documents

Publication Publication Date Title
JP7736764B2 (ja) アフィンコーディングされたブロックに対するオプティカルフローを用いた予測洗練化のための方法および装置
JP7471328B2 (ja) エンコーダ、デコーダ、および対応する方法
JP7823167B2 (ja) クロマサブブロックのアフィンベースのインター予測のための方法及び装置
JP7469475B2 (ja) 交差成分線形モデル予測のためのフィルタリングの方法及び装置
US12363284B2 (en) Encoder, a decoder and corresponding methods for merge mode
US20220078484A1 (en) Method and apparatus of cross-component prediction
JP7708823B2 (ja) 現在のブロックについての補間フィルタインデックスを導出するための方法および装置
JP7303894B2 (ja) エンコーダ、デコーダ、及び対応するインター予測方法
JP7528286B2 (ja) オプティカルフローベースのビデオフレーム間予測
CN113597761A (zh) 帧内预测方法和装置
US11997296B2 (en) Motion field storage optimization for a line buffer

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211119

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211119

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20221227

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230116

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230417

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20230724

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20241114

R150 Certificate of patent or registration of utility model

Ref document number: 7590337

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150