JP7691936B2 - ビデオコーディングのための勾配ベースの予測改良 - Google Patents

ビデオコーディングのための勾配ベースの予測改良 Download PDF

Info

Publication number
JP7691936B2
JP7691936B2 JP2021566995A JP2021566995A JP7691936B2 JP 7691936 B2 JP7691936 B2 JP 7691936B2 JP 2021566995 A JP2021566995 A JP 2021566995A JP 2021566995 A JP2021566995 A JP 2021566995A JP 7691936 B2 JP7691936 B2 JP 7691936B2
Authority
JP
Japan
Prior art keywords
block
samples
prediction
horizontal
gradient
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021566995A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022533061A (ja
JPWO2020236568A5 (https=
JP2022533061A5 (https=
Inventor
ファン、ハン
チェン、ウェイ－ジュン
カルチェビチ、マルタ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2022533061A publication Critical patent/JP2022533061A/ja
Publication of JPWO2020236568A5 publication Critical patent/JPWO2020236568A5/ja
Publication of JP2022533061A5 publication Critical patent/JP2022533061A5/ja
Priority to JP2025019182A priority Critical patent/JP2025087703A/ja
Application granted granted Critical
Publication of JP7691936B2 publication Critical patent/JP7691936B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/527—Global motion vector estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
JP2021566995A 2019-05-17 2020-05-15 ビデオコーディングのための勾配ベースの予測改良 Active JP7691936B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025019182A JP2025087703A (ja) 2019-05-17 2025-02-07 ビデオコーディングのための勾配ベースの予測改良

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962849352P 2019-05-17 2019-05-17
US62/849,352 2019-05-17
US16/874,057 2020-05-14
US16/874,057 US11317088B2 (en) 2019-05-17 2020-05-14 Gradient-based prediction refinement for video coding
PCT/US2020/033091 WO2020236568A1 (en) 2019-05-17 2020-05-15 Gradient-based prediction refinement for video coding

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025019182A Division JP2025087703A (ja) 2019-05-17 2025-02-07 ビデオコーディングのための勾配ベースの予測改良

Publications (4)

Publication Number Publication Date
JP2022533061A JP2022533061A (ja) 2022-07-21
JPWO2020236568A5 JPWO2020236568A5 (https=) 2023-04-28
JP2022533061A5 JP2022533061A5 (https=) 2023-04-28
JP7691936B2 true JP7691936B2 (ja) 2025-06-12

Family

ID=73230856

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021566995A Active JP7691936B2 (ja) 2019-05-17 2020-05-15 ビデオコーディングのための勾配ベースの予測改良
JP2025019182A Pending JP2025087703A (ja) 2019-05-17 2025-02-07 ビデオコーディングのための勾配ベースの予測改良

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025019182A Pending JP2025087703A (ja) 2019-05-17 2025-02-07 ビデオコーディングのための勾配ベースの予測改良

Country Status (13)

Country Link
US (1) US11317088B2 (https=)
EP (1) EP3970370A1 (https=)
JP (2) JP7691936B2 (https=)
KR (1) KR20220009384A (https=)
CN (1) CN113950839B (https=)
BR (1) BR112021022331A2 (https=)
CA (1) CA3137462A1 (https=)
CO (1) CO2021015352A2 (https=)
IL (1) IL287257B2 (https=)
MX (1) MX2021014018A (https=)
SG (1) SG11202111550WA (https=)
TW (1) TWI904088B (https=)
WO (1) WO2020236568A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10609423B2 (en) * 2016-09-07 2020-03-31 Qualcomm Incorporated Tree-type coding for video coding
US11962796B2 (en) 2019-04-01 2024-04-16 Qualcomm Incorporated Gradient-based prediction refinement for video coding
JP2021048514A (ja) * 2019-09-19 2021-03-25 シャープ株式会社 動画像符号化装置、動画像復号装置、予測画像生成方法
WO2021054886A1 (en) * 2019-09-20 2021-03-25 Telefonaktiebolaget Lm Ericsson (Publ) Methods of video encoding and/or decoding with bidirectional optical flow simplification on shift operations and related apparatus
US20220337865A1 (en) * 2019-09-23 2022-10-20 Sony Group Corporation Image processing device and image processing method
WO2022197137A1 (ko) * 2021-03-19 2022-09-22 현대자동차주식회사 성분별 적응적 공간해상도를 갖는 움직임벡터를 이용하는 비디오 코딩방법 및 장치
JP2024511887A (ja) * 2021-04-02 2024-03-15 ヒョンダイ モーター カンパニー 適応的イントラ予測精度を用いるビデオコーディング方法及び装置
CN114079792A (zh) * 2021-07-22 2022-02-22 珠海市杰理科技股份有限公司 视频编码参考块的压缩方法、编码方法和装置
KR20250093492A (ko) * 2022-10-21 2025-06-24 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스 낮은 복잡성 모션 정제
CN121844566A (zh) * 2023-09-13 2026-04-10 三星电子株式会社 用于通过使用帧内预测对图像进行编码和解码的设备和方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017535163A (ja) 2014-10-07 2017-11-24 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ イントラｂｃとインターの統合
WO2020058890A1 (en) 2018-09-19 2020-03-26 Beijing Bytedance Network Technology Co., Ltd. Syntax reuse for affine mode with adaptive motion vector resolution

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9325991B2 (en) * 2012-04-11 2016-04-26 Qualcomm Incorporated Motion vector rounding
US10015515B2 (en) * 2013-06-21 2018-07-03 Qualcomm Incorporated Intra prediction from a predictive block
CN107925775A (zh) * 2015-09-02 2018-04-17 联发科技股份有限公司 基于双向预测光流技术的视频编解码的运动补偿方法及装置
JP2018533871A (ja) * 2015-11-11 2018-11-15 サムスン エレクトロニクス カンパニー リミテッド ビデオ復号方法及びその装置、並びにビデオ符号化方法及びその装置
EP3413563B1 (en) * 2016-02-03 2026-02-18 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Moving image decoding device, moving image encoding device, and prediction image generation device
US10694204B2 (en) * 2016-05-06 2020-06-23 Vid Scale, Inc. Systems and methods for motion compensated residual prediction
US10560712B2 (en) * 2016-05-16 2020-02-11 Qualcomm Incorporated Affine motion prediction for video coding
GB2574733B (en) * 2016-12-28 2020-05-06 Arris Entpr Llc Improved video bitstream coding
WO2018125972A1 (en) * 2016-12-28 2018-07-05 Arris Enterprises Llc Adaptive unequal weight planar prediction
JP7036628B2 (ja) * 2017-03-10 2022-03-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法及び復号方法
US10477237B2 (en) * 2017-06-28 2019-11-12 Futurewei Technologies, Inc. Decoder side motion vector refinement in video coding
JP7168593B2 (ja) * 2017-07-03 2022-11-09 ヴィド スケール インコーポレイテッド 双方向オプティカルフローに基づいた動き補償予測
EP3643065A1 (en) * 2017-07-24 2020-04-29 ARRIS Enterprises LLC Intra mode jvet coding
JP2021520710A (ja) * 2018-04-06 2021-08-19 ヴィド スケール インコーポレイテッド 簡易化された勾配導出による双方向オプティカルフロー方法
US10986343B2 (en) * 2018-04-15 2021-04-20 Arris Enterprises Llc Reducing overhead for multiple-hypothesis temporal prediction
US11962796B2 (en) * 2019-04-01 2024-04-16 Qualcomm Incorporated Gradient-based prediction refinement for video coding
KR20250143124A (ko) * 2019-04-25 2025-09-30 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 광학 흐름에 의한 예측 미세화 방법 및 장치

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017535163A (ja) 2014-10-07 2017-11-24 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ イントラｂｃとインターの統合
WO2020058890A1 (en) 2018-09-19 2020-03-26 Beijing Bytedance Network Technology Co., Ltd. Syntax reuse for affine mode with adaptive motion vector resolution
JP2022500909A (ja) 2018-09-19 2022-01-04 北京字節跳動網絡技術有限公司Beijing Bytedance Network Technology Co., Ltd. 適応動きベクトル解像度によるアフィンモードへの構文の使用

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Benjamin Bross et al.，Versatile Video Coding (Draft 4) [online]，JVET-M1001-v7（JVET-M1001-v7.docx）, [2024年3月18日検索]，インターネット ＜URL: https://jvet-experts.org/doc_end_user/documents/13_Marrakech/wg11/JVET-M1001-v7.zip＞，2019年03月17日，pp.165-186,197-199
Chen-Yen Lai et al.，CE4-related: Alignment of displacement bitdepths for BDOF and PROF [online]，JVET-O0281-v2（JVET-O0281-v2.docx）, [2024年3月18日検索]，インターネット ＜URL: https://jvet-experts.org/doc_end_user/documents/15_Gothenburg/wg11/JVET-O0281-v2.zip＞，2019年07月03日
Han Huang et al.，CE4-related: Simplification of PROF and BDOF [online]，JVET-P0091（JVET-P0091.docx）, [2024年3月18日検索]，インターネット ＜URL: https://jvet-experts.org/doc_end_user/documents/16_Geneva/wg11/JVET-P0091-v1.zip＞，2019年09月23日
JIANCONG LUO; ET AL，CE2-RELATED: PREDICTION REFINEMENT WITH OPTICAL FLOW FOR AFFINE MODE，JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, DOCUMENT: JVET-N0236，2019年03月13日，NR:JVET-N0236，PAGE(S):1-7，https://jvet-experts.org/doc_end_user/documents/14_Geneva/wg11/JVET-N0236-v7.zip，JVET-N0236-R5.DOCX
XIAOYU XIU; ET AL，CE4-RELATED: HARMONIZATION OF BDOF AND PROF，JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, DOCUMENT: JVET-O0593-R2，2019年07月07日，NR:JVET-O0593，PAGE(S):1-6，https://jvet-experts.org/doc_end_user/documents/15_Gothenburg/wg11/JVET-O0593-v4.zip，JVET-O0593-R2.DOCX

Also Published As

Publication number Publication date
JP2025087703A (ja) 2025-06-10
US11317088B2 (en) 2022-04-26
EP3970370A1 (en) 2022-03-23
CN113950839B (zh) 2025-06-13
IL287257B1 (en) 2024-04-01
CA3137462A1 (en) 2020-11-26
KR20220009384A (ko) 2022-01-24
JP2022533061A (ja) 2022-07-21
CN113950839A (zh) 2022-01-18
CO2021015352A2 (es) 2021-11-19
US20200366889A1 (en) 2020-11-19
TW202101996A (zh) 2021-01-01
BR112021022331A2 (pt) 2021-12-28
SG11202111550WA (en) 2021-12-30
MX2021014018A (es) 2021-12-10
WO2020236568A1 (en) 2020-11-26
IL287257B2 (en) 2024-08-01
TWI904088B (zh) 2025-11-11
IL287257A (en) 2021-12-01

Similar Documents

Publication Publication Date Title
JP7691936B2 (ja) ビデオコーディングのための勾配ベースの予測改良
CN113812148B (zh) 用于视频译码的参考图片重采样和帧间译码工具
JP7504925B2 (ja) ビデオコーディングのための組み合わされたインターおよびイントラ予測モード
JP7463399B2 (ja) ビデオコーディングのための勾配ベースの予測改良
CN112673636B (zh) 将运动向量取整以自适应运动向量差分辨率及提高视频译码中的运动向量存储精度
US20190313115A1 (en) Decoder-side motion vector derivation for video coding
CN113892264B (zh) 使用非矩形预测模式来减少用于视频数据预测的运动场存储
CN114080802A (zh) 用于视频译码中的变换跳过模式和调色板模式的最小允许量化参数
CN113940078B (zh) 用于视频编解码中的双向光流计算的简化的方法和设备
JP7823046B2 (ja) ビデオコーディングにおける双方向オプティカルフロー
RU2817298C2 (ru) Уточнение предсказания на основе градиента для кодирования видео
HK40063011A (en) Gradient-based prediction refinement for video coding
HK40062582A (en) Gradient-based prediction refinement for video coding
CN121368891A (zh) 视频译码中的色度bdof和自适应多通道dmvr
CN116601952A (zh) 视频译码的多假设预测
HK40065522A (en) Combined inter and intra prediction mode for video coding
HK40046177A (en) Rounding of motion vectors for adaptive motion vector difference resolution and increased motion vector storage precision in video coding

Legal Events

Date Code Title Description
RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20230104

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230420

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230420

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240402

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240702

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20241015

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250207

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250602

R150 Certificate of patent or registration of utility model

Ref document number: 7691936

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150