JP7823047B2 - ビデオコーディングにおけるテンプレートマッチング - Google Patents

ビデオコーディングにおけるテンプレートマッチング

Info

Publication number
JP7823047B2
JP7823047B2 JP2023532810A JP2023532810A JP7823047B2 JP 7823047 B2 JP7823047 B2 JP 7823047B2 JP 2023532810 A JP2023532810 A JP 2023532810A JP 2023532810 A JP2023532810 A JP 2023532810A JP 7823047 B2 JP7823047 B2 JP 7823047B2
Authority
JP
Japan
Prior art keywords
step size
motion vector
block
reference block
initial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2023532810A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022146833A5 (https=
JP2024501137A5 (https=
JP2024501137A (ja
Inventor
チュン-チ・チェン
ハン・フアン
ジ・ジャン
ヴァディム・セレジン
マルタ・カルチェヴィッチ
Original Assignee
クアルコム,インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/558,119 external-priority patent/US11758151B2/en
Application filed by クアルコム,インコーポレイテッド filed Critical クアルコム,インコーポレイテッド
Publication of JP2024501137A publication Critical patent/JP2024501137A/ja
Publication of JPWO2022146833A5 publication Critical patent/JPWO2022146833A5/ja
Publication of JP2024501137A5 publication Critical patent/JP2024501137A5/ja
Application granted granted Critical
Publication of JP7823047B2 publication Critical patent/JP7823047B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/521Processing of motion vectors for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/192Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/523Motion estimation or motion compensation with sub-pixel accuracy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/53Multi-resolution motion estimation; Hierarchical motion estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/57Motion estimation characterised by a search window with variable size or shape
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Picture Signal Circuits (AREA)
JP2023532810A 2020-12-29 2021-12-22 ビデオコーディングにおけるテンプレートマッチング Active JP7823047B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202063131676P 2020-12-29 2020-12-29
US63/131,676 2020-12-29
US17/558,119 US11758151B2 (en) 2020-12-29 2021-12-21 Template matching in video coding
US17/558,119 2021-12-21
PCT/US2021/064908 WO2022146833A1 (en) 2020-12-29 2021-12-22 Template matching in video coding

Publications (4)

Publication Number Publication Date
JP2024501137A JP2024501137A (ja) 2024-01-11
JPWO2022146833A5 JPWO2022146833A5 (https=) 2024-12-16
JP2024501137A5 JP2024501137A5 (https=) 2024-12-16
JP7823047B2 true JP7823047B2 (ja) 2026-03-03

Family

ID=79927080

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023532810A Active JP7823047B2 (ja) 2020-12-29 2021-12-22 ビデオコーディングにおけるテンプレートマッチング

Country Status (10)

Country Link
US (1) US12375688B2 (https=)
EP (1) EP4272436A1 (https=)
JP (1) JP7823047B2 (https=)
KR (1) KR20230125784A (https=)
AU (1) AU2021416082A1 (https=)
BR (1) BR112023012151A2 (https=)
CA (1) CA3198100A1 (https=)
CL (1) CL2023001900A1 (https=)
MX (1) MX2023007564A (https=)
WO (1) WO2022146833A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12167019B2 (en) * 2022-07-21 2024-12-10 Tencent America LLC Temporal motion vector predictor with displacement
US12418670B2 (en) * 2022-10-14 2025-09-16 Tencent America LLC Template-matching based merge index reordering for geometric partition mode (GPM)
WO2024182669A1 (en) * 2023-03-02 2024-09-06 Ofinno, Llc Template-based weight derivation for block prediction
WO2025075451A1 (ko) * 2023-10-05 2025-04-10 한국전자통신연구원 아틀라스 영상의 템플릿 매칭 예측 기술의 검색 장치 및 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011090783A1 (en) 2010-01-19 2011-07-28 Thomson Licensing Methods and apparatus for reduced complexity template matching prediction for video encoding and decoding
WO2015106126A1 (en) 2014-01-09 2015-07-16 Qualcomm Incorporated Adaptive motion vector resolution signaling for video coding
US20170134726A1 (en) 2014-03-31 2017-05-11 Intellectual Discovery Co., Ltd. Template-matching-based method and apparatus for encoding and decoding intra picture
WO2017134957A1 (ja) 2016-02-03 2017-08-10 シャープ株式会社 動画像復号装置、動画像符号化装置、および予測画像生成装置
WO2018067672A1 (en) 2016-10-04 2018-04-12 Qualcomm Incorporated Adaptive motion vector precision for video coding
US20210195227A1 (en) 2018-03-30 2021-06-24 Electronics And Telecommunications Research Institute Image encoding/decoding method and device, and recording medium in which bitstream is stored

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331703B (zh) 2015-07-03 2020-09-08 华为技术有限公司 视频编码和解码方法、视频编码和解码装置
US10511835B2 (en) 2015-09-02 2019-12-17 Mediatek Inc. Method and apparatus of decoder side motion derivation for video coding
US10390038B2 (en) * 2016-02-17 2019-08-20 Telefonaktiebolaget Lm Ericsson (Publ) Methods and devices for encoding and decoding video pictures using a denoised reference picture
US20190082192A1 (en) * 2016-03-16 2019-03-14 Mediatek Inc. Method and apparatus of pattern-based motion vector derivation for video coding
US20190007699A1 (en) 2017-06-28 2019-01-03 Futurewei Technologies, Inc. Decoder Side Motion Vector Derivation in Video Coding
EP3451664A1 (en) 2017-09-01 2019-03-06 Thomson Licensing Motion compensation at a finer precision than motion vector differential
WO2019188942A1 (en) 2018-03-30 2019-10-03 Sharp Kabushiki Kaisha Systems and methods for performing motion compensated prediction for video coding
TWI719519B (zh) 2018-07-02 2021-02-21 大陸商北京字節跳動網絡技術有限公司 對於dmvr的塊尺寸限制
WO2020047132A1 (en) 2018-08-29 2020-03-05 Vid Scale, Inc. Adaptive motion vector precision for affine motion model based video coding
TWI815974B (zh) 2018-09-23 2023-09-21 大陸商北京字節跳動網絡技術有限公司 具有自適應運動矢量分辨率的運動矢量的修改
CN115314708B (zh) * 2019-05-15 2023-05-12 华为技术有限公司 视频码流的解码方法及对应的设备及介质
CN111050182B (zh) 2019-12-27 2022-02-18 浙江大华技术股份有限公司 运动矢量的预测方法、视频编码方法及相关设备、装置
US11758151B2 (en) 2020-12-29 2023-09-12 Qualcomm Incorporated Template matching in video coding

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011090783A1 (en) 2010-01-19 2011-07-28 Thomson Licensing Methods and apparatus for reduced complexity template matching prediction for video encoding and decoding
WO2015106126A1 (en) 2014-01-09 2015-07-16 Qualcomm Incorporated Adaptive motion vector resolution signaling for video coding
US20170134726A1 (en) 2014-03-31 2017-05-11 Intellectual Discovery Co., Ltd. Template-matching-based method and apparatus for encoding and decoding intra picture
WO2017134957A1 (ja) 2016-02-03 2017-08-10 シャープ株式会社 動画像復号装置、動画像符号化装置、および予測画像生成装置
WO2018067672A1 (en) 2016-10-04 2018-04-12 Qualcomm Incorporated Adaptive motion vector precision for video coding
US20210195227A1 (en) 2018-03-30 2021-06-24 Electronics And Telecommunications Research Institute Image encoding/decoding method and device, and recording medium in which bitstream is stored

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Huanbang Chen, et al.,Description of SDR, HDR and 360° video coding technology proposal by Huawei, GoPro, HiSilicon, and Samsung,buJoint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,JVET-J0025_v2,10th Meeting: San Diego, US,2018年04月,p.73
Semih Esenlik, et al.,Description of Core Experiment 9 (CE9): Decoder Side Motion Vector Derivation,Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,JVET-J1029_r4,10th Meeting: San Diego, US,2018年05月,p.15

Also Published As

Publication number Publication date
US20230362391A1 (en) 2023-11-09
KR20230125784A (ko) 2023-08-29
EP4272436A1 (en) 2023-11-08
TW202232956A (zh) 2022-08-16
AU2021416082A1 (en) 2023-05-18
WO2022146833A1 (en) 2022-07-07
CL2023001900A1 (es) 2024-01-05
MX2023007564A (es) 2023-07-11
JP2024501137A (ja) 2024-01-11
AU2021416082A9 (en) 2024-09-05
CA3198100A1 (en) 2022-07-07
US12375688B2 (en) 2025-07-29
BR112023012151A2 (pt) 2023-11-28

Similar Documents

Publication Publication Date Title
US11758151B2 (en) Template matching in video coding
CN113424542B (zh) 用于视频编解码中带有运动矢量差的合并模式的信令
US11936877B2 (en) Template matching based affine prediction for video coding
CN111869217B (zh) 简化的局部照度补偿
KR20230169958A (ko) 인터-예측 모드들에서의 템플릿 매칭 정세화
CN113508594A (zh) 视频编解码中三角形合并模式索引的信令
KR20210093926A (ko) 비디오 코딩을 위한 삼각형 모션 정보
CN113812153A (zh) 用于视频译码的可切换插值滤波(sif)
CN117529921A (zh) 视频译码中的混合帧间双预测
CN114128261A (zh) 用于视频译码的组合的帧间和帧内预测模式
JP7823047B2 (ja) ビデオコーディングにおけるテンプレートマッチング
US20250080769A1 (en) Model-based motion vector difference derivation and template matching prediction for video coding
US20220248047A1 (en) Model-based motion vector difference derivation and template matching prediction for video coding
CN113892264A (zh) 使用非矩形预测模式来减少用于视频数据预测的运动场存储
CN118355662A (zh) 视频译码中在参考图片重采样与基于模板的帧间预测技术之间的交互
WO2022221140A1 (en) Template matching based affine prediction for video coding
CN117981313A (zh) 具有用于视频译码的解码器侧运动向量推导的多个帧间预测符
CN114073079A (zh) 带有运动信息采集缓冲器的运动矢量预测
JP7832938B2 (ja) マルチパスデコーダ側動きベクトル改良
CN116636213A (zh) 视频译码中的模板匹配
JP7823046B2 (ja) ビデオコーディングにおける双方向オプティカルフロー
WO2025006760A1 (en) Bi-direction optical flow subblock refinement for an affine modeled block
CN116803081A (zh) 用于视频编解码的基于模型的运动矢量差导出和模板匹配预测
KR20260026486A (ko) 비디오 데이터를 코딩하기 위한 인트라 블록 카피 예측을 위한 블록 벡터 탐색
CN120883603A (zh) 用于视频译码中的基于滤波或定位的模板匹配的融合

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241206

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20241206

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20250925

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250930

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20251210

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20260120

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20260218

R150 Certificate of patent or registration of utility model

Ref document number: 7823047

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150