EP4262208A3 - Constrained motion vector derivation for long-term reference pictures in video coding - Google Patents

Constrained motion vector derivation for long-term reference pictures in video coding Download PDF

Info

Publication number
EP4262208A3
EP4262208A3 EP23195885.1A EP23195885A EP4262208A3 EP 4262208 A3 EP4262208 A3 EP 4262208A3 EP 23195885 A EP23195885 A EP 23195885A EP 4262208 A3 EP4262208 A3 EP 4262208A3
Authority
EP
European Patent Office
Prior art keywords
inter
long
term reference
reference pictures
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP23195885.1A
Other languages
German (de)
French (fr)
Other versions
EP4262208A2 (en
Inventor
Yi-Wen Chen
Xiaoyu XIU
Xianglin Wang
Tsung-Chuan MA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Publication of EP4262208A2 publication Critical patent/EP4262208A2/en
Publication of EP4262208A3 publication Critical patent/EP4262208A3/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/58—Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Abstract

A method for video encoding, comprising: splitting a video frame into a plurality of blocks, determining whether one or more of the reference pictures associated with an inter-mode coded block involved in an operation of an inter-mode coding tool are long-term reference pictures and constraining the operation of an inter-mode coding tool on the inter-mode coded block based on the determination, wherein in the case that the inter-mode coding tool comprises Bi-Directional Optical Flow, BDOF, and the inter-mode coded block is a bi-directional prediction block, constraining the operation of the inter-mode coding tool on the inter-mode coded block based on the determination comprises: prohibiting the performance of the BDOF when determining that one reference picture of the bi-directional prediction block is a long-term reference picture and the other reference picture of the bi-directional prediction block is not a long-term reference picture.
EP23195885.1A 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding Pending EP4262208A3 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962808271P 2019-02-20 2019-02-20
PCT/US2020/018918 WO2020172341A1 (en) 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding
EP20760226.9A EP3912357B1 (en) 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP20760226.9A Division EP3912357B1 (en) 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding

Publications (2)

Publication Number Publication Date
EP4262208A2 EP4262208A2 (en) 2023-10-18
EP4262208A3 true EP4262208A3 (en) 2024-01-17

Family

ID=72144437

Family Applications (2)

Application Number Title Priority Date Filing Date
EP23195885.1A Pending EP4262208A3 (en) 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding
EP20760226.9A Active EP3912357B1 (en) 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP20760226.9A Active EP3912357B1 (en) 2019-02-20 2020-02-19 Constrained motion vector derivation for long-term reference pictures in video coding

Country Status (12)

Country Link
US (1) US20210377520A1 (en)
EP (2) EP4262208A3 (en)
JP (2) JP7218449B2 (en)
KR (2) KR20230018540A (en)
CN (6) CN117041556B (en)
DK (1) DK3912357T3 (en)
FI (1) FI3912357T3 (en)
HU (1) HUE064569T2 (en)
MX (1) MX2021010062A (en)
PL (1) PL3912357T3 (en)
PT (1) PT3912357T (en)
WO (1) WO2020172341A1 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113545041A (en) * 2019-03-07 2021-10-22 数字洞察力有限公司 Image encoding/decoding method and apparatus
JP2022525401A (en) * 2019-03-11 2022-05-13 ヴィド スケール インコーポレイテッド Symmetric merge mode motion vector coding
KR102622468B1 (en) * 2019-06-14 2024-01-09 엘지전자 주식회사 Inter prediction based video coding method and device
EP3979650A4 (en) 2019-06-14 2023-04-12 Lg Electronics Inc. Method and device for image coding using motion vector differences
CN114080813A (en) * 2019-06-14 2022-02-22 Lg 电子株式会社 Method and apparatus for image coding using motion vector
KR102640262B1 (en) 2019-06-24 2024-02-23 엘지전자 주식회사 Image coding method and device using motion vector differences
KR20240029111A (en) 2019-06-24 2024-03-05 엘지전자 주식회사 Image coding method and apparatus using motion vector
WO2020262914A1 (en) 2019-06-24 2020-12-30 엘지전자 주식회사 Inter prediction-based image coding method and apparatus
CN114175655B (en) 2019-07-27 2024-01-02 北京字节跳动网络技术有限公司 Restriction of use of tools according to reference picture types
CN110545424B (en) * 2019-08-21 2021-05-11 浙江大华技术股份有限公司 Inter-frame prediction method based on MMVD (multimedia MediaVision video) mode, video coding method, related device and equipment
WO2023055199A1 (en) * 2021-09-30 2023-04-06 한국전자통신연구원 Method, device, and recording medium for encoding/decoding image
WO2023132510A1 (en) * 2022-01-04 2023-07-13 현대자동차주식회사 Method and device for video coding using improved merge with motion vector difference

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180278949A1 (en) * 2017-03-22 2018-09-27 Qualcomm Incorporated Constraining motion vector information derived by decoder-side motion vector derivation

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2745058T3 (en) * 2002-04-19 2020-02-27 Panasonic Ip Corp America Motion vector calculation method
KR100491530B1 (en) * 2002-05-03 2005-05-27 엘지전자 주식회사 Method of determining motion vector
US8170116B2 (en) * 2006-03-27 2012-05-01 Nokia Corporation Reference picture marking in scalable video encoding and decoding
US20100091845A1 (en) * 2006-03-30 2010-04-15 Byeong Moon Jeon Method and apparatus for decoding/encoding a video signal
KR101379188B1 (en) * 2010-05-17 2014-04-18 에스케이 텔레콤주식회사 Video Coding and Decoding Method and Apparatus for Macroblock Including Intra and Inter Blocks
EP2728879A4 (en) * 2011-06-30 2015-02-18 Sony Corp Image processing device and method
MX2013012223A (en) * 2011-10-28 2013-11-01 Panasonic Corp Image encoding method, image decoding method, image encoding device, and image decoding device.
MY179745A (en) * 2011-11-08 2020-11-12 Samsung Electronics Co Ltd Method and apparatus for motion vector determination in video encoding or decoding
US9503720B2 (en) * 2012-03-16 2016-11-22 Qualcomm Incorporated Motion vector coding and bi-prediction in HEVC and its extensions
US20130343459A1 (en) * 2012-06-22 2013-12-26 Nokia Corporation Method and apparatus for video coding
CN104488272B (en) * 2012-07-02 2018-03-16 三星电子株式会社 It is used to encode video or the method and apparatus of the motion vector for decoding video for predicting
JP6149151B2 (en) * 2013-04-02 2017-06-14 ヴィド スケール インコーポレイテッド Extended temporal motion vector prediction for scalable video coding
US9509999B2 (en) * 2013-06-11 2016-11-29 Qualcomm Incorporated Inter-layer prediction types in multi-layer video coding
KR102311815B1 (en) * 2014-06-19 2021-10-13 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 Unified intra block copy and inter prediction modes
US10412387B2 (en) * 2014-08-22 2019-09-10 Qualcomm Incorporated Unified intra-block copy and inter-prediction
US9918105B2 (en) * 2014-10-07 2018-03-13 Qualcomm Incorporated Intra BC and inter unification
WO2016200043A1 (en) * 2015-06-10 2016-12-15 엘지전자 주식회사 Method and apparatus for inter prediction on basis of virtual reference picture in video coding system
WO2017084512A1 (en) * 2015-11-20 2017-05-26 Mediatek Inc. Method and apparatus of motion vector prediction or merge candidate derivation for video coding
KR102435500B1 (en) * 2016-10-06 2022-08-23 세종대학교산학협력단 A method of decoding a video signal and an apparatus having the same
US20180199057A1 (en) * 2017-01-12 2018-07-12 Mediatek Inc. Method and Apparatus of Candidate Skipping for Predictor Refinement in Video Coding
WO2020145656A1 (en) * 2019-01-09 2020-07-16 엘지전자 주식회사 Method and device for signaling whether tmvp candidate is available
CN113424525B (en) * 2019-02-14 2023-11-10 北京字节跳动网络技术有限公司 Size selective application of decoder side refinement tools

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180278949A1 (en) * 2017-03-22 2018-09-27 Qualcomm Incorporated Constraining motion vector information derived by decoder-side motion vector derivation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BROSS B ET AL: "Versatile Video Coding (Draft 4)", no. JVET-M1001, 19 February 2019 (2019-02-19), XP030202591, Retrieved from the Internet <URL:http://phenix.int-evry.fr/jvet/doc_end_user/documents/13_Marrakech/wg11/JVET-M1001-v3.zip JVET-M1001-v3.docx> [retrieved on 20190219] *
JIANLE CHEN ET AL: "Algorithm description for Versatile Video Coding and Test Model 4 (VTM 4)", no. JVET-M1002-v2; JVET-M1002, 18 January 2019 (2019-01-18), pages 1 - 62, XP030255391, Retrieved from the Internet <URL:http://phenix.int-evry.fr/jvet/doc_end_user/documents/13_Marrakech/wg11/JVET-M1002-v2.zip JVET-M1002-v2.docx> [retrieved on 20190319] *
R. SJOBERG ET AL: "Overview of HEVC high-level syntax and reference picture management", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, vol. 22, no. 12, 5 October 2012 (2012-10-05), USA, pages 1 - 14, XP055045360, ISSN: 1051-8215, DOI: 10.1109/TCSVT.2012.2223052 *

Also Published As

Publication number Publication date
CN116915983B (en) 2024-04-16
JP7218449B2 (en) 2023-02-06
EP3912357B1 (en) 2023-10-04
CN117041556B (en) 2024-03-26
DK3912357T3 (en) 2024-01-08
MX2021010062A (en) 2021-09-21
EP3912357A4 (en) 2022-05-18
CN117119181B (en) 2024-03-26
CN117119181A (en) 2023-11-24
EP4262208A2 (en) 2023-10-18
EP3912357A1 (en) 2021-11-24
FI3912357T3 (en) 2023-12-19
US20210377520A1 (en) 2021-12-02
CN113424539A (en) 2021-09-21
CN116915983A (en) 2023-10-20
HUE064569T2 (en) 2024-03-28
JP7447322B2 (en) 2024-03-11
PL3912357T3 (en) 2024-03-25
CN117041556A (en) 2023-11-10
JP2023055778A (en) 2023-04-18
CN116915982B (en) 2024-03-26
WO2020172341A1 (en) 2020-08-27
PT3912357T (en) 2023-12-26
CN114339237A (en) 2022-04-12
CN116915982A (en) 2023-10-20
KR102492738B1 (en) 2023-01-26
KR20230018540A (en) 2023-02-07
JP2022520867A (en) 2022-04-01
CN114339237B (en) 2023-04-25
KR20210107897A (en) 2021-09-01

Similar Documents

Publication Publication Date Title
EP4262208A3 (en) Constrained motion vector derivation for long-term reference pictures in video coding
PH12018501883A1 (en) Determining prediction parameters for non-square blocks in video coding
WO2020113051A3 (en) Decoder-side motion vector refinement
WO2020016735A3 (en) Block size restriction for video coding
EP4236312A3 (en) Intra filtering applied together with transform processing in video coding
MX2021006039A (en) An encoder, a decoder and corresponding methods for inter prediction.
MX2018011198A (en) Method and apparatus of video data processing with restricted block size in video coding.
EP4072143A3 (en) Overlapped motion compensation for video coding
MX2021012516A (en) Context coding for transform skip mode.
MX2018013942A (en) Method and apparatus for video coding with adaptive clipping.
MX2021003135A (en) Method for encodng and decoding motion information, and apparatus for encodng and decoding motion information.
MX358071B (en) Motion-constrained tile set for region of interest coding.
MX337935B (en) System and method for implementing efficient decoded buffer management in multi-view video coding.
MX2021001745A (en) Reference picture management in video coding.
JP2020533839A5 (en)
MX2021011042A (en) Coefficient coding for transform skip mode.
ZA202105444B (en) Systems, apparatus and methods for inter prediction refinement with optical flow
TN2017000313A1 (en) Coding escape pixels for palette mode coding
MX2021013977A (en) Handling of bi-directional optical flow (bio) coding tool for reference picture resampling in video coding.
MX2019014443A (en) A method and a device for picture encoding and decoding.
PH12020551004A1 (en) Transform selection in a video encoder and/or video decoder
MX2021014221A (en) Signaling of motion vector difference derivation.
EP4243418A3 (en) Early termination for optical flow refinement
MX2022003404A (en) Harmonized early termination in bdof and dmvr in video coding.
EP4231646A3 (en) Video decoding method and apparatus, and video encoding method and apparatus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230907

AC Divisional application: reference to earlier application

Ref document number: 3912357

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04N0019159000

Ipc: H04N0019105000

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/159 20140101ALI20231211BHEP

Ipc: H04N 19/176 20140101ALI20231211BHEP

Ipc: H04N 19/513 20140101ALI20231211BHEP

Ipc: H04N 19/577 20140101ALI20231211BHEP

Ipc: H04N 19/58 20140101ALI20231211BHEP

Ipc: H04N 19/105 20140101AFI20231211BHEP