IL289255B2 - Resampling a reference image with switchable filters - Google Patents

Resampling a reference image with switchable filters

Info

Publication number
IL289255B2
IL289255B2 IL289255A IL28925521A IL289255B2 IL 289255 B2 IL289255 B2 IL 289255B2 IL 289255 A IL289255 A IL 289255A IL 28925521 A IL28925521 A IL 28925521A IL 289255 B2 IL289255 B2 IL 289255B2
Authority
IL
Israel
Prior art keywords
current
picture
filter index
reference picture
filter
Prior art date
Application number
IL289255A
Other languages
Hebrew (he)
Other versions
IL289255B1 (en
IL289255A (en
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of IL289255A publication Critical patent/IL289255A/en
Publication of IL289255B1 publication Critical patent/IL289255B1/en
Publication of IL289255B2 publication Critical patent/IL289255B2/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Claims (16)

289255/ Claims
1. A method of processing video data, the method comprising: obtaining (505) a current picture (314, 324, 334; 420) and a reference picture (312, 322, 332; 410); identifying (510; 610, 612) filter index information for a current block of the current picture; determining (515; 616) that a first picture size value of the current picture and a second picture size value of the reference picture are different; and based on the determining that the first picture size value of the current picture and the second picture size value of the reference picture are different, performing (520; 622) a reference picture resampling process using a default filter index in place of a current filter index identified by the filter index information for selecting between different interpolation filters.
2. The method of claim 1, further comprising: storing the current filter index identified by the filter index information with the current block; and using the current filter index in motion vector candidate derivation for a subsequent block based on the current filter index being identified by the filter index information.
3. The method of claim 1, further comprising: assigning a default value for the current filter index to replace an original value when the reference picture resampling process is performed without using the current filter index to create the default filter index; and assigning the original value for the current filter index after the reference picture resampling process; 289255/ wherein the default value for the current filter index in particular indicates that switching between the different interpolation filters is not applied as part of the reference picture resampling process.
4. The method of claim 1, wherein the different interpolation filters are half-pel interpolation filters.
5. The method of claim 1, wherein the filter index information comprises neighbor block information, and wherein the current filter index is derived from the neighbor block information during a merge mode motion vector candidate list derivation.
6. The method of claim 1, wherein the filter index information comprises adaptive motion vector resolution, AMVR, mode signaling, and wherein the current filter index is signaled through the AMVR mode signaling.
7. The method of claim 1, wherein the reference picture resampling process includes an interpolation process.
8. The method of claim 1, wherein a current filter index value is not signaled in response to a determination that the current filter index is not used in the reference picture resampling process.
9. The method of claim 1, wherein the current filter index indicates a filter to be selected from a set of filters, wherein a subset of the set of filters are used for performing the reference picture resampling process, and wherein a remaining portion of the set of filters are not usable for reference picture resampling; wherein the filter is in particular selected using a syntax element indicating that selection of the filter from the remaining portion of the set of filters is prohibited. 289255/
10. The method of claim 1, further comprising: identifying a first group of filters for interpolation, and a second group of filters for resampling, wherein the current filter index indicates a filter from the second group of filters.
11. The method of claim 10, further comprising: obtaining a second current picture and a second reference picture; determining that a third picture size value of the second current picture and a fourth picture size value of the second reference picture are a same size value; and based on determining that the third picture size value of the second current picture and the fourth picture size value of the second reference picture are the same size value, performing a second resampling process for a second current block using a second selected filter, wherein the second selected filter is from the first group of filters; or further comprising: obtaining the current filter index from a filter index by a lookup operation for a selected filter index value; wherein the selected filter index value is associated with the second group of filters; and wherein association between the selected filter index value and the second group of filters is based on determining that the first picture size value and the second picture size value are different.
12. The method of claim 10, wherein each filter of the first group of filters and the second group of filters is identified by an associated filter index, the associated filter index indicating an associated index value from a filter set for interpolation or a filter set for resampling; or wherein determining that the first picture size value of the current picture and the second picture size value of the reference picture are different comprises determining at least one of: 289255/ a current picture width is different from a reference picture width; and a current picture height is different from a reference picture height.
13. The method of claim 1, further comprising: generating an encoded video bitstream comprising the current picture and the reference picture and optionally sending the encoded video bitstream to a decoding device, the encoded video bitstream being sent with signaling information, the signaling information comprising the default filter index or storing the encoded video bitstream; or further comprising: obtaining an encoded video bitstream comprising the current picture and the reference picture; identifying signaling information associated with the encoded video bitstream, the signaling information comprising the filter index information; and decoding the current block of the current picture from the encoded video bitstream; wherein decoding the current block of the current picture from the encoded video bitstream in particular comprises reconstructing the current block based on the default filter index.
14. An apparatus for processing video data, the apparatus comprising: one or more memory units (108, 64; 118, 92 ) storing instructions; and one or more processors (106; 116) that execute the instructions, wherein execution of the instructions by the one or more processors causes the one or more processors to: obtain (505) a current picture (314, 324, 334; 420) and a reference picture (312, 322, 332; 410); 289255/ identify (510; 610, 612) filter index information for a current block of the current picture; determine (515; 616) that a first picture size value of the current picture and a second picture size value of the reference picture are different; and based on a determination that the first picture size value of the current picture and the second picture size value of the reference picture are different, perform (520; 622) a reference picture resampling process using a default filter index in place of a current filter index identified by the filter index information for selecting between different interpolation filters.
15. The apparatus of claim 14, wherein the execution of the instructions by the one or more processors further causes the one or more processors to perform the method of any one of claims to 13.
16. The apparatus of claim 14, wherein the apparatus is a mobile device; or wherein the apparatus includes a display configured to display the video data or a camera configured to capture one or more video frames of the video data.
IL289255A 2019-07-09 2020-06-26 Resampling a reference image with switchable filters IL289255B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962872225P 2019-07-09 2019-07-09
US16/912,660 US11563933B2 (en) 2019-07-09 2020-06-25 Reference picture resampling with switchable filters
PCT/US2020/039824 WO2021007048A1 (en) 2019-07-09 2020-06-26 Reference picture resampling with switchable filters

Publications (3)

Publication Number Publication Date
IL289255A IL289255A (en) 2022-02-01
IL289255B1 IL289255B1 (en) 2024-06-01
IL289255B2 true IL289255B2 (en) 2024-10-01

Family

ID=74102083

Family Applications (1)

Application Number Title Priority Date Filing Date
IL289255A IL289255B2 (en) 2019-07-09 2020-06-26 Resampling a reference image with switchable filters

Country Status (16)

Country Link
US (1) US11563933B2 (en)
EP (1) EP3997873A1 (en)
JP (1) JP7513641B2 (en)
KR (1) KR20220030988A (en)
CN (1) CN114303374B (en)
AU (2) AU2020311851A1 (en)
BR (1) BR112021026705A2 (en)
CA (1) CA3144976A1 (en)
CL (1) CL2022000026A1 (en)
CO (1) CO2022000028A2 (en)
IL (1) IL289255B2 (en)
MX (1) MX2022000300A (en)
PH (1) PH12021553244A1 (en)
TW (1) TWI867001B (en)
WO (1) WO2021007048A1 (en)
ZA (1) ZA202201424B (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20230157529A (en) 2019-04-01 2023-11-16 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 Using interpolation filters for history based motion vector prediction
CN120343237A (en) * 2019-05-13 2025-07-18 三星电子株式会社 Method and device for encoding and decoding video based on video size
KR20220088679A (en) * 2019-08-06 2022-06-28 오피 솔루션즈, 엘엘씨 Adaptive Resolution Management Predictive Rescaling
KR102635319B1 (en) * 2019-08-20 2024-02-07 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 Selective use of alternative interpolation filters in video processing
CN114586348A (en) * 2019-09-04 2022-06-03 交互数字Vc控股法国公司 Switchable interpolation filter
US11336894B2 (en) * 2019-09-20 2022-05-17 Tencent America LLC Signaling of reference picture resampling with resampling picture size indication in video bitstream
JP2021052241A (en) * 2019-09-20 2021-04-01 Kddi株式会社 Image decoding device, image decoding method, and program
JP7707170B2 (en) * 2019-12-20 2025-07-14 フラウンホッファー－ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ Subsample Interpolation for Reference Image Resampling
CN113242427B (en) * 2021-04-14 2024-03-12 中南大学 A fast method and device based on adaptive motion vector accuracy in VVC
US12375651B2 (en) * 2021-08-02 2025-07-29 Tencent America LLC Adaptive up-sampling filter for luma and chroma with reference picture resampling (RPR)
CN116076073B (en) * 2021-09-02 2025-10-21 辉达公司 Hardware codec accelerator for high-performance video encoding
WO2023029045A1 (en) 2021-09-06 2023-03-09 Nvidia Corporation Parallel encoding of video frames without filtering dependency
WO2023200246A1 (en) * 2022-04-12 2023-10-19 엘지전자 주식회사 Image encoding/decoding method, bitstream transmission method, and recording medium storing bitstream therein
CN119013976A (en) * 2022-04-12 2024-11-22 Lg电子株式会社 Image encoding/decoding method and apparatus based on MVD code prediction and recording medium storing bit stream
EP4552336A4 (en) * 2022-04-12 2025-12-17 Ericsson Telefon Ab L M IMPROVED INTERPOLATION FILTRATION
US12238335B2 (en) 2023-04-18 2025-02-25 Nvidia Corporation Efficient sub-pixel motion vector search for high-performance video encoding
US12316863B2 (en) 2023-04-18 2025-05-27 Nvidia Corporation Chroma-from-luma mode selection for high-performance video encoding

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7720311B1 (en) * 2005-03-03 2010-05-18 Nvidia Corporation Memory and compute efficient block-based two-dimensional sample-rate converter for image/video applications
US9369712B2 (en) * 2010-01-14 2016-06-14 Dolby Laboratories Licensing Corporation Buffered adaptive filters
US9648353B2 (en) * 2013-04-04 2017-05-09 Qualcomm Incorporated Multiple base layer reference pictures for SHVC
US9510001B2 (en) * 2013-07-09 2016-11-29 Electronics And Telecommunications Research Institute Video decoding method and apparatus using the same
US10462464B2 (en) * 2013-11-24 2019-10-29 Lg Electronics Inc. Method and apparatus for encoding and decoding video signal using adaptive sampling
US10182241B2 (en) * 2014-03-04 2019-01-15 Microsoft Technology Licensing, Llc Encoding strategies for adaptive switching of color spaces, color sampling rates and/or bit depths
WO2017147765A1 (en) * 2016-03-01 2017-09-08 Mediatek Inc. Methods for affine motion compensation
US10341659B2 (en) * 2016-10-05 2019-07-02 Qualcomm Incorporated Systems and methods of switching interpolation filters

Also Published As

Publication number Publication date
WO2021007048A1 (en) 2021-01-14
PH12021553244A1 (en) 2023-02-27
KR20220030988A (en) 2022-03-11
JP7513641B2 (en) 2024-07-09
BR112021026705A2 (en) 2022-02-15
JP2022539455A (en) 2022-09-09
MX2022000300A (en) 2022-02-03
CO2022000028A2 (en) 2022-01-17
AU2025283501A1 (en) 2026-01-15
CN114303374A (en) 2022-04-08
AU2020311851A1 (en) 2022-01-27
CL2022000026A1 (en) 2022-10-28
ZA202201424B (en) 2024-06-26
CA3144976A1 (en) 2021-01-14
TWI867001B (en) 2024-12-21
US20210014478A1 (en) 2021-01-14
TW202110178A (en) 2021-03-01
CN114303374B (en) 2025-03-21
IL289255B1 (en) 2024-06-01
IL289255A (en) 2022-02-01
US11563933B2 (en) 2023-01-24
EP3997873A1 (en) 2022-05-18

Similar Documents

Publication Publication Date Title
IL289255B2 (en) Resampling a reference image with switchable filters
JP7530465B2 (en) Video Encoding and Decoding
JP2023160996A5 (en)
US12170757B2 (en) Hardware codec accelerators for high-performance video encoding
JP2018521539A5 (en)
JP6975121B2 (en) Methods and Encoders for Encoding Video Streams in Video Coding Formats That Support Auxiliary Frames
CA2773156A1 (en) An apparatus
KR102162856B1 (en) Apparatus and method for video motion compensation
JP2011515981A (en) Method and apparatus for encoding or decoding video signal
AU2018435559A1 (en) Video image component prediction method and device, and computer storage medium
WO2020038378A1 (en) Method and device for predicting chroma block
CN111866502B (en) Image prediction method, device and computer readable storage medium
TW201322186A (en) Image coding method, image decoding method, image coding apparatus, image decoding apparatus, and image coding and decoding apparatus
JP2018536339A (en) Motion vector prediction using previous frame residual
JP2026501894A (en) Codec method, bitstream, encoder, decoder and storage medium
JPWO2021007048A5 (en)
CN114365500A (en) Method of video encoding and/or decoding with bidirectional optical flow simplification of shifting operations and related devices
CN113891004B (en) Image processing method, device, equipment and storage medium
CN113067984B (en) Binocular shooting correction method, binocular shooting correction device and electronic equipment
CN104396239B (en) Apparatus and method for encoding a video signal
RU2021139150A (en) RESAMPLING OF REFERENCE FRAMES USING SWITCHABLE FILTERS
KR20210103561A (en) Inter prediction method and apparatus
CN106604030A (en) Reference image processing method and device, encoder and decoder
JP6622546B2 (en) Image processing apparatus and method
KR20130056441A (en) Method and apparatus for motion estimation encoding/decoding for depth image