WO2016123749A1 - Deblocking filtering with adaptive motion vector resolution - Google Patents

Deblocking filtering with adaptive motion vector resolution Download PDF

Info

Publication number
WO2016123749A1
WO2016123749A1 PCT/CN2015/072175 CN2015072175W WO2016123749A1 WO 2016123749 A1 WO2016123749 A1 WO 2016123749A1 CN 2015072175 W CN2015072175 W CN 2015072175W WO 2016123749 A1 WO2016123749 A1 WO 2016123749A1
Authority
WO
WIPO (PCT)
Prior art keywords
integer
mvy
mvx
pixel resolution
flag
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/072175
Other languages
French (fr)
Inventor
Kai Zhang
Jicheng An
Xianguo Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MediaTek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MediaTek Inc filed Critical MediaTek Inc
Priority to PCT/CN2015/072175 priority Critical patent/WO2016123749A1/en
Priority to CN202010541786.3A priority patent/CN111818334B/en
Priority to KR1020177010070A priority patent/KR102068828B1/en
Priority to CA2961681A priority patent/CA2961681C/en
Priority to CN202111509061.7A priority patent/CN114554199B/en
Priority to KR1020207001441A priority patent/KR102115715B1/en
Priority to CN201580052679.1A priority patent/CN107079164B/en
Priority to EP15847504.6A priority patent/EP3189660B1/en
Priority to PCT/CN2015/091275 priority patent/WO2016050219A1/en
Priority to US15/514,129 priority patent/US10455231B2/en
Publication of WO2016123749A1 publication Critical patent/WO2016123749A1/en
Anticipated expiration legal-status Critical
Priority to US16/564,042 priority patent/US10880547B2/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy

Definitions

  • the invention relates generally to video/image coding/processing. Particularly, it is related adaptive motion vector resolution.
  • Adaptive motion vector resolution (JCTVC-S0085) is described as follows.
  • an adaptive_mv_resolution_enabled_flag is signaled to indicate whether adaptive motion vector resolution is applied.
  • MV is parsed and decoded in the same way no matter use_integer_mv_flag is 0 or 1 in the current slice.
  • the number ‘4’ is designed with the assumption that MVs always use quarter-pixel resolution. However, when MVs in the current slice uses other MV resolution such as integer pixel resolution, ‘4’ may be not appropriate.
  • Fig. 1 is a diagram illustrating an exemplary flowchart for MV comparison in de-blocking when AMVR is used.
  • deblocking are performed differently when different MV resolution is used.
  • deblocking are performed differently with different use_integer_mv_flag.
  • the absolute difference between the horizontal or vertical component of the motion vectors is compared with 2 instead of 4 when MVs use the half pixel resolution.
  • the absolute difference between the horizontal or vertical component of the motion vectors is compared with 8 instead of 4 when MVs use the eighth pixel resolution.
  • an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
  • An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
  • DSP Digital Signal Processor
  • the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) .
  • processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
  • the software code or firmware codes may be developed in different programming languages and different format or style.
  • the software code may also be compiled for different target platform.
  • different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Methods are proposed to harmonize adaptive motion vector resolution with de-blocking.

Description

DEBLOCKING FILTERING WITH ADAPTIVE MOTION VECTOR RESOLUTION TECHNICAL FIELD
The invention relates generally to video/image coding/processing. Particularly, it is related adaptive motion vector resolution.
BACKGROUND
Adaptive motion vector resolution (JCTVC-S0085) is described as follows.
In SPS, an adaptive_mv_resolution_enabled_flag is signaled to indicate whether adaptive motion vector resolution is applied.
In slice header, a use_integer_mv_flag is signaled to indicate whether a motion vector (MV) in the current slice uses integer pixel resolution (use_integer_mv_flag ＝ 1 ) or quarter pixel resolution (use_integer_mv_flag ＝ 0 ) .
if (adaptive_mv_resolution_enabled_flag )  
use_integer_mv_flag u (1)
MV is parsed and decoded in the same way no matter use_integer_mv_flag is 0 or 1 in the current slice.
Before the interpolating process, MV is scaled based on use_integer_mv_flag as below recited from JCTVC-S1005When use_integer_mv_flag is equal to 1, mvLX and mvCLX (where X equals to 0 or 1) are modified as mvLX <<＝ 2, mvCLX <<＝ 2.
A problem in the de-blocking process arises when MVs in the current slice uses integer pixel resolution.
In the de-blocking process, |Q_MVx –P_MVx| and |Q_MVy –P_MVy| will be compared to 4 to determine the filtering boundary strength, where Q_MV and P_MV represents motion vectors in two adjacent blocks.
The number ‘4’ is designed with the assumption that MVs always use quarter-pixel resolution. However, when MVs in the current slice uses other MV resolution such as integer pixel resolution, ‘4’ may be not appropriate.
SUMMARY
In light of the previously described problems, methods are proposed to harmonize adaptive motion vector resolution and de-blocking.
Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments.
BRIEF DESCRIPTION OF DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
Fig. 1 is a diagram illustrating an exemplary flowchart for MV comparison in de-blocking when AMVR is used.
DETAILED DESCRIPTION
The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
In order to harmonize AMVR and de-blocking, several methods are proposed.
In one embodiment, deblocking are performed differently when different MV resolution is used.
In one embodiment, deblocking are performed differently with different use_integer_mv_flag.
In one embodiment, a MV is left shifted by 2 (MVx＝MVx<<2 and MVy＝MVy<<2) before it is used in MV comparison in the de-blocking process when the MV uses the integer pixel resolution (use_integer_mv_flag ＝ 1) as depicted in Fig. 1.
In another embodiment, the absolute difference between the horizontal or vertical component of the motion vectors is compared with 1 instead of 4 when MVs use the integer pixel resolution (use_integer_mv_flag ＝ 1) .
In another embodiment, a MV is left shifted by 1 (MVx＝MVx<<1 and MVy＝MVy<<1) before it is used in MV comparison in the de-blocking process when the MV uses the half pixel resolution.
In still another embodiment, a MV is right shifted by 1 (MVx＝MVx>>1 and MVy＝MVy>>1 or MVx＝ (MVx+1) >>1 and MVy＝ (MVy+1) >>1) before it is used in MV comparison in the de-blocking process when the MV uses the eighth pixel resolution.
In still another embodiment, the absolute difference between the horizontal or vertical component of the motion vectors is compared with 2 instead of 4 when MVs use the half pixel resolution.
In still another embodiment, the absolute difference between the horizontal or vertical component of the motion vectors is compared with 8 instead of 4 when MVs use the eighth pixel resolution.
In still another embodiment, de-blocking is not conducted when integer pixel resolution is used (use_integer_mv_flag ＝ 1) .
The methods described above can be used in a video encoder as well as in a video decoder. Embodiments of disparity vector derivation methods according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) . These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different format or style. The software code may also be compiled for different target platform. However, different code formats, styles and languages of software codes  and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art) . Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Claims (9)

  1. A method in which deblocking are performed differently when different MV resolution is used.
  2. The method as claimed in claim 1, wherein deblocking are performed differently with different use_integer_mv_flag.
  3. The method as claimed in claim 1, wherein a MV is left shifted by 2 (MVx＝MVx<<2 and MVy＝MVy<<2) before it is used in MV comparison in the de- blocking process when the MV uses the integer pixel resolution (use_integer_mv_flag ＝ 1) .
  4. The method as claimed in claim 1, wherein the absolute difference between the horizontal or vertical component of the motion vectors is compared with K not equal to 4 when MVs use the integer pixel resolution (use_integer_mv_flag ＝ 1). Specially, K ＝1.
  5. The method as claimed in claim 1, wherein a MV is left shifted by 1 (MVx＝MVx<<1 and MVy＝MVy<<1) before it is used in MV comparison in the de- blocking process when the MV uses the half pixel resolution.
  6. The method as claimed in claim 1, wherein a MV is right shifted by 1 (MVx＝MVx>>1 and MVy＝MVy>>1 or MVx＝(MVx+1)>>1 and MVy＝(MVy+1)>>1) before it is used in MV comparison in the de-blocking process when the MV uses the eighth pixel resolution.
  7. The method as claimed in claim 1, wherein the absolute difference between the horizontal or vertical component of the motion vectors is compared with K not equal to 4 when MVs use the half pixel resolution. Specially, K ＝2.
  8. The method as claimed in claim 1, wherein the absolute difference between the horizontal or vertical component of the motion vectors is compared with K not equal to 4 when MVs use the eighth pixel resolution. Specially, K ＝8.
  9. The method as claimed in claim 1, wherein de-blocking is not conducted when integer pixel resolution is used (use_integer_mv_flag ＝ 1) .
PCT/CN2015/072175 2014-09-30 2015-02-03 Deblocking filtering with adaptive motion vector resolution Ceased WO2016123749A1 (en)

Priority Applications (11)

Application Number Priority Date Filing Date Title
PCT/CN2015/072175 WO2016123749A1 (en) 2015-02-03 2015-02-03 Deblocking filtering with adaptive motion vector resolution
KR1020207001441A KR102115715B1 (en) 2014-09-30 2015-09-30 Method of adaptive motion vector resolution for video coding
KR1020177010070A KR102068828B1 (en) 2014-09-30 2015-09-30 Method of adaptive motion vector resolution for video coding
CA2961681A CA2961681C (en) 2014-09-30 2015-09-30 Method of adaptive motion vetor resolution for video coding
CN202111509061.7A CN114554199B (en) 2014-09-30 2015-09-30 Method for adaptive motion vector resolution for video coding
CN202010541786.3A CN111818334B (en) 2014-09-30 2015-09-30 Method for adaptive motion vector resolution for video coding
CN201580052679.1A CN107079164B (en) 2014-09-30 2015-09-30 Method for adaptive motion vector resolution for video coding
EP15847504.6A EP3189660B1 (en) 2014-09-30 2015-09-30 Method of adaptive motion vector resolution for video coding
PCT/CN2015/091275 WO2016050219A1 (en) 2014-09-30 2015-09-30 Method of adaptive motion vetor resolution for video coding
US15/514,129 US10455231B2 (en) 2014-09-30 2015-09-30 Method of adaptive motion vector resolution for video coding
US16/564,042 US10880547B2 (en) 2014-09-30 2019-09-09 Method of adaptive motion vector resolution for video coding

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/072175 WO2016123749A1 (en) 2015-02-03 2015-02-03 Deblocking filtering with adaptive motion vector resolution

Publications (1)

Publication Number Publication Date
WO2016123749A1 true WO2016123749A1 (en) 2016-08-11

Family

ID=56563299

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/072175 Ceased WO2016123749A1 (en) 2014-09-30 2015-02-03 Deblocking filtering with adaptive motion vector resolution

Country Status (1)

Country Link
WO (1) WO2016123749A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019144732A1 (en) * 2018-01-29 2019-08-01 Mediatek Inc. Length-adaptive deblocking filtering in video coding
CN111436226A (en) * 2018-11-12 2020-07-21 北京字节跳动网络技术有限公司 Motion vector storage for inter prediction
US12348760B2 (en) 2018-11-20 2025-07-01 Beijing Bytedance Network Technology Co., Ltd. Coding and decoding of video coding modes
US12477106B2 (en) 2018-10-22 2025-11-18 Beijing Bytedance Network Technology Co., Ltd. Sub-block based prediction

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080310509A1 (en) * 2007-06-13 2008-12-18 Nvidia Corporation Sub-pixel Interpolation and its Application in Motion Compensated Encoding of a Video Signal
CN101453651A (en) * 2007-11-30 2009-06-10 华为技术有限公司 A deblocking filtering method and apparatus
CN103813176A (en) * 2012-11-14 2014-05-21 北京三星通信技术研究有限公司 Deblocking filter method and adaptive loop filter method in video encoding and decoding
US20140307772A1 (en) * 2013-04-12 2014-10-16 Sony Corporation Image processing apparatus and image processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080310509A1 (en) * 2007-06-13 2008-12-18 Nvidia Corporation Sub-pixel Interpolation and its Application in Motion Compensated Encoding of a Video Signal
CN101453651A (en) * 2007-11-30 2009-06-10 华为技术有限公司 A deblocking filtering method and apparatus
CN103813176A (en) * 2012-11-14 2014-05-21 北京三星通信技术研究有限公司 Deblocking filter method and adaptive loop filter method in video encoding and decoding
US20140307772A1 (en) * 2013-04-12 2014-10-16 Sony Corporation Image processing apparatus and image processing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LIST, PETER ET AL.: "Adaptive Deblocking Filter", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEM FOR VIDEO TECHNOLOGY, vol. 13, no. 7, 31 July 2003 (2003-07-31), pages 616 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019144732A1 (en) * 2018-01-29 2019-08-01 Mediatek Inc. Length-adaptive deblocking filtering in video coding
US11153607B2 (en) 2018-01-29 2021-10-19 Mediatek Inc. Length-adaptive deblocking filtering in video coding
US12477106B2 (en) 2018-10-22 2025-11-18 Beijing Bytedance Network Technology Co., Ltd. Sub-block based prediction
CN111436226A (en) * 2018-11-12 2020-07-21 北京字节跳动网络技术有限公司 Motion vector storage for inter prediction
US12432355B2 (en) 2018-11-12 2025-09-30 Beijing Bytedance Network Technology Co., Ltd. Using combined inter intra prediction in video processing
US12348760B2 (en) 2018-11-20 2025-07-01 Beijing Bytedance Network Technology Co., Ltd. Coding and decoding of video coding modes
US12363337B2 (en) 2018-11-20 2025-07-15 Beijing Bytedance Network Technology Co., Ltd. Coding and decoding of video coding modes

Similar Documents

Publication Publication Date Title
US11109052B2 (en) Method of motion vector derivation for video coding
US10257536B2 (en) Method of temporal derived bi-directional motion vector for motion vector prediciton
WO2016165069A1 (en) Advanced temporal motion vector prediction in video coding
US10511835B2 (en) Method and apparatus of decoder side motion derivation for video coding
WO2017035831A1 (en) Adaptive inter prediction
US10750203B2 (en) Method and apparatus of adaptive bi-prediction for video coding
US10075712B2 (en) Method of motion vector and block vector resolution control
EP3130147B1 (en) Methods of block vector prediction and decoding for intra block copy mode coding
US11831928B2 (en) Method and apparatus of combined inter and intra prediction with different chroma formats for video coding
WO2017156669A1 (en) Methods for motion vector storage in video coding
US10944983B2 (en) Method of motion information coding
US20160150242A1 (en) Method of Background Residual Prediction for Video Coding
WO2016119104A1 (en) Motion vector regularization
WO2016123749A1 (en) Deblocking filtering with adaptive motion vector resolution
WO2015180166A1 (en) Improved intra prediction mode coding
CN114503557B (en) Video data prediction method and device
WO2015176225A1 (en) Improved intra-block copy searching methods
WO2015100732A1 (en) A padding method for intra block copying
WO2015188332A1 (en) A default vector selection method for block copy vector prediction in video compression
WO2015196364A1 (en) Methods for inter-view advanced residual prediction
WO2016070363A1 (en) Merge with inter prediction offset
WO2016165122A1 (en) Inter prediction offset
WO2015135137A1 (en) A method of motion information sharing in multi-view and 3d video coding
WO2015006899A1 (en) A simplified dv derivation method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15880705

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15880705

Country of ref document: EP

Kind code of ref document: A1