WO2015196364A1 - Methods for inter-view advanced residual prediction - Google Patents

Methods for inter-view advanced residual prediction Download PDF

Info

Publication number
WO2015196364A1
WO2015196364A1 PCT/CN2014/080615 CN2014080615W WO2015196364A1 WO 2015196364 A1 WO2015196364 A1 WO 2015196364A1 CN 2014080615 W CN2014080615 W CN 2014080615W WO 2015196364 A1 WO2015196364 A1 WO 2015196364A1
Authority
WO
WIPO (PCT)
Prior art keywords
inter
view
residual prediction
arp
methods
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/080615
Other languages
French (fr)
Inventor
Jicheng An
Kai Zhang
Xianguo Zhang
Han HUANG
Jian-Liang Lin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Singapore Pte Ltd
Original Assignee
MediaTek Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MediaTek Singapore Pte Ltd filed Critical MediaTek Singapore Pte Ltd
Priority to PCT/CN2014/080615 priority Critical patent/WO2015196364A1/en
Priority to TW104119511A priority patent/TWI548264B/en
Priority to PCT/CN2015/082169 priority patent/WO2015196988A1/en
Priority to CN201580000679.7A priority patent/CN105393535B/en
Priority to US14/916,170 priority patent/US9843821B2/en
Publication of WO2015196364A1 publication Critical patent/WO2015196364A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/537—Motion estimation other than block-based
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction

Definitions

  • the invention relates generally to Three-Dimensional (3D) video processing.
  • the present invention relates to methods for inter-view advanced residual prediction (ARP).
  • ARP advanced residual prediction
  • 3D video coding is developed for encoding or decoding video data of multiple views simultaneously captured by several cameras. Since all cameras capture the same scene from different viewpoints, multi-view video data contains a large amount of inter-view redundancy. To exploit the inter-view redundancy, additional tools such as advanced residual prediction (ARP) have been integrated to conventional 3D-HEVC (High Efficiency Video Coding) or 3D- AVC (Advanced Video Coding) codec.
  • ARP advanced residual prediction
  • inter-view ARP There are two kinds of ARP, inter-view ARP and temporal ARP. If current motion vector (MV) is in inter-view direction, the ARP is called inter-view ARP, otherwise, if current MV is in temporal direction, the ARP is called temporal ARP.
  • inter-view ARP The basic concept of the inter-view ARP in current 3DV-HEVC is illustrated in Fig. 1.
  • the MV of the current PU is in inter-view direction, which is applied to a corresponding block in a temporal reference picture in the same view to generate the reference residual in temporal direction.
  • the corresponding block in a temporal reference picture is located by a derived motion vector (DMV), the DMV is a scaled MV of the reference block in the reference view, and the reference block is located by current MV.
  • DMV derived motion vector
  • the DMV is set to (0, 0) so that the MV scaling process is avoided as shown in Fig. 4.
  • Fig. 1 is a diagram illustrating the inter- view residual prediction in current 3D-HEVC
  • Fig. 2 is a diagram illustrating the DMV derivation in current 3D-HEVC
  • Fig. 3 is a diagram illustrating the problematic DMV derivation in current 3D-HEVC
  • Fig. 4 is a diagram illustrating the proposed solution for the problematic DMV derivation in current 3D-HEVC.
  • the DMV derivation if the MV of the reference block, which is located by current MV (in inter-view direction), is in inter-view direction, or the POC of the reference block is the same as the POC of the reference block's reference block, the DMV is directly set to the default value (0, 0) as shown in Fig. 4.
  • JCT3V-H1001_v2 The related part of the draft text of current 3D-HEVC (JCT3V-H1001_v2) is in section 1.8.5.3.3.7.4, which should be modified as follows (the added part is underline and the deleted part is in brackets and italic): I 8.5.3.3.7.4 Derivation process for a motion vector from a reference block for residual prediction
  • variable refPredFlagLX is set equal to the prediction utilization flag predFlagLX of the prediction unit refPU.
  • refPicListRefX be the reference picture list X of refPic.
  • mvLX and refldxLX be the motion vector and reference index of the prediction unit refPU corresponding to refPicListRefX, respectively.
  • PicOrderCntfrefPicListRefXi refidxLX is not equal to PicOrderCnt(refPic) (refPicListRefXf refldxLX ] is a temporal reference picture of refPic) and RpRefldxLX is not equal to -1
  • availFlag is set to 1
  • Y is set equal to X
  • the residual prediction motion vector scaling process as specified in subclause 1.8.5.3.3.7.3 is invoked with the prediction list utilization variable equal to X, the motion vector mvLX, and the reference picture refPicListRefX[ refldxLX ] as inputs, and the output being mvT.
  • an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
  • An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
  • DSP Digital Signal Processor
  • the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA).
  • processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
  • the software code or firmware codes may be developed in different programming languages and different format or style.
  • the software code may also be compiled for different target platform.
  • different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A method of MV derivation is proposed for the inter-view advanced residual prediction. With the proposed method，one problematic MV scaling process can be avoided.

Description

METHODS FOR INTER-VIEW ADVANCED RESIDUAL PREDICTION
FIELD OF INVENTION
The invention relates generally to Three-Dimensional (3D) video processing. In particular, the present invention relates to methods for inter-view advanced residual prediction (ARP).
BACKGROUND OF THE INVENTION
3D video coding is developed for encoding or decoding video data of multiple views simultaneously captured by several cameras. Since all cameras capture the same scene from different viewpoints, multi-view video data contains a large amount of inter-view redundancy. To exploit the inter-view redundancy, additional tools such as advanced residual prediction (ARP) have been integrated to conventional 3D-HEVC (High Efficiency Video Coding) or 3D- AVC (Advanced Video Coding) codec.
There are two kinds of ARP, inter-view ARP and temporal ARP. If current motion vector (MV) is in inter-view direction, the ARP is called inter-view ARP, otherwise, if current MV is in temporal direction, the ARP is called temporal ARP. Here we only address the inter-view ARP. The basic concept of the inter-view ARP in current 3DV-HEVC is illustrated in Fig. 1. In inter-view ARP, the MV of the current PU is in inter-view direction, which is applied to a corresponding block in a temporal reference picture in the same view to generate the reference residual in temporal direction. The corresponding block in a temporal reference picture is located by a derived motion vector (DMV), the DMV is a scaled MV of the reference block in the reference view, and the reference block is located by current MV. The derivation of DMV is illustrated in Fig. 2.
The scaling process is well-known according to picture order count (POC) as follows (input is MV, output is the DMV):
tx = ( 16384 + ( Abs( td ) » 1 ) ) / td (1) distScaleFactor = Clip3( -4096, 4095, ( tb * tx + 32 ) » 6 ) (2) DMV = Clip3( -32768, 32767, Sign( distScaleFactor * MV ) *
( ( Abs( distScaleFactor * MV ) + 127 ) » 8 ) ) (3) where td and tb are derived as:
td = Clip3( -128, 127, POC0-POC1) (4) tb = Clip3( -128, 127, POC0-POC2 ) (5) However, when POCO is the same as the POCl, i.e., the MV of the reference block in the reference view is in inter- view direction as shown in Fig. 3, the scaling process becomes meaningless and would result in coder crash since the denominator td equal to 0 in (1). SUMMARY OF THE INVENTION
In light of the previously described problem, a method is proposed. In the proposed method, if the POCO is equal to POCl, i.e., the MV of reference block is in inter- view direction, the DMV is set to (0, 0) so that the MV scaling process is avoided as shown in Fig. 4.
Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
Fig. 1 is a diagram illustrating the inter- view residual prediction in current 3D-HEVC;
Fig. 2 is a diagram illustrating the DMV derivation in current 3D-HEVC;
Fig. 3 is a diagram illustrating the problematic DMV derivation in current 3D-HEVC;
Fig. 4 is a diagram illustrating the proposed solution for the problematic DMV derivation in current 3D-HEVC.
DETAILED DESCRIPTION
The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
To avoid the meanlingless and problematic MV scaling, based on the original method, some change is proposed as follows:
In the DMV derivation, if the MV of the reference block, which is located by current MV (in inter-view direction), is in inter-view direction, or the POC of the reference block is the same as the POC of the reference block's reference block, the DMV is directly set to the default value (0, 0) as shown in Fig. 4.
The related part of the draft text of current 3D-HEVC (JCT3V-H1001_v2) is in section 1.8.5.3.3.7.4, which should be modified as follows (the added part is underline and the deleted part is in brackets and italic): I 8.5.3.3.7.4 Derivation process for a motion vector from a reference block for residual prediction
When the variable CuPredMode for the coding unit refCU is equal to MODE SKIP or MODE INTER, the following applies for X in the range of 0 to 1, inclusive:
- The variable refPredFlagLX is set equal to the prediction utilization flag predFlagLX of the prediction unit refPU.
- When availFlag is equal to 0 and refPredFlagLX is equal to 1, the following applies: i. Let refPicListRefX be the reference picture list X of refPic.
ii. Let mvLX and refldxLX be the motion vector and reference index of the prediction unit refPU corresponding to refPicListRefX, respectively.
iii When PicOrderCntfrefPicListRefXi refidxLX is not equal to PicOrderCnt(refPic) (refPicListRefXf refldxLX ] is a temporal reference picture of refPic) and RpRefldxLX is not equal to -1, availFlag is set to 1, Y is set equal to X and the residual prediction motion vector scaling process as specified in subclause 1.8.5.3.3.7.3 is invoked with the prediction list utilization variable equal to X, the motion vector mvLX, and the reference picture refPicListRefX[ refldxLX ] as inputs, and the output being mvT. The methods described above can be used in a video encoder as well as in a video decoder. Embodiments of the method according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different format or style. The software code may also be compiled for different target platform. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Claims

1. A method for MV derivation in inter-view ARP.
2. The method as claimed in claim 1, wherein a reference block in the reference view is located by the current MV (in inter-view direction).
3. The method as claimed in claim 1 and claim 2, if the MV of the reference block is in inter-view direction, the MV scaling process is skipped, and the DMV for inter-view ARP is set to a default value (0, 0).
4. The method as claimed in claim 1 and claim 2, if the POC of the reference block is the same as the POC of the reference block's reference block, the MV scaling process is skipped, and the DMV for inter-view ARP is set to a default value (0, 0).
PCT/CN2014/080615 2014-06-24 2014-06-24 Methods for inter-view advanced residual prediction Ceased WO2015196364A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
PCT/CN2014/080615 WO2015196364A1 (en) 2014-06-24 2014-06-24 Methods for inter-view advanced residual prediction
TW104119511A TWI548264B (en) 2014-06-24 2015-06-17 Method of inter-view advanced residual prediction in 3d video coding
PCT/CN2015/082169 WO2015196988A1 (en) 2014-06-24 2015-06-24 Method of inter-view advanced residual prediction in 3d video coding
CN201580000679.7A CN105393535B (en) 2014-06-24 2015-06-24 Inter-view Advanced Residual Prediction Method in 3D Video Coding
US14/916,170 US9843821B2 (en) 2014-06-24 2015-06-24 Method of inter-view advanced residual prediction in 3D video coding

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/080615 WO2015196364A1 (en) 2014-06-24 2014-06-24 Methods for inter-view advanced residual prediction

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/916,170 Continuation-In-Part US9843821B2 (en) 2014-06-24 2015-06-24 Method of inter-view advanced residual prediction in 3D video coding

Publications (1)

Publication Number Publication Date
WO2015196364A1 true WO2015196364A1 (en) 2015-12-30

Family

ID=54936438

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2014/080615 Ceased WO2015196364A1 (en) 2014-06-24 2014-06-24 Methods for inter-view advanced residual prediction
PCT/CN2015/082169 Ceased WO2015196988A1 (en) 2014-06-24 2015-06-24 Method of inter-view advanced residual prediction in 3d video coding

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/082169 Ceased WO2015196988A1 (en) 2014-06-24 2015-06-24 Method of inter-view advanced residual prediction in 3d video coding

Country Status (3)

Country Link
US (1) US9843821B2 (en)
TW (1) TWI548264B (en)
WO (2) WO2015196364A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112243131B (en) * 2020-10-31 2022-11-11 西安邮电大学 Advanced Residual Prediction Method Based on Reconfigurable Array Processor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103597837A (en) * 2011-06-15 2014-02-19 联发科技股份有限公司 Method and device for motion and disparity vector prediction and 3D video coding compensation
US20140078250A1 (en) * 2012-09-19 2014-03-20 Qualcomm Incorporated Advanced inter-view residual prediction in multiview or 3-dimensional video coding
WO2014056423A1 (en) * 2012-10-09 2014-04-17 Mediatek Inc. Method and apparatus for motion information prediction and inheritance in video coding
WO2014075236A1 (en) * 2012-11-14 2014-05-22 Mediatek Singapore Pte. Ltd. Methods for residual prediction with pseudo residues in 3d video coding
US20140161175A1 (en) * 2012-12-07 2014-06-12 Qualcomm Incorporated Advanced residual prediction in scalable and multi-view video coding

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103139555B (en) * 2011-11-22 2017-07-11 浙江大学 A kind of video sequence parameter coding method, coding/decoding method, corresponding device and code stream
US9357195B2 (en) * 2012-08-16 2016-05-31 Qualcomm Incorporated Inter-view predicted motion vector for 3D video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103597837A (en) * 2011-06-15 2014-02-19 联发科技股份有限公司 Method and device for motion and disparity vector prediction and 3D video coding compensation
US20140078250A1 (en) * 2012-09-19 2014-03-20 Qualcomm Incorporated Advanced inter-view residual prediction in multiview or 3-dimensional video coding
WO2014056423A1 (en) * 2012-10-09 2014-04-17 Mediatek Inc. Method and apparatus for motion information prediction and inheritance in video coding
WO2014075236A1 (en) * 2012-11-14 2014-05-22 Mediatek Singapore Pte. Ltd. Methods for residual prediction with pseudo residues in 3d video coding
US20140161175A1 (en) * 2012-12-07 2014-06-12 Qualcomm Incorporated Advanced residual prediction in scalable and multi-view video coding

Also Published As

Publication number Publication date
TW201611580A (en) 2016-03-16
WO2015196988A1 (en) 2015-12-30
US9843821B2 (en) 2017-12-12
US20160219304A1 (en) 2016-07-28
TWI548264B (en) 2016-09-01

Similar Documents

Publication Publication Date Title
WO2016008157A1 (en) Methods for motion compensation using high order motion model
WO2016165069A1 (en) Advanced temporal motion vector prediction in video coding
WO2015000108A1 (en) An improved texture merging candidate in 3dvc
WO2015109598A1 (en) Methods for motion parameter hole filling
CN104717510B (en) Method and apparatus for image procossing
WO2017139937A1 (en) Advanced linear model prediction for chroma coding
WO2015100710A1 (en) Existence of inter-view reference picture and availability of 3dvc coding tools
WO2016008161A1 (en) Temporal derived bi-directional motion vector predictor
WO2015085575A1 (en) Methods for background residual prediction
WO2015003383A1 (en) Methods for inter-view motion prediction
WO2015006922A1 (en) Methods for residual prediction
WO2015135175A1 (en) Simplified depth based block partitioning method
WO2016119104A1 (en) Motion vector regularization
WO2014166109A1 (en) Methods for disparity vector derivation
WO2016123749A1 (en) Deblocking filtering with adaptive motion vector resolution
WO2015196364A1 (en) Methods for inter-view advanced residual prediction
CN105122792B (en) Method and device for residual error prediction in 3D or multi-view coding system
WO2015131404A1 (en) Methods for depth map coding
CN103533361B (en) Determination method, encoding device and the decoding device of multi-view disparity vector
WO2015143603A1 (en) An improved method for temporal motion vector prediction in video coding
WO2014106327A1 (en) Method and apparatus for inter-view residual prediction in multiview video coding
WO2014106346A1 (en) Method of signalling additional collocated picture for 3dvc
WO2015103747A1 (en) Motion parameter hole filling
CN105393535B (en) Inter-view Advanced Residual Prediction Method in 3D Video Coding
WO2014166096A1 (en) Reference view derivation for inter-view motion prediction and inter-view residual prediction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14895957

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14895957

Country of ref document: EP

Kind code of ref document: A1