CN104104956A - Layered video encoding and decoding method, encoding device and decoding device - Google Patents

Layered video encoding and decoding method, encoding device and decoding device Download PDF

Info

Publication number
CN104104956A
CN104104956A CN201310119503.6A CN201310119503A CN104104956A CN 104104956 A CN104104956 A CN 104104956A CN 201310119503 A CN201310119503 A CN 201310119503A CN 104104956 A CN104104956 A CN 104104956A
Authority
CN
China
Prior art keywords
associated picture
piece
picture piece
enhancement layer
residual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310119503.6A
Other languages
Chinese (zh)
Other versions
CN104104956B (en
Inventor
魏湘辉
昝劲文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201310119503.6A priority Critical patent/CN104104956B/en
Publication of CN104104956A publication Critical patent/CN104104956A/en
Application granted granted Critical
Publication of CN104104956B publication Critical patent/CN104104956B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the invention provides a layered video encoding and decoding method, an encoding device and a decoding device. The method comprises steps: a relative image block of an enhancement layer image block is determined, wherein the relative image block comprises a base layer image block corresponding to the enhancement layer image block and an encoded image block near the enhancement layer image block; residual information corresponding to the relative image block is acquired; according to the residual information corresponding to the relative image block, whether generalized residual prediction algorithm is adopted when interframe prediction is carried out on the enhancement layer image block is determined, wherein the residual information corresponding to the relative image block is used for indicating whether the relative image block has residual or indicating the residual degree of the relative image block. According to the layered video encoding and decoding method, the encoding device and the decoding device, complexity of video encoding and decoding and the time of encoding and decoding can be reduced.

Description

For method, the encoding apparatus and decoding apparatus of layered video coding and decoding
Technical field
The present invention relates to the communications field, and more specifically, relate to a kind of method for layered video coding and decoding, encoding apparatus and decoding apparatus.
Background technology
In recent years,, along with the universal and development of the Internet and the communication technology, digital media technology must be applied to multiple fields by extensive.Meanwhile, the appearance of high definition and ultra high-definition video, has higher requirement to video compression technology.High-performance video coding (High Efficiency Video Coding, HEVC) video standard adapts to this demand and is formulated.
Scalable high-performance video coding (Scalable High-efficiency Video Coding, SHVC) is the expansion in a formulation on scalable video of HEVC video encoding standard.In SHVC, video code flow contains multi-layer video data.The video data (Layer ID=0) of the bottom is called as basic layer (Base Layer, BL), and the data hierarchy (Layer ID>0) on basic layer is called as enhancement layer (Enhancement Layer, EL).Like this, in different application scene, can provide by extracting the data adaptive of different levels the vision signal of different resolution and different images quality.
In SHVC, prediction or when motion compensation between conducting frame, can adopt vague generalization residual prediction (Generalized Residual Prediction, GRP) algorithm.GRP algorithm uses base layer data correction enhancement layer prediction signal, has contributed maximum code check in SHVC to gain.But GRP has also increased the complexity of encoding and decoding greatly, has extended the time of encoding and decoding.
Summary of the invention
It is a kind of for the method for layered video coding and the method for decoding that the embodiment of the present invention provides, and encoding apparatus and decoding apparatus can reduce the complexity of coding and decoding video and the time of minimizing encoding and decoding.
First aspect, a kind of method for layered video coding is provided, comprise: determine the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece; Obtain the residual information that this associated picture piece is corresponding; The residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, whether the residual information that wherein, this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece.
In conjunction with first aspect, in the possible implementation of the first of first aspect, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
In conjunction with the possible implementation of the first of first aspect, in the possible implementation of the second of first aspect, the residual information that this is corresponding according to this associated picture piece, determines in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm.
In conjunction with the possible implementation of the first of first aspect, in the third possible implementation of first aspect, the residual information that this is corresponding according to this associated picture piece, determines in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece is indicated this associated picture piece without residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm.
In conjunction with the third possible implementation of first aspect, in the 4th kind of possible implementation of first aspect, this associated picture piece comprises the two or more encoded image pieces adjacent with this enhancement layer image piece.
In conjunction with first aspect, the possible implementation of the first of first aspect, the possible implementation of the second of first aspect, the 4th kind of possible implementation of the third possible implementation of first aspect or first aspect, in the 5th kind of possible implementation of first aspect, the method also comprises: in the time determining this vague generalization residual prediction algorithm of employing, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm, determining while not adopting this vague generalization residual prediction algorithm, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
Second aspect, provides a kind of method for layered video decoding, comprising:
Determine the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece;
Obtain residual information corresponding to described enhancement layer image piece;
The residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding.
In conjunction with second aspect, in the possible implementation of the first of second aspect, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise.
In conjunction with the possible implementation of the first of second aspect, in the possible implementation of the second of second aspect, the residual information that this is corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error after decoding, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm.
In conjunction with the possible implementation of the first of second aspect, in the third possible implementation of second aspect, the residual information that this is corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and the coded block flag of this associated picture piece indicates this associated picture piece after decoding during without residual error, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm;
In conjunction with the third possible implementation of second aspect, in the 4th kind of possible implementation of second aspect, this associated picture piece comprises the adjacent two or more decoded image blocks with this enhancement layer image piece.
In conjunction with second aspect, the possible implementation of the first of second aspect, the possible implementation of the second of second aspect, the 4th kind of possible implementation of the third possible implementation of second aspect or second aspect, in the 5th kind of possible implementation of second aspect, the method also comprises: in the time determining this vague generalization residual prediction algorithm of employing, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, to determine the pattern of described vague generalization residual prediction algorithm according to arranging of described vague generalization residual prediction flag position; Determining while not adopting this vague generalization residual prediction algorithm, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
The third aspect, provides a kind of code device, comprising:
The first determining unit, for determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece;
Acquiring unit, for obtaining residual information corresponding to described associated picture piece;
The second determining unit, for the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, whether the residual information that wherein, this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece.
In conjunction with the third aspect, in the possible implementation of the first of the third aspect, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
In conjunction with the possible implementation of the first of the third aspect, in the possible implementation of the second of the third aspect, this second determining unit specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm.
In conjunction with the possible implementation of the first of the third aspect, in the third possible implementation of the third aspect, this second determining unit specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece is indicated this associated picture piece without residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm.
In conjunction with the third possible implementation of the third aspect, in the 4th kind of possible implementation of the third aspect, this associated picture piece comprises the two or more encoded image pieces adjacent with this enhancement layer image piece.
In conjunction with the third aspect, the possible implementation of the first of the third aspect, the possible implementation of the second of the third aspect, the 4th kind of possible implementation of the third possible implementation of the third aspect or the third aspect, in the 5th kind of possible implementation of the third aspect, this code device also comprises writing unit, while adopting this vague generalization residual prediction algorithm for determining in this second determining unit, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm, determine while not adopting this vague generalization residual prediction algorithm in this second determining unit, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
Fourth aspect, provides a kind of decoding device, comprising:
The first determining unit, for determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece;
Acquiring unit, for obtaining residual information corresponding to described enhancement layer image piece;
The second determining unit, for the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding.
In conjunction with fourth aspect, in the possible implementation of the first of fourth aspect, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise.
In conjunction with the possible implementation of the first of fourth aspect, in the possible implementation of the second of fourth aspect, this second determining unit specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error after decoding, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm.
In conjunction with the possible implementation of the first of fourth aspect, in the third possible implementation of fourth aspect, this second determining unit specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and the coded block flag of this associated picture piece indicates this associated picture piece after decoding during without residual error, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm;
In conjunction with the third possible implementation of fourth aspect, in the 4th kind of possible implementation of fourth aspect, this associated picture piece comprises the adjacent two or more decoded image blocks with this enhancement layer image piece.
In conjunction with fourth aspect, the possible implementation of the first of fourth aspect, the possible implementation of the second of fourth aspect, the 4th kind of possible implementation of the third possible implementation of fourth aspect or fourth aspect, in the 5th kind of possible implementation of fourth aspect, this decoding device also comprises resolution unit, while adopting this vague generalization residual prediction algorithm for determining in this second determining unit, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, to determine the pattern of described vague generalization residual prediction algorithm according to arranging of described vague generalization residual prediction flag position, determine while not adopting this vague generalization residual prediction algorithm in this second determining unit, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
The 5th aspect, provides a kind of code device, comprises memory and processor; Program code stored in memory, processor calls the program code of storing in memory and carries out following operation:
Determine the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece;
Obtain residual information corresponding to described associated picture piece;
The residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, whether the residual information that wherein, this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece.
In conjunction with the 5th aspect, in the possible implementation of the first aspect the 5th, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
In conjunction with the possible implementation of the first of the 5th aspect, in the possible implementation of the second aspect the 5th, processor calls that the program code of storing in memory is concrete carries out following operation:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm.
In conjunction with the possible implementation of the first of the 5th aspect, in the third the possible implementation aspect the 5th, the residual information that this is corresponding according to this associated picture piece, processor calls the following operation of the concrete execution of the program code of storing in memory:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece is indicated this associated picture piece without residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm.
In conjunction with the third possible implementation of the 5th aspect, in the 4th kind of possible implementation aspect the 5th, this associated picture piece comprises the two or more encoded image pieces adjacent with this enhancement layer image piece.
In conjunction with the 5th aspect, the possible implementation of the first of the 5th aspect, the possible implementation of the second of the 5th aspect, the 4th kind of possible implementation of the third possible implementation of the 5th aspect or the 5th aspect, in the 5th kind of possible implementation aspect the 5th, processor calls the program code of storing in memory and also carries out following operation:
In the time determining this vague generalization residual prediction algorithm of employing, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm; Determining while not adopting this vague generalization residual prediction algorithm, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
The 6th aspect, provides a kind of decoding device, comprises memory and processor; Program code stored in memory, processor calls the program code of storing in memory and carries out following operation:
Determine the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece;
Obtain residual information corresponding to described enhancement layer image piece;
The residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding.
In conjunction with the 6th aspect, in the possible implementation of the first aspect the 6th, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise.
In conjunction with the possible implementation of the first of the 6th aspect, in the possible implementation of the second aspect the 6th, processor calls that the program code of storing in memory is concrete carries out following operation:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error after decoding, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm.
In conjunction with the possible implementation of the first of the 6th aspect, in the third the possible implementation aspect the 6th, the residual information that this is corresponding according to this associated picture piece, processor calls the following operation of the concrete execution of the program code of storing in memory:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and the coded block flag of this associated picture piece indicates this associated picture piece after decoding during without residual error, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm;
In conjunction with the third possible implementation of the 6th aspect, in the 4th kind of possible implementation aspect the 6th, this associated picture piece comprises the adjacent two or more decoded image blocks with this enhancement layer image piece.
In conjunction with the 6th aspect, the possible implementation of the first of the 6th aspect, the possible implementation of the second of the 6th aspect, the 4th kind of possible implementation of the third possible implementation of the 6th aspect or the 6th aspect, in the 5th kind of possible implementation aspect the 6th, processor calls the program code of storing in memory and also carries out following operation:
Adopt when this vague generalization residual prediction algorithm determining, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, with according to the pattern of determining described vague generalization residual prediction algorithm that arranges of described vague generalization residual prediction flag position; Determining while not adopting this vague generalization residual prediction algorithm, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
Therefore, in embodiments of the present invention, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out inter prediction or motion compensation, thereby can, ensureing that picture quality does not have in affected situation substantially, reduce coding and decoding video complexity and reduce the encoding and decoding time.
Brief description of the drawings
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, to the accompanying drawing of required use in the embodiment of the present invention be briefly described below, apparently, described accompanying drawing is only some embodiments of the present invention below, for those of ordinary skill in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the illustrative diagram of GRP algorithm.
Fig. 2 is according to the indicative flowchart of the method for layered video coding of the embodiment of the present invention.
Fig. 3 is the illustrative diagram of the image block that enhancement layer image piece is adjacent with it according to another embodiment of the present invention.
Fig. 4 is the indicative flowchart for the method for layered video decoding according to another embodiment of the present invention.
Fig. 5 is the schematic block diagram of code device according to another embodiment of the present invention.
Fig. 6 is the schematic block diagram of code device according to another embodiment of the present invention.
Fig. 7 is the schematic block diagram of decoding device according to another embodiment of the present invention.
Fig. 8 is the schematic block diagram of decoding device according to another embodiment of the present invention.
Fig. 9 is the schematic block diagram of code device according to another embodiment of the present invention.
Figure 10 is the schematic block diagram of decoding device according to another embodiment of the present invention.
Figure 11 is the schematic block diagram of decoding device according to another embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is a part of embodiment of the present invention, instead of whole embodiment.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain under the prerequisite of not making creative work, should belong to the scope of protection of the invention.
In order to be more expressly understood the present invention, below with reference to Fig. 1, the GRP algorithm of mentioning in the embodiment of the present invention is elaborated.
Fig. 1 shows the schematic diagram of GRP algorithm.Wherein, CurPic is current frame image, and RefPic is reference frame image; Be is the image block that enhancement layer is performed inter prediction or motion compensation, and Pe is enhancement layer prediction signal, and MVe is the enhancement layer motion vector corresponding with Pe; Equally, Bb is the image block of basic layer corresponding to Be, and Pb is basic layer prediction signal, and the motion vector of basic layer adopts the value the same with enhancement layer, i.e. MVe.
GRP algorithm is divided into three steps:
1) image block (Be) that enhancement layer is performed inter prediction or motion compensation, in enhancement layer reference frame Refpic, searches the image block mating most and obtains prediction signal Pe, obtains motion vector MVe simultaneously;
2) basic layer correspondence image piece Bb uses the motion vector MVe of enhancement layer Be, in basic layer reference frame, obtains prediction signal Pb.
3) Pe is according to formula P=P e+ w (B b-P b) revise, obtain final prediction signal P, wherein w can be 0,0.5,1, is called as respectively Res-0 pattern, Res-0.5 pattern, Res-1 pattern.
For some special circumstances, layer correspondence image piece Bb, as prediction signal, can obtain better performance substantially, thereby can be according to formula P=B b+ 0.5 (P e-P b) calculate, this pattern is called as Diff-0.5 pattern.
In sum, the pattern that GRP algorithm uses base layer data to revise the prediction signal of enhancement layer, is divided into pattern in 4: Res-0, Res-0.5, Res-1 and Diff-0.5.Correspondingly, in the grammer of coding unit, can adopt GRP flag bit (length 2 bits) to indicate corresponding pattern, for example, GRP flag bit represents respectively Res-0/Res-0.5/Res-1/Diff-0.5 pattern with 0/1/2/3, wherein, and coding unit (Coding Unit, CU) be the base unit of coding, CU inside has identical prediction mode.CU is in the present invention also referred to as image block.Prediction mode comprises inter prediction (Inter Prediction) and infra-frame prediction (Intra Prediction).A CU can be divided into multiple predicting unit (Prediction Unit, PU), and PU is the base unit of carrying out prediction.A CU can be divided into multiple converter units (Transform Unit, TU), and TU is the base unit of carrying out conversion.
Below the method for layered video coding of the embodiment of the present invention is elaborated.Fig. 1 is according to the indicative flowchart of the method 100 for layered video coding of the embodiment of the present invention.The method 100 can be carried out by code device.As shown in Figure 1, the method 100 comprises:
S110, determines basic tomographic image piece that the associated picture piece of enhancement layer image piece, this associated picture piece comprise that this enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece;
S120, obtain the residual information that this associated picture piece is corresponding, the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece.
In SHVC, due to when the inter prediction, contribute maximum code check in SHVC to gain although adopt GRP algorithm, but also greatly increase the complexity of coding, extend the time of coding, therefore needed to determine in which kind of situation, to use in GRP algorithm and which kind of situation not use GRP algorithm, can be in ensureing picture quality, reduce the complexity of coding, reduce the time of coding.
Particularly, when code device is carried out inter prediction at needs to current enhancement layer image piece, can determine the associated picture piece of this enhancement layer image piece, wherein, this associated picture piece can comprise basic tomographic image piece that this encoding enhancement layer image block is corresponding or the encoded image piece adjacent with this enhancement layer image piece; Then, code device can obtain the residual information that this associated picture piece is corresponding, and wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece; Getting after the residual information of this associated picture piece, code device can be according to the residual information of this associated picture piece, determines in the time that this enhancement layer image piece is carried out to inter prediction, whether adopts GRP algorithm; Determining need to adopt GRP algorithm time, in the time that this enhancement layer image piece is carried out to inter prediction, adopt GRP algorithm to get the prediction signal of enhancement layer image piece, determining while not needing to adopt GRP algorithm, can adopt the inter-frame forecast mode of single-layer video to carry out inter prediction to get the prediction signal of enhancement layer image piece, be while predicting between conducting frame, do not need to adopt base layer data correction enhancement layer prediction signal.Getting after the prediction signal of enhancement layer image piece, can, according to the prediction signal of this enhancement layer image piece, carry out coding to this enhancement layer image piece, for example, obtaining the residual error of this enhancement layer image piece, then carrying out orthogonal transform, quantification and entropy coding etc.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece after coding, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out inter prediction to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce video encoding complexity and reduce the Video coding time.
In embodiments of the present invention, image block is the elementary cell of encoding and decoding.Image block can be divided into one or more transform blocks.And transform block is the elementary cell of storage non-zero residual transform coefficient, comprise brightness (luma) transform block, blue poor (chroma blue, cb) transform block and red poor (chroma red, cr) transform block.
In embodiments of the present invention, the encoded image piece adjacent with enhancement layer image piece can be as shown in Figure 2, comprises upper left-hand image piece, top image block, upper right side image block, left image block and the lower left image block of this enhancement layer image piece.The associated picture piece of this enhancement layer image piece can comprise the encoded image piece of two or more (for example, upper left-hand image piece and top image blocks) adjacent with this enhancement layer image piece.Certainly, also can only include an encoded image piece.The embodiment of the present invention does not limit this.Certainly, the encoded image piece adjacent with enhancement layer image piece can be also other image block, for example, and upper left-hand image piece, top image block, upper right side image block, right-hand image block and lower right image block; Specifically can determine according to coded sequence.
In embodiments of the present invention, the residual information corresponding to associated picture piece of enhancement layer image piece can comprise: coded block flag (the coding block flag of this associated picture piece, rqt_root_cbf), at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise, wherein, whether the coded block flag of this associated picture piece has residual error after being used to indicate this associated picture piece coding, whether the coded block flag of one or more transform blocks of this associated picture piece has residual error after being used to indicate corresponding transform block coding.Wherein, the coded block flag of this image block can be residual error quaternary tree root coded block flag (the residual quad tree root coding block flag of this image block, rqt_root_cbf), for example, rqt_root_cbf be this associated picture piece of 0 expression without residual error, rqt_root_cbf is that this associated picture piece of 1 expression has residual error.The coded block flag of one or more transform blocks of this associated picture piece refers to the coded block flag (cbf_luma) of the luminance transformation piece of this associated picture piece, one or more in the coded block flag (cbf_cb) of blue poor transform block and the red coded block flag (cbf_cr) that differs from transform block.Cbf_luma is used to indicate this luminance transformation piece and whether comprises residual error non-zero transform coefficient, and for example, cbf_luma is that this luminance transformation piece of 1 expression comprises residual error non-zero transform coefficient, and cbf_luma is that this luminance transformation piece of 0 expression does not comprise residual error non-zero transform coefficient.Cbf_cr is used to indicate red poor transform block and whether comprises residual error non-zero transform coefficient, and for example, cbf_cr is that the poor transform block of this redness of 1 expression comprises residual error non-zero transform coefficient, and cbf_cr is that the poor transform block of this redness of 0 expression does not comprise residual error non-zero transform coefficient.Cbf_cb is used to indicate the poor transform block of this blueness and whether comprises residual error non-zero transform coefficient, and for example, cbf_cb is that the poor transform block of this blueness of 1 expression comprises residual error non-zero transform coefficient, and cbf_cb is that the poor transform block of this blueness of 0 expression does not comprise residual error non-zero transform coefficient.In embodiments of the present invention, residual error non-zero transform coefficient can characterize residual extent degree, specifically can characterize by number and amplitude the big or small degree of residual error.
In embodiments of the present invention, in the time determining employing GRP algorithm, code device can write GRP flag bit in enhancement layer bitstream, for example, GRP flag bit represents respectively Res-0/Res-0.5/Res-1/Diff-0.5 pattern with 0/1/2/3, thereby decoding device can be determined the GRP algorithm that need to adopt which kind of pattern according to this GRP flag bit; Determining while not adopting GRP algorithm, can GRP flag bit not write in enhancement layer bitstream, thereby can save code stream.
In an embodiment of the present invention, the residual information corresponding according to this associated picture piece described in S120, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, can comprise: in the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this GRP algorithm, or, the one or more transform blocks that comprise this associated picture piece at residual information corresponding to this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) coded block flag time, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this GRP algorithm, or, the one or more transform blocks that comprise this associated picture piece at residual information corresponding to this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) when the residual error non-zero transform coefficient that comprises, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this GRP algorithm.If do not meet above-mentioned three kinds of conditions, while prediction between conducting frame, can not adopt GRP algorithm.
In another embodiment of the invention, the residual information corresponding according to this associated picture piece described in S120, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, can comprise: in the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece is indicated this associated picture piece without residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this GRP algorithm, or, in the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and one or more transform blocks of this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) coded block flag while indicating corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this GRP algorithm, or, the one or more transform blocks that comprise this associated picture piece at residual information corresponding to this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) when the residual error non-zero transform coefficient that comprises, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this GRP algorithm.If do not meet above-mentioned three kinds of conditions, while prediction between conducting frame, can adopt GRP algorithm.
The first threshold of indication can be determined according to the statistical of residual error non-zero transform coefficient amplitude in embodiments of the present invention, for example, the mean value of the residual error non-zero transform coefficient amplitude of statistics is defined as to this first threshold.The Second Threshold of indication can be definite according to the statistical property of the residual error non-zero transform coefficient number of transform block, and for example, the mean value of the number of the residual error non-zero transform coefficient that a transform block of statistics can be had is defined as this Second Threshold.For dissimilar transform block, the value of threshold value can be different.For example, be a for the poor transform block first threshold of redness value, Second Threshold value is b, for example, a can be the mean value of residual error non-zero transform coefficient amplitude of the poor transform block of redness of statistics, the mean value of the residual error non-zero transform coefficient number that b can have for the red difference of of statistics transform block; And for the poor transform block of blueness, first threshold can value be c, Second Threshold can value be d, for example, c can be the mean value of residual error non-zero transform coefficient amplitude of the poor transform block of blueness of statistics, the mean value of the residual error non-zero transform coefficient number that d can have for the blue difference of of statistics transform block.And above-mentioned threshold value also can be relevant to quantization step.
In order to be more expressly understood the present invention, comprise that taking the associated picture piece of enhancement layer image piece the associated picture piece of corresponding basic tomographic image piece and enhancement layer image piece comprises that adjacent encoded image piece describes as example respectively below.Wherein, the coded block flag of image block is that rqt_root_cbf is that example describes, but the embodiment of the present invention does not limit this.
First below comprise that taking the associated picture piece of enhancement layer image piece corresponding basic tomographic image piece describes as example.
In embodiments of the present invention, code device can obtain the rqt_root_cbf of the basic tomographic image piece that enhancement layer image piece is corresponding from basic layer bit stream; After this rqt_root_cbf indicates this basic tomographic image piece coding during without residual error, for example, rqt_root_cbf be 0 instruction without residual error, code device can directly be determined in the time that this enhancement layer image piece is carried out to inter prediction, not adopt GRP algorithm.Have residual error after this rqt_root_cbf indicates this basic tomographic image piece coding time, for example, rqt_root_cbf is that 1 instruction has residual error, and code device can directly be determined in the time that this enhancement layer image piece is carried out to inter prediction, adopt GRP algorithm.
In embodiments of the present invention, though the rqt_root_cbf of the basic tomographic image piece that enhancement layer image piece is corresponding has residual error after indicating this basic tomographic image piece coding, code device also can further determine that a transform block of this basic tomographic image piece (can be any transform block, also can be a transform block of specifying) or multiple transform block (can be any number of transform blocks, can be also multiple transform blocks of specifying) whether comprise residual error non-zero transform coefficient; Particularly, code device can obtain the coded block flag of one or more transform blocks of this basic tomographic image piece from basic layer bit stream, thereby according to the coded block flag of these one or more transform blocks of this basic tomographic image piece, determine whether corresponding transform block comprises residual error non-zero transform coefficient; In the time that the coded block flag of this one or more transform blocks of this basic tomographic image piece indicates corresponding transform block not comprise residual error non-zero transform coefficient (wherein, if what detect is the coded block flag of multiple transform blocks, need the plurality of transform block all not comprise residual error non-zero transform coefficient), can directly determine in the time that this enhancement layer image piece is carried out to inter prediction, not adopt GRP algorithm.When the coded block flag of any in these one or more transform blocks of this basic tomographic image piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, can directly determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt GRP algorithm.
In embodiments of the present invention, when coded block flag some or multiple transform blocks in one or more transform blocks of basic tomographic image piece corresponding to enhancement layer image piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, code device can also further be determined number and the amplitude of the residual error non-zero transform coefficient that these some or multiple transform blocks comprise.If the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is greater than the number of first threshold and residual error non-zero transform coefficient while being greater than Second Threshold, can determine and adopt GRP algorithm, otherwise can determine and do not adopt GRP algorithm.Certainly, also can determine whether in such a way to adopt GRP algorithm: be less than Second Threshold if the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is less than the number of first threshold and residual error non-zero transform coefficient, can determine and not adopt GRP algorithm, otherwise can determine employing GRP algorithm.
Secondly below comprise adjacent image block with the associated picture piece of enhancement layer image piece, and this adjacent image block is that left image block and top image block are that example describes, is not limited to this but should understand the embodiment of the present invention.
In embodiments of the present invention, code device can obtain the rqt_root_cbf of top image block and the rqt_root_cbf of left image block of enhancement layer image piece from enhancement layer bitstream; Above this above rqt_root_cbf of image block instruction after image block coding without after the rqt_root_cbf instruction left image block coding of residual error and left image block during without residual error, for example, rqt_root_cbf is that 0 instruction is without residual error, code device can directly be determined in the time that this enhancement layer image piece is carried out to inter prediction, not adopt GRP algorithm.Above this, above the rqt_root_cbf of image block instruction, after image block coding, there is the rqt_root_cbf instruction left image block of residual error or left image block to encode while having residual error, for example, rqt_root_cbf is that 1 instruction has residual error, code device can directly be determined in the time that this enhancement layer image piece is carried out to inter prediction, adopt GRP algorithm.Below after hypothesis top image block and left image block coding, all there is residual error.
In embodiments of the present invention, after the image block coding of the rqt_root_cbf of image block instruction top, there is up the rqt_root_cbf instruction left image block of residual sum left image block to encode while having residual error, code device also can further determine that one or more transform blocks of this top image block (can be one or more transform blocks arbitrarily, also can be one or more transform blocks of specifying) and one or more transform blocks of left image block (can be one or more transform blocks arbitrarily, also can be one or more transform blocks of specifying) whether comprise residual error non-zero transform coefficient, particularly, code device can obtain the coded block flag of one or more transform blocks of this top image block from enhancement layer bitstream, according to the coded block flag of these one or more transform blocks of this top image block, whether the transform block of determining top image block comprises residual error non-zero transform coefficient, and from code stream, obtain the coded block flag of one or more transform blocks of this left image block, according to the coded block flag of these one or more transform blocks of this left image block, determine whether the transform block of left image block comprises residual error non-zero transform coefficient, above this, the coded block flag of these one or more transform blocks of image block indicates corresponding transform block not comprise residual error non-zero transform coefficient and when coded block flag of these one or more transform blocks of image block indicates corresponding transform block not comprise residual error non-zero transform coefficient above this, can directly determine in the time that this enhancement layer image piece is carried out to inter prediction, not adopt GRP algorithm.When above this, the coded block flag of these one or more transform blocks of image block indicates the coded block flag of these one or more transform blocks that corresponding transform block comprises residual error non-zero transform coefficient or this left image block to indicate corresponding transform block to comprise residual error non-zero transform coefficient, can directly determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt GRP algorithm.Below hypothesis only has the coded block flag some or multiple transform blocks in one or more transform blocks of left image block to indicate corresponding transform block to comprise residual error non-zero transform coefficient.
In embodiments of the present invention, though when the coded block flag some or multiple transform blocks in one or more transform blocks of the left image block of enhancement layer image piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, code device can also further be determined number and the amplitude of the residual error non-zero transform coefficient that these some or multiple transform blocks of left image block comprise.If the amplitude of the residual error non-zero transform coefficient comprising is greater than the number of first threshold and residual error non-zero transform coefficient while being greater than Second Threshold, can determine and adopt GRP algorithm, otherwise, determine and do not adopt GRP algorithm.Certainly, also can determine whether in such a way to adopt GRP algorithm: when the number that the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is less than first threshold and residual error non-zero transform coefficient is less than Second Threshold, can determine and not adopt GRP algorithm, otherwise can determine employing GRP algorithm.
Should understand, in embodiments of the present invention, code device also can directly obtain the coded block flag of the transform block of the associated picture piece of enhancement layer image piece from code stream, but not have after residual error after the rqt_root_cbf of associated picture piece that determines enhancement layer image piece indicates this associated picture piece coding, just obtain the coded block flag of the transform block of the associated picture piece of this enhancement layer image piece.Will also be understood that, in embodiments of the present invention, code device also can directly obtain the residual error non-zero transform coefficient of one or more transform blocks of the associated picture piece of enhancement layer image piece from code stream, and judge size and the amplitude of the residual error non-zero transform coefficient of these one or more transform blocks, or after indicating this associated picture piece coding, the rqt_root_cbf of associated picture piece that determines this enhancement layer image piece has after residual error, directly from code stream, obtain the residual error non-zero transform coefficient of one or more transform blocks of the associated picture piece of enhancement layer image piece, and judge size and the amplitude of the residual error non-zero transform coefficient of these one or more transform blocks, but not obtaining the coded block flag of transform block of this associated picture piece, determine that corresponding transform block comprises the residual error non-zero transform coefficient that just obtains one or more transform blocks of the associated picture piece of enhancement layer image piece after residual error non-zero transform coefficient.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out inter prediction to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce video encoding complexity and reduce the Video coding time.
Below describe the method for layered video coding according to the embodiment of the present invention in conjunction with Fig. 2 and Fig. 3, described the method for layered video decoding according to the embodiment of the present invention below with reference to Fig. 4.
Fig. 4 is according to the indicative flowchart of the method 200 for layered video decoding of the embodiment of the present invention.As shown in Figure 4, the method 200 comprises:
S210, determines basic tomographic image piece that the associated picture piece of enhancement layer image piece, this associated picture piece comprise that enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece;
S220, obtain the residual information that this enhancement layer image piece is corresponding, the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding.
In SHVC, due to when the motion compensation, can contribute maximum code check in SHVC to gain though adopt GRP algorithm, but also greatly increase the complexity of decoding, extend the time of decoding, therefore needed to determine in which kind of situation, to use in GRP algorithm and which kind of situation not use GRP algorithm, can be in ensureing picture quality, reduce the complexity of decoding, reduce the time of decoding.
Particularly, decoding device is in the time need to carrying out the motion compensation in decoding and rebuilding operation to current enhancement layer image piece, can determine the associated picture piece of this enhancement layer image piece, wherein, this associated picture piece can comprise basic tomographic image piece that this decoding enhancement layer image block is corresponding or the decoded image blocks adjacent with this enhancement layer image piece; Then, decoding device can obtain the residual information that this associated picture piece is corresponding, and wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding; Getting after the residual information of this associated picture piece, decoding device can be according to the residual information of this associated picture piece, determines in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopts GRP algorithm; Determining need to adopt GRP algorithm time, in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt GRP algorithm with the prediction signal of obtaining this enhancement layer image piece to obtain the prediction signal of this enhancement layer image piece, determining while not needing to adopt GRP algorithm, can adopt the movement compensating algorithm of single-layer video compress technique, in the time of the motion compensation of carrying out in decoding and rebuilding operation, do not need to adopt base layer data correction enhancement layer prediction signal.Then, decoding device can, according to this prediction signal, be carried out decoding to this enhancement layer image piece, for example, adds the residual error of this enhancement layer image piece by the prediction signal of this enhancement layer image piece, obtains reconstructed image piece.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece, the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out the motion compensation in decoding and rebuilding operation to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce video decoding complexity and reduce the video decode time.
In embodiments of the present invention, can, with reference to shown in figure 2 and adjacent encoded image piece enhancement layer image piece, comprise upper left-hand image piece, top image block, upper right side image block, left image block and the lower left image block of this enhancement layer image piece with the adjacent decoded image blocks of enhancement layer image piece.Certainly, the decoded image blocks adjacent with enhancement layer image piece can be also other image block, for example, and upper left-hand image piece, top image block, upper right side image block, right-hand image block and lower right image block; Specifically can determine according to decoding order.The associated picture piece of this enhancement layer image piece can comprise the decoded image blocks of two or more (for example, upper left-hand image piece and top image blocks) adjacent with this enhancement layer image piece.Certainly, also can only include a decoded image blocks.The embodiment of the present invention does not limit this.
In embodiments of the present invention, the residual information corresponding to associated picture piece of enhancement layer image piece can comprise: coded block flag (the coding block flag of this associated picture piece, rqt_root_cbf), at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise, whether the coded block flag of this associated picture piece has residual error after being used to indicate this associated picture piece decoding, whether the coded block flag of one or more transform blocks of this associated picture piece has residual error after being used to indicate corresponding transform block decoding.Wherein, the coded block flag of this image block can be residual error quaternary tree root coded block flag (the residual quad tree root coding block flag of this image block, rqt_root_cbf), for example, rqt_root_cbf be after the decoding of this associated picture piece of 0 expression without residual error, rqt_root_cbf has residual error after this associated picture piece decoding of 1 expression.The coded block flag of one or more transform blocks of this associated picture piece refers to the coded block flag (cbf_luma) of the luminance transformation piece of this associated picture piece, one or more in the coded block flag (cbf_cb) of blue poor transform block and the red coded block flag (cbf_cr) that differs from transform block.Cbf_luma is used to indicate this luminance transformation piece and whether comprises residual error non-zero transform coefficient, and for example, cbf_luma is that this luminance transformation piece of 1 expression comprises residual error non-zero transform coefficient, and cbf_luma is that this luminance transformation piece of 0 expression does not comprise residual error non-zero transform coefficient.Cbf_cr is used to indicate red poor transform block and whether comprises residual error non-zero transform coefficient, and for example, cbf_cr is that the poor transform block of this redness of 1 expression comprises residual error non-zero transform coefficient, and cbf_cr is that the poor transform block of this redness of 0 expression does not comprise residual error non-zero transform coefficient.Cbf_cb is used to indicate the poor transform block of this blueness and whether comprises residual error non-zero transform coefficient, and for example, cbf_cb is that the poor transform block of this blueness of 1 expression comprises residual error non-zero transform coefficient, and cbf_cb is that the poor transform block of this blueness of 0 expression does not comprise residual error non-zero transform coefficient.
In embodiments of the present invention, determining that while adopting GRP algorithm, decoding device is resolved GRP flag bit from enhancement layer bitstream, determining that while not adopting GRP algorithm, decoding device is not resolved GRP flag bit from enhancement layer bitstream, thereby can reduce the difficulty of decoding.
In an embodiment of the present invention, the residual information corresponding according to this associated picture piece in S220, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, can comprise: in the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error after decoding, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this GRP algorithm, or, the one or more transform blocks that comprise this associated picture piece at residual information corresponding to this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) coded block flag time, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this GRP algorithm, or, in the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and one or more transform blocks of this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) the amplitude of the residual error non-zero transform coefficient number that is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece when being greater than at least one in Second Threshold and being met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this GRP algorithm.In the time that above-mentioned three kinds of conditions are not being met, can determine and not adopt this GRP algorithm.
In another embodiment of the invention, the residual information corresponding according to this associated picture piece in S220, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, can comprise: in the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and the coded block flag of this associated picture piece indicates this associated picture piece after decoding during without residual error, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this GRP algorithm, or, the one or more transform blocks that comprise this associated picture piece at residual information corresponding to this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) coded block flag time, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this GRP algorithm, or, in the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and one or more transform blocks of this associated picture piece (can be one or more transform blocks of specifying, also can be any one or more transform blocks) the amplitude of the residual error non-zero transform coefficient number that is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece when being less than at least one in Second Threshold and being met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this GRP algorithm.In the time that above-mentioned three kinds of conditions are not being met, can determine and adopt this GRP algorithm.
In embodiments of the present invention, above-mentioned first threshold can be determined according to the statistical of residual error non-zero transform coefficient amplitude, for example, the mean value of the residual error non-zero transform coefficient amplitude of statistics is defined as to this first threshold.This Second Threshold can be definite according to the statistical property of the residual error non-zero transform coefficient number of transform block, and for example, the mean value of the number of the residual error non-zero transform coefficient that a transform block of statistics can be had is defined as this Second Threshold.For dissimilar transform block, the value of threshold value can be different.For example, be a for the poor transform block first threshold of redness value, Second Threshold value is b, for example, a can be the mean value of residual error non-zero transform coefficient amplitude of the poor transform block of redness of statistics, the mean value of the residual error non-zero transform coefficient number that b can have for the red difference of of statistics transform block; And for the poor transform block of blueness, first threshold can value be c, Second Threshold can value be d.For example, c can be the mean value of residual error non-zero transform coefficient amplitude of the poor transform block of blueness of statistics, the mean value of the residual error non-zero transform coefficient number that d can have for the blue difference of of statistics transform block.And above-mentioned threshold value also can be relevant to quantization step.
In order to be more expressly understood the present invention, comprise that taking the associated picture piece of enhancement layer image piece the associated picture piece of corresponding basic tomographic image piece and enhancement layer image piece comprises that adjacent decoded image blocks describes as example respectively below.Wherein, the coded block flag of image block is that rqt_root_cbf is that example describes, but the embodiment of the present invention does not limit this.
First below comprise that taking the associated picture piece of enhancement layer image piece basic tomographic image piece that enhancement layer is corresponding describes as example.
In embodiments of the present invention, decoding device can obtain the rqt_root_cbf of the basic tomographic image piece that enhancement layer image piece is corresponding from basic layer bit stream; After this rqt_root_cbf indicates this basic tomographic image piece decoding during without residual error, for example, rqt_root_cbf be 0 instruction without residual error, decoding device can directly be determined in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, not adopt GRP algorithm.Have residual error after this rqt_root_cbf indicates this basic tomographic image piece decoding time, for example, rqt_root_cbf is that 1 instruction has residual error, and decoding device can directly be determined in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt GRP algorithm.
In embodiments of the present invention, have residual error after the rqt_root_cbf of basic tomographic image piece corresponding to enhancement layer image piece indicates this basic tomographic image piece decoding time, decoding device also can further determine that a transform block of this basic tomographic image piece (can be any transform block, also can be a transform block of specifying) or multiple transform block (can be any number of transform blocks, can be also multiple transform blocks of specifying) whether comprise residual error non-zero transform coefficient; Particularly, decoding device can obtain the coded block flag of one or more transform blocks of this basic tomographic image piece, thereby according to the coded block flag of these one or more transform blocks of this basic tomographic image piece, determine whether corresponding transform block comprises residual error non-zero transform coefficient; In the time that the coded block flag of this one or more transform blocks of this basic tomographic image piece indicates corresponding transform block not comprise residual error non-zero transform coefficient (wherein, if what detect is the coded block flag of multiple transform blocks, need the plurality of transform block all not comprise residual error non-zero transform coefficient), can directly determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, not adopt GRP algorithm.When any coded block flag in these one or more transform blocks of this basic tomographic image piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, can directly determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt GRP algorithm.
In embodiments of the present invention, when coded block flag some or multiple transform blocks in one or more transform blocks of basic tomographic image piece corresponding to enhancement layer image piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, decoding device can also further be determined number and the amplitude of the residual error non-zero transform coefficient that these some or multiple transform blocks comprise.If the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is greater than the number of first threshold and residual error non-zero transform coefficient while being greater than Second Threshold, can determine and adopt GRP algorithm, otherwise can be defined as not adopting GRP algorithm.Also can determine whether in such a way to adopt GRP algorithm: when the number that the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is less than first threshold and residual error non-zero transform coefficient is less than Second Threshold, can determine and not adopt GRP algorithm, otherwise adopt GRP algorithm.
Secondly below comprise adjacent decoded image blocks with the associated picture piece of enhancement layer image piece, and this adjacent decoded image blocks is that left image block and top image block are that example describes, is not limited to this but should understand the embodiment of the present invention.
In embodiments of the present invention, decoding device can obtain the rqt_root_cbf of top image block and the rqt_root_cbf of left image block of enhancement layer image piece from enhancement layer bitstream; Above this above rqt_root_cbf of image block instruction after image block decoding without after the rqt_root_cbf instruction left image block decoding of residual error and left image block during without residual error, for example, rqt_root_cbf is that 0 instruction is without residual error, decoding device can directly be determined in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, not adopt GRP algorithm.When above this, above the rqt_root_cbf of image block instruction, image block has residual error after having the rqt_root_cbf instruction left image block of residual error or left image block to decode after decoding, for example, rqt_root_cbf is that 1 instruction has residual error, decoding device can directly be determined in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt GRP algorithm.But below after hypothesis top image block and the decoding of left image block, all there is residual error.
In embodiments of the present invention, the rqt_root_cbf of image block instruction top image block has residual error after having the rqt_root_cbf instruction left image block of residual sum left image block to decode after decoding up, decoding device also can further determine that one or more transform blocks of this top image block (can be one or more transform blocks arbitrarily, also can be one or more transform blocks of specifying) and one or more transform blocks of left image block (can be one or more transform blocks arbitrarily, also can be one or more transform blocks of specifying) whether comprise residual error non-zero transform coefficient, particularly, decoding device can obtain the coded block flag of one or more transform blocks of this top image block from enhancement layer bitstream, according to the coded block flag of these one or more transform blocks of this top image block, whether the transform block of determining top image block comprises residual error non-zero transform coefficient, and from enhancement layer bitstream, obtain the coded block flag of one or more transform blocks of this left image block, according to the coded block flag of these one or more transform blocks of this left image block, determine whether the transform block of left image block comprises residual error non-zero transform coefficient, above this, the coded block flag of these one or more transform blocks of image block indicates corresponding transform block not comprise residual error non-zero transform coefficient and when coded block flag of these one or more transform blocks of image block indicates corresponding transform block not comprise residual error non-zero transform coefficient above this, can directly determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, not adopt GRP algorithm.When above this, the coded block flag of these one or more transform blocks of image block indicates the coded block flag of these one or more transform blocks that corresponding transform block comprises residual error non-zero transform coefficient or this left image block to indicate corresponding transform block to comprise residual error non-zero transform coefficient, can directly determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt GRP algorithm.Below hypothesis only has the coded block flag some or multiple transform blocks in these one or more transform blocks of left image block to indicate corresponding transform block to comprise residual error non-zero transform coefficient.
In embodiments of the present invention, when coded block flag some or multiple transform blocks in one or more transform blocks of the left image block of enhancement layer image piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, decoding device can also further be determined number and the amplitude of the residual error non-zero transform coefficient that these some or multiple transform blocks of left image block comprise.If the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is greater than the number of first threshold and residual error non-zero transform coefficient while being greater than Second Threshold, can determine and adopt GRP algorithm, otherwise can be defined as not adopting GRP algorithm.Also can determine whether in such a way to adopt GRP algorithm: when the number that the amplitude of the residual error non-zero transform coefficient that each transform block in these some or multiple transform blocks comprises is less than first threshold and residual error non-zero transform coefficient is less than Second Threshold, can determine and not adopt GRP algorithm, otherwise adopt GRP algorithm.
Should understand, in embodiments of the present invention, decoding device also can directly obtain the coded block flag of the transform block of the associated picture piece of enhancement layer image piece from code stream, but not have after residual error after the rqt_root_cbf of associated picture piece that determines enhancement layer image piece indicates this associated picture piece decoding, just obtain the coded block flag of the transform block of the associated picture piece of this enhancement layer image piece.Will also be understood that, in embodiments of the present invention, decoding device also can directly obtain the residual error non-zero transform coefficient of one or more transform blocks of the associated picture piece of enhancement layer image piece from code stream, and judge size and the amplitude of the residual error non-zero transform coefficient of these one or more transform blocks, or after indicating this associated picture piece decoding, the rqt_root_cbf of associated picture piece that determines this enhancement layer image piece has after residual error, directly from code stream, obtain the residual error non-zero transform coefficient of one or more transform blocks of the associated picture piece of enhancement layer image piece, and judge size and the amplitude of the residual error non-zero transform coefficient of these one or more transform blocks, but not obtaining the coded block flag of transform block of this associated picture piece, determine that corresponding transform block comprises the residual error non-zero transform coefficient that just obtains one or more transform blocks of the associated picture piece of enhancement layer image piece after residual error non-zero transform coefficient.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out the motion compensation in decoding and rebuilding operation to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce decoding complex degree and reduce decode time.
Below in conjunction with Fig. 1 to Fig. 4 described according to the embodiment of the present invention for the method for layered video coding and the method for decoding.Describe according to the encoding apparatus and decoding apparatus of the embodiment of the present invention below with reference to Fig. 5 to Figure 10.
Fig. 5 is according to the schematic block diagram of the code device 300 of the embodiment of the present invention.This code device 300 can be encoder.As shown in Figure 5, this code device 300 comprises:
The first determining unit 310, for determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece;
Acquiring unit 340, for obtaining the residual information that this associated picture piece is corresponding;
The second determining unit 320, for the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, whether the residual information that wherein, this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece.
Alternatively, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, and whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
Alternatively, this second determining unit 320 specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, adopt this vague generalization residual prediction algorithm.
Alternatively, this second determining unit 320 specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece is indicated this associated picture piece without residual error, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to inter prediction, do not adopt this vague generalization residual prediction algorithm.
Alternatively, this associated picture piece comprises the two or more encoded image pieces adjacent with this enhancement layer image piece.
Alternatively, as shown in Figure 6, this code device 300 also comprises writing unit 330, while adopting this vague generalization residual prediction algorithm for determining in this second determining unit 320, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm, determine while not adopting this vague generalization residual prediction algorithm in this second determining unit 320, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
Should understand, can be corresponding to the code device of the method for layered video coding in the embodiment of the present invention according to the code device 300 of the embodiment of the present invention, and above-mentioned and other operation of the unit in code device 300 and/or function are respectively in order to realize the corresponding flow process of the method 100 in Fig. 1, for simplicity, do not repeat them here.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out inter prediction to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce encoder complexity and reduce the scramble time.
Fig. 7 is according to the schematic block diagram of the decoding device 400 of the embodiment of the present invention.This decoding device 400 can be decoder.As shown in Figure 7, this decoding device 400 comprises:
The first determining unit 410, for determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece;
Acquiring unit 440, for obtaining the residual information that this enhancement layer image piece is corresponding;
The second determining unit 420, for the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding.
Alternatively, the residual information that this associated picture piece is corresponding comprises the coded block flag of this associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of this associated picture piece and this associated picture piece comprise.
Alternatively, this second determining unit 420 specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and when the coded block flag of this associated picture piece indicates this associated picture piece to have residual error after decoding, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt this vague generalization residual prediction algorithm.
Alternatively, this second determining unit 420 specifically for:
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of this associated picture piece, and the coded block flag of this associated picture piece indicates this associated picture piece after decoding during without residual error, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the coded block flag of one or more transform blocks of this associated picture piece, and when the coded block flag of one or more transform blocks of this associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to this associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of this associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of this associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and this associated picture piece is less than at least one in Second Threshold and is met, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt this vague generalization residual prediction algorithm;
Alternatively, this associated picture piece comprises and adjacent two or more decoded image blocks of this enhancement layer image piece.
Alternatively, as shown in Figure 8, this decoding device 400 also comprises resolution unit 430, while adopting this vague generalization residual prediction algorithm for determining in this second determining unit 420, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, to determine the pattern of described vague generalization residual prediction algorithm according to arranging of described vague generalization residual prediction flag position; Determine while not adopting this vague generalization residual prediction algorithm in this second determining unit 420, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
Should understand, can be corresponding to the code device of the method for layered video coding in the embodiment of the present invention according to the decoding device 400 of the embodiment of the present invention, and above-mentioned and other operation of the unit in decoding device 400 and/or function are respectively in order to realize the corresponding flow process of the method 200 in Fig. 4, for simplicity, do not repeat them here.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out the motion compensation in decoding and rebuilding operation to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce decoding complex degree and reduce decode time.
Fig. 9 is according to the schematic block diagram of the code device 500 of the embodiment of the present invention.This code device 500 can be encoder.As shown in Figure 9, this code device 500 comprises memory 510 and processor 520.This memory 510 is program code stored, and processor 520 can call the following operation of program code execution of storage in memory 510:
Determine the associated picture piece of enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with described enhancement layer image piece;
Acquiring unit, for obtaining residual information corresponding to described associated picture piece;
According to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, whether wherein, residual information corresponding to described associated picture piece is used to indicate described associated picture piece the residual error size degree of residual error or described associated picture piece.
Alternatively, residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of described associated picture piece and described associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, and whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
Alternatively, processor 520 can call the following operation of the concrete execution of program code of storage in memory 510:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece indicates described associated picture piece to have residual error, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm.
Alternatively, processor 520 can call the following operation of the concrete execution of program code of storage in memory 510:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when described associated picture piece coded block flag is indicated described associated picture piece without residual error, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is less than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm.
Alternatively, described associated picture piece comprises the two or more encoded image pieces adjacent with described enhancement layer image piece.
Alternatively, processor 520 calls the program code of storing in memory 510 and can also carry out following operation:
In the time determining the described vague generalization residual prediction algorithm of employing, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm;
Determining while not adopting described vague generalization residual prediction algorithm, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
Should understand, can be corresponding to the code device of the method for layered video coding in the embodiment of the present invention according to the code device 500 of the embodiment of the present invention, and above-mentioned and other operation of the unit in code device 500 and/or function are respectively in order to realize the corresponding flow process of the method 100 in Fig. 1, for simplicity, do not repeat them here.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the encoded image piece adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to inter prediction, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece the residual error size degree of residual error or this associated picture piece, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out inter prediction to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce encoder complexity and reduce the scramble time.
Figure 10 is according to the schematic block diagram of the decoding device 600 of the embodiment of the present invention.This decoding device 600 can be decoder.As shown in figure 10, this code device 600 comprises memory 610 and processor 620.This memory 610 is program code stored, and processor 620 can call the following operation of program code execution of storage in memory 610:
Determine the associated picture piece of enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with described enhancement layer image piece;
Obtain residual information corresponding to described enhancement layer image piece;
According to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether residual information corresponding to described associated picture piece is used to indicate described associated picture piece has residual error or described associated picture piece in decoded residual error size degree after decoding.
Alternatively, residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of described associated picture piece and described associated picture piece comprise.
Alternatively, processor 620 calls the following operation of the concrete execution of program code of storage in memory 610:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece indicates described associated picture piece to have residual error after decoding, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm.
Alternatively, processor 620 can call the following operation of the concrete execution of program code of storage in memory 610:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and the coded block flag of described associated picture piece indicates described associated picture piece after decoding during without residual error, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is less than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm;
Alternatively, described associated picture piece comprises and adjacent two or more decoded image blocks of described enhancement layer image piece.
Alternatively, processor 620 calls the program code of storing in memory 610 and can also carry out following operation:
Adopt when described vague generalization residual prediction algorithm determining, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, with according to the pattern of determining described vague generalization residual prediction algorithm that arranges of described vague generalization residual prediction flag position;
Determining while not adopting described vague generalization residual prediction algorithm, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
Should understand, can be corresponding to the code device of the method for layered video coding in the embodiment of the present invention according to the decoding device 600 of the embodiment of the present invention, and above-mentioned and other operation of the unit in decoding device 600 and/or function are respectively in order to realize the corresponding flow process of the method 200 in Fig. 4, for simplicity, do not repeat them here.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out motion compensation to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce decoding complex degree and reduce decode time.
Figure 11 is according to the schematic block diagram of the decoder 700 of the embodiment of the present invention.As shown in figure 11, this decoder 700 comprises entropy decoding unit 710, predicting unit 720, coefficient scanning unit 730, inverse quantization unit 740, inverse transformation block 750, adder 760 and frame storaging piece 770.
Entropy decoding unit 710 carries out after entropy decoding the bit stream receiving, and obtains header information and 1 dimensional vector.
Predicting unit 720 is carried out motion compensation according to header information, to obtain predicting piece, wherein, before to enhancement layer image piece execution motion compensation, can determine whether to adopt GRP pattern to carry out motion compensation, specifically can first determine the associated picture piece of this enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with described enhancement layer image piece, then obtain residual information corresponding to described associated picture piece, according to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, wherein, whether residual information corresponding to described associated picture piece is used to indicate described associated picture piece the residual error size degree of residual error or described associated picture piece.Concrete judge whether to adopt GRP algorithm, can, with reference to above describing, not repeat them here.The feedback information of predicting unit 720 received frame storaging pieces 770, if frame storaging piece 770 without memory space, predicting unit 720 quits work.
1 dimensional vector is carried out coefficient scanning unit 730 that coefficient scanning, inverse quantization unit 740 are carried out re-quantization, inverse orthogonal transformation unit 750 obtains residual block after carrying out inverse orthogonal transformation successively.Adder 760 obtains the image block of rebuilding according to the residual block of prediction piece and reconstruction, the image block of reconstruction is put into frame storaging piece 770, and show at display place.
Therefore, in embodiments of the present invention, by determining the associated picture piece of enhancement layer image piece, this associated picture piece comprises basic tomographic image piece that this enhancement layer image piece is corresponding or the decoded image blocks adjacent with this enhancement layer image piece, and the residual information corresponding according to this associated picture piece, determine in the time that this enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt GRP algorithm, wherein, whether the residual information that this associated picture piece is corresponding is used to indicate this associated picture piece has residual error or this associated picture piece in decoded residual error size degree after decoding, thereby, only according to the residual information of associated picture piece, determine need to adopt GRP algorithm time, just adopt GRP algorithm to carry out motion compensation to enhancement layer image piece, thereby can ensure that picture quality does not have in affected situation substantially, reduce decoding complex degree and reduce decode time.
Those of ordinary skill in the art can recognize, unit and the algorithm steps of each example of describing in conjunction with embodiment disclosed herein, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can realize described function with distinct methods to each specifically should being used for, but this realization should not thought and exceeds scope of the present invention.
Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the system of foregoing description, device and unit, can, with reference to the corresponding process in preceding method embodiment, not repeat them here.
In the several embodiment that provide in the application, should be understood that disclosed system, apparatus and method can realize by another way.For example, device embodiment described above is only schematic, for example, the division of described unit, be only that a kind of logic function is divided, when actual realization, can have other dividing mode, for example multiple unit or assembly can in conjunction with or can be integrated into another system, or some features can ignore, or do not carry out.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, indirect coupling or the communication connection of device or unit can be electrically, machinery or other form.
The described unit as separating component explanation can or can not be also physically to separate, and the parts that show as unit can be or can not be also physical locations, can be positioned at a place, or also can be distributed in multiple network element.Can select according to the actual needs some or all of unit wherein to realize the object of the present embodiment scheme.
In addition, the each functional unit in each embodiment of the present invention can be integrated in a processing unit, can be also that the independent physics of unit exists, and also can be integrated in a unit two or more unit.
If described function realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium using the form of SFU software functional unit.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CDs.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, any be familiar with those skilled in the art the present invention disclose technical scope in; can expect easily changing or replacing, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with the protection range of claim.

Claims (24)

1. for a method for layered video coding, it is characterized in that, comprising:
Determine the associated picture piece of enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with described enhancement layer image piece;
Obtain residual information corresponding to described associated picture piece;
According to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, whether wherein, residual information corresponding to described associated picture piece is used to indicate described associated picture piece the residual error size degree of residual error or described associated picture piece.
2. method according to claim 1, it is characterized in that, residual information corresponding to described associated picture piece comprises the volume coded block flag of described associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of described associated picture piece and described associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
3. method according to claim 2, is characterized in that, described according to residual information corresponding to described associated picture piece, determines in the time that described enhancement layer image piece is carried out to inter prediction, whether adopts vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece indicates described associated picture piece to have residual error, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm.
4. method according to claim 2, is characterized in that, described according to residual information corresponding to described associated picture piece, determines in the time that described enhancement layer image piece is carried out to inter prediction, whether adopts vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece is indicated described associated picture piece without residual error, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is less than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm.
5. method according to claim 4, is characterized in that, described associated picture piece comprises the two or more encoded image pieces adjacent with described enhancement layer image piece.
6. according to the method described in any one in claim 1 to 5, it is characterized in that, described method also comprises:
In the time determining the described vague generalization residual prediction algorithm of employing, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm;
Determining while not adopting described vague generalization residual prediction algorithm, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
7. for a method for layered video decoding, it is characterized in that, comprising:
Determine the associated picture piece of enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with described enhancement layer image piece;
Obtain residual information corresponding to described enhancement layer image piece;
According to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether residual information corresponding to described associated picture piece is used to indicate described associated picture piece the residual error size degree of residual error or described associated picture piece.
8. method according to claim 7, it is characterized in that, residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of described associated picture piece and described associated picture piece comprise.
9. method according to claim 8, it is characterized in that, described according to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece indicates described associated picture piece to have residual error, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm.
10. method according to claim 8, it is characterized in that, described according to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, comprising:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece is indicated described associated picture piece without residual error, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is less than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm.
11. methods according to claim 10, is characterized in that, described associated picture piece comprises the adjacent two or more decoded image blocks with described enhancement layer image piece.
12. according to the method described in any one in claim 7 to 11, it is characterized in that, described method also comprises:
Adopt when described vague generalization residual prediction algorithm determining, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, with according to the pattern of determining described vague generalization residual prediction algorithm that arranges of described vague generalization residual prediction flag position;
Determining while not adopting described vague generalization residual prediction algorithm, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
13. 1 kinds of code devices, is characterized in that, comprising:
The first determining unit, for determining the associated picture piece of enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the encoded image piece adjacent with described enhancement layer image piece;
Acquiring unit, for obtaining residual information corresponding to described associated picture piece;
The second determining unit, be used for according to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to inter prediction, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described inter prediction to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is encoded, wherein, whether residual information corresponding to described associated picture piece is used to indicate described associated picture piece the residual error size degree of residual error or described associated picture piece.
14. code devices according to claim 13, it is characterized in that, residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of described associated picture piece and described associated picture piece comprise, wherein, whether the coded block flag of described associated picture piece is used to indicate described associated picture piece residual error, whether the coded block flag of one or more transform blocks of described associated picture piece is used to indicate corresponding transform block residual error.
15. code devices according to claim 14, is characterized in that, described the second determining unit specifically for:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece indicates described associated picture piece to have residual error, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to inter prediction, adopt described vague generalization residual prediction algorithm.
16. code devices according to claim 14, is characterized in that, described the second determining unit specifically for:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece is indicated described associated picture piece without residual error, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is less than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to inter prediction, do not adopt described vague generalization residual prediction algorithm.
17. code devices according to claim 16, is characterized in that, described associated picture piece comprises the two or more encoded image pieces adjacent with described enhancement layer image piece.
18. according to claim 13 to the code device described in any one in 17, it is characterized in that, described code device also comprises writing unit, while adopting described vague generalization residual prediction algorithm for determining in described the second determining unit, vague generalization residual prediction flag position is write in enhancement layer bitstream, wherein, the described vague generalization residual prediction flag position writing in described enhancement layer bitstream is set to indicate the pattern of described vague generalization residual prediction algorithm, determine while not adopting described vague generalization residual prediction algorithm in described the second determining unit, vague generalization residual prediction flag position is not write in enhancement layer bitstream.
19. 1 kinds of decoding devices, is characterized in that, comprising:
The first determining unit, for determining the associated picture piece of enhancement layer image piece, described associated picture piece comprises basic tomographic image piece that enhancement layer image piece is corresponding or the decoded image blocks adjacent with described enhancement layer image piece;
Acquiring unit, for obtaining residual information corresponding to described enhancement layer image piece;
The second determining unit, be used for according to residual information corresponding to described associated picture piece, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, whether adopt vague generalization residual prediction algorithm, so that described enhancement layer image piece is carried out to described motion compensation to obtain the prediction signal of described enhancement layer image piece, and according to the prediction signal of described enhancement layer image piece, described enhancement layer image piece is decoded, wherein, whether residual information corresponding to described associated picture piece is used to indicate described associated picture piece the residual error size degree of residual error or described associated picture piece.
20. decoding devices according to claim 19, it is characterized in that, residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, at least one in the residual error non-zero transform coefficient that one or more transform blocks of the coded block flag of one or more transform blocks of described associated picture piece and described associated picture piece comprise.
21. decoding devices according to claim 20, is characterized in that, described the second determining unit specifically for:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece indicates described associated picture piece to have residual error, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block to comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is greater than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is greater than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, adopt described vague generalization residual prediction algorithm.
22. decoding devices according to claim 20, is characterized in that, described the second determining unit specifically for:
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of described associated picture piece, and when the coded block flag of described associated picture piece is indicated described associated picture piece without residual error, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the coded block flag of one or more transform blocks of described associated picture piece, and when the coded block flag of one or more transform blocks of described associated picture piece indicates corresponding transform block not comprise residual error non-zero transform coefficient, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm; Or,
In the time that residual information corresponding to described associated picture piece comprises the residual error non-zero transform coefficient that one or more transform blocks of described associated picture piece comprise, and when the number that the amplitude of the residual error non-zero transform coefficient of one or more transform blocks of described associated picture piece is less than the residual error non-zero transform coefficient of one or more transform blocks of first threshold and described associated picture piece is less than at least one in Second Threshold and is met, determine in the time that described enhancement layer image piece is carried out to the motion compensation in decoding and rebuilding operation, do not adopt described vague generalization residual prediction algorithm.
23. decoding devices according to claim 20, is characterized in that, described associated picture piece comprises the adjacent two or more decoded image blocks with described enhancement layer image piece.
24. according to claim 19 to the decoding device described in any one in 23, it is characterized in that, described decoding device also comprises resolution unit, while adopting described vague generalization residual prediction algorithm for determining in described the second determining unit, from enhancement layer bitstream, resolve vague generalization residual prediction flag position, to determine the pattern of described vague generalization residual prediction algorithm according to arranging of described vague generalization residual prediction flag position, determine while not adopting described vague generalization residual prediction algorithm in described the second determining unit, from enhancement layer bitstream, do not resolve vague generalization residual prediction flag position.
CN201310119503.6A 2013-04-08 2013-04-08 For layered video coding and the method for decoding, encoding apparatus and decoding apparatus Active CN104104956B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310119503.6A CN104104956B (en) 2013-04-08 2013-04-08 For layered video coding and the method for decoding, encoding apparatus and decoding apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310119503.6A CN104104956B (en) 2013-04-08 2013-04-08 For layered video coding and the method for decoding, encoding apparatus and decoding apparatus

Publications (2)

Publication Number Publication Date
CN104104956A true CN104104956A (en) 2014-10-15
CN104104956B CN104104956B (en) 2017-10-17

Family

ID=51672713

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310119503.6A Active CN104104956B (en) 2013-04-08 2013-04-08 For layered video coding and the method for decoding, encoding apparatus and decoding apparatus

Country Status (1)

Country Link
CN (1) CN104104956B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107371032A (en) * 2017-07-10 2017-11-21 上海国茂数字技术有限公司 A kind of multi-viewpoint three-dimensional video hierarchy encoding method and coding/decoding method
WO2021135856A1 (en) * 2019-12-31 2021-07-08 腾讯科技（深圳）有限公司 Video coding method and apparatus, video decoding method and apparatus, device, and storage medium
CN113395521A (en) * 2020-03-13 2021-09-14 华为技术有限公司 Image encoding and decoding method and device
WO2022141096A1 (en) * 2020-12-29 2022-07-07 华为技术有限公司 Wireless screen projection method and apparatus

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060083308A1 (en) * 2004-10-15 2006-04-20 Heiko Schwarz Apparatus and method for generating a coded video sequence and for decoding a coded video sequence by using an intermediate layer residual value prediction
CN101129072A (en) * 2005-01-12 2008-02-20 诺基亚公司 Method and system for inter-layer prediction mode coding in scalable video coding
CN102088605A (en) * 2011-02-23 2011-06-08 浙江大学 Rapid interlayer prediction selection method for scalable video coding

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060083308A1 (en) * 2004-10-15 2006-04-20 Heiko Schwarz Apparatus and method for generating a coded video sequence and for decoding a coded video sequence by using an intermediate layer residual value prediction
CN101129072A (en) * 2005-01-12 2008-02-20 诺基亚公司 Method and system for inter-layer prediction mode coding in scalable video coding
CN102088605A (en) * 2011-02-23 2011-06-08 浙江大学 Rapid interlayer prediction selection method for scalable video coding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
E.FRANCOIS: "exploration of generalized residual prediction in scalable HEVC", 《VISUAL COMMUNICATION AND IMAGE PROCESSING》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107371032A (en) * 2017-07-10 2017-11-21 上海国茂数字技术有限公司 A kind of multi-viewpoint three-dimensional video hierarchy encoding method and coding/decoding method
CN107371032B (en) * 2017-07-10 2019-11-22 上海国茂数字技术有限公司 A kind of multi-viewpoint three-dimensional video hierarchy encoding method and coding/decoding method
WO2021135856A1 (en) * 2019-12-31 2021-07-08 腾讯科技（深圳）有限公司 Video coding method and apparatus, video decoding method and apparatus, device, and storage medium
CN113395521A (en) * 2020-03-13 2021-09-14 华为技术有限公司 Image encoding and decoding method and device
WO2022141096A1 (en) * 2020-12-29 2022-07-07 华为技术有限公司 Wireless screen projection method and apparatus

Also Published As

Publication number Publication date
CN104104956B (en) 2017-10-17

Similar Documents

Publication Publication Date Title
JP7299221B2 (en) Method and apparatus for video encoding and decoding based on linear model according to neighboring samples
CN103220508B (en) Coding and decoding method and device
US20220038684A1 (en) Multi-reference line intra prediction and most probable mode
CN102857764A (en) Device and method for intra prediction mode processing
CN113557730A (en) Video encoding and decoding methods and apparatus for using sub-block based local illumination compensation
US20190238842A1 (en) Method and apparatus for extracting intra prediction mode information of square or rectangular block
WO2020180449A1 (en) Method and device for picture encoding and decoding
US20230254507A1 (en) Deep intra predictor generating side information
EP3706421A1 (en) Method and apparatus for video encoding and decoding based on affine motion compensation
JP7448558B2 (en) Methods and devices for image encoding and decoding
US20220264085A1 (en) Method and apparatus for video encoding and decoding with matrix based intra-prediction
JP2019521555A (en) Method and apparatus for decoding a block of intra-predicted pictures and corresponding coding method and apparatus
CN104104956A (en) Layered video encoding and decoding method, encoding device and decoding device
US20220256161A1 (en) Method and apparatus for video encoding and decoding with matrix based intra-prediction
RU2815092C2 (en) Wide-angle intra-frame prediction with subsections
KR101431463B1 (en) Apparatus for lossless video coding／decoding and method thereof
US20220398455A1 (en) Iterative training of neural networks for intra prediction
KR20230157975A (en) Motion flow coding for deep learning-based YUV video compression
JP2024510433A (en) Temporal structure-based conditional convolutional neural network for video compression
WO2020000487A1 (en) Transformation method, inverse transformation method and apparatus
WO2024064329A1 (en) Reinforcement learning-based rate control for end-to-end neural network bsed video compression
CN104093026A (en) Coding and decoding method and device
CN114586348A (en) Switchable interpolation filter
KR20120138430A (en) Apparatus and method of encoding and decoding for hierarchicalintra prediction

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant